[2025-10-14T17:00:01.617797] [INFO ] [MAIN ] Using last completed trading day: 2025-10-14 [2025-10-14T17:00:01.805616] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-14T17:00:01.805834] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-14T17:00:02.118964] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-14T17:00:02.119376] [WARN ] [STATE ] State set to: RUNNING [2025-10-14T17:00:02.119474] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-14T17:00:02.119547] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-14T17:00:02.119737] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-14T17:00:02.119792] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-14T17:00:03.633299] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-14T17:00:03.633446] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-14T17:00:03.633691] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-14T17:00:03.634235] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-14T17:00:03.634290] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-14T17:00:03.634322] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-14T17:00:03.634377] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-14T17:00:03.634408] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-14T17:00:03.634437] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-14T17:00:03.634851] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-14T17:00:03.634904] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-14T17:00:03.635060] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-14T17:00:03.635092] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-14T17:00:03.635121] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-14T17:00:03.635151] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-14T17:00:03.641504] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ENFY.csv (symbol ENFY no longer active). [2025-10-14T17:00:03.658854] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-14T17:00:03.665898] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/ENFY.csv (symbol ENFY no longer active). [2025-10-14T17:00:03.681884] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-10-14T17:00:03.681966] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-14T17:00:03.682000] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-14T17:00:03.682028] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-14T17:00:03.682084] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-14T17:00:03.682433] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-14T17:00:03.682467] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-14T17:00:03.682497] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-10-14T17:00:03.682525] [INFO ] [MAIN ] Running in parallel mode [2025-10-14T17:00:03.682709] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-10-14T17:00:04.278721] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:04.338779] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-14T17:00:04.363924] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-14T17:00:04.413073] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:04.449381] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:04.451384] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-14T17:00:04.445763] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-14T17:00:04.451154] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:04.451843] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-14T17:00:04.452191] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-14T17:00:04.452556] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-14T17:00:04.452084] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-14T17:00:04.453079] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-14T17:00:04.453003] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-14T17:00:04.453223] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-14T17:00:04.454151] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-14T17:00:04.454092] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-14T17:00:04.477923] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-14T17:00:04.488295] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-14T17:00:04.493743] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-14T17:00:04.488440] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-14T17:00:04.499068] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-14T17:00:05.402750] [DEBUG] [LOCAL ] AA: Loaded 53621 existing records from primary storage. [2025-10-14T17:00:05.456799] [INFO ] [MAIN ] AA: Loaded 53621 existing records. [2025-10-14T17:00:05.517447] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:05.557938] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-14T17:00:05.761124] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:05.817414] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:05.822105] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-14T17:00:05.823488] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-14T17:00:05.916943] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:05.917240] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-14T17:00:05.917294] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-14T17:00:05.917538] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-14T17:00:05.917600] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-14T17:00:06.085968] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-14T17:00:06.077490] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:00:06.097512] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-14T17:00:06.157696] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-14T17:00:06.158097] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:00:06.158184] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-14T17:00:06.158254] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:00:06.158333] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-14T17:00:06.158414] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-14T17:00:06.158528] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-14T17:00:06.193891] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-14T17:00:06.208562] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 39m 41s. Rate: 23.8 symbols/min [2025-10-14T17:00:06.442049] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:06.458881] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-14T17:00:06.495675] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T17:00:06.515419] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-14T17:00:06.514416] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:06.586867] [DEBUG] [LOCAL ] AAP: Loaded 51899 existing records from primary storage. [2025-10-14T17:00:06.587427] [INFO ] [MAIN ] AAP: Loaded 51899 existing records. [2025-10-14T17:00:06.790031] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:06.790354] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-14T17:00:06.790416] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-14T17:00:06.790742] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-14T17:00:06.790800] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-14T17:00:06.904038] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-14T17:00:06.915827] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-14T17:00:07.206274] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:07.206721] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-14T17:00:07.320308] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-14T17:00:07.321285] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-14T17:00:07.763116] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T17:00:07.764080] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-14T17:00:07.794897] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-14T17:00:07.804728] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-14T17:00:07.998164] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-14T17:00:07.999284] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-14T17:00:08.224017] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-14T17:00:08.225096] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-14T17:00:08.481441] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-14T17:00:08.482806] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-14T17:00:08.538211] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-14T17:00:08.548895] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-14T17:00:08.822098] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-14T17:00:08.823210] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-14T17:00:09.057433] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-14T17:00:09.058712] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-14T17:00:09.094848] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T17:00:09.133949] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-14T17:00:09.136406] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:00:09.148282] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-14T17:00:09.494923] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T17:00:09.495980] [INFO ] [REMOTE ] AAM: Full fetch complete (935 records). [2025-10-14T17:00:09.496096] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-14T17:00:09.496582] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:00:09.497068] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:00:09.497182] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:00:09.497273] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-14T17:00:09.497359] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-14T17:00:09.497403] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-14T17:00:09.497449] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-14T17:00:09.497547] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AAM took 5.8s. Estimated remaining: 1h 54m 42s. Rate: 20.6 symbols/min [2025-10-14T17:00:09.672159] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:09.672364] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-14T17:00:09.672404] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-14T17:00:09.672515] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-14T17:00:09.672557] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-14T17:00:09.672597] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-14T17:00:09.672629] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-14T17:00:10.022334] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:10.022754] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-14T17:00:10.711031] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-14T17:00:10.722883] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-14T17:00:10.791437] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T17:00:10.801399] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-14T17:00:10.874400] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T17:00:10.884917] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-14T17:00:10.907687] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T17:00:10.913522] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-14T17:00:12.651812] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-14T17:00:12.662476] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-14T17:00:12.704296] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T17:00:12.715748] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-14T17:00:12.762171] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T17:00:12.767925] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-14T17:00:13.080340] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-14T17:00:13.090153] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-14T17:00:13.539417] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T17:00:13.545176] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-14T17:00:14.572151] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:00:14.586420] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-14T17:00:14.832779] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T17:00:14.835061] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-14T17:00:14.864022] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-14T17:00:14.866062] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-14T17:00:14.887344] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T17:00:14.895314] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-14T17:00:16.063477] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T17:00:16.071093] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-14T17:00:16.161093] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T17:00:16.172336] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-14T17:00:16.952933] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T17:00:16.959690] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-14T17:00:16.992961] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-14T17:00:17.004124] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-14T17:00:17.096634] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-14T17:00:17.109681] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-14T17:00:17.412157] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T17:00:17.422552] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-14T17:00:18.188613] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T17:00:18.196781] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-14T17:00:18.816551] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T17:00:18.828059] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-14T17:00:18.858401] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T17:00:18.870233] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-14T17:00:18.977389] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T17:00:18.989767] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-14T17:00:19.123968] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T17:00:19.131384] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-14T17:00:20.449105] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T17:00:20.456695] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-14T17:00:20.503580] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T17:00:20.515308] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-14T17:00:20.690144] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T17:00:20.703440] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-14T17:00:20.772166] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T17:00:20.784515] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-14T17:00:21.557419] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T17:00:21.563809] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-14T17:00:22.242525] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T17:00:22.254141] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-14T17:00:22.304583] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:00:22.315740] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-14T17:00:22.385368] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T17:00:22.388562] [INFO ] [REMOTE ] AAT: Full fetch complete (42588 records). [2025-10-14T17:00:22.388639] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-14T17:00:22.389173] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:00:22.389255] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:00:22.389298] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:00:22.389337] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-14T17:00:22.389389] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-14T17:00:22.389424] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-10-14T17:00:22.389462] [DEBUG] [LOCAL ] AAT: No derivative data file found to delete. [2025-10-14T17:00:22.389515] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. AAT took 12.9s. Estimated remaining: 4h 5m 54s. Rate: 9.6 symbols/min [2025-10-14T17:00:22.568764] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:22.569049] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-14T17:00:22.569175] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-14T17:00:22.569327] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-14T17:00:22.569420] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-14T17:00:22.569493] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-14T17:00:22.569557] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-14T17:00:22.886394] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-14T17:00:22.976373] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:22.976899] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-14T17:00:22.977337] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-14T17:00:23.144925] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:00:23.145223] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-14T17:00:23.145323] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:00:23.145377] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-14T17:00:23.145437] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:00:23.145507] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-14T17:00:23.145570] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-14T17:00:23.145605] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-14T17:00:23.145676] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-14T17:00:23.145747] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 11m 48s. Rate: 12.3 symbols/min [2025-10-14T17:00:23.322487] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:23.348559] [DEBUG] [LOCAL ] AB: Loaded 25789 existing records from primary storage. [2025-10-14T17:00:23.348846] [INFO ] [MAIN ] AB: Loaded 25789 existing records. [2025-10-14T17:00:23.555905] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:23.556167] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-14T17:00:23.556224] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-14T17:00:23.556912] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-14T17:00:23.556972] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-14T17:00:24.019619] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:24.020609] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-14T17:00:24.091113] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T17:00:24.108324] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-14T17:00:24.116699] [INFO ] [REMOTE ] A: Full fetch complete (73350 records). [2025-10-14T17:00:24.116900] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-14T17:00:24.117691] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-14T17:00:24.753304] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-14T17:00:24.753433] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-14T17:00:24.754333] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-14T17:00:24.754412] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-14T17:00:24.756303] [DEBUG] [LOCAL ] A: Trimmed 73350 records to 50803 (keeping 200 days of data) [2025-10-14T17:00:25.086071] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T17:00:25.136202] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-14T17:00:25.183203] [DEBUG] [LOCAL ] A: Primary data saved (50803 records). [2025-10-14T17:00:25.183343] [INFO ] [MAIN ] A: Full history saved. [2025-10-14T17:00:25.183593] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. A took 21.5s. Estimated remaining: 2h 49m 26s. Rate: 14.0 symbols/min [2025-10-14T17:00:25.387021] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:25.437848] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T17:00:25.445738] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-14T17:00:25.466250] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-10-14T17:00:25.466604] [INFO ] [MAIN ] ABBV: Loaded 53686 existing records. [2025-10-14T17:00:25.700548] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:25.700902] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-14T17:00:25.700965] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-14T17:00:25.701197] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-14T17:00:25.701253] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-14T17:00:26.066444] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:26.066842] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-14T17:00:26.099232] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T17:00:26.111722] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-14T17:00:26.788521] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T17:00:26.796107] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-14T17:00:26.841602] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T17:00:26.852944] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-14T17:00:27.836891] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T17:00:27.846622] [INFO ] [REMOTE ] AAP: Full fetch complete (75202 records). [2025-10-14T17:00:27.846958] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-14T17:00:28.282212] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-14T17:00:28.282667] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-14T17:00:28.283801] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-14T17:00:28.313127] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-14T17:00:28.318526] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T17:00:28.362201] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-14T17:00:28.366624] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-14T17:00:28.367104] [DEBUG] [LOCAL ] AAP: Trimmed 75202 records to 51878 (keeping 200 days of data) [2025-10-14T17:00:28.382087] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-14T17:00:28.588256] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T17:00:28.626808] [INFO ] [REMOTE ] AA: Full fetch complete (77710 records). [2025-10-14T17:00:28.639820] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-14T17:00:28.942482] [DEBUG] [LOCAL ] AAP: Primary data saved (51878 records). [2025-10-14T17:00:29.018911] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-14T17:00:29.036441] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAP took 22.8s. Estimated remaining: 2h 46m 25s. Rate: 14.2 symbols/min [2025-10-14T17:00:29.285930] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-14T17:00:29.291183] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-14T17:00:29.312026] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-14T17:00:29.326628] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-14T17:00:29.347794] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:29.349414] [DEBUG] [LOCAL ] AA: Trimmed 77710 records to 53621 (keeping 200 days of data) [2025-10-14T17:00:29.614892] [DEBUG] [LOCAL ] ABCB: Loaded 30598 existing records from primary storage. [2025-10-14T17:00:29.621849] [INFO ] [MAIN ] ABCB: Loaded 30598 existing records. [2025-10-14T17:00:29.878089] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:29.879414] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-14T17:00:29.879494] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-14T17:00:29.880984] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-14T17:00:29.883893] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-14T17:00:29.998015] [DEBUG] [LOCAL ] AA: Primary data saved (53621 records). [2025-10-14T17:00:29.998272] [INFO ] [MAIN ] AA: Full history saved. [2025-10-14T17:00:29.998888] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AA took 26.3s. Estimated remaining: 2h 27m 60s. Rate: 16.0 symbols/min [2025-10-14T17:00:30.399145] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:30.428739] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T17:00:30.494164] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-14T17:00:30.498538] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:30.500006] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-14T17:00:30.534355] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-14T17:00:30.546611] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-14T17:00:30.586628] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-14T17:00:30.586983] [INFO ] [MAIN ] ABEV: Loaded 53279 existing records. [2025-10-14T17:00:30.763134] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:30.763335] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-14T17:00:30.763386] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-14T17:00:30.763707] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-14T17:00:30.763807] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-14T17:00:31.116463] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:31.116795] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-14T17:00:32.067874] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T17:00:32.073930] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-14T17:00:32.113844] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T17:00:32.122152] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-14T17:00:32.490988] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-14T17:00:32.501500] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-14T17:00:33.166844] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-14T17:00:33.177848] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-14T17:00:33.238077] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T17:00:33.249407] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-14T17:00:33.267310] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T17:00:33.273914] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-14T17:00:34.217939] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T17:00:34.223243] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-14T17:00:34.254737] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T17:00:34.266511] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-14T17:00:34.304316] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T17:00:34.310564] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-14T17:00:34.863007] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T17:00:34.873920] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-14T17:00:35.550934] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T17:00:35.560037] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-14T17:00:35.700475] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T17:00:35.710297] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-14T17:00:36.124765] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:00:36.136181] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-14T17:00:36.210953] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T17:00:36.221024] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-14T17:00:36.261236] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T17:00:36.266580] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-14T17:00:36.919953] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T17:00:36.928215] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-14T17:00:37.368130] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T17:00:37.373718] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-14T17:00:37.665407] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:00:37.676531] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-14T17:00:37.841702] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T17:00:37.847801] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-14T17:00:37.921487] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T17:00:37.932968] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-14T17:00:38.183219] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T17:00:38.186473] [INFO ] [REMOTE ] AB: Full fetch complete (44609 records). [2025-10-14T17:00:38.186551] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-14T17:00:38.592823] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-14T17:00:38.592955] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-14T17:00:38.593400] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-14T17:00:38.593468] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-14T17:00:38.594748] [DEBUG] [LOCAL ] AB: Trimmed 44609 records to 25669 (keeping 200 days of data) [2025-10-14T17:00:38.709180] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T17:00:38.717361] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-14T17:00:38.767036] [DEBUG] [LOCAL ] AB: Primary data saved (25669 records). [2025-10-14T17:00:38.767157] [INFO ] [MAIN ] AB: Full history saved. [2025-10-14T17:00:38.767235] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AB took 15.6s. Estimated remaining: 2h 52m 34s. Rate: 13.7 symbols/min [2025-10-14T17:00:38.935626] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:38.952422] [DEBUG] [LOCAL ] ABG: Loaded 18555 existing records from primary storage. [2025-10-14T17:00:38.952677] [INFO ] [MAIN ] ABG: Loaded 18555 existing records. [2025-10-14T17:00:39.131399] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:39.131919] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-14T17:00:39.132045] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-14T17:00:39.132574] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-14T17:00:39.132760] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-14T17:00:39.534500] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:39.537899] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-14T17:00:39.537337] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:00:39.553168] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-14T17:00:39.610125] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T17:00:39.622402] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-14T17:00:40.020009] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:00:40.027181] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-14T17:00:40.697969] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:00:40.701258] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-14T17:00:41.361886] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T17:00:41.385041] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-14T17:00:41.390789] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T17:00:41.403319] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-14T17:00:41.462942] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T17:00:41.475305] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-14T17:00:41.713315] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T17:00:41.718593] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-14T17:00:42.742931] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T17:00:42.746807] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-14T17:00:42.830272] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:00:42.837699] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-14T17:00:42.927086] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:00:42.937638] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-14T17:00:43.027910] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T17:00:43.039053] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-14T17:00:43.800462] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T17:00:43.805206] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-14T17:00:43.871757] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T17:00:43.875600] [INFO ] [REMOTE ] ABCB: Full fetch complete (44726 records). [2025-10-14T17:00:43.875713] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-14T17:00:44.260342] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-14T17:00:44.260435] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-14T17:00:44.260969] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-14T17:00:44.261050] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-14T17:00:44.262255] [DEBUG] [LOCAL ] ABCB: Trimmed 44726 records to 30529 (keeping 200 days of data) [2025-10-14T17:00:44.451915] [DEBUG] [LOCAL ] ABCB: Primary data saved (30529 records). [2025-10-14T17:00:44.452067] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-14T17:00:44.452148] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. ABCB took 15.4s. Estimated remaining: 2h 58m 11s. Rate: 13.2 symbols/min [2025-10-14T17:00:44.630555] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:44.661342] [DEBUG] [LOCAL ] ABM: Loaded 32067 existing records from primary storage. [2025-10-14T17:00:44.661629] [INFO ] [MAIN ] ABM: Loaded 32067 existing records. [2025-10-14T17:00:44.852806] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:44.853515] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-14T17:00:44.853878] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-14T17:00:44.854400] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-14T17:00:44.854675] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-14T17:00:44.968219] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T17:00:45.023260] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-14T17:00:45.250713] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T17:00:45.273703] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-14T17:00:45.308784] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-14T17:00:45.338111] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:45.351488] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-14T17:00:45.353017] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-14T17:00:46.190753] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T17:00:46.199277] [INFO ] [REMOTE ] ABBV: Full fetch complete (77453 records). [2025-10-14T17:00:46.199405] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-14T17:00:46.200110] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:00:46.200197] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:00:46.200240] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:00:46.200278] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-14T17:00:46.200336] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-14T17:00:46.200371] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-14T17:00:46.200615] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-14T17:00:46.200736] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABBV took 21.0s. Estimated remaining: 2h 47m 10s. Rate: 14.1 symbols/min [2025-10-14T17:00:46.381228] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:46.391850] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T17:00:46.396453] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-14T17:00:46.417255] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T17:00:46.423582] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-14T17:00:46.464541] [DEBUG] [LOCAL ] ABR: Loaded 51970 existing records from primary storage. [2025-10-14T17:00:46.464915] [INFO ] [MAIN ] ABR: Loaded 51970 existing records. [2025-10-14T17:00:46.646540] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:46.646873] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-14T17:00:46.646973] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-14T17:00:46.647299] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-14T17:00:46.647356] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-14T17:00:47.040296] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:47.042166] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-14T17:00:47.041000] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-14T17:00:47.054611] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-14T17:00:47.125383] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T17:00:47.129214] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-14T17:00:47.230392] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T17:00:47.236166] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-14T17:00:48.170778] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T17:00:48.175614] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-14T17:00:48.248052] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T17:00:48.253865] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-14T17:00:48.387167] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T17:00:48.398685] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-14T17:00:48.766801] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:00:48.778358] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-14T17:00:49.310955] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T17:00:49.316542] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-14T17:00:49.370214] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T17:00:49.378581] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-14T17:00:49.859406] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T17:00:49.869205] [INFO ] [REMOTE ] ABEV: Full fetch complete (77353 records). [2025-10-14T17:00:49.869454] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-14T17:00:50.181116] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T17:00:50.220484] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-14T17:00:50.317668] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-14T17:00:50.317965] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-14T17:00:50.318785] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-14T17:00:50.318870] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-14T17:00:50.337740] [DEBUG] [LOCAL ] ABEV: Trimmed 77353 records to 53279 (keeping 200 days of data) [2025-10-14T17:00:50.353604] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T17:00:50.425008] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-14T17:00:50.597302] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T17:00:50.617202] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-14T17:00:50.717512] [DEBUG] [LOCAL ] ABEV: Primary data saved (53279 records). [2025-10-14T17:00:50.717699] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-14T17:00:50.719867] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABEV took 20.7s. Estimated remaining: 2h 48m 3s. Rate: 14.0 symbols/min [2025-10-14T17:00:50.896521] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:50.896742] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-14T17:00:50.896789] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-14T17:00:50.896901] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-14T17:00:50.896942] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-14T17:00:50.896982] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-14T17:00:50.897014] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-14T17:00:51.256952] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:51.257296] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-14T17:00:51.284994] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T17:00:51.287675] [INFO ] [REMOTE ] ABG: Full fetch complete (26548 records). [2025-10-14T17:00:51.287765] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-14T17:00:51.288353] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:00:51.288442] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:00:51.288486] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:00:51.288561] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-14T17:00:51.288633] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-14T17:00:51.288716] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-14T17:00:51.289036] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-14T17:00:51.289143] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 12.5s. Estimated remaining: 2h 35m 51s. Rate: 15.1 symbols/min [2025-10-14T17:00:51.473845] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:51.495138] [DEBUG] [LOCAL ] ACA: Loaded 23039 existing records from primary storage. [2025-10-14T17:00:51.495411] [INFO ] [MAIN ] ACA: Loaded 23039 existing records. [2025-10-14T17:00:51.676617] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:00:51.676920] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-14T17:00:51.676986] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-14T17:00:51.692117] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-14T17:00:51.692247] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-14T17:00:51.725434] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T17:00:51.770105] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-14T17:00:52.084453] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:52.084960] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-14T17:00:52.117118] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T17:00:52.128404] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-14T17:00:53.044240] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T17:00:53.048790] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-14T17:00:53.134847] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T17:00:53.142319] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-14T17:00:53.403443] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-14T17:00:53.414172] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-14T17:00:53.834419] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T17:00:53.845758] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-14T17:00:53.860734] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T17:00:53.865954] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-14T17:00:54.216521] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T17:00:54.224288] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-14T17:00:54.802753] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:00:54.813344] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-14T17:00:54.976111] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T17:00:54.981167] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-14T17:00:55.588880] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T17:00:55.599536] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-14T17:00:55.701057] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:00:55.712385] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-14T17:00:56.317600] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T17:00:56.325314] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-14T17:00:56.427007] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T17:00:56.437054] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-14T17:00:57.020931] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T17:00:57.030476] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-14T17:00:57.289820] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T17:00:57.301863] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-14T17:00:57.656844] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T17:00:57.663489] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-14T17:00:58.023339] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T17:00:58.043705] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T17:00:58.047301] [INFO ] [REMOTE ] ABM: Full fetch complete (44873 records). [2025-10-14T17:00:58.047386] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-14T17:00:58.363370] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-14T17:00:58.437574] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-14T17:00:58.437773] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-14T17:00:58.438489] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-14T17:00:58.438582] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-14T17:00:58.440408] [DEBUG] [LOCAL ] ABM: Trimmed 44873 records to 32100 (keeping 200 days of data) [2025-10-14T17:00:58.571935] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T17:00:58.698815] [DEBUG] [LOCAL ] ABM: Primary data saved (32100 records). [2025-10-14T17:00:58.699065] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-14T17:00:58.699198] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABM took 14.2s. Estimated remaining: 2h 46m 11s. Rate: 14.2 symbols/min [2025-10-14T17:00:58.900503] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:00:58.900936] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-14T17:00:58.901009] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-14T17:00:58.901217] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-14T17:00:58.901291] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-14T17:00:58.901608] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-14T17:00:58.901715] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-14T17:00:59.163731] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-14T17:00:59.171474] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T17:00:59.358340] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:00:59.958042] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-14T17:01:00.124582] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T17:01:00.345910] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T17:01:00.758078] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-14T17:01:01.558090] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-14T17:01:01.846577] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T17:01:01.929724] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T17:01:02.358140] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-14T17:01:02.841363] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T17:01:03.158090] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-14T17:01:03.958117] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-14T17:01:04.161337] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:01:04.758055] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-14T17:01:05.033809] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T17:01:05.247515] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-14T17:01:05.558074] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-14T17:01:06.013446] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T17:01:06.358070] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-14T17:01:06.806903] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:01:07.158065] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-14T17:01:07.438812] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T17:01:07.958119] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-14T17:01:08.534906] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T17:01:08.758118] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-14T17:01:09.472465] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T17:01:09.558068] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-14T17:01:10.358042] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-14T17:01:10.399725] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T17:01:11.158073] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-14T17:01:11.653803] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-14T17:01:11.671364] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T17:01:11.674578] [INFO ] [REMOTE ] ACA: Full fetch complete (34130 records). [2025-10-14T17:01:11.674725] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-14T17:01:11.958976] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-14T17:01:12.048987] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-14T17:01:12.049067] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-14T17:01:12.049516] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-14T17:01:12.049579] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-14T17:01:12.050504] [DEBUG] [LOCAL ] ACA: Trimmed 34130 records to 22976 (keeping 200 days of data) [2025-10-14T17:01:12.185922] [DEBUG] [LOCAL ] ACA: Primary data saved (22976 records). [2025-10-14T17:01:12.186070] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-14T17:01:12.186162] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ACA took 20.9s. Estimated remaining: 3h 12m 3s. Rate: 12.3 symbols/min [2025-10-14T17:01:12.364133] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:12.364323] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-14T17:01:12.364365] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-14T17:01:12.364479] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-14T17:01:12.364560] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-14T17:01:12.364613] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-14T17:01:12.364672] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-14T17:01:12.738058] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:12.759280] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-14T17:01:12.761975] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T17:01:13.499107] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T17:01:13.505172] [INFO ] [REMOTE ] ABR: Full fetch complete (75355 records). [2025-10-14T17:01:13.505337] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-14T17:01:13.571229] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-14T17:01:13.919692] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-14T17:01:13.919960] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-14T17:01:13.920948] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-14T17:01:13.921042] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-14T17:01:13.922523] [DEBUG] [LOCAL ] ABR: Trimmed 75355 records to 51964 (keeping 200 days of data) [2025-10-14T17:01:14.049502] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T17:01:14.259036] [DEBUG] [LOCAL ] ABR: Primary data saved (51964 records). [2025-10-14T17:01:14.259184] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-14T17:01:14.259267] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ABR took 28.1s. Estimated remaining: 3h 4m 36s. Rate: 12.8 symbols/min [2025-10-14T17:01:14.363547] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-14T17:01:14.436014] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:14.490188] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-14T17:01:14.490556] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-14T17:01:14.709191] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:01:14.709429] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-14T17:01:14.709494] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-14T17:01:14.709751] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-14T17:01:14.709818] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-14T17:01:15.092756] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:15.163198] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-14T17:01:15.175384] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T17:01:15.958089] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-14T17:01:16.219393] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T17:01:16.758101] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-14T17:01:17.009841] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T17:01:17.558096] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-14T17:01:17.837601] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T17:01:18.167616] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.00 seconds). [2025-10-14T17:01:18.358055] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-14T17:01:19.158084] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-14T17:01:19.416887] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T17:01:19.958067] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-14T17:01:20.575095] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T17:01:20.642916] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T17:01:20.648947] [INFO ] [REMOTE ] ABT: Full fetch complete (77372 records). [2025-10-14T17:01:20.649079] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-14T17:01:20.651262] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:01:20.651365] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:01:20.651429] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:01:20.651481] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-14T17:01:20.651565] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-14T17:01:20.651678] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-14T17:01:20.651778] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-10-14T17:01:20.651885] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ABT took 29.9s. Estimated remaining: 3h 8m 39s. Rate: 12.5 symbols/min [2025-10-14T17:01:20.758289] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-14T17:01:20.840118] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:20.895437] [DEBUG] [LOCAL ] ACI: Loaded 53274 existing records from primary storage. [2025-10-14T17:01:20.895904] [INFO ] [MAIN ] ACI: Loaded 53274 existing records. [2025-10-14T17:01:21.111790] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-14T17:01:21.110299] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:01:21.112104] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-14T17:01:21.122334] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-14T17:01:21.123266] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-14T17:01:21.123343] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-14T17:01:21.490558] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:21.558079] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-14T17:01:22.005696] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:01:22.358059] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-14T17:01:22.746946] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T17:01:23.158079] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-14T17:01:23.958071] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-14T17:01:24.492766] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:01:24.601500] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-14T17:01:24.758068] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-14T17:01:25.558072] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-14T17:01:25.792423] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T17:01:25.865631] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T17:01:26.358091] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-14T17:01:27.158081] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-14T17:01:27.958070] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-14T17:01:28.204992] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T17:01:28.623619] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-10-14T17:01:28.758034] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-14T17:01:29.178319] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T17:01:29.241098] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-14T17:01:29.558116] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-14T17:01:30.358086] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-14T17:01:31.158113] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-14T17:01:31.612565] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-14T17:01:31.774409] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-14T17:01:31.835098] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T17:01:31.958096] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-14T17:01:32.550018] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T17:01:32.553941] [INFO ] [REMOTE ] ACCO: Full fetch complete (53833 records). [2025-10-14T17:01:32.554092] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-14T17:01:32.554885] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:01:32.554986] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:01:32.555055] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:01:32.555127] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-14T17:01:32.555194] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-14T17:01:32.555230] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-14T17:01:32.555271] [DEBUG] [LOCAL ] ACCO: No derivative data file found to delete. [2025-10-14T17:01:32.555357] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 33.9s. Estimated remaining: 3h 24m 56s. Rate: 11.5 symbols/min [2025-10-14T17:01:32.728452] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:32.766249] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-14T17:01:32.769627] [DEBUG] [LOCAL ] ACM: Loaded 43041 existing records from primary storage. [2025-10-14T17:01:32.769930] [INFO ] [MAIN ] ACM: Loaded 43041 existing records. [2025-10-14T17:01:32.959124] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:01:32.959978] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-14T17:01:32.960040] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-14T17:01:32.960788] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-14T17:01:32.960917] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-14T17:01:33.312550] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:33.558069] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-14T17:01:34.364544] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-14T17:01:34.370666] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T17:01:34.450023] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-14T17:01:34.832770] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T17:01:35.158088] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-14T17:01:35.734479] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T17:01:35.958069] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-14T17:01:36.758106] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-14T17:01:36.817688] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T17:01:36.941920] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T17:01:37.558064] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-14T17:01:38.196926] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T17:01:38.358057] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-14T17:01:38.706133] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T17:01:39.158079] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-14T17:01:39.958067] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-14T17:01:40.758050] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-14T17:01:40.888696] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T17:01:41.032298] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-14T17:01:41.563166] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-14T17:01:41.583327] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T17:01:41.894258] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T17:01:41.897187] [INFO ] [REMOTE ] ACEL: Full fetch complete (38648 records). [2025-10-14T17:01:41.897286] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-14T17:01:41.897782] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:01:41.897897] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:01:41.897941] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:01:41.898005] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-14T17:01:41.898067] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-14T17:01:41.898102] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-14T17:01:41.898141] [DEBUG] [LOCAL ] ACEL: No derivative data file found to delete. [2025-10-14T17:01:41.898216] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACEL took 29.7s. Estimated remaining: 3h 33m 48s. Rate: 11.0 symbols/min [2025-10-14T17:01:42.071257] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:42.120587] [DEBUG] [LOCAL ] ACN: Loaded 53429 existing records from primary storage. [2025-10-14T17:01:42.120957] [INFO ] [MAIN ] ACN: Loaded 53429 existing records. [2025-10-14T17:01:42.296170] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:01:42.296415] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-14T17:01:42.296467] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-14T17:01:42.296706] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-14T17:01:42.296761] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-14T17:01:42.363297] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-14T17:01:42.658561] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:43.158048] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-14T17:01:43.479048] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T17:01:43.958128] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-14T17:01:44.758093] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-14T17:01:44.980763] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T17:01:45.067362] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-14T17:01:45.558052] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-14T17:01:45.640489] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T17:01:46.035714] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T17:01:46.358049] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-14T17:01:47.158067] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-14T17:01:47.840334] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T17:01:47.963506] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-14T17:01:47.977150] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-14T17:01:48.758082] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-14T17:01:48.978735] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T17:01:49.472909] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T17:01:49.558065] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-14T17:01:50.358106] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-14T17:01:51.081420] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:01:51.158031] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-14T17:01:51.460393] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-14T17:01:51.958082] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-14T17:01:52.023360] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T17:01:52.435876] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T17:01:52.758106] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-14T17:01:53.558087] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-14T17:01:53.720946] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T17:01:54.358104] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-14T17:01:55.033438] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T17:01:55.141502] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-14T17:01:55.146881] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-14T17:01:55.147014] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-14T17:01:55.147736] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:01:55.147874] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:01:55.147927] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:01:55.147968] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-14T17:01:55.148023] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-14T17:01:55.148056] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-14T17:01:55.148305] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-14T17:01:55.148394] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACHR took 40.9s. Estimated remaining: 3h 49m 47s. Rate: 10.2 symbols/min [2025-10-14T17:01:55.163243] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-14T17:01:55.316956] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:55.345243] [DEBUG] [LOCAL ] ACP: Loaded 30940 existing records from primary storage. [2025-10-14T17:01:55.345524] [INFO ] [MAIN ] ACP: Loaded 30940 existing records. [2025-10-14T17:01:55.521255] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:01:55.521479] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-14T17:01:55.521529] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-14T17:01:55.521842] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-14T17:01:55.521902] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-14T17:01:55.876799] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:55.960037] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-14T17:01:55.962721] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T17:01:56.758068] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-14T17:01:56.941263] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T17:01:57.558094] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-14T17:01:57.705639] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T17:01:57.711597] [INFO ] [REMOTE ] ACI: Full fetch complete (77220 records). [2025-10-14T17:01:57.711774] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-14T17:01:58.100276] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-14T17:01:58.100464] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-14T17:01:58.101308] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-14T17:01:58.101387] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-14T17:01:58.103125] [DEBUG] [LOCAL ] ACI: Trimmed 77220 records to 53280 (keeping 200 days of data) [2025-10-14T17:01:58.232759] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T17:01:58.363467] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-14T17:01:58.473062] [DEBUG] [LOCAL ] ACI: Primary data saved (53280 records). [2025-10-14T17:01:58.473193] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-14T17:01:58.474106] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACI took 37.8s. Estimated remaining: 3h 44m 42s. Rate: 10.5 symbols/min [2025-10-14T17:01:58.641699] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:01:58.641871] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-14T17:01:58.641909] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-14T17:01:58.642039] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-14T17:01:58.642080] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-14T17:01:58.642122] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-14T17:01:58.642153] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-14T17:01:58.994098] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:01:59.158083] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-14T17:01:59.515074] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T17:01:59.547353] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T17:01:59.679857] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-14T17:01:59.958073] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-14T17:02:00.758070] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-14T17:02:01.395580] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T17:02:01.558050] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-14T17:02:02.036043] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-14T17:02:02.358137] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-14T17:02:03.114257] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T17:02:03.158102] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-14T17:02:03.203342] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T17:02:03.958082] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-14T17:02:04.585852] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:02:04.758077] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-14T17:02:05.351313] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T17:02:05.558042] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-14T17:02:05.640882] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T17:02:05.646683] [INFO ] [REMOTE ] ACM: Full fetch complete (62966 records). [2025-10-14T17:02:05.646862] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-14T17:02:06.066266] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-14T17:02:06.066343] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-14T17:02:06.066952] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-14T17:02:06.067015] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-14T17:02:06.068386] [DEBUG] [LOCAL ] ACM: Trimmed 62966 records to 43037 (keeping 200 days of data) [2025-10-14T17:02:06.331439] [DEBUG] [LOCAL ] ACM: Primary data saved (43037 records). [2025-10-14T17:02:06.331563] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-14T17:02:06.332635] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACM took 33.8s. Estimated remaining: 3h 48m 33s. Rate: 10.3 symbols/min [2025-10-14T17:02:06.363262] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-14T17:02:06.510276] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:06.544339] [DEBUG] [LOCAL ] ACRE: Loaded 33602 existing records from primary storage. [2025-10-14T17:02:06.544631] [INFO ] [MAIN ] ACRE: Loaded 33602 existing records. [2025-10-14T17:02:06.726536] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:02:06.726953] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-14T17:02:06.733266] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-14T17:02:06.744284] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-14T17:02:06.744738] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-14T17:02:06.745305] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T17:02:07.045891] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T17:02:07.126049] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:07.158093] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-14T17:02:07.958124] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-14T17:02:08.415912] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T17:02:08.430351] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-14T17:02:08.758097] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-14T17:02:09.558083] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-14T17:02:10.358158] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-14T17:02:10.686111] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T17:02:10.982832] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T17:02:11.125299] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T17:02:11.158104] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-14T17:02:11.958095] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-14T17:02:12.758113] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-14T17:02:13.328165] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T17:02:13.388197] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T17:02:13.389880] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-14T17:02:13.558078] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-14T17:02:14.358115] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-14T17:02:15.158080] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-14T17:02:15.626882] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-14T17:02:15.779659] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T17:02:15.876224] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:02:15.958120] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-14T17:02:16.758065] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-14T17:02:17.307897] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T17:02:17.558064] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-14T17:02:17.986789] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T17:02:18.177042] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T17:02:18.358051] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-14T17:02:18.948909] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T17:02:18.949889] [INFO ] [REMOTE ] ACR: Full fetch complete (8527 records). [2025-10-14T17:02:18.949956] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-14T17:02:19.163185] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-14T17:02:19.322455] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-14T17:02:19.322540] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-14T17:02:19.322780] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-14T17:02:19.322842] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-14T17:02:19.323296] [DEBUG] [LOCAL ] ACR: Trimmed 8527 records to 5471 (keeping 200 days of data) [2025-10-14T17:02:19.356880] [DEBUG] [LOCAL ] ACR: Primary data saved (5471 records). [2025-10-14T17:02:19.357040] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-14T17:02:19.357117] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACR took 20.9s. Estimated remaining: 4h 1m 14s. Rate: 9.7 symbols/min [2025-10-14T17:02:19.532402] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:19.544081] [DEBUG] [LOCAL ] ACV: Loaded 7678 existing records from primary storage. [2025-10-14T17:02:19.544344] [INFO ] [MAIN ] ACV: Loaded 7678 existing records. [2025-10-14T17:02:19.736166] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:02:19.736404] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-14T17:02:19.736451] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-14T17:02:19.736618] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-14T17:02:19.736711] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-14T17:02:19.963144] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-14T17:02:20.098101] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:20.758037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-14T17:02:20.779021] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T17:02:21.453883] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T17:02:21.558044] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-14T17:02:22.079031] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-14T17:02:22.358061] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-14T17:02:22.860311] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:02:23.158089] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-14T17:02:23.573085] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T17:02:23.958067] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-14T17:02:24.392180] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-14T17:02:24.400494] [INFO ] [REMOTE ] ACN: Full fetch complete (76928 records). [2025-10-14T17:02:24.400725] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-14T17:02:24.401709] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:02:24.401813] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:02:24.401864] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:02:24.401912] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-14T17:02:24.401980] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-14T17:02:24.402023] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-14T17:02:24.402295] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-14T17:02:24.403430] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACN took 42.5s. Estimated remaining: 3h 59m 14s. Rate: 9.8 symbols/min [2025-10-14T17:02:24.581096] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:24.636524] [DEBUG] [LOCAL ] ACVA: Loaded 49302 existing records from primary storage. [2025-10-14T17:02:24.636874] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T17:02:24.640339] [INFO ] [MAIN ] ACVA: Loaded 49302 existing records. [2025-10-14T17:02:24.763169] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-14T17:02:24.831256] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:02:24.831506] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-14T17:02:24.831556] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-14T17:02:24.832378] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-14T17:02:24.832436] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-14T17:02:25.204701] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:25.558075] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-14T17:02:26.194451] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T17:02:26.358072] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-14T17:02:26.948199] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T17:02:27.158043] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-14T17:02:27.412540] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T17:02:27.958072] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-14T17:02:28.509025] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T17:02:28.514698] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-14T17:02:28.758061] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-14T17:02:29.558068] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-14T17:02:30.337797] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T17:02:30.358044] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-14T17:02:30.496724] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T17:02:30.816942] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T17:02:31.158074] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-14T17:02:31.958120] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-14T17:02:32.758054] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-14T17:02:32.978786] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T17:02:32.982578] [INFO ] [REMOTE ] ACP: Full fetch complete (46601 records). [2025-10-14T17:02:32.982694] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-14T17:02:33.295126] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T17:02:33.404491] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-14T17:02:33.404578] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-14T17:02:33.405088] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-14T17:02:33.405152] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-14T17:02:33.406213] [DEBUG] [LOCAL ] ACP: Trimmed 46601 records to 30979 (keeping 200 days of data) [2025-10-14T17:02:33.579055] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-14T17:02:33.609792] [DEBUG] [LOCAL ] ACP: Primary data saved (30979 records). [2025-10-14T17:02:33.609947] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-14T17:02:33.610046] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACP took 38.5s. Estimated remaining: 4h 4m 9s. Rate: 9.6 symbols/min [2025-10-14T17:02:33.788342] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:33.788524] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-14T17:02:33.788580] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-14T17:02:33.788720] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-14T17:02:33.788777] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-14T17:02:33.788848] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-14T17:02:33.788885] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-14T17:02:34.160112] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:34.183602] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T17:02:34.358066] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-14T17:02:35.038552] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T17:02:35.158062] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-14T17:02:35.559933] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T17:02:35.958073] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-14T17:02:36.086276] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T17:02:36.508424] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T17:02:36.758071] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-14T17:02:37.357368] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T17:02:37.558120] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-14T17:02:38.358075] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-14T17:02:38.852762] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T17:02:39.158233] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-14T17:02:39.362458] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:02:39.362823] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-14T17:02:39.362906] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:02:39.362955] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-14T17:02:39.362987] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:02:39.363021] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-14T17:02:39.363073] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-14T17:02:39.363114] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-14T17:02:39.363153] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-14T17:02:39.363204] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. AD took 5.8s. Estimated remaining: 4h 3m 17s. Rate: 9.6 symbols/min [2025-10-14T17:02:39.531251] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:39.531451] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-14T17:02:39.531504] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-14T17:02:39.531614] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-14T17:02:39.531684] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-14T17:02:39.531770] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-14T17:02:39.531803] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-14T17:02:39.895330] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:39.924612] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T17:02:39.958034] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-14T17:02:40.758069] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-14T17:02:41.558064] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-14T17:02:41.650528] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T17:02:42.069043] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T17:02:42.077551] [INFO ] [REMOTE ] ACRE: Full fetch complete (49744 records). [2025-10-14T17:02:42.078362] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-14T17:02:42.078455] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-14T17:02:42.081028] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:02:42.081457] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:02:42.081533] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:02:42.081608] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-14T17:02:42.081723] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-14T17:02:42.081794] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-10-14T17:02:42.082025] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-10-14T17:02:42.083266] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACRE took 35.8s. Estimated remaining: 3h 57m 54s. Rate: 9.8 symbols/min [2025-10-14T17:02:42.282661] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:42.322375] [DEBUG] [LOCAL ] ADCT: Loaded 35218 existing records from primary storage. [2025-10-14T17:02:42.322701] [INFO ] [MAIN ] ADCT: Loaded 35218 existing records. [2025-10-14T17:02:42.363255] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-14T17:02:42.514013] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:02:42.514219] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-14T17:02:42.514270] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-14T17:02:42.514944] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-14T17:02:42.515003] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-14T17:02:42.866987] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:43.158108] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-14T17:02:43.772329] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T17:02:43.958051] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-14T17:02:43.977517] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T17:02:44.758085] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-14T17:02:45.439404] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T17:02:45.486404] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T17:02:45.488400] [INFO ] [REMOTE ] ACV: Full fetch complete (10371 records). [2025-10-14T17:02:45.488490] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-14T17:02:45.563532] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-14T17:02:45.900527] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-14T17:02:45.900627] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-14T17:02:45.900942] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-14T17:02:45.900995] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-14T17:02:45.901475] [DEBUG] [LOCAL ] ACV: Trimmed 10371 records to 7641 (keeping 200 days of data) [2025-10-14T17:02:45.951366] [DEBUG] [LOCAL ] ACV: Primary data saved (7641 records). [2025-10-14T17:02:45.951570] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-14T17:02:45.951709] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACV took 26.6s. Estimated remaining: 3h 54m 35s. Rate: 10.0 symbols/min [2025-10-14T17:02:46.136200] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:02:46.194566] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-14T17:02:46.195064] [INFO ] [MAIN ] ADM: Loaded 53394 existing records. [2025-10-14T17:02:46.364076] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-14T17:02:46.393695] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:02:46.394898] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-14T17:02:46.394974] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-14T17:02:46.395840] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-14T17:02:46.395900] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-14T17:02:46.759404] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:02:47.158066] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-14T17:02:47.302023] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T17:02:47.907388] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T17:02:47.958027] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-14T17:02:48.758055] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-14T17:02:48.880462] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T17:02:49.456616] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T17:02:49.558058] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-14T17:02:50.279103] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T17:02:50.358040] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-14T17:02:50.565937] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T17:02:51.158118] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-14T17:02:51.958129] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-14T17:02:52.134064] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T17:02:52.278862] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T17:02:52.758176] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-14T17:02:53.463300] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:02:53.526324] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T17:02:53.558031] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-14T17:02:54.358073] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-14T17:02:54.958517] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T17:02:55.158068] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-14T17:02:55.814872] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T17:02:55.958069] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-14T17:02:56.344322] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T17:02:56.758097] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-14T17:02:57.193012] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T17:02:57.558062] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-14T17:02:58.249722] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T17:02:58.358031] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-14T17:02:58.862200] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T17:02:59.158115] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-14T17:02:59.958123] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-14T17:03:00.340907] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T17:03:00.758056] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-14T17:03:00.982793] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T17:03:01.053793] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T17:03:01.558058] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-14T17:03:02.358060] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-14T17:03:02.952468] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T17:03:03.158169] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-14T17:03:03.262538] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T17:03:03.561048] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T17:03:03.958099] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-14T17:03:04.758085] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-14T17:03:05.001268] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T17:03:05.558100] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-14T17:03:05.603099] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T17:03:05.978549] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T17:03:06.358113] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-14T17:03:06.686369] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T17:03:07.158113] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-14T17:03:07.878451] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:03:07.958028] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-14T17:03:08.632770] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T17:03:08.758046] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-14T17:03:09.558104] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-14T17:03:09.655018] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T17:03:09.660627] [INFO ] [REMOTE ] ADCT: Full fetch complete (51505 records). [2025-10-14T17:03:09.660743] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-14T17:03:10.054112] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-14T17:03:10.054216] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-14T17:03:10.054752] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-14T17:03:10.054813] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-14T17:03:10.055970] [DEBUG] [LOCAL ] ADCT: Trimmed 51505 records to 35199 (keeping 200 days of data) [2025-10-14T17:03:10.154514] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T17:03:10.162736] [INFO ] [REMOTE ] ACVA: Full fetch complete (70826 records). [2025-10-14T17:03:10.168382] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-14T17:03:10.362389] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-14T17:03:10.698242] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-14T17:03:10.699718] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-14T17:03:10.701382] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-14T17:03:10.702133] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-14T17:03:10.706152] [DEBUG] [LOCAL ] ADCT: Primary data saved (35199 records). [2025-10-14T17:03:10.706298] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-14T17:03:10.708025] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ADCT took 28.6s. Estimated remaining: 4h 20m 37s. Rate: 9.0 symbols/min [2025-10-14T17:03:10.803532] [DEBUG] [LOCAL ] ACVA: Trimmed 70826 records to 49301 (keeping 200 days of data) [2025-10-14T17:03:10.984457] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T17:03:10.983942] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:10.992106] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-14T17:03:10.992038] [INFO ] [REMOTE ] ADC: Full fetch complete (66355 records). [2025-10-14T17:03:10.992351] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-14T17:03:10.994184] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-14T17:03:10.992271] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-14T17:03:10.994801] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-14T17:03:10.995965] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-14T17:03:10.996453] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-14T17:03:11.879811] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:11.880103] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-14T17:03:11.881019] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-14T17:03:11.881901] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-14T17:03:11.883237] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-14T17:03:11.883594] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-14T17:03:11.891268] [DEBUG] [LOCAL ] ADC: Trimmed 66355 records to 46340 (keeping 200 days of data) [2025-10-14T17:03:12.049486] [DEBUG] [LOCAL ] ACVA: Primary data saved (49301 records). [2025-10-14T17:03:12.055338] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-14T17:03:12.055700] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ACVA took 47.7s. Estimated remaining: 4h 13m 20s. Rate: 9.2 symbols/min [2025-10-14T17:03:12.305213] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:12.448702] [DEBUG] [LOCAL ] ADC: Primary data saved (46340 records). [2025-10-14T17:03:12.448899] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-14T17:03:12.449015] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 33.1s. Estimated remaining: 4h 5m 17s. Rate: 9.5 symbols/min [2025-10-14T17:03:12.486760] [DEBUG] [LOCAL ] ADT: Loaded 53446 existing records from primary storage. [2025-10-14T17:03:12.526271] [INFO ] [MAIN ] ADT: Loaded 53446 existing records. [2025-10-14T17:03:12.737985] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:12.808049] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:03:12.808520] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-14T17:03:12.808611] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-14T17:03:12.809169] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-14T17:03:12.809248] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-14T17:03:13.051438] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-14T17:03:13.062354] [DEBUG] [LOCAL ] ADX: Loaded 27695 existing records from primary storage. [2025-10-14T17:03:13.087144] [INFO ] [MAIN ] ADX: Loaded 27695 existing records. [2025-10-14T17:03:13.168253] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-14T17:03:13.392201] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:13.418212] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-14T17:03:13.423147] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:03:13.424198] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-14T17:03:13.424264] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-14T17:03:13.424933] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-14T17:03:13.434220] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-14T17:03:13.555456] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T17:03:13.567191] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-14T17:03:13.821849] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:14.358128] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-14T17:03:15.233214] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-14T17:03:15.244471] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-14T17:03:15.298328] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T17:03:15.375249] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T17:03:15.430580] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-14T17:03:15.958077] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-14T17:03:16.758105] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-14T17:03:17.119489] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T17:03:17.252672] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T17:03:17.558074] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-14T17:03:17.970581] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T17:03:18.358112] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-14T17:03:19.158104] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-14T17:03:19.187073] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T17:03:19.679332] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T17:03:19.958097] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-14T17:03:20.449674] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T17:03:20.758090] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-14T17:03:21.558055] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-14T17:03:21.673398] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T17:03:21.973334] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T17:03:22.358054] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-14T17:03:22.414049] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T17:03:23.158165] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-14T17:03:23.916861] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T17:03:23.958037] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-14T17:03:24.703764] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T17:03:24.758032] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-14T17:03:25.285720] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T17:03:25.292257] [INFO ] [REMOTE ] ADM: Full fetch complete (77429 records). [2025-10-14T17:03:25.292426] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-14T17:03:25.563246] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-14T17:03:25.744759] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-14T17:03:25.744855] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-14T17:03:25.745582] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-14T17:03:25.745626] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-14T17:03:25.747347] [DEBUG] [LOCAL ] ADM: Trimmed 77429 records to 53395 (keeping 200 days of data) [2025-10-14T17:03:25.883610] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T17:03:26.105602] [DEBUG] [LOCAL ] ADM: Primary data saved (53395 records). [2025-10-14T17:03:26.105775] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-14T17:03:26.106803] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADM took 40.2s. Estimated remaining: 4h 14m 27s. Rate: 9.2 symbols/min [2025-10-14T17:03:26.273841] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:26.321335] [DEBUG] [LOCAL ] AEE: Loaded 50188 existing records from primary storage. [2025-10-14T17:03:26.321679] [INFO ] [MAIN ] AEE: Loaded 50188 existing records. [2025-10-14T17:03:26.363400] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-14T17:03:26.497942] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:03:26.498112] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-14T17:03:26.498159] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-14T17:03:26.498528] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-14T17:03:26.498585] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-14T17:03:26.841927] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:27.163973] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-14T17:03:27.190529] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T17:03:27.766322] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T17:03:27.958074] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-14T17:03:28.758089] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-14T17:03:29.047301] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T17:03:29.558122] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-14T17:03:29.816394] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T17:03:29.880868] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T17:03:30.358059] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-14T17:03:31.158076] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-14T17:03:31.210694] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T17:03:31.958043] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-14T17:03:32.154009] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T17:03:32.431951] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T17:03:32.758100] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-14T17:03:32.922246] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T17:03:33.558102] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-14T17:03:34.358076] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-14T17:03:34.652321] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T17:03:34.685863] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T17:03:35.158076] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-14T17:03:35.863847] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T17:03:35.958047] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-14T17:03:35.993782] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T17:03:36.758114] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-14T17:03:37.558086] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-14T17:03:37.788013] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T17:03:38.312965] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T17:03:38.358070] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-14T17:03:38.917552] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T17:03:39.158068] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-14T17:03:39.958100] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-14T17:03:40.020958] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T17:03:40.746582] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T17:03:40.758138] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-14T17:03:41.120921] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T17:03:41.124295] [INFO ] [REMOTE ] ADX: Full fetch complete (41878 records). [2025-10-14T17:03:41.124385] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-14T17:03:41.497779] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-14T17:03:41.497900] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-14T17:03:41.498355] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-14T17:03:41.498396] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-14T17:03:41.499402] [DEBUG] [LOCAL ] ADX: Trimmed 41878 records to 27690 (keeping 200 days of data) [2025-10-14T17:03:41.558166] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-14T17:03:41.662890] [DEBUG] [LOCAL ] ADX: Primary data saved (27690 records). [2025-10-14T17:03:41.663012] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-14T17:03:41.663093] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADX took 29.2s. Estimated remaining: 4h 25m 19s. Rate: 8.8 symbols/min [2025-10-14T17:03:41.838257] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:41.848187] [DEBUG] [LOCAL ] AEFC: Loaded 8389 existing records from primary storage. [2025-10-14T17:03:41.848388] [INFO ] [MAIN ] AEFC: Loaded 8389 existing records. [2025-10-14T17:03:42.027236] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:03:42.027460] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-14T17:03:42.027535] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-14T17:03:42.027730] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-14T17:03:42.027786] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-14T17:03:42.359177] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-14T17:03:42.386578] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:42.636620] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-14T17:03:42.643506] [INFO ] [REMOTE ] ADT: Full fetch complete (77359 records). [2025-10-14T17:03:42.643782] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-14T17:03:43.073986] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-14T17:03:43.074193] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-14T17:03:43.075226] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-14T17:03:43.075300] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-14T17:03:43.077502] [DEBUG] [LOCAL ] ADT: Trimmed 77359 records to 53444 (keeping 200 days of data) [2025-10-14T17:03:43.167401] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-14T17:03:43.431592] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T17:03:43.460332] [DEBUG] [LOCAL ] ADT: Primary data saved (53444 records). [2025-10-14T17:03:43.460546] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-14T17:03:43.461400] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADT took 31.4s. Estimated remaining: 4h 19m 18s. Rate: 9.0 symbols/min [2025-10-14T17:03:43.657279] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:43.657612] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-14T17:03:43.657880] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-14T17:03:43.658277] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-14T17:03:43.658355] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-14T17:03:43.658662] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-14T17:03:43.658778] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-14T17:03:43.828123] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T17:03:43.963603] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-14T17:03:44.129038] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:44.130279] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T17:03:44.758082] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-14T17:03:45.547620] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T17:03:45.553368] [INFO ] [REMOTE ] ADNT: Full fetch complete (68091 records). [2025-10-14T17:03:45.553507] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-14T17:03:45.566589] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-14T17:03:45.968485] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-14T17:03:45.968596] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-14T17:03:45.969415] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-14T17:03:45.969497] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-14T17:03:45.971397] [DEBUG] [LOCAL ] ADNT: Trimmed 68091 records to 46912 (keeping 200 days of data) [2025-10-14T17:03:46.275436] [DEBUG] [LOCAL ] ADNT: Primary data saved (46912 records). [2025-10-14T17:03:46.275624] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-14T17:03:46.275747] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADNT took 35.6s. Estimated remaining: 4h 14m 47s. Rate: 9.2 symbols/min [2025-10-14T17:03:46.363160] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-14T17:03:46.478719] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:03:46.510225] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T17:03:46.572051] [DEBUG] [LOCAL ] AEM: Loaded 53478 existing records from primary storage. [2025-10-14T17:03:46.572439] [INFO ] [MAIN ] AEM: Loaded 53478 existing records. [2025-10-14T17:03:46.790592] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:03:46.791000] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-14T17:03:46.791076] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-14T17:03:46.791477] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-14T17:03:46.791539] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-14T17:03:47.175377] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-14T17:03:47.188773] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:03:47.189934] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T17:03:47.303141] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T17:03:47.958067] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-14T17:03:48.572740] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T17:03:48.758078] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-14T17:03:48.918005] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T17:03:49.525338] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T17:03:49.558046] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-14T17:03:50.103705] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T17:03:50.358100] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-14T17:03:51.158080] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-14T17:03:51.911792] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T17:03:51.958059] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-14T17:03:52.756467] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T17:03:52.764608] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-14T17:03:53.498485] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T17:03:53.558094] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-14T17:03:54.282224] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:03:54.330113] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T17:03:54.358043] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-14T17:03:54.745177] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-14T17:03:55.158102] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-14T17:03:55.958075] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-14T17:03:56.665170] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T17:03:56.758118] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-14T17:03:56.855751] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T17:03:57.558070] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-14T17:03:58.174579] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T17:03:58.358048] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-14T17:03:59.158117] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-14T17:03:59.193370] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T17:03:59.692925] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T17:03:59.919750] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T17:03:59.958079] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-14T17:04:00.758074] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-14T17:04:01.558073] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-14T17:04:02.097748] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-14T17:04:02.193921] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T17:04:02.358075] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-14T17:04:03.158151] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-14T17:04:03.522028] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T17:04:03.958052] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-14T17:04:04.094547] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T17:04:04.758075] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-14T17:04:04.943574] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T17:04:05.388753] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T17:04:05.558069] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-14T17:04:05.780740] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T17:04:06.084524] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T17:04:06.085742] [INFO ] [REMOTE ] AEFC: Full fetch complete (11914 records). [2025-10-14T17:04:06.085813] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-14T17:04:06.363206] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-14T17:04:06.456485] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-14T17:04:06.456556] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-14T17:04:06.456796] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-14T17:04:06.456882] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-14T17:04:06.457313] [DEBUG] [LOCAL ] AEFC: Trimmed 11914 records to 8406 (keeping 200 days of data) [2025-10-14T17:04:06.506130] [DEBUG] [LOCAL ] AEFC: Primary data saved (8406 records). [2025-10-14T17:04:06.506252] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-14T17:04:06.506323] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 24.8s. Estimated remaining: 4h 29m 53s. Rate: 8.6 symbols/min [2025-10-14T17:04:06.677359] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:06.677534] [DEBUG] [LOCAL ] AEO: No existing data file found in primary storage. [2025-10-14T17:04:06.677574] [WARN ] [MAIN ] AEO: No existing data found, performing full refresh instead. [2025-10-14T17:04:06.677707] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-14T17:04:06.677764] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-14T17:04:06.677808] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-14T17:04:06.677888] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-14T17:04:07.041084] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:07.158121] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-14T17:04:07.958049] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-14T17:04:08.049221] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T17:04:08.758040] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-14T17:04:09.156347] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T17:04:09.558090] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-14T17:04:09.875680] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T17:04:10.358065] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-14T17:04:10.611163] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T17:04:11.158044] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-14T17:04:11.252509] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T17:04:11.958145] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-14T17:04:12.624770] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-14T17:04:12.758118] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-14T17:04:12.973787] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T17:04:12.979683] [INFO ] [REMOTE ] AEE: Full fetch complete (72892 records). [2025-10-14T17:04:12.979824] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-14T17:04:13.388169] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-14T17:04:13.388305] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-14T17:04:13.389274] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-14T17:04:13.389350] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-14T17:04:13.391440] [DEBUG] [LOCAL ] AEE: Trimmed 72892 records to 50168 (keeping 200 days of data) [2025-10-14T17:04:13.577761] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-14T17:04:13.672410] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T17:04:13.751770] [DEBUG] [LOCAL ] AEE: Primary data saved (50168 records). [2025-10-14T17:04:13.751906] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-14T17:04:13.751987] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. AEE took 47.6s. Estimated remaining: 4h 30m 6s. Rate: 8.6 symbols/min [2025-10-14T17:04:13.918258] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:13.963052] [DEBUG] [LOCAL ] AER: Loaded 48213 existing records from primary storage. [2025-10-14T17:04:13.963340] [INFO ] [MAIN ] AER: Loaded 48213 existing records. [2025-10-14T17:04:14.147629] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:04:14.148018] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-14T17:04:14.148132] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-14T17:04:14.148602] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-14T17:04:14.148726] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-14T17:04:14.285742] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T17:04:14.368969] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-14T17:04:14.550905] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:15.158092] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-14T17:04:15.767523] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-14T17:04:15.958089] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-14T17:04:16.226995] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-14T17:04:16.231905] [INFO ] [REMOTE ] AEG: Full fetch complete (70091 records). [2025-10-14T17:04:16.232019] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-14T17:04:16.232767] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:04:16.232874] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:04:16.232939] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:04:16.233010] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-14T17:04:16.233072] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-14T17:04:16.233106] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-14T17:04:16.233162] [DEBUG] [LOCAL ] AEG: No derivative data file found to delete. [2025-10-14T17:04:16.233240] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEG took 32.8s. Estimated remaining: 4h 25m 18s. Rate: 8.8 symbols/min [2025-10-14T17:04:16.471428] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T17:04:16.758108] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-14T17:04:17.558086] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-14T17:04:17.632231] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T17:04:17.834066] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T17:04:18.358111] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-14T17:04:19.158109] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-14T17:04:19.549746] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T17:04:19.958061] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-14T17:04:20.007797] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T17:04:20.380599] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T17:04:20.758073] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-14T17:04:21.558096] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-14T17:04:21.822666] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:04:22.358121] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-14T17:04:22.819331] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T17:04:23.003207] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T17:04:23.158051] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-14T17:04:23.958057] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-14T17:04:24.231836] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T17:04:24.632255] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T17:04:24.758060] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-14T17:04:25.558099] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-14T17:04:26.061774] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-14T17:04:26.358045] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-14T17:04:26.415376] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T17:04:27.168689] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-14T17:04:27.173883] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T17:04:27.958093] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-14T17:04:28.319386] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-14T17:04:28.325435] [INFO ] [REMOTE ] AEM: Full fetch complete (77368 records). [2025-10-14T17:04:28.325560] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-14T17:04:28.718438] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-14T17:04:28.718527] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-14T17:04:28.719260] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-14T17:04:28.719330] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-14T17:04:28.720822] [DEBUG] [LOCAL ] AEM: Trimmed 77368 records to 53476 (keeping 200 days of data) [2025-10-14T17:04:29.061043] [DEBUG] [LOCAL ] AEM: Primary data saved (53476 records). [2025-10-14T17:04:29.061187] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-14T17:04:29.062032] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEM took 42.8s. Estimated remaining: 4h 31m 19s. Rate: 8.6 symbols/min [2025-10-14T17:04:29.210068] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T17:04:29.219563] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-14T17:04:29.331915] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-14T17:04:29.558071] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-14T17:04:30.628533] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T17:04:30.642553] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-14T17:04:31.960751] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-14T17:04:31.972444] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-14T17:04:32.280879] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T17:04:32.291469] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-14T17:04:33.709470] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T17:04:33.721863] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-14T17:04:34.005922] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T17:04:34.017558] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-14T17:04:35.573474] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T17:04:35.579549] [INFO ] [REMOTE ] AEO: Full fetch complete (77628 records). [2025-10-14T17:04:35.579739] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-14T17:04:35.894918] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-14T17:04:35.939123] [INFO ] [REMOTE ] AER: Full fetch complete (69762 records). [2025-10-14T17:04:35.957145] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-14T17:04:36.052940] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-14T17:04:36.062449] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-14T17:04:36.080066] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-14T17:04:36.080151] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-14T17:04:36.141230] [DEBUG] [LOCAL ] AEO: Trimmed 77628 records to 53566 (keeping 200 days of data) [2025-10-14T17:04:36.626216] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-14T17:04:36.639710] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-14T17:04:36.650465] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-14T17:04:36.661839] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-14T17:04:36.722681] [DEBUG] [LOCAL ] AER: Trimmed 69762 records to 48175 (keeping 200 days of data) [2025-10-14T17:04:36.853949] [DEBUG] [LOCAL ] AEO: Primary data saved (53566 records). [2025-10-14T17:04:36.855137] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-14T17:04:36.855280] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEO took 30.3s. Estimated remaining: 4h 32m 0s. Rate: 8.6 symbols/min [2025-10-14T17:04:37.070250] [DEBUG] [LOCAL ] AER: Primary data saved (48175 records). [2025-10-14T17:04:37.070385] [INFO ] [MAIN ] AER: Full history saved. [2025-10-14T17:04:37.070476] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AER took 23.3s. Estimated remaining: 4h 25m 18s. Rate: 8.8 symbols/min [2025-10-14T17:04:37.624552] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:37.812456] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:37.880076] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:37.891237] [DEBUG] [LOCAL ] AFB: Loaded 11281 existing records from primary storage. [2025-10-14T17:04:37.885598] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:37.891625] [INFO ] [MAIN ] AFB: Loaded 11281 existing records. [2025-10-14T17:04:37.898148] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-14T17:04:37.904290] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-14T17:04:37.914543] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-14T17:04:37.914868] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-14T17:04:37.923971] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-14T17:04:37.934578] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-14T17:04:38.285147] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:04:38.344318] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-14T17:04:38.344481] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-14T17:04:38.366423] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-14T17:04:38.337373] [DEBUG] [LOCAL ] AESI: Loaded 49713 existing records from primary storage. [2025-10-14T17:04:38.367447] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-14T17:04:38.366595] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-14T17:04:38.419062] [INFO ] [MAIN ] AES: Loaded 53669 existing records. [2025-10-14T17:04:38.391021] [INFO ] [MAIN ] AESI: Loaded 49713 existing records. [2025-10-14T17:04:39.179830] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:39.281437] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:04:39.260510] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-14T17:04:39.306060] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-14T17:04:39.306170] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-14T17:04:39.309181] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:04:39.309477] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-14T17:04:39.313219] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-14T17:04:39.313371] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-14T17:04:39.313333] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-14T17:04:39.351832] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-14T17:04:39.397980] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-14T17:04:39.423380] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:39.507325] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-14T17:04:39.531395] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:04:39.571162] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-14T17:04:39.612319] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:04:39.673931] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-14T17:04:39.694943] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:04:39.815178] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-14T17:04:39.904988] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-14T17:04:39.974619] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-14T17:04:40.027101] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-14T17:04:40.044997] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AEXA took 3.0s. Estimated remaining: 4h 21m 32s. Rate: 8.9 symbols/min [2025-10-14T17:04:40.108482] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:40.163460] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-14T17:04:40.208799] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:40.227616] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-14T17:04:40.336772] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:04:40.336935] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-10-14T17:04:40.336972] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-10-14T17:04:40.337081] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-14T17:04:40.337122] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-14T17:04:40.337161] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-14T17:04:40.337192] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-14T17:04:40.525968] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T17:04:40.563995] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-14T17:04:40.710980] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:04:40.711297] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-14T17:04:41.401607] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T17:04:41.404546] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-14T17:04:41.857857] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T17:04:41.863224] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-14T17:04:42.005898] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T17:04:42.007441] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T17:04:42.021554] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-14T17:04:42.010489] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-14T17:04:42.116037] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T17:04:42.358062] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-14T17:04:42.970363] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T17:04:43.019093] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T17:04:43.158125] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-14T17:04:43.691518] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:04:43.742856] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T17:04:43.958042] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-14T17:04:44.067884] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T17:04:44.758084] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-14T17:04:45.505262] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T17:04:45.558027] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-14T17:04:46.217813] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T17:04:46.358065] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-14T17:04:47.137118] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T17:04:47.158053] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-14T17:04:47.177074] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T17:04:47.958069] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-14T17:04:48.701782] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T17:04:48.758031] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-14T17:04:49.304359] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T17:04:49.558086] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-14T17:04:50.184193] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T17:04:50.299299] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T17:04:50.358056] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-14T17:04:51.158085] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-14T17:04:51.339289] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T17:04:51.958105] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-14T17:04:52.758063] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-14T17:04:52.888301] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T17:04:53.558065] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-14T17:04:53.736568] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T17:04:54.178301] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T17:04:54.358043] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-14T17:04:55.158056] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-14T17:04:55.368048] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T17:04:55.619870] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T17:04:55.958094] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-14T17:04:56.052623] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T17:04:56.758116] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-14T17:04:56.766751] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T17:04:57.558070] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-14T17:04:57.853687] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T17:04:58.358060] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-14T17:04:58.926090] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T17:04:59.158194] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-14T17:04:59.444102] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T17:04:59.958104] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-14T17:05:00.758037] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-14T17:05:01.065623] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T17:05:01.407016] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:05:01.558048] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-14T17:05:02.110375] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T17:05:02.358066] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-14T17:05:02.669250] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T17:05:02.673274] [INFO ] [REMOTE ] AFG: Full fetch complete (46516 records). [2025-10-14T17:05:02.673368] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-14T17:05:03.055739] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-14T17:05:03.055837] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-14T17:05:03.056358] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-14T17:05:03.056400] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-14T17:05:03.057522] [DEBUG] [LOCAL ] AFG: Trimmed 46516 records to 32274 (keeping 200 days of data) [2025-10-14T17:05:03.158379] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-14T17:05:03.260960] [DEBUG] [LOCAL ] AFG: Primary data saved (32274 records). [2025-10-14T17:05:03.261098] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-14T17:05:03.261171] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AFG took 23.2s. Estimated remaining: 4h 36m 38s. Rate: 8.4 symbols/min [2025-10-14T17:05:03.425971] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:03.429709] [DEBUG] [LOCAL ] AFGB: Loaded 2291 existing records from primary storage. [2025-10-14T17:05:03.429860] [INFO ] [MAIN ] AFGB: Loaded 2291 existing records. [2025-10-14T17:05:03.603452] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:03.603717] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-14T17:05:03.603802] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-14T17:05:03.603959] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-14T17:05:03.603998] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-14T17:05:03.953043] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:03.958022] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-14T17:05:04.205519] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T17:05:04.435991] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-14T17:05:04.466127] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-14T17:05:04.758121] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-14T17:05:05.241324] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T17:05:05.558123] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-14T17:05:06.358114] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-14T17:05:07.069935] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T17:05:07.071690] [INFO ] [REMOTE ] AFB: Full fetch complete (16521 records). [2025-10-14T17:05:07.071759] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-14T17:05:07.163289] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-14T17:05:07.443356] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-14T17:05:07.443451] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-14T17:05:07.443735] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-14T17:05:07.443880] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-14T17:05:07.444711] [DEBUG] [LOCAL ] AFB: Trimmed 16521 records to 11214 (keeping 200 days of data) [2025-10-14T17:05:07.513369] [DEBUG] [LOCAL ] AFB: Primary data saved (11214 records). [2025-10-14T17:05:07.513584] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-14T17:05:07.513704] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AFB took 30.4s. Estimated remaining: 4h 33m 55s. Rate: 8.5 symbols/min [2025-10-14T17:05:07.646960] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T17:05:07.753337] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:07.758626] [DEBUG] [LOCAL ] AFGC: Loaded 2526 existing records from primary storage. [2025-10-14T17:05:07.758844] [INFO ] [MAIN ] AFGC: Loaded 2526 existing records. [2025-10-14T17:05:07.946967] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:07.947224] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-14T17:05:07.947300] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-14T17:05:07.947529] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-14T17:05:07.947594] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-14T17:05:07.968752] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-14T17:05:08.299025] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:08.758081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-14T17:05:08.790588] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T17:05:09.246816] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-14T17:05:09.558037] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-14T17:05:09.730496] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T17:05:10.358060] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-14T17:05:11.158115] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-14T17:05:11.199842] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T17:05:11.205825] [INFO ] [REMOTE ] AESI: Full fetch complete (71044 records). [2025-10-14T17:05:11.205942] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-14T17:05:11.634980] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-14T17:05:11.635068] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-14T17:05:11.635861] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-14T17:05:11.635928] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-14T17:05:11.637462] [DEBUG] [LOCAL ] AESI: Trimmed 71044 records to 49736 (keeping 200 days of data) [2025-10-14T17:05:11.717145] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T17:05:11.918767] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T17:05:11.958134] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-14T17:05:12.019195] [DEBUG] [LOCAL ] AESI: Primary data saved (49736 records). [2025-10-14T17:05:12.019380] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-14T17:05:12.019479] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AESI took 34.9s. Estimated remaining: 4h 31m 33s. Rate: 8.6 symbols/min [2025-10-14T17:05:12.191439] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:12.195179] [DEBUG] [LOCAL ] AFGD: Loaded 1795 existing records from primary storage. [2025-10-14T17:05:12.195380] [INFO ] [MAIN ] AFGD: Loaded 1795 existing records. [2025-10-14T17:05:12.380691] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:12.380928] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-14T17:05:12.380977] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-14T17:05:12.381160] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-14T17:05:12.381219] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-14T17:05:12.474316] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T17:05:12.771842] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-14T17:05:12.777888] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:13.196603] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T17:05:13.558152] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-14T17:05:13.983829] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T17:05:14.358084] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-14T17:05:15.158105] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-14T17:05:15.632801] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T17:05:15.958060] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-14T17:05:16.461860] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-14T17:05:16.505480] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T17:05:16.758077] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-14T17:05:17.558084] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-14T17:05:18.062440] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T17:05:18.358071] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-14T17:05:18.762054] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-14T17:05:18.771093] [INFO ] [REMOTE ] AES: Full fetch complete (77847 records). [2025-10-14T17:05:18.771232] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-14T17:05:18.772798] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-14T17:05:19.160378] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-14T17:05:19.180747] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-14T17:05:19.180808] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-14T17:05:19.181594] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-14T17:05:19.181745] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-14T17:05:19.183238] [DEBUG] [LOCAL ] AES: Trimmed 77847 records to 53669 (keeping 200 days of data) [2025-10-14T17:05:19.514152] [DEBUG] [LOCAL ] AES: Primary data saved (53669 records). [2025-10-14T17:05:19.514323] [INFO ] [MAIN ] AES: Full history saved. [2025-10-14T17:05:19.515566] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AES took 42.4s. Estimated remaining: 4h 31m 51s. Rate: 8.5 symbols/min [2025-10-14T17:05:19.703150] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:19.699623] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T17:05:19.710417] [DEBUG] [LOCAL ] AFGE: Loaded 2404 existing records from primary storage. [2025-10-14T17:05:19.710608] [INFO ] [MAIN ] AFGE: Loaded 2404 existing records. [2025-10-14T17:05:19.908728] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:19.908988] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-14T17:05:19.909036] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-14T17:05:19.909187] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-14T17:05:19.909243] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-14T17:05:19.963233] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-14T17:05:20.263813] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:20.503188] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T17:05:20.758072] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-14T17:05:21.275483] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-14T17:05:21.558053] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-14T17:05:22.150712] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T17:05:22.358076] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-14T17:05:22.812981] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-14T17:05:23.158072] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-14T17:05:23.495353] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T17:05:23.958077] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-14T17:05:24.284984] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-14T17:05:24.758076] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-14T17:05:25.198671] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T17:05:25.558084] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-14T17:05:26.017050] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T17:05:26.358056] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-14T17:05:26.890851] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T17:05:27.158052] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-14T17:05:27.709710] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T17:05:27.958067] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-14T17:05:28.553694] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T17:05:28.758110] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-14T17:05:29.197871] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T17:05:29.558069] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-14T17:05:29.867683] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-14T17:05:30.358079] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-14T17:05:30.719897] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-14T17:05:31.158084] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-14T17:05:31.753132] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T17:05:31.958060] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-14T17:05:32.370430] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T17:05:32.758074] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-14T17:05:33.209148] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T17:05:33.558074] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-14T17:05:33.992281] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T17:05:34.358087] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-14T17:05:34.810397] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T17:05:35.158109] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-14T17:05:35.576779] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-14T17:05:35.958113] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-14T17:05:36.355445] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-14T17:05:36.356248] [INFO ] [REMOTE ] AFGC: Full fetch complete (3694 records). [2025-10-14T17:05:36.356318] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-14T17:05:36.712961] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-14T17:05:36.713038] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-14T17:05:36.713160] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-14T17:05:36.713199] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-14T17:05:36.713531] [DEBUG] [LOCAL ] AFGC: Trimmed 3694 records to 2554 (keeping 200 days of data) [2025-10-14T17:05:36.729074] [DEBUG] [LOCAL ] AFGC: Primary data saved (2554 records). [2025-10-14T17:05:36.729141] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-14T17:05:36.729206] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 29.2s. Estimated remaining: 4h 40m 19s. Rate: 8.3 symbols/min [2025-10-14T17:05:36.761162] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-14T17:05:36.900989] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:36.950556] [DEBUG] [LOCAL ] AFL: Loaded 53185 existing records from primary storage. [2025-10-14T17:05:36.950924] [INFO ] [MAIN ] AFL: Loaded 53185 existing records. [2025-10-14T17:05:37.130496] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:37.130737] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-14T17:05:37.130796] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-14T17:05:37.132041] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-14T17:05:37.132100] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-14T17:05:37.302860] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T17:05:37.492473] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:37.558026] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-14T17:05:38.358085] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-14T17:05:38.869734] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T17:05:39.158037] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-14T17:05:39.338816] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T17:05:39.607311] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T17:05:39.958054] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-14T17:05:40.303830] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T17:05:40.758108] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-14T17:05:41.315596] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T17:05:41.316427] [INFO ] [REMOTE ] AFGD: Full fetch complete (3041 records). [2025-10-14T17:05:41.316515] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-14T17:05:41.563195] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-14T17:05:41.713188] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-14T17:05:41.713266] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-14T17:05:41.713376] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-14T17:05:41.713414] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-14T17:05:41.713788] [DEBUG] [LOCAL ] AFGD: Trimmed 3041 records to 1770 (keeping 200 days of data) [2025-10-14T17:05:41.724905] [DEBUG] [LOCAL ] AFGD: Primary data saved (1770 records). [2025-10-14T17:05:41.725027] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-14T17:05:41.725104] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGD took 29.7s. Estimated remaining: 4h 38m 21s. Rate: 8.3 symbols/min [2025-10-14T17:05:41.896006] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:41.945817] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-14T17:05:41.946208] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-14T17:05:42.122333] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:42.122581] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-14T17:05:42.122636] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-14T17:05:42.122969] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-14T17:05:42.123024] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-14T17:05:42.363205] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-14T17:05:42.479254] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:43.017964] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T17:05:43.018790] [INFO ] [REMOTE ] AFGB: Full fetch complete (3586 records). [2025-10-14T17:05:43.018865] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-14T17:05:43.166082] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-14T17:05:43.411690] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-14T17:05:43.411795] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-14T17:05:43.412096] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-14T17:05:43.412181] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-14T17:05:43.412800] [DEBUG] [LOCAL ] AFGB: Trimmed 3586 records to 2269 (keeping 200 days of data) [2025-10-14T17:05:43.455427] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T17:05:43.456756] [DEBUG] [LOCAL ] AFGB: Primary data saved (2269 records). [2025-10-14T17:05:43.466991] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-14T17:05:43.467598] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGB took 40.2s. Estimated remaining: 4h 33m 50s. Rate: 8.5 symbols/min [2025-10-14T17:05:43.666293] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:43.709874] [DEBUG] [LOCAL ] AGCO: Loaded 42483 existing records from primary storage. [2025-10-14T17:05:43.710422] [INFO ] [MAIN ] AGCO: Loaded 42483 existing records. [2025-10-14T17:05:43.944082] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:43.944531] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-14T17:05:43.944586] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-14T17:05:43.945733] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-14T17:05:43.945792] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-14T17:05:43.968280] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-14T17:05:44.334100] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:44.409261] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T17:05:44.758104] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-14T17:05:45.307092] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-14T17:05:45.558089] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-14T17:05:46.162246] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T17:05:46.358111] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-14T17:05:46.745819] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-14T17:05:47.158083] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-14T17:05:47.416866] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T17:05:47.958074] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-14T17:05:48.518005] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T17:05:48.586278] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T17:05:48.758088] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-14T17:05:49.264515] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T17:05:49.558067] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-14T17:05:50.140035] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T17:05:50.140783] [INFO ] [REMOTE ] AFGE: Full fetch complete (3450 records). [2025-10-14T17:05:50.140850] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-14T17:05:50.367234] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-14T17:05:50.491114] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-14T17:05:50.491203] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-14T17:05:50.491315] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-14T17:05:50.491352] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-14T17:05:50.491698] [DEBUG] [LOCAL ] AFGE: Trimmed 3450 records to 2396 (keeping 200 days of data) [2025-10-14T17:05:50.505781] [DEBUG] [LOCAL ] AFGE: Primary data saved (2396 records). [2025-10-14T17:05:50.505839] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-14T17:05:50.505900] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGE took 31.0s. Estimated remaining: 4h 33m 41s. Rate: 8.5 symbols/min [2025-10-14T17:05:50.674844] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:05:50.694395] [DEBUG] [LOCAL ] AGD: Loaded 19042 existing records from primary storage. [2025-10-14T17:05:50.694623] [INFO ] [MAIN ] AGD: Loaded 19042 existing records. [2025-10-14T17:05:50.867691] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:05:50.867931] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-14T17:05:50.867981] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-14T17:05:50.868206] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-14T17:05:50.868261] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-14T17:05:51.163344] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-14T17:05:51.222052] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:05:51.958107] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-14T17:05:52.450565] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-14T17:05:52.758061] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-14T17:05:52.873777] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T17:05:52.919050] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T17:05:53.558065] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-14T17:05:54.358073] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-14T17:05:54.528416] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T17:05:55.158054] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-14T17:05:55.352015] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T17:05:55.813104] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T17:05:55.851266] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T17:05:55.958052] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-14T17:05:56.758067] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-14T17:05:57.558045] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-14T17:05:57.737402] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T17:05:58.046104] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T17:05:58.358111] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-14T17:05:58.747401] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-14T17:05:59.158153] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-14T17:05:59.192127] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T17:05:59.958082] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-14T17:06:00.763153] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-14T17:06:00.779100] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T17:06:01.497786] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T17:06:01.558055] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-14T17:06:02.358043] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-14T17:06:02.722181] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T17:06:02.790852] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T17:06:03.158080] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-14T17:06:03.929071] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T17:06:03.958031] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-14T17:06:04.758072] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-14T17:06:05.232711] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-14T17:06:05.357254] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T17:06:05.558062] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-14T17:06:06.197308] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:06:06.358084] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-14T17:06:07.158085] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-14T17:06:07.878937] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-14T17:06:07.931916] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T17:06:07.958038] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-14T17:06:07.988696] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T17:06:08.758172] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-14T17:06:09.558078] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-14T17:06:09.591137] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T17:06:10.358069] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-14T17:06:10.396776] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T17:06:10.402787] [INFO ] [REMOTE ] AFL: Full fetch complete (77074 records). [2025-10-14T17:06:10.402952] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-14T17:06:10.808715] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-14T17:06:10.808853] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-14T17:06:10.809759] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-14T17:06:10.809834] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-14T17:06:10.812212] [DEBUG] [LOCAL ] AFL: Trimmed 77074 records to 53189 (keeping 200 days of data) [2025-10-14T17:06:11.158701] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-14T17:06:11.181677] [DEBUG] [LOCAL ] AFL: Primary data saved (53189 records). [2025-10-14T17:06:11.181899] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-14T17:06:11.182043] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 34.5s. Estimated remaining: 4h 44m 5s. Rate: 8.2 symbols/min [2025-10-14T17:06:11.371140] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:11.426038] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-14T17:06:11.426543] [INFO ] [MAIN ] AGI: Loaded 53423 existing records. [2025-10-14T17:06:11.626908] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:06:11.627803] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-14T17:06:11.628134] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-14T17:06:11.640449] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-14T17:06:11.640621] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-14T17:06:11.701129] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-14T17:06:11.968421] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-14T17:06:12.103161] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:12.107524] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T17:06:12.131589] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T17:06:12.758110] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-14T17:06:13.558071] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-14T17:06:13.963730] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T17:06:14.324926] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T17:06:14.358098] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-14T17:06:15.158055] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-14T17:06:15.380305] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T17:06:15.958158] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-14T17:06:16.533596] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-14T17:06:16.542104] [INFO ] [REMOTE ] AG: Full fetch complete (77770 records). [2025-10-14T17:06:16.542285] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-14T17:06:16.759015] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-14T17:06:17.005078] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-14T17:06:17.005219] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-14T17:06:17.006075] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-14T17:06:17.006155] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-14T17:06:17.008415] [DEBUG] [LOCAL ] AG: Trimmed 77770 records to 53643 (keeping 200 days of data) [2025-10-14T17:06:17.032467] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T17:06:17.375684] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-14T17:06:17.375846] [INFO ] [MAIN ] AG: Full history saved. [2025-10-14T17:06:17.376783] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AG took 35.7s. Estimated remaining: 4h 43m 5s. Rate: 8.2 symbols/min [2025-10-14T17:06:17.565910] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-14T17:06:17.567442] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:17.599113] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T17:06:17.617933] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T17:06:17.678954] [DEBUG] [LOCAL ] AGL: Loaded 52552 existing records from primary storage. [2025-10-14T17:06:17.679280] [INFO ] [MAIN ] AGL: Loaded 52552 existing records. [2025-10-14T17:06:17.853767] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:06:17.853998] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-14T17:06:17.854046] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-14T17:06:17.854303] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-14T17:06:17.854343] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-14T17:06:18.234762] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:18.358075] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-14T17:06:19.161522] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-14T17:06:19.168804] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T17:06:19.735759] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T17:06:19.958078] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-14T17:06:20.545846] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T17:06:20.758081] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-14T17:06:21.558122] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-14T17:06:21.626978] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T17:06:21.632310] [INFO ] [REMOTE ] AGCO: Full fetch complete (61747 records). [2025-10-14T17:06:21.632452] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-14T17:06:21.764568] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T17:06:22.035509] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-14T17:06:22.035597] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-14T17:06:22.036225] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-14T17:06:22.036289] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-14T17:06:22.037576] [DEBUG] [LOCAL ] AGCO: Trimmed 61747 records to 42456 (keeping 200 days of data) [2025-10-14T17:06:22.306462] [DEBUG] [LOCAL ] AGCO: Primary data saved (42456 records). [2025-10-14T17:06:22.306586] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-14T17:06:22.306686] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AGCO took 38.8s. Estimated remaining: 4h 41m 11s. Rate: 8.2 symbols/min [2025-10-14T17:06:22.370544] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-14T17:06:22.480820] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:22.492504] [DEBUG] [LOCAL ] AGM: Loaded 10647 existing records from primary storage. [2025-10-14T17:06:22.492765] [INFO ] [MAIN ] AGM: Loaded 10647 existing records. [2025-10-14T17:06:22.670116] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:06:22.670358] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-14T17:06:22.670407] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-14T17:06:22.670575] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-14T17:06:22.670689] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-14T17:06:23.037470] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:23.158140] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-14T17:06:23.263403] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T17:06:23.958187] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-14T17:06:23.982421] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T17:06:24.105496] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T17:06:24.758104] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-14T17:06:25.500520] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T17:06:25.558046] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-14T17:06:25.638429] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T17:06:26.358067] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-14T17:06:27.158100] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-14T17:06:27.237695] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T17:06:27.245032] [INFO ] [REMOTE ] AGD: Full fetch complete (26453 records). [2025-10-14T17:06:27.245138] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-14T17:06:27.538232] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T17:06:27.656735] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-14T17:06:27.656815] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-14T17:06:27.657150] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-14T17:06:27.657188] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-14T17:06:27.657891] [DEBUG] [LOCAL ] AGD: Trimmed 26453 records to 19218 (keeping 200 days of data) [2025-10-14T17:06:27.771377] [DEBUG] [LOCAL ] AGD: Primary data saved (19218 records). [2025-10-14T17:06:27.771508] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-14T17:06:27.771582] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGD took 37.3s. Estimated remaining: 4h 39m 44s. Rate: 8.3 symbols/min [2025-10-14T17:06:27.938889] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:27.939067] [DEBUG] [LOCAL ] AGO: No existing data file found in primary storage. [2025-10-14T17:06:27.939104] [WARN ] [MAIN ] AGO: No existing data found, performing full refresh instead. [2025-10-14T17:06:27.939211] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-14T17:06:27.939252] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-14T17:06:27.939292] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-14T17:06:27.939324] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-14T17:06:27.969791] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-14T17:06:28.297949] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:28.758074] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-14T17:06:29.353702] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-14T17:06:29.558051] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-14T17:06:29.772912] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T17:06:29.799535] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T17:06:30.358109] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-14T17:06:30.536430] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T17:06:30.841344] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T17:06:31.158077] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-14T17:06:31.958083] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-14T17:06:32.758036] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-14T17:06:33.103173] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-14T17:06:33.213273] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T17:06:33.558065] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-14T17:06:34.358087] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-14T17:06:34.396196] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T17:06:34.563202] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T17:06:34.993051] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-14T17:06:35.158083] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-14T17:06:35.714577] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-14T17:06:35.958209] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-14T17:06:36.758123] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-14T17:06:37.558035] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-14T17:06:37.587466] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T17:06:38.087615] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:06:38.158030] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-14T17:06:38.358051] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-14T17:06:39.158073] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-14T17:06:39.784594] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T17:06:39.958061] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-14T17:06:40.055154] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T17:06:40.758085] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-14T17:06:41.297056] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T17:06:41.558072] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-14T17:06:41.678737] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T17:06:42.358081] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-14T17:06:42.732072] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T17:06:43.136838] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T17:06:43.158088] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-14T17:06:43.958102] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-14T17:06:44.758045] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-14T17:06:45.110135] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-14T17:06:45.373263] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T17:06:45.519348] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T17:06:45.558072] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-14T17:06:46.358107] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-14T17:06:47.158085] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-14T17:06:47.183208] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T17:06:47.516377] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T17:06:47.958129] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-14T17:06:48.518857] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T17:06:48.758106] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-14T17:06:48.805322] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T17:06:48.807179] [INFO ] [REMOTE ] AGM: Full fetch complete (13225 records). [2025-10-14T17:06:48.807245] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-14T17:06:49.171506] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-14T17:06:49.171615] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-14T17:06:49.171874] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-14T17:06:49.171966] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-14T17:06:49.172433] [DEBUG] [LOCAL ] AGM: Trimmed 13225 records to 10669 (keeping 200 days of data) [2025-10-14T17:06:49.237973] [DEBUG] [LOCAL ] AGM: Primary data saved (10669 records). [2025-10-14T17:06:49.238095] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-14T17:06:49.238170] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 26.9s. Estimated remaining: 4h 49m 46s. Rate: 8.0 symbols/min [2025-10-14T17:06:49.407225] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:49.440032] [DEBUG] [LOCAL ] AGRO: Loaded 33364 existing records from primary storage. [2025-10-14T17:06:49.440320] [INFO ] [MAIN ] AGRO: Loaded 33364 existing records. [2025-10-14T17:06:49.563146] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-14T17:06:49.622363] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:06:49.622537] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-14T17:06:49.622588] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-14T17:06:49.622837] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-14T17:06:49.622894] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-14T17:06:49.984754] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:50.358084] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-14T17:06:50.568364] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T17:06:50.599487] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T17:06:51.158136] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-14T17:06:51.958112] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-14T17:06:52.027122] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T17:06:52.707916] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T17:06:52.758099] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-14T17:06:53.142969] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T17:06:53.558062] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-14T17:06:54.358065] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-14T17:06:54.387202] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T17:06:54.393344] [INFO ] [REMOTE ] AGI: Full fetch complete (77146 records). [2025-10-14T17:06:54.393511] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-14T17:06:54.794482] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-14T17:06:54.794569] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-14T17:06:54.795305] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-14T17:06:54.795372] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-14T17:06:54.797300] [DEBUG] [LOCAL ] AGI: Trimmed 77146 records to 53424 (keeping 200 days of data) [2025-10-14T17:06:55.123732] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T17:06:55.151291] [DEBUG] [LOCAL ] AGI: Primary data saved (53424 records). [2025-10-14T17:06:55.151425] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-14T17:06:55.151505] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGI took 44.0s. Estimated remaining: 4h 48m 32s. Rate: 8.0 symbols/min [2025-10-14T17:06:55.163162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-14T17:06:55.340202] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:55.375424] [DEBUG] [LOCAL ] AGX: Loaded 33020 existing records from primary storage. [2025-10-14T17:06:55.375787] [INFO ] [MAIN ] AGX: Loaded 33020 existing records. [2025-10-14T17:06:55.560336] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:06:55.560535] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-14T17:06:55.560581] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-14T17:06:55.560821] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-14T17:06:55.560878] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-14T17:06:55.695787] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T17:06:55.759281] [INFO ] [REMOTE ] AGO: Full fetch complete (39574 records). [2025-10-14T17:06:55.836808] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-14T17:06:55.969112] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-14T17:06:56.082777] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:56.349970] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-14T17:06:56.350060] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-14T17:06:56.350582] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-14T17:06:56.350667] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-14T17:06:56.351951] [DEBUG] [LOCAL ] AGO: Trimmed 39574 records to 27878 (keeping 200 days of data) [2025-10-14T17:06:56.524854] [DEBUG] [LOCAL ] AGO: Primary data saved (27878 records). [2025-10-14T17:06:56.524998] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-14T17:06:56.525070] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 28.8s. Estimated remaining: 4h 44m 12s. Rate: 8.1 symbols/min [2025-10-14T17:06:56.695428] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T17:06:56.727763] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:06:56.763350] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-14T17:06:56.766191] [DEBUG] [LOCAL ] AHH: Loaded 40607 existing records from primary storage. [2025-10-14T17:06:56.766487] [INFO ] [MAIN ] AHH: Loaded 40607 existing records. [2025-10-14T17:06:56.972894] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:06:56.973143] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-14T17:06:56.973196] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-14T17:06:56.973377] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-14T17:06:56.973416] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-14T17:06:57.398494] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:06:57.558071] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-14T17:06:57.875338] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T17:06:57.911572] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T17:06:58.358084] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-14T17:06:58.745260] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T17:06:59.158103] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-14T17:06:59.747211] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T17:06:59.958051] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-14T17:07:00.557056] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T17:07:00.758078] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-14T17:07:01.558107] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-14T17:07:01.756760] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T17:07:02.090227] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:07:02.358064] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-14T17:07:03.079238] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T17:07:03.085062] [INFO ] [REMOTE ] AGL: Full fetch complete (75818 records). [2025-10-14T17:07:03.085182] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-14T17:07:03.163163] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-14T17:07:03.476856] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-14T17:07:03.476978] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-14T17:07:03.477878] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-14T17:07:03.477962] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-14T17:07:03.485964] [DEBUG] [LOCAL ] AGL: Trimmed 75818 records to 52562 (keeping 200 days of data) [2025-10-14T17:07:03.499619] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T17:07:03.803629] [DEBUG] [LOCAL ] AGL: Primary data saved (52562 records). [2025-10-14T17:07:03.803805] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-14T17:07:03.803892] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGL took 46.4s. Estimated remaining: 4h 44m 1s. Rate: 8.1 symbols/min [2025-10-14T17:07:03.974745] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:03.971483] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-14T17:07:03.974905] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-14T17:07:03.975027] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-14T17:07:03.975170] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-14T17:07:03.976088] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-14T17:07:03.976150] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-14T17:07:03.976186] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-14T17:07:04.348992] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:04.677014] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T17:07:04.758133] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-14T17:07:05.150470] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T17:07:05.558089] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-14T17:07:06.083919] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:07:06.358069] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-14T17:07:07.158087] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-14T17:07:07.226342] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T17:07:07.357315] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:07:07.357599] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-14T17:07:07.357703] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:07:07.357773] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-14T17:07:07.357857] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:07:07.357930] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-14T17:07:07.358016] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-14T17:07:07.358071] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-14T17:07:07.358113] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-14T17:07:07.358158] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AHL took 3.6s. Estimated remaining: 4h 41m 21s. Rate: 8.2 symbols/min [2025-10-14T17:07:07.528506] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:07.572453] [DEBUG] [LOCAL ] AHR: Loaded 49096 existing records from primary storage. [2025-10-14T17:07:07.572784] [INFO ] [MAIN ] AHR: Loaded 49096 existing records. [2025-10-14T17:07:07.760773] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:07:07.761190] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-14T17:07:07.761263] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-14T17:07:07.761796] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-14T17:07:07.761855] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-14T17:07:07.888008] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T17:07:07.963966] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-14T17:07:08.156848] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:08.758108] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-14T17:07:09.558126] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-14T17:07:09.693050] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T17:07:10.087962] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T17:07:10.358081] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-14T17:07:11.113803] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:07:11.158034] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-14T17:07:11.480855] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T17:07:11.958074] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-14T17:07:12.652374] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T17:07:12.758046] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-14T17:07:13.558052] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-14T17:07:13.717182] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T17:07:14.347623] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T17:07:14.358025] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-14T17:07:14.883446] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T17:07:15.158065] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-14T17:07:15.529969] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T17:07:15.958074] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-14T17:07:16.758081] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-14T17:07:16.817107] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T17:07:17.404824] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:07:17.558039] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-14T17:07:17.622713] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T17:07:18.358082] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-14T17:07:19.089791] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T17:07:19.158045] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-14T17:07:19.452563] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T17:07:19.958113] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-14T17:07:20.373556] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T17:07:20.758061] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-14T17:07:21.558069] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-14T17:07:21.600622] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T17:07:21.605128] [INFO ] [REMOTE ] AHH: Full fetch complete (59853 records). [2025-10-14T17:07:21.605270] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-14T17:07:22.013810] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-14T17:07:22.013912] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-14T17:07:22.014527] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-14T17:07:22.014570] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-14T17:07:22.015874] [DEBUG] [LOCAL ] AHH: Trimmed 59853 records to 40550 (keeping 200 days of data) [2025-10-14T17:07:22.243316] [DEBUG] [LOCAL ] AHH: Primary data saved (40550 records). [2025-10-14T17:07:22.243441] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-14T17:07:22.243517] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AHH took 25.7s. Estimated remaining: 4h 46m 11s. Rate: 8.1 symbols/min [2025-10-14T17:07:22.370943] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-14T17:07:22.414612] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:22.448251] [DEBUG] [LOCAL ] AHT: Loaded 6328 existing records from primary storage. [2025-10-14T17:07:22.451409] [INFO ] [MAIN ] AHT: Loaded 6328 existing records. [2025-10-14T17:07:22.496730] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T17:07:22.645229] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:07:22.645504] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-14T17:07:22.645553] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-14T17:07:22.645740] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-14T17:07:22.645798] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-14T17:07:23.004749] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:23.023592] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T17:07:23.158057] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-14T17:07:23.630076] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T17:07:23.958088] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-14T17:07:24.030529] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T17:07:24.758038] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-14T17:07:24.978683] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T17:07:25.167231] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T17:07:25.558104] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-14T17:07:26.358095] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-14T17:07:26.814149] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T17:07:26.818263] [INFO ] [REMOTE ] AGRO: Full fetch complete (49172 records). [2025-10-14T17:07:26.818374] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-14T17:07:27.170174] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-14T17:07:27.224361] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-14T17:07:27.224465] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-14T17:07:27.225093] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-14T17:07:27.225160] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-14T17:07:27.226678] [DEBUG] [LOCAL ] AGRO: Trimmed 49172 records to 33181 (keeping 200 days of data) [2025-10-14T17:07:27.425276] [DEBUG] [LOCAL ] AGRO: Primary data saved (33181 records). [2025-10-14T17:07:27.425483] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-14T17:07:27.425588] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AGRO took 38.2s. Estimated remaining: 4h 44m 37s. Rate: 8.1 symbols/min [2025-10-14T17:07:27.599428] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:27.654788] [DEBUG] [LOCAL ] AI: Loaded 53759 existing records from primary storage. [2025-10-14T17:07:27.655199] [INFO ] [MAIN ] AI: Loaded 53759 existing records. [2025-10-14T17:07:27.838449] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:07:27.838747] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-14T17:07:27.838803] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-14T17:07:27.839166] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-14T17:07:27.839224] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-14T17:07:27.963167] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-14T17:07:28.150553] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T17:07:28.231013] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:28.382880] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T17:07:28.758121] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-14T17:07:29.417129] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:07:29.558071] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-14T17:07:30.358065] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-14T17:07:30.438362] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T17:07:30.946179] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T17:07:30.953851] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-14T17:07:30.953666] [INFO ] [REMOTE ] AGX: Full fetch complete (48829 records). [2025-10-14T17:07:30.954048] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-14T17:07:31.163751] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-14T17:07:31.342406] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-14T17:07:31.342489] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-14T17:07:31.343064] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-14T17:07:31.343127] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-14T17:07:31.344195] [DEBUG] [LOCAL ] AGX: Trimmed 48829 records to 33019 (keeping 200 days of data) [2025-10-14T17:07:31.541453] [DEBUG] [LOCAL ] AGX: Primary data saved (33019 records). [2025-10-14T17:07:31.541583] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-14T17:07:31.541681] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AGX took 36.4s. Estimated remaining: 4h 42m 25s. Rate: 8.2 symbols/min [2025-10-14T17:07:31.712596] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:31.762533] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-14T17:07:31.762911] [INFO ] [MAIN ] AIG: Loaded 53474 existing records. [2025-10-14T17:07:31.943611] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T17:07:31.964717] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-14T17:07:31.982929] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:07:31.986708] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-14T17:07:31.986772] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-14T17:07:31.987080] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-14T17:07:31.987246] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-14T17:07:32.406462] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:32.758077] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-14T17:07:33.558088] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-14T17:07:33.590638] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T17:07:34.358072] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-14T17:07:34.655184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T17:07:35.158106] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-14T17:07:35.707464] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T17:07:35.795695] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-14T17:07:35.958139] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-14T17:07:36.402076] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T17:07:36.736336] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T17:07:36.758037] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-14T17:07:37.481843] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T17:07:37.558050] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-14T17:07:38.324511] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T17:07:38.358047] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-14T17:07:39.158070] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-14T17:07:39.884068] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T17:07:39.958081] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-14T17:07:40.136686] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T17:07:40.758131] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-14T17:07:41.360617] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T17:07:41.468616] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T17:07:41.558060] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-14T17:07:42.352709] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T17:07:42.354220] [INFO ] [REMOTE ] AHT: Full fetch complete (9207 records). [2025-10-14T17:07:42.354292] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-14T17:07:42.365617] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-14T17:07:42.723314] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-14T17:07:42.723395] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-14T17:07:42.723610] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-14T17:07:42.723670] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-14T17:07:42.724106] [DEBUG] [LOCAL ] AHT: Trimmed 9207 records to 6353 (keeping 200 days of data) [2025-10-14T17:07:42.759103] [DEBUG] [LOCAL ] AHT: Primary data saved (6353 records). [2025-10-14T17:07:42.759227] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-14T17:07:42.759307] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHT took 20.5s. Estimated remaining: 4h 44m 42s. Rate: 8.1 symbols/min [2025-10-14T17:07:42.931878] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:42.932061] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-14T17:07:42.932100] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-14T17:07:42.932216] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-14T17:07:42.932288] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-14T17:07:42.932363] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-14T17:07:42.932403] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-14T17:07:43.166941] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-14T17:07:43.302887] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:43.958085] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-14T17:07:44.152925] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:07:44.153344] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-14T17:07:44.153437] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:07:44.153486] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-14T17:07:44.153519] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:07:44.153562] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-14T17:07:44.153890] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-14T17:07:44.154095] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-14T17:07:44.154143] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-14T17:07:44.154202] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AII took 1.4s. Estimated remaining: 4h 40m 55s. Rate: 8.2 symbols/min [2025-10-14T17:07:44.330384] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:44.353700] [DEBUG] [LOCAL ] AIN: Loaded 24485 existing records from primary storage. [2025-10-14T17:07:44.353993] [INFO ] [MAIN ] AIN: Loaded 24485 existing records. [2025-10-14T17:07:44.535969] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:07:44.536178] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-14T17:07:44.536229] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-14T17:07:44.536466] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-14T17:07:44.536524] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-14T17:07:44.763159] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-14T17:07:44.916955] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:45.136231] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T17:07:45.177331] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-14T17:07:45.558060] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-14T17:07:46.258063] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T17:07:46.358041] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-14T17:07:47.158052] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-14T17:07:47.372405] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T17:07:47.895331] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T17:07:47.901309] [INFO ] [REMOTE ] AHR: Full fetch complete (70796 records). [2025-10-14T17:07:47.901429] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-14T17:07:47.966165] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-14T17:07:48.299697] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T17:07:48.371694] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-14T17:07:48.371778] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-14T17:07:48.372447] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-14T17:07:48.372486] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-14T17:07:48.373877] [DEBUG] [LOCAL ] AHR: Trimmed 70796 records to 49074 (keeping 200 days of data) [2025-10-14T17:07:48.688233] [DEBUG] [LOCAL ] AHR: Primary data saved (49074 records). [2025-10-14T17:07:48.688367] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-14T17:07:48.688443] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AHR took 41.3s. Estimated remaining: 4h 39m 7s. Rate: 8.3 symbols/min [2025-10-14T17:07:48.763203] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-14T17:07:48.869339] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:07:48.882764] [DEBUG] [LOCAL ] AIO: Loaded 13409 existing records from primary storage. [2025-10-14T17:07:48.882963] [INFO ] [MAIN ] AIO: Loaded 13409 existing records. [2025-10-14T17:07:49.066117] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:07:49.066340] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-14T17:07:49.066387] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-14T17:07:49.066577] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-14T17:07:49.066633] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-14T17:07:49.431460] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:07:49.558034] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-14T17:07:50.000759] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-14T17:07:50.358114] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-14T17:07:50.548962] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T17:07:50.723935] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T17:07:51.001426] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T17:07:51.158078] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-14T17:07:51.958081] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-14T17:07:52.671175] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T17:07:52.758044] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-14T17:07:52.899343] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T17:07:53.558072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-14T17:07:54.244401] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T17:07:54.358057] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-14T17:07:54.538419] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T17:07:55.158094] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-14T17:07:55.958045] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-14T17:07:56.285045] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T17:07:56.443450] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T17:07:56.758052] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-14T17:07:57.170341] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-14T17:07:57.558073] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-14T17:07:58.358072] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-14T17:07:58.944091] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T17:07:58.999145] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T17:07:59.139734] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T17:07:59.158136] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-14T17:07:59.958118] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-14T17:08:00.354361] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T17:08:00.735714] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T17:08:00.744818] [INFO ] [REMOTE ] AIG: Full fetch complete (77553 records). [2025-10-14T17:08:00.745040] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-14T17:08:00.767398] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-14T17:08:01.221845] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-14T17:08:01.221978] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-14T17:08:01.223266] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-14T17:08:01.223409] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-14T17:08:01.225874] [DEBUG] [LOCAL ] AIG: Trimmed 77553 records to 53470 (keeping 200 days of data) [2025-10-14T17:08:01.558104] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-14T17:08:01.581566] [DEBUG] [LOCAL ] AIG: Primary data saved (53470 records). [2025-10-14T17:08:01.581789] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-14T17:08:01.581940] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AIG took 30.0s. Estimated remaining: 4h 42m 20s. Rate: 8.2 symbols/min [2025-10-14T17:08:01.767922] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:01.802296] [DEBUG] [LOCAL ] AIR: Loaded 29044 existing records from primary storage. [2025-10-14T17:08:01.803034] [INFO ] [MAIN ] AIR: Loaded 29044 existing records. [2025-10-14T17:08:01.982496] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T17:08:02.032845] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:08:02.033184] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-14T17:08:02.033242] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-14T17:08:02.033424] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-14T17:08:02.033463] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-14T17:08:02.363296] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-14T17:08:02.403321] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:03.158071] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-14T17:08:03.211213] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T17:08:03.666326] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-14T17:08:03.958046] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-14T17:08:04.321762] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:08:04.758091] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-14T17:08:04.880907] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T17:08:05.558059] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-14T17:08:05.924789] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T17:08:06.359030] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T17:08:06.358569] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-14T17:08:07.158172] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-14T17:08:07.958120] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-14T17:08:07.984716] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T17:08:08.500885] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-14T17:08:08.758050] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-14T17:08:09.080370] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T17:08:09.558080] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-14T17:08:09.794916] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T17:08:10.263722] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T17:08:10.358107] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-14T17:08:11.158072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-14T17:08:11.958081] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-14T17:08:12.437309] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T17:08:12.674735] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-14T17:08:12.758070] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-14T17:08:13.181730] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T17:08:13.184404] [INFO ] [REMOTE ] AIO: Full fetch complete (20139 records). [2025-10-14T17:08:13.184509] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-14T17:08:13.561161] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-14T17:08:13.581979] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-14T17:08:13.582091] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-14T17:08:13.582570] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-14T17:08:13.582620] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-14T17:08:13.583464] [DEBUG] [LOCAL ] AIO: Trimmed 20139 records to 13374 (keeping 200 days of data) [2025-10-14T17:08:13.674453] [DEBUG] [LOCAL ] AIO: Primary data saved (13374 records). [2025-10-14T17:08:13.674700] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-14T17:08:13.674932] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AIO took 25.0s. Estimated remaining: 4h 44m 58s. Rate: 8.1 symbols/min [2025-10-14T17:08:13.861913] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:13.891849] [DEBUG] [LOCAL ] AIT: Loaded 27046 existing records from primary storage. [2025-10-14T17:08:13.892228] [INFO ] [MAIN ] AIT: Loaded 27046 existing records. [2025-10-14T17:08:14.079251] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T17:08:14.118640] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:08:14.118964] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-14T17:08:14.119015] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-14T17:08:14.119391] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-14T17:08:14.119508] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-14T17:08:14.363245] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-14T17:08:14.561588] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:14.925684] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T17:08:15.158082] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-14T17:08:15.958135] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-14T17:08:16.075971] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T17:08:16.758089] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-14T17:08:17.208093] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-14T17:08:17.348563] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T17:08:17.558070] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-14T17:08:17.891794] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T17:08:18.358062] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-14T17:08:18.624618] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T17:08:19.158060] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-14T17:08:19.648753] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T17:08:19.958105] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-14T17:08:20.758073] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-14T17:08:21.212402] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:08:21.372704] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-14T17:08:21.558061] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-14T17:08:21.606454] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T17:08:22.358069] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-14T17:08:23.158043] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-14T17:08:23.691305] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:08:23.763390] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-14T17:08:23.770197] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-14T17:08:23.770401] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-14T17:08:23.976304] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-14T17:08:24.182133] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-14T17:08:24.182276] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-14T17:08:24.183125] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-14T17:08:24.183208] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-14T17:08:24.197281] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53764 (keeping 200 days of data) [2025-10-14T17:08:24.197166] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T17:08:24.522103] [DEBUG] [LOCAL ] AI: Primary data saved (53764 records). [2025-10-14T17:08:24.522239] [INFO ] [MAIN ] AI: Full history saved. [2025-10-14T17:08:24.522321] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AI took 57.1s. Estimated remaining: 4h 46m 48s. Rate: 8.0 symbols/min [2025-10-14T17:08:24.691391] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:24.726545] [DEBUG] [LOCAL ] AIV: Loaded 41190 existing records from primary storage. [2025-10-14T17:08:24.726862] [INFO ] [MAIN ] AIV: Loaded 41190 existing records. [2025-10-14T17:08:24.763152] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-14T17:08:24.904125] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:08:24.904353] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-14T17:08:24.904401] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-14T17:08:24.904707] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-14T17:08:24.904767] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-14T17:08:25.253807] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T17:08:25.276403] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:25.277194] [INFO ] [REMOTE ] AIN: Full fetch complete (33546 records). [2025-10-14T17:08:25.277274] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-14T17:08:25.564313] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-14T17:08:25.657593] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-14T17:08:25.657712] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-14T17:08:25.658347] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-14T17:08:25.658411] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-14T17:08:25.659245] [DEBUG] [LOCAL ] AIN: Trimmed 33546 records to 24467 (keeping 200 days of data) [2025-10-14T17:08:25.807498] [DEBUG] [LOCAL ] AIN: Primary data saved (24467 records). [2025-10-14T17:08:25.807636] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-14T17:08:25.807759] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIN took 41.7s. Estimated remaining: 4h 43m 11s. Rate: 8.1 symbols/min [2025-10-14T17:08:25.982852] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:26.018023] [DEBUG] [LOCAL ] AIZ: Loaded 29610 existing records from primary storage. [2025-10-14T17:08:26.018478] [INFO ] [MAIN ] AIZ: Loaded 29610 existing records. [2025-10-14T17:08:26.222952] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:08:26.223254] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-14T17:08:26.223428] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-14T17:08:26.223996] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-14T17:08:26.224221] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-14T17:08:26.324352] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T17:08:26.358864] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-14T17:08:26.628310] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:27.158338] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-14T17:08:27.158251] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T17:08:27.573731] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T17:08:27.958110] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-14T17:08:28.707795] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T17:08:28.758031] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-14T17:08:29.087326] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T17:08:29.558068] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-14T17:08:29.598363] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T17:08:30.358055] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-14T17:08:30.918311] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T17:08:31.158129] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-14T17:08:31.384851] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T17:08:31.958076] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-14T17:08:32.602196] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T17:08:32.758121] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-14T17:08:33.303084] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T17:08:33.558073] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-14T17:08:33.775620] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T17:08:34.358096] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-14T17:08:34.544132] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T17:08:35.158048] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-14T17:08:35.573175] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T17:08:35.958124] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-14T17:08:36.684458] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T17:08:36.758053] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-14T17:08:36.936335] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T17:08:37.558094] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-14T17:08:38.337783] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T17:08:38.358026] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-14T17:08:38.479442] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T17:08:38.483043] [INFO ] [REMOTE ] AIT: Full fetch complete (39127 records). [2025-10-14T17:08:38.483224] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-14T17:08:38.848545] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-14T17:08:38.848629] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-14T17:08:38.849124] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-14T17:08:38.849173] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-14T17:08:38.850117] [DEBUG] [LOCAL ] AIT: Trimmed 39127 records to 26970 (keeping 200 days of data) [2025-10-14T17:08:39.014244] [DEBUG] [LOCAL ] AIT: Primary data saved (26970 records). [2025-10-14T17:08:39.014376] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-14T17:08:39.014463] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIT took 25.3s. Estimated remaining: 4h 46m 18s. Rate: 8.0 symbols/min [2025-10-14T17:08:39.182283] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-14T17:08:39.184697] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:39.191043] [DEBUG] [LOCAL ] AIZN: Loaded 4085 existing records from primary storage. [2025-10-14T17:08:39.191218] [INFO ] [MAIN ] AIZN: Loaded 4085 existing records. [2025-10-14T17:08:39.365515] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:08:39.365738] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-14T17:08:39.365806] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-14T17:08:39.365995] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-14T17:08:39.366066] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-14T17:08:39.730791] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:39.757974] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T17:08:39.958144] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-14T17:08:40.370467] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T17:08:40.695212] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T17:08:40.758070] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-14T17:08:41.558083] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-14T17:08:42.175175] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T17:08:42.358082] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-14T17:08:43.049167] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T17:08:43.054045] [INFO ] [REMOTE ] AIR: Full fetch complete (40074 records). [2025-10-14T17:08:43.054174] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-14T17:08:43.163224] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-14T17:08:43.443836] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-14T17:08:43.443917] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-14T17:08:43.444444] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-14T17:08:43.444507] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-14T17:08:43.445384] [DEBUG] [LOCAL ] AIR: Trimmed 40074 records to 29018 (keeping 200 days of data) [2025-10-14T17:08:43.615847] [DEBUG] [LOCAL ] AIR: Primary data saved (29018 records). [2025-10-14T17:08:43.615992] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-14T17:08:43.616078] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIR took 42.0s. Estimated remaining: 4h 44m 36s. Rate: 8.1 symbols/min [2025-10-14T17:08:43.793139] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:43.824313] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T17:08:43.858346] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T17:08:43.877812] [DEBUG] [LOCAL ] AJG: Loaded 46567 existing records from primary storage. [2025-10-14T17:08:43.878197] [INFO ] [MAIN ] AJG: Loaded 46567 existing records. [2025-10-14T17:08:43.963226] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-14T17:08:44.068004] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:08:44.068321] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-14T17:08:44.068381] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-14T17:08:44.068684] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-14T17:08:44.068742] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-14T17:08:44.442867] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:44.758116] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-14T17:08:45.401426] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T17:08:45.558047] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-14T17:08:46.358084] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-14T17:08:46.475527] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T17:08:46.676831] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-14T17:08:47.056178] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T17:08:47.158025] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-14T17:08:47.958113] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-14T17:08:48.612558] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T17:08:48.758049] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-14T17:08:49.558051] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-14T17:08:49.719095] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T17:08:49.827686] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T17:08:50.029362] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-14T17:08:50.358077] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-14T17:08:51.158091] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-14T17:08:51.958056] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-14T17:08:52.129830] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T17:08:52.737876] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T17:08:52.758133] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-14T17:08:52.963428] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T17:08:53.558092] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-14T17:08:54.212687] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T17:08:54.289972] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T17:08:54.296043] [INFO ] [REMOTE ] AIV: Full fetch complete (60244 records). [2025-10-14T17:08:54.296258] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-14T17:08:54.365700] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-14T17:08:54.682608] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-14T17:08:54.682727] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-14T17:08:54.683350] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-14T17:08:54.683393] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-14T17:08:54.684585] [DEBUG] [LOCAL ] AIV: Trimmed 60244 records to 41269 (keeping 200 days of data) [2025-10-14T17:08:54.912965] [DEBUG] [LOCAL ] AIV: Primary data saved (41269 records). [2025-10-14T17:08:54.913090] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-14T17:08:54.913196] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIV took 30.4s. Estimated remaining: 4h 46m 34s. Rate: 8.0 symbols/min [2025-10-14T17:08:55.088260] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:08:55.088467] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-14T17:08:55.088507] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-14T17:08:55.088628] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-14T17:08:55.088705] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-14T17:08:55.088784] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-14T17:08:55.088842] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-14T17:08:55.167005] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-14T17:08:55.456706] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:08:55.635110] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T17:08:55.764153] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T17:08:55.958062] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-14T17:08:56.518617] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T17:08:56.758074] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-14T17:08:57.558125] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-14T17:08:58.119707] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T17:08:58.183976] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:08:58.358078] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-14T17:08:58.761967] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T17:08:59.158065] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-14T17:08:59.613932] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T17:08:59.958060] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-14T17:09:00.758102] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-14T17:09:01.255106] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T17:09:01.558074] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-14T17:09:01.766519] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T17:09:01.894744] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-14T17:09:02.358216] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-14T17:09:03.158099] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-14T17:09:03.626837] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T17:09:03.958082] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-14T17:09:04.758086] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-14T17:09:05.013817] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T17:09:05.042180] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T17:09:05.046090] [INFO ] [REMOTE ] AIZ: Full fetch complete (42758 records). [2025-10-14T17:09:05.046224] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-14T17:09:05.296183] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T17:09:05.465772] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-14T17:09:05.465860] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-14T17:09:05.466402] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-14T17:09:05.466464] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-14T17:09:05.467436] [DEBUG] [LOCAL ] AIZ: Trimmed 42758 records to 29563 (keeping 200 days of data) [2025-10-14T17:09:05.559187] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-14T17:09:05.655294] [DEBUG] [LOCAL ] AIZ: Primary data saved (29563 records). [2025-10-14T17:09:05.655468] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-14T17:09:05.655585] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZ took 39.8s. Estimated remaining: 4h 48m 10s. Rate: 8.0 symbols/min [2025-10-14T17:09:05.821261] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:09:05.863206] [DEBUG] [LOCAL ] AKR: Loaded 46010 existing records from primary storage. [2025-10-14T17:09:05.863574] [INFO ] [MAIN ] AKR: Loaded 46010 existing records. [2025-10-14T17:09:06.040960] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:09:06.041174] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-14T17:09:06.041221] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-14T17:09:06.041539] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-14T17:09:06.041578] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-14T17:09:06.214879] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T17:09:06.363243] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-14T17:09:06.416170] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:09:06.806526] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-14T17:09:07.158102] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-14T17:09:07.719388] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T17:09:07.958093] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-14T17:09:08.758085] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-14T17:09:09.558089] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-14T17:09:09.725553] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T17:09:10.174329] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T17:09:10.358068] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-14T17:09:10.808500] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-14T17:09:11.158090] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-14T17:09:11.587196] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T17:09:11.830055] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T17:09:11.831196] [INFO ] [REMOTE ] AIZN: Full fetch complete (5916 records). [2025-10-14T17:09:11.831264] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-14T17:09:11.963298] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-14T17:09:12.243610] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-14T17:09:12.243717] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-14T17:09:12.243904] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-14T17:09:12.243943] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-14T17:09:12.244312] [DEBUG] [LOCAL ] AIZN: Trimmed 5916 records to 4043 (keeping 200 days of data) [2025-10-14T17:09:12.272054] [DEBUG] [LOCAL ] AIZN: Primary data saved (4043 records). [2025-10-14T17:09:12.272191] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-14T17:09:12.272298] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZN took 33.3s. Estimated remaining: 4h 47m 34s. Rate: 8.0 symbols/min [2025-10-14T17:09:12.449181] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:09:12.490515] [DEBUG] [LOCAL ] AL: Loaded 44615 existing records from primary storage. [2025-10-14T17:09:12.490908] [INFO ] [MAIN ] AL: Loaded 44615 existing records. [2025-10-14T17:09:12.670566] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:09:12.670823] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-14T17:09:12.670873] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-14T17:09:12.671169] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-14T17:09:12.671210] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-14T17:09:12.763189] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-14T17:09:13.031186] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:09:13.140986] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-14T17:09:13.506858] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T17:09:13.558030] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-14T17:09:14.358117] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-14T17:09:15.158096] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-14T17:09:15.204755] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T17:09:15.841415] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T17:09:15.958044] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-14T17:09:16.758101] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-14T17:09:16.959034] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T17:09:17.401387] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-14T17:09:17.438531] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T17:09:17.558054] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-14T17:09:18.358074] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-14T17:09:19.043848] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T17:09:19.158076] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-14T17:09:19.411257] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-14T17:09:19.970395] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-14T17:09:19.989131] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T17:09:20.758078] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-14T17:09:21.558055] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-14T17:09:21.733843] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T17:09:22.287799] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T17:09:22.288841] [INFO ] [REMOTE ] AKA: Full fetch complete (2546 records). [2025-10-14T17:09:22.288910] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-14T17:09:22.362039] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-14T17:09:22.508956] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T17:09:22.507366] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T17:09:22.518322] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:09:22.518576] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:09:22.519080] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-14T17:09:22.519182] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-14T17:09:22.519279] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-14T17:09:22.519701] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-14T17:09:22.519786] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 27.6s. Estimated remaining: 4h 48m 52s. Rate: 7.9 symbols/min [2025-10-14T17:09:22.697142] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:09:22.697421] [DEBUG] [LOCAL ] ALB: No existing data file found in primary storage. [2025-10-14T17:09:22.697516] [WARN ] [MAIN ] ALB: No existing data found, performing full refresh instead. [2025-10-14T17:09:22.697632] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-14T17:09:22.697718] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-14T17:09:22.697796] [DEBUG] [LOCAL ] ALB: No primary data file found to delete. [2025-10-14T17:09:22.697870] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-14T17:09:23.058961] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:09:23.158083] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-14T17:09:23.958081] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-14T17:09:24.012371] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T17:09:24.758094] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-14T17:09:24.838863] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T17:09:25.558058] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-14T17:09:26.186896] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-14T17:09:26.256765] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T17:09:26.358042] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-14T17:09:27.163157] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-14T17:09:27.174586] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T17:09:27.915376] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T17:09:27.958026] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-14T17:09:28.582990] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T17:09:28.758083] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-14T17:09:29.558040] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-14T17:09:30.006734] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-14T17:09:30.358071] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-14T17:09:30.467325] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T17:09:30.717254] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T17:09:31.158088] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-14T17:09:31.820950] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T17:09:31.958103] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-14T17:09:32.758083] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-14T17:09:32.869145] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T17:09:33.558095] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-14T17:09:33.702450] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T17:09:33.966826] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T17:09:34.358131] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-14T17:09:35.158072] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-14T17:09:35.423279] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T17:09:35.916414] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T17:09:35.958075] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-14T17:09:36.617332] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T17:09:36.622313] [INFO ] [REMOTE ] AJG: Full fetch complete (69078 records). [2025-10-14T17:09:36.622412] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-14T17:09:36.763262] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-14T17:09:37.015088] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-14T17:09:37.015166] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-14T17:09:37.015846] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-14T17:09:37.015909] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-14T17:09:37.017184] [DEBUG] [LOCAL ] AJG: Trimmed 69078 records to 46548 (keeping 200 days of data) [2025-10-14T17:09:37.306112] [DEBUG] [LOCAL ] AJG: Primary data saved (46548 records). [2025-10-14T17:09:37.306237] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-14T17:09:37.306316] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 53.7s. Estimated remaining: 4h 52m 25s. Rate: 7.8 symbols/min [2025-10-14T17:09:37.478325] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:09:37.478517] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-14T17:09:37.478573] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-14T17:09:37.478707] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-14T17:09:37.478760] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-14T17:09:37.478831] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-14T17:09:37.478877] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-14T17:09:37.569778] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-14T17:09:37.841203] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:09:37.928286] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-14T17:09:38.361191] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-14T17:09:38.365234] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T17:09:38.372084] [INFO ] [REMOTE ] AKR: Full fetch complete (65415 records). [2025-10-14T17:09:38.372235] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-14T17:09:38.778312] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-14T17:09:38.778552] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-14T17:09:38.779554] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-14T17:09:38.779626] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-14T17:09:38.781487] [DEBUG] [LOCAL ] AKR: Trimmed 65415 records to 46079 (keeping 200 days of data) [2025-10-14T17:09:39.102241] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T17:09:39.137766] [DEBUG] [LOCAL ] AKR: Primary data saved (46079 records). [2025-10-14T17:09:39.138568] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-14T17:09:39.139461] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 33.5s. Estimated remaining: 4h 49m 22s. Rate: 7.9 symbols/min [2025-10-14T17:09:39.163199] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-14T17:09:39.323383] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:09:39.363869] [DEBUG] [LOCAL ] ALE: Loaded 31630 existing records from primary storage. [2025-10-14T17:09:39.364322] [INFO ] [MAIN ] ALE: Loaded 31630 existing records. [2025-10-14T17:09:39.557119] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:09:39.557401] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-14T17:09:39.557453] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-14T17:09:39.557771] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-14T17:09:39.557834] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-14T17:09:39.926025] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:09:39.958076] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-14T17:09:40.043683] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T17:09:40.710557] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T17:09:40.758035] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-14T17:09:41.226569] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T17:09:41.558109] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-14T17:09:42.098912] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T17:09:42.358062] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-14T17:09:43.158093] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-14T17:09:43.512556] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-14T17:09:43.807919] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T17:09:43.813197] [INFO ] [REMOTE ] AL: Full fetch complete (63206 records). [2025-10-14T17:09:43.813302] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-14T17:09:43.963245] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-14T17:09:44.197029] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-14T17:09:44.197112] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-14T17:09:44.197768] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-14T17:09:44.197832] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-14T17:09:44.199308] [DEBUG] [LOCAL ] AL: Trimmed 63206 records to 44659 (keeping 200 days of data) [2025-10-14T17:09:44.472030] [DEBUG] [LOCAL ] AL: Primary data saved (44659 records). [2025-10-14T17:09:44.472161] [INFO ] [MAIN ] AL: Full history saved. [2025-10-14T17:09:44.472239] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AL took 32.2s. Estimated remaining: 4h 48m 8s. Rate: 8.0 symbols/min [2025-10-14T17:09:44.523286] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T17:09:44.758056] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-14T17:09:45.558193] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-14T17:09:46.149969] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-14T17:09:46.218501] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T17:09:46.358207] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-14T17:09:46.787384] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T17:09:47.158089] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-14T17:09:47.958098] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-14T17:09:48.021334] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T17:09:48.281454] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T17:09:48.758182] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-14T17:09:49.189381] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T17:09:49.558060] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-14T17:09:49.883302] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:09:50.358087] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-14T17:09:51.158205] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-14T17:09:51.591461] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T17:09:51.868536] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:09:51.958111] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-14T17:09:52.758217] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-14T17:09:53.063338] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T17:09:53.558085] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-14T17:09:53.932796] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-14T17:09:53.956753] [INFO ] [REMOTE ] ALB: Full fetch complete (77032 records). [2025-10-14T17:09:53.958467] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T17:09:53.957570] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-14T17:09:54.367970] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-14T17:09:54.412095] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-14T17:09:54.412236] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-14T17:09:54.413627] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-14T17:09:54.413738] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-14T17:09:54.415949] [DEBUG] [LOCAL ] ALB: Trimmed 77032 records to 53335 (keeping 200 days of data) [2025-10-14T17:09:54.742325] [DEBUG] [LOCAL ] ALB: Primary data saved (53335 records). [2025-10-14T17:09:54.742464] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-14T17:09:54.742533] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALB took 32.2s. Estimated remaining: 4h 49m 20s. Rate: 7.9 symbols/min [2025-10-14T17:09:54.853637] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T17:09:55.158078] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-14T17:09:55.239046] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T17:09:55.958076] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-14T17:09:56.466692] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T17:09:56.758113] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-14T17:09:57.363163] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T17:09:57.558040] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-14T17:09:58.657018] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T17:09:58.668856] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-14T17:09:58.691243] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:09:59.158126] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-14T17:10:00.169631] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T17:10:00.179043] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-14T17:10:00.596453] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-14T17:10:00.758062] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-14T17:10:01.643714] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T17:10:01.651481] [INFO ] [REMOTE ] ALE: Full fetch complete (43666 records). [2025-10-14T17:10:01.651831] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-14T17:10:02.155954] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-14T17:10:02.156153] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-14T17:10:02.157042] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-14T17:10:02.157223] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-14T17:10:02.160547] [DEBUG] [LOCAL ] ALE: Trimmed 43666 records to 31799 (keeping 200 days of data) [2025-10-14T17:10:02.317215] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T17:10:02.334029] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-14T17:10:02.436124] [DEBUG] [LOCAL ] ALE: Primary data saved (31799 records). [2025-10-14T17:10:02.436330] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-14T17:10:02.438505] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALE took 23.3s. Estimated remaining: 4h 49m 16s. Rate: 7.9 symbols/min [2025-10-14T17:10:04.380941] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-14T17:10:04.387410] [INFO ] [REMOTE ] ALC: Full fetch complete (73472 records). [2025-10-14T17:10:04.387576] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-14T17:10:04.807094] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-14T17:10:04.807191] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-14T17:10:04.807977] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-14T17:10:04.808042] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-14T17:10:04.809494] [DEBUG] [LOCAL ] ALC: Trimmed 73472 records to 51170 (keeping 200 days of data) [2025-10-14T17:10:05.137200] [DEBUG] [LOCAL ] ALC: Primary data saved (51170 records). [2025-10-14T17:10:05.137688] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-14T17:10:05.137796] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALC took 27.8s. Estimated remaining: 4h 46m 49s. Rate: 8.0 symbols/min [2025-10-14T17:10:05.888404] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:05.949866] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:05.966310] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:05.973881] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:05.975574] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-14T17:10:05.975772] [DEBUG] [LOCAL ] ALEX: No existing data file found in primary storage. [2025-10-14T17:10:05.975940] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-14T17:10:05.976540] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-14T17:10:05.976718] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-14T17:10:05.976938] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-14T17:10:05.977008] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-14T17:10:05.990061] [WARN ] [MAIN ] ALEX: No existing data found, performing full refresh instead. [2025-10-14T17:10:06.021791] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-14T17:10:06.021939] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-14T17:10:06.037273] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-10-14T17:10:06.057604] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-14T17:10:06.199310] [DEBUG] [LOCAL ] ALG: Loaded 9742 existing records from primary storage. [2025-10-14T17:10:06.265180] [INFO ] [MAIN ] ALG: Loaded 9742 existing records. [2025-10-14T17:10:06.694142] [DEBUG] [LOCAL ] ALIT: Loaded 52786 existing records from primary storage. [2025-10-14T17:10:06.773372] [INFO ] [MAIN ] ALIT: Loaded 52786 existing records. [2025-10-14T17:10:06.953629] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:07.069049] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-14T17:10:07.076989] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:07.093124] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-14T17:10:07.093206] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-14T17:10:07.139736] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-14T17:10:07.182417] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-14T17:10:07.247807] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:07.286867] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-14T17:10:07.345430] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:07.360947] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-14T17:10:07.361095] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-14T17:10:07.376589] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-14T17:10:07.417387] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-14T17:10:07.471984] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:10:07.521918] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-14T17:10:07.594333] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:10:07.625013] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-14T17:10:07.646068] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:10:07.651444] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-14T17:10:07.698812] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-14T17:10:07.764174] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-14T17:10:07.800700] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-14T17:10:07.881197] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALH took 2.7s. Estimated remaining: 4h 44m 27s. Rate: 8.0 symbols/min [2025-10-14T17:10:08.150415] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:08.168760] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-14T17:10:08.367925] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:08.374383] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:08.375483] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-14T17:10:08.440663] [DEBUG] [LOCAL ] ALK: Loaded 53061 existing records from primary storage. [2025-10-14T17:10:08.441128] [INFO ] [MAIN ] ALK: Loaded 53061 existing records. [2025-10-14T17:10:08.637370] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:08.637701] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-14T17:10:08.637766] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-14T17:10:08.638271] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-14T17:10:08.638330] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-14T17:10:09.036745] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:09.037344] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-14T17:10:09.164296] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T17:10:09.171972] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-14T17:10:09.237612] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T17:10:09.240856] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-14T17:10:10.078754] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T17:10:10.093906] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-14T17:10:10.095847] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T17:10:10.110762] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-14T17:10:10.114521] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T17:10:10.118265] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-14T17:10:10.841217] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T17:10:10.852570] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-14T17:10:10.865917] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T17:10:11.158128] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-14T17:10:11.271837] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T17:10:11.481155] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:10:11.800990] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T17:10:11.958149] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-14T17:10:12.377890] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T17:10:12.758113] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-14T17:10:13.558088] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-14T17:10:13.813587] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T17:10:14.204225] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T17:10:14.358109] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-14T17:10:15.007705] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T17:10:15.026303] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T17:10:15.158088] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-14T17:10:15.958075] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-14T17:10:16.339500] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T17:10:16.758106] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-14T17:10:17.558130] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-14T17:10:17.692844] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T17:10:17.731565] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T17:10:18.358072] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-14T17:10:18.596345] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T17:10:19.158072] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-14T17:10:19.958064] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-14T17:10:20.137312] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T17:10:20.758065] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-14T17:10:21.028187] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T17:10:21.053409] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T17:10:21.558109] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-14T17:10:22.358128] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-14T17:10:22.560439] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T17:10:22.675046] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T17:10:22.867627] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T17:10:23.158066] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-14T17:10:23.958086] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-14T17:10:24.374844] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T17:10:24.387368] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T17:10:24.758098] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-14T17:10:25.558122] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-14T17:10:26.358085] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-14T17:10:26.733375] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T17:10:27.158060] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-14T17:10:27.198992] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T17:10:27.554510] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T17:10:27.864049] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T17:10:27.865341] [INFO ] [REMOTE ] ALG: Full fetch complete (15397 records). [2025-10-14T17:10:27.865423] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-14T17:10:27.963202] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-14T17:10:28.243136] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-14T17:10:28.243211] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-14T17:10:28.243492] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-14T17:10:28.243554] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-14T17:10:28.244059] [DEBUG] [LOCAL ] ALG: Trimmed 15397 records to 9741 (keeping 200 days of data) [2025-10-14T17:10:28.305032] [DEBUG] [LOCAL ] ALG: Primary data saved (9741 records). [2025-10-14T17:10:28.305156] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-14T17:10:28.305234] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALG took 23.2s. Estimated remaining: 4h 50m 21s. Rate: 7.9 symbols/min [2025-10-14T17:10:28.477427] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:28.526394] [DEBUG] [LOCAL ] ALL: Loaded 49796 existing records from primary storage. [2025-10-14T17:10:28.526772] [INFO ] [MAIN ] ALL: Loaded 49796 existing records. [2025-10-14T17:10:28.710986] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:28.711206] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-14T17:10:28.711253] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-14T17:10:28.711575] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-14T17:10:28.711632] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-14T17:10:28.767913] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-14T17:10:29.096518] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:29.113813] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T17:10:29.558081] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-14T17:10:30.358066] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-14T17:10:30.639090] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-14T17:10:30.893131] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T17:10:31.158179] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-14T17:10:31.915573] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:10:31.958041] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-14T17:10:32.758075] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-14T17:10:32.901000] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T17:10:33.517541] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T17:10:33.558025] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-14T17:10:33.813724] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T17:10:33.817607] [INFO ] [REMOTE ] ALEX: Full fetch complete (44659 records). [2025-10-14T17:10:33.817740] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-14T17:10:34.192951] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-14T17:10:34.193024] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-14T17:10:34.193488] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-14T17:10:34.193528] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-14T17:10:34.194434] [DEBUG] [LOCAL ] ALEX: Trimmed 44659 records to 31123 (keeping 200 days of data) [2025-10-14T17:10:34.361106] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-14T17:10:34.400309] [DEBUG] [LOCAL ] ALEX: Primary data saved (31123 records). [2025-10-14T17:10:34.400480] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-14T17:10:34.400585] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALEX took 29.3s. Estimated remaining: 4h 49m 31s. Rate: 7.9 symbols/min [2025-10-14T17:10:34.623799] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:34.663290] [DEBUG] [LOCAL ] ALLE: Loaded 44301 existing records from primary storage. [2025-10-14T17:10:34.663589] [INFO ] [MAIN ] ALLE: Loaded 44301 existing records. [2025-10-14T17:10:34.840530] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:34.840811] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-14T17:10:34.840858] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-14T17:10:34.841081] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-14T17:10:34.841137] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-14T17:10:35.166255] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-14T17:10:35.197129] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:35.365801] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T17:10:35.958040] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-14T17:10:36.077269] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T17:10:36.758085] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-14T17:10:37.080225] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-14T17:10:37.445470] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T17:10:37.558035] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-14T17:10:38.120391] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T17:10:38.129206] [INFO ] [REMOTE ] ALIT: Full fetch complete (76617 records). [2025-10-14T17:10:38.129385] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-14T17:10:38.365871] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-14T17:10:38.522443] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-14T17:10:38.522542] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-14T17:10:38.523320] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-14T17:10:38.523398] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-14T17:10:38.524915] [DEBUG] [LOCAL ] ALIT: Trimmed 76617 records to 52792 (keeping 200 days of data) [2025-10-14T17:10:38.907371] [DEBUG] [LOCAL ] ALIT: Primary data saved (52792 records). [2025-10-14T17:10:38.907560] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-14T17:10:38.907698] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 33.8s. Estimated remaining: 4h 47m 60s. Rate: 7.9 symbols/min [2025-10-14T17:10:39.179377] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-14T17:10:39.185860] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:39.256589] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-14T17:10:39.257492] [INFO ] [MAIN ] ALLY: Loaded 53223 existing records. [2025-10-14T17:10:39.535857] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T17:10:39.562564] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:39.562932] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-14T17:10:39.578145] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-14T17:10:39.578894] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-14T17:10:39.578969] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-14T17:10:39.963166] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-14T17:10:40.028860] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:40.520958] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-14T17:10:40.758043] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-14T17:10:40.790509] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T17:10:41.558056] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-14T17:10:41.669844] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T17:10:42.358068] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-14T17:10:42.579693] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T17:10:43.158064] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-14T17:10:43.365123] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T17:10:43.768374] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T17:10:43.958081] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-14T17:10:44.758462] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-14T17:10:44.763761] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T17:10:45.558101] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-14T17:10:45.704477] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T17:10:46.358096] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-14T17:10:46.681895] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T17:10:47.158090] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-14T17:10:47.367252] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T17:10:47.958934] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-14T17:10:47.964266] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T17:10:48.758092] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-14T17:10:49.105146] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-14T17:10:49.111350] [INFO ] [REMOTE ] ALK: Full fetch complete (76986 records). [2025-10-14T17:10:49.111522] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-14T17:10:49.537738] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-14T17:10:49.537886] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-14T17:10:49.538776] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-14T17:10:49.538841] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-14T17:10:49.540556] [DEBUG] [LOCAL ] ALK: Trimmed 76986 records to 53079 (keeping 200 days of data) [2025-10-14T17:10:49.599090] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-14T17:10:49.864580] [DEBUG] [LOCAL ] ALK: Primary data saved (53079 records). [2025-10-14T17:10:49.864736] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-14T17:10:49.864819] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALK took 42.0s. Estimated remaining: 4h 49m 23s. Rate: 7.9 symbols/min [2025-10-14T17:10:50.041232] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:50.070689] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-14T17:10:50.122339] [DEBUG] [LOCAL ] ALSN: Loaded 43420 existing records from primary storage. [2025-10-14T17:10:50.122679] [INFO ] [MAIN ] ALSN: Loaded 43420 existing records. [2025-10-14T17:10:50.299924] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:10:50.300247] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-14T17:10:50.300303] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-14T17:10:50.300594] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-14T17:10:50.300683] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-14T17:10:50.365306] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-14T17:10:50.663014] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:10:50.693873] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-14T17:10:51.158045] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-14T17:10:51.350513] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T17:10:51.825769] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T17:10:51.958101] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-14T17:10:52.753840] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T17:10:52.762012] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-14T17:10:53.415537] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T17:10:53.558089] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-14T17:10:54.365070] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-14T17:10:54.388796] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T17:10:54.584530] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T17:10:55.158076] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-14T17:10:55.958161] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-14T17:10:56.110247] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T17:10:56.519515] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T17:10:56.758163] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-14T17:10:57.206754] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:10:57.558067] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-14T17:10:58.358109] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-14T17:10:58.388888] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T17:10:58.979704] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T17:10:58.985886] [INFO ] [REMOTE ] ALL: Full fetch complete (72404 records). [2025-10-14T17:10:58.986077] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-14T17:10:59.163387] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-14T17:10:59.414368] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-14T17:10:59.414446] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-14T17:10:59.415148] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-14T17:10:59.415209] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-14T17:10:59.420865] [DEBUG] [LOCAL ] ALL: Trimmed 72404 records to 49767 (keeping 200 days of data) [2025-10-14T17:10:59.753343] [DEBUG] [LOCAL ] ALL: Primary data saved (49767 records). [2025-10-14T17:10:59.753476] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-14T17:10:59.753556] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALL took 31.4s. Estimated remaining: 4h 50m 16s. Rate: 7.9 symbols/min [2025-10-14T17:10:59.924346] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:10:59.944585] [DEBUG] [LOCAL ] ALTG: Loaded 23514 existing records from primary storage. [2025-10-14T17:10:59.944869] [INFO ] [MAIN ] ALTG: Loaded 23514 existing records. [2025-10-14T17:10:59.976506] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-14T17:11:00.130394] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:00.130600] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-14T17:11:00.130799] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-14T17:11:00.131501] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-14T17:11:00.131563] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-14T17:11:00.471784] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-14T17:11:00.541766] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:00.586633] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T17:11:00.758056] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-14T17:11:01.442043] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T17:11:01.558024] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-14T17:11:01.648585] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T17:11:02.358061] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-14T17:11:03.101907] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T17:11:03.158049] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-14T17:11:03.958044] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-14T17:11:04.268227] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T17:11:04.371822] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T17:11:04.758081] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-14T17:11:05.558051] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-14T17:11:05.742058] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T17:11:06.194856] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T17:11:06.358070] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-14T17:11:07.013427] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T17:11:07.158054] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-14T17:11:07.616200] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T17:11:07.958097] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-14T17:11:08.527415] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T17:11:08.758134] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-14T17:11:08.939277] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T17:11:09.558076] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-14T17:11:10.051525] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-14T17:11:10.358085] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-14T17:11:11.031745] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T17:11:11.036520] [INFO ] [REMOTE ] ALLE: Full fetch complete (64751 records). [2025-10-14T17:11:11.036713] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-14T17:11:11.158789] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-14T17:11:11.430632] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-14T17:11:11.430753] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-14T17:11:11.431398] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-14T17:11:11.431442] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-14T17:11:11.432824] [DEBUG] [LOCAL ] ALLE: Trimmed 64751 records to 44314 (keeping 200 days of data) [2025-10-14T17:11:11.547948] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T17:11:11.737322] [DEBUG] [LOCAL ] ALLE: Primary data saved (44314 records). [2025-10-14T17:11:11.737500] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-14T17:11:11.738197] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALLE took 37.3s. Estimated remaining: 4h 52m 3s. Rate: 7.8 symbols/min [2025-10-14T17:11:11.905796] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:11.916947] [DEBUG] [LOCAL ] ALUR: Loaded 9743 existing records from primary storage. [2025-10-14T17:11:11.917173] [INFO ] [MAIN ] ALUR: Loaded 9743 existing records. [2025-10-14T17:11:11.970205] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-14T17:11:12.095323] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:12.095558] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-14T17:11:12.095605] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-14T17:11:12.095795] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-14T17:11:12.095852] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-14T17:11:12.443029] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:12.758053] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-14T17:11:12.813956] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T17:11:13.225428] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T17:11:13.558067] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-14T17:11:13.966312] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T17:11:14.358038] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-14T17:11:14.601986] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T17:11:15.158075] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-14T17:11:15.958064] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-14T17:11:16.564938] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-14T17:11:16.758051] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-14T17:11:16.823487] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T17:11:16.828737] [INFO ] [REMOTE ] ALSN: Full fetch complete (62413 records). [2025-10-14T17:11:16.828838] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-14T17:11:17.252461] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-14T17:11:17.253173] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-14T17:11:17.253779] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T17:11:17.254471] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-14T17:11:17.259394] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-14T17:11:17.261278] [DEBUG] [LOCAL ] ALSN: Trimmed 62413 records to 43460 (keeping 200 days of data) [2025-10-14T17:11:17.524881] [DEBUG] [LOCAL ] ALSN: Primary data saved (43460 records). [2025-10-14T17:11:17.525011] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-14T17:11:17.525859] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 27.7s. Estimated remaining: 4h 51m 6s. Rate: 7.8 symbols/min [2025-10-14T17:11:17.563252] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-14T17:11:17.699572] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:17.740865] [DEBUG] [LOCAL ] ALV: Loaded 42115 existing records from primary storage. [2025-10-14T17:11:17.741144] [INFO ] [MAIN ] ALV: Loaded 42115 existing records. [2025-10-14T17:11:17.914738] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:17.914974] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-14T17:11:17.915020] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-14T17:11:17.915897] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-14T17:11:17.915955] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-14T17:11:18.300220] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:18.358061] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-14T17:11:18.533554] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T17:11:18.804012] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T17:11:19.158054] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-14T17:11:19.958031] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-14T17:11:20.083097] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T17:11:20.147930] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T17:11:20.758112] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-14T17:11:21.303939] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T17:11:21.558062] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-14T17:11:21.613935] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T17:11:22.358138] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-14T17:11:23.158062] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-14T17:11:23.206624] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T17:11:23.212461] [INFO ] [REMOTE ] ALLY: Full fetch complete (77129 records). [2025-10-14T17:11:23.212567] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-14T17:11:23.625249] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-14T17:11:23.625336] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-14T17:11:23.626140] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-14T17:11:23.626204] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-14T17:11:23.627753] [DEBUG] [LOCAL ] ALLY: Trimmed 77129 records to 53223 (keeping 200 days of data) [2025-10-14T17:11:23.953710] [DEBUG] [LOCAL ] ALLY: Primary data saved (53223 records). [2025-10-14T17:11:23.953856] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-14T17:11:23.953948] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 45.0s. Estimated remaining: 4h 50m 27s. Rate: 7.8 symbols/min [2025-10-14T17:11:23.975446] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-14T17:11:24.139839] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T17:11:24.173572] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:24.175457] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T17:11:24.192373] [DEBUG] [LOCAL ] ALX: Loaded 6822 existing records from primary storage. [2025-10-14T17:11:24.192612] [INFO ] [MAIN ] ALX: Loaded 6822 existing records. [2025-10-14T17:11:24.415347] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:24.415609] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-14T17:11:24.415688] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-14T17:11:24.416000] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-14T17:11:24.416058] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-14T17:11:24.763197] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-14T17:11:24.836941] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:25.150093] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T17:11:25.558087] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-14T17:11:26.126460] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T17:11:26.358056] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-14T17:11:26.423739] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T17:11:27.158041] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-14T17:11:27.484925] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T17:11:27.958110] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-14T17:11:28.758066] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-14T17:11:28.822950] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T17:11:28.821579] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T17:11:29.522573] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T17:11:29.558073] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-14T17:11:30.059960] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T17:11:30.358059] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-14T17:11:31.158076] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-14T17:11:31.684142] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T17:11:31.880573] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T17:11:31.958054] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-14T17:11:32.758143] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-14T17:11:33.182915] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T17:11:33.478910] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:11:33.558052] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-14T17:11:34.358075] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-14T17:11:34.822140] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T17:11:35.158046] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-14T17:11:35.300822] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T17:11:35.958060] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-14T17:11:36.573169] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T17:11:36.732127] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T17:11:36.758027] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-14T17:11:37.392995] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T17:11:37.558066] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-14T17:11:38.171728] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-14T17:11:38.358090] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-14T17:11:39.158071] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-14T17:11:39.854538] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T17:11:39.867737] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T17:11:39.869458] [INFO ] [REMOTE ] ALUR: Full fetch complete (19556 records). [2025-10-14T17:11:39.869526] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-14T17:11:39.963252] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-14T17:11:40.246015] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-14T17:11:40.246091] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-14T17:11:40.246372] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-14T17:11:40.246413] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-14T17:11:40.246947] [DEBUG] [LOCAL ] ALUR: Trimmed 19556 records to 9637 (keeping 200 days of data) [2025-10-14T17:11:40.299559] [DEBUG] [LOCAL ] ALUR: Primary data saved (9637 records). [2025-10-14T17:11:40.299717] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-14T17:11:40.299808] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALUR took 28.6s. Estimated remaining: 4h 53m 60s. Rate: 7.8 symbols/min [2025-10-14T17:11:40.466671] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:40.521774] [DEBUG] [LOCAL ] AM: Loaded 51957 existing records from primary storage. [2025-10-14T17:11:40.522096] [INFO ] [MAIN ] AM: Loaded 51957 existing records. [2025-10-14T17:11:40.695955] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:40.696186] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-14T17:11:40.696234] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-14T17:11:40.696442] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-14T17:11:40.696498] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-14T17:11:40.763191] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-14T17:11:41.054293] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:41.546107] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T17:11:41.567925] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-14T17:11:41.573466] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T17:11:42.356845] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T17:11:42.358806] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-14T17:11:43.158070] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-14T17:11:43.758711] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T17:11:43.958084] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-14T17:11:44.758046] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-14T17:11:44.799335] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T17:11:45.526159] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T17:11:45.558018] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-14T17:11:45.602621] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T17:11:46.358111] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-14T17:11:46.991595] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:11:47.158106] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-14T17:11:47.526339] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T17:11:47.531528] [INFO ] [REMOTE ] ALTG: Full fetch complete (33530 records). [2025-10-14T17:11:47.531878] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-14T17:11:47.963735] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-14T17:11:48.107388] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-14T17:11:48.107514] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-14T17:11:48.108342] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-14T17:11:48.108430] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-14T17:11:48.109801] [DEBUG] [LOCAL ] ALTG: Trimmed 33530 records to 23430 (keeping 200 days of data) [2025-10-14T17:11:48.308928] [DEBUG] [LOCAL ] ALTG: Primary data saved (23430 records). [2025-10-14T17:11:48.309209] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-14T17:11:48.309324] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALTG took 48.6s. Estimated remaining: 4h 53m 59s. Rate: 7.7 symbols/min [2025-10-14T17:11:48.599403] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:48.615320] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T17:11:48.621430] [INFO ] [REMOTE ] ALV: Full fetch complete (61910 records). [2025-10-14T17:11:48.621607] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-14T17:11:48.761084] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-14T17:11:48.874135] [DEBUG] [LOCAL ] AMBC: Loaded 36300 existing records from primary storage. [2025-10-14T17:11:48.912773] [INFO ] [MAIN ] AMBC: Loaded 36300 existing records. [2025-10-14T17:11:49.249572] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-14T17:11:49.253259] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-14T17:11:49.253207] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:49.253445] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-14T17:11:49.253520] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-14T17:11:49.254197] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-14T17:11:49.254341] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-14T17:11:49.254481] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-14T17:11:49.254537] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-14T17:11:49.358669] [DEBUG] [LOCAL ] ALV: Trimmed 61910 records to 42132 (keeping 200 days of data) [2025-10-14T17:11:49.739154] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:49.753460] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-14T17:11:49.755099] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T17:11:49.912394] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T17:11:49.962040] [DEBUG] [LOCAL ] ALV: Primary data saved (42132 records). [2025-10-14T17:11:49.962185] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-14T17:11:49.963486] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALV took 32.4s. Estimated remaining: 4h 51m 20s. Rate: 7.8 symbols/min [2025-10-14T17:11:50.159016] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:50.208268] [DEBUG] [LOCAL ] AMBP: Loaded 44625 existing records from primary storage. [2025-10-14T17:11:50.208617] [INFO ] [MAIN ] AMBP: Loaded 44625 existing records. [2025-10-14T17:11:50.363210] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-14T17:11:50.404977] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:50.405219] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-14T17:11:50.405285] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-14T17:11:50.405530] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-14T17:11:50.405597] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-14T17:11:50.764858] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:51.050483] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T17:11:51.072836] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T17:11:51.158069] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-14T17:11:51.958039] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-14T17:11:52.105353] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T17:11:52.758094] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-14T17:11:53.558042] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-14T17:11:53.574696] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T17:11:53.625602] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T17:11:54.358059] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-14T17:11:54.587387] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T17:11:55.158112] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-14T17:11:55.242981] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T17:11:55.244973] [INFO ] [REMOTE ] ALX: Full fetch complete (7704 records). [2025-10-14T17:11:55.245047] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-14T17:11:55.612178] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-14T17:11:55.612273] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-14T17:11:55.612499] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-14T17:11:55.612560] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-14T17:11:55.612997] [DEBUG] [LOCAL ] ALX: Trimmed 7704 records to 6886 (keeping 200 days of data) [2025-10-14T17:11:55.654772] [DEBUG] [LOCAL ] ALX: Primary data saved (6886 records). [2025-10-14T17:11:55.654882] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-14T17:11:55.654980] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALX took 31.7s. Estimated remaining: 4h 50m 24s. Rate: 7.8 symbols/min [2025-10-14T17:11:55.827673] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:55.827888] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-14T17:11:55.827945] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-14T17:11:55.828055] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-14T17:11:55.828097] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-14T17:11:55.828137] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-14T17:11:55.828190] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-14T17:11:55.963208] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-14T17:11:56.205853] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:11:56.758082] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-14T17:11:57.040906] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T17:11:57.370463] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T17:11:57.558090] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-14T17:11:58.306541] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T17:11:58.358032] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-14T17:11:58.890948] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T17:11:59.158075] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-14T17:11:59.361363] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:11:59.361680] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-14T17:11:59.361766] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:11:59.361811] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-14T17:11:59.361843] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:11:59.361878] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-14T17:11:59.361950] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-14T17:11:59.362005] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-14T17:11:59.362047] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-14T17:11:59.362093] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBQ took 3.7s. Estimated remaining: 4h 48m 41s. Rate: 7.9 symbols/min [2025-10-14T17:11:59.536040] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:11:59.561385] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T17:11:59.617373] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-14T17:11:59.617820] [INFO ] [MAIN ] AMC: Loaded 53762 existing records. [2025-10-14T17:11:59.792576] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:11:59.792830] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-14T17:11:59.792877] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-14T17:11:59.793354] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-14T17:11:59.793410] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-14T17:11:59.970257] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-14T17:12:00.141495] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:00.758122] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-14T17:12:01.558067] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-14T17:12:01.920267] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T17:12:02.358077] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-14T17:12:03.163745] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-14T17:12:03.176473] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T17:12:03.392906] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-14T17:12:03.448370] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T17:12:03.958059] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-14T17:12:04.758061] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-14T17:12:04.849380] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T17:12:04.924552] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T17:12:05.558063] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-14T17:12:06.358138] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-14T17:12:07.158098] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-14T17:12:07.891738] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (3.13 seconds). [2025-10-14T17:12:07.958069] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-14T17:12:08.152094] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-14T17:12:08.244077] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T17:12:08.510526] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T17:12:08.758073] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-14T17:12:09.558067] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-14T17:12:10.054068] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-14T17:12:10.129034] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T17:12:10.358073] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-14T17:12:11.158061] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-14T17:12:11.241060] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T17:12:11.691770] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T17:12:11.958144] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-14T17:12:12.758083] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-14T17:12:13.558080] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-14T17:12:13.666058] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T17:12:13.703230] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-14T17:12:14.107408] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T17:12:14.114365] [INFO ] [REMOTE ] AM: Full fetch complete (75712 records). [2025-10-14T17:12:14.114519] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-14T17:12:14.364384] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-14T17:12:14.541195] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-14T17:12:14.541277] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-14T17:12:14.542161] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-14T17:12:14.542229] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-14T17:12:14.543874] [DEBUG] [LOCAL ] AM: Trimmed 75712 records to 51955 (keeping 200 days of data) [2025-10-14T17:12:14.854305] [DEBUG] [LOCAL ] AM: Primary data saved (51955 records). [2025-10-14T17:12:14.854435] [INFO ] [MAIN ] AM: Full history saved. [2025-10-14T17:12:14.855216] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 34.6s. Estimated remaining: 4h 51m 42s. Rate: 7.8 symbols/min [2025-10-14T17:12:15.046709] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T17:12:15.049002] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:15.107011] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-14T17:12:15.107324] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-14T17:12:15.168854] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-14T17:12:15.290699] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:15.290952] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-14T17:12:15.291022] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-14T17:12:15.291242] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-14T17:12:15.291298] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-14T17:12:15.652316] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:15.958134] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-14T17:12:16.747875] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-14T17:12:16.758685] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-14T17:12:16.847084] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T17:12:16.880511] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T17:12:17.558106] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-14T17:12:18.358041] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-14T17:12:18.481697] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T17:12:19.083561] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T17:12:19.158048] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-14T17:12:19.958069] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-14T17:12:20.649963] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T17:12:20.690735] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-14T17:12:20.758036] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-14T17:12:21.026714] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T17:12:21.031242] [INFO ] [REMOTE ] AMBC: Full fetch complete (51688 records). [2025-10-14T17:12:21.031369] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-14T17:12:21.420520] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-14T17:12:21.420610] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-14T17:12:21.421181] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-14T17:12:21.421243] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-14T17:12:21.422431] [DEBUG] [LOCAL ] AMBC: Trimmed 51688 records to 36259 (keeping 200 days of data) [2025-10-14T17:12:21.569103] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-14T17:12:21.625430] [DEBUG] [LOCAL ] AMBC: Primary data saved (36259 records). [2025-10-14T17:12:21.625605] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-14T17:12:21.625723] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBC took 33.3s. Estimated remaining: 4h 51m 12s. Rate: 7.8 symbols/min [2025-10-14T17:12:21.792295] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:21.839980] [DEBUG] [LOCAL ] AME: Loaded 48705 existing records from primary storage. [2025-10-14T17:12:21.840316] [INFO ] [MAIN ] AME: Loaded 48705 existing records. [2025-10-14T17:12:22.026055] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:22.026315] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-14T17:12:22.026364] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-14T17:12:22.026586] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-14T17:12:22.026625] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-14T17:12:22.373468] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-14T17:12:22.415572] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:23.070585] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-14T17:12:23.158118] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-14T17:12:23.391592] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T17:12:23.486320] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T17:12:23.491354] [INFO ] [REMOTE ] AMBP: Full fetch complete (65383 records). [2025-10-14T17:12:23.491484] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-14T17:12:23.892076] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-14T17:12:23.892161] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-14T17:12:23.892835] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-14T17:12:23.892896] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-14T17:12:23.894461] [DEBUG] [LOCAL ] AMBP: Trimmed 65383 records to 44612 (keeping 200 days of data) [2025-10-14T17:12:23.978800] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-14T17:12:24.155902] [DEBUG] [LOCAL ] AMBP: Primary data saved (44612 records). [2025-10-14T17:12:24.156036] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-14T17:12:24.156955] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMBP took 34.2s. Estimated remaining: 4h 49m 4s. Rate: 7.9 symbols/min [2025-10-14T17:12:24.335870] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:24.357418] [DEBUG] [LOCAL ] AMG: Loaded 20121 existing records from primary storage. [2025-10-14T17:12:24.357695] [INFO ] [MAIN ] AMG: Loaded 20121 existing records. [2025-10-14T17:12:24.554274] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:24.554593] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-14T17:12:24.554674] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-14T17:12:24.554966] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-14T17:12:24.555033] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-14T17:12:24.776574] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-14T17:12:24.928705] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:25.355394] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-14T17:12:25.558070] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-14T17:12:25.606468] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T17:12:26.358052] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-14T17:12:26.521687] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T17:12:26.737127] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T17:12:27.158079] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-14T17:12:27.869018] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T17:12:27.958041] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-14T17:12:28.120256] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T17:12:28.758081] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-14T17:12:29.558085] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-14T17:12:29.996731] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T17:12:30.315465] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T17:12:30.352528] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T17:12:30.362300] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-14T17:12:31.158149] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-14T17:12:31.958058] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-14T17:12:32.051031] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T17:12:32.327111] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T17:12:32.758109] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-14T17:12:33.314737] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T17:12:33.558068] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-14T17:12:33.927891] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T17:12:34.358084] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-14T17:12:35.158110] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-14T17:12:35.321169] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T17:12:35.552427] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T17:12:35.958104] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-14T17:12:36.758069] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-14T17:12:37.558061] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-14T17:12:37.641725] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-14T17:12:37.757184] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T17:12:37.826559] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T17:12:38.358122] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-14T17:12:39.144068] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T17:12:39.158030] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-14T17:12:39.850304] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T17:12:39.958137] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-14T17:12:40.758142] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-14T17:12:41.124095] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T17:12:41.553351] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T17:12:41.561584] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-14T17:12:41.650756] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T17:12:42.358100] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-14T17:12:43.158113] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-14T17:12:43.958075] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-14T17:12:43.992417] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-14T17:12:44.123261] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T17:12:44.192426] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T17:12:44.758099] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-14T17:12:45.558109] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-14T17:12:45.671417] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T17:12:46.358039] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-14T17:12:46.440150] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T17:12:46.463325] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T17:12:47.158089] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-14T17:12:47.958123] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-14T17:12:48.004553] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T17:12:48.345501] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T17:12:48.348020] [INFO ] [REMOTE ] AMG: Full fetch complete (29449 records). [2025-10-14T17:12:48.348102] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-14T17:12:48.349321] [FATAL] [VALIDATOR ] AMG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:12:48.349407] [FATAL] [MAIN ] AMG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:12:48.349448] [WARN ] [MAIN ] AMG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:12:48.349507] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-14T17:12:48.349602] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-10-14T17:12:48.349676] [INFO ] [LOCAL ] AMG: Starting deletion of derivative data. [2025-10-14T17:12:48.350164] [DEBUG] [LOCAL ] AMG: Deleted derivative data file. [2025-10-14T17:12:48.350287] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMG took 24.2s. Estimated remaining: 4h 55m 20s. Rate: 7.7 symbols/min [2025-10-14T17:12:48.533292] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:48.587697] [DEBUG] [LOCAL ] AMH: Loaded 51797 existing records from primary storage. [2025-10-14T17:12:48.588168] [INFO ] [MAIN ] AMH: Loaded 51797 existing records. [2025-10-14T17:12:48.778584] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-14T17:12:48.784346] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:48.785636] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-14T17:12:48.785723] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-14T17:12:48.785971] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-14T17:12:48.786011] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-14T17:12:49.166964] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:49.558087] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-14T17:12:50.358117] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-14T17:12:50.504379] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-14T17:12:50.511124] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-14T17:12:50.511324] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-14T17:12:50.938148] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-14T17:12:50.938521] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-14T17:12:50.939728] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-14T17:12:50.939818] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-14T17:12:50.961554] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-14T17:12:50.968269] [INFO ] [REMOTE ] AMCR: Full fetch complete (77840 records). [2025-10-14T17:12:50.968634] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-14T17:12:50.968498] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53762 (keeping 200 days of data) [2025-10-14T17:12:51.591375] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-14T17:12:51.595703] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-14T17:12:51.600619] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-14T17:12:51.601230] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-14T17:12:51.634418] [DEBUG] [LOCAL ] AMCR: Trimmed 77840 records to 53669 (keeping 200 days of data) [2025-10-14T17:12:51.648573] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-14T17:12:51.730764] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-14T17:12:51.911301] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T17:12:51.936108] [DEBUG] [LOCAL ] AMC: Primary data saved (53762 records). [2025-10-14T17:12:51.937185] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-14T17:12:51.937578] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AMC took 52.6s. Estimated remaining: 4h 53m 36s. Rate: 7.7 symbols/min [2025-10-14T17:12:51.963695] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-14T17:12:52.242036] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:52.361421] [DEBUG] [LOCAL ] AMN: Loaded 41763 existing records from primary storage. [2025-10-14T17:12:52.363978] [INFO ] [MAIN ] AMN: Loaded 41763 existing records. [2025-10-14T17:12:52.576692] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:52.578209] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-14T17:12:52.578290] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-14T17:12:52.578891] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-14T17:12:52.578978] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-14T17:12:52.663777] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-14T17:12:52.675777] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-14T17:12:52.676579] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMCR took 37.8s. Estimated remaining: 4h 50m 48s. Rate: 7.8 symbols/min [2025-10-14T17:12:53.052065] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:53.155072] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:53.155624] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-14T17:12:53.184442] [DEBUG] [LOCAL ] AMP: Loaded 32007 existing records from primary storage. [2025-10-14T17:12:53.184900] [INFO ] [MAIN ] AMP: Loaded 32007 existing records. [2025-10-14T17:12:53.380067] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:53.380743] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-14T17:12:53.380934] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-14T17:12:53.387296] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-14T17:12:53.400429] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T17:12:53.405949] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-14T17:12:53.453680] [INFO ] [REMOTE ] AME: Full fetch complete (70047 records). [2025-10-14T17:12:53.483095] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-14T17:12:54.091202] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:54.104778] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-14T17:12:54.194238] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-14T17:12:54.314982] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-14T17:12:54.315194] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-14T17:12:54.316108] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-14T17:12:54.316196] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-14T17:12:54.318820] [DEBUG] [LOCAL ] AME: Trimmed 70047 records to 48682 (keeping 200 days of data) [2025-10-14T17:12:54.383965] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-14T17:12:54.471494] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T17:12:54.691549] [DEBUG] [LOCAL ] AME: Primary data saved (48682 records). [2025-10-14T17:12:54.691759] [INFO ] [MAIN ] AME: Full history saved. [2025-10-14T17:12:54.691868] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AME took 33.1s. Estimated remaining: 4h 48m 33s. Rate: 7.9 symbols/min [2025-10-14T17:12:54.863629] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:12:54.921117] [DEBUG] [LOCAL ] AMPX: Loaded 52323 existing records from primary storage. [2025-10-14T17:12:54.921553] [INFO ] [MAIN ] AMPX: Loaded 52323 existing records. [2025-10-14T17:12:55.119253] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:12:55.119525] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-14T17:12:55.119577] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-14T17:12:55.119921] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-14T17:12:55.119981] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-14T17:12:55.169892] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-14T17:12:55.520722] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:12:55.625521] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T17:12:55.730982] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T17:12:55.958095] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-14T17:12:56.306560] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T17:12:56.758103] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-14T17:12:57.558085] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-14T17:12:57.933781] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T17:12:58.023034] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T17:12:58.358115] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-14T17:12:59.022003] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T17:12:59.158055] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-14T17:12:59.958106] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-14T17:13:00.228367] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T17:13:00.428177] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T17:13:00.758075] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-14T17:13:01.469454] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T17:13:01.558069] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-14T17:13:02.358132] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-14T17:13:02.748204] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T17:13:03.158086] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-14T17:13:03.314844] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T17:13:03.958068] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-14T17:13:04.444382] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-14T17:13:04.515905] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T17:13:04.758075] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-14T17:13:05.558140] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-14T17:13:05.594381] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:13:06.305018] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T17:13:06.358023] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-14T17:13:06.702420] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T17:13:07.158094] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-14T17:13:07.743347] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T17:13:07.958073] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-14T17:13:08.621288] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T17:13:08.758086] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-14T17:13:09.525365] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T17:13:09.558031] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-14T17:13:10.158993] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T17:13:10.358057] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-14T17:13:10.475636] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T17:13:11.158069] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-14T17:13:11.743413] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T17:13:11.958062] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-14T17:13:12.758057] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-14T17:13:12.882684] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T17:13:13.453276] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T17:13:13.558050] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-14T17:13:14.281069] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:13:14.358054] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-14T17:13:15.027635] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T17:13:15.158048] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-14T17:13:15.908181] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T17:13:15.914079] [INFO ] [REMOTE ] AMH: Full fetch complete (75007 records). [2025-10-14T17:13:15.914211] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-14T17:13:15.969526] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-14T17:13:16.315447] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-14T17:13:16.315537] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-14T17:13:16.316278] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-14T17:13:16.316339] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-14T17:13:16.317820] [DEBUG] [LOCAL ] AMH: Trimmed 75007 records to 51797 (keeping 200 days of data) [2025-10-14T17:13:16.632442] [DEBUG] [LOCAL ] AMH: Primary data saved (51797 records). [2025-10-14T17:13:16.632566] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-14T17:13:16.633821] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMH took 28.3s. Estimated remaining: 4h 53m 44s. Rate: 7.7 symbols/min [2025-10-14T17:13:16.762353] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-14T17:13:16.807806] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:16.834265] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T17:13:16.879523] [DEBUG] [LOCAL ] AMPY: Loaded 38869 existing records from primary storage. [2025-10-14T17:13:16.879825] [INFO ] [MAIN ] AMPY: Loaded 38869 existing records. [2025-10-14T17:13:17.061096] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:13:17.061284] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-14T17:13:17.061334] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-14T17:13:17.061528] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-14T17:13:17.061584] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-14T17:13:17.424227] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:17.558046] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-14T17:13:17.608297] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T17:13:18.171521] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T17:13:18.358164] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-14T17:13:18.868496] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T17:13:19.158104] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-14T17:13:19.458557] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T17:13:19.958063] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-14T17:13:20.758043] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-14T17:13:20.958329] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:13:21.290475] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T17:13:21.558060] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-14T17:13:22.358124] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-14T17:13:22.960038] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T17:13:23.158106] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-14T17:13:23.364421] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-14T17:13:23.854622] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T17:13:23.958082] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-14T17:13:24.243964] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T17:13:24.247600] [INFO ] [REMOTE ] AMP: Full fetch complete (47436 records). [2025-10-14T17:13:24.247708] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-14T17:13:24.628380] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-14T17:13:24.628456] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-14T17:13:24.629023] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-14T17:13:24.629084] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-14T17:13:24.630137] [DEBUG] [LOCAL ] AMP: Trimmed 47436 records to 32028 (keeping 200 days of data) [2025-10-14T17:13:24.758504] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-14T17:13:24.836290] [DEBUG] [LOCAL ] AMP: Primary data saved (32028 records). [2025-10-14T17:13:24.836497] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-14T17:13:24.836597] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 32.2s. Estimated remaining: 4h 53m 45s. Rate: 7.7 symbols/min [2025-10-14T17:13:24.996855] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T17:13:25.037393] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:25.074700] [DEBUG] [LOCAL ] AMR: Loaded 28890 existing records from primary storage. [2025-10-14T17:13:25.075003] [INFO ] [MAIN ] AMR: Loaded 28890 existing records. [2025-10-14T17:13:25.250604] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:13:25.250855] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-14T17:13:25.250902] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-14T17:13:25.251107] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-14T17:13:25.251163] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-14T17:13:25.562570] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-14T17:13:25.597121] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:26.358070] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-14T17:13:26.956604] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T17:13:26.961592] [INFO ] [REMOTE ] AMN: Full fetch complete (60391 records). [2025-10-14T17:13:26.961711] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-14T17:13:27.170251] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-14T17:13:27.291694] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-14T17:13:27.411226] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T17:13:27.432087] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-14T17:13:27.432526] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-14T17:13:27.433243] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-14T17:13:27.433307] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-14T17:13:27.434521] [DEBUG] [LOCAL ] AMN: Trimmed 60391 records to 41804 (keeping 200 days of data) [2025-10-14T17:13:27.668846] [DEBUG] [LOCAL ] AMN: Primary data saved (41804 records). [2025-10-14T17:13:27.668977] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-14T17:13:27.669053] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMN took 35.7s. Estimated remaining: 4h 51m 50s. Rate: 7.8 symbols/min [2025-10-14T17:13:27.838948] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:27.873859] [DEBUG] [LOCAL ] AMRC: Loaded 38297 existing records from primary storage. [2025-10-14T17:13:27.874137] [INFO ] [MAIN ] AMRC: Loaded 38297 existing records. [2025-10-14T17:13:27.963251] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-14T17:13:28.051525] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:13:28.051759] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-14T17:13:28.051810] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-14T17:13:28.052026] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-14T17:13:28.052081] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-14T17:13:28.403088] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:28.487608] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T17:13:28.758121] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-14T17:13:29.178795] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T17:13:29.558127] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-14T17:13:30.196124] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T17:13:30.358136] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-14T17:13:30.636474] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T17:13:31.158113] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-14T17:13:31.958138] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-14T17:13:32.019053] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T17:13:32.081088] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T17:13:32.758116] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-14T17:13:33.558111] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-14T17:13:34.064269] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T17:13:34.164119] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T17:13:34.358132] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-14T17:13:35.047019] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T17:13:35.158145] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-14T17:13:35.958081] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-14T17:13:36.286118] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T17:13:36.617896] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-14T17:13:36.623971] [INFO ] [REMOTE ] AMPX: Full fetch complete (75202 records). [2025-10-14T17:13:36.624121] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-14T17:13:36.771038] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-14T17:13:37.045884] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-14T17:13:37.046052] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-14T17:13:37.046868] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-14T17:13:37.046946] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-14T17:13:37.048700] [DEBUG] [LOCAL ] AMPX: Trimmed 75202 records to 52326 (keeping 200 days of data) [2025-10-14T17:13:37.164838] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T17:13:37.379403] [DEBUG] [LOCAL ] AMPX: Primary data saved (52326 records). [2025-10-14T17:13:37.379522] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-14T17:13:37.379601] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPX took 42.7s. Estimated remaining: 4h 52m 25s. Rate: 7.7 symbols/min [2025-10-14T17:13:37.559151] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-14T17:13:37.559083] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:37.560300] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-14T17:13:37.560350] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-14T17:13:37.560455] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-14T17:13:37.560495] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-14T17:13:37.560538] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-14T17:13:37.560570] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-14T17:13:37.912841] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:38.150498] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T17:13:38.358062] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-14T17:13:38.671130] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T17:13:39.158070] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-14T17:13:39.342899] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:13:39.343211] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-14T17:13:39.343300] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:13:39.343349] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-14T17:13:39.343383] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:13:39.343419] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-14T17:13:39.343471] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-14T17:13:39.343505] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-14T17:13:39.343544] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-14T17:13:39.343589] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRZ took 2.0s. Estimated remaining: 4h 50m 14s. Rate: 7.8 symbols/min [2025-10-14T17:13:39.539252] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:39.542490] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T17:13:39.601365] [DEBUG] [LOCAL ] AMT: Loaded 52462 existing records from primary storage. [2025-10-14T17:13:39.601742] [INFO ] [MAIN ] AMT: Loaded 52462 existing records. [2025-10-14T17:13:39.778380] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:13:39.778602] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-14T17:13:39.778674] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-14T17:13:39.779149] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-14T17:13:39.779219] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-14T17:13:39.963263] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-14T17:13:40.126481] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:40.758086] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-14T17:13:41.206527] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T17:13:41.558091] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-14T17:13:42.358043] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-14T17:13:42.701873] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T17:13:42.729988] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T17:13:43.158156] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-14T17:13:43.914384] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T17:13:43.958049] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-14T17:13:44.617336] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T17:13:44.758073] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-14T17:13:45.558095] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-14T17:13:45.664165] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T17:13:45.669076] [INFO ] [REMOTE ] AMPY: Full fetch complete (52316 records). [2025-10-14T17:13:45.669159] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-14T17:13:45.669791] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:13:45.669873] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:13:45.669914] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:13:45.669975] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-14T17:13:45.670038] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-14T17:13:45.670073] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-10-14T17:13:45.670310] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-10-14T17:13:45.671102] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMPY took 29.0s. Estimated remaining: 4h 49m 37s. Rate: 7.8 symbols/min [2025-10-14T17:13:45.835030] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:45.857970] [DEBUG] [LOCAL ] AMTB: Loaded 20503 existing records from primary storage. [2025-10-14T17:13:45.858206] [INFO ] [MAIN ] AMTB: Loaded 20503 existing records. [2025-10-14T17:13:46.037436] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:13:46.037847] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-14T17:13:46.037921] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-14T17:13:46.038281] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-14T17:13:46.038369] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-14T17:13:46.372177] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-14T17:13:46.411526] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:46.490697] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T17:13:47.059556] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T17:13:47.158059] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-14T17:13:47.958139] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-14T17:13:48.015352] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:13:48.220479] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T17:13:48.758074] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-14T17:13:49.391359] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T17:13:49.558087] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-14T17:13:50.256787] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:13:50.358061] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-14T17:13:50.622454] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T17:13:51.158057] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-14T17:13:51.958126] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-14T17:13:51.991115] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T17:13:52.176243] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T17:13:52.758077] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-14T17:13:52.802301] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T17:13:53.558106] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-14T17:13:54.108015] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T17:13:54.358157] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-14T17:13:55.158032] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-14T17:13:55.453163] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T17:13:55.714710] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T17:13:55.958099] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-14T17:13:56.421262] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T17:13:56.424515] [INFO ] [REMOTE ] AMR: Full fetch complete (40368 records). [2025-10-14T17:13:56.424609] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-14T17:13:56.763262] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-14T17:13:56.812042] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-14T17:13:56.813066] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-14T17:13:56.813548] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-14T17:13:56.813609] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-14T17:13:56.814755] [DEBUG] [LOCAL ] AMR: Trimmed 40368 records to 28850 (keeping 200 days of data) [2025-10-14T17:13:56.926313] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T17:13:57.010538] [DEBUG] [LOCAL ] AMR: Primary data saved (28850 records). [2025-10-14T17:13:57.010714] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-14T17:13:57.011620] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMR took 32.2s. Estimated remaining: 4h 50m 46s. Rate: 7.8 symbols/min [2025-10-14T17:13:57.193575] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:13:57.200725] [DEBUG] [LOCAL ] AMTD: Loaded 3779 existing records from primary storage. [2025-10-14T17:13:57.200935] [INFO ] [MAIN ] AMTD: Loaded 3779 existing records. [2025-10-14T17:13:57.381755] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:13:57.382459] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-14T17:13:57.382555] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-14T17:13:57.382741] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-14T17:13:57.382834] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-14T17:13:57.563358] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-14T17:13:57.740984] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:13:58.358079] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-14T17:13:58.572577] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T17:13:58.702354] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T17:13:59.158117] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-14T17:13:59.495404] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T17:13:59.855955] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T17:13:59.958051] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-14T17:14:00.758084] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-14T17:14:01.052053] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T17:14:01.558067] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-14T17:14:02.358116] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-14T17:14:02.512757] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T17:14:02.716585] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:14:03.158126] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-14T17:14:03.735153] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T17:14:03.867433] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T17:14:03.958043] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-14T17:14:04.758043] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-14T17:14:05.151221] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T17:14:05.558109] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-14T17:14:06.358049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-14T17:14:06.744885] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T17:14:06.789115] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T17:14:07.158091] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-14T17:14:07.958063] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-14T17:14:08.050366] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T17:14:08.109768] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T17:14:08.758074] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-14T17:14:09.558080] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-14T17:14:09.869223] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T17:14:09.948175] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T17:14:09.952988] [INFO ] [REMOTE ] AMRC: Full fetch complete (53999 records). [2025-10-14T17:14:09.953087] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-14T17:14:10.301145] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T17:14:10.370860] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-14T17:14:10.393243] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-14T17:14:10.393364] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-14T17:14:10.394206] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-14T17:14:10.394286] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-14T17:14:10.396266] [DEBUG] [LOCAL ] AMRC: Trimmed 53999 records to 38369 (keeping 200 days of data) [2025-10-14T17:14:10.632400] [DEBUG] [LOCAL ] AMRC: Primary data saved (38369 records). [2025-10-14T17:14:10.632618] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-14T17:14:10.632770] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMRC took 43.0s. Estimated remaining: 4h 52m 41s. Rate: 7.7 symbols/min [2025-10-14T17:14:10.818969] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:10.872851] [DEBUG] [LOCAL ] AMTM: Loaded 50593 existing records from primary storage. [2025-10-14T17:14:10.873261] [INFO ] [MAIN ] AMTM: Loaded 50593 existing records. [2025-10-14T17:14:11.058492] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:14:11.059556] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-14T17:14:11.059687] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-14T17:14:11.061138] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-14T17:14:11.061406] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-14T17:14:11.163265] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-14T17:14:11.422781] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T17:14:11.467808] [INFO ] [REMOTE ] AMTB: Full fetch complete (29590 records). [2025-10-14T17:14:11.474189] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-14T17:14:11.578336] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:11.886361] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-14T17:14:11.886439] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-14T17:14:11.886836] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-14T17:14:11.886897] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-14T17:14:11.887604] [DEBUG] [LOCAL ] AMTB: Trimmed 29590 records to 20513 (keeping 200 days of data) [2025-10-14T17:14:11.973229] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-14T17:14:12.012510] [DEBUG] [LOCAL ] AMTB: Primary data saved (20513 records). [2025-10-14T17:14:12.012675] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-14T17:14:12.012777] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMTB took 26.3s. Estimated remaining: 4h 50m 22s. Rate: 7.8 symbols/min [2025-10-14T17:14:12.184627] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:12.196124] [DEBUG] [LOCAL ] AMWL: Loaded 9437 existing records from primary storage. [2025-10-14T17:14:12.196320] [INFO ] [MAIN ] AMWL: Loaded 9437 existing records. [2025-10-14T17:14:12.373383] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:14:12.373616] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-14T17:14:12.373694] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-14T17:14:12.373920] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-14T17:14:12.374003] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-14T17:14:12.487769] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T17:14:12.752121] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:12.758068] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-14T17:14:12.812922] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T17:14:13.182993] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T17:14:13.558074] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-14T17:14:14.017473] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T17:14:14.358063] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-14T17:14:15.158077] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-14T17:14:15.688731] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T17:14:15.958057] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-14T17:14:16.249209] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T17:14:16.255116] [INFO ] [REMOTE ] AMT: Full fetch complete (76187 records). [2025-10-14T17:14:16.255254] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-14T17:14:16.531005] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T17:14:16.662835] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-14T17:14:16.662935] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-14T17:14:16.663857] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-14T17:14:16.663925] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-14T17:14:16.666040] [DEBUG] [LOCAL ] AMT: Trimmed 76187 records to 52466 (keeping 200 days of data) [2025-10-14T17:14:16.761310] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-14T17:14:17.000020] [DEBUG] [LOCAL ] AMT: Primary data saved (52466 records). [2025-10-14T17:14:17.000163] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-14T17:14:17.000243] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMT took 37.7s. Estimated remaining: 4h 49m 18s. Rate: 7.8 symbols/min [2025-10-14T17:14:17.171002] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:17.188086] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T17:14:17.220783] [DEBUG] [LOCAL ] AMX: Loaded 49092 existing records from primary storage. [2025-10-14T17:14:17.221074] [INFO ] [MAIN ] AMX: Loaded 49092 existing records. [2025-10-14T17:14:17.393871] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:14:17.394091] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-14T17:14:17.394141] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-14T17:14:17.394352] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-14T17:14:17.394392] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-14T17:14:17.563368] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-14T17:14:17.744133] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:18.358067] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-14T17:14:18.941725] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T17:14:19.158031] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-14T17:14:19.661103] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-14T17:14:19.836070] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T17:14:19.958038] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-14T17:14:20.760293] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-14T17:14:20.761874] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T17:14:21.558066] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-14T17:14:22.234867] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T17:14:22.261830] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:14:22.358025] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-14T17:14:23.015214] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T17:14:23.016766] [INFO ] [REMOTE ] AMTD: Full fetch complete (5604 records). [2025-10-14T17:14:23.016852] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-14T17:14:23.163215] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-14T17:14:23.448229] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-14T17:14:23.448313] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-14T17:14:23.448491] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-14T17:14:23.448537] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-14T17:14:23.449088] [DEBUG] [LOCAL ] AMTD: Trimmed 5604 records to 3790 (keeping 200 days of data) [2025-10-14T17:14:23.472506] [DEBUG] [LOCAL ] AMTD: Primary data saved (3790 records). [2025-10-14T17:14:23.472670] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-14T17:14:23.472772] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMTD took 26.5s. Estimated remaining: 4h 48m 46s. Rate: 7.8 symbols/min [2025-10-14T17:14:23.657104] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:23.657303] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-14T17:14:23.657343] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-14T17:14:23.657455] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-14T17:14:23.657497] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-14T17:14:23.657540] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-14T17:14:23.657577] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-14T17:14:23.963270] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-14T17:14:24.042194] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:24.120630] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T17:14:24.758083] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-14T17:14:25.558045] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-14T17:14:25.756701] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T17:14:26.350591] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T17:14:26.360513] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-14T17:14:26.671599] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T17:14:27.158170] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-14T17:14:27.958077] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-14T17:14:28.080412] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T17:14:28.137833] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T17:14:28.377137] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T17:14:28.758091] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-14T17:14:29.558092] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-14T17:14:30.358054] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-14T17:14:30.792057] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T17:14:31.146805] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T17:14:31.158020] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-14T17:14:31.378724] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T17:14:31.958069] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-14T17:14:32.548727] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T17:14:32.758075] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-14T17:14:33.120170] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T17:14:33.558133] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-14T17:14:34.183607] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T17:14:34.213205] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T17:14:34.358031] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-14T17:14:35.158077] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-14T17:14:35.744433] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T17:14:35.958083] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-14T17:14:36.501341] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T17:14:36.691563] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T17:14:36.758078] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-14T17:14:37.450349] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T17:14:37.558062] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-14T17:14:38.358107] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-14T17:14:38.956532] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T17:14:39.158095] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-14T17:14:39.958040] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-14T17:14:40.038991] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T17:14:40.465072] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T17:14:40.758119] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-14T17:14:41.437374] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-14T17:14:41.558080] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-14T17:14:41.705985] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T17:14:42.358127] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-14T17:14:42.381303] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T17:14:43.158113] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-14T17:14:43.384082] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T17:14:43.958107] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-14T17:14:44.758080] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-14T17:14:44.921261] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T17:14:44.977174] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T17:14:45.558063] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-14T17:14:46.358047] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-14T17:14:46.559129] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T17:14:46.832957] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T17:14:47.089298] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T17:14:47.158104] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-14T17:14:47.958091] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-14T17:14:48.071386] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T17:14:48.073749] [INFO ] [REMOTE ] AMWL: Full fetch complete (14427 records). [2025-10-14T17:14:48.073839] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-14T17:14:48.432619] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-14T17:14:48.432726] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-14T17:14:48.432992] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-14T17:14:48.433031] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-14T17:14:48.433480] [DEBUG] [LOCAL ] AMWL: Trimmed 14427 records to 9471 (keeping 200 days of data) [2025-10-14T17:14:48.485842] [DEBUG] [LOCAL ] AMWL: Primary data saved (9471 records). [2025-10-14T17:14:48.485966] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-14T17:14:48.486042] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMWL took 36.5s. Estimated remaining: 4h 54m 25s. Rate: 7.7 symbols/min [2025-10-14T17:14:48.651859] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:48.652022] [DEBUG] [LOCAL ] ANET: No existing data file found in primary storage. [2025-10-14T17:14:48.652058] [WARN ] [MAIN ] ANET: No existing data found, performing full refresh instead. [2025-10-14T17:14:48.652186] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-14T17:14:48.652226] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-14T17:14:48.652265] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-10-14T17:14:48.652297] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-14T17:14:48.764518] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-14T17:14:49.019677] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:49.448056] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T17:14:49.558066] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-14T17:14:50.287855] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:14:50.358052] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-14T17:14:50.760711] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T17:14:50.764751] [INFO ] [REMOTE ] AN: Full fetch complete (47140 records). [2025-10-14T17:14:50.764891] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-14T17:14:51.160390] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-14T17:14:51.201377] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-14T17:14:51.201445] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-14T17:14:51.202155] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-14T17:14:51.202220] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-14T17:14:51.203827] [DEBUG] [LOCAL ] AN: Trimmed 47140 records to 31479 (keeping 200 days of data) [2025-10-14T17:14:51.406211] [DEBUG] [LOCAL ] AN: Primary data saved (31479 records). [2025-10-14T17:14:51.406405] [INFO ] [MAIN ] AN: Full history saved. [2025-10-14T17:14:51.406501] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 27.9s. Estimated remaining: 4h 52m 40s. Rate: 7.7 symbols/min [2025-10-14T17:14:51.588375] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:51.643730] [DEBUG] [LOCAL ] ANF: Loaded 52071 existing records from primary storage. [2025-10-14T17:14:51.644119] [INFO ] [MAIN ] ANF: Loaded 52071 existing records. [2025-10-14T17:14:51.832087] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:14:51.832360] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-14T17:14:51.832410] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-14T17:14:51.832737] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-14T17:14:51.832795] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-14T17:14:51.963179] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-14T17:14:52.176772] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T17:14:52.213595] [INFO ] [REMOTE ] AMX: Full fetch complete (70888 records). [2025-10-14T17:14:52.246598] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-14T17:14:52.250920] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:52.711064] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-14T17:14:52.711235] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-14T17:14:52.712113] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-14T17:14:52.712197] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-14T17:14:52.713842] [DEBUG] [LOCAL ] AMX: Trimmed 70888 records to 49095 (keeping 200 days of data) [2025-10-14T17:14:52.768057] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-14T17:14:52.836291] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T17:14:53.051272] [DEBUG] [LOCAL ] AMX: Primary data saved (49095 records). [2025-10-14T17:14:53.051431] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-14T17:14:53.051515] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 36.1s. Estimated remaining: 4h 50m 32s. Rate: 7.8 symbols/min [2025-10-14T17:14:53.224148] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:53.224345] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-14T17:14:53.224402] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-14T17:14:53.224517] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-14T17:14:53.224558] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-14T17:14:53.224601] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-14T17:14:53.224633] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-14T17:14:53.567495] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-14T17:14:53.608626] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:54.112801] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-14T17:14:54.358113] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-14T17:14:54.885706] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T17:14:54.961346] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-14T17:14:55.158116] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-14T17:14:55.958072] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-14T17:14:56.149049] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:14:56.149285] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-14T17:14:56.149371] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:14:56.149418] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-14T17:14:56.149480] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:14:56.149550] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-14T17:14:56.149608] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-14T17:14:56.149665] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-14T17:14:56.149731] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-14T17:14:56.149779] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANGX took 3.1s. Estimated remaining: 4h 48m 54s. Rate: 7.8 symbols/min [2025-10-14T17:14:56.318465] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:14:56.337281] [DEBUG] [LOCAL ] ANRO: Loaded 19332 existing records from primary storage. [2025-10-14T17:14:56.337585] [INFO ] [MAIN ] ANRO: Loaded 19332 existing records. [2025-10-14T17:14:56.529797] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:14:56.530256] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-14T17:14:56.530511] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-14T17:14:56.530958] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-14T17:14:56.531029] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-14T17:14:56.760441] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-14T17:14:56.842699] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-14T17:14:56.964870] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:14:57.060034] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-14T17:14:57.558060] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-14T17:14:58.358084] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-14T17:14:58.552805] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T17:14:59.158061] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-14T17:14:59.677541] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-14T17:14:59.752309] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T17:14:59.958066] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-14T17:15:00.479563] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T17:15:00.758051] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-14T17:15:01.558078] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-14T17:15:02.358064] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-14T17:15:02.591891] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-14T17:15:02.679455] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T17:15:03.158109] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-14T17:15:03.502962] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-14T17:15:03.599422] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T17:15:03.958078] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-14T17:15:04.758082] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-14T17:15:05.096696] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T17:15:05.204398] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-14T17:15:05.210715] [INFO ] [REMOTE ] AMTM: Full fetch complete (73601 records). [2025-10-14T17:15:05.210879] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-14T17:15:05.212018] [FATAL] [VALIDATOR ] AMTM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:15:05.212112] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:15:05.212157] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:15:05.212207] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-14T17:15:05.212299] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-14T17:15:05.212339] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-10-14T17:15:05.212636] [DEBUG] [LOCAL ] AMTM: Deleted derivative data file. [2025-10-14T17:15:05.212819] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. AMTM took 54.6s. Estimated remaining: 4h 49m 13s. Rate: 7.8 symbols/min [2025-10-14T17:15:05.558091] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-14T17:15:06.358148] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-14T17:15:06.652058] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T17:15:07.158086] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-14T17:15:07.189064] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T17:15:07.958084] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-14T17:15:08.108537] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-14T17:15:08.753189] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T17:15:08.765068] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-14T17:15:09.089603] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T17:15:09.558079] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-14T17:15:10.358103] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-14T17:15:11.271267] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-14T17:15:11.283857] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-14T17:15:11.400739] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T17:15:11.450411] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T17:15:11.958123] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-14T17:15:12.758064] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-14T17:15:13.074265] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T17:15:13.563227] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-14T17:15:13.589245] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-14T17:15:14.288144] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T17:15:14.363081] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-14T17:15:14.370398] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T17:15:15.158147] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-14T17:15:15.958167] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-14T17:15:16.027231] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T17:15:16.483115] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T17:15:16.758118] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-14T17:15:17.545753] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T17:15:17.558018] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-14T17:15:17.797306] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T17:15:18.358046] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-14T17:15:18.447027] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T17:15:18.450480] [INFO ] [REMOTE ] ANRO: Full fetch complete (29777 records). [2025-10-14T17:15:18.450560] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-14T17:15:18.824605] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-14T17:15:18.824715] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-14T17:15:18.825124] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-14T17:15:18.825166] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-14T17:15:18.825959] [DEBUG] [LOCAL ] ANRO: Trimmed 29777 records to 19308 (keeping 200 days of data) [2025-10-14T17:15:18.935010] [DEBUG] [LOCAL ] ANRO: Primary data saved (19308 records). [2025-10-14T17:15:18.935193] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-14T17:15:18.935271] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANRO took 22.8s. Estimated remaining: 4h 50m 60s. Rate: 7.7 symbols/min [2025-10-14T17:15:19.158087] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-14T17:15:19.964011] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T17:15:19.974863] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-14T17:15:21.569028] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T17:15:21.575209] [INFO ] [REMOTE ] ANF: Full fetch complete (75753 records). [2025-10-14T17:15:21.575361] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-14T17:15:21.748629] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-14T17:15:21.821577] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-14T17:15:22.012933] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-14T17:15:22.013011] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-14T17:15:22.013749] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-14T17:15:22.013817] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-14T17:15:22.015195] [DEBUG] [LOCAL ] ANF: Trimmed 75753 records to 52075 (keeping 200 days of data) [2025-10-14T17:15:22.321781] [DEBUG] [LOCAL ] ANF: Primary data saved (52075 records). [2025-10-14T17:15:22.321924] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-14T17:15:22.322564] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANF took 30.9s. Estimated remaining: 4h 49m 29s. Rate: 7.8 symbols/min [2025-10-14T17:15:24.374862] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-14T17:15:24.387384] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-14T17:15:25.156134] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T17:15:25.162152] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-14T17:15:25.162339] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-14T17:15:25.554810] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-14T17:15:25.554898] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-14T17:15:25.555674] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-14T17:15:25.555737] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-14T17:15:25.557305] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-14T17:15:25.875367] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-14T17:15:25.875514] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-14T17:15:25.875588] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANET took 37.4s. Estimated remaining: 4h 48m 3s. Rate: 7.8 symbols/min [2025-10-14T17:15:26.527982] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:26.606171] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:26.589158] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:26.625423] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:26.625696] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-14T17:15:26.626065] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-14T17:15:26.626179] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-14T17:15:26.626809] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-14T17:15:26.627276] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-14T17:15:26.627331] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-14T17:15:26.748036] [DEBUG] [LOCAL ] AOMR: Loaded 16492 existing records from primary storage. [2025-10-14T17:15:26.761378] [INFO ] [MAIN ] AOMR: Loaded 16492 existing records. [2025-10-14T17:15:26.967246] [DEBUG] [LOCAL ] ANVS: Loaded 23559 existing records from primary storage. [2025-10-14T17:15:26.987147] [INFO ] [MAIN ] ANVS: Loaded 23559 existing records. [2025-10-14T17:15:26.966564] [DEBUG] [LOCAL ] AOD: Loaded 30694 existing records from primary storage. [2025-10-14T17:15:27.049773] [INFO ] [MAIN ] AOD: Loaded 30694 existing records. [2025-10-14T17:15:27.291800] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:15:27.411510] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-14T17:15:27.487253] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:27.465838] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-14T17:15:27.508887] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-14T17:15:27.577586] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-14T17:15:27.608036] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-14T17:15:27.589533] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:15:27.618593] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-14T17:15:27.613235] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:15:27.636021] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-14T17:15:27.625866] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-14T17:15:27.636178] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-14T17:15:27.667592] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-14T17:15:27.700766] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-14T17:15:27.705947] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-14T17:15:27.725701] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-14T17:15:27.792729] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:15:27.844586] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-14T17:15:27.853749] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:15:27.878838] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-14T17:15:27.926196] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:15:27.941828] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-14T17:15:27.980309] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-14T17:15:28.050375] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-14T17:15:28.083445] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-14T17:15:28.128338] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 2.2s. Estimated remaining: 4h 46m 15s. Rate: 7.9 symbols/min [2025-10-14T17:15:28.798737] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:28.911201] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-14T17:15:28.912465] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:28.910973] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:28.954324] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-14T17:15:28.973184] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:28.973627] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-14T17:15:29.012846] [DEBUG] [LOCAL ] AON: Loaded 45124 existing records from primary storage. [2025-10-14T17:15:29.013198] [INFO ] [MAIN ] AON: Loaded 45124 existing records. [2025-10-14T17:15:29.192390] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:15:29.192614] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-14T17:15:29.192702] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-14T17:15:29.193050] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-14T17:15:29.193107] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-14T17:15:29.552132] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:29.552461] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-14T17:15:29.817318] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T17:15:29.820346] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-14T17:15:29.986188] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T17:15:29.992180] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-14T17:15:30.428934] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T17:15:30.430009] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T17:15:30.433079] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-14T17:15:30.441024] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-14T17:15:30.962589] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T17:15:30.971429] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-14T17:15:31.299822] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T17:15:31.307230] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-14T17:15:31.417341] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T17:15:31.421772] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-14T17:15:31.511255] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T17:15:31.958130] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-14T17:15:32.162840] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T17:15:32.297064] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:15:32.442256] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T17:15:32.758116] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-14T17:15:33.024390] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T17:15:33.558102] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-14T17:15:34.358099] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-14T17:15:34.432700] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T17:15:34.491229] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T17:15:35.158088] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-14T17:15:35.352412] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T17:15:35.958041] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-14T17:15:36.097494] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T17:15:36.687596] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-14T17:15:36.758128] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-14T17:15:37.558097] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-14T17:15:38.116425] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T17:15:38.195146] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-14T17:15:38.358125] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-14T17:15:39.158079] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-14T17:15:39.958117] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-14T17:15:40.134511] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T17:15:40.188140] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T17:15:40.758102] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-14T17:15:40.864770] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T17:15:41.558085] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-14T17:15:42.358116] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-14T17:15:42.625772] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T17:15:42.662434] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T17:15:43.158101] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-14T17:15:43.713367] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T17:15:43.822794] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T17:15:43.958137] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-14T17:15:44.758058] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-14T17:15:44.830378] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T17:15:44.832203] [INFO ] [REMOTE ] AOMR: Full fetch complete (23192 records). [2025-10-14T17:15:44.832416] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-14T17:15:45.202391] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-14T17:15:45.202474] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-14T17:15:45.202834] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-14T17:15:45.202896] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-14T17:15:45.203563] [DEBUG] [LOCAL ] AOMR: Trimmed 23192 records to 16470 (keeping 200 days of data) [2025-10-14T17:15:45.298035] [DEBUG] [LOCAL ] AOMR: Primary data saved (16470 records). [2025-10-14T17:15:45.298184] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-14T17:15:45.298270] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOMR took 19.4s. Estimated remaining: 4h 49m 3s. Rate: 7.8 symbols/min [2025-10-14T17:15:45.473948] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:45.474196] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-14T17:15:45.474284] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-14T17:15:45.474431] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-14T17:15:45.474487] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-14T17:15:45.474535] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-14T17:15:45.474577] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-14T17:15:45.563177] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-14T17:15:45.840781] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:45.855464] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T17:15:46.358065] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-14T17:15:46.832081] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T17:15:47.158070] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-14T17:15:47.647690] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T17:15:47.958099] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-14T17:15:48.758070] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-14T17:15:48.827124] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T17:15:49.090788] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T17:15:49.558064] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-14T17:15:49.896146] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T17:15:50.358107] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-14T17:15:51.158040] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-14T17:15:51.257367] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T17:15:51.306240] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T17:15:51.958137] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-14T17:15:52.178822] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T17:15:52.758106] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-14T17:15:52.962838] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T17:15:53.558051] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-14T17:15:54.006782] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T17:15:54.358070] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-14T17:15:54.535336] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T17:15:55.158043] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-14T17:15:55.278727] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T17:15:55.282326] [INFO ] [REMOTE ] ANVS: Full fetch complete (36616 records). [2025-10-14T17:15:55.282434] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-14T17:15:55.657385] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-14T17:15:55.657459] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-14T17:15:55.661820] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-14T17:15:55.662744] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-14T17:15:55.663692] [DEBUG] [LOCAL ] ANVS: Trimmed 36616 records to 23680 (keeping 200 days of data) [2025-10-14T17:15:55.797014] [DEBUG] [LOCAL ] ANVS: Primary data saved (23680 records). [2025-10-14T17:15:55.797144] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-14T17:15:55.797237] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. ANVS took 29.9s. Estimated remaining: 4h 49m 46s. Rate: 7.8 symbols/min [2025-10-14T17:15:55.966679] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-14T17:15:55.969397] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:55.970581] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-14T17:15:55.970932] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-14T17:15:55.971099] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-14T17:15:55.971158] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-14T17:15:55.971228] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-14T17:15:55.971346] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-14T17:15:56.181015] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T17:15:56.368630] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:15:56.758134] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-14T17:15:56.995510] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T17:15:57.558130] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-14T17:15:58.358054] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-14T17:15:58.636065] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T17:15:58.938204] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T17:15:58.942334] [INFO ] [REMOTE ] AOD: Full fetch complete (44623 records). [2025-10-14T17:15:58.942418] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-14T17:15:59.163289] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-14T17:15:59.321798] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-14T17:15:59.321952] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-14T17:15:59.322449] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-14T17:15:59.322487] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-14T17:15:59.323463] [DEBUG] [LOCAL ] AOD: Trimmed 44623 records to 30776 (keeping 200 days of data) [2025-10-14T17:15:59.509566] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T17:15:59.526268] [DEBUG] [LOCAL ] AOD: Primary data saved (30776 records). [2025-10-14T17:15:59.526357] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-14T17:15:59.526427] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOD took 33.6s. Estimated remaining: 4h 48m 25s. Rate: 7.8 symbols/min [2025-10-14T17:15:59.697206] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:15:59.697375] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-14T17:15:59.697413] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-14T17:15:59.697537] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-14T17:15:59.697587] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-14T17:15:59.697633] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-14T17:15:59.697702] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-14T17:15:59.964023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-14T17:16:00.077346] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:00.758039] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-14T17:16:01.256451] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-14T17:16:01.347445] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T17:16:01.558098] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-14T17:16:01.590195] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T17:16:02.358086] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-14T17:16:03.158116] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-14T17:16:03.222203] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T17:16:03.958070] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-14T17:16:03.975964] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T17:16:04.004083] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T17:16:04.758075] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-14T17:16:05.336169] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T17:16:05.509101] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T17:16:05.558069] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-14T17:16:06.358058] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-14T17:16:06.826921] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T17:16:06.934896] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T17:16:07.158042] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-14T17:16:07.958045] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-14T17:16:08.320967] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T17:16:08.758070] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-14T17:16:09.558102] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-14T17:16:09.655174] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T17:16:10.104691] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T17:16:10.358079] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-14T17:16:10.964259] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-14T17:16:11.040254] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T17:16:11.158064] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-14T17:16:11.958075] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-14T17:16:12.612309] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T17:16:12.630357] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T17:16:12.758070] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-14T17:16:13.554369] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T17:16:13.558014] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-14T17:16:14.358079] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-14T17:16:14.376967] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T17:16:15.158104] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-14T17:16:15.952327] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T17:16:15.956909] [INFO ] [REMOTE ] AON: Full fetch complete (64694 records). [2025-10-14T17:16:15.957015] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-14T17:16:15.968941] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-14T17:16:16.362748] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-14T17:16:16.362863] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-14T17:16:16.363564] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-14T17:16:16.363604] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-14T17:16:16.364942] [DEBUG] [LOCAL ] AON: Trimmed 64694 records to 45116 (keeping 200 days of data) [2025-10-14T17:16:16.484766] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T17:16:16.669080] [DEBUG] [LOCAL ] AON: Primary data saved (45116 records). [2025-10-14T17:16:16.669205] [INFO ] [MAIN ] AON: Full history saved. [2025-10-14T17:16:16.669277] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AON took 48.5s. Estimated remaining: 4h 51m 7s. Rate: 7.7 symbols/min [2025-10-14T17:16:16.767621] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-14T17:16:16.841478] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:16.874664] [DEBUG] [LOCAL ] APAM: Loaded 36096 existing records from primary storage. [2025-10-14T17:16:16.874963] [INFO ] [MAIN ] APAM: Loaded 36096 existing records. [2025-10-14T17:16:17.050693] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:16:17.050935] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-14T17:16:17.050982] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-14T17:16:17.051450] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-14T17:16:17.051507] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-14T17:16:17.409095] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:17.563255] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-14T17:16:17.580546] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T17:16:17.832362] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T17:16:17.835588] [INFO ] [REMOTE ] AORT: Full fetch complete (42229 records). [2025-10-14T17:16:17.835685] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-14T17:16:18.157595] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T17:16:18.225173] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-14T17:16:18.225248] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-14T17:16:18.225773] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-14T17:16:18.225835] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-14T17:16:18.226726] [DEBUG] [LOCAL ] AORT: Trimmed 42229 records to 29205 (keeping 200 days of data) [2025-10-14T17:16:18.364468] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-14T17:16:18.398287] [DEBUG] [LOCAL ] AORT: Primary data saved (29205 records). [2025-10-14T17:16:18.398431] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-14T17:16:18.398503] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AORT took 33.1s. Estimated remaining: 4h 49m 11s. Rate: 7.8 symbols/min [2025-10-14T17:16:18.567488] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:18.611180] [DEBUG] [LOCAL ] APD: Loaded 45325 existing records from primary storage. [2025-10-14T17:16:18.611460] [INFO ] [MAIN ] APD: Loaded 45325 existing records. [2025-10-14T17:16:18.784869] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:16:18.785095] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-14T17:16:18.785148] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-14T17:16:18.785348] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-14T17:16:18.785388] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-14T17:16:19.064245] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:16:19.151534] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:19.158021] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-14T17:16:19.958070] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-14T17:16:20.489969] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T17:16:20.758064] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-14T17:16:21.289675] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T17:16:21.419417] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T17:16:21.420603] [INFO ] [REMOTE ] AP: Full fetch complete (9049 records). [2025-10-14T17:16:21.420716] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-14T17:16:21.564900] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-14T17:16:21.795254] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-14T17:16:21.795329] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-14T17:16:21.795591] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-14T17:16:21.795629] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-14T17:16:21.796073] [DEBUG] [LOCAL ] AP: Trimmed 9049 records to 7321 (keeping 200 days of data) [2025-10-14T17:16:21.836558] [DEBUG] [LOCAL ] AP: Primary data saved (7321 records). [2025-10-14T17:16:21.836670] [INFO ] [MAIN ] AP: Full history saved. [2025-10-14T17:16:21.836755] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AP took 22.3s. Estimated remaining: 4h 47m 48s. Rate: 7.8 symbols/min [2025-10-14T17:16:22.005915] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:22.057709] [DEBUG] [LOCAL ] APG: Loaded 50584 existing records from primary storage. [2025-10-14T17:16:22.058049] [INFO ] [MAIN ] APG: Loaded 50584 existing records. [2025-10-14T17:16:22.234855] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:16:22.235095] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-14T17:16:22.235141] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-14T17:16:22.235337] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-14T17:16:22.235391] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-14T17:16:22.363289] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-14T17:16:22.593291] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:23.158060] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-14T17:16:23.239107] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T17:16:23.419486] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T17:16:23.958084] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-14T17:16:24.758064] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-14T17:16:24.816920] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T17:16:25.558979] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-14T17:16:25.563371] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T17:16:26.137096] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T17:16:26.358072] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-14T17:16:27.158042] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-14T17:16:27.375849] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T17:16:27.958110] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-14T17:16:28.100457] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T17:16:28.758048] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-14T17:16:28.881929] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T17:16:29.060155] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T17:16:29.558081] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-14T17:16:30.373085] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-14T17:16:30.378471] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T17:16:31.163430] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-14T17:16:31.172152] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T17:16:31.916672] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T17:16:31.958045] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-14T17:16:32.676842] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T17:16:32.758050] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-14T17:16:33.558072] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-14T17:16:33.626408] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T17:16:34.088874] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:16:34.358060] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-14T17:16:34.839563] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T17:16:35.158078] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-14T17:16:35.958082] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-14T17:16:36.072609] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T17:16:36.712997] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T17:16:36.758073] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-14T17:16:37.325503] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T17:16:37.558061] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-14T17:16:37.972540] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T17:16:38.358094] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-14T17:16:39.153282] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T17:16:39.162577] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-14T17:16:39.958120] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-14T17:16:40.279579] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T17:16:40.643431] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T17:16:40.758105] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-14T17:16:41.464405] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T17:16:41.471611] [INFO ] [REMOTE ] AOS: Full fetch complete (70854 records). [2025-10-14T17:16:41.471795] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-14T17:16:41.563286] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-14T17:16:41.868293] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-14T17:16:41.868382] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-14T17:16:41.869118] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-14T17:16:41.869180] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-14T17:16:41.870518] [DEBUG] [LOCAL ] AOS: Trimmed 70854 records to 48722 (keeping 200 days of data) [2025-10-14T17:16:42.167008] [DEBUG] [LOCAL ] AOS: Primary data saved (48722 records). [2025-10-14T17:16:42.167144] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-14T17:16:42.167227] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. AOS took 46.4s. Estimated remaining: 4h 51m 21s. Rate: 7.7 symbols/min [2025-10-14T17:16:42.337572] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:42.366605] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-14T17:16:42.390397] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-14T17:16:42.390850] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-14T17:16:42.550308] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T17:16:42.613335] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:16:42.613532] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-14T17:16:42.613594] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-14T17:16:42.614011] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-14T17:16:42.614069] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-14T17:16:42.977569] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:42.997176] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T17:16:43.158112] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-14T17:16:43.958112] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-14T17:16:44.051080] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T17:16:44.464320] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T17:16:44.758139] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-14T17:16:45.558075] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-14T17:16:45.936544] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T17:16:46.358065] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-14T17:16:46.673203] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T17:16:46.936406] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T17:16:46.941039] [INFO ] [REMOTE ] APAM: Full fetch complete (51989 records). [2025-10-14T17:16:46.941189] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-14T17:16:47.163278] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-14T17:16:47.320135] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-14T17:16:47.320210] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-14T17:16:47.320796] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-14T17:16:47.320884] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-14T17:16:47.321932] [DEBUG] [LOCAL ] APAM: Trimmed 51989 records to 36060 (keeping 200 days of data) [2025-10-14T17:16:47.536082] [DEBUG] [LOCAL ] APAM: Primary data saved (36060 records). [2025-10-14T17:16:47.536217] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-14T17:16:47.536870] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APAM took 30.9s. Estimated remaining: 4h 50m 31s. Rate: 7.7 symbols/min [2025-10-14T17:16:47.705260] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:47.705437] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-14T17:16:47.705473] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-14T17:16:47.705579] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-14T17:16:47.705619] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-14T17:16:47.705698] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-14T17:16:47.705744] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-14T17:16:47.967737] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-14T17:16:48.062918] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:48.114965] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T17:16:48.758051] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-14T17:16:48.893233] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T17:16:49.378406] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T17:16:49.558073] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-14T17:16:50.209255] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T17:16:50.358093] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-14T17:16:50.913006] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T17:16:51.158079] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-14T17:16:51.958077] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-14T17:16:52.265449] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-14T17:16:52.350619] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T17:16:52.758074] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-14T17:16:53.505052] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T17:16:53.558122] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-14T17:16:53.916798] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T17:16:53.922502] [INFO ] [REMOTE ] APG: Full fetch complete (72056 records). [2025-10-14T17:16:53.922703] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-14T17:16:54.309992] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-14T17:16:54.310072] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-14T17:16:54.310776] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-14T17:16:54.310838] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-14T17:16:54.312207] [DEBUG] [LOCAL ] APG: Trimmed 72056 records to 50586 (keeping 200 days of data) [2025-10-14T17:16:54.365456] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-14T17:16:54.611803] [DEBUG] [LOCAL ] APG: Primary data saved (50586 records). [2025-10-14T17:16:54.611943] [INFO ] [MAIN ] APG: Full history saved. [2025-10-14T17:16:54.612020] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APG took 32.8s. Estimated remaining: 4h 50m 11s. Rate: 7.7 symbols/min [2025-10-14T17:16:54.782410] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:54.835885] [DEBUG] [LOCAL ] APO: Loaded 53387 existing records from primary storage. [2025-10-14T17:16:54.836255] [INFO ] [MAIN ] APO: Loaded 53387 existing records. [2025-10-14T17:16:55.022869] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:16:55.023115] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-14T17:16:55.023181] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-14T17:16:55.023458] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-14T17:16:55.023529] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-14T17:16:55.164957] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-14T17:16:55.401013] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:55.448625] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T17:16:55.599221] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T17:16:55.958086] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-14T17:16:56.758090] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-14T17:16:56.974011] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T17:16:57.469052] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T17:16:57.558048] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-14T17:16:58.320813] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T17:16:58.325899] [INFO ] [REMOTE ] APD: Full fetch complete (67090 records). [2025-10-14T17:16:58.326017] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-14T17:16:58.363154] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-14T17:16:58.745021] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-14T17:16:58.745104] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-14T17:16:58.745823] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-14T17:16:58.745883] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-14T17:16:58.747177] [DEBUG] [LOCAL ] APD: Trimmed 67090 records to 45380 (keeping 200 days of data) [2025-10-14T17:16:59.039981] [DEBUG] [LOCAL ] APD: Primary data saved (45380 records). [2025-10-14T17:16:59.040110] [INFO ] [MAIN ] APD: Full history saved. [2025-10-14T17:16:59.040773] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APD took 40.6s. Estimated remaining: 4h 49m 6s. Rate: 7.7 symbols/min [2025-10-14T17:16:59.162563] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-14T17:16:59.211924] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:16:59.213129] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-14T17:16:59.213194] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-14T17:16:59.213326] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-14T17:16:59.213372] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-14T17:16:59.213415] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-14T17:16:59.213446] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-14T17:16:59.498892] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-14T17:16:59.613686] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:16:59.958117] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-14T17:17:00.393145] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T17:17:00.758072] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-14T17:17:01.455848] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-14T17:17:01.558041] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-14T17:17:01.660186] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T17:17:01.676595] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T17:17:02.358063] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-14T17:17:03.158037] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-14T17:17:03.352247] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T17:17:03.958052] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-14T17:17:04.133427] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T17:17:04.758138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-14T17:17:05.151229] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-14T17:17:05.385392] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T17:17:05.558056] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-14T17:17:06.358024] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-14T17:17:06.531954] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T17:17:07.158079] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-14T17:17:07.280321] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T17:17:07.311038] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T17:17:07.958087] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-14T17:17:08.619444] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T17:17:08.758067] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-14T17:17:08.932358] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T17:17:09.558066] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-14T17:17:10.358058] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-14T17:17:10.794101] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T17:17:11.059359] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T17:17:11.159849] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-14T17:17:11.165454] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T17:17:11.958126] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-14T17:17:12.758084] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-14T17:17:13.225147] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-14T17:17:13.558052] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-14T17:17:14.011895] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-14T17:17:14.363140] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-14T17:17:14.382993] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T17:17:15.158085] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-14T17:17:15.253140] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-14T17:17:15.460242] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T17:17:15.466285] [INFO ] [REMOTE ] APH: Full fetch complete (77469 records). [2025-10-14T17:17:15.466448] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-14T17:17:15.467188] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:17:15.467323] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:17:15.467391] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:17:15.467464] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-14T17:17:15.467528] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-14T17:17:15.467564] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-10-14T17:17:15.467843] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-10-14T17:17:15.467993] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APH took 33.3s. Estimated remaining: 4h 51m 26s. Rate: 7.7 symbols/min [2025-10-14T17:17:15.645442] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:17:15.694456] [DEBUG] [LOCAL ] APTV: Loaded 52009 existing records from primary storage. [2025-10-14T17:17:15.694801] [INFO ] [MAIN ] APTV: Loaded 52009 existing records. [2025-10-14T17:17:15.869636] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:17:15.869842] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-14T17:17:15.869887] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-14T17:17:15.870061] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-14T17:17:15.870102] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-14T17:17:15.968207] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-14T17:17:16.231123] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:17:16.758059] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-14T17:17:17.383699] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T17:17:17.446584] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-14T17:17:17.558031] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-14T17:17:17.765342] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T17:17:18.358068] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-14T17:17:18.371216] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T17:17:19.158154] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-14T17:17:19.958062] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-14T17:17:20.276789] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T17:17:20.758091] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-14T17:17:20.858957] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T17:17:21.360899] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T17:17:21.477178] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T17:17:21.558065] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-14T17:17:22.152594] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T17:17:22.358083] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-14T17:17:23.158128] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-14T17:17:23.958194] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-14T17:17:24.137718] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T17:17:24.663072] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:17:24.758069] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-14T17:17:24.833877] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T17:17:25.558088] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-14T17:17:26.202020] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T17:17:26.209140] [INFO ] [REMOTE ] APLE: Full fetch complete (74645 records). [2025-10-14T17:17:26.209320] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-14T17:17:26.318475] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T17:17:26.331608] [INFO ] [REMOTE ] APOS: Full fetch complete (10337 records). [2025-10-14T17:17:26.348197] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-14T17:17:26.358764] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-14T17:17:26.384712] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:17:26.440769] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:17:26.493746] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:17:26.526632] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-14T17:17:26.555959] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-14T17:17:26.556502] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-14T17:17:26.562048] [DEBUG] [LOCAL ] APOS: No derivative data file found to delete. [2025-10-14T17:17:26.572519] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APOS took 27.5s. Estimated remaining: 4h 52m 13s. Rate: 7.7 symbols/min [2025-10-14T17:17:26.808428] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-14T17:17:26.821239] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-14T17:17:26.822289] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-14T17:17:26.822380] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-14T17:17:26.856031] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:17:26.856829] [DEBUG] [LOCAL ] APLE: Trimmed 74645 records to 51970 (keeping 200 days of data) [2025-10-14T17:17:27.128081] [DEBUG] [LOCAL ] AQN: Loaded 51791 existing records from primary storage. [2025-10-14T17:17:27.130122] [INFO ] [MAIN ] AQN: Loaded 51791 existing records. [2025-10-14T17:17:27.163268] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-14T17:17:27.423431] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:17:27.431104] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-14T17:17:27.433840] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-14T17:17:27.434689] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-14T17:17:27.434764] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-14T17:17:27.562429] [DEBUG] [LOCAL ] APLE: Primary data saved (51970 records). [2025-10-14T17:17:27.569518] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-14T17:17:27.579914] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APLE took 40.0s. Estimated remaining: 4h 50m 11s. Rate: 7.7 symbols/min [2025-10-14T17:17:27.987319] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:17:28.047002] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:17:28.047630] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-14T17:17:28.051064] [DEBUG] [LOCAL ] AQNB: Loaded 4117 existing records from primary storage. [2025-10-14T17:17:28.051305] [INFO ] [MAIN ] AQNB: Loaded 4117 existing records. [2025-10-14T17:17:28.232340] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:17:28.232808] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-14T17:17:28.232881] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-14T17:17:28.233176] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-14T17:17:28.233231] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-14T17:17:28.621188] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:17:28.758050] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-14T17:17:28.973274] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T17:17:29.563237] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-14T17:17:29.590931] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T17:17:29.641861] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (3.28 seconds). [2025-10-14T17:17:29.906174] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T17:17:30.358126] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-14T17:17:31.158111] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-14T17:17:31.356219] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T17:17:31.472541] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-14T17:17:31.958074] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-14T17:17:32.044158] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T17:17:32.758112] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-14T17:17:33.558061] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-14T17:17:33.804305] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T17:17:33.812308] [INFO ] [REMOTE ] APO: Full fetch complete (77446 records). [2025-10-14T17:17:33.812508] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-14T17:17:34.021049] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T17:17:34.292556] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-14T17:17:34.292743] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-14T17:17:34.294075] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-14T17:17:34.294150] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-14T17:17:34.297192] [DEBUG] [LOCAL ] APO: Trimmed 77446 records to 53390 (keeping 200 days of data) [2025-10-14T17:17:34.393729] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-14T17:17:34.438321] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T17:17:34.732820] [DEBUG] [LOCAL ] APO: Primary data saved (53390 records). [2025-10-14T17:17:34.733043] [INFO ] [MAIN ] APO: Full history saved. [2025-10-14T17:17:34.733176] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APO took 40.1s. Estimated remaining: 4h 49m 53s. Rate: 7.7 symbols/min [2025-10-14T17:17:34.933506] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:17:34.999912] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-14T17:17:35.000366] [INFO ] [MAIN ] AR: Loaded 53587 existing records. [2025-10-14T17:17:35.113325] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T17:17:35.167431] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-14T17:17:35.221178] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:17:35.221604] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-14T17:17:35.221769] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-14T17:17:35.222108] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-14T17:17:35.222179] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-14T17:17:35.616199] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:17:35.958171] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-14T17:17:36.552300] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T17:17:36.758127] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-14T17:17:36.821933] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T17:17:37.558060] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-14T17:17:38.135846] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T17:17:38.358064] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-14T17:17:38.968552] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-14T17:17:39.158042] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-14T17:17:39.413551] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-14T17:17:39.958105] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-14T17:17:40.758083] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-14T17:17:41.052462] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T17:17:41.558083] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-14T17:17:41.644936] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T17:17:42.358049] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-14T17:17:43.158084] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-14T17:17:43.239305] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T17:17:43.297517] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-14T17:17:43.958045] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-14T17:17:44.738524] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-14T17:17:44.758036] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-14T17:17:44.780747] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T17:17:45.558048] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-14T17:17:45.763482] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T17:17:45.939831] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-14T17:17:46.320844] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T17:17:46.358028] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-14T17:17:47.158108] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-14T17:17:47.958047] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-14T17:17:47.995775] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T17:17:48.539478] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T17:17:48.758065] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-14T17:17:48.870841] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T17:17:49.558086] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-14T17:17:50.116226] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T17:17:50.117138] [INFO ] [REMOTE ] AQNB: Full fetch complete (5527 records). [2025-10-14T17:17:50.117203] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-14T17:17:50.363240] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-14T17:17:50.489217] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-14T17:17:50.490093] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T17:17:50.494947] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-14T17:17:50.495807] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-14T17:17:50.495984] [INFO ] [REMOTE ] APTV: Full fetch complete (75952 records). [2025-10-14T17:17:50.496084] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-14T17:17:50.496150] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-14T17:17:50.553292] [DEBUG] [LOCAL ] AQNB: Trimmed 5527 records to 4087 (keeping 200 days of data) [2025-10-14T17:17:50.631965] [DEBUG] [LOCAL ] AQNB: Primary data saved (4087 records). [2025-10-14T17:17:50.637188] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-14T17:17:50.642386] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. AQNB took 23.1s. Estimated remaining: 4h 51m 59s. Rate: 7.6 symbols/min [2025-10-14T17:17:51.006432] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:17:51.021961] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-14T17:17:51.033856] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-14T17:17:51.050273] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-14T17:17:51.051632] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-14T17:17:51.052558] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-14T17:17:51.067386] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-14T17:17:51.152608] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-14T17:17:51.164165] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-14T17:17:51.158459] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-14T17:17:51.175386] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-14T17:17:51.190709] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-14T17:17:51.245374] [DEBUG] [LOCAL ] APTV: Trimmed 75952 records to 51980 (keeping 200 days of data) [2025-10-14T17:17:51.559246] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:17:51.757481] [DEBUG] [LOCAL ] APTV: Primary data saved (51980 records). [2025-10-14T17:17:51.757699] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-14T17:17:51.757790] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. APTV took 36.3s. Estimated remaining: 4h 50m 1s. Rate: 7.7 symbols/min [2025-10-14T17:17:51.928729] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:17:51.928904] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-10-14T17:17:51.928975] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-10-14T17:17:51.929217] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-14T17:17:51.929272] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-14T17:17:51.929369] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-14T17:17:51.929492] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-14T17:17:51.980391] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-14T17:17:52.197277] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T17:17:52.348381] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:17:52.758087] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-14T17:17:52.911893] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T17:17:53.435602] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T17:17:53.558048] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-14T17:17:53.704822] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T17:17:54.358093] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-14T17:17:55.158153] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-14T17:17:55.711791] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-14T17:17:55.842091] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T17:17:55.958075] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-14T17:17:56.758082] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-14T17:17:57.351281] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-14T17:17:57.473813] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T17:17:57.558050] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-14T17:17:58.358047] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-14T17:17:58.508241] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T17:17:59.158057] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-14T17:17:59.371900] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T17:17:59.397477] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T17:17:59.958105] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-14T17:18:00.758097] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-14T17:18:00.985410] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T17:18:01.558146] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-14T17:18:01.616228] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T17:18:01.628955] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-14T17:18:02.358078] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-14T17:18:03.158043] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-14T17:18:03.634402] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-14T17:18:03.958100] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-14T17:18:04.452225] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T17:18:04.593743] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T17:18:04.758119] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-14T17:18:04.831723] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T17:18:05.558093] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-14T17:18:05.647677] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T17:18:06.358062] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-14T17:18:06.948457] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T17:18:07.158095] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-14T17:18:07.378715] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T17:18:07.958072] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-14T17:18:08.758135] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-14T17:18:09.337592] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T17:18:09.364041] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T17:18:09.369625] [INFO ] [REMOTE ] AQN: Full fetch complete (75003 records). [2025-10-14T17:18:09.369848] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-14T17:18:09.370762] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:18:09.370853] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:18:09.370896] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:18:09.370937] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-14T17:18:09.371008] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-14T17:18:09.371073] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-14T17:18:09.371325] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-14T17:18:09.371506] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AQN took 42.8s. Estimated remaining: 4h 52m 32s. Rate: 7.6 symbols/min [2025-10-14T17:18:09.561040] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-14T17:18:09.565785] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:18:09.576441] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T17:18:09.605802] [DEBUG] [LOCAL ] ARDT: Loaded 27696 existing records from primary storage. [2025-10-14T17:18:09.606080] [INFO ] [MAIN ] ARDT: Loaded 27696 existing records. [2025-10-14T17:18:09.787230] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:18:09.787482] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-14T17:18:09.787531] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-14T17:18:09.787752] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-14T17:18:09.787832] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-14T17:18:10.161511] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:18:10.358113] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-14T17:18:11.158057] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-14T17:18:11.204845] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T17:18:11.963166] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-14T17:18:11.980262] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T17:18:12.527368] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T17:18:12.758062] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-14T17:18:13.558065] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-14T17:18:13.993342] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T17:18:14.206777] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T17:18:14.358066] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-14T17:18:14.371678] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T17:18:15.158038] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-14T17:18:15.252730] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T17:18:15.958143] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-14T17:18:16.292214] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T17:18:16.295339] [INFO ] [REMOTE ] ARDC: Full fetch complete (21355 records). [2025-10-14T17:18:16.295471] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-14T17:18:16.763187] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-14T17:18:16.828249] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-14T17:18:16.828334] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-14T17:18:16.828757] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-14T17:18:16.828822] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-14T17:18:16.829590] [DEBUG] [LOCAL ] ARDC: Trimmed 21355 records to 15257 (keeping 200 days of data) [2025-10-14T17:18:16.944228] [DEBUG] [LOCAL ] ARDC: Primary data saved (15257 records). [2025-10-14T17:18:16.944388] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-14T17:18:16.944466] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. ARDC took 25.2s. Estimated remaining: 4h 52m 19s. Rate: 7.6 symbols/min [2025-10-14T17:18:17.146846] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:18:17.196220] [DEBUG] [LOCAL ] ARE: Loaded 50891 existing records from primary storage. [2025-10-14T17:18:17.196767] [INFO ] [MAIN ] ARE: Loaded 50891 existing records. [2025-10-14T17:18:17.385088] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:18:17.385355] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-14T17:18:17.385531] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-14T17:18:17.393671] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-14T17:18:17.407023] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-14T17:18:17.473233] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:18:17.563177] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-14T17:18:17.788691] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:18:18.358072] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-14T17:18:18.680914] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T17:18:19.168524] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-14T17:18:19.171533] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T17:18:19.528773] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T17:18:19.958173] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-14T17:18:20.758181] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-14T17:18:20.965568] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T17:18:21.063421] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T17:18:21.070150] [INFO ] [REMOTE ] AR: Full fetch complete (77714 records). [2025-10-14T17:18:21.070507] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-14T17:18:21.510710] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-14T17:18:21.510840] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-14T17:18:21.511929] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-14T17:18:21.512049] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-14T17:18:21.514393] [DEBUG] [LOCAL ] AR: Trimmed 77714 records to 53587 (keeping 200 days of data) [2025-10-14T17:18:21.566443] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-14T17:18:21.837221] [DEBUG] [LOCAL ] AR: Primary data saved (53587 records). [2025-10-14T17:18:21.837407] [INFO ] [MAIN ] AR: Full history saved. [2025-10-14T17:18:21.837562] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. AR took 47.1s. Estimated remaining: 4h 51m 24s. Rate: 7.6 symbols/min [2025-10-14T17:18:22.014110] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:18:22.059501] [DEBUG] [LOCAL ] ARES: Loaded 49688 existing records from primary storage. [2025-10-14T17:18:22.059818] [INFO ] [MAIN ] ARES: Loaded 49688 existing records. [2025-10-14T17:18:22.247969] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:18:22.248222] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-14T17:18:22.248284] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-14T17:18:22.249259] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-14T17:18:22.249317] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-14T17:18:22.359047] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-14T17:18:22.636703] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:18:22.651444] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T17:18:22.683732] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T17:18:23.158050] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-14T17:18:23.678397] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T17:18:23.958117] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-14T17:18:24.758234] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-14T17:18:24.857907] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T17:18:25.094610] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T17:18:25.558099] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-14T17:18:26.358060] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-14T17:18:26.493190] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:18:27.122080] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T17:18:27.158035] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-14T17:18:27.489736] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T17:18:27.958086] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-14T17:18:28.578264] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T17:18:28.583694] [INFO ] [REMOTE ] ARCO: Full fetch complete (65252 records). [2025-10-14T17:18:28.583853] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-14T17:18:28.763618] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-14T17:18:28.983589] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-14T17:18:28.983686] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-14T17:18:28.984386] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-14T17:18:28.984447] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-14T17:18:28.985835] [DEBUG] [LOCAL ] ARCO: Trimmed 65252 records to 44536 (keeping 200 days of data) [2025-10-14T17:18:29.240114] [DEBUG] [LOCAL ] ARCO: Primary data saved (44536 records). [2025-10-14T17:18:29.240246] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-14T17:18:29.240315] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARCO took 38.6s. Estimated remaining: 4h 51m 9s. Rate: 7.7 symbols/min [2025-10-14T17:18:29.417281] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:18:29.458069] [DEBUG] [LOCAL ] ARI: Loaded 43711 existing records from primary storage. [2025-10-14T17:18:29.458575] [INFO ] [MAIN ] ARI: Loaded 43711 existing records. [2025-10-14T17:18:29.565226] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-14T17:18:29.652926] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:18:29.653156] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-14T17:18:29.653321] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-14T17:18:29.665438] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-14T17:18:29.685087] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-14T17:18:29.770486] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T17:18:30.092622] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:18:30.358048] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-14T17:18:30.441488] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T17:18:30.641307] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T17:18:31.158089] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-14T17:18:31.927665] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T17:18:31.958035] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-14T17:18:32.390440] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T17:18:32.758139] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-14T17:18:33.327402] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T17:18:33.558086] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-14T17:18:34.358105] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-14T17:18:34.582252] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T17:18:34.795951] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T17:18:35.158073] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-14T17:18:35.958052] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-14T17:18:36.106383] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T17:18:36.110996] [INFO ] [REMOTE ] ARDT: Full fetch complete (41759 records). [2025-10-14T17:18:36.111094] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-14T17:18:36.518407] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-14T17:18:36.518491] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-14T17:18:36.519077] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-14T17:18:36.519147] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-14T17:18:36.520197] [DEBUG] [LOCAL ] ARDT: Trimmed 41759 records to 27735 (keeping 200 days of data) [2025-10-14T17:18:36.706291] [DEBUG] [LOCAL ] ARDT: Primary data saved (27735 records). [2025-10-14T17:18:36.706428] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-14T17:18:36.706511] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARDT took 27.3s. Estimated remaining: 4h 50m 56s. Rate: 7.7 symbols/min [2025-10-14T17:18:36.763175] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-14T17:18:36.938274] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:18:36.970076] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T17:18:37.021417] [DEBUG] [LOCAL ] ARIS: Loaded 42525 existing records from primary storage. [2025-10-14T17:18:37.021852] [INFO ] [MAIN ] ARIS: Loaded 42525 existing records. [2025-10-14T17:18:37.208608] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:18:37.288578] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:18:37.288838] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-14T17:18:37.288885] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-14T17:18:37.289201] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-14T17:18:37.289259] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-14T17:18:37.567348] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-14T17:18:37.720197] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:18:38.358038] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-14T17:18:38.762839] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T17:18:39.158048] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-14T17:18:39.275571] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T17:18:39.483199] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T17:18:39.958072] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-14T17:18:40.758089] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-14T17:18:40.990925] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T17:18:41.523537] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T17:18:41.558043] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-14T17:18:42.358051] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-14T17:18:42.461037] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T17:18:42.642493] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T17:18:43.158081] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-14T17:18:43.804675] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T17:18:43.958050] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-14T17:18:44.758108] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-14T17:18:44.998756] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T17:18:45.558100] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-14T17:18:45.659828] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T17:18:46.259851] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:18:46.358091] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-14T17:18:47.158091] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-14T17:18:47.431240] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-14T17:18:47.958102] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-14T17:18:47.994179] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T17:18:48.758034] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-14T17:18:48.965384] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T17:18:49.461259] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T17:18:49.558038] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-14T17:18:50.079445] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T17:18:50.358058] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-14T17:18:51.114053] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T17:18:51.158091] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-14T17:18:51.731457] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T17:18:51.958067] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-14T17:18:52.545739] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T17:18:52.758096] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-14T17:18:53.558046] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-14T17:18:53.660623] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T17:18:54.038299] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T17:18:54.358075] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-14T17:18:55.158559] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-14T17:18:55.165047] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T17:18:55.824932] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T17:18:55.958074] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-14T17:18:56.472205] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T17:18:56.758062] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-14T17:18:57.558411] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-14T17:18:57.560991] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T17:18:57.569123] [INFO ] [REMOTE ] ARE: Full fetch complete (72940 records). [2025-10-14T17:18:57.569339] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-14T17:18:57.962986] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-14T17:18:57.963099] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-14T17:18:57.963931] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-14T17:18:57.963995] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-14T17:18:57.965432] [DEBUG] [LOCAL ] ARE: Trimmed 72940 records to 50917 (keeping 200 days of data) [2025-10-14T17:18:58.086360] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T17:18:58.334804] [DEBUG] [LOCAL ] ARE: Primary data saved (50917 records). [2025-10-14T17:18:58.334956] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-14T17:18:58.335085] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARE took 41.4s. Estimated remaining: 4h 54m 22s. Rate: 7.6 symbols/min [2025-10-14T17:18:58.366031] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-14T17:18:58.505150] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:18:58.545212] [DEBUG] [LOCAL ] ARLO: Loaded 43759 existing records from primary storage. [2025-10-14T17:18:58.545558] [INFO ] [MAIN ] ARLO: Loaded 43759 existing records. [2025-10-14T17:18:58.720684] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:18:58.720944] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-14T17:18:58.720990] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-14T17:18:58.721489] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-14T17:18:58.721547] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-14T17:18:59.103094] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T17:18:59.108055] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:18:59.158025] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-14T17:18:59.958038] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-14T17:19:00.156576] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T17:19:00.758082] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-14T17:19:00.814049] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T17:19:01.388074] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T17:19:01.558122] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-14T17:19:02.358102] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-14T17:19:02.399250] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T17:19:03.157986] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-14T17:19:03.233872] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T17:19:03.239813] [INFO ] [REMOTE ] ARES: Full fetch complete (71201 records). [2025-10-14T17:19:03.239944] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-14T17:19:03.633342] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-14T17:19:03.633464] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-14T17:19:03.634248] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-14T17:19:03.634700] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-14T17:19:03.636285] [DEBUG] [LOCAL ] ARES: Trimmed 71201 records to 49704 (keeping 200 days of data) [2025-10-14T17:19:03.882956] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T17:19:03.892767] [INFO ] [REMOTE ] ARIS: Full fetch complete (61525 records). [2025-10-14T17:19:03.894777] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-14T17:19:03.963240] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-14T17:19:04.392006] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-14T17:19:04.392557] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-14T17:19:04.393807] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-14T17:19:04.395678] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-14T17:19:04.399619] [DEBUG] [LOCAL ] ARES: Primary data saved (49704 records). [2025-10-14T17:19:04.400134] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-14T17:19:04.400312] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARES took 42.6s. Estimated remaining: 4h 53m 46s. Rate: 7.6 symbols/min [2025-10-14T17:19:04.424946] [DEBUG] [LOCAL ] ARIS: Trimmed 61525 records to 42574 (keeping 200 days of data) [2025-10-14T17:19:04.725948] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:04.842928] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T17:19:04.863405] [INFO ] [REMOTE ] ARI: Full fetch complete (62643 records). [2025-10-14T17:19:04.865479] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-14T17:19:04.988027] [DEBUG] [LOCAL ] ARMK: Loaded 50343 existing records from primary storage. [2025-10-14T17:19:05.001947] [INFO ] [MAIN ] ARMK: Loaded 50343 existing records. [2025-10-14T17:19:05.401887] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:05.439507] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-14T17:19:05.446634] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-14T17:19:05.467504] [DEBUG] [LOCAL ] ARIS: Primary data saved (42574 records). [2025-10-14T17:19:05.467754] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-14T17:19:05.461273] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-14T17:19:05.473634] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARIS took 28.8s. Estimated remaining: 4h 51m 53s. Rate: 7.6 symbols/min [2025-10-14T17:19:05.484339] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-14T17:19:05.731998] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-14T17:19:05.767716] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-14T17:19:05.769036] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-14T17:19:05.786470] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-14T17:19:05.876747] [DEBUG] [LOCAL ] ARI: Trimmed 62643 records to 43778 (keeping 200 days of data) [2025-10-14T17:19:05.947472] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:05.950506] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-14T17:19:06.096501] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-14T17:19:06.313831] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:06.314886] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-14T17:19:06.357519] [DEBUG] [LOCAL ] AROC: Loaded 48999 existing records from primary storage. [2025-10-14T17:19:06.363957] [INFO ] [MAIN ] AROC: Loaded 48999 existing records. [2025-10-14T17:19:06.714541] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:06.720426] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-14T17:19:06.720511] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-14T17:19:06.722778] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-14T17:19:06.722882] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-14T17:19:06.804341] [DEBUG] [LOCAL ] ARI: Primary data saved (43778 records). [2025-10-14T17:19:06.817892] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-14T17:19:06.818994] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARI took 37.6s. Estimated remaining: 4h 50m 5s. Rate: 7.7 symbols/min [2025-10-14T17:19:07.224633] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:07.350417] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:07.351187] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-14T17:19:07.396783] [DEBUG] [LOCAL ] ARR: Loaded 52091 existing records from primary storage. [2025-10-14T17:19:07.397293] [INFO ] [MAIN ] ARR: Loaded 52091 existing records. [2025-10-14T17:19:07.562502] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T17:19:07.611301] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-14T17:19:07.614673] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:07.616180] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-14T17:19:07.616261] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-14T17:19:07.616774] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-14T17:19:07.616836] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-14T17:19:08.005590] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:08.006013] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-14T17:19:08.040183] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:19:08.758054] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-14T17:19:08.959050] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T17:19:09.016255] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T17:19:09.558091] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-14T17:19:10.072426] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T17:19:10.297088] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T17:19:10.358083] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-14T17:19:11.158082] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-14T17:19:11.226325] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T17:19:11.958099] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-14T17:19:11.962497] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T17:19:12.739453] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T17:19:12.758035] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-14T17:19:13.432158] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T17:19:13.558071] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-14T17:19:14.237932] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T17:19:14.358109] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-14T17:19:15.066519] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T17:19:15.158093] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-14T17:19:15.734374] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T17:19:15.958062] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-14T17:19:16.758095] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-14T17:19:16.852061] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T17:19:17.543526] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T17:19:17.558050] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-14T17:19:18.297422] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T17:19:18.358111] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-14T17:19:19.158082] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-14T17:19:19.325793] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T17:19:19.605030] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T17:19:19.958093] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-14T17:19:20.758061] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-14T17:19:21.232434] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T17:19:21.558067] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-14T17:19:21.772834] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T17:19:22.300943] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T17:19:22.358053] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-14T17:19:22.982588] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T17:19:23.158062] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-14T17:19:23.770128] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T17:19:23.958060] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-14T17:19:24.758125] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-14T17:19:24.848931] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T17:19:25.558207] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-14T17:19:25.716729] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T17:19:26.191445] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T17:19:26.196508] [INFO ] [REMOTE ] ARLO: Full fetch complete (63072 records). [2025-10-14T17:19:26.196664] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-14T17:19:26.364005] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-14T17:19:26.612024] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-14T17:19:26.612151] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-14T17:19:26.612991] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-14T17:19:26.613065] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-14T17:19:26.615303] [DEBUG] [LOCAL ] ARLO: Trimmed 63072 records to 43765 (keeping 200 days of data) [2025-10-14T17:19:26.868355] [DEBUG] [LOCAL ] ARLO: Primary data saved (43765 records). [2025-10-14T17:19:26.868486] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-14T17:19:26.868563] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARLO took 28.5s. Estimated remaining: 4h 53m 2s. Rate: 7.6 symbols/min [2025-10-14T17:19:27.039477] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:27.075013] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:19:27.113952] [DEBUG] [LOCAL ] ARW: Loaded 33011 existing records from primary storage. [2025-10-14T17:19:27.114262] [INFO ] [MAIN ] ARW: Loaded 33011 existing records. [2025-10-14T17:19:27.168238] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-14T17:19:27.326818] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:27.327198] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-14T17:19:27.327282] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-14T17:19:27.327570] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-14T17:19:27.327674] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-14T17:19:27.693898] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:27.751294] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T17:19:27.958138] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-14T17:19:28.758060] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-14T17:19:28.987293] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-14T17:19:29.300230] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T17:19:29.558065] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-14T17:19:30.358094] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-14T17:19:30.655930] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T17:19:31.158109] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-14T17:19:31.451206] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T17:19:31.520020] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:19:31.958116] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-14T17:19:32.758075] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-14T17:19:32.846615] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T17:19:33.534142] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T17:19:33.558032] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-14T17:19:34.301188] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T17:19:34.358155] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-14T17:19:35.158131] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-14T17:19:35.569627] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-14T17:19:35.963236] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-14T17:19:35.981777] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T17:19:36.534950] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T17:19:36.758127] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-14T17:19:37.320166] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T17:19:37.558088] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-14T17:19:38.123937] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T17:19:38.130408] [INFO ] [REMOTE ] ARMK: Full fetch complete (72889 records). [2025-10-14T17:19:38.130605] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-14T17:19:38.363272] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-14T17:19:38.567608] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-14T17:19:38.567756] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-14T17:19:38.568702] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-14T17:19:38.568771] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-14T17:19:38.570807] [DEBUG] [LOCAL ] ARMK: Trimmed 72889 records to 50356 (keeping 200 days of data) [2025-10-14T17:19:38.893386] [DEBUG] [LOCAL ] ARMK: Primary data saved (50356 records). [2025-10-14T17:19:38.893690] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-14T17:19:38.893836] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARMK took 34.5s. Estimated remaining: 4h 53m 56s. Rate: 7.6 symbols/min [2025-10-14T17:19:39.077524] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T17:19:39.120164] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:39.120380] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-14T17:19:39.120420] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-14T17:19:39.120538] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-14T17:19:39.120581] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-14T17:19:39.120624] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-14T17:19:39.120864] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-14T17:19:39.163304] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-14T17:19:39.512355] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:39.958054] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-14T17:19:40.070979] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T17:19:40.450232] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T17:19:40.758087] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-14T17:19:41.558052] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-14T17:19:41.807125] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T17:19:41.813156] [INFO ] [REMOTE ] AROC: Full fetch complete (71186 records). [2025-10-14T17:19:41.813322] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-14T17:19:42.223078] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-14T17:19:42.223200] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-14T17:19:42.224182] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-14T17:19:42.224328] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-14T17:19:42.226000] [DEBUG] [LOCAL ] AROC: Trimmed 71186 records to 49037 (keeping 200 days of data) [2025-10-14T17:19:42.402190] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-14T17:19:42.474475] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T17:19:42.559454] [DEBUG] [LOCAL ] AROC: Primary data saved (49037 records). [2025-10-14T17:19:42.559607] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-14T17:19:42.560236] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. AROC took 37.1s. Estimated remaining: 4h 52m 44s. Rate: 7.6 symbols/min [2025-10-14T17:19:42.665222] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:19:42.674825] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-14T17:19:42.685272] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:19:42.708894] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-14T17:19:42.723427] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:19:42.739359] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-14T17:19:42.743377] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-14T17:19:42.743089] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:42.743604] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-14T17:19:42.744223] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-14T17:19:42.744326] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARX took 3.9s. Estimated remaining: 4h 50m 42s. Rate: 7.6 symbols/min [2025-10-14T17:19:42.938546] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:42.989064] [DEBUG] [LOCAL ] AS: Loaded 53163 existing records from primary storage. [2025-10-14T17:19:42.995805] [INFO ] [MAIN ] AS: Loaded 53163 existing records. [2025-10-14T17:19:42.995567] [DEBUG] [LOCAL ] ASA: Loaded 14963 existing records from primary storage. [2025-10-14T17:19:43.028119] [INFO ] [MAIN ] ASA: Loaded 14963 existing records. [2025-10-14T17:19:43.161160] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-14T17:19:43.350700] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:43.351044] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-14T17:19:43.356939] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-14T17:19:43.391488] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:43.391930] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-14T17:19:43.392435] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-14T17:19:43.392500] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-14T17:19:43.405234] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-14T17:19:43.450405] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-14T17:19:43.502140] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-14T17:19:43.515488] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-14T17:19:43.612822] [INFO ] [REMOTE ] ARR: Full fetch complete (75423 records). [2025-10-14T17:19:43.673374] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-14T17:19:44.229571] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:44.346481] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-14T17:19:44.558141] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:44.655594] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-14T17:19:44.655790] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-14T17:19:44.656669] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-14T17:19:44.656750] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-14T17:19:44.665302] [DEBUG] [LOCAL ] ARR: Trimmed 75423 records to 52116 (keeping 200 days of data) [2025-10-14T17:19:44.678592] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:19:44.773119] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-14T17:19:45.010150] [DEBUG] [LOCAL ] ARR: Primary data saved (52116 records). [2025-10-14T17:19:45.010298] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-14T17:19:45.010901] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARR took 38.2s. Estimated remaining: 4h 49m 12s. Rate: 7.7 symbols/min [2025-10-14T17:19:45.177158] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:19:45.230033] [DEBUG] [LOCAL ] ASAN: Loaded 52724 existing records from primary storage. [2025-10-14T17:19:45.230345] [INFO ] [MAIN ] ASAN: Loaded 52724 existing records. [2025-10-14T17:19:45.405794] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:19:45.406009] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-14T17:19:45.406056] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-14T17:19:45.406431] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-14T17:19:45.406488] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-14T17:19:45.567767] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-14T17:19:45.712706] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T17:19:45.798368] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:19:45.880704] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T17:19:46.358077] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-14T17:19:46.729916] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T17:19:47.158158] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-14T17:19:47.856430] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T17:19:47.958095] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-14T17:19:48.295686] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T17:19:48.758130] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-14T17:19:49.297469] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T17:19:49.558081] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-14T17:19:50.358119] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-14T17:19:50.556371] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T17:19:50.936886] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T17:19:50.954600] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T17:19:51.158071] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-14T17:19:51.958121] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-14T17:19:52.317228] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T17:19:52.758064] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-14T17:19:53.324408] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T17:19:53.558053] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-14T17:19:54.358106] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-14T17:19:54.455873] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T17:19:54.911399] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T17:19:55.154107] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T17:19:55.158018] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-14T17:19:55.926018] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T17:19:55.958103] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-14T17:19:56.758120] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-14T17:19:56.822151] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T17:19:57.558092] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-14T17:19:58.255774] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T17:19:58.358072] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-14T17:19:58.516784] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T17:19:58.904100] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T17:19:59.158102] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-14T17:19:59.958098] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-14T17:20:00.758117] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-14T17:20:00.957639] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T17:20:01.558114] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-14T17:20:01.593325] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T17:20:01.598005] [INFO ] [REMOTE ] ARW: Full fetch complete (48305 records). [2025-10-14T17:20:01.598273] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-14T17:20:02.004205] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T17:20:02.089240] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-14T17:20:02.089407] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-14T17:20:02.090334] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-14T17:20:02.090425] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-14T17:20:02.092187] [DEBUG] [LOCAL ] ARW: Trimmed 48305 records to 33043 (keeping 200 days of data) [2025-10-14T17:20:02.325965] [DEBUG] [LOCAL ] ARW: Primary data saved (33043 records). [2025-10-14T17:20:02.326169] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-14T17:20:02.326304] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. ARW took 35.5s. Estimated remaining: 4h 51m 23s. Rate: 7.6 symbols/min [2025-10-14T17:20:02.363257] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-14T17:20:02.525364] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:20:02.578884] [DEBUG] [LOCAL ] ASB: Loaded 49582 existing records from primary storage. [2025-10-14T17:20:02.579806] [INFO ] [MAIN ] ASB: Loaded 49582 existing records. [2025-10-14T17:20:02.772556] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:20:02.772974] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-14T17:20:02.773037] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-14T17:20:02.773872] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-14T17:20:02.773948] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-14T17:20:03.172307] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-14T17:20:03.199360] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:20:03.279949] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T17:20:03.958115] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-14T17:20:04.167242] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T17:20:04.270563] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-14T17:20:04.758090] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-14T17:20:05.558077] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-14T17:20:05.996297] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-14T17:20:06.358113] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-14T17:20:06.544824] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T17:20:06.734313] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T17:20:06.737228] [INFO ] [REMOTE ] ASA: Full fetch complete (19930 records). [2025-10-14T17:20:06.737299] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-14T17:20:07.118153] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-14T17:20:07.118233] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-14T17:20:07.118569] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-14T17:20:07.118608] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-14T17:20:07.119203] [DEBUG] [LOCAL ] ASA: Trimmed 19930 records to 15119 (keeping 200 days of data) [2025-10-14T17:20:07.167421] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-14T17:20:07.223578] [DEBUG] [LOCAL ] ASA: Primary data saved (15119 records). [2025-10-14T17:20:07.223776] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-14T17:20:07.223887] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASA took 24.5s. Estimated remaining: 4h 50m 32s. Rate: 7.6 symbols/min [2025-10-14T17:20:07.395512] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:20:07.401976] [DEBUG] [LOCAL ] ASBA: Loaded 3450 existing records from primary storage. [2025-10-14T17:20:07.402179] [INFO ] [MAIN ] ASBA: Loaded 3450 existing records. [2025-10-14T17:20:07.578259] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:20:07.578512] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-14T17:20:07.578559] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-14T17:20:07.578734] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-14T17:20:07.578790] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-14T17:20:07.929894] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:20:07.958032] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-14T17:20:08.079513] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T17:20:08.732052] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T17:20:08.758027] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-14T17:20:08.815873] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T17:20:09.337834] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T17:20:09.558096] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-14T17:20:10.358095] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-14T17:20:11.158083] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-14T17:20:11.385972] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T17:20:11.657529] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-14T17:20:11.958095] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-14T17:20:12.328777] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-14T17:20:12.758121] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-14T17:20:13.558066] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-14T17:20:14.320827] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (3.96 seconds). [2025-10-14T17:20:14.338581] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T17:20:14.362843] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-14T17:20:14.368810] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T17:20:15.158120] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-14T17:20:15.713087] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T17:20:15.958049] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-14T17:20:16.365661] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T17:20:16.405883] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-14T17:20:16.758063] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-14T17:20:17.299311] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T17:20:17.558050] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-14T17:20:17.970361] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-14T17:20:18.358136] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-14T17:20:19.158143] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-14T17:20:19.958059] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-14T17:20:20.338330] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T17:20:20.758046] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-14T17:20:21.028920] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T17:20:21.411317] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T17:20:21.412394] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T17:20:21.419219] [INFO ] [REMOTE ] ASAN: Full fetch complete (76268 records). [2025-10-14T17:20:21.419330] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-14T17:20:21.420148] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:20:21.420234] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:20:21.420285] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:20:21.420373] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-14T17:20:21.420450] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-14T17:20:21.420498] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-10-14T17:20:21.420786] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-10-14T17:20:21.421361] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASAN took 36.4s. Estimated remaining: 4h 51m 55s. Rate: 7.6 symbols/min [2025-10-14T17:20:21.567355] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-14T17:20:21.605421] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:20:21.644574] [DEBUG] [LOCAL ] ASC: Loaded 37351 existing records from primary storage. [2025-10-14T17:20:21.644910] [INFO ] [MAIN ] ASC: Loaded 37351 existing records. [2025-10-14T17:20:21.848147] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:20:21.848402] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-14T17:20:21.848467] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-14T17:20:21.848729] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-14T17:20:21.848789] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-14T17:20:22.193700] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T17:20:22.224688] [INFO ] [REMOTE ] ASBA: Full fetch complete (5210 records). [2025-10-14T17:20:22.224566] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:20:22.224800] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-14T17:20:22.363140] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-14T17:20:22.589867] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-14T17:20:22.589947] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-14T17:20:22.590099] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-14T17:20:22.590158] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-14T17:20:22.590617] [DEBUG] [LOCAL ] ASBA: Trimmed 5210 records to 3448 (keeping 200 days of data) [2025-10-14T17:20:22.611408] [DEBUG] [LOCAL ] ASBA: Primary data saved (3448 records). [2025-10-14T17:20:22.611480] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-14T17:20:22.611553] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASBA took 15.4s. Estimated remaining: 4h 50m 11s. Rate: 7.6 symbols/min [2025-10-14T17:20:22.785112] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:20:22.804457] [DEBUG] [LOCAL ] ASG: Loaded 19522 existing records from primary storage. [2025-10-14T17:20:22.804761] [INFO ] [MAIN ] ASG: Loaded 19522 existing records. [2025-10-14T17:20:22.983877] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:20:22.984082] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-14T17:20:22.984129] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-14T17:20:22.984288] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-14T17:20:22.984325] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-14T17:20:23.167341] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-14T17:20:23.342897] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:20:23.741858] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T17:20:23.958070] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-14T17:20:24.758035] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-14T17:20:24.807468] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T17:20:24.831677] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T17:20:25.558069] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-14T17:20:25.940895] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T17:20:26.358075] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-14T17:20:26.888157] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T17:20:27.158106] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-14T17:20:27.942328] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T17:20:27.958021] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-14T17:20:28.758067] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-14T17:20:28.972983] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T17:20:29.212319] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T17:20:29.481191] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T17:20:29.558107] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-14T17:20:30.358067] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-14T17:20:31.158055] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-14T17:20:31.358202] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:20:31.857107] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T17:20:31.958071] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-14T17:20:32.204700] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T17:20:32.758145] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-14T17:20:33.504179] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T17:20:33.558052] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-14T17:20:34.358101] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-14T17:20:34.647765] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T17:20:35.052667] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T17:20:35.158065] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-14T17:20:35.617346] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T17:20:35.958101] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-14T17:20:36.763146] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-14T17:20:36.777950] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T17:20:36.899396] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T17:20:37.558062] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-14T17:20:38.358112] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-14T17:20:38.555257] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-14T17:20:38.561688] [INFO ] [REMOTE ] AS: Full fetch complete (76780 records). [2025-10-14T17:20:38.561861] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-14T17:20:38.916698] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T17:20:38.978835] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-14T17:20:38.978916] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-14T17:20:38.979680] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-14T17:20:38.979743] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-14T17:20:38.981189] [DEBUG] [LOCAL ] AS: Trimmed 76780 records to 53174 (keeping 200 days of data) [2025-10-14T17:20:39.161628] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-14T17:20:39.299480] [DEBUG] [LOCAL ] AS: Primary data saved (53174 records). [2025-10-14T17:20:39.299619] [INFO ] [MAIN ] AS: Full history saved. [2025-10-14T17:20:39.300357] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. AS took 56.7s. Estimated remaining: 4h 52m 8s. Rate: 7.6 symbols/min [2025-10-14T17:20:39.474363] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:20:39.499207] [DEBUG] [LOCAL ] ASGI: Loaded 22835 existing records from primary storage. [2025-10-14T17:20:39.499462] [INFO ] [MAIN ] ASGI: Loaded 22835 existing records. [2025-10-14T17:20:39.709284] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:20:39.709754] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-14T17:20:39.709857] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-14T17:20:39.710196] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-14T17:20:39.718106] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-14T17:20:39.812348] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T17:20:39.965023] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-14T17:20:40.102434] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:20:40.531801] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T17:20:40.761678] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-14T17:20:40.765151] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T17:20:41.558064] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-14T17:20:42.206585] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T17:20:42.358039] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-14T17:20:42.622135] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T17:20:43.158124] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-14T17:20:43.234495] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T17:20:43.958103] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-14T17:20:44.148252] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T17:20:44.758061] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-14T17:20:45.368501] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T17:20:45.558150] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-14T17:20:46.358089] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-14T17:20:46.524315] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-14T17:20:46.530179] [INFO ] [REMOTE ] ASB: Full fetch complete (71969 records). [2025-10-14T17:20:46.530333] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-14T17:20:46.921870] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-14T17:20:46.921955] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-14T17:20:46.922689] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-14T17:20:46.922753] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-14T17:20:46.924163] [DEBUG] [LOCAL ] ASB: Trimmed 71969 records to 49600 (keeping 200 days of data) [2025-10-14T17:20:47.053589] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T17:20:47.180995] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-14T17:20:47.284863] [DEBUG] [LOCAL ] ASB: Primary data saved (49600 records). [2025-10-14T17:20:47.285077] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-14T17:20:47.285185] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASB took 45.0s. Estimated remaining: 4h 52m 1s. Rate: 7.6 symbols/min [2025-10-14T17:20:47.485913] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:20:47.958087] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-14T17:20:48.374761] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T17:20:48.758067] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-14T17:20:49.372972] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T17:20:49.558053] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-14T17:20:49.744993] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T17:20:50.358079] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-14T17:20:50.654160] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T17:20:50.658527] [INFO ] [REMOTE ] ASC: Full fetch complete (56266 records). [2025-10-14T17:20:50.658713] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-14T17:20:51.116529] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-14T17:20:51.116716] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-14T17:20:51.117492] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-14T17:20:51.117556] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-14T17:20:51.118952] [DEBUG] [LOCAL ] ASC: Trimmed 56266 records to 37331 (keeping 200 days of data) [2025-10-14T17:20:51.177136] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-14T17:20:51.363612] [DEBUG] [LOCAL ] ASC: Primary data saved (37331 records). [2025-10-14T17:20:51.363790] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-14T17:20:51.364340] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASC took 29.9s. Estimated remaining: 4h 50m 60s. Rate: 7.6 symbols/min [2025-10-14T17:20:51.404805] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T17:20:51.958045] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-14T17:20:52.222574] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T17:20:52.632245] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T17:20:52.634739] [INFO ] [REMOTE ] ASG: Full fetch complete (30983 records). [2025-10-14T17:20:52.634830] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-14T17:20:52.759934] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-14T17:20:53.071352] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-14T17:20:53.071438] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-14T17:20:53.071921] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-14T17:20:53.071985] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-14T17:20:53.072899] [DEBUG] [LOCAL ] ASG: Trimmed 30983 records to 19552 (keeping 200 days of data) [2025-10-14T17:20:53.180856] [DEBUG] [LOCAL ] ASG: Primary data saved (19552 records). [2025-10-14T17:20:53.180990] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-14T17:20:53.181065] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASG took 30.6s. Estimated remaining: 4h 49m 27s. Rate: 7.6 symbols/min [2025-10-14T17:20:53.912031] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T17:20:53.917262] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-14T17:20:54.962371] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T17:20:54.968372] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-14T17:20:55.768330] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T17:20:55.773283] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-14T17:20:56.924203] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T17:20:56.929819] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-14T17:20:57.990750] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T17:20:57.996614] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-14T17:20:59.198203] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T17:20:59.204573] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-14T17:21:00.058211] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T17:21:00.061283] [INFO ] [REMOTE ] ASGI: Full fetch complete (33339 records). [2025-10-14T17:21:00.061362] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-14T17:21:00.506206] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-14T17:21:00.506279] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-14T17:21:00.506714] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-14T17:21:00.506774] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-14T17:21:00.507603] [DEBUG] [LOCAL ] ASGI: Trimmed 33339 records to 22862 (keeping 200 days of data) [2025-10-14T17:21:00.644248] [DEBUG] [LOCAL ] ASGI: Primary data saved (22862 records). [2025-10-14T17:21:00.644382] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-14T17:21:00.644459] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGI took 21.3s. Estimated remaining: 4h 49m 14s. Rate: 7.6 symbols/min [2025-10-14T17:21:01.235294] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:01.249885] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:01.298822] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:01.335043] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:01.376308] [DEBUG] [LOCAL ] ASIX: Loaded 22959 existing records from primary storage. [2025-10-14T17:21:01.388065] [INFO ] [MAIN ] ASIX: Loaded 22959 existing records. [2025-10-14T17:21:01.476606] [DEBUG] [LOCAL ] ASGN: Loaded 36450 existing records from primary storage. [2025-10-14T17:21:01.529789] [INFO ] [MAIN ] ASGN: Loaded 36450 existing records. [2025-10-14T17:21:01.554170] [DEBUG] [LOCAL ] ASPN: Loaded 49849 existing records from primary storage. [2025-10-14T17:21:01.554867] [DEBUG] [LOCAL ] ASH: Loaded 37545 existing records from primary storage. [2025-10-14T17:21:01.592784] [INFO ] [MAIN ] ASPN: Loaded 49849 existing records. [2025-10-14T17:21:01.591979] [INFO ] [MAIN ] ASH: Loaded 37545 existing records. [2025-10-14T17:21:01.968483] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:01.978736] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-14T17:21:01.991369] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-14T17:21:02.012100] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-14T17:21:02.043491] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-14T17:21:02.253140] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:02.250129] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:02.253354] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-14T17:21:02.263970] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-14T17:21:02.272089] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:02.290195] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-14T17:21:02.316214] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-14T17:21:02.332323] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-14T17:21:02.332543] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-14T17:21:02.332601] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-14T17:21:02.343456] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-14T17:21:02.359120] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-14T17:21:02.343523] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-14T17:21:02.616795] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-14T17:21:02.689800] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-14T17:21:03.190183] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:03.269862] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-14T17:21:03.620062] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:03.615280] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:03.631631] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-14T17:21:03.631436] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-14T17:21:03.739459] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:03.739812] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-14T17:21:04.537086] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T17:21:04.540549] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-14T17:21:04.812923] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T17:21:04.819159] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-14T17:21:05.064345] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T17:21:05.074933] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-14T17:21:05.094558] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T17:21:05.101474] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-14T17:21:05.275780] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-14T17:21:05.279744] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-14T17:21:05.954256] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T17:21:05.958172] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-14T17:21:06.264917] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T17:21:06.323080] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T17:21:06.358070] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-14T17:21:06.531471] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T17:21:06.586067] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T17:21:07.158133] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-14T17:21:07.561953] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T17:21:07.958030] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-14T17:21:08.273153] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T17:21:08.758073] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-14T17:21:09.399248] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:21:09.483095] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-14T17:21:09.558054] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-14T17:21:10.358062] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-14T17:21:10.996083] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T17:21:11.158166] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-14T17:21:11.886805] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T17:21:11.958170] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-14T17:21:12.680852] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T17:21:12.758091] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-14T17:21:13.336479] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T17:21:13.558061] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-14T17:21:13.792684] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T17:21:14.358096] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-14T17:21:15.109859] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T17:21:15.158040] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-14T17:21:15.958047] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-14T17:21:16.215387] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T17:21:16.767778] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-14T17:21:16.772577] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T17:21:17.044775] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T17:21:17.558068] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-14T17:21:18.358053] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-14T17:21:18.435492] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T17:21:18.498491] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T17:21:19.158076] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-14T17:21:19.498083] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T17:21:19.958073] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-14T17:21:20.250580] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T17:21:20.758083] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-14T17:21:21.211555] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T17:21:21.412952] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T17:21:21.558074] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-14T17:21:22.358108] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-14T17:21:22.555887] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T17:21:22.558781] [INFO ] [REMOTE ] ASIX: Full fetch complete (30542 records). [2025-10-14T17:21:22.558879] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-14T17:21:22.559377] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:21:22.559460] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:21:22.559502] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:21:22.559569] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-14T17:21:22.559631] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-14T17:21:22.559706] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-10-14T17:21:22.559897] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-10-14T17:21:22.559985] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASIX took 21.9s. Estimated remaining: 4h 52m 19s. Rate: 7.6 symbols/min [2025-10-14T17:21:22.730583] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:22.742051] [DEBUG] [LOCAL ] ASR: Loaded 9350 existing records from primary storage. [2025-10-14T17:21:22.742273] [INFO ] [MAIN ] ASR: Loaded 9350 existing records. [2025-10-14T17:21:22.920850] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:22.920997] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-14T17:21:22.921042] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-14T17:21:22.921186] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-14T17:21:22.921225] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-14T17:21:23.170611] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-14T17:21:23.289997] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:23.773038] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T17:21:23.958065] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-14T17:21:24.758099] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-14T17:21:24.981111] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T17:21:25.118631] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:21:25.558063] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-14T17:21:26.155046] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T17:21:26.163156] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T17:21:26.358100] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-14T17:21:27.078262] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T17:21:27.158108] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-14T17:21:27.912222] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T17:21:27.958078] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-14T17:21:28.758076] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-14T17:21:29.558096] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-14T17:21:29.893887] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T17:21:29.965097] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T17:21:30.358068] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-14T17:21:30.676788] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T17:21:31.158100] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-14T17:21:31.271582] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T17:21:31.958080] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-14T17:21:32.710609] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T17:21:32.758031] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-14T17:21:32.853031] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T17:21:33.532868] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T17:21:33.558039] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-14T17:21:34.358085] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-14T17:21:34.978611] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T17:21:35.158085] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-14T17:21:35.477212] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T17:21:35.482873] [INFO ] [REMOTE ] ASGN: Full fetch complete (53053 records). [2025-10-14T17:21:35.483101] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-14T17:21:35.898391] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-14T17:21:35.898478] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-14T17:21:35.899077] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-14T17:21:35.899140] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-14T17:21:35.900186] [DEBUG] [LOCAL ] ASGN: Trimmed 53053 records to 36558 (keeping 200 days of data) [2025-10-14T17:21:35.961601] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-14T17:21:36.113615] [DEBUG] [LOCAL ] ASGN: Primary data saved (36558 records). [2025-10-14T17:21:36.113800] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-14T17:21:36.113890] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASGN took 35.5s. Estimated remaining: 4h 53m 27s. Rate: 7.5 symbols/min [2025-10-14T17:21:36.290695] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:36.341544] [DEBUG] [LOCAL ] ASX: Loaded 52872 existing records from primary storage. [2025-10-14T17:21:36.341892] [INFO ] [MAIN ] ASX: Loaded 52872 existing records. [2025-10-14T17:21:36.517803] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:36.518079] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-14T17:21:36.518127] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-14T17:21:36.518335] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-14T17:21:36.518394] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-14T17:21:36.768390] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-14T17:21:36.814239] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T17:21:36.903474] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:36.975386] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T17:21:37.558060] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-14T17:21:38.048569] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T17:21:38.053073] [INFO ] [REMOTE ] ASH: Full fetch complete (55405 records). [2025-10-14T17:21:38.053187] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-14T17:21:38.363233] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-14T17:21:38.430705] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-14T17:21:38.430785] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-14T17:21:38.431372] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-14T17:21:38.431410] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-14T17:21:38.432487] [DEBUG] [LOCAL ] ASH: Trimmed 55405 records to 37552 (keeping 200 days of data) [2025-10-14T17:21:38.654711] [DEBUG] [LOCAL ] ASH: Primary data saved (37552 records). [2025-10-14T17:21:38.654845] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-14T17:21:38.655351] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASH took 38.0s. Estimated remaining: 4h 52m 6s. Rate: 7.6 symbols/min [2025-10-14T17:21:38.825691] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:38.863266] [DEBUG] [LOCAL ] ATEN: Loaded 38519 existing records from primary storage. [2025-10-14T17:21:38.863731] [INFO ] [MAIN ] ATEN: Loaded 38519 existing records. [2025-10-14T17:21:39.038630] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:39.039061] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-14T17:21:39.039119] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-14T17:21:39.039297] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-14T17:21:39.039334] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-14T17:21:39.163238] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-14T17:21:39.400037] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:39.467534] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T17:21:39.958109] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-14T17:21:40.039625] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T17:21:40.244470] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T17:21:40.758123] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-14T17:21:41.558035] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-14T17:21:41.633487] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T17:21:41.789260] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T17:21:42.358075] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-14T17:21:43.158084] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-14T17:21:43.219740] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T17:21:43.221748] [INFO ] [REMOTE ] ASR: Full fetch complete (12381 records). [2025-10-14T17:21:43.221945] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-14T17:21:43.411924] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T17:21:43.678519] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-14T17:21:43.678610] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-14T17:21:43.678983] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-14T17:21:43.679041] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-14T17:21:43.679496] [DEBUG] [LOCAL ] ASR: Trimmed 12381 records to 9384 (keeping 200 days of data) [2025-10-14T17:21:43.738535] [DEBUG] [LOCAL ] ASR: Primary data saved (9384 records). [2025-10-14T17:21:43.738719] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-14T17:21:43.738825] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASR took 21.2s. Estimated remaining: 4h 51m 19s. Rate: 7.6 symbols/min [2025-10-14T17:21:43.943501] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:43.963539] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-14T17:21:43.979250] [DEBUG] [LOCAL ] ATGE: Loaded 31039 existing records from primary storage. [2025-10-14T17:21:43.979541] [INFO ] [MAIN ] ATGE: Loaded 31039 existing records. [2025-10-14T17:21:44.172588] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:21:44.172844] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-14T17:21:44.172892] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-14T17:21:44.173109] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-14T17:21:44.173164] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-14T17:21:44.538188] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:44.758045] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-14T17:21:44.891964] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T17:21:44.897825] [INFO ] [REMOTE ] ASPN: Full fetch complete (72606 records). [2025-10-14T17:21:44.897972] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-14T17:21:45.308122] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-14T17:21:45.308312] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-14T17:21:45.309143] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-14T17:21:45.309232] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-14T17:21:45.331406] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T17:21:45.339732] [DEBUG] [LOCAL ] ASPN: Trimmed 72606 records to 49874 (keeping 200 days of data) [2025-10-14T17:21:45.558299] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-14T17:21:45.633810] [DEBUG] [LOCAL ] ASPN: Primary data saved (49874 records). [2025-10-14T17:21:45.633970] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-14T17:21:45.634057] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ASPN took 45.0s. Estimated remaining: 4h 49m 51s. Rate: 7.6 symbols/min [2025-10-14T17:21:45.806142] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:21:45.806385] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-10-14T17:21:45.806565] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-10-14T17:21:45.806718] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-14T17:21:45.806777] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-14T17:21:45.806885] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-14T17:21:45.806934] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-14T17:21:45.974511] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T17:21:46.193050] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:21:46.358110] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-14T17:21:47.045467] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T17:21:47.158102] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-14T17:21:47.571765] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T17:21:47.958059] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-14T17:21:48.547350] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T17:21:48.758059] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-14T17:21:49.404735] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T17:21:49.558110] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-14T17:21:49.673257] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T17:21:50.358068] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-14T17:21:51.158107] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-14T17:21:51.299523] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T17:21:51.746429] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T17:21:51.958063] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-14T17:21:52.522080] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T17:21:52.758039] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-14T17:21:53.419731] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T17:21:53.558043] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-14T17:21:53.901341] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T17:21:54.358207] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-14T17:21:55.158121] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-14T17:21:55.313588] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T17:21:55.688418] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:21:55.958059] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-14T17:21:56.758049] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-14T17:21:56.806436] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T17:21:57.558063] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-14T17:21:57.684762] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T17:21:58.241988] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T17:21:58.358073] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-14T17:21:58.838620] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-14T17:21:59.158119] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-14T17:21:59.749065] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T17:21:59.958084] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-14T17:22:00.759339] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-14T17:22:00.764763] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T17:22:01.071944] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T17:22:01.558077] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-14T17:22:01.926622] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T17:22:02.358039] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-14T17:22:02.817148] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T17:22:03.159842] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-14T17:22:03.164579] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T17:22:03.958125] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-14T17:22:04.758463] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-14T17:22:04.775562] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T17:22:05.558094] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-14T17:22:05.836172] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T17:22:06.182106] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T17:22:06.358112] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-14T17:22:07.039027] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T17:22:07.158078] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-14T17:22:07.960877] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-14T17:22:07.964172] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T17:22:08.656963] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T17:22:08.758031] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-14T17:22:09.264998] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T17:22:09.558051] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-14T17:22:09.926470] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T17:22:10.358036] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-14T17:22:10.407750] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T17:22:11.158073] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-14T17:22:11.469100] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T17:22:11.958121] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-14T17:22:12.357430] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T17:22:12.363415] [INFO ] [REMOTE ] ATHM: Full fetch complete (50236 records). [2025-10-14T17:22:12.363745] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-14T17:22:12.763275] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-14T17:22:12.875198] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-14T17:22:12.875291] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-14T17:22:12.875942] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-14T17:22:12.876002] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-14T17:22:12.877177] [DEBUG] [LOCAL ] ATHM: Trimmed 50236 records to 31560 (keeping 200 days of data) [2025-10-14T17:22:13.061980] [DEBUG] [LOCAL ] ATHM: Primary data saved (31560 records). [2025-10-14T17:22:13.062212] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-14T17:22:13.062297] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ATHM took 27.4s. Estimated remaining: 4h 54m 2s. Rate: 7.5 symbols/min [2025-10-14T17:22:13.238209] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:13.250320] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T17:22:13.256763] [INFO ] [REMOTE ] ATEN: Full fetch complete (56833 records). [2025-10-14T17:22:13.256959] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-14T17:22:13.266915] [DEBUG] [LOCAL ] ATHS: Loaded 6739 existing records from primary storage. [2025-10-14T17:22:13.338234] [INFO ] [MAIN ] ATHS: Loaded 6739 existing records. [2025-10-14T17:22:13.572495] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-14T17:22:13.730580] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:22:13.742678] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-14T17:22:13.764807] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-14T17:22:13.770514] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-14T17:22:13.780860] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-14T17:22:13.992456] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-14T17:22:14.017229] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-14T17:22:14.021090] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-14T17:22:14.026865] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-14T17:22:14.093583] [DEBUG] [LOCAL ] ATEN: Trimmed 56833 records to 38394 (keeping 200 days of data) [2025-10-14T17:22:14.409891] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:14.413788] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-14T17:22:14.584852] [DEBUG] [LOCAL ] ATEN: Primary data saved (38394 records). [2025-10-14T17:22:14.599620] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-14T17:22:14.600802] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATEN took 35.9s. Estimated remaining: 4h 52m 29s. Rate: 7.5 symbols/min [2025-10-14T17:22:14.602824] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T17:22:14.796518] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:14.851376] [DEBUG] [LOCAL ] ATI: Loaded 51366 existing records from primary storage. [2025-10-14T17:22:14.851903] [INFO ] [MAIN ] ATI: Loaded 51366 existing records. [2025-10-14T17:22:15.121021] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T17:22:15.152553] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:22:15.154724] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-14T17:22:15.154586] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T17:22:15.154874] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-14T17:22:15.161159] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-14T17:22:15.161561] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-14T17:22:15.162282] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-14T17:22:15.561728] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:15.958070] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-14T17:22:16.758142] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-14T17:22:16.863066] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T17:22:17.558067] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-14T17:22:17.607726] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T17:22:17.661613] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T17:22:18.358124] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-14T17:22:19.158106] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-14T17:22:19.363296] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T17:22:19.369323] [INFO ] [REMOTE ] ASX: Full fetch complete (76752 records). [2025-10-14T17:22:19.369477] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-14T17:22:19.542225] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T17:22:19.609580] [INFO ] [REMOTE ] ATGE: Full fetch complete (46050 records). [2025-10-14T17:22:19.625345] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-14T17:22:19.914797] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T17:22:19.967342] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-14T17:22:19.958103] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-14T17:22:19.976236] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-14T17:22:19.992680] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-14T17:22:20.027805] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-14T17:22:20.190068] [DEBUG] [LOCAL ] ASX: Trimmed 76752 records to 52873 (keeping 200 days of data) [2025-10-14T17:22:20.389148] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-14T17:22:20.392728] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-14T17:22:20.393753] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-14T17:22:20.399824] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-14T17:22:20.414237] [DEBUG] [LOCAL ] ATGE: Trimmed 46050 records to 31110 (keeping 200 days of data) [2025-10-14T17:22:20.760082] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-14T17:22:20.759979] [DEBUG] [LOCAL ] ASX: Primary data saved (52873 records). [2025-10-14T17:22:20.761800] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-14T17:22:20.761946] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ASX took 44.6s. Estimated remaining: 4h 51m 57s. Rate: 7.5 symbols/min [2025-10-14T17:22:20.957409] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:20.957851] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-10-14T17:22:20.958719] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-10-14T17:22:20.959251] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-14T17:22:20.959324] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-14T17:22:20.959402] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-14T17:22:20.959711] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-14T17:22:21.326555] [DEBUG] [LOCAL ] ATGE: Primary data saved (31110 records). [2025-10-14T17:22:21.351153] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-14T17:22:21.351533] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATGE took 37.6s. Estimated remaining: 4h 50m 13s. Rate: 7.6 symbols/min [2025-10-14T17:22:21.418431] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T17:22:21.546265] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:21.570376] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-14T17:22:21.674703] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:21.674876] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-10-14T17:22:21.674913] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-10-14T17:22:21.675018] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-14T17:22:21.675058] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-14T17:22:21.675098] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-14T17:22:21.675131] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-14T17:22:21.967575] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-14T17:22:22.100101] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:22.358122] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-14T17:22:22.412380] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T17:22:23.158085] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-14T17:22:23.671281] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T17:22:23.958172] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-14T17:22:24.706374] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T17:22:24.758088] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-14T17:22:25.439262] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T17:22:25.558081] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-14T17:22:25.877584] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T17:22:26.358100] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-14T17:22:27.158169] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-14T17:22:27.421073] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T17:22:27.484034] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T17:22:27.958115] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-14T17:22:28.289200] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T17:22:28.758123] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-14T17:22:29.558050] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-14T17:22:29.881380] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T17:22:29.920201] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T17:22:30.226036] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T17:22:30.358061] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-14T17:22:31.158059] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-14T17:22:31.901250] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T17:22:31.958033] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-14T17:22:32.666728] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:22:32.758054] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-14T17:22:33.558059] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-14T17:22:33.747064] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T17:22:33.815366] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T17:22:34.358148] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-14T17:22:34.928911] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T17:22:35.158075] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-14T17:22:35.936367] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T17:22:35.958041] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-14T17:22:36.579681] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T17:22:36.579446] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T17:22:36.758267] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-14T17:22:37.558054] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-14T17:22:38.151799] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T17:22:38.358106] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-14T17:22:38.915105] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-14T17:22:39.158072] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-14T17:22:39.321444] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T17:22:39.958094] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-14T17:22:40.476278] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T17:22:40.758062] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-14T17:22:41.558088] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-14T17:22:41.891078] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T17:22:42.369279] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-14T17:22:42.374168] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T17:22:42.753663] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T17:22:43.158081] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-14T17:22:43.744024] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T17:22:43.966535] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-14T17:22:43.973126] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T17:22:43.979512] [INFO ] [REMOTE ] ATI: Full fetch complete (73960 records). [2025-10-14T17:22:43.979689] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-14T17:22:44.440509] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-14T17:22:44.440629] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-14T17:22:44.441679] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-14T17:22:44.441759] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-14T17:22:44.443666] [DEBUG] [LOCAL ] ATI: Trimmed 73960 records to 51381 (keeping 200 days of data) [2025-10-14T17:22:44.663100] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:22:44.759206] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-14T17:22:44.780216] [DEBUG] [LOCAL ] ATI: Primary data saved (51381 records). [2025-10-14T17:22:44.780431] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-14T17:22:44.780543] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATI took 30.2s. Estimated remaining: 4h 53m 26s. Rate: 7.5 symbols/min [2025-10-14T17:22:44.958741] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:44.958988] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-10-14T17:22:44.959055] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-10-14T17:22:44.959180] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-14T17:22:44.959221] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-14T17:22:44.959261] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-14T17:22:44.959295] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-14T17:22:45.354496] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:45.558058] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-14T17:22:46.298191] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T17:22:46.358068] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-14T17:22:46.869142] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T17:22:47.158116] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-14T17:22:47.706280] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T17:22:47.958065] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-14T17:22:48.341120] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T17:22:48.758096] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-14T17:22:49.109790] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T17:22:49.115724] [INFO ] [REMOTE ] ATMU: Full fetch complete (56637 records). [2025-10-14T17:22:49.115867] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-14T17:22:49.543025] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T17:22:49.560093] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-14T17:22:49.580608] [INFO ] [REMOTE ] ATHS: Full fetch complete (9671 records). [2025-10-14T17:22:49.584819] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-14T17:22:49.584617] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-14T17:22:49.585180] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-14T17:22:49.608675] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-14T17:22:49.631732] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-14T17:22:49.695754] [DEBUG] [LOCAL ] ATMU: Trimmed 56637 records to 38890 (keeping 200 days of data) [2025-10-14T17:22:50.079757] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-14T17:22:50.080841] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-14T17:22:50.082041] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-14T17:22:50.082120] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-14T17:22:50.084519] [DEBUG] [LOCAL ] ATHS: Trimmed 9671 records to 6717 (keeping 200 days of data) [2025-10-14T17:22:50.130883] [DEBUG] [LOCAL ] ATHS: Primary data saved (6717 records). [2025-10-14T17:22:50.136305] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-14T17:22:50.136430] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATHS took 37.1s. Estimated remaining: 4h 52m 44s. Rate: 7.5 symbols/min [2025-10-14T17:22:50.317513] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:50.321119] [DEBUG] [LOCAL ] ATR: No existing data file found in primary storage. [2025-10-14T17:22:50.321170] [WARN ] [MAIN ] ATR: No existing data found, performing full refresh instead. [2025-10-14T17:22:50.321277] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-14T17:22:50.321319] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-14T17:22:50.321359] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-14T17:22:50.321440] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-14T17:22:50.408795] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-14T17:22:50.740981] [DEBUG] [LOCAL ] ATMU: Primary data saved (38890 records). [2025-10-14T17:22:50.746196] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-14T17:22:50.757452] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATMU took 29.4s. Estimated remaining: 4h 51m 2s. Rate: 7.5 symbols/min [2025-10-14T17:22:50.949093] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:51.045875] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T17:22:51.091789] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:22:51.092840] [DEBUG] [LOCAL ] ATS: No existing data file found in primary storage. [2025-10-14T17:22:51.092902] [WARN ] [MAIN ] ATS: No existing data found, performing full refresh instead. [2025-10-14T17:22:51.093028] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-14T17:22:51.093589] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-14T17:22:51.093704] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-14T17:22:51.093758] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-14T17:22:51.163272] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-14T17:22:51.477913] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:22:51.958078] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-14T17:22:52.758200] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-14T17:23:05.229812] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (14.07 seconds). [2025-10-14T17:23:05.238694] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-14T17:23:05.906968] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (15.50 seconds). [2025-10-14T17:23:05.917021] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-14T17:23:06.513950] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T17:23:06.522486] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-14T17:23:06.540462] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (13.78 seconds). [2025-10-14T17:23:06.546736] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-14T17:23:07.047308] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T17:23:07.056118] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-14T17:23:07.491252] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T17:23:07.497348] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-14T17:23:07.713900] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T17:23:07.722632] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-14T17:23:07.745237] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (15.79 seconds). [2025-10-14T17:23:07.749891] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-14T17:23:08.601614] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T17:23:08.612847] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-14T17:23:08.677474] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T17:23:08.685846] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-14T17:23:08.766312] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T17:23:08.771683] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-14T17:23:08.845029] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T17:23:08.850062] [INFO ] [REMOTE ] ATKR: Full fetch complete (53509 records). [2025-10-14T17:23:08.850201] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-14T17:23:09.302034] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-14T17:23:09.302136] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-14T17:23:09.302752] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-14T17:23:09.302813] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-14T17:23:09.303819] [DEBUG] [LOCAL ] ATKR: Trimmed 53509 records to 35205 (keeping 200 days of data) [2025-10-14T17:23:09.521122] [DEBUG] [LOCAL ] ATKR: Primary data saved (35205 records). [2025-10-14T17:23:09.521337] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-14T17:23:09.521424] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATKR took 48.8s. Estimated remaining: 4h 53m 11s. Rate: 7.5 symbols/min [2025-10-14T17:23:09.701496] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:09.724884] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T17:23:09.733173] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-14T17:23:09.775297] [DEBUG] [LOCAL ] ATUS: Loaded 49722 existing records from primary storage. [2025-10-14T17:23:09.775637] [INFO ] [MAIN ] ATUS: Loaded 49722 existing records. [2025-10-14T17:23:09.963013] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:23:09.963331] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-14T17:23:09.963477] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-14T17:23:09.964064] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-14T17:23:09.964240] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-14T17:23:10.303246] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T17:23:10.367372] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-14T17:23:10.399996] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:10.400723] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-14T17:23:10.501014] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T17:23:10.505107] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-14T17:23:10.658968] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T17:23:10.665990] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-14T17:23:11.314516] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T17:23:11.319156] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-14T17:23:11.703956] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T17:23:11.714068] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-14T17:23:11.985856] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T17:23:11.993685] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-14T17:23:12.058127] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T17:23:12.068378] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-14T17:23:12.147758] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T17:23:12.152808] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-14T17:23:13.191261] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T17:23:13.203230] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-14T17:23:13.218635] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T17:23:13.224166] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-14T17:23:13.322223] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T17:23:13.329740] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-14T17:23:13.715285] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T17:23:13.725598] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-14T17:23:14.028956] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T17:23:14.033289] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-14T17:23:14.266052] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T17:23:14.358187] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-14T17:23:14.397904] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T17:23:14.818337] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T17:23:15.158166] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-14T17:23:15.376413] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T17:23:15.724625] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T17:23:15.958176] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-14T17:23:16.312915] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T17:23:16.758151] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-14T17:23:16.929853] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T17:23:17.558147] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-14T17:23:17.963045] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T17:23:18.358141] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-14T17:23:19.011385] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:23:19.158095] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-14T17:23:19.958129] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-14T17:23:20.020164] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T17:23:20.152774] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T17:23:20.758134] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-14T17:23:21.201757] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T17:23:21.205907] [INFO ] [REMOTE ] ATR: Full fetch complete (43845 records). [2025-10-14T17:23:21.206055] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-14T17:23:21.571821] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-14T17:23:21.633424] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-14T17:23:21.633754] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-14T17:23:21.634420] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-14T17:23:21.634504] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-14T17:23:21.642952] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T17:23:21.646230] [INFO ] [REMOTE ] ATS: Full fetch complete (25554 records). [2025-10-14T17:23:21.646113] [DEBUG] [LOCAL ] ATR: Trimmed 43845 records to 30558 (keeping 200 days of data) [2025-10-14T17:23:21.646472] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-14T17:23:22.182915] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-14T17:23:22.183525] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-14T17:23:22.184568] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-14T17:23:22.184678] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-14T17:23:22.187765] [DEBUG] [LOCAL ] ATS: Trimmed 25554 records to 17644 (keeping 200 days of data) [2025-10-14T17:23:22.360703] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-14T17:23:22.373767] [DEBUG] [LOCAL ] ATR: Primary data saved (30558 records). [2025-10-14T17:23:22.374851] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-14T17:23:22.376172] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 32.2s. Estimated remaining: 4h 54m 4s. Rate: 7.5 symbols/min [2025-10-14T17:23:22.494427] [DEBUG] [LOCAL ] ATS: Primary data saved (17644 records). [2025-10-14T17:23:22.499817] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-14T17:23:22.499957] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATS took 31.7s. Estimated remaining: 4h 52m 17s. Rate: 7.5 symbols/min [2025-10-14T17:23:22.682480] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:22.685308] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-14T17:23:22.685682] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-14T17:23:22.696399] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-14T17:23:22.701621] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-14T17:23:22.706885] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-14T17:23:22.712116] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-14T17:23:22.802113] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:23.148918] [DEBUG] [LOCAL ] AUB: Loaded 46091 existing records from primary storage. [2025-10-14T17:23:23.149500] [INFO ] [MAIN ] AUB: Loaded 46091 existing records. [2025-10-14T17:23:23.179605] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:23.234689] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-14T17:23:23.393180] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:23:23.396348] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-14T17:23:23.396059] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T17:23:23.396543] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-14T17:23:23.406196] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-14T17:23:23.406274] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-14T17:23:23.764189] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:23.800053] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T17:23:23.958119] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-14T17:23:24.758123] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-14T17:23:25.196776] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T17:23:25.326244] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-14T17:23:25.558068] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-14T17:23:26.049474] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T17:23:26.054170] [INFO ] [REMOTE ] ATO: Full fetch complete (60480 records). [2025-10-14T17:23:26.054288] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-14T17:23:26.363225] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-14T17:23:26.449459] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-14T17:23:26.449547] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-14T17:23:26.450247] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-14T17:23:26.450309] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-14T17:23:26.451677] [DEBUG] [LOCAL ] ATO: Trimmed 60480 records to 41812 (keeping 200 days of data) [2025-10-14T17:23:26.716311] [DEBUG] [LOCAL ] ATO: Primary data saved (41812 records). [2025-10-14T17:23:26.716444] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-14T17:23:26.716515] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATO took 41.9s. Estimated remaining: 4h 51m 22s. Rate: 7.5 symbols/min [2025-10-14T17:23:26.898340] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:26.905380] [DEBUG] [LOCAL ] AUNA: Loaded 5088 existing records from primary storage. [2025-10-14T17:23:26.905551] [INFO ] [MAIN ] AUNA: Loaded 5088 existing records. [2025-10-14T17:23:27.107843] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:23:27.108376] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-14T17:23:27.108482] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-14T17:23:27.108797] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-14T17:23:27.108865] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-14T17:23:27.176935] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-14T17:23:27.256767] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T17:23:27.552222] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:27.958123] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-14T17:23:28.010702] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T17:23:28.469222] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T17:23:28.634104] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T17:23:28.758065] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-14T17:23:29.558082] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-14T17:23:30.181682] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T17:23:30.358088] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-14T17:23:31.158075] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-14T17:23:31.348185] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T17:23:31.631871] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-14T17:23:31.633224] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T17:23:31.958103] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-14T17:23:32.758089] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-14T17:23:33.334944] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T17:23:33.558074] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-14T17:23:33.677795] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T17:23:34.358077] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-14T17:23:35.158076] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-14T17:23:35.226223] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T17:23:35.574877] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T17:23:35.958103] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-14T17:23:36.354528] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T17:23:36.368842] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-14T17:23:36.758134] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-14T17:23:37.558100] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-14T17:23:38.024246] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-14T17:23:38.358087] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-14T17:23:38.905443] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-14T17:23:39.158085] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-14T17:23:39.919438] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:23:39.958028] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-14T17:23:40.758082] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-14T17:23:41.169141] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-14T17:23:41.345811] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T17:23:41.558075] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-14T17:23:41.679450] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T17:23:42.358056] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-14T17:23:43.158070] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-14T17:23:43.363016] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:23:43.963761] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-14T17:23:43.968771] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T17:23:44.758113] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-14T17:23:45.188288] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-14T17:23:45.282784] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T17:23:45.336769] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T17:23:45.558056] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-14T17:23:46.142546] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T17:23:46.358113] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-14T17:23:47.158087] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-14T17:23:47.617349] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T17:23:47.622936] [INFO ] [REMOTE ] ATUS: Full fetch complete (71269 records). [2025-10-14T17:23:47.623090] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-14T17:23:47.966838] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-14T17:23:48.033397] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-14T17:23:48.033517] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-14T17:23:48.034460] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-14T17:23:48.034548] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-14T17:23:48.036209] [DEBUG] [LOCAL ] ATUS: Trimmed 71269 records to 49800 (keeping 200 days of data) [2025-10-14T17:23:48.358618] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:23:48.385127] [DEBUG] [LOCAL ] ATUS: Primary data saved (49800 records). [2025-10-14T17:23:48.385327] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-14T17:23:48.385433] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. ATUS took 38.9s. Estimated remaining: 4h 54m 4s. Rate: 7.5 symbols/min [2025-10-14T17:23:48.560349] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:48.601534] [DEBUG] [LOCAL ] AVA: Loaded 38997 existing records from primary storage. [2025-10-14T17:23:48.602041] [INFO ] [MAIN ] AVA: Loaded 38997 existing records. [2025-10-14T17:23:48.760726] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-14T17:23:48.790061] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:23:48.790526] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-14T17:23:48.790580] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-14T17:23:48.790844] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-14T17:23:48.790903] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-14T17:23:49.155834] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:49.532335] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T17:23:49.558035] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-14T17:23:49.865994] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T17:23:50.358068] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-14T17:23:50.374008] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T17:23:50.375466] [INFO ] [REMOTE ] AUNA: Full fetch complete (7815 records). [2025-10-14T17:23:50.375559] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-14T17:23:50.815551] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-14T17:23:50.815633] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-14T17:23:50.815880] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-14T17:23:50.815925] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-14T17:23:50.816320] [DEBUG] [LOCAL ] AUNA: Trimmed 7815 records to 5113 (keeping 200 days of data) [2025-10-14T17:23:50.846566] [DEBUG] [LOCAL ] AUNA: Primary data saved (5113 records). [2025-10-14T17:23:50.846709] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-14T17:23:50.846804] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AUNA took 24.1s. Estimated remaining: 4h 52m 47s. Rate: 7.5 symbols/min [2025-10-14T17:23:51.048018] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:51.058860] [DEBUG] [LOCAL ] AVAL: Loaded 8610 existing records from primary storage. [2025-10-14T17:23:51.059059] [INFO ] [MAIN ] AVAL: Loaded 8610 existing records. [2025-10-14T17:23:51.163245] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-14T17:23:51.282321] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:23:51.282476] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-14T17:23:51.282525] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-14T17:23:51.282698] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-14T17:23:51.282757] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-14T17:23:51.714234] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:51.799293] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T17:23:51.958078] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-14T17:23:52.461354] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T17:23:52.744226] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T17:23:52.758042] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-14T17:23:53.558121] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-14T17:23:54.358052] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-14T17:23:54.735452] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-14T17:23:54.767825] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T17:23:55.158085] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-14T17:23:55.958053] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-14T17:23:55.973052] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T17:23:55.978713] [INFO ] [REMOTE ] AUB: Full fetch complete (65990 records). [2025-10-14T17:23:55.978834] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-14T17:23:56.464811] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T17:23:56.465000] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-14T17:23:56.471790] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-14T17:23:56.473739] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-14T17:23:56.473843] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-14T17:23:56.476249] [DEBUG] [LOCAL ] AUB: Trimmed 65990 records to 46046 (keeping 200 days of data) [2025-10-14T17:23:56.765906] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-14T17:23:56.779884] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T17:23:56.796368] [DEBUG] [LOCAL ] AUB: Primary data saved (46046 records). [2025-10-14T17:23:56.796526] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-14T17:23:56.796617] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUB took 34.3s. Estimated remaining: 4h 52m 14s. Rate: 7.5 symbols/min [2025-10-14T17:23:56.992139] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:23:57.036104] [DEBUG] [LOCAL ] AVB: Loaded 42176 existing records from primary storage. [2025-10-14T17:23:57.036470] [INFO ] [MAIN ] AVB: Loaded 42176 existing records. [2025-10-14T17:23:57.249911] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:23:57.250124] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-14T17:23:57.250174] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-14T17:23:57.250588] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-14T17:23:57.250683] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-14T17:23:57.563244] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-14T17:23:57.672746] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:23:58.358099] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-14T17:23:58.809428] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-14T17:23:59.084805] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T17:23:59.111389] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T17:23:59.158063] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-14T17:23:59.958082] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-14T17:24:00.666815] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:24:00.715595] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T17:24:00.758092] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-14T17:24:01.558129] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-14T17:24:02.253903] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T17:24:02.358100] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-14T17:24:03.158102] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-14T17:24:03.239044] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T17:24:03.577231] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-14T17:24:03.584008] [INFO ] [REMOTE ] AU: Full fetch complete (76091 records). [2025-10-14T17:24:03.584246] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-14T17:24:03.585457] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:24:03.585553] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:24:03.585598] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:24:03.585676] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-14T17:24:03.585770] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-14T17:24:03.585808] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-10-14T17:24:03.585848] [DEBUG] [LOCAL ] AU: No derivative data file found to delete. [2025-10-14T17:24:03.585918] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AU took 41.2s. Estimated remaining: 4h 51m 51s. Rate: 7.5 symbols/min [2025-10-14T17:24:03.766929] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:03.767144] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-14T17:24:03.767185] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-14T17:24:03.767300] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-14T17:24:03.767341] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-14T17:24:03.767383] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-14T17:24:03.767414] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-14T17:24:03.965108] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-14T17:24:04.129605] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:04.625773] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T17:24:04.758113] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-14T17:24:05.519863] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T17:24:05.558057] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-14T17:24:06.072983] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T17:24:06.358122] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-14T17:24:07.001305] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T17:24:07.134336] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T17:24:07.158074] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-14T17:24:07.660491] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-14T17:24:07.958086] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-14T17:24:08.758158] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-14T17:24:09.430478] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T17:24:09.506503] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T17:24:09.558030] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-14T17:24:09.757955] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:24:09.758209] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-14T17:24:09.758286] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:24:09.758334] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-14T17:24:09.758367] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:24:09.758433] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-14T17:24:09.758517] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-14T17:24:09.758563] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-14T17:24:09.758611] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-14T17:24:09.758708] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVBC took 6.2s. Estimated remaining: 4h 51m 21s. Rate: 7.5 symbols/min [2025-10-14T17:24:09.932634] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:09.955508] [DEBUG] [LOCAL ] AVD: Loaded 22083 existing records from primary storage. [2025-10-14T17:24:09.955799] [INFO ] [MAIN ] AVD: Loaded 22083 existing records. [2025-10-14T17:24:10.128862] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:24:10.129019] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-14T17:24:10.129066] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-14T17:24:10.129274] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-14T17:24:10.129337] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-14T17:24:10.368463] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-14T17:24:10.493479] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:11.158113] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-14T17:24:11.501077] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T17:24:11.958115] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-14T17:24:12.623328] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T17:24:12.758039] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-14T17:24:12.833949] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T17:24:13.558075] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-14T17:24:14.209342] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T17:24:14.233988] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T17:24:14.358111] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-14T17:24:15.158074] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-14T17:24:15.958048] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-14T17:24:16.000057] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T17:24:16.427843] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T17:24:16.758106] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-14T17:24:16.840148] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T17:24:16.841779] [INFO ] [REMOTE ] AVAL: Full fetch complete (14862 records). [2025-10-14T17:24:16.841849] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-14T17:24:17.215990] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-14T17:24:17.216134] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-14T17:24:17.216443] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-14T17:24:17.216485] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-14T17:24:17.217910] [DEBUG] [LOCAL ] AVAL: Trimmed 14862 records to 8611 (keeping 200 days of data) [2025-10-14T17:24:17.267550] [DEBUG] [LOCAL ] AVAL: Primary data saved (8611 records). [2025-10-14T17:24:17.267707] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-14T17:24:17.267793] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVAL took 26.4s. Estimated remaining: 4h 51m 7s. Rate: 7.5 symbols/min [2025-10-14T17:24:17.434863] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:17.453570] [DEBUG] [LOCAL ] AVK: Loaded 18522 existing records from primary storage. [2025-10-14T17:24:17.453869] [INFO ] [MAIN ] AVK: Loaded 18522 existing records. [2025-10-14T17:24:17.563334] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-14T17:24:17.637047] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:24:17.637320] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-14T17:24:17.637367] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-14T17:24:17.637563] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-14T17:24:17.637620] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-14T17:24:18.009635] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:18.045095] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T17:24:18.358094] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-14T17:24:18.821515] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T17:24:19.158106] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-14T17:24:19.857789] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T17:24:19.861881] [INFO ] [REMOTE ] AVA: Full fetch complete (55488 records). [2025-10-14T17:24:19.862004] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-14T17:24:19.963160] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-14T17:24:20.249064] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T17:24:20.271863] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-14T17:24:20.271963] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-14T17:24:20.272943] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-14T17:24:20.273009] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-14T17:24:20.274210] [DEBUG] [LOCAL ] AVA: Trimmed 55488 records to 38899 (keeping 200 days of data) [2025-10-14T17:24:20.505036] [DEBUG] [LOCAL ] AVA: Primary data saved (38899 records). [2025-10-14T17:24:20.505173] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-14T17:24:20.505250] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVA took 32.1s. Estimated remaining: 4h 50m 2s. Rate: 7.5 symbols/min [2025-10-14T17:24:20.682673] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:20.721107] [DEBUG] [LOCAL ] AVNS: Loaded 33586 existing records from primary storage. [2025-10-14T17:24:20.721423] [INFO ] [MAIN ] AVNS: Loaded 33586 existing records. [2025-10-14T17:24:20.764359] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-14T17:24:20.903112] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:24:20.903375] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-14T17:24:20.903436] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-14T17:24:20.903869] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-14T17:24:20.903934] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-14T17:24:21.220782] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T17:24:21.282445] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:21.558121] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-14T17:24:22.206377] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:24:22.358078] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-14T17:24:22.585509] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T17:24:23.158120] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-14T17:24:23.459264] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T17:24:23.958062] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-14T17:24:24.412356] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T17:24:24.586548] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T17:24:24.758098] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-14T17:24:25.558076] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-14T17:24:25.784096] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T17:24:26.358105] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-14T17:24:27.158121] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-14T17:24:27.245952] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T17:24:27.316507] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T17:24:27.958052] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-14T17:24:28.011556] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T17:24:28.758071] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-14T17:24:29.175404] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T17:24:29.558066] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-14T17:24:30.359064] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-14T17:24:30.362912] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T17:24:30.679980] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T17:24:31.158045] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-14T17:24:31.493508] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:24:31.958121] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-14T17:24:32.717815] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T17:24:32.758071] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-14T17:24:33.195198] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T17:24:33.558044] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-14T17:24:34.055464] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T17:24:34.060199] [INFO ] [REMOTE ] AVB: Full fetch complete (58906 records). [2025-10-14T17:24:34.060336] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-14T17:24:34.363195] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-14T17:24:34.472051] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-14T17:24:34.472131] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-14T17:24:34.472892] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-14T17:24:34.472956] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-14T17:24:34.474211] [DEBUG] [LOCAL ] AVB: Trimmed 58906 records to 42213 (keeping 200 days of data) [2025-10-14T17:24:34.714662] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T17:24:34.770689] [DEBUG] [LOCAL ] AVB: Primary data saved (42213 records). [2025-10-14T17:24:34.770840] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-14T17:24:34.770960] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVB took 38.0s. Estimated remaining: 4h 51m 9s. Rate: 7.5 symbols/min [2025-10-14T17:24:34.954434] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:34.999514] [DEBUG] [LOCAL ] AVNT: Loaded 39118 existing records from primary storage. [2025-10-14T17:24:34.999827] [INFO ] [MAIN ] AVNT: Loaded 39118 existing records. [2025-10-14T17:24:35.167301] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-14T17:24:35.204432] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:24:35.204883] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-14T17:24:35.204951] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-14T17:24:35.206022] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-14T17:24:35.206088] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-14T17:24:35.605058] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:35.778093] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T17:24:35.958068] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-14T17:24:36.284133] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T17:24:36.758110] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-14T17:24:37.234335] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T17:24:37.558082] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-14T17:24:37.749377] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T17:24:38.358066] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-14T17:24:38.823090] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T17:24:39.158046] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-14T17:24:39.629554] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T17:24:39.958056] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-14T17:24:40.012532] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T17:24:40.758080] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-14T17:24:40.836596] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T17:24:41.558098] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-14T17:24:41.763035] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T17:24:41.765531] [INFO ] [REMOTE ] AVD: Full fetch complete (33012 records). [2025-10-14T17:24:41.765717] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-14T17:24:42.143725] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-14T17:24:42.143813] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-14T17:24:42.144256] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-14T17:24:42.144295] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-14T17:24:42.145191] [DEBUG] [LOCAL ] AVD: Trimmed 33012 records to 21954 (keeping 200 days of data) [2025-10-14T17:24:42.267231] [DEBUG] [LOCAL ] AVD: Primary data saved (21954 records). [2025-10-14T17:24:42.267366] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-14T17:24:42.267456] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVD took 32.5s. Estimated remaining: 4h 50m 55s. Rate: 7.5 symbols/min [2025-10-14T17:24:42.367597] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-14T17:24:42.452389] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:42.452905] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-10-14T17:24:42.452952] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-10-14T17:24:42.453078] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-14T17:24:42.453122] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-14T17:24:42.453165] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-14T17:24:42.453198] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-14T17:24:42.892167] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T17:24:42.914095] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:43.158102] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-14T17:24:43.374183] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T17:24:43.958073] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-14T17:24:44.621758] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T17:24:44.758057] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-14T17:24:44.965312] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T17:24:45.558086] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-14T17:24:46.018742] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T17:24:46.358080] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-14T17:24:47.158075] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-14T17:24:47.754900] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T17:24:47.958207] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-14T17:24:48.163338] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T17:24:48.167624] [INFO ] [REMOTE ] AVNS: Full fetch complete (48387 records). [2025-10-14T17:24:48.167761] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-14T17:24:48.558851] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-14T17:24:48.558946] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-14T17:24:48.559559] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-14T17:24:48.559605] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-14T17:24:48.560859] [DEBUG] [LOCAL ] AVNS: Trimmed 48387 records to 33614 (keeping 200 days of data) [2025-10-14T17:24:48.756429] [DEBUG] [LOCAL ] AVNS: Primary data saved (33614 records). [2025-10-14T17:24:48.756600] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-14T17:24:48.756706] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNS took 28.3s. Estimated remaining: 4h 50m 30s. Rate: 7.5 symbols/min [2025-10-14T17:24:48.789987] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-14T17:24:48.939532] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:24:48.994413] [DEBUG] [LOCAL ] AVY: Loaded 37819 existing records from primary storage. [2025-10-14T17:24:48.994777] [INFO ] [MAIN ] AVY: Loaded 37819 existing records. [2025-10-14T17:24:49.174980] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:24:49.175230] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-14T17:24:49.175277] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-14T17:24:49.175941] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-14T17:24:49.176036] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-14T17:24:49.538009] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:24:49.558034] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-14T17:24:49.922099] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T17:24:50.308681] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (4.75 seconds). [2025-10-14T17:24:50.358032] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-14T17:24:50.580505] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T17:24:50.995814] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T17:24:51.158094] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-14T17:24:51.848453] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T17:24:51.890790] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T17:24:51.958090] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-14T17:24:52.758100] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-14T17:24:52.941723] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T17:24:53.558092] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-14T17:24:54.190905] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T17:24:54.358068] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-14T17:24:54.770835] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T17:24:55.158107] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-14T17:24:55.432138] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T17:24:55.958067] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-14T17:24:56.585579] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:24:56.758069] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-14T17:24:57.422905] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T17:24:57.558096] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-14T17:24:57.757972] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T17:24:58.358084] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-14T17:24:59.022955] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T17:24:59.158084] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-14T17:24:59.610955] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T17:24:59.958144] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-14T17:25:00.649784] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T17:25:00.758092] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-14T17:25:00.793435] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T17:25:00.797761] [INFO ] [REMOTE ] AVK: Full fetch complete (26667 records). [2025-10-14T17:25:00.797962] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-14T17:25:01.231101] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-14T17:25:01.231242] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-14T17:25:01.231860] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-14T17:25:01.231950] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-14T17:25:01.233029] [DEBUG] [LOCAL ] AVK: Trimmed 26667 records to 18602 (keeping 200 days of data) [2025-10-14T17:25:01.361842] [DEBUG] [LOCAL ] AVK: Primary data saved (18602 records). [2025-10-14T17:25:01.362026] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-14T17:25:01.362117] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVK took 44.1s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-14T17:25:01.574734] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-14T17:25:01.580813] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:01.617609] [DEBUG] [LOCAL ] AWF: Loaded 24023 existing records from primary storage. [2025-10-14T17:25:01.618191] [INFO ] [MAIN ] AWF: Loaded 24023 existing records. [2025-10-14T17:25:01.864863] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:01.865337] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-14T17:25:01.865393] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-14T17:25:01.866041] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-14T17:25:01.866108] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-14T17:25:02.291578] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:02.314236] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T17:25:02.358085] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-14T17:25:03.149852] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T17:25:03.158338] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-14T17:25:03.958091] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-14T17:25:04.116126] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T17:25:04.755073] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T17:25:04.765298] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-14T17:25:05.558076] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-14T17:25:05.815295] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T17:25:05.867464] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T17:25:06.358114] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-14T17:25:06.881057] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T17:25:07.158084] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-14T17:25:07.505584] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T17:25:07.958117] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-14T17:25:08.758121] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-14T17:25:08.793250] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T17:25:09.161883] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T17:25:09.558074] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-14T17:25:10.246810] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T17:25:10.358072] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-14T17:25:11.073489] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T17:25:11.078700] [INFO ] [REMOTE ] AVNT: Full fetch complete (56426 records). [2025-10-14T17:25:11.078853] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-14T17:25:11.163217] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-14T17:25:11.496053] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-14T17:25:11.496177] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-14T17:25:11.496943] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-14T17:25:11.497011] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-14T17:25:11.498494] [DEBUG] [LOCAL ] AVNT: Trimmed 56426 records to 39087 (keeping 200 days of data) [2025-10-14T17:25:11.768285] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T17:25:11.800722] [DEBUG] [LOCAL ] AVNT: Primary data saved (39087 records). [2025-10-14T17:25:11.800965] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-14T17:25:11.801111] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVNT took 37.0s. Estimated remaining: 4h 51m 36s. Rate: 7.5 symbols/min [2025-10-14T17:25:11.968134] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-14T17:25:11.985194] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:12.012166] [DEBUG] [LOCAL ] AWI: Loaded 25385 existing records from primary storage. [2025-10-14T17:25:12.012448] [INFO ] [MAIN ] AWI: Loaded 25385 existing records. [2025-10-14T17:25:12.193132] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:12.193364] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-14T17:25:12.193414] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-14T17:25:12.194115] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-14T17:25:12.194176] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-14T17:25:12.523560] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T17:25:12.587242] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:12.758085] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-14T17:25:13.558134] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-14T17:25:13.654710] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T17:25:13.661459] [INFO ] [REMOTE ] AVY: Full fetch complete (56219 records). [2025-10-14T17:25:13.661722] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-14T17:25:13.662706] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:25:13.662843] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:25:13.662937] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:25:13.663029] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-14T17:25:13.663112] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-14T17:25:13.663165] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-14T17:25:13.663445] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-10-14T17:25:13.663563] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 24.9s. Estimated remaining: 4h 50m 17s. Rate: 7.5 symbols/min [2025-10-14T17:25:13.894117] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T17:25:13.896817] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:13.950419] [DEBUG] [LOCAL ] AWK: Loaded 48619 existing records from primary storage. [2025-10-14T17:25:13.950802] [INFO ] [MAIN ] AWK: Loaded 48619 existing records. [2025-10-14T17:25:14.125545] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:14.125813] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-14T17:25:14.125862] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-14T17:25:14.126767] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-14T17:25:14.126825] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-14T17:25:14.364758] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-14T17:25:14.505810] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T17:25:14.513982] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:15.158082] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-14T17:25:15.415615] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T17:25:15.958106] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-14T17:25:16.152168] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T17:25:16.736500] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T17:25:16.758027] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-14T17:25:17.558147] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-14T17:25:17.861371] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T17:25:18.358090] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-14T17:25:19.158052] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-14T17:25:19.477738] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T17:25:19.584745] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T17:25:19.958072] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-14T17:25:20.511993] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T17:25:20.758065] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-14T17:25:21.558064] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-14T17:25:21.780893] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T17:25:21.838163] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T17:25:22.358071] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-14T17:25:22.616758] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T17:25:23.158119] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-14T17:25:23.649631] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T17:25:23.958119] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-14T17:25:24.758028] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-14T17:25:24.866476] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T17:25:24.967577] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T17:25:25.558124] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-14T17:25:26.276839] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:25:26.358068] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-14T17:25:26.706783] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T17:25:27.158070] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-14T17:25:27.474713] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T17:25:27.958058] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-14T17:25:28.301344] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T17:25:28.758045] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-14T17:25:29.167913] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T17:25:29.558086] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-14T17:25:30.358106] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-14T17:25:30.540605] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T17:25:30.614502] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T17:25:31.158104] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-14T17:25:31.958133] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-14T17:25:32.068304] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T17:25:32.074964] [INFO ] [REMOTE ] AVTR: Full fetch complete (77619 records). [2025-10-14T17:25:32.075141] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-14T17:25:32.437283] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T17:25:32.542202] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-14T17:25:32.542293] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-14T17:25:32.543124] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-14T17:25:32.543185] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-14T17:25:32.544788] [DEBUG] [LOCAL ] AVTR: Trimmed 77619 records to 53571 (keeping 200 days of data) [2025-10-14T17:25:32.758222] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-14T17:25:32.871907] [DEBUG] [LOCAL ] AVTR: Primary data saved (53571 records). [2025-10-14T17:25:32.872046] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-14T17:25:32.872119] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AVTR took 50.6s. Estimated remaining: 4h 52m 17s. Rate: 7.5 symbols/min [2025-10-14T17:25:33.052849] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:33.072368] [DEBUG] [LOCAL ] AWP: Loaded 21557 existing records from primary storage. [2025-10-14T17:25:33.072602] [INFO ] [MAIN ] AWP: Loaded 21557 existing records. [2025-10-14T17:25:33.260894] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:33.261252] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-14T17:25:33.261323] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-14T17:25:33.262055] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-14T17:25:33.262130] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-14T17:25:33.560740] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-14T17:25:33.733463] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:33.765332] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T17:25:33.876578] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T17:25:34.358068] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-14T17:25:34.606139] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T17:25:34.609457] [INFO ] [REMOTE ] AWI: Full fetch complete (35902 records). [2025-10-14T17:25:34.609583] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-14T17:25:34.996927] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-14T17:25:34.997006] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-14T17:25:34.997437] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-14T17:25:34.997476] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-14T17:25:34.998280] [DEBUG] [LOCAL ] AWI: Trimmed 35902 records to 25384 (keeping 200 days of data) [2025-10-14T17:25:35.158494] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-14T17:25:35.162734] [DEBUG] [LOCAL ] AWI: Primary data saved (25384 records). [2025-10-14T17:25:35.162893] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-14T17:25:35.162976] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWI took 23.4s. Estimated remaining: 4h 51m 4s. Rate: 7.5 symbols/min [2025-10-14T17:25:35.332524] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:35.353679] [DEBUG] [LOCAL ] AWR: Loaded 22779 existing records from primary storage. [2025-10-14T17:25:35.353993] [INFO ] [MAIN ] AWR: Loaded 22779 existing records. [2025-10-14T17:25:35.554399] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:35.555810] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-14T17:25:35.555918] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-14T17:25:35.555732] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T17:25:35.560817] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-14T17:25:35.561481] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-14T17:25:35.938487] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:35.958086] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-14T17:25:36.190315] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T17:25:36.193422] [INFO ] [REMOTE ] AWF: Full fetch complete (35671 records). [2025-10-14T17:25:36.193496] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-14T17:25:36.589084] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-14T17:25:36.589158] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-14T17:25:36.589634] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-14T17:25:36.589712] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-14T17:25:36.590520] [DEBUG] [LOCAL ] AWF: Trimmed 35671 records to 23950 (keeping 200 days of data) [2025-10-14T17:25:36.732067] [DEBUG] [LOCAL ] AWF: Primary data saved (23950 records). [2025-10-14T17:25:36.732195] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-14T17:25:36.732275] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWF took 35.4s. Estimated remaining: 4h 49m 43s. Rate: 7.5 symbols/min [2025-10-14T17:25:36.763282] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-14T17:25:36.912749] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:36.938870] [DEBUG] [LOCAL ] AX: Loaded 28013 existing records from primary storage. [2025-10-14T17:25:36.939131] [INFO ] [MAIN ] AX: Loaded 28013 existing records. [2025-10-14T17:25:37.105566] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T17:25:37.144432] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:37.144593] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-14T17:25:37.144639] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-14T17:25:37.145226] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-14T17:25:37.145283] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-14T17:25:37.512137] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:37.558074] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-14T17:25:37.996639] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T17:25:38.358096] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-14T17:25:38.524614] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T17:25:39.158067] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-14T17:25:39.660985] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T17:25:39.958045] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-14T17:25:40.253502] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T17:25:40.758083] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-14T17:25:41.558051] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-14T17:25:41.611574] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T17:25:41.966848] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T17:25:42.358112] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-14T17:25:42.584938] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T17:25:43.158053] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-14T17:25:43.465908] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T17:25:43.958063] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-14T17:25:44.192081] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T17:25:44.758073] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-14T17:25:45.468774] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T17:25:45.558063] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-14T17:25:45.957016] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T17:25:46.358044] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-14T17:25:46.510794] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T17:25:47.158112] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-14T17:25:47.936302] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T17:25:47.958031] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-14T17:25:48.284037] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:25:48.758065] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-14T17:25:49.422198] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T17:25:49.488570] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T17:25:49.558025] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-14T17:25:50.358134] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-14T17:25:50.872945] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T17:25:51.158074] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-14T17:25:51.676217] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T17:25:51.958074] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-14T17:25:52.007256] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T17:25:52.758093] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-14T17:25:53.400893] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T17:25:53.562201] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-14T17:25:53.567409] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T17:25:54.358147] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-14T17:25:54.929392] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T17:25:55.158057] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-14T17:25:55.588530] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T17:25:55.958139] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-14T17:25:56.571603] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T17:25:56.577157] [INFO ] [REMOTE ] AWK: Full fetch complete (70824 records). [2025-10-14T17:25:56.577326] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-14T17:25:56.760183] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-14T17:25:56.984880] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-14T17:25:56.984957] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-14T17:25:56.985673] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-14T17:25:56.985734] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-14T17:25:56.987052] [DEBUG] [LOCAL ] AWK: Trimmed 70824 records to 48593 (keeping 200 days of data) [2025-10-14T17:25:57.109031] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T17:25:57.319897] [DEBUG] [LOCAL ] AWK: Primary data saved (48593 records). [2025-10-14T17:25:57.320071] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-14T17:25:57.320175] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWK took 43.7s. Estimated remaining: 4h 51m 57s. Rate: 7.5 symbols/min [2025-10-14T17:25:57.501125] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:25:57.549074] [DEBUG] [LOCAL ] AXL: Loaded 50550 existing records from primary storage. [2025-10-14T17:25:57.549378] [INFO ] [MAIN ] AXL: Loaded 50550 existing records. [2025-10-14T17:25:57.563225] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-14T17:25:57.731997] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:25:57.732213] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-14T17:25:57.732260] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-14T17:25:57.732814] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-14T17:25:57.732883] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-14T17:25:58.106712] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:25:58.116891] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T17:25:58.358056] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-14T17:25:58.700239] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T17:25:59.158120] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-14T17:25:59.665337] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T17:25:59.790634] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T17:25:59.958099] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-14T17:26:00.758044] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-14T17:26:00.942819] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T17:26:00.945140] [INFO ] [REMOTE ] AWP: Full fetch complete (31905 records). [2025-10-14T17:26:00.945213] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-14T17:26:01.323279] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-14T17:26:01.323352] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-14T17:26:01.323780] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-14T17:26:01.323840] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-14T17:26:01.324536] [DEBUG] [LOCAL ] AWP: Trimmed 31905 records to 21577 (keeping 200 days of data) [2025-10-14T17:26:01.454448] [DEBUG] [LOCAL ] AWP: Primary data saved (21577 records). [2025-10-14T17:26:01.454569] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-14T17:26:01.454673] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWP took 28.6s. Estimated remaining: 4h 51m 5s. Rate: 7.5 symbols/min [2025-10-14T17:26:01.559673] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-14T17:26:01.655408] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:01.666302] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-10-14T17:26:01.667368] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T17:26:01.666875] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-10-14T17:26:01.672187] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-14T17:26:01.672512] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-14T17:26:01.672581] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-14T17:26:01.672619] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-14T17:26:02.101727] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:02.358080] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-14T17:26:02.956301] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T17:26:03.158110] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-14T17:26:03.958055] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-14T17:26:04.100485] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T17:26:04.758118] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-14T17:26:04.801152] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T17:26:05.275961] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T17:26:05.558125] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-14T17:26:05.858213] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T17:26:06.358058] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-14T17:26:07.158073] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-14T17:26:07.259702] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T17:26:07.295481] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T17:26:07.958047] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-14T17:26:08.057341] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T17:26:08.758082] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-14T17:26:09.559892] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-14T17:26:09.565388] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T17:26:10.358117] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-14T17:26:10.527941] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T17:26:10.699675] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T17:26:11.158113] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-14T17:26:11.958045] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-14T17:26:12.145526] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T17:26:12.758122] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-14T17:26:13.076858] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T17:26:13.297209] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T17:26:13.300179] [INFO ] [REMOTE ] AWR: Full fetch complete (32271 records). [2025-10-14T17:26:13.300262] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-14T17:26:13.563605] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-14T17:26:13.715179] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-14T17:26:13.715258] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-14T17:26:13.715705] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-14T17:26:13.715766] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-14T17:26:13.716541] [DEBUG] [LOCAL ] AWR: Trimmed 32271 records to 22835 (keeping 200 days of data) [2025-10-14T17:26:13.854869] [DEBUG] [LOCAL ] AWR: Primary data saved (22835 records). [2025-10-14T17:26:13.854994] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-14T17:26:13.855068] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AWR took 38.7s. Estimated remaining: 4h 51m 45s. Rate: 7.5 symbols/min [2025-10-14T17:26:14.027322] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:14.027637] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-14T17:26:14.027780] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-14T17:26:14.047094] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-14T17:26:14.047258] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-14T17:26:14.048077] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-14T17:26:14.049267] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-14T17:26:14.049165] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T17:26:14.369776] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-14T17:26:14.415070] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:15.158099] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-14T17:26:15.269441] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T17:26:15.958066] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-14T17:26:16.058534] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T17:26:16.395246] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T17:26:16.758112] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-14T17:26:17.249612] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-14T17:26:17.291094] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T17:26:17.558103] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-14T17:26:18.358072] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-14T17:26:19.158098] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-14T17:26:19.273450] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T17:26:19.958125] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-14T17:26:20.198968] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T17:26:20.202438] [INFO ] [REMOTE ] AX: Full fetch complete (42249 records). [2025-10-14T17:26:20.202520] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-14T17:26:20.431995] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T17:26:20.594226] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-14T17:26:20.594488] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-14T17:26:20.595505] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-14T17:26:20.595595] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-14T17:26:20.597338] [DEBUG] [LOCAL ] AX: Trimmed 42249 records to 28003 (keeping 200 days of data) [2025-10-14T17:26:20.771108] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-14T17:26:20.752298] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-14T17:26:20.820717] [DEBUG] [LOCAL ] AX: Primary data saved (28003 records). [2025-10-14T17:26:20.820975] [INFO ] [MAIN ] AX: Full history saved. [2025-10-14T17:26:20.821089] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AX took 44.1s. Estimated remaining: 4h 51m 25s. Rate: 7.5 symbols/min [2025-10-14T17:26:21.014783] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:21.058667] [DEBUG] [LOCAL ] AXS: Loaded 38639 existing records from primary storage. [2025-10-14T17:26:21.059059] [INFO ] [MAIN ] AXS: Loaded 38639 existing records. [2025-10-14T17:26:21.246382] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:26:21.246798] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-14T17:26:21.246857] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-14T17:26:21.247130] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-14T17:26:21.247191] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-14T17:26:21.536980] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T17:26:21.563862] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-14T17:26:21.657839] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:22.358104] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-14T17:26:23.158073] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-14T17:26:23.300575] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T17:26:23.716902] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-14T17:26:23.958060] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-14T17:26:24.121980] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T17:26:24.441018] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T17:26:24.758138] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-14T17:26:25.314807] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T17:26:25.558071] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-14T17:26:26.107135] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T17:26:26.358075] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-14T17:26:26.804446] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T17:26:27.158134] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-14T17:26:27.587838] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T17:26:27.958109] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-14T17:26:28.758108] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-14T17:26:29.462368] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T17:26:29.558056] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-14T17:26:30.230852] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T17:26:30.236694] [INFO ] [REMOTE ] AXL: Full fetch complete (72994 records). [2025-10-14T17:26:30.236864] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-14T17:26:30.363167] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-14T17:26:30.632675] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-14T17:26:30.632760] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-14T17:26:30.633483] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-14T17:26:30.633522] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-14T17:26:30.634860] [DEBUG] [LOCAL ] AXL: Trimmed 72994 records to 50552 (keeping 200 days of data) [2025-10-14T17:26:30.927848] [DEBUG] [LOCAL ] AXL: Primary data saved (50552 records). [2025-10-14T17:26:30.928134] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-14T17:26:30.928236] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXL took 33.6s. Estimated remaining: 4h 51m 40s. Rate: 7.4 symbols/min [2025-10-14T17:26:31.097370] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T17:26:31.098208] [INFO ] [REMOTE ] AXR: Full fetch complete (4440 records). [2025-10-14T17:26:31.098275] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-14T17:26:31.168119] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-14T17:26:31.283333] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T17:26:31.498835] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-14T17:26:31.498927] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-14T17:26:31.499145] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-14T17:26:31.499193] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-14T17:26:31.499666] [DEBUG] [LOCAL ] AXR: Trimmed 4440 records to 2948 (keeping 200 days of data) [2025-10-14T17:26:31.518272] [DEBUG] [LOCAL ] AXR: Primary data saved (2948 records). [2025-10-14T17:26:31.518387] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-14T17:26:31.518463] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXR took 17.7s. Estimated remaining: 4h 50m 10s. Rate: 7.5 symbols/min [2025-10-14T17:26:31.958125] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-14T17:26:32.965962] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T17:26:32.977055] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-14T17:26:33.381383] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T17:26:33.558074] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-14T17:26:34.892763] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:26:34.901192] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-14T17:26:35.083280] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-14T17:26:35.158025] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-14T17:26:36.456868] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T17:26:36.465233] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-14T17:26:36.853328] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T17:26:36.864706] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-14T17:26:37.516450] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T17:26:37.558028] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-14T17:26:38.698401] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T17:26:38.707033] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-14T17:26:38.791889] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T17:26:39.158073] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-14T17:26:40.284266] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T17:26:40.292888] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-14T17:26:40.891253] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T17:26:40.899264] [INFO ] [REMOTE ] AXP: Full fetch complete (77034 records). [2025-10-14T17:26:40.899614] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-14T17:26:41.310104] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-14T17:26:41.310222] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-14T17:26:41.311135] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-14T17:26:41.311199] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-14T17:26:41.312978] [DEBUG] [LOCAL ] AXP: Trimmed 77034 records to 53167 (keeping 200 days of data) [2025-10-14T17:26:41.651632] [DEBUG] [LOCAL ] AXP: Primary data saved (53167 records). [2025-10-14T17:26:41.651790] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-14T17:26:41.651887] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 40.2s. Estimated remaining: 4h 50m 25s. Rate: 7.5 symbols/min [2025-10-14T17:26:41.702279] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T17:26:41.710735] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-14T17:26:42.820184] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T17:26:42.829161] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-14T17:26:44.336327] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T17:26:44.341074] [INFO ] [REMOTE ] AXS: Full fetch complete (55784 records). [2025-10-14T17:26:44.341200] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-14T17:26:44.742039] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-14T17:26:44.742370] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-14T17:26:44.743153] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-14T17:26:44.743216] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-14T17:26:44.744723] [DEBUG] [LOCAL ] AXS: Trimmed 55784 records to 38625 (keeping 200 days of data) [2025-10-14T17:26:44.979383] [DEBUG] [LOCAL ] AXS: Primary data saved (38625 records). [2025-10-14T17:26:44.979513] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-14T17:26:44.979589] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXS took 24.2s. Estimated remaining: 4h 49m 26s. Rate: 7.5 symbols/min [2025-10-14T17:26:45.577079] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:45.611002] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:45.712596] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:45.732535] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:26:45.730950] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-10-14T17:26:45.733240] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-10-14T17:26:45.733367] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-14T17:26:45.733407] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-14T17:26:45.733448] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-14T17:26:45.733494] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-14T17:26:45.861800] [DEBUG] [LOCAL ] AZZ: Loaded 22566 existing records from primary storage. [2025-10-14T17:26:45.873448] [INFO ] [MAIN ] AZZ: Loaded 22566 existing records. [2025-10-14T17:26:45.873239] [DEBUG] [LOCAL ] AZO: Loaded 11208 existing records from primary storage. [2025-10-14T17:26:45.985735] [INFO ] [MAIN ] AZO: Loaded 11208 existing records. [2025-10-14T17:26:45.958635] [DEBUG] [LOCAL ] AYI: Loaded 25068 existing records from primary storage. [2025-10-14T17:26:46.124371] [INFO ] [MAIN ] AYI: Loaded 25068 existing records. [2025-10-14T17:26:46.536619] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:26:46.593994] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-14T17:26:46.596761] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-14T17:26:46.708511] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-14T17:26:46.656868] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:26:46.718762] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-14T17:26:46.718058] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:46.709487] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-14T17:26:46.728506] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-14T17:26:46.721201] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-14T17:26:46.746710] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:26:46.753290] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-14T17:26:46.764124] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-14T17:26:46.779098] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-14T17:26:46.799720] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-14T17:26:46.790034] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-14T17:26:46.799896] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-14T17:26:47.869418] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:47.866263] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:47.894057] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-14T17:26:47.894317] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-14T17:26:47.900029] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:26:47.900485] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-14T17:26:48.451680] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T17:26:48.461683] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-14T17:26:48.667417] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T17:26:48.671629] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-14T17:26:48.994150] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T17:26:48.999778] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-14T17:26:49.021627] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T17:26:49.025229] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-14T17:26:49.651618] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T17:26:49.662065] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-14T17:26:49.677582] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T17:26:49.685856] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T17:26:49.693620] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-14T17:26:49.994279] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T17:26:50.358067] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-14T17:26:50.482998] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T17:26:51.158033] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-14T17:26:51.202195] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T17:26:51.248263] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T17:26:51.958085] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-14T17:26:52.051881] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-14T17:26:52.758067] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-14T17:26:53.558075] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-14T17:26:53.693268] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T17:26:53.978966] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T17:26:54.084799] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T17:26:54.358104] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-14T17:26:55.158072] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-14T17:26:55.914524] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T17:26:55.958050] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-14T17:26:56.275415] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T17:26:56.758091] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-14T17:26:57.349186] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T17:26:57.558079] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-14T17:26:57.828560] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T17:26:58.358139] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-14T17:26:59.158103] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-14T17:26:59.335005] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T17:26:59.406327] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T17:26:59.958102] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-14T17:27:00.391556] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T17:27:00.758088] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-14T17:27:01.228617] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T17:27:01.558115] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-14T17:27:02.227049] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T17:27:02.358152] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-14T17:27:03.103066] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T17:27:03.158099] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-14T17:27:03.252548] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T17:27:03.958090] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-14T17:27:04.758177] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-14T17:27:04.904273] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T17:27:05.093263] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T17:27:05.323218] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T17:27:05.558058] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-14T17:27:06.358103] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-14T17:27:06.404252] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T17:27:07.158094] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-14T17:27:07.962097] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-14T17:27:07.985486] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T17:27:08.008686] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T17:27:08.680562] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T17:27:08.758048] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-14T17:27:09.558070] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-14T17:27:09.651068] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T17:27:10.358073] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-14T17:27:11.158117] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-14T17:27:11.376935] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T17:27:11.382763] [INFO ] [REMOTE ] AXTA: Full fetch complete (75320 records). [2025-10-14T17:27:11.382871] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-14T17:27:11.797363] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T17:27:11.806630] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-14T17:27:11.807321] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-14T17:27:11.808576] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-14T17:27:11.808674] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-14T17:27:11.810581] [DEBUG] [LOCAL ] AXTA: Trimmed 75320 records to 52240 (keeping 200 days of data) [2025-10-14T17:27:11.976777] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-14T17:27:12.121887] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T17:27:12.127233] [INFO ] [REMOTE ] AZZ: Full fetch complete (31722 records). [2025-10-14T17:27:12.128229] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-14T17:27:12.446138] [DEBUG] [LOCAL ] AXTA: Primary data saved (52240 records). [2025-10-14T17:27:12.462474] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-14T17:27:12.465531] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. AXTA took 27.5s. Estimated remaining: 4h 52m 48s. Rate: 7.4 symbols/min [2025-10-14T17:27:12.713048] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-14T17:27:12.722237] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-14T17:27:12.728093] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-14T17:27:12.746287] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-14T17:27:12.746220] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:12.746517] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-14T17:27:12.746560] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-14T17:27:12.747000] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-14T17:27:12.747221] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-14T17:27:12.747469] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-14T17:27:12.747569] [DEBUG] [LOCAL ] AZZ: Trimmed 31722 records to 22646 (keeping 200 days of data) [2025-10-14T17:27:12.747620] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-14T17:27:12.759028] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-14T17:27:13.099961] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T17:27:13.238029] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:13.268288] [DEBUG] [LOCAL ] AZZ: Primary data saved (22646 records). [2025-10-14T17:27:13.268404] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-14T17:27:13.268478] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AZZ took 28.3s. Estimated remaining: 4h 51m 22s. Rate: 7.4 symbols/min [2025-10-14T17:27:13.433258] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:13.495354] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-14T17:27:13.495682] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-14T17:27:13.563244] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-14T17:27:13.675061] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:27:13.675278] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-14T17:27:13.675326] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-14T17:27:13.675584] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-14T17:27:13.675636] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-14T17:27:14.036755] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:14.283524] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:27:14.358091] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-14T17:27:14.690903] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T17:27:15.158114] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-14T17:27:15.958081] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-14T17:27:16.289791] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T17:27:16.291399] [INFO ] [REMOTE ] AZO: Full fetch complete (15951 records). [2025-10-14T17:27:16.291467] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-14T17:27:16.659960] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-14T17:27:16.660072] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-14T17:27:16.660445] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-14T17:27:16.660520] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-14T17:27:16.661380] [DEBUG] [LOCAL ] AZO: Trimmed 15951 records to 11054 (keeping 200 days of data) [2025-10-14T17:27:16.739957] [DEBUG] [LOCAL ] AZO: Primary data saved (11054 records). [2025-10-14T17:27:16.740052] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-14T17:27:16.740127] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 31.8s. Estimated remaining: 4h 50m 25s. Rate: 7.5 symbols/min [2025-10-14T17:27:16.773123] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-14T17:27:16.920150] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:16.947864] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T17:27:16.986186] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-14T17:27:17.047035] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-14T17:27:17.047371] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-14T17:27:17.226270] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:27:17.226500] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-14T17:27:17.226548] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-14T17:27:17.227780] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-14T17:27:17.227839] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-14T17:27:17.565555] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-14T17:27:17.595871] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:17.925143] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T17:27:18.358067] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-14T17:27:18.531270] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:27:18.531604] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-14T17:27:18.531710] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:27:18.531808] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-14T17:27:18.531876] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:27:18.531943] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-14T17:27:18.532009] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-14T17:27:18.532045] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-14T17:27:18.532084] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-14T17:27:18.532128] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. B took 6.1s. Estimated remaining: 4h 49m 10s. Rate: 7.5 symbols/min [2025-10-14T17:27:18.720604] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:18.781559] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-14T17:27:18.781889] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-14T17:27:18.961256] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:27:18.961523] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-14T17:27:18.961579] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-14T17:27:18.962077] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-14T17:27:18.962143] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-14T17:27:19.169085] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-14T17:27:19.324414] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:19.638240] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-14T17:27:19.958085] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-14T17:27:20.373545] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:27:20.758122] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-14T17:27:21.558103] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-14T17:27:21.975924] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-14T17:27:22.274875] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-14T17:27:22.358068] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-14T17:27:23.158110] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-14T17:27:23.550696] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T17:27:23.554063] [INFO ] [REMOTE ] AYI: Full fetch complete (37040 records). [2025-10-14T17:27:23.554147] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-14T17:27:23.959327] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-14T17:27:23.973823] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-14T17:27:23.974982] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-14T17:27:23.975748] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-14T17:27:23.975892] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-14T17:27:23.977671] [DEBUG] [LOCAL ] AYI: Trimmed 37040 records to 25008 (keeping 200 days of data) [2025-10-14T17:27:24.110119] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-14T17:27:24.185130] [DEBUG] [LOCAL ] AYI: Primary data saved (25008 records). [2025-10-14T17:27:24.185277] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-14T17:27:24.185361] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. AYI took 39.2s. Estimated remaining: 4h 48m 37s. Rate: 7.5 symbols/min [2025-10-14T17:27:24.376680] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:24.376884] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-14T17:27:24.376923] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-14T17:27:24.377034] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-14T17:27:24.377076] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-14T17:27:24.377118] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-14T17:27:24.377152] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-14T17:27:24.732862] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:24.758116] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-14T17:27:25.482131] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-14T17:27:25.558035] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-14T17:27:26.007416] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-14T17:27:26.358125] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-14T17:27:27.158158] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-14T17:27:27.255579] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-14T17:27:27.334872] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T17:27:27.958048] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-14T17:27:28.285204] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T17:27:28.758115] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-14T17:27:29.232941] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T17:27:29.558071] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-14T17:27:30.032634] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T17:27:30.358061] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-14T17:27:30.789517] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-14T17:27:31.158076] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-14T17:27:31.958179] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-14T17:27:31.990093] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-14T17:27:32.424538] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T17:27:32.758102] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-14T17:27:33.492836] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T17:27:33.538913] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-14T17:27:33.558027] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-14T17:27:34.358116] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-14T17:27:34.942832] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-14T17:27:35.158090] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-14T17:27:35.646768] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T17:27:35.958105] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-14T17:27:36.363781] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-14T17:27:36.758112] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-14T17:27:37.275148] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-14T17:27:37.558116] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-14T17:27:37.796785] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T17:27:38.358066] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-14T17:27:38.858546] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-14T17:27:39.158122] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-14T17:27:39.771603] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-14T17:27:39.958075] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-14T17:27:40.758100] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-14T17:27:40.862566] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T17:27:40.979582] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-14T17:27:41.558067] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-14T17:27:42.358203] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-14T17:27:42.425811] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-14T17:27:42.909854] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-14T17:27:43.158096] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-14T17:27:43.915292] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:27:43.958056] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-14T17:27:44.282771] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-14T17:27:44.758112] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-14T17:27:45.046253] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T17:27:45.289446] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T17:27:45.558085] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-14T17:27:46.358119] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-14T17:27:46.816618] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T17:27:47.158068] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-14T17:27:47.958087] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-14T17:27:48.029684] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-14T17:27:48.758096] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-14T17:27:48.892614] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T17:27:48.934063] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-14T17:27:49.320103] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T17:27:49.325955] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-14T17:27:49.326069] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-14T17:27:49.563831] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-14T17:27:49.728878] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-14T17:27:49.729047] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-14T17:27:49.729895] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-14T17:27:49.729974] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-14T17:27:49.731583] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-14T17:27:49.982591] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T17:27:50.122270] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-14T17:27:50.122470] [INFO ] [MAIN ] BA: Full history saved. [2025-10-14T17:27:50.122570] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BA took 36.9s. Estimated remaining: 4h 51m 38s. Rate: 7.4 symbols/min [2025-10-14T17:27:50.304849] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:50.345537] [DEBUG] [LOCAL ] BAK: Loaded 39338 existing records from primary storage. [2025-10-14T17:27:50.345954] [INFO ] [MAIN ] BAK: Loaded 39338 existing records. [2025-10-14T17:27:50.363434] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-14T17:27:50.557997] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:27:50.558336] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-14T17:27:50.558391] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-14T17:27:50.560162] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-14T17:27:50.560240] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-14T17:27:50.937485] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:51.158027] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-14T17:27:51.321174] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T17:27:51.958076] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-14T17:27:52.758116] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-14T17:27:52.858715] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-14T17:27:53.189685] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-14T17:27:53.198403] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-14T17:27:53.198624] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-14T17:27:53.575493] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-14T17:27:53.616749] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-14T17:27:53.616890] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-14T17:27:53.617736] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-14T17:27:53.617897] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-14T17:27:53.635561] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-14T17:27:53.649216] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T17:27:53.988311] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-14T17:27:53.988439] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-14T17:27:53.988517] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 35.5s. Estimated remaining: 4h 50m 45s. Rate: 7.4 symbols/min [2025-10-14T17:27:54.156923] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:54.207305] [DEBUG] [LOCAL ] BALL: Loaded 51851 existing records from primary storage. [2025-10-14T17:27:54.207629] [INFO ] [MAIN ] BALL: Loaded 51851 existing records. [2025-10-14T17:27:54.366697] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-14T17:27:54.388445] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:27:54.388764] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-14T17:27:54.388904] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-14T17:27:54.389633] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-14T17:27:54.389719] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-14T17:27:54.595363] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T17:27:54.806162] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:55.158120] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-14T17:27:55.958152] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-14T17:27:56.179960] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T17:27:56.187309] [INFO ] [REMOTE ] BAH: Full fetch complete (75144 records). [2025-10-14T17:27:56.204136] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-14T17:27:56.271047] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-14T17:27:56.761115] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-14T17:27:56.814304] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-14T17:27:56.814537] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-14T17:27:56.815358] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-14T17:27:56.822944] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-14T17:27:56.839749] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T17:27:56.838338] [DEBUG] [LOCAL ] BAH: Trimmed 75144 records to 51734 (keeping 200 days of data) [2025-10-14T17:27:57.190225] [DEBUG] [LOCAL ] BAH: Primary data saved (51734 records). [2025-10-14T17:27:57.190381] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-14T17:27:57.190452] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAH took 33.0s. Estimated remaining: 4h 49m 47s. Rate: 7.5 symbols/min [2025-10-14T17:27:57.365476] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:27:57.365715] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-14T17:27:57.365768] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-14T17:27:57.365876] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-14T17:27:57.365917] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-14T17:27:57.365973] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-14T17:27:57.366006] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-14T17:27:57.573841] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-14T17:27:57.728569] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:27:57.856948] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T17:27:58.358186] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-14T17:27:58.629001] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T17:27:59.158047] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-14T17:27:59.251493] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T17:27:59.297693] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-14T17:27:59.304407] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-14T17:27:59.304631] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-14T17:27:59.738306] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-14T17:27:59.738430] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-14T17:27:59.739430] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-14T17:27:59.739499] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-14T17:27:59.741622] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-14T17:27:59.975732] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-14T17:28:00.117708] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-14T17:28:00.117961] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-14T17:28:00.119138] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BABA took 43.4s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-14T17:28:00.303681] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:28:00.303917] [DEBUG] [LOCAL ] BAM: No existing data file found in primary storage. [2025-10-14T17:28:00.303969] [WARN ] [MAIN ] BAM: No existing data found, performing full refresh instead. [2025-10-14T17:28:00.304095] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-14T17:28:00.304184] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-14T17:28:00.304261] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-14T17:28:00.304323] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-14T17:28:00.703837] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:28:00.758090] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-14T17:28:01.341171] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-14T17:28:01.558073] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-14T17:28:01.635908] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T17:28:02.140191] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T17:28:02.358149] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-14T17:28:03.100238] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T17:28:03.158114] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-14T17:28:03.875616] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T17:28:03.958093] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-14T17:28:04.758094] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-14T17:28:04.880667] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T17:28:05.143774] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T17:28:05.558065] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-14T17:28:06.344363] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T17:28:06.358083] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-14T17:28:06.458096] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T17:28:07.158153] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-14T17:28:07.924089] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T17:28:07.958087] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-14T17:28:08.758080] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-14T17:28:08.986706] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T17:28:09.442221] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T17:28:09.558027] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-14T17:28:09.727698] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T17:28:09.999999] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T17:28:10.358123] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-14T17:28:11.158063] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-14T17:28:11.821442] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T17:28:11.958067] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-14T17:28:12.758115] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-14T17:28:12.999408] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T17:28:13.163724] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-14T17:28:13.459390] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T17:28:13.558056] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-14T17:28:14.358076] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-14T17:28:15.004532] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T17:28:15.158046] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-14T17:28:15.958096] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-14T17:28:15.995188] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T17:28:16.758034] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-14T17:28:16.825435] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T17:28:16.848510] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T17:28:17.558070] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-14T17:28:18.127110] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T17:28:18.320401] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T17:28:18.358040] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-14T17:28:19.158082] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-14T17:28:19.958043] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-14T17:28:20.137180] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T17:28:20.202132] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T17:28:20.758192] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-14T17:28:21.469267] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T17:28:21.559676] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-14T17:28:21.560498] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T17:28:22.358077] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-14T17:28:23.134127] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T17:28:23.158052] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-14T17:28:23.958062] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-14T17:28:24.039102] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T17:28:24.662267] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T17:28:24.758042] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-14T17:28:25.558047] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-14T17:28:25.638754] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T17:28:26.086356] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T17:28:26.086872] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-14T17:28:26.358090] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-14T17:28:27.158089] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-14T17:28:27.882828] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T17:28:27.887597] [INFO ] [REMOTE ] BAK: Full fetch complete (57091 records). [2025-10-14T17:28:27.887746] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-14T17:28:27.963178] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-14T17:28:28.269885] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-14T17:28:28.269969] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-14T17:28:28.270590] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-14T17:28:28.270632] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-14T17:28:28.271868] [DEBUG] [LOCAL ] BAK: Trimmed 57091 records to 39300 (keeping 200 days of data) [2025-10-14T17:28:28.485993] [DEBUG] [LOCAL ] BAK: Primary data saved (39300 records). [2025-10-14T17:28:28.486137] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-14T17:28:28.486231] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BAK took 38.4s. Estimated remaining: 4h 52m 7s. Rate: 7.4 symbols/min [2025-10-14T17:28:28.661141] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:28:28.676851] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T17:28:28.683085] [INFO ] [REMOTE ] BAM: Full fetch complete (74815 records). [2025-10-14T17:28:28.683211] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-14T17:28:28.758290] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-14T17:28:29.068122] [DEBUG] [LOCAL ] BANC: Loaded 51326 existing records from primary storage. [2025-10-14T17:28:29.069282] [INFO ] [MAIN ] BANC: Loaded 51326 existing records. [2025-10-14T17:28:29.205779] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-14T17:28:29.208106] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-14T17:28:29.208873] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-14T17:28:29.209196] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-14T17:28:29.293233] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:28:29.288265] [DEBUG] [LOCAL ] BAM: Trimmed 74815 records to 52087 (keeping 200 days of data) [2025-10-14T17:28:29.293586] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-14T17:28:29.294045] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-14T17:28:29.294360] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-14T17:28:29.294463] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-14T17:28:29.667823] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T17:28:29.698956] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-14T17:28:29.794773] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:28:29.819147] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-14T17:28:29.828969] [INFO ] [REMOTE ] BALL: Full fetch complete (75550 records). [2025-10-14T17:28:29.829153] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-14T17:28:30.364930] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-14T17:28:30.365417] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-14T17:28:30.366002] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-14T17:28:30.367982] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-14T17:28:30.368565] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-14T17:28:30.374281] [DEBUG] [LOCAL ] BALL: Trimmed 75550 records to 51865 (keeping 200 days of data) [2025-10-14T17:28:30.546073] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T17:28:30.550450] [INFO ] [REMOTE ] BALY: Full fetch complete (16541 records). [2025-10-14T17:28:30.551331] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-14T17:28:30.871967] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T17:28:30.882427] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:28:30.883008] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:28:30.885549] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-14T17:28:30.886602] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-14T17:28:30.887718] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-14T17:28:30.888939] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-14T17:28:30.889518] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BALY took 33.7s. Estimated remaining: 4h 51m 0s. Rate: 7.4 symbols/min [2025-10-14T17:28:31.006769] [DEBUG] [LOCAL ] BAM: Primary data saved (52087 records). [2025-10-14T17:28:31.068074] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-14T17:28:31.094229] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BAM took 31.0s. Estimated remaining: 4h 49m 32s. Rate: 7.4 symbols/min [2025-10-14T17:28:31.160931] [DEBUG] [LOCAL ] BALL: Primary data saved (51865 records). [2025-10-14T17:28:31.180482] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-14T17:28:31.209328] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:28:31.207120] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BALL took 37.2s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-14T17:28:31.475872] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:28:31.547082] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:28:31.548755] [DEBUG] [LOCAL ] BAP: Loaded 25796 existing records from primary storage. [2025-10-14T17:28:31.549555] [INFO ] [MAIN ] BAP: Loaded 25796 existing records. [2025-10-14T17:28:31.743875] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:28:31.754334] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-14T17:28:31.754405] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-14T17:28:31.754711] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-14T17:28:31.754792] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-14T17:28:31.814699] [DEBUG] [LOCAL ] BARK: Loaded 38175 existing records from primary storage. [2025-10-14T17:28:31.840108] [INFO ] [MAIN ] BARK: Loaded 38175 existing records. [2025-10-14T17:28:32.023296] [DEBUG] [LOCAL ] BAX: Loaded 53520 existing records from primary storage. [2025-10-14T17:28:32.064745] [INFO ] [MAIN ] BAX: Loaded 53520 existing records. [2025-10-14T17:28:32.260459] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:28:32.330221] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-14T17:28:32.376957] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-14T17:28:32.391917] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-14T17:28:32.392129] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-14T17:28:32.572483] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:28:32.619036] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-14T17:28:32.671567] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:28:32.672637] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-14T17:28:32.693780] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-14T17:28:32.725415] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-14T17:28:32.781705] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-14T17:28:32.909920] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-14T17:28:32.997256] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-14T17:28:33.119579] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:28:33.137488] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-14T17:28:33.387071] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:28:33.558057] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-14T17:28:34.173831] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T17:28:34.343736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T17:28:34.358025] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-14T17:28:34.412390] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T17:28:35.158065] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-14T17:28:35.443621] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T17:28:35.845530] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T17:28:35.958069] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-14T17:28:36.497129] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T17:28:36.758062] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-14T17:28:37.405675] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T17:28:37.558082] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-14T17:28:38.358051] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-14T17:28:38.479022] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T17:28:39.000208] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:28:39.158062] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-14T17:28:39.944134] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T17:28:39.964203] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-14T17:28:39.973993] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T17:28:40.758116] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-14T17:28:41.558148] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-14T17:28:41.728096] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T17:28:41.838879] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T17:28:42.358093] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-14T17:28:43.158176] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-14T17:28:43.160026] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T17:28:43.727473] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T17:28:43.958105] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-14T17:28:44.234686] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T17:28:44.758079] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-14T17:28:45.558084] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-14T17:28:45.587326] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T17:28:46.358087] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-14T17:28:46.732154] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T17:28:47.158106] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-14T17:28:47.363283] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T17:28:47.910274] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T17:28:47.958035] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-14T17:28:48.758139] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-14T17:28:49.026482] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T17:28:49.355242] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T17:28:49.558101] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-14T17:28:50.323576] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T17:28:50.358029] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-14T17:28:51.115923] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:28:51.158020] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-14T17:28:51.958132] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-14T17:28:52.091286] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T17:28:52.492778] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T17:28:52.758092] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-14T17:28:53.273738] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T17:28:53.558084] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-14T17:28:54.249891] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T17:28:54.358158] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-14T17:28:54.506357] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-14T17:28:55.158180] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-14T17:28:55.730710] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T17:28:55.735213] [INFO ] [REMOTE ] BARK: Full fetch complete (56165 records). [2025-10-14T17:28:55.735456] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-14T17:28:55.963338] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-14T17:28:56.153176] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-14T17:28:56.153285] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-14T17:28:56.154296] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-14T17:28:56.154364] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-14T17:28:56.155977] [DEBUG] [LOCAL ] BARK: Trimmed 56165 records to 38229 (keeping 200 days of data) [2025-10-14T17:28:56.391597] [DEBUG] [LOCAL ] BARK: Primary data saved (38229 records). [2025-10-14T17:28:56.391841] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-14T17:28:56.391983] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BARK took 25.3s. Estimated remaining: 4h 50m 49s. Rate: 7.4 symbols/min [2025-10-14T17:28:56.565755] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:28:56.618842] [DEBUG] [LOCAL ] BB: Loaded 52937 existing records from primary storage. [2025-10-14T17:28:56.619224] [INFO ] [MAIN ] BB: Loaded 52937 existing records. [2025-10-14T17:28:56.763712] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-14T17:28:56.800767] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:28:56.801023] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-14T17:28:56.801115] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-14T17:28:56.801959] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-14T17:28:56.802041] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-14T17:28:56.953230] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:28:57.227946] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:28:57.558115] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-14T17:28:57.664117] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T17:28:57.787476] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T17:28:58.358073] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-14T17:28:59.158051] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-14T17:28:59.326236] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T17:28:59.391981] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T17:28:59.958159] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-14T17:29:00.758103] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-14T17:29:01.374833] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-14T17:29:01.474349] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:29:01.558096] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-14T17:29:02.120714] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T17:29:02.126492] [INFO ] [REMOTE ] BANC: Full fetch complete (74521 records). [2025-10-14T17:29:02.126597] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-14T17:29:02.369467] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-14T17:29:02.519754] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-14T17:29:02.519834] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-14T17:29:02.520600] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-14T17:29:02.520663] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-14T17:29:02.522104] [DEBUG] [LOCAL ] BANC: Trimmed 74521 records to 51342 (keeping 200 days of data) [2025-10-14T17:29:02.836169] [DEBUG] [LOCAL ] BANC: Primary data saved (51342 records). [2025-10-14T17:29:02.836349] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-14T17:29:02.836481] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BANC took 34.4s. Estimated remaining: 4h 50m 24s. Rate: 7.4 symbols/min [2025-10-14T17:29:03.008536] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:03.056179] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-14T17:29:03.056480] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-14T17:29:03.158123] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-14T17:29:03.240143] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:03.240693] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-14T17:29:03.240751] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-14T17:29:03.241813] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-14T17:29:03.241872] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-14T17:29:03.481393] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-14T17:29:03.536527] [INFO ] [REMOTE ] BAX: Full fetch complete (77607 records). [2025-10-14T17:29:03.551246] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-14T17:29:03.729867] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:03.859930] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T17:29:03.964575] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-14T17:29:04.061391] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-14T17:29:04.061470] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-14T17:29:04.062284] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-14T17:29:04.062350] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-14T17:29:04.063913] [DEBUG] [LOCAL ] BAX: Trimmed 77607 records to 53525 (keeping 200 days of data) [2025-10-14T17:29:04.372566] [DEBUG] [LOCAL ] BAX: Primary data saved (53525 records). [2025-10-14T17:29:04.372720] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-14T17:29:04.372804] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 33.1s. Estimated remaining: 4h 49m 10s. Rate: 7.4 symbols/min [2025-10-14T17:29:04.538270] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:04.576357] [DEBUG] [LOCAL ] BBAR: Loaded 42127 existing records from primary storage. [2025-10-14T17:29:04.576626] [INFO ] [MAIN ] BBAR: Loaded 42127 existing records. [2025-10-14T17:29:04.751216] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:04.751378] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-14T17:29:04.751423] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-14T17:29:04.751866] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-14T17:29:04.751928] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-14T17:29:04.772239] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-14T17:29:05.107570] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:05.226669] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-14T17:29:05.558060] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-14T17:29:05.807801] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T17:29:06.358066] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-14T17:29:06.428927] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-14T17:29:07.158082] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-14T17:29:07.553580] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-14T17:29:07.596483] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T17:29:07.958116] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-14T17:29:08.563128] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T17:29:08.758108] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-14T17:29:09.558096] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-14T17:29:09.926956] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T17:29:09.986129] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T17:29:10.358072] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-14T17:29:11.158075] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-14T17:29:11.958053] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-14T17:29:12.179097] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-14T17:29:12.285830] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T17:29:12.758112] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-14T17:29:12.872258] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T17:29:13.324492] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T17:29:13.327428] [INFO ] [REMOTE ] BAP: Full fetch complete (37424 records). [2025-10-14T17:29:13.327500] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-14T17:29:13.563245] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-14T17:29:13.712833] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-14T17:29:13.712911] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-14T17:29:13.713421] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-14T17:29:13.713482] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-14T17:29:13.714357] [DEBUG] [LOCAL ] BAP: Trimmed 37424 records to 25720 (keeping 200 days of data) [2025-10-14T17:29:13.867210] [DEBUG] [LOCAL ] BAP: Primary data saved (25720 records). [2025-10-14T17:29:13.867342] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-14T17:29:13.867418] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BAP took 43.0s. Estimated remaining: 4h 49m 17s. Rate: 7.4 symbols/min [2025-10-14T17:29:14.033966] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:14.081920] [DEBUG] [LOCAL ] BBD: Loaded 53253 existing records from primary storage. [2025-10-14T17:29:14.082254] [INFO ] [MAIN ] BBD: Loaded 53253 existing records. [2025-10-14T17:29:14.258383] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:14.258624] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-14T17:29:14.258705] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-14T17:29:14.259693] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-14T17:29:14.259758] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-14T17:29:14.364313] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-14T17:29:14.630466] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:15.158101] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-14T17:29:15.324911] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-14T17:29:15.423630] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T17:29:15.867007] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T17:29:15.958035] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-14T17:29:16.758080] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-14T17:29:16.800899] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T17:29:16.965321] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T17:29:17.558085] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-14T17:29:18.358112] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-14T17:29:18.691763] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T17:29:19.158122] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-14T17:29:19.310618] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T17:29:19.958105] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-14T17:29:20.771723] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-14T17:29:20.776487] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T17:29:20.890036] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-14T17:29:21.504078] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T17:29:21.558055] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-14T17:29:22.204463] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:29:22.358085] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-14T17:29:23.069639] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T17:29:23.158098] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-14T17:29:23.958083] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-14T17:29:24.587367] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T17:29:24.758056] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-14T17:29:24.940986] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-14T17:29:25.558084] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-14T17:29:25.742070] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T17:29:26.294172] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T17:29:26.358102] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-14T17:29:27.158168] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-14T17:29:27.958082] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-14T17:29:28.251171] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T17:29:28.328167] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-14T17:29:28.758044] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-14T17:29:29.210212] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-14T17:29:29.290397] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T17:29:29.558117] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-14T17:29:30.132417] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T17:29:30.358068] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-14T17:29:31.158128] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-14T17:29:31.733696] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-14T17:29:31.739879] [INFO ] [REMOTE ] BB: Full fetch complete (77018 records). [2025-10-14T17:29:31.740068] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-14T17:29:31.968678] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-14T17:29:32.146747] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-14T17:29:32.146940] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-14T17:29:32.147780] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-14T17:29:32.156971] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-14T17:29:32.174991] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T17:29:32.185034] [DEBUG] [LOCAL ] BB: Trimmed 77018 records to 52924 (keeping 200 days of data) [2025-10-14T17:29:32.510037] [DEBUG] [LOCAL ] BB: Primary data saved (52924 records). [2025-10-14T17:29:32.510248] [INFO ] [MAIN ] BB: Full history saved. [2025-10-14T17:29:32.511193] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BB took 36.1s. Estimated remaining: 4h 50m 53s. Rate: 7.4 symbols/min [2025-10-14T17:29:32.699580] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:32.738778] [DEBUG] [LOCAL ] BBDC: Loaded 33121 existing records from primary storage. [2025-10-14T17:29:32.739145] [INFO ] [MAIN ] BBDC: Loaded 33121 existing records. [2025-10-14T17:29:32.774038] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-14T17:29:32.943858] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:32.944432] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-14T17:29:32.944564] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-14T17:29:32.944850] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-14T17:29:32.944907] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-14T17:29:33.386342] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-14T17:29:33.383318] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:33.558062] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-14T17:29:34.358028] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-14T17:29:34.458908] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T17:29:34.464571] [INFO ] [REMOTE ] BBAR: Full fetch complete (61259 records). [2025-10-14T17:29:34.464737] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-14T17:29:34.818270] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-14T17:29:34.914556] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-14T17:29:34.914672] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-14T17:29:34.915517] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-14T17:29:34.915595] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-14T17:29:34.916876] [DEBUG] [LOCAL ] BBAR: Trimmed 61259 records to 42247 (keeping 200 days of data) [2025-10-14T17:29:35.037875] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T17:29:35.159143] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-14T17:29:35.195849] [DEBUG] [LOCAL ] BBAR: Primary data saved (42247 records). [2025-10-14T17:29:35.195969] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-14T17:29:35.196042] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAR took 30.8s. Estimated remaining: 4h 49m 52s. Rate: 7.4 symbols/min [2025-10-14T17:29:35.361788] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:35.369476] [DEBUG] [LOCAL ] BBDO: Loaded 5048 existing records from primary storage. [2025-10-14T17:29:35.369734] [INFO ] [MAIN ] BBDO: Loaded 5048 existing records. [2025-10-14T17:29:35.547558] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:35.548223] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-14T17:29:35.548274] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-14T17:29:35.548419] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-14T17:29:35.548475] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-14T17:29:35.918125] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:35.946281] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T17:29:35.958027] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-14T17:29:36.464924] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T17:29:36.758098] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-14T17:29:37.558056] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-14T17:29:38.358091] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-14T17:29:38.708516] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T17:29:39.158063] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-14T17:29:39.655832] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T17:29:39.958068] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-14T17:29:40.078498] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (4.12 seconds). [2025-10-14T17:29:40.314100] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-14T17:29:40.517592] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T17:29:40.758057] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-14T17:29:41.084474] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:29:41.558085] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-14T17:29:42.358080] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-14T17:29:43.158068] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-14T17:29:43.282977] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T17:29:43.413073] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-14T17:29:43.607366] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-14T17:29:43.729204] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T17:29:43.958098] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-14T17:29:44.758092] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-14T17:29:45.290384] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T17:29:45.558092] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-14T17:29:46.043468] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T17:29:46.358050] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-14T17:29:46.443295] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T17:29:46.449232] [INFO ] [REMOTE ] BBD: Full fetch complete (77273 records). [2025-10-14T17:29:46.449361] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-14T17:29:46.857450] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-14T17:29:46.857525] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-14T17:29:46.858345] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-14T17:29:46.858409] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-14T17:29:46.860018] [DEBUG] [LOCAL ] BBD: Trimmed 77273 records to 53260 (keeping 200 days of data) [2025-10-14T17:29:47.166755] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-14T17:29:47.223595] [DEBUG] [LOCAL ] BBD: Primary data saved (53260 records). [2025-10-14T17:29:47.223880] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-14T17:29:47.224000] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 33.4s. Estimated remaining: 4h 50m 22s. Rate: 7.4 symbols/min [2025-10-14T17:29:47.406779] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:47.430822] [DEBUG] [LOCAL ] BBN: Loaded 18055 existing records from primary storage. [2025-10-14T17:29:47.431183] [INFO ] [MAIN ] BBN: Loaded 18055 existing records. [2025-10-14T17:29:47.623122] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:47.623534] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-14T17:29:47.623597] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-14T17:29:47.624469] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-14T17:29:47.624560] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-14T17:29:47.972109] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-14T17:29:48.019582] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:48.579781] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T17:29:48.613523] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T17:29:48.692433] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-14T17:29:48.758131] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-14T17:29:49.558074] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-14T17:29:50.358091] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-14T17:29:50.749042] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T17:29:51.158083] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-14T17:29:51.556622] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-14T17:29:51.563098] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-14T17:29:51.563428] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-14T17:29:51.704184] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T17:29:51.966048] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-14T17:29:52.016030] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-14T17:29:52.016180] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-14T17:29:52.017102] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-14T17:29:52.017166] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-14T17:29:52.018825] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-14T17:29:52.138219] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T17:29:52.351106] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-14T17:29:52.351253] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-14T17:29:52.351414] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBAI took 49.5s. Estimated remaining: 4h 49m 45s. Rate: 7.4 symbols/min [2025-10-14T17:29:52.528177] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:52.528395] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-14T17:29:52.528464] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-14T17:29:52.528613] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-14T17:29:52.528738] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-14T17:29:52.528797] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-14T17:29:52.528832] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-14T17:29:52.765726] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-14T17:29:52.897597] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:52.904800] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T17:29:53.558046] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-14T17:29:53.689751] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T17:29:53.766354] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:29:53.766616] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-14T17:29:53.766744] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:29:53.766820] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-14T17:29:53.766892] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:29:53.766973] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-14T17:29:53.767075] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-14T17:29:53.767142] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-14T17:29:53.767201] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-14T17:29:53.767249] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBT took 1.4s. Estimated remaining: 4h 48m 32s. Rate: 7.4 symbols/min [2025-10-14T17:29:53.942062] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:29:53.949199] [DEBUG] [LOCAL ] BBU: Loaded 5248 existing records from primary storage. [2025-10-14T17:29:53.949366] [INFO ] [MAIN ] BBU: Loaded 5248 existing records. [2025-10-14T17:29:54.122268] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:29:54.122459] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-14T17:29:54.122533] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-14T17:29:54.122759] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-14T17:29:54.122816] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-14T17:29:54.363211] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-14T17:29:54.481689] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:29:55.158122] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-14T17:29:55.448795] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T17:29:55.958189] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-14T17:29:56.460557] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T17:29:56.758132] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-14T17:29:56.781692] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T17:29:57.529236] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T17:29:57.558059] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-14T17:29:58.358079] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-14T17:29:58.629837] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T17:29:58.957214] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T17:29:59.158092] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-14T17:29:59.958072] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-14T17:30:00.344342] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T17:30:00.348725] [INFO ] [REMOTE ] BBDC: Full fetch complete (48731 records). [2025-10-14T17:30:00.348820] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-14T17:30:00.621601] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T17:30:00.735733] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-14T17:30:00.735826] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-14T17:30:00.736475] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-14T17:30:00.736518] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-14T17:30:00.737721] [DEBUG] [LOCAL ] BBDC: Trimmed 48731 records to 33129 (keeping 200 days of data) [2025-10-14T17:30:00.790697] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-14T17:30:00.941181] [DEBUG] [LOCAL ] BBDC: Primary data saved (33129 records). [2025-10-14T17:30:00.941332] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-14T17:30:00.941898] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBDC took 28.4s. Estimated remaining: 4h 48m 16s. Rate: 7.4 symbols/min [2025-10-14T17:30:01.110840] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:01.111035] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-14T17:30:01.111074] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-14T17:30:01.111187] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-14T17:30:01.111234] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-14T17:30:01.111277] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-14T17:30:01.111311] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-14T17:30:01.494817] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:01.549689] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T17:30:01.558016] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-14T17:30:02.358042] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-14T17:30:02.567369] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T17:30:03.158113] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-14T17:30:03.522248] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T17:30:03.625349] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T17:30:03.958088] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-14T17:30:04.758097] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-14T17:30:04.942429] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T17:30:05.558075] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-14T17:30:05.791738] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T17:30:05.933042] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-14T17:30:06.358075] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-14T17:30:06.870362] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-14T17:30:07.158119] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-14T17:30:07.954896] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T17:30:07.959702] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-14T17:30:08.432362] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T17:30:08.758075] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-14T17:30:09.558083] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-14T17:30:09.744065] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T17:30:10.292988] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T17:30:10.358095] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-14T17:30:10.806172] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T17:30:11.158084] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-14T17:30:11.958041] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-14T17:30:11.964768] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T17:30:12.666392] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T17:30:12.758149] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-14T17:30:13.217232] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T17:30:13.558039] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-14T17:30:14.358047] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-14T17:30:14.530522] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T17:30:15.056506] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:30:15.158093] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-14T17:30:15.958081] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-14T17:30:16.016993] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T17:30:16.019217] [INFO ] [REMOTE ] BBN: Full fetch complete (25729 records). [2025-10-14T17:30:16.019346] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-14T17:30:16.402095] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-14T17:30:16.402173] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-14T17:30:16.402555] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-14T17:30:16.402595] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-14T17:30:16.403219] [DEBUG] [LOCAL ] BBN: Trimmed 25729 records to 18085 (keeping 200 days of data) [2025-10-14T17:30:16.509862] [DEBUG] [LOCAL ] BBN: Primary data saved (18085 records). [2025-10-14T17:30:16.510028] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-14T17:30:16.510118] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBN took 29.3s. Estimated remaining: 4h 49m 19s. Rate: 7.4 symbols/min [2025-10-14T17:30:16.680911] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:16.726205] [DEBUG] [LOCAL ] BBVA: Loaded 49136 existing records from primary storage. [2025-10-14T17:30:16.726503] [INFO ] [MAIN ] BBVA: Loaded 49136 existing records. [2025-10-14T17:30:16.763300] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-14T17:30:16.911036] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:30:16.911317] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-14T17:30:16.911365] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-14T17:30:16.911599] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-14T17:30:16.911665] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-14T17:30:17.176690] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-14T17:30:17.283264] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:17.299820] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-14T17:30:17.558091] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-14T17:30:18.358118] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-14T17:30:19.158073] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-14T17:30:19.299836] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T17:30:19.370527] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T17:30:19.761418] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T17:30:19.762875] [INFO ] [REMOTE ] BBDO: Full fetch complete (7530 records). [2025-10-14T17:30:19.762945] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-14T17:30:19.965284] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-14T17:30:20.142783] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-14T17:30:20.142868] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-14T17:30:20.143122] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-14T17:30:20.143163] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-14T17:30:20.143605] [DEBUG] [LOCAL ] BBDO: Trimmed 7530 records to 5044 (keeping 200 days of data) [2025-10-14T17:30:20.174337] [DEBUG] [LOCAL ] BBDO: Primary data saved (5044 records). [2025-10-14T17:30:20.174484] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-14T17:30:20.174563] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBDO took 45.0s. Estimated remaining: 4h 48m 29s. Rate: 7.4 symbols/min [2025-10-14T17:30:20.354750] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:20.383765] [DEBUG] [LOCAL ] BBW: Loaded 27362 existing records from primary storage. [2025-10-14T17:30:20.384029] [INFO ] [MAIN ] BBW: Loaded 27362 existing records. [2025-10-14T17:30:20.567801] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:30:20.568063] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-14T17:30:20.568111] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-14T17:30:20.568329] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-14T17:30:20.568385] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-14T17:30:20.763319] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-14T17:30:21.004762] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T17:30:21.012251] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:21.015372] [INFO ] [REMOTE ] BBU: Full fetch complete (7031 records). [2025-10-14T17:30:21.015490] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-14T17:30:21.016071] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:30:21.016159] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:30:21.016218] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:30:21.016304] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-14T17:30:21.016455] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-14T17:30:21.016516] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-14T17:30:21.016830] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-10-14T17:30:21.016940] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBU took 27.2s. Estimated remaining: 4h 47m 13s. Rate: 7.5 symbols/min [2025-10-14T17:30:21.186869] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:21.234821] [DEBUG] [LOCAL ] BBWI: Loaded 53583 existing records from primary storage. [2025-10-14T17:30:21.235214] [INFO ] [MAIN ] BBWI: Loaded 53583 existing records. [2025-10-14T17:30:21.411013] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:30:21.411230] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-14T17:30:21.411277] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-14T17:30:21.412377] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-14T17:30:21.412438] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-14T17:30:21.563958] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-14T17:30:21.783251] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:21.829603] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T17:30:22.358078] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-14T17:30:23.120423] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T17:30:23.158043] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-14T17:30:23.449363] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T17:30:23.958126] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-14T17:30:24.145315] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T17:30:24.758099] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-14T17:30:25.558075] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-14T17:30:25.599129] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T17:30:26.361942] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-14T17:30:26.365247] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T17:30:26.402283] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T17:30:27.158047] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-14T17:30:27.926140] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T17:30:27.958033] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-14T17:30:28.758041] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-14T17:30:28.924796] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T17:30:29.558039] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-14T17:30:29.682334] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T17:30:30.004621] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T17:30:30.058139] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-14T17:30:30.358074] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-14T17:30:31.158086] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-14T17:30:31.958068] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-14T17:30:32.266598] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-14T17:30:32.758073] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-14T17:30:32.883027] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T17:30:32.902686] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T17:30:33.558112] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-14T17:30:33.998258] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T17:30:34.358047] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-14T17:30:34.472747] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T17:30:35.158065] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-14T17:30:35.885488] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T17:30:35.958033] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-14T17:30:36.065788] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T17:30:36.758100] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-14T17:30:37.505805] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T17:30:37.508305] [INFO ] [REMOTE ] BBUC: Full fetch complete (18725 records). [2025-10-14T17:30:37.508375] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-14T17:30:37.563141] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-14T17:30:37.879206] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-14T17:30:37.879301] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-14T17:30:37.879724] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-14T17:30:37.879801] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-14T17:30:37.880503] [DEBUG] [LOCAL ] BBUC: Trimmed 18725 records to 13635 (keeping 200 days of data) [2025-10-14T17:30:37.972689] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-14T17:30:38.005425] [DEBUG] [LOCAL ] BBUC: Primary data saved (13635 records). [2025-10-14T17:30:38.005539] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-14T17:30:38.005603] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBUC took 37.1s. Estimated remaining: 4h 48m 29s. Rate: 7.4 symbols/min [2025-10-14T17:30:38.197219] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:38.244944] [DEBUG] [LOCAL ] BBY: Loaded 53453 existing records from primary storage. [2025-10-14T17:30:38.245250] [INFO ] [MAIN ] BBY: Loaded 53453 existing records. [2025-10-14T17:30:38.363297] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-14T17:30:38.426974] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:30:38.427286] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-14T17:30:38.427343] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-14T17:30:38.428364] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-14T17:30:38.428422] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-14T17:30:38.786221] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:39.153623] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T17:30:39.163333] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-14T17:30:39.958091] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-14T17:30:40.368147] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T17:30:40.606380] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T17:30:40.758051] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-14T17:30:40.828234] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T17:30:41.558129] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-14T17:30:42.358117] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-14T17:30:42.668444] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T17:30:42.723820] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T17:30:43.158072] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-14T17:30:43.958113] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-14T17:30:44.073774] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T17:30:44.376375] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T17:30:44.758137] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-14T17:30:45.558034] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-14T17:30:45.627317] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T17:30:45.799591] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T17:30:46.358072] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-14T17:30:46.815329] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-14T17:30:47.158088] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-14T17:30:47.958156] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-14T17:30:48.176620] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T17:30:48.257586] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T17:30:48.758135] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-14T17:30:49.558043] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-14T17:30:49.664545] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T17:30:50.358099] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-14T17:30:50.479188] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T17:30:51.158135] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-14T17:30:51.644337] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-14T17:30:51.865417] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:30:51.958122] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-14T17:30:52.409294] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T17:30:52.758089] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-14T17:30:53.558077] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-14T17:30:54.361147] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-14T17:30:54.368572] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-14T17:30:54.748991] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-14T17:30:54.807937] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T17:30:54.813860] [INFO ] [REMOTE ] BBW: Full fetch complete (39772 records). [2025-10-14T17:30:54.814049] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-14T17:30:55.163319] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-14T17:30:55.203096] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-14T17:30:55.203189] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-14T17:30:55.203771] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-14T17:30:55.203837] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-14T17:30:55.204975] [DEBUG] [LOCAL ] BBW: Trimmed 39772 records to 27403 (keeping 200 days of data) [2025-10-14T17:30:55.377924] [DEBUG] [LOCAL ] BBW: Primary data saved (27403 records). [2025-10-14T17:30:55.378197] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-14T17:30:55.378287] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBW took 35.2s. Estimated remaining: 4h 49m 48s. Rate: 7.4 symbols/min [2025-10-14T17:30:55.543792] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:55.585464] [DEBUG] [LOCAL ] BC: Loaded 44145 existing records from primary storage. [2025-10-14T17:30:55.585901] [INFO ] [MAIN ] BC: Loaded 44145 existing records. [2025-10-14T17:30:55.795006] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:30:55.795255] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-14T17:30:55.795356] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-14T17:30:55.795699] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-14T17:30:55.795756] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-14T17:30:55.969336] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-14T17:30:56.175989] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:56.178073] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T17:30:56.185180] [INFO ] [REMOTE ] BBVA: Full fetch complete (71727 records). [2025-10-14T17:30:56.185379] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-14T17:30:56.598455] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-14T17:30:56.598543] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-14T17:30:56.599369] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-14T17:30:56.599432] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-14T17:30:56.600794] [DEBUG] [LOCAL ] BBVA: Trimmed 71727 records to 49107 (keeping 200 days of data) [2025-10-14T17:30:56.769580] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-14T17:30:56.893552] [DEBUG] [LOCAL ] BBVA: Primary data saved (49107 records). [2025-10-14T17:30:56.893716] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-14T17:30:56.893810] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBVA took 40.4s. Estimated remaining: 4h 48m 38s. Rate: 7.4 symbols/min [2025-10-14T17:30:57.068491] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:30:57.103063] [DEBUG] [LOCAL ] BCAT: Loaded 34066 existing records from primary storage. [2025-10-14T17:30:57.103449] [INFO ] [MAIN ] BCAT: Loaded 34066 existing records. [2025-10-14T17:30:57.252219] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-14T17:30:57.333687] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:30:57.333896] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-14T17:30:57.333944] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-14T17:30:57.334229] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-14T17:30:57.334287] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-14T17:30:57.560935] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-14T17:30:57.717277] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:30:57.761252] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T17:30:58.247311] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T17:30:58.358098] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-14T17:30:59.158159] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-14T17:30:59.728495] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-14T17:30:59.743215] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:30:59.958090] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-14T17:31:00.470517] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T17:31:00.758143] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-14T17:31:01.193382] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T17:31:01.558093] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-14T17:31:02.143920] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:31:02.358132] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-14T17:31:02.777778] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T17:31:03.158110] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-14T17:31:03.796153] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T17:31:03.958085] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-14T17:31:04.393339] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T17:31:04.758144] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-14T17:31:05.558082] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-14T17:31:05.758514] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:31:06.358117] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-14T17:31:06.662894] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T17:31:06.669904] [INFO ] [REMOTE ] BBWI: Full fetch complete (77616 records). [2025-10-14T17:31:06.670156] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-14T17:31:07.100337] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-14T17:31:07.100452] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-14T17:31:07.101313] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-14T17:31:07.101400] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-14T17:31:07.133243] [DEBUG] [LOCAL ] BBWI: Trimmed 77616 records to 53584 (keeping 200 days of data) [2025-10-14T17:31:07.134482] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T17:31:07.203879] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-14T17:31:07.505592] [DEBUG] [LOCAL ] BBWI: Primary data saved (53584 records). [2025-10-14T17:31:07.505854] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-14T17:31:07.506067] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBWI took 46.5s. Estimated remaining: 4h 48m 54s. Rate: 7.4 symbols/min [2025-10-14T17:31:07.692440] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:07.692611] [DEBUG] [LOCAL ] BCC: No existing data file found in primary storage. [2025-10-14T17:31:07.692675] [WARN ] [MAIN ] BCC: No existing data found, performing full refresh instead. [2025-10-14T17:31:07.692803] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-14T17:31:07.692845] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-14T17:31:07.692913] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-14T17:31:07.692976] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-14T17:31:07.961105] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-14T17:31:08.069071] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:08.289463] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T17:31:08.549902] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T17:31:08.758057] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-14T17:31:09.541401] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T17:31:09.558049] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-14T17:31:10.358150] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-14T17:31:10.466376] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T17:31:10.471795] [INFO ] [REMOTE ] BBY: Full fetch complete (77015 records). [2025-10-14T17:31:10.471953] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-14T17:31:10.472796] [FATAL] [VALIDATOR ] BBY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:31:10.472910] [FATAL] [MAIN ] BBY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:31:10.472980] [WARN ] [MAIN ] BBY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:31:10.473074] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-14T17:31:10.473172] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-14T17:31:10.473228] [INFO ] [LOCAL ] BBY: Starting deletion of derivative data. [2025-10-14T17:31:10.473705] [DEBUG] [LOCAL ] BBY: Deleted derivative data file. [2025-10-14T17:31:10.474306] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BBY took 32.5s. Estimated remaining: 4h 47m 58s. Rate: 7.4 symbols/min [2025-10-14T17:31:10.639699] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:10.639905] [DEBUG] [LOCAL ] BCE: No existing data file found in primary storage. [2025-10-14T17:31:10.639944] [WARN ] [MAIN ] BCE: No existing data found, performing full refresh instead. [2025-10-14T17:31:10.640079] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-14T17:31:10.640145] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-14T17:31:10.640198] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-14T17:31:10.640229] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-14T17:31:11.032820] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:11.073779] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T17:31:11.158096] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-14T17:31:11.641528] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T17:31:11.958126] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-14T17:31:12.637849] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T17:31:12.758055] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-14T17:31:13.558046] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-14T17:31:13.638839] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T17:31:13.729905] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T17:31:14.358116] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-14T17:31:15.158082] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-14T17:31:15.381786] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T17:31:15.425924] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T17:31:15.958103] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-14T17:31:16.608208] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T17:31:16.758127] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-14T17:31:17.479144] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T17:31:17.558109] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-14T17:31:18.113156] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T17:31:18.305111] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T17:31:18.358050] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-14T17:31:19.158076] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-14T17:31:19.242414] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T17:31:19.958138] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-14T17:31:20.591387] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T17:31:20.758199] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-14T17:31:21.558067] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-14T17:31:21.635057] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T17:31:21.640389] [INFO ] [REMOTE ] BC: Full fetch complete (63737 records). [2025-10-14T17:31:21.640550] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-14T17:31:22.064695] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-14T17:31:22.067519] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-14T17:31:22.068427] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-14T17:31:22.068859] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-14T17:31:22.069872] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T17:31:22.077171] [DEBUG] [LOCAL ] BC: Trimmed 63737 records to 44123 (keeping 200 days of data) [2025-10-14T17:31:22.347579] [DEBUG] [LOCAL ] BC: Primary data saved (44123 records). [2025-10-14T17:31:22.347742] [INFO ] [MAIN ] BC: Full history saved. [2025-10-14T17:31:22.347835] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BC took 27.0s. Estimated remaining: 4h 48m 25s. Rate: 7.4 symbols/min [2025-10-14T17:31:22.363297] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-14T17:31:22.531014] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:22.560521] [DEBUG] [LOCAL ] BCH: Loaded 30043 existing records from primary storage. [2025-10-14T17:31:22.560897] [INFO ] [MAIN ] BCH: Loaded 30043 existing records. [2025-10-14T17:31:22.744872] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:31:22.745112] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-14T17:31:22.745164] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-14T17:31:22.745343] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-14T17:31:22.745382] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-14T17:31:23.142347] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:23.158034] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-14T17:31:23.293162] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T17:31:23.726763] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T17:31:23.958135] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-14T17:31:24.318157] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:31:24.758107] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-14T17:31:25.530284] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T17:31:25.558028] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-14T17:31:25.856338] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T17:31:26.358085] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-14T17:31:26.705968] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T17:31:27.158037] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-14T17:31:27.297072] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T17:31:27.958061] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-14T17:31:28.758050] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-14T17:31:28.944538] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T17:31:29.262592] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:31:29.558068] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-14T17:31:29.721117] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T17:31:30.358124] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-14T17:31:30.997484] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T17:31:31.158064] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-14T17:31:31.746334] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T17:31:31.958103] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-14T17:31:32.474547] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T17:31:32.758076] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-14T17:31:33.366552] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T17:31:33.558084] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-14T17:31:33.713753] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T17:31:34.358070] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-14T17:31:35.158042] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-14T17:31:35.356502] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T17:31:35.433765] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T17:31:35.958091] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-14T17:31:36.254247] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T17:31:36.758048] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-14T17:31:37.322494] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T17:31:37.558040] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-14T17:31:37.963535] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T17:31:38.358064] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-14T17:31:39.158076] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-14T17:31:39.194911] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T17:31:39.616745] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T17:31:39.958064] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-14T17:31:40.128539] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T17:31:40.758096] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-14T17:31:41.187153] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T17:31:41.193017] [INFO ] [REMOTE ] BCE: Full fetch complete (76104 records). [2025-10-14T17:31:41.193170] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-14T17:31:41.563162] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-14T17:31:41.621576] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-14T17:31:41.621907] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-14T17:31:41.622821] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-14T17:31:41.622902] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-14T17:31:41.624360] [DEBUG] [LOCAL ] BCE: Trimmed 76104 records to 52241 (keeping 200 days of data) [2025-10-14T17:31:41.945637] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T17:31:41.969913] [DEBUG] [LOCAL ] BCE: Primary data saved (52241 records). [2025-10-14T17:31:41.970056] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-14T17:31:41.970143] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCE took 31.5s. Estimated remaining: 4h 50m 2s. Rate: 7.4 symbols/min [2025-10-14T17:31:42.136992] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:42.162342] [DEBUG] [LOCAL ] BCO: Loaded 25559 existing records from primary storage. [2025-10-14T17:31:42.162674] [INFO ] [MAIN ] BCO: Loaded 25559 existing records. [2025-10-14T17:31:42.335847] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:31:42.336082] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-14T17:31:42.336129] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-14T17:31:42.336300] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-14T17:31:42.336338] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-14T17:31:42.366711] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-14T17:31:42.715974] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:42.717069] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T17:31:42.721919] [INFO ] [REMOTE ] BCAT: Full fetch complete (49990 records). [2025-10-14T17:31:42.722054] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-14T17:31:43.096456] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-14T17:31:43.096535] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-14T17:31:43.097163] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-14T17:31:43.097225] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-14T17:31:43.098362] [DEBUG] [LOCAL ] BCAT: Trimmed 49990 records to 34173 (keeping 200 days of data) [2025-10-14T17:31:43.158836] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-14T17:31:43.314939] [DEBUG] [LOCAL ] BCAT: Primary data saved (34173 records). [2025-10-14T17:31:43.315084] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-14T17:31:43.315166] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCAT took 46.4s. Estimated remaining: 4h 48m 52s. Rate: 7.4 symbols/min [2025-10-14T17:31:43.507264] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:43.536366] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T17:31:43.614097] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-14T17:31:43.614501] [INFO ] [MAIN ] BCS: Loaded 53441 existing records. [2025-10-14T17:31:43.828627] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:31:43.828981] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-14T17:31:43.829046] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-14T17:31:43.829583] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-14T17:31:43.829698] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-14T17:31:43.966132] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-14T17:31:44.371590] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:44.512895] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T17:31:44.517349] [INFO ] [REMOTE ] BCC: Full fetch complete (41170 records). [2025-10-14T17:31:44.517507] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-14T17:31:44.763305] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-14T17:31:44.950181] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-14T17:31:44.950295] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-14T17:31:44.951079] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-14T17:31:44.951169] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-14T17:31:44.952475] [DEBUG] [LOCAL ] BCC: Trimmed 41170 records to 28478 (keeping 200 days of data) [2025-10-14T17:31:45.064312] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T17:31:45.072184] [INFO ] [REMOTE ] BCH: Full fetch complete (41593 records). [2025-10-14T17:31:45.073123] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-14T17:31:45.561079] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-14T17:31:45.592179] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-14T17:31:45.597602] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-14T17:31:45.598563] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-14T17:31:45.598939] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-14T17:31:45.607972] [DEBUG] [LOCAL ] BCH: Trimmed 41593 records to 30171 (keeping 200 days of data) [2025-10-14T17:31:45.610623] [DEBUG] [LOCAL ] BCC: Primary data saved (28478 records). [2025-10-14T17:31:45.611032] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-14T17:31:45.611140] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCC took 38.1s. Estimated remaining: 4h 47m 51s. Rate: 7.4 symbols/min [2025-10-14T17:31:45.951458] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:45.983479] [DEBUG] [LOCAL ] BCH: Primary data saved (30171 records). [2025-10-14T17:31:45.983799] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-14T17:31:45.983906] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCH took 23.6s. Estimated remaining: 4h 46m 33s. Rate: 7.4 symbols/min [2025-10-14T17:31:46.083065] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T17:31:46.197210] [DEBUG] [LOCAL ] BCSF: Loaded 28213 existing records from primary storage. [2025-10-14T17:31:46.201433] [INFO ] [MAIN ] BCSF: Loaded 28213 existing records. [2025-10-14T17:31:46.201160] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:31:46.265336] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-10-14T17:31:46.282215] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-10-14T17:31:46.293276] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-14T17:31:46.301542] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-14T17:31:46.304003] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-14T17:31:46.304341] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-14T17:31:46.368729] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-14T17:31:46.477618] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:31:46.490023] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-14T17:31:46.490398] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-14T17:31:46.516680] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-14T17:31:46.543979] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-14T17:31:47.062707] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:47.173526] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-14T17:31:47.182297] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:31:47.330349] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T17:31:47.570803] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T17:31:47.958061] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-14T17:31:48.402919] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T17:31:48.758075] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-14T17:31:48.804107] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T17:31:49.558088] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-14T17:31:49.660811] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T17:31:50.358103] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-14T17:31:50.563757] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T17:31:51.158110] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-14T17:31:51.474775] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T17:31:51.958109] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-14T17:31:52.689917] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T17:31:52.758052] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-14T17:31:53.233024] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T17:31:53.558101] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-14T17:31:54.358074] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-14T17:31:54.413919] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T17:31:54.429924] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T17:31:55.158107] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-14T17:31:55.579330] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T17:31:55.958053] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-14T17:31:56.362776] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T17:31:56.758097] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-14T17:31:57.004422] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T17:31:57.558079] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-14T17:31:58.044526] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T17:31:58.358069] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-14T17:31:59.158052] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-14T17:31:59.380698] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T17:31:59.409496] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T17:31:59.958078] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-14T17:32:00.159898] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T17:32:00.758083] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-14T17:32:01.558091] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-14T17:32:01.626516] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T17:32:01.662564] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T17:32:02.358050] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-14T17:32:02.686370] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:32:03.158063] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-14T17:32:03.873573] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:32:03.908440] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T17:32:03.958081] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-14T17:32:04.758132] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-14T17:32:05.200606] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T17:32:05.558093] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-14T17:32:06.358089] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-14T17:32:06.627371] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T17:32:06.670944] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T17:32:06.673687] [INFO ] [REMOTE ] BCO: Full fetch complete (36276 records). [2025-10-14T17:32:06.673773] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-14T17:32:07.129277] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-14T17:32:07.129460] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-14T17:32:07.130073] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-14T17:32:07.130207] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-14T17:32:07.131264] [DEBUG] [LOCAL ] BCO: Trimmed 36276 records to 25488 (keeping 200 days of data) [2025-10-14T17:32:07.189615] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-14T17:32:07.257679] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T17:32:07.331488] [DEBUG] [LOCAL ] BCO: Primary data saved (25488 records). [2025-10-14T17:32:07.331627] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-14T17:32:07.331755] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCO took 25.4s. Estimated remaining: 4h 48m 25s. Rate: 7.4 symbols/min [2025-10-14T17:32:07.958115] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-14T17:32:08.758088] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-14T17:32:09.138344] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T17:32:09.207060] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T17:32:09.526282] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T17:32:09.558068] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-14T17:32:10.358040] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-14T17:32:10.585856] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T17:32:11.158111] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-14T17:32:11.958089] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-14T17:32:12.356843] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T17:32:12.406546] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-14T17:32:12.758096] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-14T17:32:12.954028] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T17:32:13.459854] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T17:32:13.558130] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-14T17:32:14.358191] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-14T17:32:15.158077] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-14T17:32:15.358603] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-14T17:32:15.619128] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T17:32:15.958071] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-14T17:32:16.181305] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T17:32:16.185716] [INFO ] [REMOTE ] BCSF: Full fetch complete (39407 records). [2025-10-14T17:32:16.185879] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-14T17:32:16.572572] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-14T17:32:16.572704] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-14T17:32:16.573317] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-14T17:32:16.573362] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-14T17:32:16.574633] [DEBUG] [LOCAL ] BCSF: Trimmed 39407 records to 28261 (keeping 200 days of data) [2025-10-14T17:32:16.745918] [DEBUG] [LOCAL ] BCSF: Primary data saved (28261 records). [2025-10-14T17:32:16.746063] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-14T17:32:16.746143] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 31.1s. Estimated remaining: 4h 48m 28s. Rate: 7.4 symbols/min [2025-10-14T17:32:16.758061] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-14T17:32:17.795741] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T17:32:17.801720] [INFO ] [REMOTE ] BCS: Full fetch complete (77502 records). [2025-10-14T17:32:17.801867] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-14T17:32:18.041894] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T17:32:18.112058] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-14T17:32:18.293458] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-14T17:32:18.293609] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-14T17:32:18.294995] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-14T17:32:18.295091] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-14T17:32:18.297443] [DEBUG] [LOCAL ] BCS: Trimmed 77502 records to 53441 (keeping 200 days of data) [2025-10-14T17:32:18.660310] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-14T17:32:18.660510] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-14T17:32:18.660609] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCS took 35.3s. Estimated remaining: 4h 47m 25s. Rate: 7.4 symbols/min [2025-10-14T17:32:18.951084] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T17:32:18.957133] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-14T17:32:20.018250] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T17:32:20.023675] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-14T17:32:21.093079] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T17:32:21.096823] [INFO ] [REMOTE ] BCX: Full fetch complete (33847 records). [2025-10-14T17:32:21.096985] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-14T17:32:21.492386] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-14T17:32:21.492505] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-14T17:32:21.493200] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-14T17:32:21.493270] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-14T17:32:21.494560] [DEBUG] [LOCAL ] BCX: Trimmed 33847 records to 21952 (keeping 200 days of data) [2025-10-14T17:32:21.632841] [DEBUG] [LOCAL ] BCX: Primary data saved (21952 records). [2025-10-14T17:32:21.633030] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-14T17:32:21.633116] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BCX took 35.6s. Estimated remaining: 4h 46m 31s. Rate: 7.4 symbols/min [2025-10-14T17:32:22.222219] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:22.313187] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:22.332001] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:22.367621] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:22.411930] [DEBUG] [LOCAL ] BDC: Loaded 24544 existing records from primary storage. [2025-10-14T17:32:22.412307] [INFO ] [MAIN ] BDC: Loaded 24544 existing records. [2025-10-14T17:32:22.467972] [DEBUG] [LOCAL ] BDJ: Loaded 29388 existing records from primary storage. [2025-10-14T17:32:22.523032] [INFO ] [MAIN ] BDJ: Loaded 29388 existing records. [2025-10-14T17:32:22.560144] [DEBUG] [LOCAL ] BDN: Loaded 47607 existing records from primary storage. [2025-10-14T17:32:22.600824] [INFO ] [MAIN ] BDN: Loaded 47607 existing records. [2025-10-14T17:32:22.815694] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:22.871574] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-14T17:32:22.866236] [DEBUG] [LOCAL ] BDX: Loaded 52183 existing records from primary storage. [2025-10-14T17:32:22.880954] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-14T17:32:22.881115] [INFO ] [MAIN ] BDX: Loaded 52183 existing records. [2025-10-14T17:32:22.901396] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-14T17:32:23.014013] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-14T17:32:23.081115] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:23.202325] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-14T17:32:23.232929] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:23.238340] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-14T17:32:23.271840] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-14T17:32:23.307206] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-14T17:32:23.331302] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-14T17:32:23.402819] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-14T17:32:23.387799] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-14T17:32:23.445111] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-14T17:32:23.444943] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:23.513916] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-14T17:32:23.569564] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-14T17:32:23.650374] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-14T17:32:23.749842] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-14T17:32:24.034108] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:24.128870] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-14T17:32:24.714974] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:24.720457] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:24.731420] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-14T17:32:24.736772] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-14T17:32:24.802605] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:24.803099] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-14T17:32:25.555949] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T17:32:25.560581] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-14T17:32:25.858850] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T17:32:25.865157] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-14T17:32:26.522525] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T17:32:26.532249] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-14T17:32:26.642071] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T17:32:26.658563] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-14T17:32:26.673616] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T17:32:26.678878] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-14T17:32:27.138816] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T17:32:27.158023] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-14T17:32:27.547692] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T17:32:27.818286] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T17:32:27.958115] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-14T17:32:28.083512] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T17:32:28.324563] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T17:32:28.758075] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-14T17:32:29.123124] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T17:32:29.558082] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-14T17:32:30.031530] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T17:32:30.358110] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-14T17:32:30.777427] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T17:32:31.158116] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-14T17:32:31.377698] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T17:32:31.958051] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-14T17:32:32.077379] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T17:32:32.758119] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-14T17:32:33.558051] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-14T17:32:33.728456] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T17:32:34.358110] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-14T17:32:34.403225] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T17:32:34.435570] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T17:32:35.158056] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-14T17:32:35.766386] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T17:32:35.958108] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-14T17:32:36.758115] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-14T17:32:36.901929] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T17:32:37.258136] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T17:32:37.558088] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-14T17:32:38.358066] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-14T17:32:38.552942] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T17:32:38.743136] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T17:32:39.158103] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-14T17:32:39.588117] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T17:32:39.958071] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-14T17:32:40.407827] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T17:32:40.758100] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-14T17:32:41.558082] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-14T17:32:41.840387] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T17:32:42.011932] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T17:32:42.358085] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-14T17:32:42.952203] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T17:32:43.158066] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-14T17:32:43.958046] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-14T17:32:44.180110] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T17:32:44.336472] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T17:32:44.758066] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-14T17:32:45.154225] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:32:45.558069] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-14T17:32:45.953832] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T17:32:46.358081] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-14T17:32:47.131736] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T17:32:47.158030] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-14T17:32:47.958124] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-14T17:32:48.587625] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-14T17:32:48.758082] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-14T17:32:49.067938] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T17:32:49.248365] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T17:32:49.558076] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-14T17:32:50.165516] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T17:32:50.358041] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-14T17:32:50.679031] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T17:32:51.158073] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-14T17:32:51.925265] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T17:32:51.930883] [INFO ] [REMOTE ] BDN: Full fetch complete (69303 records). [2025-10-14T17:32:51.931064] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-14T17:32:51.963242] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-14T17:32:52.331832] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-14T17:32:52.331960] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-14T17:32:52.332729] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-14T17:32:52.332792] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-14T17:32:52.334065] [DEBUG] [LOCAL ] BDN: Trimmed 69303 records to 47627 (keeping 200 days of data) [2025-10-14T17:32:52.451522] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T17:32:52.458503] [INFO ] [REMOTE ] BDC: Full fetch complete (35890 records). [2025-10-14T17:32:52.463156] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-14T17:32:52.765233] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-14T17:32:52.966055] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-14T17:32:52.966408] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-14T17:32:52.967129] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-14T17:32:52.967202] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-14T17:32:52.976114] [DEBUG] [LOCAL ] BDC: Trimmed 35890 records to 24554 (keeping 200 days of data) [2025-10-14T17:32:53.115321] [DEBUG] [LOCAL ] BDN: Primary data saved (47627 records). [2025-10-14T17:32:53.116018] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-14T17:32:53.116691] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 31.5s. Estimated remaining: 4h 49m 50s. Rate: 7.3 symbols/min [2025-10-14T17:32:53.313833] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:53.398249] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-14T17:32:53.398953] [DEBUG] [LOCAL ] BDC: Primary data saved (24554 records). [2025-10-14T17:32:53.399196] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-14T17:32:53.399438] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDC took 31.8s. Estimated remaining: 4h 48m 32s. Rate: 7.4 symbols/min [2025-10-14T17:32:53.399596] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-14T17:32:53.809383] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:53.811281] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:53.811580] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-14T17:32:53.812024] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-14T17:32:53.811926] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-14T17:32:53.812676] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-14T17:32:53.827232] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-14T17:32:53.829554] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-14T17:32:53.829794] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-14T17:32:53.881885] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-14T17:32:53.876606] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T17:32:53.893615] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-14T17:32:53.925215] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-14T17:32:53.946680] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-14T17:32:54.445055] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-14T17:32:54.519002] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-14T17:32:54.680588] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:54.701091] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:55.042961] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T17:32:55.046571] [INFO ] [REMOTE ] BDJ: Full fetch complete (43017 records). [2025-10-14T17:32:55.046683] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-14T17:32:55.163176] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-14T17:32:55.417638] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-14T17:32:55.417748] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-14T17:32:55.418304] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-14T17:32:55.418365] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-14T17:32:55.419309] [DEBUG] [LOCAL ] BDJ: Trimmed 43017 records to 29403 (keeping 200 days of data) [2025-10-14T17:32:55.610168] [DEBUG] [LOCAL ] BDJ: Primary data saved (29403 records). [2025-10-14T17:32:55.610370] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-14T17:32:55.610483] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BDJ took 34.0s. Estimated remaining: 4h 47m 32s. Rate: 7.4 symbols/min [2025-10-14T17:32:55.799750] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:55.859144] [DEBUG] [LOCAL ] BEKE: Loaded 53220 existing records from primary storage. [2025-10-14T17:32:55.859666] [INFO ] [MAIN ] BEKE: Loaded 53220 existing records. [2025-10-14T17:32:55.967688] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-14T17:32:56.056932] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:56.057234] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-14T17:32:56.057288] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-14T17:32:56.057559] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-14T17:32:56.057618] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-14T17:32:56.458602] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:56.470452] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-14T17:32:56.476933] [INFO ] [REMOTE ] BDX: Full fetch complete (75587 records). [2025-10-14T17:32:56.477186] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-14T17:32:56.605687] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T17:32:56.762875] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-14T17:32:56.928794] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-14T17:32:56.928909] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-14T17:32:56.929941] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-14T17:32:56.930113] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-14T17:32:56.932294] [DEBUG] [LOCAL ] BDX: Trimmed 75587 records to 52180 (keeping 200 days of data) [2025-10-14T17:32:57.084524] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T17:32:57.207986] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-14T17:32:57.347271] [DEBUG] [LOCAL ] BDX: Primary data saved (52180 records). [2025-10-14T17:32:57.347420] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-14T17:32:57.348403] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BDX took 35.7s. Estimated remaining: 4h 46m 29s. Rate: 7.4 symbols/min [2025-10-14T17:32:57.515913] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:32:57.569163] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-14T17:32:57.572321] [DEBUG] [LOCAL ] BEN: Loaded 53109 existing records from primary storage. [2025-10-14T17:32:57.572787] [INFO ] [MAIN ] BEN: Loaded 53109 existing records. [2025-10-14T17:32:57.750278] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:32:57.750455] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-14T17:32:57.750502] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-14T17:32:57.750978] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-14T17:32:57.751037] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-14T17:32:58.095955] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:32:58.358099] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-14T17:32:59.158116] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-14T17:32:59.314060] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T17:32:59.958052] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-14T17:33:00.086614] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:33:00.631366] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T17:33:00.758040] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-14T17:33:01.448160] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T17:33:01.558095] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-14T17:33:01.866092] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-14T17:33:02.358064] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-14T17:33:02.621611] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T17:33:03.158172] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-14T17:33:03.948849] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T17:33:03.959698] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-14T17:33:04.632605] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T17:33:04.758064] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-14T17:33:05.558038] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-14T17:33:05.711703] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T17:33:05.997716] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T17:33:06.358104] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-14T17:33:06.557685] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T17:33:06.746397] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-14T17:33:07.158079] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-14T17:33:07.958066] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-14T17:33:08.758040] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-14T17:33:09.096259] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-14T17:33:09.284046] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-14T17:33:09.563689] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-14T17:33:09.569167] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T17:33:10.358101] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-14T17:33:11.158072] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-14T17:33:11.777128] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T17:33:11.820818] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T17:33:11.958100] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-14T17:33:12.758034] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-14T17:33:13.031452] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T17:33:13.328880] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T17:33:13.558064] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-14T17:33:14.358077] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-14T17:33:14.976898] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T17:33:15.158052] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-14T17:33:15.243227] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-14T17:33:15.958084] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-14T17:33:16.439201] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-14T17:33:16.758112] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-14T17:33:17.154425] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-14T17:33:17.197588] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T17:33:17.558197] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-14T17:33:18.187558] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-14T17:33:18.221709] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-14T17:33:18.358059] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-14T17:33:18.595439] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-14T17:33:19.158127] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-14T17:33:19.958129] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-14T17:33:20.536536] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T17:33:20.758123] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-14T17:33:21.558065] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-14T17:33:22.327385] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-14T17:33:22.358031] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-14T17:33:22.821029] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-14T17:33:23.158088] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-14T17:33:23.280413] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T17:33:23.958074] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-14T17:33:24.541157] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-14T17:33:24.758044] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-14T17:33:25.008810] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T17:33:25.461615] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T17:33:25.558083] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-14T17:33:25.886295] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-14T17:33:26.358063] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-14T17:33:27.158105] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-14T17:33:27.219191] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T17:33:27.220021] [INFO ] [REMOTE ] BEDU: Full fetch complete (1369 records). [2025-10-14T17:33:27.220088] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-14T17:33:27.392033] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-14T17:33:27.411542] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-14T17:33:27.419049] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:33:27.419256] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:33:27.419339] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-14T17:33:27.419411] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-14T17:33:27.419449] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-14T17:33:27.419554] [INFO ] [REMOTE ] BE: Full fetch complete (77419 records). [2025-10-14T17:33:27.419490] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-14T17:33:27.419814] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 34.0s. Estimated remaining: 4h 49m 31s. Rate: 7.3 symbols/min [2025-10-14T17:33:27.419738] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-14T17:33:27.489802] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:33:27.511583] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:33:27.519563] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:33:27.521863] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-14T17:33:27.521935] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-14T17:33:27.527580] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-10-14T17:33:27.548435] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-10-14T17:33:27.567174] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BE took 34.4s. Estimated remaining: 4h 48m 14s. Rate: 7.4 symbols/min [2025-10-14T17:33:27.667871] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:33:27.766189] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:33:27.766444] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-14T17:33:27.766500] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-14T17:33:27.766617] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-14T17:33:27.766702] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-14T17:33:27.766775] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-14T17:33:27.766820] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-14T17:33:27.968241] [DEBUG] [LOCAL ] BEP: Loaded 38934 existing records from primary storage. [2025-10-14T17:33:27.985070] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-14T17:33:27.996171] [INFO ] [MAIN ] BEP: Loaded 38934 existing records. [2025-10-14T17:33:28.339942] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:33:28.336594] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:33:28.340204] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-14T17:33:28.340281] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-14T17:33:28.340622] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-14T17:33:28.340718] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-14T17:33:28.704462] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:33:28.758024] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-14T17:33:29.219472] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T17:33:29.558085] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-14T17:33:29.783172] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T17:33:29.792911] [INFO ] [REMOTE ] BEKE: Full fetch complete (77353 records). [2025-10-14T17:33:29.793206] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-14T17:33:30.342120] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-14T17:33:30.343089] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-14T17:33:30.344120] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-14T17:33:30.344254] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-14T17:33:30.346958] [DEBUG] [LOCAL ] BEKE: Trimmed 77353 records to 53218 (keeping 200 days of data) [2025-10-14T17:33:30.403166] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-14T17:33:30.479039] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T17:33:30.733998] [DEBUG] [LOCAL ] BEKE: Primary data saved (53218 records). [2025-10-14T17:33:30.734207] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-14T17:33:30.734349] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 35.1s. Estimated remaining: 4h 47m 23s. Rate: 7.4 symbols/min [2025-10-14T17:33:30.965742] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T17:33:30.968188] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:33:30.985562] [DEBUG] [LOCAL ] BEPH: Loaded 5283 existing records from primary storage. [2025-10-14T17:33:30.985756] [INFO ] [MAIN ] BEPH: Loaded 5283 existing records. [2025-10-14T17:33:31.158089] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-14T17:33:31.161821] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:33:31.162113] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-14T17:33:31.162401] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-14T17:33:31.163397] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-14T17:33:31.163456] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-14T17:33:31.515847] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:33:31.958067] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-14T17:33:32.018212] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T17:33:32.554056] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T17:33:32.758064] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-14T17:33:33.558061] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-14T17:33:33.602356] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T17:33:33.774263] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T17:33:34.323557] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T17:33:34.358031] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-14T17:33:35.158075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-14T17:33:35.958081] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-14T17:33:36.103483] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T17:33:36.109340] [INFO ] [REMOTE ] BEN: Full fetch complete (77081 records). [2025-10-14T17:33:36.109433] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-14T17:33:36.503100] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-14T17:33:36.503292] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-14T17:33:36.504107] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-14T17:33:36.504183] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-14T17:33:36.505992] [DEBUG] [LOCAL ] BEN: Trimmed 77081 records to 53122 (keeping 200 days of data) [2025-10-14T17:33:36.622834] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T17:33:36.758252] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-14T17:33:36.865620] [DEBUG] [LOCAL ] BEN: Primary data saved (53122 records). [2025-10-14T17:33:36.865794] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-14T17:33:36.865910] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEN took 39.5s. Estimated remaining: 4h 46m 58s. Rate: 7.4 symbols/min [2025-10-14T17:33:37.035889] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:33:37.042514] [DEBUG] [LOCAL ] BEPI: Loaded 3617 existing records from primary storage. [2025-10-14T17:33:37.042745] [INFO ] [MAIN ] BEPI: Loaded 3617 existing records. [2025-10-14T17:33:37.249075] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:33:37.251095] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T17:33:37.249695] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-14T17:33:37.260346] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-14T17:33:37.261081] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-14T17:33:37.261139] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-14T17:33:37.364750] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T17:33:37.563139] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-14T17:33:37.629827] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:33:38.358106] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-14T17:33:39.128206] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T17:33:39.158038] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-14T17:33:39.770452] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T17:33:39.958088] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-14T17:33:40.429678] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-14T17:33:40.688991] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T17:33:40.758111] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-14T17:33:41.558088] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-14T17:33:42.255167] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T17:33:42.358047] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-14T17:33:42.889779] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T17:33:43.158065] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-14T17:33:43.545116] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T17:33:43.958075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-14T17:33:44.758055] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-14T17:33:44.896528] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T17:33:45.331471] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T17:33:45.362621] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T17:33:45.558054] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-14T17:33:46.358111] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-14T17:33:46.589689] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T17:33:47.158063] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-14T17:33:47.664388] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-14T17:33:47.930412] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T17:33:47.958053] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-14T17:33:48.426023] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T17:33:48.758096] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-14T17:33:49.558081] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-14T17:33:49.990049] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T17:33:50.226074] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T17:33:50.231351] [INFO ] [REMOTE ] BEP: Full fetch complete (59001 records). [2025-10-14T17:33:50.231499] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-14T17:33:50.363230] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-14T17:33:50.619161] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-14T17:33:50.619239] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-14T17:33:50.619890] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-14T17:33:50.619953] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-14T17:33:50.621102] [DEBUG] [LOCAL ] BEP: Trimmed 59001 records to 38935 (keeping 200 days of data) [2025-10-14T17:33:50.857750] [DEBUG] [LOCAL ] BEP: Primary data saved (38935 records). [2025-10-14T17:33:50.857927] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-14T17:33:50.858628] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEP took 23.4s. Estimated remaining: 4h 47m 39s. Rate: 7.4 symbols/min [2025-10-14T17:33:51.026136] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:33:51.032286] [DEBUG] [LOCAL ] BEPJ: Loaded 3122 existing records from primary storage. [2025-10-14T17:33:51.032481] [INFO ] [MAIN ] BEPJ: Loaded 3122 existing records. [2025-10-14T17:33:51.170617] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-14T17:33:51.214479] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:33:51.214752] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-14T17:33:51.214814] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-14T17:33:51.214982] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-14T17:33:51.215056] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-14T17:33:51.578144] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:33:51.887125] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T17:33:51.958099] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-14T17:33:52.070975] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T17:33:52.397930] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-14T17:33:52.758070] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-14T17:33:53.407031] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T17:33:53.558074] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-14T17:33:54.230496] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T17:33:54.358072] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-14T17:33:54.908221] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T17:33:55.158124] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-14T17:33:55.958080] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-14T17:33:56.041547] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T17:33:56.511950] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T17:33:56.758083] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-14T17:33:57.558063] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-14T17:33:58.024439] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T17:33:58.178805] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T17:33:58.358066] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-14T17:33:58.686834] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-14T17:33:59.158079] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-14T17:33:59.519059] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T17:33:59.958066] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-14T17:34:00.337427] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T17:34:00.758125] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-14T17:34:01.224196] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T17:34:01.225327] [INFO ] [REMOTE ] BEPI: Full fetch complete (4776 records). [2025-10-14T17:34:01.225419] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-14T17:34:01.568033] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-14T17:34:01.604604] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-14T17:34:01.604750] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-14T17:34:01.604985] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-14T17:34:01.605030] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-14T17:34:01.605541] [DEBUG] [LOCAL ] BEPI: Trimmed 4776 records to 3611 (keeping 200 days of data) [2025-10-14T17:34:01.631897] [DEBUG] [LOCAL ] BEPI: Primary data saved (3611 records). [2025-10-14T17:34:01.632081] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-14T17:34:01.632210] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPI took 24.8s. Estimated remaining: 4h 47m 54s. Rate: 7.4 symbols/min [2025-10-14T17:34:01.870564] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:01.911226] [DEBUG] [LOCAL ] BFAM: Loaded 33707 existing records from primary storage. [2025-10-14T17:34:01.911590] [INFO ] [MAIN ] BFAM: Loaded 33707 existing records. [2025-10-14T17:34:02.114949] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:02.115232] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-14T17:34:02.115284] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-14T17:34:02.115718] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-14T17:34:02.115784] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-14T17:34:02.368961] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-14T17:34:02.506120] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:03.017732] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T17:34:03.158044] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-14T17:34:03.255339] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T17:34:03.609619] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-14T17:34:03.958081] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-14T17:34:04.416813] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T17:34:04.758106] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-14T17:34:05.558067] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-14T17:34:06.297717] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T17:34:06.358103] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-14T17:34:06.390691] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T17:34:06.396113] [INFO ] [REMOTE ] BEPC: Full fetch complete (68866 records). [2025-10-14T17:34:06.396225] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-14T17:34:06.816456] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-14T17:34:06.816531] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-14T17:34:06.817268] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-14T17:34:06.817329] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-14T17:34:06.818684] [DEBUG] [LOCAL ] BEPC: Trimmed 68866 records to 46493 (keeping 200 days of data) [2025-10-14T17:34:07.032266] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T17:34:07.102987] [DEBUG] [LOCAL ] BEPC: Primary data saved (46493 records). [2025-10-14T17:34:07.103117] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-14T17:34:07.103184] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPC took 39.5s. Estimated remaining: 4h 47m 23s. Rate: 7.4 symbols/min [2025-10-14T17:34:07.166322] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-14T17:34:07.275632] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:07.313075] [DEBUG] [LOCAL ] BFH: Loaded 41480 existing records from primary storage. [2025-10-14T17:34:07.313352] [INFO ] [MAIN ] BFH: Loaded 41480 existing records. [2025-10-14T17:34:07.490593] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:07.490819] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-14T17:34:07.490887] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-14T17:34:07.491262] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-14T17:34:07.491341] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-14T17:34:07.861837] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:07.958086] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-14T17:34:08.758088] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-14T17:34:08.826387] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T17:34:09.205053] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T17:34:09.409977] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T17:34:09.558035] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-14T17:34:10.358101] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-14T17:34:10.847792] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T17:34:10.847973] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-14T17:34:11.158084] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-14T17:34:11.729250] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T17:34:11.958082] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-14T17:34:12.758055] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-14T17:34:13.244003] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T17:34:13.250398] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T17:34:13.558066] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-14T17:34:14.358078] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-14T17:34:14.707378] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-14T17:34:14.828056] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T17:34:15.158077] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-14T17:34:15.811450] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T17:34:15.813015] [INFO ] [REMOTE ] BEPH: Full fetch complete (7606 records). [2025-10-14T17:34:15.813104] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-14T17:34:15.968226] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-14T17:34:16.190088] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-14T17:34:16.190165] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-14T17:34:16.190346] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-14T17:34:16.190384] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-14T17:34:16.190837] [DEBUG] [LOCAL ] BEPH: Trimmed 7606 records to 5235 (keeping 200 days of data) [2025-10-14T17:34:16.225234] [DEBUG] [LOCAL ] BEPH: Primary data saved (5235 records). [2025-10-14T17:34:16.225373] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-14T17:34:16.225454] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPH took 45.5s. Estimated remaining: 4h 47m 23s. Rate: 7.4 symbols/min [2025-10-14T17:34:16.396974] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:16.411953] [DEBUG] [LOCAL ] BFK: Loaded 13519 existing records from primary storage. [2025-10-14T17:34:16.412192] [INFO ] [MAIN ] BFK: Loaded 13519 existing records. [2025-10-14T17:34:16.590626] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:16.590891] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-14T17:34:16.590938] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-14T17:34:16.591201] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-14T17:34:16.591266] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-14T17:34:16.764214] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-14T17:34:16.951752] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:17.289826] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-14T17:34:17.470518] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:34:17.558068] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-14T17:34:17.833193] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-14T17:34:18.358083] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-14T17:34:18.725853] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T17:34:18.726570] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4460 records). [2025-10-14T17:34:18.726636] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-14T17:34:19.084109] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-14T17:34:19.084192] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-14T17:34:19.084324] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-14T17:34:19.084360] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-14T17:34:19.084736] [DEBUG] [LOCAL ] BEPJ: Trimmed 4460 records to 3116 (keeping 200 days of data) [2025-10-14T17:34:19.104766] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3116 records). [2025-10-14T17:34:19.104863] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-14T17:34:19.104935] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BEPJ took 28.2s. Estimated remaining: 4h 46m 31s. Rate: 7.4 symbols/min [2025-10-14T17:34:19.163175] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-14T17:34:19.291745] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:19.344843] [DEBUG] [LOCAL ] BFLY: Loaded 51828 existing records from primary storage. [2025-10-14T17:34:19.345177] [INFO ] [MAIN ] BFLY: Loaded 51828 existing records. [2025-10-14T17:34:19.521861] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:19.522124] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-14T17:34:19.522175] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-14T17:34:19.522473] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-14T17:34:19.522515] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-14T17:34:19.888495] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:19.958031] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-14T17:34:20.221922] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T17:34:20.758096] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-14T17:34:20.865466] [DEBUG] [REMOTE ] BFLY: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-14T17:34:20.865771] [WARN ] [REMOTE ] BFLY: No data returned for month 2024-12 [2025-10-14T17:34:20.865857] [FATAL] [REMOTE ] BFLY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:34:20.865910] [FATAL] [MAIN ] BFLY: Failed to fetch primary data. [2025-10-14T17:34:20.865968] [WARN ] [MAIN ] BFLY: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:34:20.866039] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-14T17:34:20.866100] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-14T17:34:20.866135] [INFO ] [LOCAL ] BFLY: Starting deletion of derivative data. [2025-10-14T17:34:20.866374] [DEBUG] [LOCAL ] BFLY: Deleted derivative data file. [2025-10-14T17:34:20.867013] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFLY took 1.8s. Estimated remaining: 4h 45m 30s. Rate: 7.4 symbols/min [2025-10-14T17:34:21.036746] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:21.049114] [DEBUG] [LOCAL ] BFS: Loaded 9473 existing records from primary storage. [2025-10-14T17:34:21.049345] [INFO ] [MAIN ] BFS: Loaded 9473 existing records. [2025-10-14T17:34:21.233035] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:21.233317] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-14T17:34:21.233381] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-14T17:34:21.233533] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-14T17:34:21.233572] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-14T17:34:21.578716] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-14T17:34:21.628904] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:21.633919] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T17:34:22.358073] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-14T17:34:23.158061] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-14T17:34:23.224255] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T17:34:23.253444] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T17:34:23.955507] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T17:34:23.958502] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-14T17:34:24.684405] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T17:34:24.758107] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-14T17:34:25.558049] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-14T17:34:25.650341] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-14T17:34:26.358085] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-14T17:34:26.734065] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T17:34:27.147472] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T17:34:27.158026] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-14T17:34:27.943347] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T17:34:27.958024] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-14T17:34:28.665219] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T17:34:28.758058] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-14T17:34:29.329571] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T17:34:29.558081] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-14T17:34:30.325503] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T17:34:30.358091] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-14T17:34:31.158072] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-14T17:34:31.958064] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-14T17:34:31.989568] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T17:34:31.992025] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T17:34:32.758079] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-14T17:34:33.558040] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-14T17:34:33.648389] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T17:34:33.671970] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T17:34:34.358061] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-14T17:34:34.920814] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T17:34:35.009006] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T17:34:35.158048] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-14T17:34:35.958098] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-14T17:34:36.001563] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T17:34:36.758062] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-14T17:34:37.179976] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T17:34:37.558115] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-14T17:34:38.234609] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T17:34:38.358028] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-14T17:34:38.403934] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T17:34:39.158065] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-14T17:34:39.854437] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:34:39.958281] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-14T17:34:40.758115] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-14T17:34:40.807820] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T17:34:40.834541] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T17:34:41.440917] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T17:34:41.442738] [INFO ] [REMOTE ] BFS: Full fetch complete (12960 records). [2025-10-14T17:34:41.442809] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-14T17:34:41.558326] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-14T17:34:41.823172] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-14T17:34:41.823254] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-14T17:34:41.823572] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-14T17:34:41.823610] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-14T17:34:41.824102] [DEBUG] [LOCAL ] BFS: Trimmed 12960 records to 9545 (keeping 200 days of data) [2025-10-14T17:34:41.885263] [DEBUG] [LOCAL ] BFS: Primary data saved (9545 records). [2025-10-14T17:34:41.885397] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-14T17:34:41.885474] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFS took 21.0s. Estimated remaining: 4h 47m 9s. Rate: 7.4 symbols/min [2025-10-14T17:34:42.057770] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:42.070905] [DEBUG] [LOCAL ] BFZ: Loaded 11930 existing records from primary storage. [2025-10-14T17:34:42.071123] [INFO ] [MAIN ] BFZ: Loaded 11930 existing records. [2025-10-14T17:34:42.251253] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:42.251443] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-14T17:34:42.251489] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-14T17:34:42.251696] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-14T17:34:42.251752] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-14T17:34:42.363263] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-14T17:34:42.553383] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T17:34:42.648696] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:43.158088] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-14T17:34:43.958068] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-14T17:34:44.141502] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T17:34:44.184770] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T17:34:44.758119] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-14T17:34:45.461833] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:34:45.560042] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-14T17:34:45.565532] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T17:34:45.572551] [INFO ] [REMOTE ] BFAM: Full fetch complete (47181 records). [2025-10-14T17:34:45.572780] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-14T17:34:45.983030] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-14T17:34:45.983150] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-14T17:34:45.984037] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-14T17:34:45.984105] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-14T17:34:45.985624] [DEBUG] [LOCAL ] BFAM: Trimmed 47181 records to 33752 (keeping 200 days of data) [2025-10-14T17:34:46.202209] [DEBUG] [LOCAL ] BFAM: Primary data saved (33752 records). [2025-10-14T17:34:46.202416] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-14T17:34:46.202522] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFAM took 44.6s. Estimated remaining: 4h 46m 29s. Rate: 7.4 symbols/min [2025-10-14T17:34:46.360231] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-14T17:34:46.379894] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:46.439466] [DEBUG] [LOCAL ] BG: Loaded 50492 existing records from primary storage. [2025-10-14T17:34:46.440063] [INFO ] [MAIN ] BG: Loaded 50492 existing records. [2025-10-14T17:34:46.667369] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:46.667685] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-14T17:34:46.667748] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-14T17:34:46.668187] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-14T17:34:46.668251] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-14T17:34:47.041252] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T17:34:47.085284] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:47.090966] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T17:34:47.092776] [INFO ] [REMOTE ] BFK: Full fetch complete (18866 records). [2025-10-14T17:34:47.092849] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-14T17:34:47.093276] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:34:47.093357] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:34:47.093417] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:34:47.093482] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-14T17:34:47.093547] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-14T17:34:47.093584] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-10-14T17:34:47.093863] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-10-14T17:34:47.093960] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFK took 30.9s. Estimated remaining: 4h 45m 21s. Rate: 7.4 symbols/min [2025-10-14T17:34:47.163275] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-14T17:34:47.265470] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:34:47.283280] [DEBUG] [LOCAL ] BGB: Loaded 18070 existing records from primary storage. [2025-10-14T17:34:47.283504] [INFO ] [MAIN ] BGB: Loaded 18070 existing records. [2025-10-14T17:34:47.459506] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:34:47.459750] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-14T17:34:47.459802] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-14T17:34:47.459981] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-14T17:34:47.460020] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-14T17:34:47.824667] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:34:47.958082] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-14T17:34:47.967154] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T17:34:48.758124] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-14T17:34:49.467494] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T17:34:49.558066] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-14T17:34:49.725188] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T17:34:50.358075] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-14T17:34:51.162355] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-14T17:34:51.173890] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T17:34:51.958116] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-14T17:34:51.994511] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T17:34:52.249855] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T17:34:52.758134] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-14T17:34:53.558082] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-14T17:34:53.659687] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T17:34:53.715429] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T17:34:54.358089] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-14T17:34:54.825359] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T17:34:54.867072] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T17:34:55.158067] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-14T17:34:55.958088] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-14T17:34:56.541713] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T17:34:56.758050] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-14T17:34:57.065894] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T17:34:57.355389] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T17:34:57.558095] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-14T17:34:58.358053] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-14T17:34:58.521767] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T17:34:59.158065] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-14T17:34:59.935314] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T17:34:59.958034] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-14T17:34:59.959397] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T17:35:00.583404] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T17:35:00.758060] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-14T17:35:01.456960] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T17:35:01.558093] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-14T17:35:02.358111] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-14T17:35:02.570221] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T17:35:03.158103] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-14T17:35:03.776800] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T17:35:03.781339] [INFO ] [REMOTE ] BFH: Full fetch complete (59581 records). [2025-10-14T17:35:03.781510] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-14T17:35:03.782213] [FATAL] [VALIDATOR ] BFH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:35:03.782330] [FATAL] [MAIN ] BFH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:35:03.782377] [WARN ] [MAIN ] BFH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:35:03.782417] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-14T17:35:03.782486] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-14T17:35:03.782549] [INFO ] [LOCAL ] BFH: Starting deletion of derivative data. [2025-10-14T17:35:03.782854] [DEBUG] [LOCAL ] BFH: Deleted derivative data file. [2025-10-14T17:35:03.782969] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFH took 56.7s. Estimated remaining: 4h 46m 23s. Rate: 7.4 symbols/min [2025-10-14T17:35:03.964063] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-14T17:35:03.967267] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:03.986799] [DEBUG] [LOCAL ] BGH: Loaded 17259 existing records from primary storage. [2025-10-14T17:35:03.987039] [INFO ] [MAIN ] BGH: Loaded 17259 existing records. [2025-10-14T17:35:04.179701] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:35:04.179889] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-14T17:35:04.179935] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-14T17:35:04.180120] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-14T17:35:04.180175] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-14T17:35:04.367311] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T17:35:04.549426] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:35:04.758123] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-14T17:35:05.496427] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T17:35:05.558060] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-14T17:35:05.669379] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T17:35:06.358139] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-14T17:35:07.158100] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-14T17:35:07.292285] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T17:35:07.309044] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T17:35:07.311862] [INFO ] [REMOTE ] BFZ: Full fetch complete (17424 records). [2025-10-14T17:35:07.311965] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-14T17:35:07.749752] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-14T17:35:07.749869] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-14T17:35:07.750617] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-14T17:35:07.750696] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-14T17:35:07.751471] [DEBUG] [LOCAL ] BFZ: Trimmed 17424 records to 11900 (keeping 200 days of data) [2025-10-14T17:35:07.817210] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T17:35:07.850077] [DEBUG] [LOCAL ] BFZ: Primary data saved (11900 records). [2025-10-14T17:35:07.850328] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-14T17:35:07.850440] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BFZ took 26.0s. Estimated remaining: 4h 45m 42s. Rate: 7.4 symbols/min [2025-10-14T17:35:07.963382] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-14T17:35:08.037529] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:08.052274] [DEBUG] [LOCAL ] BGR: Loaded 13557 existing records from primary storage. [2025-10-14T17:35:08.052509] [INFO ] [MAIN ] BGR: Loaded 13557 existing records. [2025-10-14T17:35:08.228303] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:35:08.228546] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-14T17:35:08.228593] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-14T17:35:08.228812] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-14T17:35:08.228869] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-14T17:35:08.606227] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:35:08.758080] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-14T17:35:09.219809] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T17:35:09.558059] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-14T17:35:10.358111] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-14T17:35:10.483465] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T17:35:10.521393] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T17:35:10.981793] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T17:35:11.158074] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-14T17:35:11.739740] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T17:35:11.958093] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-14T17:35:12.758074] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-14T17:35:12.932163] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T17:35:13.423017] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T17:35:13.558065] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-14T17:35:14.255041] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T17:35:14.358092] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-14T17:35:15.158081] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-14T17:35:15.465695] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T17:35:15.940819] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T17:35:15.958025] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-14T17:35:16.758055] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-14T17:35:16.933058] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T17:35:17.479142] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T17:35:17.558059] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-14T17:35:18.358050] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-14T17:35:18.491639] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-14T17:35:19.141894] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T17:35:19.158038] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-14T17:35:19.965880] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-14T17:35:19.967795] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T17:35:20.758053] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-14T17:35:20.919913] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-14T17:35:21.558059] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-14T17:35:21.754290] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T17:35:22.358087] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-14T17:35:22.504212] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T17:35:23.132375] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T17:35:23.158027] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-14T17:35:23.958091] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-14T17:35:24.082189] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T17:35:24.758063] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-14T17:35:24.910946] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T17:35:25.510050] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T17:35:25.558082] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-14T17:35:26.358056] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-14T17:35:26.654147] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T17:35:26.656699] [INFO ] [REMOTE ] BGB: Full fetch complete (26913 records). [2025-10-14T17:35:26.656795] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-14T17:35:27.018668] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-14T17:35:27.018756] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-14T17:35:27.019156] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-14T17:35:27.019217] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-14T17:35:27.019876] [DEBUG] [LOCAL ] BGB: Trimmed 26913 records to 17991 (keeping 200 days of data) [2025-10-14T17:35:27.124381] [DEBUG] [LOCAL ] BGB: Primary data saved (17991 records). [2025-10-14T17:35:27.124518] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-14T17:35:27.124593] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGB took 40.0s. Estimated remaining: 4h 47m 4s. Rate: 7.3 symbols/min [2025-10-14T17:35:27.167431] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-14T17:35:27.304094] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:27.302697] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-14T17:35:27.307251] [INFO ] [REMOTE ] BGH: Full fetch complete (22825 records). [2025-10-14T17:35:27.307345] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-14T17:35:27.654853] [DEBUG] [LOCAL ] BGS: Loaded 50490 existing records from primary storage. [2025-10-14T17:35:27.677704] [INFO ] [MAIN ] BGS: Loaded 50490 existing records. [2025-10-14T17:35:27.802419] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-14T17:35:27.811296] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-14T17:35:27.832946] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-14T17:35:27.833035] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-14T17:35:27.854781] [DEBUG] [LOCAL ] BGH: Trimmed 22825 records to 17259 (keeping 200 days of data) [2025-10-14T17:35:27.991175] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:35:27.964162] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-14T17:35:27.991747] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-14T17:35:27.994588] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-14T17:35:27.996189] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-14T17:35:27.996552] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-14T17:35:28.342515] [DEBUG] [LOCAL ] BGH: Primary data saved (17259 records). [2025-10-14T17:35:28.354863] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-14T17:35:28.361888] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BGH took 24.6s. Estimated remaining: 4h 46m 0s. Rate: 7.4 symbols/min [2025-10-14T17:35:28.412792] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:35:28.549105] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:28.559369] [DEBUG] [LOCAL ] BGSF: Loaded 7846 existing records from primary storage. [2025-10-14T17:35:28.559596] [INFO ] [MAIN ] BGSF: Loaded 7846 existing records. [2025-10-14T17:35:28.737524] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T17:35:28.750573] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:35:28.750836] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-14T17:35:28.750950] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-14T17:35:28.755464] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-14T17:35:28.755525] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-14T17:35:28.766786] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-14T17:35:29.117279] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:35:29.151938] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-14T17:35:29.558076] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-14T17:35:30.358064] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-14T17:35:30.580346] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T17:35:30.749558] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-14T17:35:31.014454] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T17:35:31.158033] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-14T17:35:31.958078] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-14T17:35:32.758363] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-14T17:35:32.976404] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T17:35:33.413379] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T17:35:33.464865] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T17:35:33.558097] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-14T17:35:34.358078] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-14T17:35:35.168695] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-14T17:35:35.173381] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T17:35:35.958046] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-14T17:35:36.099033] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T17:35:36.131091] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T17:35:36.758084] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-14T17:35:37.558801] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-14T17:35:37.559584] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T17:35:37.563473] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T17:35:38.358105] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-14T17:35:38.626823] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-14T17:35:38.992505] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T17:35:38.998178] [INFO ] [REMOTE ] BG: Full fetch complete (72918 records). [2025-10-14T17:35:38.998333] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-14T17:35:39.171181] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-14T17:35:39.389269] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-14T17:35:39.389355] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-14T17:35:39.390150] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-14T17:35:39.390225] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-14T17:35:39.391762] [DEBUG] [LOCAL ] BG: Trimmed 72918 records to 50480 (keeping 200 days of data) [2025-10-14T17:35:39.699233] [DEBUG] [LOCAL ] BG: Primary data saved (50480 records). [2025-10-14T17:35:39.699360] [INFO ] [MAIN ] BG: Full history saved. [2025-10-14T17:35:39.699434] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BG took 53.5s. Estimated remaining: 4h 46m 18s. Rate: 7.4 symbols/min [2025-10-14T17:35:39.865604] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:39.884240] [DEBUG] [LOCAL ] BGT: Loaded 16534 existing records from primary storage. [2025-10-14T17:35:39.884481] [INFO ] [MAIN ] BGT: Loaded 16534 existing records. [2025-10-14T17:35:39.963121] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-14T17:35:40.061266] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:35:40.061489] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-14T17:35:40.061539] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-14T17:35:40.061837] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-14T17:35:40.061896] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-14T17:35:40.421851] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:35:40.601169] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T17:35:40.602909] [INFO ] [REMOTE ] BGR: Full fetch complete (20092 records). [2025-10-14T17:35:40.602977] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-14T17:35:40.758541] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-14T17:35:41.004309] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-14T17:35:41.004522] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-14T17:35:41.005025] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-14T17:35:41.005222] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-14T17:35:41.006398] [DEBUG] [LOCAL ] BGR: Trimmed 20092 records to 13590 (keeping 200 days of data) [2025-10-14T17:35:41.097824] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T17:35:41.132771] [DEBUG] [LOCAL ] BGR: Primary data saved (13590 records). [2025-10-14T17:35:41.132931] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-14T17:35:41.133017] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGR took 33.3s. Estimated remaining: 4h 45m 16s. Rate: 7.4 symbols/min [2025-10-14T17:35:41.301019] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:41.301220] [DEBUG] [LOCAL ] BGX: No existing data file found in primary storage. [2025-10-14T17:35:41.301259] [WARN ] [MAIN ] BGX: No existing data found, performing full refresh instead. [2025-10-14T17:35:41.301377] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-14T17:35:41.301447] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-14T17:35:41.301535] [DEBUG] [LOCAL ] BGX: No primary data file found to delete. [2025-10-14T17:35:41.301601] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-14T17:35:41.511235] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T17:35:41.563225] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-14T17:35:41.696100] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:35:42.211384] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T17:35:42.358080] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-14T17:35:43.158051] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-14T17:35:43.189610] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T17:35:43.958060] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-14T17:35:44.264375] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-14T17:35:44.758069] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-14T17:35:44.971216] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T17:35:45.558082] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-14T17:35:45.595125] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T17:35:46.288844] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T17:35:46.358070] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-14T17:35:47.141286] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T17:35:47.158023] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-14T17:35:47.948786] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T17:35:47.958022] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-14T17:35:48.468948] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T17:35:48.758065] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-14T17:35:49.558051] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-14T17:35:49.656417] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T17:35:50.085662] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T17:35:50.358135] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-14T17:35:51.158108] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-14T17:35:51.951171] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T17:35:51.958023] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-14T17:35:52.017825] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T17:35:52.715182] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T17:35:52.758033] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-14T17:35:53.313900] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T17:35:53.558075] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-14T17:35:54.358074] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-14T17:35:54.772669] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T17:35:55.158045] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-14T17:35:55.208523] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T17:35:55.958079] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-14T17:35:56.136274] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T17:35:56.732005] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T17:35:56.758028] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-14T17:35:57.553149] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T17:35:57.558017] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-14T17:35:58.358100] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-14T17:35:58.810717] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T17:35:58.813098] [INFO ] [REMOTE ] BGSF: Full fetch complete (9453 records). [2025-10-14T17:35:58.813233] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-14T17:35:59.167169] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-14T17:35:59.234527] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T17:35:59.235031] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-14T17:35:59.239758] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-14T17:35:59.240147] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-14T17:35:59.240595] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-14T17:35:59.241181] [DEBUG] [LOCAL ] BGSF: Trimmed 9453 records to 7899 (keeping 200 days of data) [2025-10-14T17:35:59.288324] [DEBUG] [LOCAL ] BGSF: Primary data saved (7899 records). [2025-10-14T17:35:59.288449] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-14T17:35:59.288560] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGSF took 30.9s. Estimated remaining: 4h 46m 28s. Rate: 7.3 symbols/min [2025-10-14T17:35:59.457005] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:35:59.479420] [DEBUG] [LOCAL ] BGY: Loaded 22024 existing records from primary storage. [2025-10-14T17:35:59.479703] [INFO ] [MAIN ] BGY: Loaded 22024 existing records. [2025-10-14T17:35:59.659266] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:35:59.659576] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-14T17:35:59.659631] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-14T17:35:59.659964] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-14T17:35:59.660048] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-14T17:35:59.963242] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-14T17:36:00.018577] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:00.027549] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T17:36:00.758100] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-14T17:36:01.558056] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-14T17:36:01.608810] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T17:36:01.872236] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T17:36:02.344238] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T17:36:02.358045] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-14T17:36:03.158067] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-14T17:36:03.263269] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T17:36:03.265630] [INFO ] [REMOTE ] BGX: Full fetch complete (16558 records). [2025-10-14T17:36:03.265752] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-14T17:36:03.641473] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-14T17:36:03.641810] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-14T17:36:03.642195] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-14T17:36:03.642254] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-14T17:36:03.643155] [DEBUG] [LOCAL ] BGX: Trimmed 16558 records to 11165 (keeping 200 days of data) [2025-10-14T17:36:03.712985] [DEBUG] [LOCAL ] BGX: Primary data saved (11165 records). [2025-10-14T17:36:03.713125] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-14T17:36:03.713198] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGX took 22.6s. Estimated remaining: 4h 45m 50s. Rate: 7.4 symbols/min [2025-10-14T17:36:03.905135] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:03.924739] [DEBUG] [LOCAL ] BH: Loaded 16227 existing records from primary storage. [2025-10-14T17:36:03.925037] [INFO ] [MAIN ] BH: Loaded 16227 existing records. [2025-10-14T17:36:03.961796] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-14T17:36:04.141032] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T17:36:04.145562] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:36:04.152438] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-14T17:36:04.152549] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-14T17:36:04.153050] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-14T17:36:04.153126] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-14T17:36:04.534826] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:04.758094] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-14T17:36:04.941775] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T17:36:05.558045] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-14T17:36:05.682834] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T17:36:06.358042] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-14T17:36:06.371071] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T17:36:07.158037] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-14T17:36:07.958048] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-14T17:36:08.067246] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T17:36:08.112850] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T17:36:08.758042] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-14T17:36:09.047618] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T17:36:09.558105] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-14T17:36:10.358089] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-14T17:36:10.494263] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T17:36:10.763806] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-14T17:36:11.152407] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T17:36:11.158028] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-14T17:36:11.773269] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T17:36:11.958078] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-14T17:36:12.758089] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-14T17:36:13.332816] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T17:36:13.541037] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T17:36:13.558020] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-14T17:36:14.358087] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-14T17:36:14.446550] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T17:36:14.448471] [INFO ] [REMOTE ] BGT: Full fetch complete (24177 records). [2025-10-14T17:36:14.448539] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-14T17:36:14.822837] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-14T17:36:14.822910] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-14T17:36:14.823280] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-14T17:36:14.823318] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-14T17:36:14.823929] [DEBUG] [LOCAL ] BGT: Trimmed 24177 records to 16483 (keeping 200 days of data) [2025-10-14T17:36:14.921180] [DEBUG] [LOCAL ] BGT: Primary data saved (16483 records). [2025-10-14T17:36:14.921311] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-14T17:36:14.921386] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGT took 35.2s. Estimated remaining: 4h 46m 6s. Rate: 7.4 symbols/min [2025-10-14T17:36:15.086493] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:15.127038] [DEBUG] [LOCAL ] BHC: Loaded 46690 existing records from primary storage. [2025-10-14T17:36:15.127321] [INFO ] [MAIN ] BHC: Loaded 46690 existing records. [2025-10-14T17:36:15.159184] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-14T17:36:15.329352] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:36:15.331523] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-14T17:36:15.331418] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T17:36:15.331719] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-14T17:36:15.338429] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-14T17:36:15.338495] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-14T17:36:15.708274] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:15.946444] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T17:36:15.958026] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-14T17:36:16.758087] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-14T17:36:16.808623] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T17:36:17.558043] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-14T17:36:18.329889] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T17:36:18.358044] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-14T17:36:18.598916] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T17:36:19.158079] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-14T17:36:19.958042] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-14T17:36:20.133127] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-14T17:36:20.138776] [INFO ] [REMOTE ] BGS: Full fetch complete (72638 records). [2025-10-14T17:36:20.138920] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-14T17:36:20.281003] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T17:36:20.549939] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-14T17:36:20.550036] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-14T17:36:20.550939] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-14T17:36:20.551049] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-14T17:36:20.552517] [DEBUG] [LOCAL ] BGS: Trimmed 72638 records to 50514 (keeping 200 days of data) [2025-10-14T17:36:20.662932] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T17:36:20.771620] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-14T17:36:20.865617] [DEBUG] [LOCAL ] BGS: Primary data saved (50514 records). [2025-10-14T17:36:20.865774] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-14T17:36:20.865858] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BGS took 53.7s. Estimated remaining: 4h 45m 40s. Rate: 7.4 symbols/min [2025-10-14T17:36:21.031730] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:21.053476] [DEBUG] [LOCAL ] BHE: Loaded 23897 existing records from primary storage. [2025-10-14T17:36:21.053732] [INFO ] [MAIN ] BHE: Loaded 23897 existing records. [2025-10-14T17:36:21.232687] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:36:21.232940] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-14T17:36:21.232988] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-14T17:36:21.233249] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-14T17:36:21.233306] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-14T17:36:21.568896] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-14T17:36:21.590440] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:21.895617] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T17:36:22.287457] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T17:36:22.358055] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-14T17:36:23.158053] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-14T17:36:23.518557] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:36:23.958099] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-14T17:36:24.626778] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T17:36:24.758046] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-14T17:36:25.027003] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T17:36:25.558064] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-14T17:36:26.263576] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T17:36:26.358080] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-14T17:36:26.698839] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T17:36:27.158049] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-14T17:36:27.189687] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T17:36:27.958058] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-14T17:36:28.372639] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T17:36:28.758035] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-14T17:36:28.895355] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T17:36:29.558074] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-14T17:36:30.365181] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-14T17:36:30.368800] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T17:36:30.371925] [INFO ] [REMOTE ] BGY: Full fetch complete (33001 records). [2025-10-14T17:36:30.371997] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-14T17:36:30.687239] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T17:36:30.808381] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-14T17:36:30.808470] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-14T17:36:30.809003] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-14T17:36:30.809066] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-14T17:36:30.809994] [DEBUG] [LOCAL ] BGY: Trimmed 33001 records to 21940 (keeping 200 days of data) [2025-10-14T17:36:30.938320] [DEBUG] [LOCAL ] BGY: Primary data saved (21940 records). [2025-10-14T17:36:30.938462] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-14T17:36:30.938555] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGY took 31.6s. Estimated remaining: 4h 45m 47s. Rate: 7.4 symbols/min [2025-10-14T17:36:31.107757] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:31.130911] [DEBUG] [LOCAL ] BHK: Loaded 23543 existing records from primary storage. [2025-10-14T17:36:31.131165] [INFO ] [MAIN ] BHK: Loaded 23543 existing records. [2025-10-14T17:36:31.163311] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-14T17:36:31.318369] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:36:31.318829] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-14T17:36:31.319079] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-14T17:36:31.324557] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-14T17:36:31.324712] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-14T17:36:31.417894] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T17:36:31.703391] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:31.958079] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-14T17:36:32.026156] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T17:36:32.758054] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-14T17:36:33.143613] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T17:36:33.558072] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-14T17:36:33.886388] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:36:34.358045] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-14T17:36:34.535352] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T17:36:35.158121] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-14T17:36:35.608238] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-14T17:36:35.958072] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-14T17:36:36.030405] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T17:36:36.758106] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-14T17:36:37.063753] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T17:36:37.558101] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-14T17:36:37.737889] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T17:36:38.163606] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T17:36:38.358065] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-14T17:36:38.992018] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T17:36:39.158063] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-14T17:36:39.958064] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-14T17:36:40.030036] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T17:36:40.758099] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-14T17:36:40.855821] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T17:36:40.857777] [INFO ] [REMOTE ] BH: Full fetch complete (19563 records). [2025-10-14T17:36:40.857844] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-14T17:36:41.231783] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-14T17:36:41.231862] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-14T17:36:41.232216] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-14T17:36:41.232254] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-14T17:36:41.233114] [DEBUG] [LOCAL ] BH: Trimmed 19563 records to 16212 (keeping 200 days of data) [2025-10-14T17:36:41.326126] [DEBUG] [LOCAL ] BH: Primary data saved (16212 records). [2025-10-14T17:36:41.326260] [INFO ] [MAIN ] BH: Full history saved. [2025-10-14T17:36:41.326342] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BH took 37.6s. Estimated remaining: 4h 45m 56s. Rate: 7.3 symbols/min [2025-10-14T17:36:41.500333] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:41.551002] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-14T17:36:41.551363] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-10-14T17:36:41.564082] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-14T17:36:41.735894] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:36:41.736045] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-14T17:36:41.736093] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-14T17:36:41.736421] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-14T17:36:41.736478] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-14T17:36:42.109533] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:42.358044] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-14T17:36:42.404126] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T17:36:42.587618] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T17:36:43.158084] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-14T17:36:43.958073] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-14T17:36:44.453115] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:36:44.489753] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-14T17:36:44.758048] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-14T17:36:44.788060] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T17:36:45.558060] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-14T17:36:46.358097] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-14T17:36:46.723293] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-14T17:36:47.168067] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-14T17:36:47.189407] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T17:36:47.246191] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T17:36:47.958141] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-14T17:36:48.758043] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-14T17:36:48.982396] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T17:36:49.053281] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T17:36:49.558066] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-14T17:36:50.267241] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T17:36:50.353922] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T17:36:50.360011] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-14T17:36:51.158095] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-14T17:36:51.958082] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-14T17:36:52.110065] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T17:36:52.142907] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T17:36:52.145715] [INFO ] [REMOTE ] BHK: Full fetch complete (30653 records). [2025-10-14T17:36:52.145799] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-14T17:36:52.521851] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-14T17:36:52.522036] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-14T17:36:52.522974] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-14T17:36:52.523108] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-14T17:36:52.524465] [DEBUG] [LOCAL ] BHK: Trimmed 30653 records to 23624 (keeping 200 days of data) [2025-10-14T17:36:52.668265] [DEBUG] [LOCAL ] BHK: Primary data saved (23624 records). [2025-10-14T17:36:52.668443] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-14T17:36:52.668541] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHK took 21.7s. Estimated remaining: 4h 46m 13s. Rate: 7.3 symbols/min [2025-10-14T17:36:52.767880] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-14T17:36:52.840549] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:52.864887] [DEBUG] [LOCAL ] BHR: Loaded 22109 existing records from primary storage. [2025-10-14T17:36:52.865205] [INFO ] [MAIN ] BHR: Loaded 22109 existing records. [2025-10-14T17:36:53.046237] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:36:53.046548] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-14T17:36:53.046600] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-14T17:36:53.046835] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-14T17:36:53.046891] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-14T17:36:53.415805] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:53.558090] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-14T17:36:53.616895] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T17:36:53.922568] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T17:36:54.358067] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-14T17:36:55.158056] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-14T17:36:55.303271] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T17:36:55.958137] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-14T17:36:56.292996] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T17:36:56.519380] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T17:36:56.765564] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-14T17:36:56.769228] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T17:36:57.558100] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-14T17:36:57.782360] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T17:36:57.784937] [INFO ] [REMOTE ] BHE: Full fetch complete (36261 records). [2025-10-14T17:36:57.785071] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-14T17:36:58.164159] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-14T17:36:58.164262] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-14T17:36:58.164781] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-14T17:36:58.164845] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-14T17:36:58.165839] [DEBUG] [LOCAL ] BHE: Trimmed 36261 records to 23832 (keeping 200 days of data) [2025-10-14T17:36:58.315230] [DEBUG] [LOCAL ] BHE: Primary data saved (23832 records). [2025-10-14T17:36:58.315408] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-14T17:36:58.315540] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHE took 37.4s. Estimated remaining: 4h 45m 45s. Rate: 7.3 symbols/min [2025-10-14T17:36:58.363271] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-14T17:36:58.492711] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:36:58.492902] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-14T17:36:58.493040] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-14T17:36:58.493203] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-14T17:36:58.493274] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-14T17:36:58.493362] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-14T17:36:58.493429] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-14T17:36:58.859118] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:36:59.158594] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-14T17:36:59.159394] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T17:36:59.165815] [INFO ] [REMOTE ] BHC: Full fetch complete (67326 records). [2025-10-14T17:36:59.165922] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-14T17:36:59.558574] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-14T17:36:59.558678] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-14T17:36:59.559440] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-14T17:36:59.559479] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-14T17:36:59.560847] [DEBUG] [LOCAL ] BHC: Trimmed 67326 records to 46658 (keeping 200 days of data) [2025-10-14T17:36:59.826277] [DEBUG] [LOCAL ] BHC: Primary data saved (46658 records). [2025-10-14T17:36:59.826437] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-14T17:36:59.826521] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHC took 44.9s. Estimated remaining: 4h 44m 45s. Rate: 7.4 symbols/min [2025-10-14T17:36:59.978527] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-14T17:37:00.004570] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:37:00.049841] [DEBUG] [LOCAL ] BHVN: Loaded 50396 existing records from primary storage. [2025-10-14T17:37:00.050150] [INFO ] [MAIN ] BHVN: Loaded 50396 existing records. [2025-10-14T17:37:00.232411] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:37:00.232821] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-14T17:37:00.232985] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-14T17:37:00.233839] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-14T17:37:00.233901] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-14T17:37:00.352096] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T17:37:00.585407] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T17:37:00.623709] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T17:37:00.714207] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:37:00.758096] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-14T17:37:01.558063] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-14T17:37:01.834273] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-14T17:37:02.268786] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T17:37:02.358100] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-14T17:37:02.651108] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-14T17:37:03.158065] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-14T17:37:03.513980] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-14T17:37:03.958071] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-14T17:37:04.593714] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T17:37:04.758070] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-14T17:37:05.558086] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-14T17:37:05.849905] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-14T17:37:06.358078] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-14T17:37:06.647904] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-14T17:37:06.863304] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-14T17:37:07.158080] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-14T17:37:07.958080] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-14T17:37:08.035451] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T17:37:08.309591] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T17:37:08.758064] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-14T17:37:09.558061] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-14T17:37:09.887786] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T17:37:10.358082] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-14T17:37:10.671770] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T17:37:11.158113] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-14T17:37:11.958058] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-14T17:37:12.088488] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:37:12.407704] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T17:37:12.758118] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-14T17:37:13.018888] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T17:37:13.475890] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T17:37:13.558131] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-14T17:37:14.358165] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-14T17:37:15.075072] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T17:37:15.080906] [INFO ] [REMOTE ] BHP: Full fetch complete (77433 records). [2025-10-14T17:37:15.081013] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-14T17:37:15.163269] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-14T17:37:15.477547] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-14T17:37:15.477685] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-14T17:37:15.478537] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-14T17:37:15.478615] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-14T17:37:15.495544] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T17:37:15.501315] [DEBUG] [LOCAL ] BHP: Trimmed 77433 records to 53373 (keeping 200 days of data) [2025-10-14T17:37:15.618396] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T17:37:15.620740] [INFO ] [REMOTE ] BHV: Full fetch complete (1389 records). [2025-10-14T17:37:15.621799] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-14T17:37:15.931243] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-14T17:37:15.932168] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:37:15.933018] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:37:15.934307] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-14T17:37:15.934699] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-14T17:37:15.934986] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-14T17:37:15.935902] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-14T17:37:15.936550] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHV took 17.6s. Estimated remaining: 4h 45m 38s. Rate: 7.3 symbols/min [2025-10-14T17:37:15.967729] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-14T17:37:16.127744] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:37:16.243666] [DEBUG] [LOCAL ] BILL: Loaded 52444 existing records from primary storage. [2025-10-14T17:37:16.244789] [INFO ] [MAIN ] BILL: Loaded 52444 existing records. [2025-10-14T17:37:16.410767] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-10-14T17:37:16.427292] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-14T17:37:16.430851] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:37:16.431678] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHP took 35.1s. Estimated remaining: 4h 44m 32s. Rate: 7.4 symbols/min [2025-10-14T17:37:16.437087] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-14T17:37:16.482593] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-14T17:37:16.537846] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-14T17:37:16.556509] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-14T17:37:16.737514] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:37:16.737742] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-14T17:37:16.737866] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-14T17:37:16.748748] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-14T17:37:16.753920] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-14T17:37:16.764233] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-14T17:37:16.764422] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-14T17:37:16.764280] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-14T17:37:17.230727] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:37:17.321892] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T17:37:17.432486] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:37:17.558028] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-14T17:37:18.358034] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-14T17:37:18.424812] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T17:37:18.523994] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T17:37:19.158129] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-14T17:37:19.875282] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T17:37:19.958034] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-14T17:37:20.360168] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T17:37:20.716355] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T17:37:20.758081] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-14T17:37:21.538433] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T17:37:21.558026] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-14T17:37:22.358039] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-14T17:37:22.731634] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T17:37:22.980417] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T17:37:23.158067] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-14T17:37:23.927286] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T17:37:23.958029] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-14T17:37:24.758085] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-14T17:37:25.260336] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T17:37:25.558037] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-14T17:37:26.029339] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T17:37:26.358091] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-14T17:37:27.158110] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-14T17:37:27.198443] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:37:27.619620] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T17:37:27.623062] [INFO ] [REMOTE ] BHR: Full fetch complete (31330 records). [2025-10-14T17:37:27.623134] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-14T17:37:27.963151] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-14T17:37:28.000799] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-14T17:37:28.000886] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-14T17:37:28.001432] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-14T17:37:28.001474] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-14T17:37:28.002560] [DEBUG] [LOCAL ] BHR: Trimmed 31330 records to 22078 (keeping 200 days of data) [2025-10-14T17:37:28.127313] [DEBUG] [LOCAL ] BHR: Primary data saved (22078 records). [2025-10-14T17:37:28.127449] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-14T17:37:28.127529] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHR took 35.5s. Estimated remaining: 4h 44m 50s. Rate: 7.4 symbols/min [2025-10-14T17:37:28.292445] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:37:28.326203] [DEBUG] [LOCAL ] BIP: Loaded 39207 existing records from primary storage. [2025-10-14T17:37:28.326472] [INFO ] [MAIN ] BIP: Loaded 39207 existing records. [2025-10-14T17:37:28.504726] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:37:28.505006] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-14T17:37:28.505060] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-14T17:37:28.506251] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-14T17:37:28.506308] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-14T17:37:28.758393] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-14T17:37:28.875144] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:37:28.905738] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T17:37:29.323784] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T17:37:29.558067] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-14T17:37:30.266115] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:37:30.358057] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-14T17:37:30.627971] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T17:37:31.158069] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-14T17:37:31.693378] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T17:37:31.958065] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-14T17:37:32.758042] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-14T17:37:32.975619] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T17:37:33.208073] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T17:37:33.558076] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-14T17:37:34.004061] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T17:37:34.358109] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-14T17:37:34.448885] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T17:37:35.158070] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-14T17:37:35.805559] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T17:37:35.958034] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-14T17:37:36.309186] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T17:37:36.758126] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-14T17:37:37.292682] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T17:37:37.558127] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-14T17:37:38.134268] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T17:37:38.358125] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-14T17:37:38.891635] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T17:37:39.158114] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-14T17:37:39.491051] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:37:39.958086] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-14T17:37:40.486368] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:37:40.758084] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-14T17:37:41.407167] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:37:41.484144] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T17:37:41.558073] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-14T17:37:42.358118] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-14T17:37:43.158148] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-14T17:37:43.222578] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T17:37:43.228528] [INFO ] [REMOTE ] BHVN: Full fetch complete (70410 records). [2025-10-14T17:37:43.228710] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-14T17:37:43.624607] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-14T17:37:43.624723] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-14T17:37:43.625456] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-14T17:37:43.625495] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-14T17:37:43.626856] [DEBUG] [LOCAL ] BHVN: Trimmed 70410 records to 50511 (keeping 200 days of data) [2025-10-14T17:37:43.923631] [DEBUG] [LOCAL ] BHVN: Primary data saved (50511 records). [2025-10-14T17:37:43.923814] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-14T17:37:43.923913] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BHVN took 44.1s. Estimated remaining: 4h 45m 40s. Rate: 7.3 symbols/min [2025-10-14T17:37:43.967406] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-14T17:37:44.103846] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:37:44.141733] [DEBUG] [LOCAL ] BIPC: Loaded 41208 existing records from primary storage. [2025-10-14T17:37:44.142199] [INFO ] [MAIN ] BIPC: Loaded 41208 existing records. [2025-10-14T17:37:44.328279] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:37:44.328575] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-14T17:37:44.328698] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-14T17:37:44.329176] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-14T17:37:44.329245] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-14T17:37:44.626161] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-14T17:37:44.754301] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:37:44.763595] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-14T17:37:44.783594] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T17:37:44.933479] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T17:37:44.935836] [INFO ] [REMOTE ] BIO: Full fetch complete (34085 records). [2025-10-14T17:37:44.935913] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-14T17:37:45.308861] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-14T17:37:45.308940] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-14T17:37:45.309399] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-14T17:37:45.309437] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-14T17:37:45.310198] [DEBUG] [LOCAL ] BIO: Trimmed 34085 records to 24138 (keeping 200 days of data) [2025-10-14T17:37:45.452519] [DEBUG] [LOCAL ] BIO: Primary data saved (24138 records). [2025-10-14T17:37:45.452664] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-14T17:37:45.452752] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BIO took 29.0s. Estimated remaining: 4h 44m 42s. Rate: 7.3 symbols/min [2025-10-14T17:37:45.558045] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-14T17:37:46.221395] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T17:37:46.358032] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-14T17:37:46.489240] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T17:37:47.158069] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-14T17:37:47.761972] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T17:37:47.958111] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-14T17:37:48.767267] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-14T17:37:48.772786] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T17:37:49.360820] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T17:37:49.558087] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-14T17:37:49.788874] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T17:37:50.358121] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-14T17:37:50.724214] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T17:37:51.158091] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-14T17:37:51.958099] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-14T17:37:52.135462] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T17:37:52.455375] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:37:52.758111] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-14T17:37:53.220077] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T17:37:53.558122] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-14T17:37:54.262539] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T17:37:54.358123] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-14T17:37:55.039409] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T17:37:55.158032] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-14T17:37:55.958062] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-14T17:37:56.120923] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T17:37:56.379043] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T17:37:56.758056] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-14T17:37:57.561115] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-14T17:37:57.567343] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T17:37:58.358091] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-14T17:37:58.506213] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T17:37:59.170059] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-14T17:37:59.172378] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T17:37:59.560901] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T17:37:59.565424] [INFO ] [REMOTE ] BIP: Full fetch complete (57208 records). [2025-10-14T17:37:59.565519] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-14T17:37:59.943903] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-14T17:37:59.943975] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-14T17:37:59.944715] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-14T17:37:59.944777] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-14T17:37:59.945899] [DEBUG] [LOCAL ] BIP: Trimmed 57208 records to 39214 (keeping 200 days of data) [2025-10-14T17:37:59.997062] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-14T17:38:00.175892] [DEBUG] [LOCAL ] BIP: Primary data saved (39214 records). [2025-10-14T17:38:00.176020] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-14T17:38:00.176110] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIP took 32.0s. Estimated remaining: 4h 45m 23s. Rate: 7.3 symbols/min [2025-10-14T17:38:00.658307] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T17:38:00.758075] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-14T17:38:01.453005] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T17:38:01.558027] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-14T17:38:02.237497] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T17:38:02.358030] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-14T17:38:02.706492] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T17:38:03.158107] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-14T17:38:04.093390] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T17:38:04.100159] [INFO ] [REMOTE ] BILL: Full fetch complete (76062 records). [2025-10-14T17:38:04.100335] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-14T17:38:04.508494] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-14T17:38:04.508602] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-14T17:38:04.509524] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-14T17:38:04.509684] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-14T17:38:04.511114] [DEBUG] [LOCAL ] BILL: Trimmed 76062 records to 52469 (keeping 200 days of data) [2025-10-14T17:38:04.609546] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T17:38:04.616700] [INFO ] [REMOTE ] BIPC: Full fetch complete (60149 records). [2025-10-14T17:38:04.617096] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-14T17:38:05.061089] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-14T17:38:05.064689] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-14T17:38:05.066211] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-14T17:38:05.066310] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-14T17:38:05.152192] [DEBUG] [LOCAL ] BIPC: Trimmed 60149 records to 41199 (keeping 200 days of data) [2025-10-14T17:38:05.490035] [DEBUG] [LOCAL ] BILL: Primary data saved (52469 records). [2025-10-14T17:38:05.493135] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-14T17:38:05.493266] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BILL took 49.6s. Estimated remaining: 4h 44m 53s. Rate: 7.3 symbols/min [2025-10-14T17:38:05.513940] [DEBUG] [LOCAL ] BIPC: Primary data saved (41199 records). [2025-10-14T17:38:05.514145] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-14T17:38:05.514262] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 21.6s. Estimated remaining: 4h 43m 44s. Rate: 7.4 symbols/min [2025-10-14T17:38:06.113988] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:06.206759] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:06.292502] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:06.297298] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:06.297896] [DEBUG] [LOCAL ] BIPH: Loaded 2553 existing records from primary storage. [2025-10-14T17:38:06.299064] [INFO ] [MAIN ] BIPH: Loaded 2553 existing records. [2025-10-14T17:38:06.376106] [DEBUG] [LOCAL ] BIPI: Loaded 3114 existing records from primary storage. [2025-10-14T17:38:06.388561] [INFO ] [MAIN ] BIPI: Loaded 3114 existing records. [2025-10-14T17:38:06.397230] [DEBUG] [LOCAL ] BIPJ: Loaded 3168 existing records from primary storage. [2025-10-14T17:38:06.466034] [INFO ] [MAIN ] BIPJ: Loaded 3168 existing records. [2025-10-14T17:38:06.815769] [DEBUG] [LOCAL ] BIRK: Loaded 51043 existing records from primary storage. [2025-10-14T17:38:06.809333] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:06.830339] [INFO ] [MAIN ] BIRK: Loaded 51043 existing records. [2025-10-14T17:38:06.856262] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-14T17:38:06.931517] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-14T17:38:06.961843] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:07.036008] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-14T17:38:07.025231] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:07.036212] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-14T17:38:07.035634] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-14T17:38:07.041882] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-14T17:38:07.042131] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-14T17:38:07.100353] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-14T17:38:07.105871] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-14T17:38:07.100491] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-14T17:38:07.184738] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-14T17:38:07.219695] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-14T17:38:07.567036] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:07.690552] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-14T17:38:07.797828] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-14T17:38:07.919390] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-14T17:38:07.967687] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-14T17:38:08.425591] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:08.486286] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:08.447584] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:08.487896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-14T17:38:08.499311] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-14T17:38:08.505186] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-14T17:38:08.777561] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:08.778211] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-14T17:38:09.281824] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T17:38:09.283373] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-14T17:38:09.337019] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T17:38:09.338768] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-14T17:38:09.379156] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T17:38:09.381402] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-14T17:38:09.727592] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T17:38:09.729008] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-14T17:38:09.839372] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T17:38:09.879319] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T17:38:10.039899] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-14T17:38:10.249840] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T17:38:10.358062] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-14T17:38:11.158084] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-14T17:38:11.679920] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T17:38:11.689352] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:38:11.958106] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-14T17:38:12.758115] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-14T17:38:13.456339] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T17:38:13.543594] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T17:38:13.558034] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-14T17:38:14.358062] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-14T17:38:14.781002] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-14T17:38:15.126500] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T17:38:15.158024] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-14T17:38:15.744281] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T17:38:15.958082] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-14T17:38:16.758167] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-14T17:38:17.201051] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T17:38:17.272572] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T17:38:17.558113] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-14T17:38:18.008226] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-14T17:38:18.358094] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-14T17:38:19.002259] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T17:38:19.158068] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-14T17:38:19.958069] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-14T17:38:20.652819] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T17:38:20.758032] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-14T17:38:20.785815] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T17:38:21.252628] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T17:38:21.558063] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-14T17:38:22.264927] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T17:38:22.358074] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-14T17:38:22.792273] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T17:38:23.158067] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-14T17:38:23.689959] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-14T17:38:23.958074] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-14T17:38:24.400022] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T17:38:24.758089] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-14T17:38:25.558096] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-14T17:38:26.017905] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T17:38:26.365953] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-14T17:38:26.371368] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T17:38:26.915113] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T17:38:27.158053] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-14T17:38:27.652220] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-14T17:38:27.958087] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-14T17:38:28.383008] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T17:38:28.758136] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-14T17:38:29.293927] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T17:38:29.558056] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-14T17:38:29.989001] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T17:38:30.358065] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-14T17:38:31.158149] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-14T17:38:31.580571] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-14T17:38:31.958042] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-14T17:38:32.069585] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T17:38:32.509280] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T17:38:32.510152] [INFO ] [REMOTE ] BIPI: Full fetch complete (4856 records). [2025-10-14T17:38:32.510291] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-14T17:38:32.763304] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-14T17:38:32.861739] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-14T17:38:32.861807] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-14T17:38:32.861949] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-14T17:38:32.861987] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-14T17:38:32.862322] [DEBUG] [LOCAL ] BIPI: Trimmed 4856 records to 3072 (keeping 200 days of data) [2025-10-14T17:38:32.880591] [DEBUG] [LOCAL ] BIPI: Primary data saved (3072 records). [2025-10-14T17:38:32.880675] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-14T17:38:32.880784] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 27.3s. Estimated remaining: 4h 45m 59s. Rate: 7.3 symbols/min [2025-10-14T17:38:33.047404] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:33.076004] [DEBUG] [LOCAL ] BIT: Loaded 23487 existing records from primary storage. [2025-10-14T17:38:33.076886] [INFO ] [MAIN ] BIT: Loaded 23487 existing records. [2025-10-14T17:38:33.253880] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:33.254118] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-14T17:38:33.254174] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-14T17:38:33.255001] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-14T17:38:33.255082] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-14T17:38:33.369080] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T17:38:33.572283] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-14T17:38:33.613142] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:34.108416] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T17:38:34.358087] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-14T17:38:34.919345] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T17:38:35.158039] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-14T17:38:35.958158] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-14T17:38:36.468712] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T17:38:36.469547] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4381 records). [2025-10-14T17:38:36.469613] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-14T17:38:36.763227] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-14T17:38:36.855445] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-14T17:38:36.855572] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-14T17:38:36.855860] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-14T17:38:36.855977] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-14T17:38:36.856616] [DEBUG] [LOCAL ] BIPJ: Trimmed 4381 records to 3176 (keeping 200 days of data) [2025-10-14T17:38:36.908300] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T17:38:36.926430] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3176 records). [2025-10-14T17:38:36.926668] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-14T17:38:36.926799] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIPJ took 31.4s. Estimated remaining: 4h 45m 20s. Rate: 7.3 symbols/min [2025-10-14T17:38:37.129212] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:37.189794] [DEBUG] [LOCAL ] BJ: Loaded 51584 existing records from primary storage. [2025-10-14T17:38:37.190230] [INFO ] [MAIN ] BJ: Loaded 51584 existing records. [2025-10-14T17:38:37.380623] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:37.380952] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-14T17:38:37.381005] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-14T17:38:37.381450] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-14T17:38:37.381509] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-14T17:38:37.563472] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-14T17:38:37.765122] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:37.987556] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T17:38:37.988392] [INFO ] [REMOTE ] BIPH: Full fetch complete (4117 records). [2025-10-14T17:38:37.988459] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-14T17:38:38.340096] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-14T17:38:38.340166] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-14T17:38:38.340301] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-14T17:38:38.340338] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-14T17:38:38.340850] [DEBUG] [LOCAL ] BIPH: Trimmed 4117 records to 2528 (keeping 200 days of data) [2025-10-14T17:38:38.360111] [DEBUG] [LOCAL ] BIPH: Primary data saved (2528 records). [2025-10-14T17:38:38.360277] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-14T17:38:38.360492] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPH took 32.8s. Estimated remaining: 4h 44m 22s. Rate: 7.3 symbols/min [2025-10-14T17:38:38.360174] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-14T17:38:38.530748] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:38.587897] [DEBUG] [LOCAL ] BK: Loaded 53535 existing records from primary storage. [2025-10-14T17:38:38.588256] [INFO ] [MAIN ] BK: Loaded 53535 existing records. [2025-10-14T17:38:38.762068] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:38.762313] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-14T17:38:38.762365] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-14T17:38:38.763263] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-14T17:38:38.763320] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-14T17:38:39.106116] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:39.158023] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-14T17:38:39.958187] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-14T17:38:40.356287] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T17:38:40.758122] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-14T17:38:41.020873] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T17:38:41.558043] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-14T17:38:41.765142] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T17:38:42.174456] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T17:38:42.180388] [INFO ] [REMOTE ] BIRK: Full fetch complete (73208 records). [2025-10-14T17:38:42.180489] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-14T17:38:42.296200] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (5.53 seconds). [2025-10-14T17:38:42.358928] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-14T17:38:42.596072] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-14T17:38:42.596149] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-14T17:38:42.596922] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-14T17:38:42.596983] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-14T17:38:42.598417] [DEBUG] [LOCAL ] BIRK: Trimmed 73208 records to 51059 (keeping 200 days of data) [2025-10-14T17:38:42.896129] [DEBUG] [LOCAL ] BIRK: Primary data saved (51059 records). [2025-10-14T17:38:42.896305] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-14T17:38:42.896566] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 37.4s. Estimated remaining: 4h 43m 47s. Rate: 7.3 symbols/min [2025-10-14T17:38:43.072392] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:38:43.109412] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T17:38:43.150449] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T17:38:43.169760] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-14T17:38:43.173024] [DEBUG] [LOCAL ] BKD: Loaded 50414 existing records from primary storage. [2025-10-14T17:38:43.173366] [INFO ] [MAIN ] BKD: Loaded 50414 existing records. [2025-10-14T17:38:43.350832] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:38:43.351076] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-14T17:38:43.351122] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-14T17:38:43.352061] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-14T17:38:43.352117] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-14T17:38:43.698508] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:38:43.958075] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-14T17:38:44.239738] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T17:38:44.758108] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-14T17:38:45.558036] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-14T17:38:45.714216] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T17:38:46.115059] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T17:38:46.358137] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-14T17:38:46.904031] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T17:38:47.158065] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-14T17:38:47.958036] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-14T17:38:48.128597] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T17:38:48.310725] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T17:38:48.758113] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-14T17:38:49.132192] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T17:38:49.558114] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-14T17:38:50.359217] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-14T17:38:50.359159] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T17:38:50.639986] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T17:38:51.158113] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-14T17:38:51.866696] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T17:38:51.958044] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-14T17:38:52.754246] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T17:38:52.763621] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-14T17:38:53.558085] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-14T17:38:53.769280] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T17:38:54.204090] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:38:54.358058] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-14T17:38:55.157348] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T17:38:55.167258] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-14T17:38:55.862616] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T17:38:55.958078] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-14T17:38:56.111669] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T17:38:56.758057] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-14T17:38:57.538399] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T17:38:57.558024] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-14T17:38:58.117505] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T17:38:58.358107] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-14T17:38:59.158073] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-14T17:38:59.407798] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T17:38:59.958125] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-14T17:39:00.246833] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T17:39:00.460718] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T17:39:00.758078] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-14T17:39:00.795921] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T17:39:01.558082] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-14T17:39:02.358077] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-14T17:39:02.712765] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T17:39:03.107202] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T17:39:03.158101] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-14T17:39:03.374892] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T17:39:03.958121] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-14T17:39:04.713873] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T17:39:04.758081] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-14T17:39:05.152684] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T17:39:05.558062] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-14T17:39:06.358146] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-14T17:39:06.426697] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T17:39:07.158094] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-14T17:39:07.811393] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-14T17:39:07.958121] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-14T17:39:08.137371] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T17:39:08.420712] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T17:39:08.758101] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-14T17:39:09.558052] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-14T17:39:09.770454] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T17:39:09.776373] [INFO ] [REMOTE ] BK: Full fetch complete (77653 records). [2025-10-14T17:39:09.776494] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-14T17:39:10.173887] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-14T17:39:10.173991] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-14T17:39:10.174853] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-14T17:39:10.174951] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-14T17:39:10.176823] [DEBUG] [LOCAL ] BK: Trimmed 77653 records to 53536 (keeping 200 days of data) [2025-10-14T17:39:10.205305] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T17:39:10.392881] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-14T17:39:10.546897] [DEBUG] [LOCAL ] BK: Primary data saved (53536 records). [2025-10-14T17:39:10.547029] [INFO ] [MAIN ] BK: Full history saved. [2025-10-14T17:39:10.547731] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BK took 32.2s. Estimated remaining: 4h 46m 1s. Rate: 7.3 symbols/min [2025-10-14T17:39:10.726115] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:10.761142] [DEBUG] [LOCAL ] BKE: Loaded 33944 existing records from primary storage. [2025-10-14T17:39:10.761408] [INFO ] [MAIN ] BKE: Loaded 33944 existing records. [2025-10-14T17:39:10.946409] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:10.946692] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-14T17:39:10.946752] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-14T17:39:10.947120] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-14T17:39:10.947179] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-14T17:39:11.163170] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-14T17:39:11.342900] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:11.371980] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T17:39:11.958058] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-14T17:39:12.049908] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T17:39:12.683767] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:39:12.758048] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-14T17:39:13.558048] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-14T17:39:13.674048] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T17:39:13.680092] [INFO ] [REMOTE ] BJ: Full fetch complete (74287 records). [2025-10-14T17:39:13.680211] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-14T17:39:14.068198] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-14T17:39:14.068282] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-14T17:39:14.069065] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-14T17:39:14.069126] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-14T17:39:14.070637] [DEBUG] [LOCAL ] BJ: Trimmed 74287 records to 51583 (keeping 200 days of data) [2025-10-14T17:39:14.360552] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-14T17:39:14.380431] [DEBUG] [LOCAL ] BJ: Primary data saved (51583 records). [2025-10-14T17:39:14.380537] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-14T17:39:14.380609] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BJ took 37.5s. Estimated remaining: 4h 45m 21s. Rate: 7.3 symbols/min [2025-10-14T17:39:14.499920] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T17:39:14.557151] [INFO ] [REMOTE ] BIT: Full fetch complete (31950 records). [2025-10-14T17:39:14.584599] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:14.584832] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-14T17:39:14.858603] [DEBUG] [LOCAL ] BKH: Loaded 36967 existing records from primary storage. [2025-10-14T17:39:14.884914] [INFO ] [MAIN ] BKH: Loaded 36967 existing records. [2025-10-14T17:39:14.914283] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T17:39:15.167854] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-14T17:39:15.199799] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-14T17:39:15.218799] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-14T17:39:15.221679] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:15.222586] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-14T17:39:15.223143] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-14T17:39:15.222680] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-14T17:39:15.223279] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-14T17:39:15.224202] [DEBUG] [LOCAL ] BIT: Trimmed 31950 records to 23575 (keeping 200 days of data) [2025-10-14T17:39:15.224249] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-14T17:39:15.224577] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-14T17:39:15.705573] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:15.750213] [DEBUG] [LOCAL ] BIT: Primary data saved (23575 records). [2025-10-14T17:39:15.750400] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-14T17:39:15.750503] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BIT took 42.9s. Estimated remaining: 4h 44m 23s. Rate: 7.3 symbols/min [2025-10-14T17:39:15.934413] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:15.958175] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-14T17:39:15.977369] [DEBUG] [LOCAL ] BKKT: Loaded 36153 existing records from primary storage. [2025-10-14T17:39:15.977804] [INFO ] [MAIN ] BKKT: Loaded 36153 existing records. [2025-10-14T17:39:16.194319] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:16.197761] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T17:39:16.198004] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-14T17:39:16.204889] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-14T17:39:16.205675] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-14T17:39:16.206270] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-14T17:39:16.245580] [INFO ] [REMOTE ] BKD: Full fetch complete (72004 records). [2025-10-14T17:39:16.291283] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-14T17:39:16.843206] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:16.890618] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-14T17:39:16.915374] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T17:39:17.016193] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-14T17:39:17.016274] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-14T17:39:17.016996] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-14T17:39:17.017058] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-14T17:39:17.018553] [DEBUG] [LOCAL ] BKD: Trimmed 72004 records to 50449 (keeping 200 days of data) [2025-10-14T17:39:17.303877] [DEBUG] [LOCAL ] BKD: Primary data saved (50449 records). [2025-10-14T17:39:17.304001] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-14T17:39:17.304077] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKD took 34.4s. Estimated remaining: 4h 43m 27s. Rate: 7.3 symbols/min [2025-10-14T17:39:17.488168] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:17.500541] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T17:39:17.515501] [DEBUG] [LOCAL ] BKN: Loaded 7347 existing records from primary storage. [2025-10-14T17:39:17.515715] [INFO ] [MAIN ] BKN: Loaded 7347 existing records. [2025-10-14T17:39:17.563254] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-14T17:39:17.700101] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:17.700318] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-14T17:39:17.700367] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-14T17:39:17.700547] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-14T17:39:17.700588] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-14T17:39:18.056184] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:18.358080] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-14T17:39:18.533905] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T17:39:19.096040] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T17:39:19.158042] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-14T17:39:19.810454] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T17:39:19.958063] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-14T17:39:20.709732] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T17:39:20.758020] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-14T17:39:21.122233] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T17:39:21.558077] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-14T17:39:22.184436] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T17:39:22.358168] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-14T17:39:22.996727] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T17:39:23.158156] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-14T17:39:23.499691] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T17:39:23.958118] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-14T17:39:23.972297] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T17:39:24.758073] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-14T17:39:25.546453] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T17:39:25.558027] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-14T17:39:26.170124] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T17:39:26.358069] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-14T17:39:26.928398] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T17:39:27.158088] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-14T17:39:27.958057] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-14T17:39:28.758040] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-14T17:39:28.838170] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T17:39:29.059476] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-14T17:39:29.558055] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-14T17:39:30.358084] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-14T17:39:30.840691] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-14T17:39:30.887405] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-14T17:39:30.977163] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T17:39:31.158049] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-14T17:39:31.178153] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T17:39:31.958058] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-14T17:39:32.429422] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T17:39:32.758057] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-14T17:39:33.313444] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T17:39:33.558077] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-14T17:39:34.089285] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T17:39:34.358223] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-14T17:39:34.361198] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T17:39:35.158138] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-14T17:39:35.744173] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T17:39:35.914013] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T17:39:35.958045] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-14T17:39:36.758065] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-14T17:39:37.525145] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T17:39:37.558036] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-14T17:39:38.051721] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T17:39:38.128145] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T17:39:38.358051] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-14T17:39:39.158062] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-14T17:39:39.815917] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T17:39:39.825343] [INFO ] [REMOTE ] BKE: Full fetch complete (50344 records). [2025-10-14T17:39:39.825611] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T17:39:39.827668] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-14T17:39:39.963212] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-14T17:39:40.222961] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-14T17:39:40.223044] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-14T17:39:40.223750] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-14T17:39:40.223812] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-14T17:39:40.224963] [DEBUG] [LOCAL ] BKE: Trimmed 50344 records to 33992 (keeping 200 days of data) [2025-10-14T17:39:40.433964] [DEBUG] [LOCAL ] BKE: Primary data saved (33992 records). [2025-10-14T17:39:40.434103] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-14T17:39:40.434689] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKE took 29.9s. Estimated remaining: 4h 45m 6s. Rate: 7.3 symbols/min [2025-10-14T17:39:40.543848] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T17:39:40.613551] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:40.658045] [DEBUG] [LOCAL ] BKSY: Loaded 48596 existing records from primary storage. [2025-10-14T17:39:40.658384] [INFO ] [MAIN ] BKSY: Loaded 48596 existing records. [2025-10-14T17:39:40.758152] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-14T17:39:40.837753] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:40.837915] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-14T17:39:40.838000] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-14T17:39:40.838882] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-14T17:39:40.838939] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-14T17:39:41.217154] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:41.237329] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-14T17:39:41.558083] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-14T17:39:42.333344] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T17:39:42.358044] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-14T17:39:43.158052] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-14T17:39:43.963148] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-14T17:39:43.978259] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T17:39:44.758044] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-14T17:39:44.895247] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T17:39:44.907837] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-14T17:39:44.908960] [INFO ] [REMOTE ] BKN: Full fetch complete (11462 records). [2025-10-14T17:39:44.909027] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-14T17:39:45.274833] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-14T17:39:45.274941] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-14T17:39:45.275228] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-14T17:39:45.275268] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-14T17:39:45.275724] [DEBUG] [LOCAL ] BKN: Trimmed 11462 records to 7362 (keeping 200 days of data) [2025-10-14T17:39:45.319752] [DEBUG] [LOCAL ] BKN: Primary data saved (7362 records). [2025-10-14T17:39:45.319858] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-14T17:39:45.319931] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKN took 28.0s. Estimated remaining: 4h 44m 34s. Rate: 7.3 symbols/min [2025-10-14T17:39:45.486902] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:45.501103] [DEBUG] [LOCAL ] BKT: Loaded 12267 existing records from primary storage. [2025-10-14T17:39:45.501310] [INFO ] [MAIN ] BKT: Loaded 12267 existing records. [2025-10-14T17:39:45.564535] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-14T17:39:45.681207] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:45.681473] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-14T17:39:45.681520] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-14T17:39:45.681839] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-14T17:39:45.681897] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-14T17:39:46.034757] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:46.358074] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-14T17:39:46.701311] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T17:39:46.929290] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T17:39:47.158085] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-14T17:39:47.958131] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-14T17:39:48.077335] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T17:39:48.162958] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T17:39:48.758058] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-14T17:39:49.541628] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T17:39:49.558023] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-14T17:39:49.742122] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T17:39:49.746202] [INFO ] [REMOTE ] BKH: Full fetch complete (52567 records). [2025-10-14T17:39:49.746280] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-14T17:39:50.129091] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-14T17:39:50.129218] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-14T17:39:50.129862] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-14T17:39:50.129922] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-14T17:39:50.130946] [DEBUG] [LOCAL ] BKH: Trimmed 52567 records to 37028 (keeping 200 days of data) [2025-10-14T17:39:50.346168] [DEBUG] [LOCAL ] BKH: Primary data saved (37028 records). [2025-10-14T17:39:50.346306] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-14T17:39:50.346388] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKH took 36.0s. Estimated remaining: 4h 44m 3s. Rate: 7.3 symbols/min [2025-10-14T17:39:50.367685] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-14T17:39:50.518279] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:50.555012] [DEBUG] [LOCAL ] BKU: Loaded 41954 existing records from primary storage. [2025-10-14T17:39:50.555373] [INFO ] [MAIN ] BKU: Loaded 41954 existing records. [2025-10-14T17:39:50.732073] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:50.732262] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-14T17:39:50.732310] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-14T17:39:50.732558] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-14T17:39:50.732615] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-14T17:39:51.102760] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:51.158028] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-14T17:39:51.320094] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T17:39:51.543993] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T17:39:51.958037] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-14T17:39:52.282116] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T17:39:52.758111] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-14T17:39:53.558085] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-14T17:39:53.704269] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T17:39:53.819973] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T17:39:54.358097] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-14T17:39:55.129077] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T17:39:55.158053] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-14T17:39:55.795550] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-14T17:39:55.801268] [INFO ] [REMOTE ] BKKT: Full fetch complete (51222 records). [2025-10-14T17:39:55.801362] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-14T17:39:55.970992] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-14T17:39:56.205622] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-14T17:39:56.205732] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-14T17:39:56.206372] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-14T17:39:56.206433] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-14T17:39:56.207511] [DEBUG] [LOCAL ] BKKT: Trimmed 51222 records to 36403 (keeping 200 days of data) [2025-10-14T17:39:56.413745] [DEBUG] [LOCAL ] BKKT: Primary data saved (36403 records). [2025-10-14T17:39:56.413878] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-14T17:39:56.413952] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKKT took 40.7s. Estimated remaining: 4h 43m 40s. Rate: 7.3 symbols/min [2025-10-14T17:39:56.585132] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:39:56.595869] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T17:39:56.622356] [DEBUG] [LOCAL ] BKV: Loaded 29753 existing records from primary storage. [2025-10-14T17:39:56.622635] [INFO ] [MAIN ] BKV: Loaded 29753 existing records. [2025-10-14T17:39:56.762986] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-14T17:39:56.804078] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:39:56.804459] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-14T17:39:56.804540] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-14T17:39:56.804943] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-14T17:39:56.805123] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-14T17:39:57.003335] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T17:39:57.208923] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:39:57.558039] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-14T17:39:57.618485] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T17:39:58.358071] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-14T17:39:59.158079] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-14T17:39:59.199281] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T17:39:59.749858] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T17:39:59.958097] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-14T17:40:00.190980] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T17:40:00.758088] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-14T17:40:01.558112] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-14T17:40:01.723122] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T17:40:01.757785] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T17:40:02.358176] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-14T17:40:02.938507] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T17:40:03.070777] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T17:40:03.158096] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-14T17:40:03.958129] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-14T17:40:04.758057] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-14T17:40:04.885490] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T17:40:05.232105] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T17:40:05.558070] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-14T17:40:05.899968] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-14T17:40:06.074743] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-14T17:40:06.358079] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-14T17:40:07.158103] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-14T17:40:07.948539] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T17:40:07.958263] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-14T17:40:08.312416] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T17:40:08.758075] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-14T17:40:09.441535] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T17:40:09.442802] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T17:40:09.558109] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-14T17:40:10.358103] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-14T17:40:11.131207] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T17:40:11.158034] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-14T17:40:11.184114] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T17:40:11.958071] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-14T17:40:12.584911] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T17:40:12.758078] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-14T17:40:13.206584] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:40:13.558105] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-14T17:40:14.004089] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T17:40:14.358128] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-14T17:40:15.158266] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-14T17:40:15.392167] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T17:40:15.958057] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-14T17:40:16.014663] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-14T17:40:16.758064] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-14T17:40:17.443891] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T17:40:17.558117] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-14T17:40:18.046434] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T17:40:18.049795] [INFO ] [REMOTE ] BKT: Full fetch complete (16189 records). [2025-10-14T17:40:18.049891] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-14T17:40:18.369484] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-14T17:40:18.466056] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-14T17:40:18.466192] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-14T17:40:18.466730] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-14T17:40:18.466816] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-14T17:40:18.486700] [DEBUG] [LOCAL ] BKT: Trimmed 16189 records to 12331 (keeping 200 days of data) [2025-10-14T17:40:18.487345] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (3.33 seconds). [2025-10-14T17:40:18.494611] [INFO ] [REMOTE ] BKU: Full fetch complete (60540 records). [2025-10-14T17:40:18.494842] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-14T17:40:18.901802] [DEBUG] [LOCAL ] BKT: Primary data saved (12331 records). [2025-10-14T17:40:18.907872] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-14T17:40:18.918605] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKT took 33.6s. Estimated remaining: 4h 45m 13s. Rate: 7.3 symbols/min [2025-10-14T17:40:19.102238] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-14T17:40:19.102377] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-14T17:40:19.103450] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-14T17:40:19.136348] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-14T17:40:19.201634] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T17:40:19.206465] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:19.215925] [DEBUG] [LOCAL ] BKU: Trimmed 60540 records to 42065 (keeping 200 days of data) [2025-10-14T17:40:19.217620] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-14T17:40:19.451945] [DEBUG] [LOCAL ] BLCO: Loaded 35532 existing records from primary storage. [2025-10-14T17:40:19.456101] [INFO ] [MAIN ] BLCO: Loaded 35532 existing records. [2025-10-14T17:40:19.643829] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:40:19.646322] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-14T17:40:19.646401] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-14T17:40:19.647824] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-14T17:40:19.648896] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-14T17:40:19.803775] [DEBUG] [LOCAL ] BKU: Primary data saved (42065 records). [2025-10-14T17:40:19.851472] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-14T17:40:19.876379] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKU took 29.5s. Estimated remaining: 4h 44m 13s. Rate: 7.3 symbols/min [2025-10-14T17:40:20.168417] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:20.231598] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:20.232094] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-14T17:40:20.257400] [DEBUG] [LOCAL ] BLD: Loaded 27619 existing records from primary storage. [2025-10-14T17:40:20.257690] [INFO ] [MAIN ] BLD: Loaded 27619 existing records. [2025-10-14T17:40:20.461220] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:40:20.477122] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-14T17:40:20.477317] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-14T17:40:20.480315] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-14T17:40:20.480090] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T17:40:20.480497] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-14T17:40:20.633258] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T17:40:20.763153] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-14T17:40:20.874906] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:21.558070] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-14T17:40:21.691259] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T17:40:21.768319] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T17:40:22.358066] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-14T17:40:23.158036] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-14T17:40:23.207336] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T17:40:23.345761] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T17:40:23.940210] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T17:40:23.958023] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-14T17:40:24.758096] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-14T17:40:25.200802] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T17:40:25.558069] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-14T17:40:25.647807] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T17:40:26.358106] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-14T17:40:26.542760] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T17:40:27.158118] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-14T17:40:27.741149] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T17:40:27.958084] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-14T17:40:28.758112] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-14T17:40:29.292543] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T17:40:29.332630] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T17:40:29.336438] [INFO ] [REMOTE ] BKV: Full fetch complete (44967 records). [2025-10-14T17:40:29.336533] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-14T17:40:29.563353] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-14T17:40:29.733983] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-14T17:40:29.734065] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-14T17:40:29.734711] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-14T17:40:29.734776] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-14T17:40:29.735773] [DEBUG] [LOCAL ] BKV: Trimmed 44967 records to 29704 (keeping 200 days of data) [2025-10-14T17:40:29.904000] [DEBUG] [LOCAL ] BKV: Primary data saved (29704 records). [2025-10-14T17:40:29.904125] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-14T17:40:29.904200] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKV took 33.5s. Estimated remaining: 4h 44m 18s. Rate: 7.3 symbols/min [2025-10-14T17:40:30.086015] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:30.109479] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T17:40:30.161612] [DEBUG] [LOCAL ] BLDR: Loaded 51810 existing records from primary storage. [2025-10-14T17:40:30.161993] [INFO ] [MAIN ] BLDR: Loaded 51810 existing records. [2025-10-14T17:40:30.344022] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:40:30.344347] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-14T17:40:30.344412] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-14T17:40:30.345404] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-14T17:40:30.345475] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-14T17:40:30.366386] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-14T17:40:30.727985] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:30.749839] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T17:40:31.158119] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-14T17:40:31.963227] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-14T17:40:31.976539] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T17:40:32.106216] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-14T17:40:32.758066] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-14T17:40:33.558051] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-14T17:40:33.736155] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T17:40:33.791492] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T17:40:34.358105] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-14T17:40:35.158097] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-14T17:40:35.711868] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-14T17:40:35.718309] [INFO ] [REMOTE ] BKSY: Full fetch complete (70269 records). [2025-10-14T17:40:35.718447] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-14T17:40:35.962734] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-14T17:40:36.134109] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-14T17:40:36.134237] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-14T17:40:36.135147] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-14T17:40:36.135252] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-14T17:40:36.165484] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T17:40:36.175964] [DEBUG] [LOCAL ] BKSY: Trimmed 70269 records to 48676 (keeping 200 days of data) [2025-10-14T17:40:36.491224] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T17:40:36.511634] [DEBUG] [LOCAL ] BKSY: Primary data saved (48676 records). [2025-10-14T17:40:36.511760] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-14T17:40:36.511855] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BKSY took 56.1s. Estimated remaining: 4h 43m 58s. Rate: 7.3 symbols/min [2025-10-14T17:40:36.676433] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:36.676568] [DEBUG] [LOCAL ] BLE: No existing data file found in primary storage. [2025-10-14T17:40:36.676604] [WARN ] [MAIN ] BLE: No existing data found, performing full refresh instead. [2025-10-14T17:40:36.676732] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-14T17:40:36.676774] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-14T17:40:36.676815] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-10-14T17:40:36.676846] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-14T17:40:36.764411] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-14T17:40:37.086129] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:37.189078] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T17:40:37.558075] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-14T17:40:38.304002] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T17:40:38.358068] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-14T17:40:38.513852] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T17:40:38.875556] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-14T17:40:39.158043] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-14T17:40:39.938022] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T17:40:39.958028] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-14T17:40:40.758098] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-14T17:40:40.896937] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T17:40:41.558091] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-14T17:40:42.016107] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T17:40:42.358069] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-14T17:40:42.629325] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T17:40:43.158059] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-14T17:40:43.833554] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T17:40:43.899780] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T17:40:43.958029] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-14T17:40:44.758044] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-14T17:40:44.986328] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T17:40:45.558063] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-14T17:40:46.135679] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T17:40:46.358041] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-14T17:40:46.641942] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T17:40:47.158089] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-14T17:40:47.461109] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T17:40:47.958119] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-14T17:40:47.986126] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T17:40:48.758082] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-14T17:40:48.897135] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T17:40:49.558072] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-14T17:40:50.270955] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T17:40:50.358048] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-14T17:40:50.485221] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T17:40:51.158110] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-14T17:40:51.698131] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T17:40:51.958085] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-14T17:40:52.711639] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T17:40:52.758037] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-14T17:40:53.211847] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T17:40:53.558057] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-14T17:40:54.358082] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-14T17:40:54.418383] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T17:40:54.485780] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T17:40:54.931990] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T17:40:54.933854] [INFO ] [REMOTE ] BLE: Full fetch complete (19995 records). [2025-10-14T17:40:54.933931] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-14T17:40:55.163180] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-14T17:40:55.301008] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-14T17:40:55.301086] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-14T17:40:55.301536] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-14T17:40:55.301576] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-14T17:40:55.302198] [DEBUG] [LOCAL ] BLE: Trimmed 19995 records to 13853 (keeping 200 days of data) [2025-10-14T17:40:55.383337] [DEBUG] [LOCAL ] BLE: Primary data saved (13853 records). [2025-10-14T17:40:55.383466] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-14T17:40:55.383534] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLE took 18.9s. Estimated remaining: 4h 45m 4s. Rate: 7.3 symbols/min [2025-10-14T17:40:55.554954] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:55.589972] [DEBUG] [LOCAL ] BLK: Loaded 34143 existing records from primary storage. [2025-10-14T17:40:55.590243] [INFO ] [MAIN ] BLK: Loaded 34143 existing records. [2025-10-14T17:40:55.766740] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:40:55.766958] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-14T17:40:55.767003] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-14T17:40:55.767260] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-14T17:40:55.767316] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-14T17:40:55.963317] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-14T17:40:56.116189] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:56.652405] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T17:40:56.656479] [INFO ] [REMOTE ] BLCO: Full fetch complete (52312 records). [2025-10-14T17:40:56.656579] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-14T17:40:56.763213] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-14T17:40:57.035407] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-14T17:40:57.035484] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-14T17:40:57.036099] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-14T17:40:57.036158] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-14T17:40:57.037170] [DEBUG] [LOCAL ] BLCO: Trimmed 52312 records to 35353 (keeping 200 days of data) [2025-10-14T17:40:57.235295] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T17:40:57.241118] [INFO ] [REMOTE ] BLD: Full fetch complete (40001 records). [2025-10-14T17:40:57.241749] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-14T17:40:57.433551] [DEBUG] [LOCAL ] BLCO: Primary data saved (35353 records). [2025-10-14T17:40:57.450239] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-14T17:40:57.508858] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLCO took 38.6s. Estimated remaining: 4h 44m 13s. Rate: 7.3 symbols/min [2025-10-14T17:40:57.581308] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-14T17:40:57.793016] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-14T17:40:57.802161] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-14T17:40:57.808597] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-14T17:40:57.811304] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:57.811435] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-14T17:40:57.813756] [DEBUG] [LOCAL ] BLD: Trimmed 40001 records to 27592 (keeping 200 days of data) [2025-10-14T17:40:58.014061] [DEBUG] [LOCAL ] BLND: Loaded 49275 existing records from primary storage. [2025-10-14T17:40:58.015445] [INFO ] [MAIN ] BLND: Loaded 49275 existing records. [2025-10-14T17:40:58.124237] [DEBUG] [LOCAL ] BLD: Primary data saved (27592 records). [2025-10-14T17:40:58.124733] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-14T17:40:58.135390] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLD took 38.2s. Estimated remaining: 4h 43m 12s. Rate: 7.3 symbols/min [2025-10-14T17:40:58.307840] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:40:58.313985] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-14T17:40:58.319192] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-14T17:40:58.330672] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-14T17:40:58.348184] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-14T17:40:58.438072] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:58.458817] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-14T17:40:58.464009] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-14T17:40:58.464164] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-14T17:40:58.475133] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-14T17:40:58.485577] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-14T17:40:58.496398] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-14T17:40:59.060709] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:59.112603] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-14T17:40:59.115538] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:40:59.156883] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-14T17:40:59.168208] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-14T17:40:59.193568] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T17:40:59.346343] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:40:59.346602] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-14T17:40:59.346727] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:40:59.346778] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-14T17:40:59.346810] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:40:59.346874] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-14T17:40:59.346935] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-14T17:40:59.346970] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-14T17:40:59.347008] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-14T17:40:59.347053] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLSH took 1.2s. Estimated remaining: 4h 42m 16s. Rate: 7.3 symbols/min [2025-10-14T17:40:59.528940] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:40:59.544816] [DEBUG] [LOCAL ] BLW: Loaded 13268 existing records from primary storage. [2025-10-14T17:40:59.545041] [INFO ] [MAIN ] BLW: Loaded 13268 existing records. [2025-10-14T17:40:59.749492] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:40:59.749726] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-14T17:40:59.749784] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-14T17:40:59.750063] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-14T17:40:59.750136] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-14T17:40:59.963274] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-14T17:41:00.150262] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:00.758052] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-14T17:41:00.841115] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:41:01.423966] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T17:41:01.558063] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-14T17:41:02.358137] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-14T17:41:02.575190] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T17:41:02.893037] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:41:03.158103] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-14T17:41:03.913347] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T17:41:03.958026] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-14T17:41:04.218454] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T17:41:04.758073] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-14T17:41:05.558069] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-14T17:41:05.807050] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T17:41:05.883434] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T17:41:06.109733] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T17:41:06.358034] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-14T17:41:07.158100] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-14T17:41:07.312771] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T17:41:07.958117] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-14T17:41:08.499835] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T17:41:08.758096] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-14T17:41:09.558056] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-14T17:41:09.789233] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T17:41:10.020748] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T17:41:10.358071] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-14T17:41:11.078316] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T17:41:11.158070] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-14T17:41:11.958080] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-14T17:41:12.324122] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-14T17:41:12.483321] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T17:41:12.614039] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T17:41:12.758103] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-14T17:41:13.558046] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-14T17:41:14.352526] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T17:41:14.361815] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-14T17:41:15.158079] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-14T17:41:15.267919] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T17:41:15.273834] [INFO ] [REMOTE ] BLDR: Full fetch complete (74703 records). [2025-10-14T17:41:15.273976] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-14T17:41:15.661881] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-14T17:41:15.661999] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-14T17:41:15.662953] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-14T17:41:15.663123] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-14T17:41:15.664577] [DEBUG] [LOCAL ] BLDR: Trimmed 74703 records to 51879 (keeping 200 days of data) [2025-10-14T17:41:15.929326] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T17:41:15.930674] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T17:41:15.984044] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-14T17:41:16.033069] [DEBUG] [LOCAL ] BLDR: Primary data saved (51879 records). [2025-10-14T17:41:16.033268] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-14T17:41:16.033395] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLDR took 46.1s. Estimated remaining: 4h 43m 6s. Rate: 7.3 symbols/min [2025-10-14T17:41:16.221066] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:41:16.237355] [DEBUG] [LOCAL ] BLX: Loaded 15613 existing records from primary storage. [2025-10-14T17:41:16.237596] [INFO ] [MAIN ] BLX: Loaded 15613 existing records. [2025-10-14T17:41:16.412760] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:41:16.412945] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-14T17:41:16.412989] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-14T17:41:16.413191] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-14T17:41:16.413245] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-14T17:41:16.765701] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-14T17:41:16.776182] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:16.805582] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T17:41:17.558065] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-14T17:41:18.251422] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T17:41:18.269737] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T17:41:18.358066] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-14T17:41:19.158082] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-14T17:41:19.958104] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-14T17:41:20.080074] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T17:41:20.161295] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T17:41:20.758108] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-14T17:41:21.355209] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T17:41:21.491912] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T17:41:21.558066] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-14T17:41:22.358094] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-14T17:41:22.560972] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T17:41:23.158149] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-14T17:41:23.918823] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T17:41:23.933773] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T17:41:23.958028] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-14T17:41:24.459089] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T17:41:24.758066] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-14T17:41:25.558079] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-14T17:41:26.296582] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T17:41:26.358044] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-14T17:41:26.466829] [DEBUG] [REMOTE ] BLX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-14T17:41:26.467303] [WARN ] [REMOTE ] BLX: No data returned for month 2025-04 [2025-10-14T17:41:26.467405] [FATAL] [REMOTE ] BLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:41:26.467508] [FATAL] [MAIN ] BLX: Failed to fetch primary data. [2025-10-14T17:41:26.467573] [WARN ] [MAIN ] BLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:41:26.467675] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-14T17:41:26.467764] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-10-14T17:41:26.467803] [INFO ] [LOCAL ] BLX: Starting deletion of derivative data. [2025-10-14T17:41:26.468168] [DEBUG] [LOCAL ] BLX: Deleted derivative data file. [2025-10-14T17:41:26.468272] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLX took 10.4s. Estimated remaining: 4h 43m 13s. Rate: 7.3 symbols/min [2025-10-14T17:41:26.649526] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:41:26.685537] [DEBUG] [LOCAL ] BMA: Loaded 35960 existing records from primary storage. [2025-10-14T17:41:26.685871] [INFO ] [MAIN ] BMA: Loaded 35960 existing records. [2025-10-14T17:41:26.871559] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:41:26.871818] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-14T17:41:26.871865] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-14T17:41:26.872127] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-14T17:41:26.872186] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-14T17:41:27.160966] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-14T17:41:27.253470] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:27.286219] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T17:41:27.958069] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-14T17:41:28.096330] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T17:41:28.758119] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-14T17:41:29.192908] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T17:41:29.558092] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-14T17:41:30.358087] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-14T17:41:30.431403] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T17:41:30.514883] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T17:41:30.517871] [INFO ] [REMOTE ] BLW: Full fetch complete (19296 records). [2025-10-14T17:41:30.518041] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-14T17:41:30.918514] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-14T17:41:30.918608] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-14T17:41:30.919018] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-14T17:41:30.919075] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-14T17:41:30.919919] [DEBUG] [LOCAL ] BLW: Trimmed 19296 records to 13213 (keeping 200 days of data) [2025-10-14T17:41:31.000487] [DEBUG] [LOCAL ] BLW: Primary data saved (13213 records). [2025-10-14T17:41:31.000626] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-14T17:41:31.000771] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLW took 31.7s. Estimated remaining: 4h 42m 40s. Rate: 7.3 symbols/min [2025-10-14T17:41:31.163261] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-14T17:41:31.190965] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:41:31.203874] [DEBUG] [LOCAL ] BME: Loaded 11201 existing records from primary storage. [2025-10-14T17:41:31.204218] [INFO ] [MAIN ] BME: Loaded 11201 existing records. [2025-10-14T17:41:31.389751] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:41:31.389958] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-14T17:41:31.390006] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-14T17:41:31.390212] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-14T17:41:31.390254] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-14T17:41:31.766425] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:31.958105] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-14T17:41:31.985042] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T17:41:32.396125] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T17:41:32.401078] [INFO ] [REMOTE ] BLK: Full fetch complete (52699 records). [2025-10-14T17:41:32.401230] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-14T17:41:32.760570] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-14T17:41:32.820966] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-14T17:41:32.821167] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-14T17:41:32.822206] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-14T17:41:32.822292] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-14T17:41:32.824119] [DEBUG] [LOCAL ] BLK: Trimmed 52699 records to 34255 (keeping 200 days of data) [2025-10-14T17:41:33.067248] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T17:41:33.089428] [DEBUG] [LOCAL ] BLK: Primary data saved (34255 records). [2025-10-14T17:41:33.089675] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-14T17:41:33.090537] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BLK took 37.7s. Estimated remaining: 4h 41m 50s. Rate: 7.3 symbols/min [2025-10-14T17:41:33.278386] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:41:33.278683] [DEBUG] [LOCAL ] BMEZ: No existing data file found in primary storage. [2025-10-14T17:41:33.278741] [WARN ] [MAIN ] BMEZ: No existing data found, performing full refresh instead. [2025-10-14T17:41:33.278871] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-14T17:41:33.278921] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-14T17:41:33.278966] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-14T17:41:33.278999] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-14T17:41:33.563121] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-14T17:41:33.652052] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:34.264687] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T17:41:34.358079] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-14T17:41:35.158041] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-14T17:41:35.292753] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T17:41:35.298834] [INFO ] [REMOTE ] BLND: Full fetch complete (72321 records). [2025-10-14T17:41:35.298971] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-14T17:41:35.699499] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-14T17:41:35.699611] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-14T17:41:35.700490] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-14T17:41:35.700573] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-14T17:41:35.712299] [DEBUG] [LOCAL ] BLND: Trimmed 72321 records to 49272 (keeping 200 days of data) [2025-10-14T17:41:35.720006] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T17:41:35.966378] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-14T17:41:35.999180] [DEBUG] [LOCAL ] BLND: Primary data saved (49272 records). [2025-10-14T17:41:35.999269] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-14T17:41:35.999339] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BLND took 38.5s. Estimated remaining: 4h 41m 6s. Rate: 7.3 symbols/min [2025-10-14T17:41:36.170594] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:41:36.194636] [DEBUG] [LOCAL ] BMI: Loaded 24442 existing records from primary storage. [2025-10-14T17:41:36.194922] [INFO ] [MAIN ] BMI: Loaded 24442 existing records. [2025-10-14T17:41:36.380222] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:41:36.391862] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-14T17:41:36.398860] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-14T17:41:36.399400] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-14T17:41:36.400092] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T17:41:36.400151] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-14T17:41:36.693910] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T17:41:36.772308] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-14T17:41:36.786232] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:37.558061] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-14T17:41:37.842610] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T17:41:38.358138] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-14T17:41:38.811668] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T17:41:38.868052] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T17:41:39.158129] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-14T17:41:39.958113] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-14T17:41:40.582981] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T17:41:40.596049] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T17:41:40.758049] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-14T17:41:41.558031] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-14T17:41:41.884244] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T17:41:42.188815] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T17:41:42.358035] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-14T17:41:43.158025] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-14T17:41:43.637000] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T17:41:43.958091] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-14T17:41:44.644136] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T17:41:44.758030] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-14T17:41:44.934580] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T17:41:45.558072] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-14T17:41:46.123178] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T17:41:46.354435] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T17:41:46.359331] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-14T17:41:47.158047] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-14T17:41:47.420832] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T17:41:47.958104] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-14T17:41:48.012729] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T17:41:48.758089] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-14T17:41:49.076327] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T17:41:49.558049] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-14T17:41:49.949925] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T17:41:50.358103] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-14T17:41:50.654078] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T17:41:51.127170] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T17:41:51.158030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-14T17:41:51.807818] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T17:41:51.958061] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-14T17:41:52.758044] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-14T17:41:53.310483] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T17:41:53.558035] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-14T17:41:53.669737] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T17:41:54.358083] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-14T17:41:55.158086] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-14T17:41:55.219171] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T17:41:55.692673] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T17:41:55.958057] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-14T17:41:56.355480] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T17:41:56.758051] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-14T17:41:57.000592] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T17:41:57.558078] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-14T17:41:58.312939] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T17:41:58.317871] [INFO ] [REMOTE ] BMA: Full fetch complete (51817 records). [2025-10-14T17:41:58.317989] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-14T17:41:58.363371] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-14T17:41:58.714361] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T17:41:58.736196] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-14T17:41:58.736327] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-14T17:41:58.737355] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-14T17:41:58.737440] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-14T17:41:58.741661] [DEBUG] [LOCAL ] BMA: Trimmed 51817 records to 36025 (keeping 200 days of data) [2025-10-14T17:41:58.962157] [DEBUG] [LOCAL ] BMA: Primary data saved (36025 records). [2025-10-14T17:41:58.962292] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-14T17:41:58.962369] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BMA took 32.5s. Estimated remaining: 4h 42m 38s. Rate: 7.3 symbols/min [2025-10-14T17:41:59.130369] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:41:59.135349] [DEBUG] [LOCAL ] BMN: Loaded 2587 existing records from primary storage. [2025-10-14T17:41:59.135498] [INFO ] [MAIN ] BMN: Loaded 2587 existing records. [2025-10-14T17:41:59.164367] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-14T17:41:59.317035] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:41:59.317291] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-14T17:41:59.317396] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-14T17:41:59.317589] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-14T17:41:59.322826] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-14T17:41:59.395213] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T17:41:59.690078] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:41:59.958046] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-14T17:42:00.170382] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T17:42:00.758044] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-14T17:42:01.566136] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-14T17:42:01.568573] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T17:42:02.211222] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T17:42:02.210280] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T17:42:02.358087] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-14T17:42:03.041425] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T17:42:03.158072] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-14T17:42:03.958076] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-14T17:42:04.216164] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T17:42:04.219453] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40397 records). [2025-10-14T17:42:04.219536] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-14T17:42:04.333450] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-14T17:42:04.598025] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-14T17:42:04.598143] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-14T17:42:04.598746] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-14T17:42:04.598806] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-14T17:42:04.599687] [DEBUG] [LOCAL ] BMEZ: Trimmed 40397 records to 26013 (keeping 200 days of data) [2025-10-14T17:42:04.758920] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-14T17:42:04.762509] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26013 records). [2025-10-14T17:42:04.762573] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-14T17:42:04.762669] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMEZ took 31.7s. Estimated remaining: 4h 42m 13s. Rate: 7.3 symbols/min [2025-10-14T17:42:04.936100] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:04.977098] [DEBUG] [LOCAL ] BMO: Loaded 41112 existing records from primary storage. [2025-10-14T17:42:04.977368] [INFO ] [MAIN ] BMO: Loaded 41112 existing records. [2025-10-14T17:42:05.158552] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:42:05.158802] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-14T17:42:05.158850] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-14T17:42:05.159100] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-14T17:42:05.159157] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-14T17:42:05.536109] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:05.558030] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-14T17:42:05.652944] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T17:42:05.654904] [INFO ] [REMOTE ] BME: Full fetch complete (15956 records). [2025-10-14T17:42:05.654983] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-14T17:42:06.021497] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-14T17:42:06.021799] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-14T17:42:06.022152] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-14T17:42:06.022191] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-14T17:42:06.022831] [DEBUG] [LOCAL ] BME: Trimmed 15956 records to 11234 (keeping 200 days of data) [2025-10-14T17:42:06.093471] [DEBUG] [LOCAL ] BME: Primary data saved (11234 records). [2025-10-14T17:42:06.093805] [INFO ] [MAIN ] BME: Full history saved. [2025-10-14T17:42:06.093879] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BME took 35.1s. Estimated remaining: 4h 41m 19s. Rate: 7.3 symbols/min [2025-10-14T17:42:06.268113] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:06.316992] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-14T17:42:06.317292] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-14T17:42:06.363211] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-14T17:42:06.495363] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:42:06.495571] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-14T17:42:06.495617] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-14T17:42:06.496201] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-14T17:42:06.496257] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-14T17:42:06.851515] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:07.161076] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-14T17:42:07.164509] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T17:42:07.277301] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T17:42:07.958059] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-14T17:42:08.758032] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-14T17:42:08.926925] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T17:42:09.005105] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-14T17:42:09.190296] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-14T17:42:09.558081] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-14T17:42:10.358061] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-14T17:42:11.014034] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T17:42:11.058130] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T17:42:11.158061] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-14T17:42:11.693270] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-14T17:42:11.958058] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-14T17:42:12.758117] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-14T17:42:13.421175] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T17:42:13.558071] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-14T17:42:13.972289] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T17:42:13.975769] [INFO ] [REMOTE ] BMI: Full fetch complete (33275 records). [2025-10-14T17:42:13.975925] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-14T17:42:14.372261] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-14T17:42:14.375431] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-14T17:42:14.375530] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-14T17:42:14.376195] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-14T17:42:14.376383] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-14T17:42:14.377477] [DEBUG] [LOCAL ] BMI: Trimmed 33275 records to 24471 (keeping 200 days of data) [2025-10-14T17:42:14.536483] [DEBUG] [LOCAL ] BMI: Primary data saved (24471 records). [2025-10-14T17:42:14.536829] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-14T17:42:14.536922] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMI took 38.5s. Estimated remaining: 4h 41m 12s. Rate: 7.3 symbols/min [2025-10-14T17:42:14.717876] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:14.766959] [DEBUG] [LOCAL ] BN: Loaded 52987 existing records from primary storage. [2025-10-14T17:42:14.767294] [INFO ] [MAIN ] BN: Loaded 52987 existing records. [2025-10-14T17:42:14.877410] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-14T17:42:14.959985] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:42:14.960409] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-14T17:42:14.960551] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-14T17:42:14.961583] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-14T17:42:14.961676] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-14T17:42:15.164605] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-14T17:42:15.307510] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T17:42:15.397742] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:15.702889] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-14T17:42:15.958107] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-14T17:42:16.758205] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-14T17:42:17.092048] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T17:42:17.558087] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-14T17:42:17.621916] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T17:42:18.358064] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-14T17:42:18.809844] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T17:42:19.158051] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-14T17:42:19.587575] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-14T17:42:19.642322] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-14T17:42:19.958046] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-14T17:42:20.758121] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-14T17:42:21.558112] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-14T17:42:21.857082] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T17:42:21.903419] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T17:42:22.014022] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T17:42:22.015071] [INFO ] [REMOTE ] BMN: Full fetch complete (3719 records). [2025-10-14T17:42:22.015143] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-14T17:42:22.363296] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-14T17:42:22.408858] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-14T17:42:22.408973] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-14T17:42:22.409150] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-14T17:42:22.409194] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-14T17:42:22.409824] [DEBUG] [LOCAL ] BMN: Trimmed 3719 records to 2585 (keeping 200 days of data) [2025-10-14T17:42:22.428083] [DEBUG] [LOCAL ] BMN: Primary data saved (2585 records). [2025-10-14T17:42:22.428275] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-14T17:42:22.428381] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMN took 23.5s. Estimated remaining: 4h 41m 2s. Rate: 7.3 symbols/min [2025-10-14T17:42:22.617539] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:22.645859] [DEBUG] [LOCAL ] BNED: Loaded 28770 existing records from primary storage. [2025-10-14T17:42:22.646152] [INFO ] [MAIN ] BNED: Loaded 28770 existing records. [2025-10-14T17:42:22.818965] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:42:22.819197] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-14T17:42:22.819259] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-14T17:42:22.819449] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-14T17:42:22.819513] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-14T17:42:23.158332] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-14T17:42:23.161904] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:23.887230] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:42:23.958120] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-14T17:42:24.758060] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-14T17:42:25.114224] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T17:42:25.179989] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T17:42:25.558197] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-14T17:42:26.358141] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-14T17:42:26.746313] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T17:42:27.158080] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-14T17:42:27.331566] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T17:42:27.656680] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T17:42:27.958062] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-14T17:42:28.454153] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T17:42:28.758120] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-14T17:42:29.558087] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-14T17:42:29.711487] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T17:42:29.806969] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T17:42:30.358075] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-14T17:42:30.860813] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:42:31.158077] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-14T17:42:31.958059] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-14T17:42:32.204359] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-14T17:42:32.276216] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T17:42:32.758110] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-14T17:42:33.253180] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T17:42:33.558084] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-14T17:42:34.358325] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-14T17:42:34.652479] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T17:42:34.732198] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T17:42:35.158134] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-14T17:42:35.714236] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T17:42:35.958104] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-14T17:42:36.758178] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-14T17:42:37.301420] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T17:42:37.354088] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-14T17:42:37.558106] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-14T17:42:38.358042] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-14T17:42:38.401944] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T17:42:39.030224] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T17:42:39.035036] [INFO ] [REMOTE ] BMO: Full fetch complete (59665 records). [2025-10-14T17:42:39.035389] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-14T17:42:39.163186] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-14T17:42:39.443245] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-14T17:42:39.443460] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-14T17:42:39.444317] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-14T17:42:39.444380] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-14T17:42:39.445546] [DEBUG] [LOCAL ] BMO: Trimmed 59665 records to 41163 (keeping 200 days of data) [2025-10-14T17:42:39.579262] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T17:42:39.723880] [DEBUG] [LOCAL ] BMO: Primary data saved (41163 records). [2025-10-14T17:42:39.724010] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-14T17:42:39.724742] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMO took 35.0s. Estimated remaining: 4h 41m 54s. Rate: 7.3 symbols/min [2025-10-14T17:42:39.892565] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:39.901479] [DEBUG] [LOCAL ] BNH: Loaded 5246 existing records from primary storage. [2025-10-14T17:42:39.901736] [INFO ] [MAIN ] BNH: Loaded 5246 existing records. [2025-10-14T17:42:39.964705] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-14T17:42:40.083851] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:42:40.084049] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-14T17:42:40.084095] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-14T17:42:40.084311] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-14T17:42:40.084369] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-14T17:42:40.426289] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:40.758122] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-14T17:42:40.954406] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T17:42:41.080480] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T17:42:41.558063] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-14T17:42:42.358055] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-14T17:42:42.623353] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T17:42:42.892401] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T17:42:43.158081] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-14T17:42:43.810969] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T17:42:43.958061] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-14T17:42:44.255999] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T17:42:44.758034] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-14T17:42:44.963108] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T17:42:45.558065] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-14T17:42:46.358051] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-14T17:42:46.708524] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T17:42:46.760600] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T17:42:47.158046] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-14T17:42:47.604100] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T17:42:47.609471] [INFO ] [REMOTE ] BMY: Full fetch complete (77547 records). [2025-10-14T17:42:47.609582] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-14T17:42:47.610298] [FATAL] [VALIDATOR ] BMY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:42:47.610384] [FATAL] [MAIN ] BMY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:42:47.610426] [WARN ] [MAIN ] BMY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:42:47.610465] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-14T17:42:47.610520] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-10-14T17:42:47.610554] [INFO ] [LOCAL ] BMY: Starting deletion of derivative data. [2025-10-14T17:42:47.610796] [DEBUG] [LOCAL ] BMY: Deleted derivative data file. [2025-10-14T17:42:47.610884] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BMY took 41.5s. Estimated remaining: 4h 41m 44s. Rate: 7.3 symbols/min [2025-10-14T17:42:47.777437] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:47.782316] [DEBUG] [LOCAL ] BNJ: Loaded 2668 existing records from primary storage. [2025-10-14T17:42:47.782468] [INFO ] [MAIN ] BNJ: Loaded 2668 existing records. [2025-10-14T17:42:47.963875] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:42:47.959207] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-14T17:42:47.964123] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-14T17:42:47.965009] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-14T17:42:47.965319] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-14T17:42:47.965540] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-14T17:42:48.344004] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:48.373290] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T17:42:48.758103] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-14T17:42:48.939549] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T17:42:48.942224] [INFO ] [REMOTE ] BNED: Full fetch complete (42805 records). [2025-10-14T17:42:48.942298] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-14T17:42:49.343359] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-14T17:42:49.343432] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-14T17:42:49.343958] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-14T17:42:49.344018] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-14T17:42:49.344899] [DEBUG] [LOCAL ] BNED: Trimmed 42805 records to 28733 (keeping 200 days of data) [2025-10-14T17:42:49.502362] [DEBUG] [LOCAL ] BNED: Primary data saved (28733 records). [2025-10-14T17:42:49.502491] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-14T17:42:49.502571] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BNED took 27.1s. Estimated remaining: 4h 40m 54s. Rate: 7.3 symbols/min [2025-10-14T17:42:49.563944] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-14T17:42:49.611488] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T17:42:49.680262] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:42:49.680457] [DEBUG] [LOCAL ] BNL: No existing data file found in primary storage. [2025-10-14T17:42:49.680498] [WARN ] [MAIN ] BNL: No existing data found, performing full refresh instead. [2025-10-14T17:42:49.680572] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-14T17:42:49.680607] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-14T17:42:49.680696] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-10-14T17:42:49.680745] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-14T17:42:50.037280] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:42:50.358109] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-14T17:42:50.831965] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-14T17:42:51.158053] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-14T17:42:51.449969] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T17:42:51.550367] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-14T17:42:51.958054] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-14T17:42:52.758125] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-14T17:42:53.558082] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-14T17:42:53.813477] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T17:42:54.057014] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-14T17:42:54.096967] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T17:42:54.358068] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-14T17:42:55.158043] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-14T17:42:55.559364] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-14T17:42:55.637420] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T17:42:55.958053] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-14T17:42:56.562050] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T17:42:56.758069] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-14T17:42:57.558070] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-14T17:42:58.235683] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T17:42:58.259376] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T17:42:58.358052] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-14T17:42:59.158069] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-14T17:42:59.744925] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T17:42:59.909908] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T17:42:59.958042] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-14T17:43:00.758105] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-14T17:43:01.456738] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T17:43:01.558055] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-14T17:43:02.003195] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-14T17:43:02.283958] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T17:43:02.358095] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-14T17:43:03.158116] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-14T17:43:03.958115] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-14T17:43:04.283469] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-14T17:43:04.290248] [INFO ] [REMOTE ] BN: Full fetch complete (76885 records). [2025-10-14T17:43:04.290400] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-14T17:43:04.419317] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T17:43:04.712417] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-14T17:43:04.712673] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-14T17:43:04.713591] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-14T17:43:04.713701] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-14T17:43:04.740978] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T17:43:04.739583] [DEBUG] [LOCAL ] BN: Trimmed 76885 records to 52993 (keeping 200 days of data) [2025-10-14T17:43:04.807279] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-14T17:43:05.088181] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-10-14T17:43:05.088330] [INFO ] [MAIN ] BN: Full history saved. [2025-10-14T17:43:05.088412] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BN took 50.6s. Estimated remaining: 4h 41m 34s. Rate: 7.3 symbols/min [2025-10-14T17:43:05.298280] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:05.346925] [DEBUG] [LOCAL ] BNS: Loaded 51465 existing records from primary storage. [2025-10-14T17:43:05.347318] [INFO ] [MAIN ] BNS: Loaded 51465 existing records. [2025-10-14T17:43:05.554601] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:05.554860] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-14T17:43:05.554909] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-14T17:43:05.555099] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-14T17:43:05.555138] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-14T17:43:05.568215] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-14T17:43:05.955029] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:06.089729] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-14T17:43:06.359025] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-14T17:43:06.361899] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T17:43:07.087695] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-14T17:43:07.158074] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-14T17:43:07.958124] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-14T17:43:08.704805] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T17:43:08.758110] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-14T17:43:08.762140] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T17:43:09.331145] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T17:43:09.558088] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-14T17:43:09.943073] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-14T17:43:10.358046] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-14T17:43:11.158064] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-14T17:43:11.687622] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-14T17:43:11.730634] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T17:43:11.958060] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-14T17:43:12.758099] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-14T17:43:13.558073] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-14T17:43:13.623475] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T17:43:14.044276] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T17:43:14.045159] [INFO ] [REMOTE ] BNJ: Full fetch complete (4163 records). [2025-10-14T17:43:14.045234] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-14T17:43:14.370590] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-14T17:43:14.428263] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T17:43:14.461490] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-14T17:43:14.461561] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-14T17:43:14.461720] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-14T17:43:14.461782] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-14T17:43:14.462134] [DEBUG] [LOCAL ] BNJ: Trimmed 4163 records to 2629 (keeping 200 days of data) [2025-10-14T17:43:14.479201] [DEBUG] [LOCAL ] BNJ: Primary data saved (2629 records). [2025-10-14T17:43:14.479277] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-14T17:43:14.479349] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNJ took 26.9s. Estimated remaining: 4h 41m 34s. Rate: 7.3 symbols/min [2025-10-14T17:43:14.657333] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:14.662800] [DEBUG] [LOCAL ] BNT: Loaded 3428 existing records from primary storage. [2025-10-14T17:43:14.662955] [INFO ] [MAIN ] BNT: Loaded 3428 existing records. [2025-10-14T17:43:14.840580] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:14.840842] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-14T17:43:14.840890] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-14T17:43:14.841026] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-14T17:43:14.841064] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-14T17:43:15.163283] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-14T17:43:15.191701] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:15.663063] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T17:43:15.958062] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-14T17:43:16.154401] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T17:43:16.758172] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-14T17:43:17.319821] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T17:43:17.508926] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T17:43:17.558026] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-14T17:43:18.358070] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-14T17:43:18.881297] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-14T17:43:19.158075] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-14T17:43:19.242367] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T17:43:19.647165] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T17:43:19.958081] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-14T17:43:20.758116] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-14T17:43:21.558093] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-14T17:43:21.641043] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T17:43:21.988530] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T17:43:21.993946] [INFO ] [REMOTE ] BNL: Full fetch complete (67223 records). [2025-10-14T17:43:21.994052] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-14T17:43:22.358314] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-14T17:43:22.371329] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T17:43:22.376613] [INFO ] [REMOTE ] BNH: Full fetch complete (6927 records). [2025-10-14T17:43:22.405520] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-14T17:43:22.456401] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-14T17:43:22.490525] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-14T17:43:22.503426] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-14T17:43:22.528792] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-14T17:43:22.592621] [DEBUG] [LOCAL ] BNL: Trimmed 67223 records to 47213 (keeping 200 days of data) [2025-10-14T17:43:22.944771] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-14T17:43:22.945093] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-14T17:43:22.945568] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-14T17:43:22.945664] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-14T17:43:22.947792] [DEBUG] [LOCAL ] BNH: Trimmed 6927 records to 5072 (keeping 200 days of data) [2025-10-14T17:43:22.982794] [DEBUG] [LOCAL ] BNH: Primary data saved (5072 records). [2025-10-14T17:43:22.985240] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-14T17:43:22.985356] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNH took 43.3s. Estimated remaining: 4h 41m 27s. Rate: 7.3 symbols/min [2025-10-14T17:43:23.165457] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-14T17:43:23.279019] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:23.322665] [DEBUG] [LOCAL ] BNY: Loaded 7160 existing records from primary storage. [2025-10-14T17:43:23.323692] [INFO ] [MAIN ] BNY: Loaded 7160 existing records. [2025-10-14T17:43:23.441527] [DEBUG] [LOCAL ] BNL: Primary data saved (47213 records). [2025-10-14T17:43:23.441815] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-14T17:43:23.442206] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNL took 33.9s. Estimated remaining: 4h 40m 29s. Rate: 7.3 symbols/min [2025-10-14T17:43:23.519876] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:23.520069] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-14T17:43:23.520116] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-14T17:43:23.520253] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-14T17:43:23.520289] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-14T17:43:23.685093] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T17:43:23.883701] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:23.958028] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-14T17:43:24.049691] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T17:43:24.758047] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-14T17:43:24.804033] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T17:43:25.211153] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-14T17:43:25.558080] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-14T17:43:26.357263] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T17:43:26.358820] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-14T17:43:27.158101] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-14T17:43:27.777094] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T17:43:27.958089] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-14T17:43:28.001573] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T17:43:28.275636] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-14T17:43:28.758081] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-14T17:43:29.558105] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-14T17:43:29.891706] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-14T17:43:30.358063] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-14T17:43:30.502090] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T17:43:30.739752] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-14T17:43:31.158072] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-14T17:43:31.655562] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-14T17:43:31.958061] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-14T17:43:32.303815] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-14T17:43:32.758089] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-14T17:43:33.558121] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-14T17:43:34.192967] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T17:43:34.211444] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T17:43:34.358115] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-14T17:43:34.988536] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T17:43:34.990085] [INFO ] [REMOTE ] BNT: Full fetch complete (4633 records). [2025-10-14T17:43:34.990174] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-14T17:43:35.165885] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-14T17:43:35.447502] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-14T17:43:35.447581] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-14T17:43:35.447766] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-14T17:43:35.447830] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-14T17:43:35.448261] [DEBUG] [LOCAL ] BNT: Trimmed 4633 records to 3459 (keeping 200 days of data) [2025-10-14T17:43:35.474807] [DEBUG] [LOCAL ] BNT: Primary data saved (3459 records). [2025-10-14T17:43:35.474945] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-14T17:43:35.475025] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNT took 21.0s. Estimated remaining: 4h 40m 45s. Rate: 7.3 symbols/min [2025-10-14T17:43:35.958126] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-14T17:43:36.090513] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T17:43:36.758111] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-14T17:43:37.531128] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T17:43:37.558039] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-14T17:43:37.660704] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T17:43:38.250379] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T17:43:38.358121] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-14T17:43:39.158118] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-14T17:43:39.805797] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T17:43:39.815889] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T17:43:39.818103] [INFO ] [REMOTE ] BNS: Full fetch complete (74540 records). [2025-10-14T17:43:39.818440] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-14T17:43:39.960867] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-14T17:43:40.205733] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-14T17:43:40.205815] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-14T17:43:40.206604] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-14T17:43:40.206688] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-14T17:43:40.208203] [DEBUG] [LOCAL ] BNS: Trimmed 74540 records to 51485 (keeping 200 days of data) [2025-10-14T17:43:40.515747] [DEBUG] [LOCAL ] BNS: Primary data saved (51485 records). [2025-10-14T17:43:40.515874] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-14T17:43:40.515950] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNS took 35.4s. Estimated remaining: 4h 40m 17s. Rate: 7.3 symbols/min [2025-10-14T17:43:40.782087] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T17:43:40.784693] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-14T17:43:41.519739] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T17:43:41.558030] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-14T17:43:42.250146] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T17:43:42.358093] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-14T17:43:42.989109] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T17:43:42.990779] [INFO ] [REMOTE ] BNY: Full fetch complete (10395 records). [2025-10-14T17:43:42.990855] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-14T17:43:43.420931] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-14T17:43:43.421017] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-14T17:43:43.421286] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-14T17:43:43.421379] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-14T17:43:43.421925] [DEBUG] [LOCAL ] BNY: Trimmed 10395 records to 7171 (keeping 200 days of data) [2025-10-14T17:43:43.469546] [DEBUG] [LOCAL ] BNY: Primary data saved (7171 records). [2025-10-14T17:43:43.469712] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-14T17:43:43.469806] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BNY took 20.5s. Estimated remaining: 4h 39m 35s. Rate: 7.3 symbols/min [2025-10-14T17:43:44.163002] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:44.164491] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:44.216984] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:44.219120] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:43:44.257026] [DEBUG] [LOCAL ] BOC: Loaded 18609 existing records from primary storage. [2025-10-14T17:43:44.282611] [INFO ] [MAIN ] BOC: Loaded 18609 existing records. [2025-10-14T17:43:44.294141] [DEBUG] [LOCAL ] BOH: Loaded 30490 existing records from primary storage. [2025-10-14T17:43:44.282469] [DEBUG] [LOCAL ] BOE: Loaded 18261 existing records from primary storage. [2025-10-14T17:43:44.318760] [INFO ] [MAIN ] BOE: Loaded 18261 existing records. [2025-10-14T17:43:44.325135] [DEBUG] [LOCAL ] BOND: Loaded 32321 existing records from primary storage. [2025-10-14T17:43:44.324722] [INFO ] [MAIN ] BOH: Loaded 30490 existing records. [2025-10-14T17:43:44.359420] [INFO ] [MAIN ] BOND: Loaded 32321 existing records. [2025-10-14T17:43:44.952795] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:44.974140] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-14T17:43:44.930163] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:44.975708] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-14T17:43:45.016747] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:45.034088] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-14T17:43:45.051482] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-14T17:43:45.046102] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-14T17:43:45.056380] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-14T17:43:45.060465] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-14T17:43:45.060610] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-14T17:43:45.066315] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-14T17:43:45.090834] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-14T17:43:45.060293] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:43:45.090764] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-14T17:43:45.112525] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-14T17:43:45.117876] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-14T17:43:45.127294] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-14T17:43:45.188090] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-14T17:43:45.216439] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-14T17:43:46.340805] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:46.414788] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-14T17:43:46.533092] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:46.563223] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:46.598370] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-14T17:43:46.598946] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-14T17:43:46.607510] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:43:46.608040] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-14T17:43:47.481789] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T17:43:47.485996] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-14T17:43:47.810881] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T17:43:47.816041] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-14T17:43:47.835153] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T17:43:47.958119] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-14T17:43:47.986789] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T17:43:48.213202] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T17:43:48.758102] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-14T17:43:48.931424] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T17:43:49.056166] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T17:43:49.558087] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-14T17:43:49.660677] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T17:43:50.358123] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-14T17:43:50.493588] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T17:43:51.158072] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-14T17:43:51.659098] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T17:43:51.958108] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-14T17:43:52.588347] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T17:43:52.758135] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-14T17:43:52.833048] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T17:43:53.558044] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-14T17:43:53.782616] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T17:43:54.271206] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T17:43:54.358107] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-14T17:43:55.158166] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-14T17:43:55.742381] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T17:43:55.958076] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-14T17:43:55.992366] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T17:43:56.758098] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-14T17:43:57.253282] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T17:43:57.558096] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-14T17:43:57.636128] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T17:43:58.358133] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-14T17:43:58.718282] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T17:43:59.158086] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-14T17:43:59.824609] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T17:43:59.958085] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-14T17:44:00.325122] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T17:44:00.758067] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-14T17:44:01.108823] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T17:44:01.558073] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-14T17:44:01.859408] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T17:44:02.358156] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-14T17:44:02.574634] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T17:44:03.158095] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-14T17:44:03.655741] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T17:44:03.958122] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-14T17:44:04.137207] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T17:44:04.509080] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T17:44:04.758058] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-14T17:44:05.558051] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-14T17:44:05.703825] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T17:44:06.358081] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-14T17:44:06.786801] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T17:44:07.033422] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-14T17:44:07.158049] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-14T17:44:07.958104] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-14T17:44:08.452515] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T17:44:08.456264] [INFO ] [REMOTE ] BOH: Full fetch complete (45069 records). [2025-10-14T17:44:08.456368] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-14T17:44:08.765966] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-14T17:44:08.868030] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-14T17:44:08.868126] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-14T17:44:08.868804] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-14T17:44:08.868869] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-14T17:44:08.869933] [DEBUG] [LOCAL ] BOH: Trimmed 45069 records to 30552 (keeping 200 days of data) [2025-10-14T17:44:09.015081] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T17:44:09.086976] [DEBUG] [LOCAL ] BOH: Primary data saved (30552 records). [2025-10-14T17:44:09.087101] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-14T17:44:09.087176] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOH took 25.6s. Estimated remaining: 4h 41m 18s. Rate: 7.3 symbols/min [2025-10-14T17:44:09.254370] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:09.292079] [DEBUG] [LOCAL ] BOOT: Loaded 39875 existing records from primary storage. [2025-10-14T17:44:09.292415] [INFO ] [MAIN ] BOOT: Loaded 39875 existing records. [2025-10-14T17:44:09.484297] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:44:09.484541] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-14T17:44:09.484593] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-14T17:44:09.484987] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-14T17:44:09.485051] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-14T17:44:09.559812] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-14T17:44:09.663724] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T17:44:09.878043] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:10.358071] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-14T17:44:11.021197] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T17:44:11.158061] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-14T17:44:11.387217] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T17:44:11.958068] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-14T17:44:12.483716] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T17:44:12.758100] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-14T17:44:13.121013] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T17:44:13.558102] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-14T17:44:13.886836] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T17:44:14.068570] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T17:44:14.358090] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-14T17:44:15.158122] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-14T17:44:15.958047] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-14T17:44:16.003471] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T17:44:16.225453] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T17:44:16.758048] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-14T17:44:17.391830] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T17:44:17.395784] [INFO ] [REMOTE ] BOND: Full fetch complete (46524 records). [2025-10-14T17:44:17.395898] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-14T17:44:17.560518] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-14T17:44:17.773715] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-14T17:44:17.773800] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-14T17:44:17.774423] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-14T17:44:17.774465] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-14T17:44:17.775547] [DEBUG] [LOCAL ] BOND: Trimmed 46524 records to 32377 (keeping 200 days of data) [2025-10-14T17:44:17.974105] [DEBUG] [LOCAL ] BOND: Primary data saved (32377 records). [2025-10-14T17:44:17.974237] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-14T17:44:17.975102] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOND took 34.4s. Estimated remaining: 4h 41m 14s. Rate: 7.3 symbols/min [2025-10-14T17:44:18.143479] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:18.197115] [DEBUG] [LOCAL ] BORR: Loaded 51152 existing records from primary storage. [2025-10-14T17:44:18.197413] [INFO ] [MAIN ] BORR: Loaded 51152 existing records. [2025-10-14T17:44:18.374469] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-14T17:44:18.380805] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:44:18.382071] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-14T17:44:18.382152] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-14T17:44:18.382541] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-14T17:44:18.382692] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-14T17:44:18.502234] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T17:44:18.610139] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T17:44:18.797291] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:19.158073] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-14T17:44:19.592567] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T17:44:19.595980] [INFO ] [REMOTE ] BOE: Full fetch complete (26784 records). [2025-10-14T17:44:19.596063] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-14T17:44:19.959066] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-14T17:44:19.991874] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-14T17:44:19.991985] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-14T17:44:19.992479] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-14T17:44:19.992541] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-14T17:44:19.993277] [DEBUG] [LOCAL ] BOE: Trimmed 26784 records to 18298 (keeping 200 days of data) [2025-10-14T17:44:20.102382] [DEBUG] [LOCAL ] BOE: Primary data saved (18298 records). [2025-10-14T17:44:20.102517] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-14T17:44:20.102595] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOE took 36.6s. Estimated remaining: 4h 40m 27s. Rate: 7.3 symbols/min [2025-10-14T17:44:20.209743] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T17:44:20.233201] [INFO ] [REMOTE ] BOC: Full fetch complete (25913 records). [2025-10-14T17:44:20.259762] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-14T17:44:20.315481] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:20.587830] [DEBUG] [LOCAL ] BOW: Loaded 23502 existing records from primary storage. [2025-10-14T17:44:20.588389] [INFO ] [MAIN ] BOW: Loaded 23502 existing records. [2025-10-14T17:44:20.770478] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-14T17:44:20.811456] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-14T17:44:20.844739] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-14T17:44:20.868571] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-14T17:44:20.867902] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:44:20.868816] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-14T17:44:20.868894] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-14T17:44:20.868979] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-14T17:44:20.869342] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-14T17:44:20.869454] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-14T17:44:20.919545] [DEBUG] [LOCAL ] BOC: Trimmed 25913 records to 18632 (keeping 200 days of data) [2025-10-14T17:44:21.301374] [DEBUG] [LOCAL ] BOC: Primary data saved (18632 records). [2025-10-14T17:44:21.305249] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-14T17:44:21.305686] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOC took 37.8s. Estimated remaining: 4h 39m 34s. Rate: 7.3 symbols/min [2025-10-14T17:44:21.490608] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:21.574533] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-14T17:44:21.577130] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:21.602749] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T17:44:21.650717] [DEBUG] [LOCAL ] BOX: Loaded 50236 existing records from primary storage. [2025-10-14T17:44:21.651032] [INFO ] [MAIN ] BOX: Loaded 50236 existing records. [2025-10-14T17:44:21.832211] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:44:21.832443] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-14T17:44:21.832492] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-14T17:44:21.832774] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-14T17:44:21.832831] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-14T17:44:22.177446] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:22.358035] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-14T17:44:22.466786] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T17:44:22.677295] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T17:44:23.158127] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-14T17:44:23.532480] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T17:44:23.724183] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T17:44:23.958076] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-14T17:44:24.758059] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-14T17:44:24.829588] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T17:44:25.558060] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-14T17:44:26.276730] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T17:44:26.358020] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-14T17:44:26.469004] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T17:44:27.158071] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-14T17:44:27.958050] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-14T17:44:28.026495] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T17:44:28.272001] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T17:44:28.758073] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-14T17:44:29.551549] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T17:44:29.560774] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-14T17:44:29.687087] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T17:44:30.358063] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-14T17:44:31.158046] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-14T17:44:31.233624] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T17:44:31.339995] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T17:44:31.958059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-14T17:44:32.660445] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:44:32.758067] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-14T17:44:33.558066] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-14T17:44:33.640215] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T17:44:34.367076] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-14T17:44:34.369940] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T17:44:34.421451] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T17:44:35.158071] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-14T17:44:35.511416] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T17:44:35.958038] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-14T17:44:36.108858] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T17:44:36.758092] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-14T17:44:37.563215] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-14T17:44:37.581298] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T17:44:38.358081] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-14T17:44:38.593932] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T17:44:38.642741] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T17:44:39.158072] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-14T17:44:39.886433] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T17:44:39.958024] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-14T17:44:40.666390] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T17:44:40.758044] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-14T17:44:41.034855] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T17:44:41.558113] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-14T17:44:42.008427] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T17:44:42.358113] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-14T17:44:42.836872] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T17:44:43.158099] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-14T17:44:43.958033] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-14T17:44:44.069773] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T17:44:44.553129] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T17:44:44.758085] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-14T17:44:45.394189] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T17:44:45.558063] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-14T17:44:46.358048] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-14T17:44:46.552825] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T17:44:46.752576] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T17:44:47.158071] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-14T17:44:47.454065] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T17:44:47.958053] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-14T17:44:48.572314] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T17:44:48.758166] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-14T17:44:49.128809] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T17:44:49.558060] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-14T17:44:50.039578] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T17:44:50.043426] [INFO ] [REMOTE ] BOW: Full fetch complete (32144 records). [2025-10-14T17:44:50.043503] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-14T17:44:50.363170] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-14T17:44:50.427337] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-14T17:44:50.427416] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-14T17:44:50.428032] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-14T17:44:50.428095] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-14T17:44:50.428925] [DEBUG] [LOCAL ] BOW: Trimmed 32144 records to 23426 (keeping 200 days of data) [2025-10-14T17:44:50.563404] [DEBUG] [LOCAL ] BOW: Primary data saved (23426 records). [2025-10-14T17:44:50.563557] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-14T17:44:50.563639] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BOW took 30.5s. Estimated remaining: 4h 41m 38s. Rate: 7.3 symbols/min [2025-10-14T17:44:50.736424] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:50.736611] [DEBUG] [LOCAL ] BP: No existing data file found in primary storage. [2025-10-14T17:44:50.736675] [WARN ] [MAIN ] BP: No existing data found, performing full refresh instead. [2025-10-14T17:44:50.736793] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-14T17:44:50.736833] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-14T17:44:50.736873] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-14T17:44:50.736904] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-14T17:44:51.095889] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:51.158071] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-14T17:44:51.235468] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T17:44:51.241199] [INFO ] [REMOTE ] BORR: Full fetch complete (74680 records). [2025-10-14T17:44:51.241320] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-14T17:44:51.621093] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-14T17:44:51.621176] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-14T17:44:51.622081] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-14T17:44:51.622144] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-14T17:44:51.623539] [DEBUG] [LOCAL ] BORR: Trimmed 74680 records to 51146 (keeping 200 days of data) [2025-10-14T17:44:51.906737] [DEBUG] [LOCAL ] BORR: Primary data saved (51146 records). [2025-10-14T17:44:51.906870] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-14T17:44:51.907427] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BORR took 33.9s. Estimated remaining: 4h 40m 47s. Rate: 7.3 symbols/min [2025-10-14T17:44:51.982848] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-14T17:44:52.019096] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T17:44:52.038161] [INFO ] [REMOTE ] BOOT: Full fetch complete (60083 records). [2025-10-14T17:44:52.048634] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-14T17:44:52.175763] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:52.448212] [DEBUG] [LOCAL ] BR: Loaded 34832 existing records from primary storage. [2025-10-14T17:44:52.459382] [INFO ] [MAIN ] BR: Loaded 34832 existing records. [2025-10-14T17:44:52.661679] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-14T17:44:52.666906] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-14T17:44:52.672834] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-14T17:44:52.672918] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-14T17:44:52.726267] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:44:52.727119] [DEBUG] [LOCAL ] BOOT: Trimmed 60083 records to 39842 (keeping 200 days of data) [2025-10-14T17:44:52.726903] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-14T17:44:52.727271] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-14T17:44:52.728042] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-14T17:44:52.728108] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-14T17:44:53.257321] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:53.262430] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-14T17:44:53.361414] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-14T17:44:53.433231] [DEBUG] [LOCAL ] BOOT: Primary data saved (39842 records). [2025-10-14T17:44:53.433365] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-14T17:44:53.433444] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOOT took 44.3s. Estimated remaining: 4h 39m 57s. Rate: 7.3 symbols/min [2025-10-14T17:44:53.561324] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-14T17:44:53.606200] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:44:53.640209] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T17:44:53.693091] [DEBUG] [LOCAL ] BRBR: Loaded 51571 existing records from primary storage. [2025-10-14T17:44:53.693442] [INFO ] [MAIN ] BRBR: Loaded 51571 existing records. [2025-10-14T17:44:53.869850] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:44:53.870091] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-14T17:44:53.870142] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-14T17:44:53.870707] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-14T17:44:53.870764] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-14T17:44:54.262607] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:44:54.358032] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-14T17:44:54.698349] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T17:44:55.158146] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-14T17:44:55.646246] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T17:44:55.695570] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-14T17:44:55.958108] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-14T17:44:56.254570] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T17:44:56.758068] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-14T17:44:57.558089] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-14T17:44:57.657826] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T17:44:58.226459] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T17:44:58.358061] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-14T17:44:58.942828] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T17:44:59.158056] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-14T17:44:59.897631] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T17:44:59.958108] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-14T17:45:00.758130] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-14T17:45:01.047114] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T17:45:01.479935] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T17:45:01.558080] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-14T17:45:02.312283] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T17:45:02.358069] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-14T17:45:02.800921] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T17:45:02.806015] [INFO ] [REMOTE ] BOX: Full fetch complete (71903 records). [2025-10-14T17:45:02.806242] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-14T17:45:02.806942] [FATAL] [VALIDATOR ] BOX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:45:02.807033] [FATAL] [MAIN ] BOX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:45:02.807075] [WARN ] [MAIN ] BOX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:45:02.807113] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-14T17:45:02.807169] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-14T17:45:02.807203] [INFO ] [LOCAL ] BOX: Starting deletion of derivative data. [2025-10-14T17:45:02.807475] [DEBUG] [LOCAL ] BOX: Deleted derivative data file. [2025-10-14T17:45:02.807578] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BOX took 41.5s. Estimated remaining: 4h 39m 55s. Rate: 7.3 symbols/min [2025-10-14T17:45:02.978568] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:02.997887] [DEBUG] [LOCAL ] BRC: Loaded 18661 existing records from primary storage. [2025-10-14T17:45:02.998130] [INFO ] [MAIN ] BRC: Loaded 18661 existing records. [2025-10-14T17:45:03.162351] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-14T17:45:03.190700] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:45:03.191027] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-14T17:45:03.191088] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-14T17:45:03.191303] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-14T17:45:03.191412] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-14T17:45:03.562757] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:03.626894] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T17:45:03.958067] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-14T17:45:04.758046] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-14T17:45:04.815973] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T17:45:05.558061] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-14T17:45:05.899386] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-14T17:45:06.219818] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T17:45:06.358026] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-14T17:45:07.158094] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-14T17:45:07.180121] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T17:45:07.684059] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T17:45:07.958035] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-14T17:45:08.758063] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-14T17:45:09.087984] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T17:45:09.558067] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-14T17:45:09.699550] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-14T17:45:10.005152] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T17:45:10.358044] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-14T17:45:10.574776] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T17:45:11.158088] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-14T17:45:11.542420] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T17:45:11.958044] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-14T17:45:12.758048] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-14T17:45:13.281632] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-14T17:45:13.367139] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T17:45:13.449583] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T17:45:13.558058] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-14T17:45:14.358051] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-14T17:45:14.525312] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T17:45:15.158084] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-14T17:45:15.540110] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T17:45:15.958081] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-14T17:45:16.347055] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-14T17:45:16.758082] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-14T17:45:17.558109] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-14T17:45:17.591737] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T17:45:18.331474] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T17:45:18.335593] [INFO ] [REMOTE ] BR: Full fetch complete (49774 records). [2025-10-14T17:45:18.335734] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-14T17:45:18.367034] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-14T17:45:18.717308] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-14T17:45:18.717383] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-14T17:45:18.718034] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-14T17:45:18.718094] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-14T17:45:18.719095] [DEBUG] [LOCAL ] BR: Trimmed 49774 records to 34787 (keeping 200 days of data) [2025-10-14T17:45:18.937629] [DEBUG] [LOCAL ] BR: Primary data saved (34787 records). [2025-10-14T17:45:18.937798] [INFO ] [MAIN ] BR: Full history saved. [2025-10-14T17:45:18.938667] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BR took 27.0s. Estimated remaining: 4h 40m 36s. Rate: 7.3 symbols/min [2025-10-14T17:45:19.108455] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:19.148529] [DEBUG] [LOCAL ] BRCC: Loaded 40184 existing records from primary storage. [2025-10-14T17:45:19.148839] [INFO ] [MAIN ] BRCC: Loaded 40184 existing records. [2025-10-14T17:45:19.169613] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-14T17:45:19.333396] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:45:19.333908] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-14T17:45:19.334085] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-14T17:45:19.334578] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-14T17:45:19.348992] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-14T17:45:19.388066] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T17:45:19.713901] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:19.746058] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-14T17:45:19.958082] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-14T17:45:20.699919] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T17:45:20.758067] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-14T17:45:21.558072] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-14T17:45:21.963186] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-14T17:45:22.358044] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-14T17:45:22.433849] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T17:45:23.158081] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-14T17:45:23.523296] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-14T17:45:23.937624] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T17:45:23.958075] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-14T17:45:24.758047] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-14T17:45:25.144190] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T17:45:25.558080] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-14T17:45:25.933564] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-14T17:45:26.283340] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T17:45:26.358083] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-14T17:45:27.036030] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T17:45:27.041268] [INFO ] [REMOTE ] BRBR: Full fetch complete (72301 records). [2025-10-14T17:45:27.041383] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-14T17:45:27.042135] [FATAL] [VALIDATOR ] BRBR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:45:27.042222] [FATAL] [MAIN ] BRBR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:45:27.042265] [WARN ] [MAIN ] BRBR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:45:27.042308] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-14T17:45:27.042392] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-14T17:45:27.042450] [INFO ] [LOCAL ] BRBR: Starting deletion of derivative data. [2025-10-14T17:45:27.042747] [DEBUG] [LOCAL ] BRBR: Deleted derivative data file. [2025-10-14T17:45:27.042858] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BRBR took 33.6s. Estimated remaining: 4h 40m 27s. Rate: 7.3 symbols/min [2025-10-14T17:45:27.162699] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-14T17:45:27.218354] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:27.232538] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T17:45:27.284957] [DEBUG] [LOCAL ] BRO: Loaded 52044 existing records from primary storage. [2025-10-14T17:45:27.285288] [INFO ] [MAIN ] BRO: Loaded 52044 existing records. [2025-10-14T17:45:27.459504] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:45:27.459800] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-14T17:45:27.459866] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-14T17:45:27.460421] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-14T17:45:27.460477] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-14T17:45:27.817763] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:27.958096] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-14T17:45:28.758068] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-14T17:45:29.269168] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T17:45:29.452039] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T17:45:29.506200] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T17:45:29.558062] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-14T17:45:30.358053] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-14T17:45:30.600127] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T17:45:31.158068] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-14T17:45:31.626406] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T17:45:31.898384] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T17:45:31.900828] [INFO ] [REMOTE ] BRC: Full fetch complete (28465 records). [2025-10-14T17:45:31.901012] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-14T17:45:31.963250] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-14T17:45:32.298686] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-14T17:45:32.298800] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-14T17:45:32.299404] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-14T17:45:32.299477] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-14T17:45:32.300599] [DEBUG] [LOCAL ] BRC: Trimmed 28465 records to 18597 (keeping 200 days of data) [2025-10-14T17:45:32.424625] [DEBUG] [LOCAL ] BRC: Primary data saved (18597 records). [2025-10-14T17:45:32.424792] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-14T17:45:32.424873] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 29.6s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-14T17:45:32.594825] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:32.644057] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-14T17:45:32.644355] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-14T17:45:32.763144] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-14T17:45:32.828940] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:45:32.829191] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-14T17:45:32.829241] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-14T17:45:32.829552] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-14T17:45:32.829610] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-14T17:45:33.188079] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:33.564676] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-14T17:45:33.567675] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T17:45:34.246762] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T17:45:34.358079] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-14T17:45:35.158054] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-14T17:45:35.212571] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T17:45:35.293989] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T17:45:35.958119] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-14T17:45:36.758067] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-14T17:45:36.866063] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T17:45:37.498247] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T17:45:37.558023] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-14T17:45:38.358088] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-14T17:45:38.794055] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-14T17:45:38.800026] [INFO ] [REMOTE ] BP: Full fetch complete (77881 records). [2025-10-14T17:45:38.800167] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-14T17:45:39.192889] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-14T17:45:39.174179] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-14T17:45:39.193076] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-14T17:45:39.194888] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-14T17:45:39.195062] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-14T17:45:39.196613] [DEBUG] [LOCAL ] BP: Trimmed 77881 records to 53708 (keeping 200 days of data) [2025-10-14T17:45:39.508130] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T17:45:39.611213] [DEBUG] [LOCAL ] BP: Primary data saved (53708 records). [2025-10-14T17:45:39.611524] [INFO ] [MAIN ] BP: Full history saved. [2025-10-14T17:45:39.611699] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BP took 49.0s. Estimated remaining: 4h 39m 46s. Rate: 7.3 symbols/min [2025-10-14T17:45:39.786950] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:45:39.821165] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:39.822259] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-14T17:45:39.822326] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-14T17:45:39.822446] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-14T17:45:39.822490] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-14T17:45:39.822534] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-14T17:45:39.822568] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-14T17:45:39.963260] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-14T17:45:40.195929] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:40.758080] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-14T17:45:40.853005] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T17:45:41.558040] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-14T17:45:41.727286] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T17:45:42.056851] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T17:45:42.358076] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-14T17:45:43.158069] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-14T17:45:43.244540] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T17:45:43.958063] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-14T17:45:44.163849] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:45:44.164143] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-14T17:45:44.164249] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:45:44.164318] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-14T17:45:44.164382] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:45:44.164449] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-14T17:45:44.164509] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-14T17:45:44.164543] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-14T17:45:44.164582] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-14T17:45:44.164627] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRSL took 4.6s. Estimated remaining: 4h 39m 16s. Rate: 7.3 symbols/min [2025-10-14T17:45:44.347140] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:44.377825] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T17:45:44.418962] [DEBUG] [LOCAL ] BRSP: Loaded 36738 existing records from primary storage. [2025-10-14T17:45:44.419249] [INFO ] [MAIN ] BRSP: Loaded 36738 existing records. [2025-10-14T17:45:44.600082] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:45:44.600324] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-14T17:45:44.600383] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-14T17:45:44.600756] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-14T17:45:44.600837] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-14T17:45:44.764208] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-14T17:45:44.974106] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:45.003850] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T17:45:45.558070] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-14T17:45:46.358124] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-14T17:45:46.917724] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-14T17:45:47.158059] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-14T17:45:47.478331] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T17:45:47.514724] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T17:45:47.958089] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-14T17:45:48.758181] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-14T17:45:48.886876] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T17:45:49.487995] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T17:45:49.558059] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-14T17:45:50.048634] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T17:45:50.358065] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-14T17:45:51.158048] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-14T17:45:51.309374] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T17:45:51.313167] [INFO ] [REMOTE ] BRCC: Full fetch complete (57204 records). [2025-10-14T17:45:51.313254] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-14T17:45:51.314031] [FATAL] [VALIDATOR ] BRCC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:45:51.314160] [FATAL] [MAIN ] BRCC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:45:51.314240] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:45:51.314330] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-14T17:45:51.314407] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-14T17:45:51.314443] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-14T17:45:51.314639] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-14T17:45:51.315354] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRCC took 32.4s. Estimated remaining: 4h 39m 1s. Rate: 7.3 symbols/min [2025-10-14T17:45:51.508811] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:45:51.520495] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-14T17:45:51.520695] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-14T17:45:51.522002] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T17:45:51.522076] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-14T17:45:51.529271] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-14T17:45:51.529595] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-14T17:45:51.529639] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-14T17:45:51.878608] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:45:51.958038] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-14T17:45:52.758067] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-14T17:45:52.977718] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T17:45:52.978439] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T17:45:53.558118] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-14T17:45:53.829356] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T17:45:54.358088] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-14T17:45:54.949604] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T17:45:55.154056] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T17:45:55.164389] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-14T17:45:55.468221] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-14T17:45:55.958103] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-14T17:45:56.527703] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T17:45:56.758068] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-14T17:45:57.558080] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-14T17:45:58.358044] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-14T17:45:58.727317] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T17:45:59.158121] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-14T17:45:59.250293] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T17:45:59.963160] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-14T17:45:59.974953] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T17:46:00.759106] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-14T17:46:00.762101] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T17:46:01.527861] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-14T17:46:01.558094] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-14T17:46:02.358082] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-14T17:46:02.410906] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T17:46:02.642179] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-14T17:46:02.648011] [INFO ] [REMOTE ] BRO: Full fetch complete (74311 records). [2025-10-14T17:46:02.648184] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-14T17:46:02.649173] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:46:02.649803] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:46:02.649879] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:46:02.649950] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-14T17:46:02.650010] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-14T17:46:02.650044] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-14T17:46:02.650249] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-10-14T17:46:02.650347] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BRO took 35.6s. Estimated remaining: 4h 39m 11s. Rate: 7.3 symbols/min [2025-10-14T17:46:02.845346] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:02.865357] [DEBUG] [LOCAL ] BRW: Loaded 20943 existing records from primary storage. [2025-10-14T17:46:02.865589] [INFO ] [MAIN ] BRW: Loaded 20943 existing records. [2025-10-14T17:46:03.039897] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:03.040095] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-14T17:46:03.040141] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-14T17:46:03.040347] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-14T17:46:03.040403] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-14T17:46:03.163164] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-14T17:46:03.405140] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:03.853983] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:46:03.868173] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T17:46:03.958099] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-14T17:46:04.629006] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-14T17:46:04.758116] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-14T17:46:05.558069] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-14T17:46:06.159446] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T17:46:06.358068] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-14T17:46:06.697868] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T17:46:07.158070] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-14T17:46:07.505601] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T17:46:07.958067] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-14T17:46:08.758048] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-14T17:46:09.066231] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T17:46:09.347416] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-14T17:46:09.353342] [INFO ] [REMOTE ] BROS: Full fetch complete (77220 records). [2025-10-14T17:46:09.353460] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-14T17:46:09.563154] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-14T17:46:09.762251] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-14T17:46:09.762450] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-14T17:46:09.763309] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-14T17:46:09.763426] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-14T17:46:09.782312] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T17:46:09.788987] [DEBUG] [LOCAL ] BROS: Trimmed 77220 records to 53300 (keeping 200 days of data) [2025-10-14T17:46:10.093458] [DEBUG] [LOCAL ] BROS: Primary data saved (53300 records). [2025-10-14T17:46:10.093574] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-14T17:46:10.093667] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BROS took 37.7s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-14T17:46:10.209040] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T17:46:10.272252] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:10.323198] [DEBUG] [LOCAL ] BRX: Loaded 51788 existing records from primary storage. [2025-10-14T17:46:10.323542] [INFO ] [MAIN ] BRX: Loaded 51788 existing records. [2025-10-14T17:46:10.363217] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-14T17:46:10.505833] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:10.506042] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-14T17:46:10.506091] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-14T17:46:10.506411] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-14T17:46:10.506472] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-14T17:46:10.897697] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:11.158071] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-14T17:46:11.411373] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T17:46:11.958095] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-14T17:46:12.758437] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-14T17:46:12.764898] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T17:46:13.360426] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T17:46:13.437322] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-14T17:46:13.558078] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-14T17:46:14.358047] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-14T17:46:14.405858] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T17:46:14.407137] [INFO ] [REMOTE ] BRT: Full fetch complete (6921 records). [2025-10-14T17:46:14.407204] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-14T17:46:14.407559] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:46:14.407657] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:46:14.407716] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:46:14.407798] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-14T17:46:14.407859] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-14T17:46:14.407894] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-14T17:46:14.407933] [DEBUG] [LOCAL ] BRT: No derivative data file found to delete. [2025-10-14T17:46:14.408018] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRT took 23.1s. Estimated remaining: 4h 38m 27s. Rate: 7.3 symbols/min [2025-10-14T17:46:14.574318] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:14.606197] [DEBUG] [LOCAL ] BSAC: Loaded 32825 existing records from primary storage. [2025-10-14T17:46:14.606474] [INFO ] [MAIN ] BSAC: Loaded 32825 existing records. [2025-10-14T17:46:14.791054] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:14.791325] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-14T17:46:14.791379] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-14T17:46:14.791559] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-14T17:46:14.791613] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-14T17:46:15.145860] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:15.158036] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-14T17:46:15.391145] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T17:46:15.958065] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-14T17:46:16.161052] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T17:46:16.758128] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-14T17:46:17.378779] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T17:46:17.558072] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-14T17:46:18.358062] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-14T17:46:18.408258] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T17:46:18.458394] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T17:46:19.158122] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-14T17:46:19.641316] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T17:46:19.958069] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-14T17:46:20.444185] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T17:46:20.758104] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-14T17:46:21.078700] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T17:46:21.558055] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-14T17:46:22.358050] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-14T17:46:22.394219] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T17:46:22.521989] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T17:46:23.158080] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-14T17:46:23.438291] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T17:46:23.442807] [INFO ] [REMOTE ] BRSP: Full fetch complete (54434 records). [2025-10-14T17:46:23.442917] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-14T17:46:23.821876] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-14T17:46:23.821997] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-14T17:46:23.822670] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-14T17:46:23.822732] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-14T17:46:23.823859] [DEBUG] [LOCAL ] BRSP: Trimmed 54434 records to 36881 (keeping 200 days of data) [2025-10-14T17:46:23.978301] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-14T17:46:24.035471] [DEBUG] [LOCAL ] BRSP: Primary data saved (36881 records). [2025-10-14T17:46:24.035619] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-14T17:46:24.035743] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRSP took 39.9s. Estimated remaining: 4h 38m 27s. Rate: 7.3 symbols/min [2025-10-14T17:46:24.207029] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:24.239589] [DEBUG] [LOCAL ] BSBR: Loaded 35612 existing records from primary storage. [2025-10-14T17:46:24.239897] [INFO ] [MAIN ] BSBR: Loaded 35612 existing records. [2025-10-14T17:46:24.433758] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:24.434024] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-14T17:46:24.434274] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-14T17:46:24.434712] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-14T17:46:24.434771] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-14T17:46:24.599017] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T17:46:24.760846] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-14T17:46:24.855253] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:24.991462] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-14T17:46:25.558086] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-14T17:46:26.168171] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T17:46:26.189515] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-14T17:46:26.358086] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-14T17:46:27.158082] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-14T17:46:27.951208] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T17:46:27.958944] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-14T17:46:28.387572] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T17:46:28.758113] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-14T17:46:29.298480] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T17:46:29.558092] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-14T17:46:29.972975] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T17:46:30.358113] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-14T17:46:31.143034] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T17:46:31.158030] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-14T17:46:31.702498] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T17:46:31.958095] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-14T17:46:32.513314] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T17:46:32.733920] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T17:46:32.758033] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-14T17:46:33.558053] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-14T17:46:34.294094] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T17:46:34.358129] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-14T17:46:34.869756] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T17:46:35.158112] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-14T17:46:35.746788] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T17:46:35.958076] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-14T17:46:36.218472] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T17:46:36.758111] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-14T17:46:36.877100] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T17:46:37.558123] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-14T17:46:38.332346] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T17:46:38.358066] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-14T17:46:38.761906] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:46:39.158057] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-14T17:46:39.334480] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T17:46:39.958056] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-14T17:46:40.585411] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T17:46:40.758131] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-14T17:46:41.001802] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T17:46:41.558088] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-14T17:46:41.781627] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T17:46:41.785604] [INFO ] [REMOTE ] BSAC: Full fetch complete (44651 records). [2025-10-14T17:46:41.785753] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-14T17:46:42.168413] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-14T17:46:42.168527] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-14T17:46:42.169136] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-14T17:46:42.169202] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-14T17:46:42.170298] [DEBUG] [LOCAL ] BSAC: Trimmed 44651 records to 32899 (keeping 200 days of data) [2025-10-14T17:46:42.358950] [DEBUG] [LOCAL ] BSAC: Primary data saved (32899 records). [2025-10-14T17:46:42.359128] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-14T17:46:42.359215] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-14T17:46:42.360140] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BSAC took 28.0s. Estimated remaining: 4h 39m 19s. Rate: 7.3 symbols/min [2025-10-14T17:46:42.530614] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:42.542173] [DEBUG] [LOCAL ] BSL: Loaded 8260 existing records from primary storage. [2025-10-14T17:46:42.542387] [INFO ] [MAIN ] BSL: Loaded 8260 existing records. [2025-10-14T17:46:42.719273] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:42.719528] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-14T17:46:42.719728] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-14T17:46:42.727610] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-14T17:46:42.728293] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T17:46:42.728023] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-14T17:46:42.736987] [INFO ] [REMOTE ] BRW: Full fetch complete (30549 records). [2025-10-14T17:46:42.768680] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-14T17:46:43.179331] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-14T17:46:43.450481] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:43.518417] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-14T17:46:43.518500] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-14T17:46:43.519009] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-14T17:46:43.519073] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-14T17:46:43.519785] [DEBUG] [LOCAL ] BRW: Trimmed 30549 records to 21043 (keeping 200 days of data) [2025-10-14T17:46:43.643860] [DEBUG] [LOCAL ] BRW: Primary data saved (21043 records). [2025-10-14T17:46:43.643991] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-14T17:46:43.644069] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BRW took 41.0s. Estimated remaining: 4h 38m 29s. Rate: 7.3 symbols/min [2025-10-14T17:46:43.815201] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:43.840447] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T17:46:43.876422] [DEBUG] [LOCAL ] BSM: Loaded 32287 existing records from primary storage. [2025-10-14T17:46:43.876728] [INFO ] [MAIN ] BSM: Loaded 32287 existing records. [2025-10-14T17:46:43.964760] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-14T17:46:44.053079] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:44.053879] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-14T17:46:44.053954] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-14T17:46:44.054225] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-14T17:46:44.054283] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-14T17:46:44.430834] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:44.651161] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T17:46:44.758043] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-14T17:46:45.030062] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T17:46:45.558086] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-14T17:46:46.086178] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T17:46:46.358072] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-14T17:46:47.158059] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-14T17:46:47.264604] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T17:46:47.558276] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T17:46:47.958092] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-14T17:46:48.394591] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T17:46:48.758087] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-14T17:46:49.297210] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T17:46:49.558081] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-14T17:46:50.344187] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T17:46:50.358047] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-14T17:46:50.918473] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T17:46:50.922545] [INFO ] [REMOTE ] BSBR: Full fetch complete (50786 records). [2025-10-14T17:46:50.922631] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-14T17:46:51.163318] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-14T17:46:51.311728] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-14T17:46:51.311828] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-14T17:46:51.312530] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-14T17:46:51.312595] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-14T17:46:51.313903] [DEBUG] [LOCAL ] BSBR: Trimmed 50786 records to 35663 (keeping 200 days of data) [2025-10-14T17:46:51.524836] [DEBUG] [LOCAL ] BSBR: Primary data saved (35663 records). [2025-10-14T17:46:51.524980] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-14T17:46:51.525063] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSBR took 27.5s. Estimated remaining: 4h 38m 19s. Rate: 7.3 symbols/min [2025-10-14T17:46:51.705677] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:46:51.725466] [DEBUG] [LOCAL ] BST: Loaded 18945 existing records from primary storage. [2025-10-14T17:46:51.725757] [INFO ] [MAIN ] BST: Loaded 18945 existing records. [2025-10-14T17:46:51.910173] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:46:51.910558] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-14T17:46:51.910684] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-14T17:46:51.911011] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-14T17:46:51.911066] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-14T17:46:51.974393] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-14T17:46:52.268816] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:46:52.302539] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T17:46:52.405365] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T17:46:52.758060] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-14T17:46:52.863064] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T17:46:53.558096] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-14T17:46:54.006817] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T17:46:54.343867] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T17:46:54.358027] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-14T17:46:55.158079] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-14T17:46:55.253704] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T17:46:55.958056] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-14T17:46:55.982540] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T17:46:56.758138] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-14T17:46:57.460218] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T17:46:57.508457] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T17:46:57.558140] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-14T17:46:58.257609] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T17:46:58.358110] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-14T17:46:59.158141] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-14T17:46:59.958044] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-14T17:47:00.127788] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-14T17:47:00.133739] [INFO ] [REMOTE ] BRX: Full fetch complete (75100 records). [2025-10-14T17:47:00.133860] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-14T17:47:00.584694] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-14T17:47:00.580953] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T17:47:00.591373] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-14T17:47:00.592381] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-14T17:47:00.592466] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-14T17:47:00.594548] [DEBUG] [LOCAL ] BRX: Trimmed 75100 records to 51776 (keeping 200 days of data) [2025-10-14T17:47:00.765637] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-14T17:47:00.904372] [DEBUG] [LOCAL ] BRX: Primary data saved (51776 records). [2025-10-14T17:47:00.904504] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-14T17:47:00.904586] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BRX took 50.8s. Estimated remaining: 4h 38m 17s. Rate: 7.3 symbols/min [2025-10-14T17:47:01.077506] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:01.105666] [DEBUG] [LOCAL ] BSTZ: Loaded 25020 existing records from primary storage. [2025-10-14T17:47:01.106009] [INFO ] [MAIN ] BSTZ: Loaded 25020 existing records. [2025-10-14T17:47:01.242755] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T17:47:01.302397] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:01.302601] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-14T17:47:01.302669] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-14T17:47:01.302916] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-14T17:47:01.302956] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-14T17:47:01.562348] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-14T17:47:01.575283] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T17:47:01.665086] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:02.358075] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-14T17:47:03.002492] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:47:03.158123] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-14T17:47:03.728571] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T17:47:03.958078] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-14T17:47:04.387761] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T17:47:04.681809] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T17:47:04.758055] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-14T17:47:05.547839] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T17:47:05.558037] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-14T17:47:06.358077] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-14T17:47:06.602493] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T17:47:07.086733] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T17:47:07.158061] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-14T17:47:07.901665] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T17:47:07.958099] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-14T17:47:08.758086] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-14T17:47:09.267733] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T17:47:09.558070] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-14T17:47:09.835287] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T17:47:10.358079] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-14T17:47:10.944476] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T17:47:11.158062] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-14T17:47:11.198769] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T17:47:11.200341] [INFO ] [REMOTE ] BSL: Full fetch complete (12807 records). [2025-10-14T17:47:11.200411] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-14T17:47:11.552270] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-14T17:47:11.552344] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-14T17:47:11.552636] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-14T17:47:11.552738] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-14T17:47:11.553172] [DEBUG] [LOCAL ] BSL: Trimmed 12807 records to 8184 (keeping 200 days of data) [2025-10-14T17:47:11.603452] [DEBUG] [LOCAL ] BSL: Primary data saved (8184 records). [2025-10-14T17:47:11.603578] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-14T17:47:11.603675] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSL took 29.2s. Estimated remaining: 4h 38m 24s. Rate: 7.3 symbols/min [2025-10-14T17:47:11.777460] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:11.831991] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-14T17:47:11.832355] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-14T17:47:11.961321] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-14T17:47:12.012822] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:12.013568] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-14T17:47:12.013667] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-14T17:47:12.019129] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-14T17:47:12.025219] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-14T17:47:12.043704] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T17:47:12.429757] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:12.758054] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-14T17:47:13.185604] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T17:47:13.564050] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-14T17:47:13.569357] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T17:47:14.358094] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-14T17:47:15.048113] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T17:47:15.158048] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-14T17:47:15.464315] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T17:47:15.466834] [INFO ] [REMOTE ] BST: Full fetch complete (28513 records). [2025-10-14T17:47:15.466919] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-14T17:47:15.827799] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-14T17:47:15.827863] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-14T17:47:15.828342] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-14T17:47:15.828405] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-14T17:47:15.829260] [DEBUG] [LOCAL ] BST: Trimmed 28513 records to 18922 (keeping 200 days of data) [2025-10-14T17:47:15.941829] [DEBUG] [LOCAL ] BST: Primary data saved (18922 records). [2025-10-14T17:47:15.941957] [INFO ] [MAIN ] BST: Full history saved. [2025-10-14T17:47:15.942032] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BST took 24.4s. Estimated remaining: 4h 37m 52s. Rate: 7.3 symbols/min [2025-10-14T17:47:15.963322] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-14T17:47:16.113766] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:16.121359] [DEBUG] [LOCAL ] BTA: Loaded 5590 existing records from primary storage. [2025-10-14T17:47:16.121530] [INFO ] [MAIN ] BTA: Loaded 5590 existing records. [2025-10-14T17:47:16.308450] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:16.308842] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-14T17:47:16.309037] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-14T17:47:16.309261] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-14T17:47:16.309320] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-14T17:47:16.463980] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T17:47:16.763384] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-14T17:47:16.769132] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:17.558075] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-14T17:47:17.607512] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T17:47:18.249280] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T17:47:18.252974] [INFO ] [REMOTE ] BSM: Full fetch complete (47038 records). [2025-10-14T17:47:18.253078] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-14T17:47:18.363063] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-14T17:47:18.644486] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-14T17:47:18.644570] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-14T17:47:18.645207] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-14T17:47:18.645269] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-14T17:47:18.646506] [DEBUG] [LOCAL ] BSM: Trimmed 47038 records to 32337 (keeping 200 days of data) [2025-10-14T17:47:18.751961] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T17:47:18.859371] [DEBUG] [LOCAL ] BSM: Primary data saved (32337 records). [2025-10-14T17:47:18.859510] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-14T17:47:18.859588] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BSM took 35.2s. Estimated remaining: 4h 37m 13s. Rate: 7.3 symbols/min [2025-10-14T17:47:19.025374] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:19.025585] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-10-14T17:47:19.025623] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-10-14T17:47:19.025752] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-14T17:47:19.025793] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-14T17:47:19.025833] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-14T17:47:19.025865] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-14T17:47:19.163317] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-14T17:47:19.381670] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:19.958084] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-14T17:47:20.279710] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-14T17:47:20.340619] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T17:47:20.758174] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-14T17:47:21.186772] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T17:47:21.558067] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-14T17:47:21.922583] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T17:47:22.328067] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T17:47:22.358037] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-14T17:47:23.066416] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T17:47:23.158056] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-14T17:47:23.958118] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-14T17:47:23.970306] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T17:47:24.758090] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-14T17:47:25.558081] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-14T17:47:25.577359] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T17:47:25.688868] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T17:47:26.238442] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-14T17:47:26.358126] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-14T17:47:27.125106] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T17:47:27.158053] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-14T17:47:27.898708] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T17:47:27.958111] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-14T17:47:28.622725] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T17:47:28.758096] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-14T17:47:29.276310] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-14T17:47:29.558100] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-14T17:47:30.196684] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T17:47:30.358122] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-14T17:47:31.158141] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-14T17:47:31.958130] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-14T17:47:32.223138] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T17:47:32.250987] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T17:47:32.707362] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T17:47:32.758056] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-14T17:47:33.558117] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-14T17:47:34.045886] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T17:47:34.358052] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-14T17:47:34.778701] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T17:47:34.778497] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T17:47:35.158110] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-14T17:47:35.958097] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-14T17:47:36.736336] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T17:47:36.758034] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-14T17:47:37.558069] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-14T17:47:37.736002] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T17:47:38.233211] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T17:47:38.235069] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T17:47:38.358077] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-14T17:47:38.955759] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T17:47:39.158083] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-14T17:47:39.958070] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-14T17:47:40.758104] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-14T17:47:41.155366] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:47:41.237631] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T17:47:41.558115] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-14T17:47:41.973455] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T17:47:42.358078] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-14T17:47:43.158090] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-14T17:47:43.268070] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T17:47:43.560919] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T17:47:43.958151] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-14T17:47:44.287040] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:47:44.758170] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-14T17:47:45.558081] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-14T17:47:45.912614] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T17:47:46.045408] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T17:47:46.355424] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T17:47:46.360435] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-14T17:47:47.158128] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-14T17:47:47.569629] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T17:47:47.621011] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T17:47:47.623916] [INFO ] [REMOTE ] BTCM: Full fetch complete (19914 records). [2025-10-14T17:47:47.624072] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-14T17:47:47.958082] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-14T17:47:47.985195] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-14T17:47:47.985262] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-14T17:47:47.985699] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-14T17:47:47.985759] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-14T17:47:47.986323] [DEBUG] [LOCAL ] BTCM: Trimmed 19914 records to 16664 (keeping 200 days of data) [2025-10-14T17:47:48.078515] [DEBUG] [LOCAL ] BTCM: Primary data saved (16664 records). [2025-10-14T17:47:48.078669] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-14T17:47:48.078785] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BTCM took 29.2s. Estimated remaining: 4h 39m 8s. Rate: 7.2 symbols/min [2025-10-14T17:47:48.247836] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:48.300189] [DEBUG] [LOCAL ] BTE: Loaded 52723 existing records from primary storage. [2025-10-14T17:47:48.300509] [INFO ] [MAIN ] BTE: Loaded 52723 existing records. [2025-10-14T17:47:48.482732] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:48.482988] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-14T17:47:48.483106] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-14T17:47:48.483632] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-14T17:47:48.483740] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-14T17:47:48.763340] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-14T17:47:48.842739] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T17:47:48.885699] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:48.886373] [INFO ] [REMOTE ] BSX: Full fetch complete (77463 records). [2025-10-14T17:47:48.886529] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-14T17:47:48.887470] [FATAL] [VALIDATOR ] BSX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:47:48.887560] [FATAL] [MAIN ] BSX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:47:48.887603] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:47:48.887665] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-14T17:47:48.887749] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-14T17:47:48.887787] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-14T17:47:48.888030] [DEBUG] [LOCAL ] BSX: Deleted derivative data file. [2025-10-14T17:47:48.888713] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSX took 37.3s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-14T17:47:49.056388] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:49.109592] [DEBUG] [LOCAL ] BTI: Loaded 53591 existing records from primary storage. [2025-10-14T17:47:49.109923] [INFO ] [MAIN ] BTI: Loaded 53591 existing records. [2025-10-14T17:47:49.286280] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:49.286536] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-14T17:47:49.286583] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-14T17:47:49.287043] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-14T17:47:49.287113] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-14T17:47:49.565177] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-14T17:47:49.683928] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:49.959828] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T17:47:49.963550] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36729 records). [2025-10-14T17:47:49.963773] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-14T17:47:50.363085] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-14T17:47:50.463033] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T17:47:50.484819] [INFO ] [REMOTE ] BTA: Full fetch complete (9557 records). [2025-10-14T17:47:50.503675] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-14T17:47:50.504174] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-14T17:47:50.504270] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-14T17:47:50.550103] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-14T17:47:50.592568] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-14T17:47:50.651843] [DEBUG] [LOCAL ] BSTZ: Trimmed 36729 records to 25010 (keeping 200 days of data) [2025-10-14T17:47:51.045697] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-14T17:47:51.049822] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-14T17:47:51.051404] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-14T17:47:51.051931] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-14T17:47:51.053972] [DEBUG] [LOCAL ] BTA: Trimmed 9557 records to 5627 (keeping 200 days of data) [2025-10-14T17:47:51.096078] [DEBUG] [LOCAL ] BTA: Primary data saved (5627 records). [2025-10-14T17:47:51.097166] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-14T17:47:51.097566] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTA took 35.2s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-14T17:47:51.163482] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-14T17:47:51.325544] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:51.331350] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25010 records). [2025-10-14T17:47:51.331557] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-14T17:47:51.331676] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BSTZ took 50.4s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-14T17:47:51.426003] [DEBUG] [LOCAL ] BTO: Loaded 8741 existing records from primary storage. [2025-10-14T17:47:51.433789] [INFO ] [MAIN ] BTO: Loaded 8741 existing records. [2025-10-14T17:47:51.663434] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:47:51.692809] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:51.693021] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-14T17:47:51.693133] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-14T17:47:51.693311] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-14T17:47:51.693354] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-14T17:47:51.826553] [DEBUG] [LOCAL ] BTT: Loaded 15801 existing records from primary storage. [2025-10-14T17:47:51.842387] [INFO ] [MAIN ] BTT: Loaded 15801 existing records. [2025-10-14T17:47:52.171584] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:47:52.191145] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-14T17:47:52.194754] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-14T17:47:52.195244] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-14T17:47:52.200565] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-14T17:47:52.329488] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:52.350474] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-14T17:47:52.663621] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:47:52.665729] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-14T17:47:52.758039] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-14T17:47:52.936672] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T17:47:53.256405] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-14T17:47:53.558113] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-14T17:47:53.924966] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T17:47:54.311742] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T17:47:54.358053] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-14T17:47:55.158060] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-14T17:47:55.959104] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-14T17:47:55.961781] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T17:47:56.210536] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T17:47:56.512827] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T17:47:56.758112] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-14T17:47:57.558092] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-14T17:47:57.647695] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T17:47:58.358132] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-14T17:47:58.983118] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T17:47:59.158057] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-14T17:47:59.304373] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-14T17:47:59.735453] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T17:47:59.958130] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-14T17:48:00.758103] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-14T17:48:01.558102] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-14T17:48:01.818552] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T17:48:02.041529] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-14T17:48:02.325264] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T17:48:02.358052] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-14T17:48:03.122015] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T17:48:03.158037] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-14T17:48:03.958115] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-14T17:48:04.075916] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T17:48:04.758107] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-14T17:48:05.558060] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-14T17:48:06.348384] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T17:48:06.358036] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-14T17:48:06.517170] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T17:48:06.826996] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T17:48:07.158074] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-14T17:48:07.284555] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (3.33 seconds). [2025-10-14T17:48:07.907944] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T17:48:07.958043] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-14T17:48:08.558054] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T17:48:08.559533] [INFO ] [REMOTE ] BTO: Full fetch complete (13174 records). [2025-10-14T17:48:08.559601] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-14T17:48:08.765763] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-14T17:48:08.934413] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-14T17:48:08.934524] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-14T17:48:08.934828] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-14T17:48:08.934888] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-14T17:48:08.935355] [DEBUG] [LOCAL ] BTO: Trimmed 13174 records to 8779 (keeping 200 days of data) [2025-10-14T17:48:08.985976] [DEBUG] [LOCAL ] BTO: Primary data saved (8779 records). [2025-10-14T17:48:08.986078] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-14T17:48:08.986150] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTO took 17.9s. Estimated remaining: 4h 37m 24s. Rate: 7.3 symbols/min [2025-10-14T17:48:09.156195] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:09.204963] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-14T17:48:09.205256] [INFO ] [MAIN ] BTU: Loaded 53318 existing records. [2025-10-14T17:48:09.378748] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:48:09.378920] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-14T17:48:09.378966] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-14T17:48:09.379835] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-14T17:48:09.379892] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-14T17:48:09.565042] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-14T17:48:09.734343] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:09.948688] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T17:48:10.358065] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-14T17:48:11.158048] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-14T17:48:11.414707] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T17:48:11.829058] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T17:48:11.827311] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T17:48:11.958060] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-14T17:48:12.758105] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-14T17:48:12.924894] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T17:48:13.558091] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-14T17:48:14.358107] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-14T17:48:14.457797] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T17:48:14.955150] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T17:48:15.158149] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-14T17:48:15.580933] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-14T17:48:15.958063] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-14T17:48:16.758126] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-14T17:48:16.990250] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T17:48:17.558114] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-14T17:48:17.700156] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T17:48:18.358087] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-14T17:48:18.703605] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T17:48:18.998814] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T17:48:19.019274] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T17:48:19.158072] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-14T17:48:19.906675] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T17:48:19.909093] [INFO ] [REMOTE ] BTT: Full fetch complete (23086 records). [2025-10-14T17:48:19.909172] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-14T17:48:19.966201] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-14T17:48:20.307916] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-14T17:48:20.308050] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-14T17:48:20.308660] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-14T17:48:20.308722] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-14T17:48:20.309506] [DEBUG] [LOCAL ] BTT: Trimmed 23086 records to 15724 (keeping 200 days of data) [2025-10-14T17:48:20.410694] [DEBUG] [LOCAL ] BTT: Primary data saved (15724 records). [2025-10-14T17:48:20.410958] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-14T17:48:20.411092] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTT took 29.1s. Estimated remaining: 4h 37m 34s. Rate: 7.3 symbols/min [2025-10-14T17:48:20.611206] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:20.611475] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-14T17:48:20.611515] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-14T17:48:20.611662] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-14T17:48:20.611720] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-14T17:48:20.611804] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-14T17:48:20.611840] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-14T17:48:20.763316] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-14T17:48:20.985198] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:21.558052] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-14T17:48:21.909441] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-14T17:48:22.358106] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-14T17:48:22.554052] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:48:22.554352] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-14T17:48:22.554457] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:48:22.554525] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-14T17:48:22.554589] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:48:22.554683] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-14T17:48:22.554753] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-14T17:48:22.554791] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-14T17:48:22.554829] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-14T17:48:22.554873] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTX took 2.1s. Estimated remaining: 4h 36m 51s. Rate: 7.3 symbols/min [2025-10-14T17:48:22.742157] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:22.763579] [DEBUG] [LOCAL ] BTZ: Loaded 22651 existing records from primary storage. [2025-10-14T17:48:22.763924] [INFO ] [MAIN ] BTZ: Loaded 22651 existing records. [2025-10-14T17:48:22.968996] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:48:22.969516] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-14T17:48:22.970760] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-14T17:48:22.971318] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-14T17:48:22.971374] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-14T17:48:23.175331] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-14T17:48:23.257953] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-14T17:48:23.381944] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T17:48:23.421184] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:23.958141] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-14T17:48:24.758091] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-14T17:48:25.427789] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-14T17:48:25.558040] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-14T17:48:25.618879] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T17:48:26.358123] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-14T17:48:26.729074] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T17:48:27.158112] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-14T17:48:27.568551] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-14T17:48:27.607262] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T17:48:27.958079] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-14T17:48:28.712355] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T17:48:28.758078] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-14T17:48:29.558060] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-14T17:48:29.812242] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T17:48:30.043420] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T17:48:30.049139] [INFO ] [REMOTE ] BTE: Full fetch complete (75927 records). [2025-10-14T17:48:30.049340] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-14T17:48:30.050055] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:48:30.050146] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:48:30.050190] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:48:30.050230] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-14T17:48:30.050286] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-14T17:48:30.050322] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-14T17:48:30.050602] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-14T17:48:30.050724] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTE took 42.0s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-14T17:48:30.221246] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:30.269928] [DEBUG] [LOCAL ] BUD: Loaded 52658 existing records from primary storage. [2025-10-14T17:48:30.270225] [INFO ] [MAIN ] BUD: Loaded 52658 existing records. [2025-10-14T17:48:30.363149] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-14T17:48:30.450284] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:48:30.450476] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-14T17:48:30.450522] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-14T17:48:30.451506] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-14T17:48:30.451564] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-14T17:48:30.809768] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:31.158059] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-14T17:48:31.301449] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T17:48:31.476909] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T17:48:31.958097] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-14T17:48:32.758103] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-14T17:48:32.820450] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T17:48:33.558095] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-14T17:48:33.954833] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T17:48:34.358068] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-14T17:48:34.469979] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T17:48:35.158176] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-14T17:48:35.451869] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T17:48:35.904680] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T17:48:35.958075] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-14T17:48:36.447581] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T17:48:36.758108] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-14T17:48:36.774159] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T17:48:37.558083] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-14T17:48:38.358075] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-14T17:48:38.654220] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T17:48:39.158067] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-14T17:48:39.400337] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T17:48:39.429074] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T17:48:39.958082] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-14T17:48:40.758060] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-14T17:48:41.151079] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T17:48:41.386008] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T17:48:41.391929] [INFO ] [REMOTE ] BTU: Full fetch complete (77226 records). [2025-10-14T17:48:41.392051] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-14T17:48:41.566478] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-14T17:48:41.788661] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-14T17:48:41.788752] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-14T17:48:41.789615] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-14T17:48:41.789692] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-14T17:48:41.791146] [DEBUG] [LOCAL ] BTU: Trimmed 77226 records to 53323 (keeping 200 days of data) [2025-10-14T17:48:42.108511] [DEBUG] [LOCAL ] BTU: Primary data saved (53323 records). [2025-10-14T17:48:42.108640] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-14T17:48:42.108789] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTU took 33.1s. Estimated remaining: 4h 36m 52s. Rate: 7.3 symbols/min [2025-10-14T17:48:42.284278] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:42.296098] [DEBUG] [LOCAL ] BUI: Loaded 11920 existing records from primary storage. [2025-10-14T17:48:42.296362] [INFO ] [MAIN ] BUI: Loaded 11920 existing records. [2025-10-14T17:48:42.361719] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-14T17:48:42.485462] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:48:42.485863] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-14T17:48:42.486091] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-14T17:48:42.486476] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-14T17:48:42.486659] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-14T17:48:42.792842] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T17:48:42.919901] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:42.935290] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T17:48:43.158138] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-14T17:48:43.958092] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-14T17:48:44.179434] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T17:48:44.238763] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T17:48:44.758134] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-14T17:48:45.558145] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-14T17:48:45.839849] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T17:48:45.945535] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-14T17:48:45.951843] [INFO ] [REMOTE ] BTI: Full fetch complete (77630 records). [2025-10-14T17:48:45.951976] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-14T17:48:46.360961] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-14T17:48:46.361037] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-14T17:48:46.362017] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-14T17:48:46.361917] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-14T17:48:46.362319] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-14T17:48:46.364704] [DEBUG] [LOCAL ] BTI: Trimmed 77630 records to 53590 (keeping 200 days of data) [2025-10-14T17:48:46.687826] [DEBUG] [LOCAL ] BTI: Primary data saved (53590 records). [2025-10-14T17:48:46.687960] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-14T17:48:46.688507] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTI took 57.8s. Estimated remaining: 4h 36m 23s. Rate: 7.3 symbols/min [2025-10-14T17:48:46.863596] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:46.910059] [DEBUG] [LOCAL ] BUR: Loaded 45304 existing records from primary storage. [2025-10-14T17:48:46.910352] [INFO ] [MAIN ] BUR: Loaded 45304 existing records. [2025-10-14T17:48:47.114196] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:48:47.114463] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-14T17:48:47.114543] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-14T17:48:47.115428] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-14T17:48:47.115486] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-14T17:48:47.190910] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-14T17:48:47.273858] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T17:48:47.488702] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:48:47.553129] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:47.958056] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-14T17:48:47.961842] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T17:48:48.758074] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-14T17:48:49.501234] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T17:48:49.558091] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-14T17:48:49.985819] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T17:48:50.358162] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-14T17:48:51.158500] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T17:48:51.158636] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-14T17:48:51.195989] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T17:48:51.958097] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-14T17:48:52.106524] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T17:48:52.109752] [INFO ] [REMOTE ] BTZ: Full fetch complete (33508 records). [2025-10-14T17:48:52.109863] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-14T17:48:52.497443] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-14T17:48:52.497540] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-14T17:48:52.498164] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-14T17:48:52.498227] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-14T17:48:52.499433] [DEBUG] [LOCAL ] BTZ: Trimmed 33508 records to 22641 (keeping 200 days of data) [2025-10-14T17:48:52.632605] [DEBUG] [LOCAL ] BTZ: Primary data saved (22641 records). [2025-10-14T17:48:52.632763] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-14T17:48:52.632875] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BTZ took 30.1s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-14T17:48:52.755876] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T17:48:52.766346] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-14T17:48:52.824593] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:48:52.866110] [DEBUG] [LOCAL ] BURL: Loaded 45749 existing records from primary storage. [2025-10-14T17:48:52.866409] [INFO ] [MAIN ] BURL: Loaded 45749 existing records. [2025-10-14T17:48:53.044504] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:48:53.044752] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-14T17:48:53.044813] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-14T17:48:53.045783] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-14T17:48:53.045841] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-14T17:48:53.412485] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:48:53.558105] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-14T17:48:54.358067] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-14T17:48:54.440299] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T17:48:54.851484] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T17:48:55.158086] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-14T17:48:55.958108] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-14T17:48:56.193080] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T17:48:56.722622] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T17:48:56.758048] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-14T17:48:57.456161] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T17:48:57.558094] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-14T17:48:58.358057] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-14T17:48:58.758895] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-14T17:48:59.023183] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T17:48:59.156976] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T17:48:59.159310] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-14T17:48:59.958088] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-14T17:49:00.758161] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-14T17:49:00.971492] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T17:49:01.476609] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-14T17:49:01.558106] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-14T17:49:02.312561] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T17:49:02.358111] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-14T17:49:02.381534] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T17:49:03.158125] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-14T17:49:03.958059] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-14T17:49:04.051255] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T17:49:04.057558] [INFO ] [REMOTE ] BUD: Full fetch complete (76523 records). [2025-10-14T17:49:04.057759] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-14T17:49:04.483736] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-14T17:49:04.483838] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-14T17:49:04.484883] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-14T17:49:04.484957] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-14T17:49:04.486578] [DEBUG] [LOCAL ] BUD: Trimmed 76523 records to 52625 (keeping 200 days of data) [2025-10-14T17:49:04.597456] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-14T17:49:04.781845] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-14T17:49:04.828261] [DEBUG] [LOCAL ] BUD: Primary data saved (52625 records). [2025-10-14T17:49:04.828407] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-14T17:49:04.828491] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUD took 34.8s. Estimated remaining: 4h 36m 16s. Rate: 7.3 symbols/min [2025-10-14T17:49:04.961177] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T17:49:05.558093] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-14T17:49:06.358137] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-14T17:49:06.729031] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T17:49:06.801234] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T17:49:07.158112] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-14T17:49:07.401082] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T17:49:07.958113] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-14T17:49:08.756290] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T17:49:08.758155] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-14T17:49:08.805285] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T17:49:09.558084] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-14T17:49:10.358144] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-14T17:49:10.509800] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T17:49:10.971910] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T17:49:11.158171] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-14T17:49:11.399299] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T17:49:11.958102] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-14T17:49:12.685755] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T17:49:12.687225] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T17:49:12.698729] [INFO ] [REMOTE ] BUI: Full fetch complete (16568 records). [2025-10-14T17:49:12.699078] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-14T17:49:12.764212] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-14T17:49:13.063884] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-14T17:49:13.063964] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-14T17:49:13.064401] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-14T17:49:13.064442] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-14T17:49:13.065065] [DEBUG] [LOCAL ] BUI: Trimmed 16568 records to 11942 (keeping 200 days of data) [2025-10-14T17:49:13.135707] [DEBUG] [LOCAL ] BUI: Primary data saved (11942 records). [2025-10-14T17:49:13.135834] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-14T17:49:13.135923] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUI took 31.0s. Estimated remaining: 4h 36m 8s. Rate: 7.3 symbols/min [2025-10-14T17:49:13.558067] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-14T17:49:14.411233] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T17:49:14.421886] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-14T17:49:14.854184] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T17:49:15.158099] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-14T17:49:16.238459] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T17:49:16.248175] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-14T17:49:16.536925] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T17:49:16.758108] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-14T17:49:17.776349] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T17:49:17.781533] [INFO ] [REMOTE ] BUR: Full fetch complete (63982 records). [2025-10-14T17:49:17.781708] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-14T17:49:18.179724] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-14T17:49:18.179982] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-14T17:49:18.180834] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-14T17:49:18.181039] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-14T17:49:18.183091] [DEBUG] [LOCAL ] BUR: Trimmed 63982 records to 45343 (keeping 200 days of data) [2025-10-14T17:49:18.295345] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T17:49:18.309272] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-14T17:49:18.488670] [DEBUG] [LOCAL ] BUR: Primary data saved (45343 records). [2025-10-14T17:49:18.488803] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-14T17:49:18.489367] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUR took 31.8s. Estimated remaining: 4h 35m 44s. Rate: 7.3 symbols/min [2025-10-14T17:49:20.011605] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T17:49:20.021458] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-14T17:49:21.489599] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T17:49:21.494846] [INFO ] [REMOTE ] BURL: Full fetch complete (65855 records). [2025-10-14T17:49:21.494989] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-14T17:49:21.891052] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-14T17:49:21.891130] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-14T17:49:21.891893] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-14T17:49:21.891953] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-14T17:49:21.893197] [DEBUG] [LOCAL ] BURL: Trimmed 65855 records to 45744 (keeping 200 days of data) [2025-10-14T17:49:22.167629] [DEBUG] [LOCAL ] BURL: Primary data saved (45744 records). [2025-10-14T17:49:22.167789] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-14T17:49:22.167870] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BURL took 29.5s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-14T17:49:22.891986] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:22.883730] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:22.910549] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:22.909720] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:22.947038] [DEBUG] [LOCAL ] BUXX: Loaded 15320 existing records from primary storage. [2025-10-14T17:49:22.947445] [INFO ] [MAIN ] BUXX: Loaded 15320 existing records. [2025-10-14T17:49:23.067327] [DEBUG] [LOCAL ] BV: Loaded 38568 existing records from primary storage. [2025-10-14T17:49:23.097188] [DEBUG] [LOCAL ] BVN: Loaded 44224 existing records from primary storage. [2025-10-14T17:49:23.096335] [INFO ] [MAIN ] BV: Loaded 38568 existing records. [2025-10-14T17:49:23.097520] [INFO ] [MAIN ] BVN: Loaded 44224 existing records. [2025-10-14T17:49:23.273848] [DEBUG] [LOCAL ] BW: Loaded 40411 existing records from primary storage. [2025-10-14T17:49:23.360025] [INFO ] [MAIN ] BW: Loaded 40411 existing records. [2025-10-14T17:49:23.398875] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:23.442771] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-14T17:49:23.525587] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-14T17:49:23.622636] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:23.643793] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-14T17:49:23.657208] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-14T17:49:23.633447] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-14T17:49:23.671921] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-14T17:49:23.683405] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:23.674059] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-14T17:49:23.704625] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-14T17:49:23.739921] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-14T17:49:23.729536] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-14T17:49:23.769668] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-14T17:49:23.769846] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-14T17:49:23.941758] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:23.989522] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-14T17:49:24.009081] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-14T17:49:24.080188] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-14T17:49:24.101827] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-14T17:49:25.036279] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:25.095307] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:25.125178] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-14T17:49:25.156526] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-14T17:49:25.229155] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:25.245440] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-14T17:49:25.312751] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:25.313134] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-14T17:49:25.888697] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T17:49:25.891633] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-14T17:49:26.669804] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T17:49:26.672724] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-14T17:49:26.839862] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T17:49:26.846906] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-14T17:49:26.879284] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T17:49:26.889277] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-14T17:49:26.917841] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T17:49:26.928999] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-14T17:49:27.131904] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T17:49:27.134524] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-14T17:49:27.859549] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T17:49:27.865603] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-14T17:49:27.931146] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T17:49:27.958050] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-14T17:49:28.115167] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T17:49:28.386367] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T17:49:28.758099] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-14T17:49:29.002803] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T17:49:29.441967] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T17:49:29.558044] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-14T17:49:30.132108] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T17:49:30.358113] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-14T17:49:30.688592] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:49:31.115637] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T17:49:31.158126] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-14T17:49:31.958134] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-14T17:49:32.358576] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T17:49:32.758092] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-14T17:49:33.411197] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T17:49:33.558077] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-14T17:49:33.924936] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T17:49:34.358094] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-14T17:49:34.981627] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T17:49:35.158133] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-14T17:49:35.935576] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T17:49:35.958110] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-14T17:49:35.981422] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T17:49:36.758124] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-14T17:49:37.355715] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T17:49:37.558087] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-14T17:49:38.358103] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-14T17:49:38.429070] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T17:49:39.158087] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-14T17:49:39.212698] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T17:49:39.251943] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T17:49:39.958138] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-14T17:49:40.606939] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T17:49:40.758068] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-14T17:49:41.158540] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T17:49:41.558085] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-14T17:49:41.827717] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T17:49:42.358142] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-14T17:49:42.394325] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T17:49:43.158064] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-14T17:49:43.857250] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T17:49:43.958121] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-14T17:49:44.323714] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T17:49:44.758089] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-14T17:49:44.978613] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T17:49:45.558107] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-14T17:49:46.157699] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T17:49:46.255218] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T17:49:46.358074] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-14T17:49:47.158132] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-14T17:49:47.765659] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T17:49:47.767424] [INFO ] [REMOTE ] BUXX: Full fetch complete (20388 records). [2025-10-14T17:49:47.767493] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-14T17:49:47.767927] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:49:47.768036] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:49:47.768104] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:49:47.768185] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-14T17:49:47.768249] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-14T17:49:47.768284] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-14T17:49:47.768497] [DEBUG] [LOCAL ] BUXX: Deleted derivative data file. [2025-10-14T17:49:47.768584] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BUXX took 25.6s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-14T17:49:47.963777] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-14T17:49:47.968788] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:47.965312] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T17:49:48.030330] [DEBUG] [LOCAL ] BWA: Loaded 52168 existing records from primary storage. [2025-10-14T17:49:48.030712] [INFO ] [MAIN ] BWA: Loaded 52168 existing records. [2025-10-14T17:49:48.210394] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:48.210630] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-14T17:49:48.210712] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-14T17:49:48.211791] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-14T17:49:48.211848] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-14T17:49:48.572405] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:48.758067] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-14T17:49:49.558107] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-14T17:49:49.840241] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T17:49:50.166784] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T17:49:50.358115] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-14T17:49:51.141224] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T17:49:51.158082] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-14T17:49:51.918197] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T17:49:51.958151] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-14T17:49:52.421734] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T17:49:52.427030] [INFO ] [REMOTE ] BV: Full fetch complete (54689 records). [2025-10-14T17:49:52.427213] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-14T17:49:52.764085] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-14T17:49:52.934997] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-14T17:49:52.935130] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-14T17:49:52.936209] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-14T17:49:52.936290] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-14T17:49:52.938320] [DEBUG] [LOCAL ] BV: Trimmed 54689 records to 38559 (keeping 200 days of data) [2025-10-14T17:49:53.210669] [DEBUG] [LOCAL ] BV: Primary data saved (38559 records). [2025-10-14T17:49:53.210833] [INFO ] [MAIN ] BV: Full history saved. [2025-10-14T17:49:53.210948] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BV took 31.0s. Estimated remaining: 4h 36m 15s. Rate: 7.3 symbols/min [2025-10-14T17:49:53.397699] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:53.411315] [DEBUG] [LOCAL ] BWG: Loaded 12657 existing records from primary storage. [2025-10-14T17:49:53.411546] [INFO ] [MAIN ] BWG: Loaded 12657 existing records. [2025-10-14T17:49:53.556141] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T17:49:53.569778] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-14T17:49:53.620989] [INFO ] [REMOTE ] BW: Full fetch complete (59277 records). [2025-10-14T17:49:53.656990] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:53.657610] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-14T17:49:53.657934] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-14T17:49:53.658438] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-14T17:49:53.659052] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-14T17:49:53.665040] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-14T17:49:54.549480] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-14T17:49:54.549295] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:54.549893] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-14T17:49:54.550139] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-14T17:49:54.551377] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-14T17:49:54.551498] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-14T17:49:54.583333] [DEBUG] [LOCAL ] BW: Trimmed 59277 records to 40458 (keeping 200 days of data) [2025-10-14T17:49:54.592262] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T17:49:54.880498] [DEBUG] [LOCAL ] BW: Primary data saved (40458 records). [2025-10-14T17:49:54.884179] [INFO ] [MAIN ] BW: Full history saved. [2025-10-14T17:49:54.884494] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BW took 32.7s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-14T17:49:54.893638] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T17:49:55.075825] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:49:55.110296] [DEBUG] [LOCAL ] BWLP: Loaded 32405 existing records from primary storage. [2025-10-14T17:49:55.110589] [INFO ] [MAIN ] BWLP: Loaded 32405 existing records. [2025-10-14T17:49:55.167331] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-14T17:49:55.323979] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:49:55.325073] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-14T17:49:55.325133] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-14T17:49:55.325958] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-14T17:49:55.326017] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-14T17:49:55.449350] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T17:49:55.696173] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:49:55.958123] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-14T17:49:56.758128] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-14T17:49:56.854443] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T17:49:57.164725] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T17:49:57.337937] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T17:49:57.558099] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-14T17:49:58.358139] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-14T17:49:58.951359] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:49:59.158066] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-14T17:49:59.166265] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T17:49:59.958104] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-14T17:50:00.758107] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-14T17:50:00.817394] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T17:50:00.822931] [INFO ] [REMOTE ] BVN: Full fetch complete (63106 records). [2025-10-14T17:50:00.823084] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-14T17:50:01.212610] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-14T17:50:01.212755] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-14T17:50:01.213495] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-14T17:50:01.213618] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-14T17:50:01.214933] [DEBUG] [LOCAL ] BVN: Trimmed 63106 records to 44242 (keeping 200 days of data) [2025-10-14T17:50:01.440943] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T17:50:01.500781] [DEBUG] [LOCAL ] BVN: Primary data saved (44242 records). [2025-10-14T17:50:01.500913] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-14T17:50:01.502057] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BVN took 39.3s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-14T17:50:01.564485] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-14T17:50:01.672124] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:01.685104] [DEBUG] [LOCAL ] BWMX: Loaded 7770 existing records from primary storage. [2025-10-14T17:50:01.685332] [INFO ] [MAIN ] BWMX: Loaded 7770 existing records. [2025-10-14T17:50:01.885686] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:01.885859] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-14T17:50:01.885907] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-14T17:50:01.886165] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-14T17:50:01.886223] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-14T17:50:02.253496] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:02.358086] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-14T17:50:02.567557] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T17:50:03.163320] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-14T17:50:03.168709] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T17:50:03.217252] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T17:50:03.958108] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-14T17:50:04.758130] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-14T17:50:04.807146] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T17:50:05.067348] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T17:50:05.433088] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T17:50:05.558112] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-14T17:50:06.358167] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-14T17:50:06.523148] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T17:50:07.158132] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-14T17:50:07.851132] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T17:50:07.958089] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-14T17:50:08.089345] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T17:50:08.758160] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-14T17:50:09.424577] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T17:50:09.558076] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-14T17:50:10.358070] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-14T17:50:10.611258] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T17:50:10.642831] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T17:50:11.158194] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-14T17:50:11.605031] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-14T17:50:11.755263] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T17:50:11.958121] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-14T17:50:12.703122] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T17:50:12.758117] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-14T17:50:13.552139] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T17:50:13.558031] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-14T17:50:14.281421] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T17:50:14.358128] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-14T17:50:15.158142] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-14T17:50:15.259135] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-14T17:50:15.634986] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-14T17:50:15.958087] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-14T17:50:16.758116] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-14T17:50:16.827096] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T17:50:17.558134] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-14T17:50:18.358067] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-14T17:50:18.403071] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T17:50:19.158105] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-14T17:50:19.346728] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T17:50:19.898047] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T17:50:19.918316] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T17:50:19.958039] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-14T17:50:20.635413] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T17:50:20.758093] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-14T17:50:21.558094] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-14T17:50:22.220466] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T17:50:22.358059] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-14T17:50:22.510564] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T17:50:22.987730] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T17:50:22.989531] [INFO ] [REMOTE ] BWMX: Full fetch complete (10062 records). [2025-10-14T17:50:22.989629] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-14T17:50:23.158833] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-14T17:50:23.392914] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-14T17:50:23.392993] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-14T17:50:23.393236] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-14T17:50:23.393275] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-14T17:50:23.393751] [DEBUG] [LOCAL ] BWMX: Trimmed 10062 records to 7777 (keeping 200 days of data) [2025-10-14T17:50:23.438443] [DEBUG] [LOCAL ] BWMX: Primary data saved (7777 records). [2025-10-14T17:50:23.438530] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-14T17:50:23.438599] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWMX took 21.9s. Estimated remaining: 4h 36m 20s. Rate: 7.3 symbols/min [2025-10-14T17:50:23.612717] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:23.619078] [DEBUG] [LOCAL ] BWNB: Loaded 4239 existing records from primary storage. [2025-10-14T17:50:23.619219] [INFO ] [MAIN ] BWNB: Loaded 4239 existing records. [2025-10-14T17:50:23.803705] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:23.803908] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-14T17:50:23.803961] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-14T17:50:23.804089] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-14T17:50:23.804125] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-14T17:50:23.965665] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-14T17:50:24.170835] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:24.758139] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-14T17:50:24.909191] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T17:50:25.103058] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T17:50:25.389037] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-14T17:50:25.558078] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-14T17:50:26.358111] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-14T17:50:26.945863] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T17:50:26.950310] [INFO ] [REMOTE ] BWLP: Full fetch complete (48138 records). [2025-10-14T17:50:26.950443] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-14T17:50:27.165583] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-14T17:50:27.410875] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-14T17:50:27.410985] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-14T17:50:27.411862] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-14T17:50:27.411932] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-14T17:50:27.413472] [DEBUG] [LOCAL ] BWLP: Trimmed 48138 records to 32295 (keeping 200 days of data) [2025-10-14T17:50:27.625334] [DEBUG] [LOCAL ] BWLP: Primary data saved (32295 records). [2025-10-14T17:50:27.625481] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-14T17:50:27.625562] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWLP took 32.7s. Estimated remaining: 4h 35m 49s. Rate: 7.3 symbols/min [2025-10-14T17:50:27.795754] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:27.803368] [DEBUG] [LOCAL ] BWSN: Loaded 5132 existing records from primary storage. [2025-10-14T17:50:27.803697] [INFO ] [MAIN ] BWSN: Loaded 5132 existing records. [2025-10-14T17:50:27.962758] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-14T17:50:27.984666] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:27.984937] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-14T17:50:27.985069] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-14T17:50:27.985281] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-14T17:50:27.985348] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-14T17:50:28.089947] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T17:50:28.123445] [INFO ] [REMOTE ] BWG: Full fetch complete (17797 records). [2025-10-14T17:50:28.173965] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-14T17:50:28.200970] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T17:50:28.536115] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T17:50:28.583383] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:28.766618] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-14T17:50:28.802154] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-14T17:50:28.802219] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-14T17:50:28.802737] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-14T17:50:28.802815] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-14T17:50:28.803813] [DEBUG] [LOCAL ] BWG: Trimmed 17797 records to 12616 (keeping 200 days of data) [2025-10-14T17:50:28.876262] [DEBUG] [LOCAL ] BWG: Primary data saved (12616 records). [2025-10-14T17:50:28.876379] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-14T17:50:28.876456] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWG took 35.7s. Estimated remaining: 4h 35m 3s. Rate: 7.3 symbols/min [2025-10-14T17:50:29.043905] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:29.086493] [DEBUG] [LOCAL ] BWXT: Loaded 46959 existing records from primary storage. [2025-10-14T17:50:29.086816] [INFO ] [MAIN ] BWXT: Loaded 46959 existing records. [2025-10-14T17:50:29.268363] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:29.268617] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-14T17:50:29.268697] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-14T17:50:29.269249] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-14T17:50:29.269307] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-14T17:50:29.376011] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T17:50:29.563035] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-14T17:50:29.640348] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:30.038450] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T17:50:30.358076] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-14T17:50:30.842976] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T17:50:31.158067] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-14T17:50:31.571037] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-14T17:50:31.958130] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-14T17:50:32.758141] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-14T17:50:33.558149] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-14T17:50:33.852278] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T17:50:34.162734] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T17:50:34.187342] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T17:50:34.358098] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-14T17:50:35.158131] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-14T17:50:35.775623] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T17:50:35.958139] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-14T17:50:36.080548] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T17:50:36.561090] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-14T17:50:36.758113] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-14T17:50:37.558068] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-14T17:50:38.358112] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-14T17:50:38.440031] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T17:50:38.674664] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-14T17:50:38.925208] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T17:50:39.158113] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-14T17:50:39.958103] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-14T17:50:39.985951] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T17:50:40.758124] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-14T17:50:41.558165] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-14T17:50:41.587203] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T17:50:41.660980] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T17:50:41.666934] [INFO ] [REMOTE ] BWA: Full fetch complete (75870 records). [2025-10-14T17:50:41.667067] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-14T17:50:42.099040] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-14T17:50:42.099146] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-14T17:50:42.099992] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-14T17:50:42.100057] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-14T17:50:42.101506] [DEBUG] [LOCAL ] BWA: Trimmed 75870 records to 52150 (keeping 200 days of data) [2025-10-14T17:50:42.368258] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-14T17:50:42.411489] [DEBUG] [LOCAL ] BWA: Primary data saved (52150 records). [2025-10-14T17:50:42.411620] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-14T17:50:42.411729] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWA took 54.6s. Estimated remaining: 4h 35m 23s. Rate: 7.3 symbols/min [2025-10-14T17:50:42.577625] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:42.628941] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-14T17:50:42.629256] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-14T17:50:42.809307] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:42.809530] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-14T17:50:42.809582] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-14T17:50:42.810034] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-14T17:50:42.810090] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-14T17:50:42.884308] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-14T17:50:43.158630] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-14T17:50:43.171333] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:43.200830] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:50:43.860869] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T17:50:43.958140] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-14T17:50:44.532465] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-14T17:50:44.758132] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-14T17:50:45.512872] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T17:50:45.558181] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-14T17:50:46.030442] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-14T17:50:46.358097] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-14T17:50:46.816033] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T17:50:47.158056] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-14T17:50:47.958147] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-14T17:50:48.416271] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T17:50:48.758083] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-14T17:50:49.033397] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T17:50:49.137751] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T17:50:49.139070] [INFO ] [REMOTE ] BWNB: Full fetch complete (5651 records). [2025-10-14T17:50:49.139148] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-14T17:50:49.532711] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-14T17:50:49.532836] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-14T17:50:49.533069] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-14T17:50:49.533112] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-14T17:50:49.533536] [DEBUG] [LOCAL ] BWNB: Trimmed 5651 records to 4215 (keeping 200 days of data) [2025-10-14T17:50:49.561971] [DEBUG] [LOCAL ] BWNB: Primary data saved (4215 records). [2025-10-14T17:50:49.561725] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-14T17:50:49.562383] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-14T17:50:49.563514] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWNB took 26.1s. Estimated remaining: 4h 35m 9s. Rate: 7.3 symbols/min [2025-10-14T17:50:49.731691] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:49.745890] [DEBUG] [LOCAL ] BXC: Loaded 13689 existing records from primary storage. [2025-10-14T17:50:49.746101] [INFO ] [MAIN ] BXC: Loaded 13689 existing records. [2025-10-14T17:50:49.942424] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:49.942681] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-14T17:50:49.942740] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-14T17:50:49.942980] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-14T17:50:49.943038] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-14T17:50:50.292196] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:50.358044] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-14T17:50:51.158140] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-14T17:50:51.608159] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-14T17:50:51.711689] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T17:50:51.760999] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T17:50:51.958074] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-14T17:50:52.725488] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T17:50:52.758045] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-14T17:50:53.300031] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T17:50:53.558151] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-14T17:50:54.135045] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T17:50:54.358099] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-14T17:50:54.838102] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T17:50:54.839298] [INFO ] [REMOTE ] BWSN: Full fetch complete (6315 records). [2025-10-14T17:50:54.839366] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-14T17:50:55.172986] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-14T17:50:55.215336] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-14T17:50:55.215409] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-14T17:50:55.215567] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-14T17:50:55.215604] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-14T17:50:55.216031] [DEBUG] [LOCAL ] BWSN: Trimmed 6315 records to 5143 (keeping 200 days of data) [2025-10-14T17:50:55.247877] [DEBUG] [LOCAL ] BWSN: Primary data saved (5143 records). [2025-10-14T17:50:55.248043] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-14T17:50:55.248161] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWSN took 27.6s. Estimated remaining: 4h 34m 47s. Rate: 7.3 symbols/min [2025-10-14T17:50:55.416293] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:50:55.459891] [DEBUG] [LOCAL ] BXMT: Loaded 47241 existing records from primary storage. [2025-10-14T17:50:55.460193] [INFO ] [MAIN ] BXMT: Loaded 47241 existing records. [2025-10-14T17:50:55.633373] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:50:55.633633] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-14T17:50:55.633715] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-14T17:50:55.634177] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-14T17:50:55.634234] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-14T17:50:55.966252] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-14T17:50:55.996074] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:50:56.758063] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-14T17:50:57.153097] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-14T17:50:57.339552] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T17:50:57.558058] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-14T17:50:57.762606] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T17:50:58.195783] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T17:50:58.358091] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-14T17:50:59.158058] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-14T17:50:59.237794] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T17:50:59.958088] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-14T17:51:00.621385] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T17:51:00.758126] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-14T17:51:01.008458] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T17:51:01.558122] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-14T17:51:02.358123] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-14T17:51:02.728400] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-14T17:51:02.891609] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T17:51:03.158100] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-14T17:51:03.958103] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-14T17:51:04.362361] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T17:51:04.595233] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T17:51:04.666462] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T17:51:04.758057] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-14T17:51:05.558114] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-14T17:51:06.358061] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-14T17:51:06.434246] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T17:51:07.158093] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-14T17:51:07.312329] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T17:51:07.459292] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T17:51:07.958111] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-14T17:51:08.758075] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-14T17:51:09.136971] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T17:51:09.558110] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-14T17:51:09.733206] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T17:51:10.141852] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T17:51:10.358126] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-14T17:51:10.503283] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T17:51:11.158155] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-14T17:51:11.958103] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-14T17:51:12.492628] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-14T17:51:12.498842] [INFO ] [REMOTE ] BWXT: Full fetch complete (67741 records). [2025-10-14T17:51:12.498962] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-14T17:51:12.768729] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-14T17:51:12.938390] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-14T17:51:12.938563] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-14T17:51:12.939355] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-14T17:51:12.939446] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-14T17:51:12.968708] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T17:51:12.967194] [DEBUG] [LOCAL ] BWXT: Trimmed 67741 records to 47039 (keeping 200 days of data) [2025-10-14T17:51:13.296527] [DEBUG] [LOCAL ] BWXT: Primary data saved (47039 records). [2025-10-14T17:51:13.296696] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-14T17:51:13.297320] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BWXT took 44.4s. Estimated remaining: 4h 35m 31s. Rate: 7.3 symbols/min [2025-10-14T17:51:13.467296] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:51:13.489546] [DEBUG] [LOCAL ] BXMX: Loaded 19531 existing records from primary storage. [2025-10-14T17:51:13.489809] [INFO ] [MAIN ] BXMX: Loaded 19531 existing records. [2025-10-14T17:51:13.558521] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-14T17:51:13.674594] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:51:13.675006] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-14T17:51:13.675062] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-14T17:51:13.675241] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-14T17:51:13.675299] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-14T17:51:13.806964] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T17:51:13.887385] [INFO ] [REMOTE ] BXC: Full fetch complete (18213 records). [2025-10-14T17:51:13.910744] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-14T17:51:14.179708] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:51:14.375202] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-14T17:51:14.498596] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-14T17:51:14.496774] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-14T17:51:14.510260] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-14T17:51:14.510731] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-14T17:51:14.510812] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-14T17:51:14.511720] [DEBUG] [LOCAL ] BXC: Trimmed 18213 records to 13691 (keeping 200 days of data) [2025-10-14T17:51:14.590179] [DEBUG] [LOCAL ] BXC: Primary data saved (13691 records). [2025-10-14T17:51:14.590309] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-14T17:51:14.590388] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BXC took 25.0s. Estimated remaining: 4h 34m 45s. Rate: 7.3 symbols/min [2025-10-14T17:51:14.757819] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:51:14.801199] [DEBUG] [LOCAL ] BXP: Loaded 49840 existing records from primary storage. [2025-10-14T17:51:14.801479] [INFO ] [MAIN ] BXP: Loaded 49840 existing records. [2025-10-14T17:51:14.979556] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:51:14.979834] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-14T17:51:14.979882] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-14T17:51:14.980207] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-14T17:51:14.980267] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-14T17:51:15.160774] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-14T17:51:15.365843] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:51:15.385691] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T17:51:15.561012] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T17:51:15.958135] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-14T17:51:16.758114] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-14T17:51:17.255459] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-14T17:51:17.558091] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-14T17:51:17.615964] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T17:51:17.763614] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T17:51:18.358139] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-14T17:51:19.158099] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-14T17:51:19.318266] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T17:51:19.381157] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T17:51:19.958138] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-14T17:51:20.758111] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-14T17:51:20.840581] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T17:51:21.558153] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-14T17:51:21.647451] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T17:51:22.289672] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T17:51:22.342364] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-14T17:51:22.358068] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-14T17:51:23.158063] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-14T17:51:23.496994] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T17:51:23.958133] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-14T17:51:24.763400] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-14T17:51:24.781252] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T17:51:25.263853] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T17:51:25.558122] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-14T17:51:26.358103] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-14T17:51:26.527788] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T17:51:26.704746] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T17:51:27.158127] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-14T17:51:27.841001] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T17:51:27.846555] [INFO ] [REMOTE ] BXMT: Full fetch complete (69903 records). [2025-10-14T17:51:27.846697] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-14T17:51:27.963159] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-14T17:51:28.235047] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-14T17:51:28.235129] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-14T17:51:28.235947] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-14T17:51:28.236010] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-14T17:51:28.237413] [DEBUG] [LOCAL ] BXMT: Trimmed 69903 records to 47304 (keeping 200 days of data) [2025-10-14T17:51:28.538183] [DEBUG] [LOCAL ] BXMT: Primary data saved (47304 records). [2025-10-14T17:51:28.538312] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-14T17:51:28.538391] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BXMT took 33.3s. Estimated remaining: 4h 35m 8s. Rate: 7.3 symbols/min [2025-10-14T17:51:28.711286] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:51:28.754350] [DEBUG] [LOCAL ] BXSL: Loaded 48025 existing records from primary storage. [2025-10-14T17:51:28.754675] [INFO ] [MAIN ] BXSL: Loaded 48025 existing records. [2025-10-14T17:51:28.787449] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-14T17:51:28.947184] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:51:28.947538] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-14T17:51:28.947597] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-14T17:51:28.948202] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-14T17:51:28.948261] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-14T17:51:29.327360] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:51:29.349262] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-14T17:51:29.386835] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T17:51:29.472984] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T17:51:29.558140] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-14T17:51:30.358111] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-14T17:51:31.158141] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-14T17:51:31.290509] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T17:51:31.742980] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T17:51:31.958094] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-14T17:51:32.758131] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-14T17:51:33.064620] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-14T17:51:33.070864] [INFO ] [REMOTE ] BX: Full fetch complete (77557 records). [2025-10-14T17:51:33.071013] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-14T17:51:33.489930] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-14T17:51:33.490088] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-14T17:51:33.491061] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-14T17:51:33.491217] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-14T17:51:33.518880] [DEBUG] [LOCAL ] BX: Trimmed 77557 records to 53484 (keeping 200 days of data) [2025-10-14T17:51:33.520906] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T17:51:33.588850] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-14T17:51:33.874467] [DEBUG] [LOCAL ] BX: Primary data saved (53484 records). [2025-10-14T17:51:33.874616] [INFO ] [MAIN ] BX: Full history saved. [2025-10-14T17:51:33.874732] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BX took 51.5s. Estimated remaining: 4h 34m 44s. Rate: 7.3 symbols/min [2025-10-14T17:51:34.052481] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:51:34.073562] [DEBUG] [LOCAL ] BY: Loaded 21757 existing records from primary storage. [2025-10-14T17:51:34.073832] [INFO ] [MAIN ] BY: Loaded 21757 existing records. [2025-10-14T17:51:34.258620] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:51:34.258952] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-14T17:51:34.259240] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-14T17:51:34.259539] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-14T17:51:34.259679] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-14T17:51:34.360968] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-14T17:51:34.637073] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-14T17:51:34.679065] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:51:34.944321] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T17:51:35.158081] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-14T17:51:35.400933] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T17:51:35.958102] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-14T17:51:36.690529] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T17:51:36.741345] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T17:51:36.758077] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-14T17:51:37.433065] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T17:51:37.558110] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-14T17:51:38.358145] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-14T17:51:38.425781] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T17:51:39.158092] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-14T17:51:39.181232] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T17:51:39.958084] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-14T17:51:40.758070] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-14T17:51:40.826185] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T17:51:41.558072] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-14T17:51:41.733357] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T17:51:41.802329] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T17:51:42.358104] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-14T17:51:42.983145] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T17:51:43.158067] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-14T17:51:43.412978] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T17:51:43.958075] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-14T17:51:44.510940] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T17:51:44.758096] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-14T17:51:44.893466] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T17:51:45.558092] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-14T17:51:46.259981] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T17:51:46.358088] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-14T17:51:46.502474] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T17:51:47.154368] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T17:51:47.158225] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-14T17:51:47.158099] [INFO ] [REMOTE ] BXMX: Full fetch complete (28847 records). [2025-10-14T17:51:47.159766] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-14T17:51:47.523228] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-14T17:51:47.523309] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-14T17:51:47.523822] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-14T17:51:47.523885] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-14T17:51:47.524586] [DEBUG] [LOCAL ] BXMX: Trimmed 28847 records to 19577 (keeping 200 days of data) [2025-10-14T17:51:47.648806] [DEBUG] [LOCAL ] BXMX: Primary data saved (19577 records). [2025-10-14T17:51:47.648942] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-14T17:51:47.649020] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXMX took 34.4s. Estimated remaining: 4h 35m 5s. Rate: 7.2 symbols/min [2025-10-14T17:51:47.821696] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:51:47.864120] [DEBUG] [LOCAL ] BYD: Loaded 44846 existing records from primary storage. [2025-10-14T17:51:47.864394] [INFO ] [MAIN ] BYD: Loaded 44846 existing records. [2025-10-14T17:51:47.963275] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-14T17:51:48.044569] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:51:48.044801] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-14T17:51:48.044850] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-14T17:51:48.045156] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-14T17:51:48.045214] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-14T17:51:48.413932] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:51:48.430116] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T17:51:48.758135] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-14T17:51:49.558102] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-14T17:51:49.792309] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T17:51:50.297771] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T17:51:50.358091] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-14T17:51:50.694190] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T17:51:51.158125] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-14T17:51:51.883072] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T17:51:51.958047] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-14T17:51:52.650774] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T17:51:52.656277] [INFO ] [REMOTE ] BXP: Full fetch complete (72006 records). [2025-10-14T17:51:52.656418] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-14T17:51:52.763203] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-14T17:51:53.046279] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-14T17:51:53.046387] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-14T17:51:53.047282] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-14T17:51:53.047365] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-14T17:51:53.048922] [DEBUG] [LOCAL ] BXP: Trimmed 72006 records to 49862 (keeping 200 days of data) [2025-10-14T17:51:53.310964] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T17:51:53.401546] [DEBUG] [LOCAL ] BXP: Primary data saved (49862 records). [2025-10-14T17:51:53.401744] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-14T17:51:53.401863] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXP took 38.8s. Estimated remaining: 4h 34m 43s. Rate: 7.3 symbols/min [2025-10-14T17:51:53.575494] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:51:53.569611] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-14T17:51:53.593010] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T17:51:53.606928] [DEBUG] [LOCAL ] BYM: Loaded 11777 existing records from primary storage. [2025-10-14T17:51:53.607141] [INFO ] [MAIN ] BYM: Loaded 11777 existing records. [2025-10-14T17:51:53.780937] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:51:53.781151] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-14T17:51:53.781197] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-14T17:51:53.781417] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-14T17:51:53.781497] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-14T17:51:54.132845] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:51:54.358070] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-14T17:51:55.158124] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-14T17:51:55.245148] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T17:51:55.291518] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T17:51:55.958077] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-14T17:51:56.383402] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T17:51:56.758058] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-14T17:51:56.800113] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T17:51:57.558115] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-14T17:51:57.586670] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T17:51:58.358058] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-14T17:51:58.483272] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-14T17:51:59.158074] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-14T17:51:59.738035] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T17:51:59.809049] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T17:51:59.958161] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-14T17:52:00.758107] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-14T17:52:00.899620] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T17:52:01.558122] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-14T17:52:01.880152] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T17:52:01.883339] [INFO ] [REMOTE ] BY: Full fetch complete (29598 records). [2025-10-14T17:52:01.883476] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-14T17:52:01.884163] [FATAL] [VALIDATOR ] BY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:52:01.884265] [FATAL] [MAIN ] BY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:52:01.884332] [WARN ] [MAIN ] BY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:52:01.884408] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-14T17:52:01.884549] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-14T17:52:01.884607] [INFO ] [LOCAL ] BY: Starting deletion of derivative data. [2025-10-14T17:52:01.885071] [DEBUG] [LOCAL ] BY: Deleted derivative data file. [2025-10-14T17:52:01.885241] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 28.0s. Estimated remaining: 4h 34m 36s. Rate: 7.3 symbols/min [2025-10-14T17:52:02.118278] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:02.153463] [DEBUG] [LOCAL ] BZH: Loaded 32456 existing records from primary storage. [2025-10-14T17:52:02.153841] [INFO ] [MAIN ] BZH: Loaded 32456 existing records. [2025-10-14T17:52:02.353420] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:02.353777] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-14T17:52:02.353836] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-14T17:52:02.354104] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-14T17:52:02.354163] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-14T17:52:02.365778] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-14T17:52:02.731708] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:02.877032] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T17:52:03.158132] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-14T17:52:03.219689] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T17:52:03.958094] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-14T17:52:04.200196] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T17:52:04.647682] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T17:52:04.758123] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-14T17:52:05.558103] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-14T17:52:06.096320] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T17:52:06.358180] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-14T17:52:06.940562] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T17:52:07.158170] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-14T17:52:07.322513] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T17:52:07.958128] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-14T17:52:08.758082] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-14T17:52:08.829957] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T17:52:08.862868] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T17:52:09.558100] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-14T17:52:10.242572] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T17:52:10.358079] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-14T17:52:10.621981] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T17:52:10.739347] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-14T17:52:11.158125] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-14T17:52:11.852236] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T17:52:11.958078] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-14T17:52:12.758089] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-14T17:52:13.332911] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T17:52:13.334568] [INFO ] [REMOTE ] BYM: Full fetch complete (17712 records). [2025-10-14T17:52:13.334664] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-14T17:52:13.494636] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T17:52:13.568409] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-14T17:52:13.727908] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-14T17:52:13.727981] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-14T17:52:13.728375] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-14T17:52:13.728435] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-14T17:52:13.728986] [DEBUG] [LOCAL ] BYM: Trimmed 17712 records to 11730 (keeping 200 days of data) [2025-10-14T17:52:13.797610] [DEBUG] [LOCAL ] BYM: Primary data saved (11730 records). [2025-10-14T17:52:13.797784] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-14T17:52:13.797872] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BYM took 20.4s. Estimated remaining: 4h 34m 47s. Rate: 7.2 symbols/min [2025-10-14T17:52:13.970122] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:14.020000] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-14T17:52:14.020303] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-14T17:52:14.199931] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:14.200113] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-14T17:52:14.200159] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-14T17:52:14.200362] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-14T17:52:14.200420] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-14T17:52:14.365461] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-14T17:52:14.566935] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:15.158109] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-14T17:52:15.180634] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T17:52:15.773378] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T17:52:15.958083] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-14T17:52:16.758098] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-14T17:52:16.920386] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T17:52:16.926823] [INFO ] [REMOTE ] BXSL: Full fetch complete (69857 records). [2025-10-14T17:52:16.926994] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-14T17:52:17.314761] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-14T17:52:17.314827] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-14T17:52:17.315601] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-14T17:52:17.315665] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-14T17:52:17.317164] [DEBUG] [LOCAL ] BXSL: Trimmed 69857 records to 48094 (keeping 200 days of data) [2025-10-14T17:52:17.558686] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-14T17:52:17.613002] [DEBUG] [LOCAL ] BXSL: Primary data saved (48094 records). [2025-10-14T17:52:17.613188] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-14T17:52:17.613290] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BXSL took 49.1s. Estimated remaining: 4h 34m 15s. Rate: 7.3 symbols/min [2025-10-14T17:52:17.782139] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:17.802208] [DEBUG] [LOCAL ] CAAP: Loaded 19758 existing records from primary storage. [2025-10-14T17:52:17.802442] [INFO ] [MAIN ] CAAP: Loaded 19758 existing records. [2025-10-14T17:52:17.980525] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:17.980892] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-14T17:52:17.980994] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-14T17:52:17.981480] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-14T17:52:17.981578] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-14T17:52:18.323677] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-14T17:52:18.382799] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-14T17:52:18.402755] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T17:52:18.432234] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:18.451135] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T17:52:19.158107] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-14T17:52:19.958087] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-14T17:52:20.211241] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T17:52:20.758051] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-14T17:52:20.961851] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T17:52:21.262279] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T17:52:21.558628] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-14T17:52:21.664490] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T17:52:22.358098] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-14T17:52:22.820862] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T17:52:23.157583] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T17:52:23.159106] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-14T17:52:23.958144] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-14T17:52:24.405442] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T17:52:24.758128] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-14T17:52:24.937355] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T17:52:25.558109] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-14T17:52:26.040733] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T17:52:26.045623] [INFO ] [REMOTE ] BYD: Full fetch complete (65234 records). [2025-10-14T17:52:26.045779] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-14T17:52:26.167764] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T17:52:26.363190] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-14T17:52:26.450765] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-14T17:52:26.450855] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-14T17:52:26.451692] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-14T17:52:26.451755] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-14T17:52:26.453280] [DEBUG] [LOCAL ] BYD: Trimmed 65234 records to 44865 (keeping 200 days of data) [2025-10-14T17:52:26.731312] [DEBUG] [LOCAL ] BYD: Primary data saved (44865 records). [2025-10-14T17:52:26.731441] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-14T17:52:26.731528] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BYD took 39.1s. Estimated remaining: 4h 34m 11s. Rate: 7.3 symbols/min [2025-10-14T17:52:26.899138] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:26.917238] [DEBUG] [LOCAL ] CABO: Loaded 16807 existing records from primary storage. [2025-10-14T17:52:26.917441] [INFO ] [MAIN ] CABO: Loaded 16807 existing records. [2025-10-14T17:52:27.091240] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:27.091449] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-14T17:52:27.091496] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-14T17:52:27.091855] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-14T17:52:27.091914] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-14T17:52:27.165497] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-14T17:52:27.449144] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:27.958075] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-14T17:52:28.453016] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-14T17:52:28.625702] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T17:52:28.652101] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T17:52:28.758080] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-14T17:52:29.558090] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-14T17:52:30.358317] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-14T17:52:30.635518] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T17:52:30.666015] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T17:52:31.158146] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-14T17:52:31.607409] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T17:52:31.611534] [INFO ] [REMOTE ] BZH: Full fetch complete (47195 records). [2025-10-14T17:52:31.611716] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-14T17:52:31.963181] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-14T17:52:32.045436] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-14T17:52:32.045542] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-14T17:52:32.046382] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-14T17:52:32.046449] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-14T17:52:32.047581] [DEBUG] [LOCAL ] BZH: Trimmed 47195 records to 32491 (keeping 200 days of data) [2025-10-14T17:52:32.261326] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T17:52:32.272287] [DEBUG] [LOCAL ] BZH: Primary data saved (32491 records). [2025-10-14T17:52:32.272390] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-14T17:52:32.272459] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. BZH took 30.4s. Estimated remaining: 4h 33m 49s. Rate: 7.3 symbols/min [2025-10-14T17:52:32.439313] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:32.461942] [DEBUG] [LOCAL ] CACI: Loaded 23367 existing records from primary storage. [2025-10-14T17:52:32.462175] [INFO ] [MAIN ] CACI: Loaded 23367 existing records. [2025-10-14T17:52:32.634241] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:32.634434] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-14T17:52:32.634480] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-14T17:52:32.634806] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-14T17:52:32.634863] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-14T17:52:32.770824] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-14T17:52:32.988569] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:33.115331] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T17:52:33.558092] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-14T17:52:34.358087] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-14T17:52:34.508987] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T17:52:34.943828] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-14T17:52:35.158059] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-14T17:52:35.581168] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T17:52:35.736571] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T17:52:35.958084] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-14T17:52:36.758078] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-14T17:52:36.889339] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T17:52:37.558087] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-14T17:52:38.358115] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-14T17:52:38.547622] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T17:52:38.671414] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T17:52:39.158138] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-14T17:52:39.437549] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T17:52:39.958156] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-14T17:52:40.758107] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-14T17:52:41.043186] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T17:52:41.333545] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T17:52:41.392072] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T17:52:41.558092] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-14T17:52:42.358050] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-14T17:52:42.594992] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T17:52:43.158142] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-14T17:52:43.369327] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T17:52:43.918463] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T17:52:43.958048] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-14T17:52:44.758123] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-14T17:52:44.855547] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T17:52:45.558080] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-14T17:52:46.290724] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T17:52:46.358044] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-14T17:52:47.158089] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-14T17:52:47.740779] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T17:52:47.958126] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-14T17:52:48.221195] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:52:48.239995] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T17:52:48.242957] [INFO ] [REMOTE ] CAAP: Full fetch complete (27872 records). [2025-10-14T17:52:48.243027] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-14T17:52:48.606032] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-14T17:52:48.606118] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-14T17:52:48.606595] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-14T17:52:48.606633] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-14T17:52:48.607309] [DEBUG] [LOCAL ] CAAP: Trimmed 27872 records to 19791 (keeping 200 days of data) [2025-10-14T17:52:48.723376] [DEBUG] [LOCAL ] CAAP: Primary data saved (19791 records). [2025-10-14T17:52:48.723518] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-14T17:52:48.723596] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. CAAP took 31.1s. Estimated remaining: 4h 34m 23s. Rate: 7.2 symbols/min [2025-10-14T17:52:48.766352] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-14T17:52:48.895411] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:48.939066] [DEBUG] [LOCAL ] CADE: Loaded 49361 existing records from primary storage. [2025-10-14T17:52:48.939382] [INFO ] [MAIN ] CADE: Loaded 49361 existing records. [2025-10-14T17:52:49.115933] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:49.116346] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-14T17:52:49.116556] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-14T17:52:49.116834] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-14T17:52:49.116891] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-14T17:52:49.332599] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T17:52:49.496248] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:49.558041] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-14T17:52:50.358100] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-14T17:52:51.005686] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-14T17:52:51.158084] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-14T17:52:51.202010] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T17:52:51.590738] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T17:52:51.958068] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-14T17:52:52.758069] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-14T17:52:53.007352] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T17:52:53.231768] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-14T17:52:53.558063] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-14T17:52:53.841103] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T17:52:54.306161] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T17:52:54.358067] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-14T17:52:55.158128] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-14T17:52:55.478281] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T17:52:55.958070] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-14T17:52:56.758050] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-14T17:52:57.017574] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T17:52:57.302320] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-14T17:52:57.309258] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-14T17:52:57.309451] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-14T17:52:57.563320] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-14T17:52:57.771138] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-14T17:52:57.771260] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-14T17:52:57.772727] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-14T17:52:57.772799] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-14T17:52:57.775021] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 53740 (keeping 200 days of data) [2025-10-14T17:52:58.133435] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-14T17:52:58.134221] [INFO ] [MAIN ] C: Full history saved. [2025-10-14T17:52:58.135535] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. C took 44.3s. Estimated remaining: 4h 34m 21s. Rate: 7.2 symbols/min [2025-10-14T17:52:58.282224] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T17:52:58.357326] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T17:52:58.361201] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-14T17:52:58.387599] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:52:58.434909] [DEBUG] [LOCAL ] CAE: Loaded 39244 existing records from primary storage. [2025-10-14T17:52:58.435306] [INFO ] [MAIN ] CAE: Loaded 39244 existing records. [2025-10-14T17:52:58.647098] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:52:58.647337] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-14T17:52:58.647388] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-14T17:52:58.647760] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-14T17:52:58.647820] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-14T17:52:58.998210] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:52:59.158104] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-14T17:52:59.405812] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T17:52:59.958148] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-14T17:53:00.720192] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T17:53:00.758051] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-14T17:53:00.871061] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T17:53:00.873294] [INFO ] [REMOTE ] CACI: Full fetch complete (38285 records). [2025-10-14T17:53:00.873378] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-14T17:53:01.249663] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-14T17:53:01.249768] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-14T17:53:01.250340] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-14T17:53:01.250381] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-14T17:53:01.251365] [DEBUG] [LOCAL ] CACI: Trimmed 38285 records to 23249 (keeping 200 days of data) [2025-10-14T17:53:01.391599] [DEBUG] [LOCAL ] CACI: Primary data saved (23249 records). [2025-10-14T17:53:01.391777] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-14T17:53:01.391873] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CACI took 29.1s. Estimated remaining: 4h 33m 46s. Rate: 7.3 symbols/min [2025-10-14T17:53:01.558217] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-14T17:53:01.576358] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:01.584735] [DEBUG] [LOCAL ] CAF: Loaded 3452 existing records from primary storage. [2025-10-14T17:53:01.584964] [INFO ] [MAIN ] CAF: Loaded 3452 existing records. [2025-10-14T17:53:01.766593] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:53:01.766861] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-14T17:53:01.766908] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-14T17:53:01.767081] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-14T17:53:01.767136] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-14T17:53:02.138885] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:02.358066] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-14T17:53:02.452747] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T17:53:02.604318] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T17:53:03.107777] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T17:53:03.158127] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-14T17:53:03.958094] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-14T17:53:04.534449] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T17:53:04.758097] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-14T17:53:04.850559] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T17:53:05.558101] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-14T17:53:06.118031] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T17:53:06.358073] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-14T17:53:06.477211] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T17:53:06.479073] [INFO ] [REMOTE ] CABO: Full fetch complete (23181 records). [2025-10-14T17:53:06.479147] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-14T17:53:06.845496] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-14T17:53:06.845578] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-14T17:53:06.846031] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-14T17:53:06.846091] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-14T17:53:06.846874] [DEBUG] [LOCAL ] CABO: Trimmed 23181 records to 16823 (keeping 200 days of data) [2025-10-14T17:53:06.950736] [DEBUG] [LOCAL ] CABO: Primary data saved (16823 records). [2025-10-14T17:53:06.950906] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-14T17:53:06.951018] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CABO took 40.2s. Estimated remaining: 4h 33m 24s. Rate: 7.3 symbols/min [2025-10-14T17:53:07.125790] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:07.158127] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-14T17:53:07.176530] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-14T17:53:07.176868] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-14T17:53:07.350845] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:53:07.351032] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-14T17:53:07.351077] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-14T17:53:07.351734] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-14T17:53:07.351792] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-14T17:53:07.702541] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:07.726192] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T17:53:07.958088] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-14T17:53:08.483719] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T17:53:08.758115] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-14T17:53:09.444893] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T17:53:09.558124] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-14T17:53:10.194726] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T17:53:10.273624] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T17:53:10.358068] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-14T17:53:11.158109] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-14T17:53:11.958107] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-14T17:53:12.009030] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T17:53:12.445389] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T17:53:12.758135] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-14T17:53:13.558068] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-14T17:53:13.954764] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T17:53:14.358045] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-14T17:53:14.508394] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T17:53:14.814975] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T17:53:14.815102] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T17:53:15.158075] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-14T17:53:15.616455] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T17:53:15.958100] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-14T17:53:16.758121] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-14T17:53:17.379570] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T17:53:17.558141] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-14T17:53:18.342393] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T17:53:18.358024] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-14T17:53:18.531860] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T17:53:19.158105] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-14T17:53:19.604115] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T17:53:19.958085] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-14T17:53:20.296933] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-14T17:53:20.303498] [INFO ] [REMOTE ] CADE: Full fetch complete (70362 records). [2025-10-14T17:53:20.303626] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-14T17:53:20.694469] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-14T17:53:20.694599] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-14T17:53:20.695418] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-14T17:53:20.695475] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-14T17:53:20.696837] [DEBUG] [LOCAL ] CADE: Trimmed 70362 records to 49416 (keeping 200 days of data) [2025-10-14T17:53:20.784450] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-14T17:53:20.997549] [DEBUG] [LOCAL ] CADE: Primary data saved (49416 records). [2025-10-14T17:53:20.997727] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-14T17:53:20.997820] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CADE took 32.3s. Estimated remaining: 4h 33m 46s. Rate: 7.2 symbols/min [2025-10-14T17:53:21.169110] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:21.223969] [DEBUG] [LOCAL ] CAH: Loaded 51475 existing records from primary storage. [2025-10-14T17:53:21.224305] [INFO ] [MAIN ] CAH: Loaded 51475 existing records. [2025-10-14T17:53:21.414128] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:53:21.428857] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-14T17:53:21.429140] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-14T17:53:21.430791] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-14T17:53:21.430729] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T17:53:21.430980] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-14T17:53:21.523802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T17:53:21.563155] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-14T17:53:21.803369] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:22.358095] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-14T17:53:22.898968] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T17:53:23.108154] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T17:53:23.158072] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-14T17:53:23.958128] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-14T17:53:24.607834] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T17:53:24.632849] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T17:53:24.758139] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-14T17:53:25.558138] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-14T17:53:26.358100] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-14T17:53:26.593809] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T17:53:26.893537] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T17:53:27.158080] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-14T17:53:27.663295] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T17:53:27.667816] [INFO ] [REMOTE ] CAE: Full fetch complete (56236 records). [2025-10-14T17:53:27.667906] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-14T17:53:27.963091] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-14T17:53:28.053900] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-14T17:53:28.053974] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-14T17:53:28.054692] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-14T17:53:28.054800] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-14T17:53:28.055923] [DEBUG] [LOCAL ] CAE: Trimmed 56236 records to 39218 (keeping 200 days of data) [2025-10-14T17:53:28.277215] [DEBUG] [LOCAL ] CAE: Primary data saved (39218 records). [2025-10-14T17:53:28.277363] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-14T17:53:28.277997] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAE took 30.1s. Estimated remaining: 4h 33m 32s. Rate: 7.2 symbols/min [2025-10-14T17:53:28.453715] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:28.498679] [DEBUG] [LOCAL ] CAL: Loaded 43025 existing records from primary storage. [2025-10-14T17:53:28.499084] [INFO ] [MAIN ] CAL: Loaded 43025 existing records. [2025-10-14T17:53:28.682092] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:53:28.682319] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-14T17:53:28.682403] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-14T17:53:28.682914] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-14T17:53:28.682987] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-14T17:53:28.779093] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-14T17:53:28.788048] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T17:53:29.086004] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:29.411446] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T17:53:29.560520] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-14T17:53:29.563496] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T17:53:30.358079] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-14T17:53:30.964763] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T17:53:30.965755] [INFO ] [REMOTE ] CAF: Full fetch complete (5591 records). [2025-10-14T17:53:30.965821] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-14T17:53:31.176193] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-14T17:53:31.358965] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-14T17:53:31.359521] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-14T17:53:31.360573] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T17:53:31.359743] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-14T17:53:31.369497] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-14T17:53:31.369920] [DEBUG] [LOCAL ] CAF: Trimmed 5591 records to 3450 (keeping 200 days of data) [2025-10-14T17:53:31.389346] [DEBUG] [LOCAL ] CAF: Primary data saved (3450 records). [2025-10-14T17:53:31.389410] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-14T17:53:31.389479] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAF took 30.0s. Estimated remaining: 4h 32m 57s. Rate: 7.3 symbols/min [2025-10-14T17:53:31.557971] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:31.595862] [DEBUG] [LOCAL ] CALX: Loaded 37689 existing records from primary storage. [2025-10-14T17:53:31.596135] [INFO ] [MAIN ] CALX: Loaded 37689 existing records. [2025-10-14T17:53:31.773345] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:53:31.773552] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-14T17:53:31.773598] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-14T17:53:31.773969] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-14T17:53:31.774025] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-14T17:53:31.966910] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-14T17:53:32.177071] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:32.758117] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-14T17:53:33.038256] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T17:53:33.558074] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-14T17:53:33.848943] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T17:53:34.147796] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T17:53:34.358079] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-14T17:53:35.097558] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T17:53:35.158061] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-14T17:53:35.958133] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-14T17:53:35.995561] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:53:36.411549] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T17:53:36.758089] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-14T17:53:37.558055] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-14T17:53:37.830924] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T17:53:38.358065] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-14T17:53:38.644295] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T17:53:38.816737] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T17:53:39.158110] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-14T17:53:39.721445] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T17:53:39.958103] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-14T17:53:40.758149] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-14T17:53:40.886193] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T17:53:41.407983] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T17:53:41.558118] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-14T17:53:42.358060] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-14T17:53:42.602467] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T17:53:43.109930] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T17:53:43.158040] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-14T17:53:43.501989] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T17:53:43.958104] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-14T17:53:44.764338] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-14T17:53:44.769769] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T17:53:45.558055] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-14T17:53:45.913675] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-14T17:53:45.946360] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T17:53:46.358127] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-14T17:53:47.033686] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T17:53:47.158081] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-14T17:53:47.655924] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T17:53:47.958140] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-14T17:53:48.758069] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-14T17:53:49.050226] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T17:53:49.452378] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T17:53:49.558066] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-14T17:53:49.951818] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T17:53:50.358134] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-14T17:53:50.934875] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T17:53:51.158128] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-14T17:53:51.918766] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T17:53:51.958046] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-14T17:53:52.758152] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-14T17:53:53.208842] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-14T17:53:53.244214] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T17:53:53.558113] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-14T17:53:53.710443] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T17:53:54.358110] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-14T17:53:54.901693] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T17:53:55.158056] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-14T17:53:55.670978] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T17:53:55.676023] [INFO ] [REMOTE ] CALX: Full fetch complete (54179 records). [2025-10-14T17:53:55.676170] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-14T17:53:55.963189] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-14T17:53:56.103290] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-14T17:53:56.103369] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-14T17:53:56.104056] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-14T17:53:56.104119] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-14T17:53:56.105212] [DEBUG] [LOCAL ] CALX: Trimmed 54179 records to 37675 (keeping 200 days of data) [2025-10-14T17:53:56.320188] [DEBUG] [LOCAL ] CALX: Primary data saved (37675 records). [2025-10-14T17:53:56.320326] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-14T17:53:56.320408] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CALX took 24.9s. Estimated remaining: 4h 34m 14s. Rate: 7.2 symbols/min [2025-10-14T17:53:56.492465] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:56.492768] [DEBUG] [LOCAL ] CANG: No existing data file found in primary storage. [2025-10-14T17:53:56.492840] [WARN ] [MAIN ] CANG: No existing data found, performing full refresh instead. [2025-10-14T17:53:56.493043] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-14T17:53:56.493120] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-14T17:53:56.493296] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-14T17:53:56.493361] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-14T17:53:56.659233] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T17:53:56.770208] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-14T17:53:56.888781] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:57.558078] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-14T17:53:57.909138] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-14T17:53:57.915036] [INFO ] [REMOTE ] CAG: Full fetch complete (77821 records). [2025-10-14T17:53:57.915148] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-14T17:53:58.303450] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-14T17:53:58.303554] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-14T17:53:58.304585] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-14T17:53:58.304749] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-14T17:53:58.306277] [DEBUG] [LOCAL ] CAG: Trimmed 77821 records to 53665 (keeping 200 days of data) [2025-10-14T17:53:58.359575] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-14T17:53:58.641546] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T17:53:58.691203] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T17:53:58.709072] [DEBUG] [LOCAL ] CAG: Primary data saved (53665 records). [2025-10-14T17:53:58.709198] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-14T17:53:58.709278] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 51.8s. Estimated remaining: 4h 33m 36s. Rate: 7.2 symbols/min [2025-10-14T17:53:58.876214] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:53:58.883443] [DEBUG] [LOCAL ] CAPL: Loaded 5669 existing records from primary storage. [2025-10-14T17:53:58.883593] [INFO ] [MAIN ] CAPL: Loaded 5669 existing records. [2025-10-14T17:53:59.056108] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:53:59.056293] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-14T17:53:59.056339] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-14T17:53:59.056558] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-14T17:53:59.056615] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-14T17:53:59.163287] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-14T17:53:59.403993] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:53:59.958136] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-14T17:54:00.068890] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T17:54:00.647791] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T17:54:00.758119] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-14T17:54:00.926684] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T17:54:01.558097] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-14T17:54:02.012822] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T17:54:02.358150] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-14T17:54:03.072891] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T17:54:03.120385] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T17:54:03.126731] [INFO ] [REMOTE ] CAH: Full fetch complete (74770 records). [2025-10-14T17:54:03.126989] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-14T17:54:03.163263] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-14T17:54:03.604440] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-14T17:54:03.604558] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-14T17:54:03.605685] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-14T17:54:03.605751] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-14T17:54:03.607714] [DEBUG] [LOCAL ] CAH: Trimmed 74770 records to 51482 (keeping 200 days of data) [2025-10-14T17:54:03.956491] [DEBUG] [LOCAL ] CAH: Primary data saved (51482 records). [2025-10-14T17:54:03.956779] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-14T17:54:03.957669] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 43.0s. Estimated remaining: 4h 33m 12s. Rate: 7.2 symbols/min [2025-10-14T17:54:03.963357] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-14T17:54:04.150015] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:54:04.209318] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-14T17:54:04.209859] [INFO ] [MAIN ] CARR: Loaded 53602 existing records. [2025-10-14T17:54:04.397804] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:54:04.398121] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-14T17:54:04.398179] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-14T17:54:04.398689] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-14T17:54:04.398783] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-14T17:54:04.657732] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T17:54:04.764268] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-14T17:54:04.810290] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T17:54:04.824686] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:54:04.831044] [INFO ] [REMOTE ] CAL: Full fetch complete (61909 records). [2025-10-14T17:54:04.831219] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-14T17:54:05.209761] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-14T17:54:05.209859] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-14T17:54:05.210623] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-14T17:54:05.210698] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-14T17:54:05.212032] [DEBUG] [LOCAL ] CAL: Trimmed 61909 records to 43003 (keeping 200 days of data) [2025-10-14T17:54:05.473477] [DEBUG] [LOCAL ] CAL: Primary data saved (43003 records). [2025-10-14T17:54:05.473668] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-14T17:54:05.474440] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CAL took 37.2s. Estimated remaining: 4h 32m 30s. Rate: 7.3 symbols/min [2025-10-14T17:54:05.565564] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-14T17:54:05.647627] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:54:05.688249] [DEBUG] [LOCAL ] CARS: Loaded 39733 existing records from primary storage. [2025-10-14T17:54:05.688527] [INFO ] [MAIN ] CARS: Loaded 39733 existing records. [2025-10-14T17:54:05.884888] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T17:54:05.890762] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:54:05.896800] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-14T17:54:05.896945] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-14T17:54:05.897714] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-14T17:54:05.897802] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-14T17:54:06.263796] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:54:06.358099] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-14T17:54:07.158074] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-14T17:54:07.423063] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T17:54:07.772586] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T17:54:07.920118] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T17:54:07.958080] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-14T17:54:08.496718] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-14T17:54:08.758113] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-14T17:54:09.558102] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-14T17:54:10.147996] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:54:10.358083] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-14T17:54:10.541097] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T17:54:11.158103] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-14T17:54:11.912963] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T17:54:11.958084] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-14T17:54:12.072040] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T17:54:12.366554] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T17:54:12.758107] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-14T17:54:13.558114] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-14T17:54:14.267256] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T17:54:14.358080] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-14T17:54:14.689068] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T17:54:15.158082] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-14T17:54:15.235568] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T17:54:15.958064] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-14T17:54:16.047048] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T17:54:16.758096] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-14T17:54:17.310414] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T17:54:17.558003] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-14T17:54:18.358084] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-14T17:54:18.756855] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T17:54:18.906453] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T17:54:19.096887] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T17:54:19.158145] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-14T17:54:19.958086] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-14T17:54:20.251755] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T17:54:20.549854] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T17:54:20.758126] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-14T17:54:21.558080] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-14T17:54:22.358071] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-14T17:54:22.644124] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T17:54:22.754127] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:54:22.848070] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T17:54:23.158110] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-14T17:54:23.754598] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T17:54:23.958073] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-14T17:54:24.758074] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-14T17:54:25.130784] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T17:54:25.329138] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T17:54:25.330310] [INFO ] [REMOTE ] CAPL: Full fetch complete (8768 records). [2025-10-14T17:54:25.330376] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-14T17:54:25.563179] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-14T17:54:25.691861] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-14T17:54:25.691936] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-14T17:54:25.692166] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-14T17:54:25.692205] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-14T17:54:25.692600] [DEBUG] [LOCAL ] CAPL: Trimmed 8768 records to 5645 (keeping 200 days of data) [2025-10-14T17:54:25.727797] [DEBUG] [LOCAL ] CAPL: Primary data saved (5645 records). [2025-10-14T17:54:25.727951] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-14T17:54:25.728091] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 27.0s. Estimated remaining: 4h 33m 22s. Rate: 7.2 symbols/min [2025-10-14T17:54:25.903779] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:54:25.953395] [DEBUG] [LOCAL ] CAT: Loaded 52927 existing records from primary storage. [2025-10-14T17:54:25.953746] [INFO ] [MAIN ] CAT: Loaded 52927 existing records. [2025-10-14T17:54:26.143573] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:54:26.143834] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-14T17:54:26.143886] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-14T17:54:26.144393] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-14T17:54:26.144450] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-14T17:54:26.369399] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-14T17:54:26.493913] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:54:26.989554] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T17:54:27.158112] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-14T17:54:27.690980] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T17:54:27.958080] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-14T17:54:28.171573] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T17:54:28.758089] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-14T17:54:29.558100] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-14T17:54:29.780597] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T17:54:29.984684] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T17:54:30.358099] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-14T17:54:30.481322] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T17:54:31.158136] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-14T17:54:31.958130] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-14T17:54:32.385506] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-14T17:54:32.645478] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T17:54:32.758087] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-14T17:54:32.794304] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T17:54:32.797580] [INFO ] [REMOTE ] CANG: Full fetch complete (39634 records). [2025-10-14T17:54:32.797696] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-14T17:54:32.798426] [FATAL] [VALIDATOR ] CANG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:54:32.798511] [FATAL] [MAIN ] CANG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:54:32.798552] [WARN ] [MAIN ] CANG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:54:32.798590] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-14T17:54:32.798670] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-14T17:54:32.798728] [INFO ] [LOCAL ] CANG: Starting deletion of derivative data. [2025-10-14T17:54:32.798771] [DEBUG] [LOCAL ] CANG: No derivative data file found to delete. [2025-10-14T17:54:32.798826] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CANG took 36.5s. Estimated remaining: 4h 33m 7s. Rate: 7.2 symbols/min [2025-10-14T17:54:32.973169] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:54:32.982344] [DEBUG] [LOCAL ] CATO: Loaded 6798 existing records from primary storage. [2025-10-14T17:54:32.982549] [INFO ] [MAIN ] CATO: Loaded 6798 existing records. [2025-10-14T17:54:33.165256] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:54:33.165480] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-14T17:54:33.165539] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-14T17:54:33.165724] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-14T17:54:33.165780] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-14T17:54:33.549875] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:54:33.558102] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-14T17:54:34.358225] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-14T17:54:34.512560] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T17:54:35.110574] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T17:54:35.158045] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-14T17:54:35.276271] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T17:54:35.928727] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T17:54:35.958045] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-14T17:54:36.670882] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T17:54:36.758138] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-14T17:54:37.302923] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T17:54:37.558103] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-14T17:54:38.358101] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-14T17:54:39.158110] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-14T17:54:39.764175] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-14T17:54:39.958159] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-14T17:54:40.147816] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T17:54:40.243301] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T17:54:40.758083] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-14T17:54:41.558113] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-14T17:54:41.682184] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T17:54:42.014183] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T17:54:42.220258] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T17:54:42.226143] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-10-14T17:54:42.226270] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-14T17:54:42.368889] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-14T17:54:42.629812] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-14T17:54:42.629912] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-14T17:54:42.630864] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-14T17:54:42.630927] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-14T17:54:42.632453] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 53602 (keeping 200 days of data) [2025-10-14T17:54:42.950155] [DEBUG] [LOCAL ] CARR: Primary data saved (53602 records). [2025-10-14T17:54:42.950282] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-14T17:54:42.950361] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARR took 39.0s. Estimated remaining: 4h 33m 8s. Rate: 7.2 symbols/min [2025-10-14T17:54:43.114998] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:54:43.162926] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-14T17:54:43.164995] [DEBUG] [LOCAL ] CAVA: Loaded 53568 existing records from primary storage. [2025-10-14T17:54:43.165367] [INFO ] [MAIN ] CAVA: Loaded 53568 existing records. [2025-10-14T17:54:43.344431] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:54:43.344680] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-14T17:54:43.344738] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-14T17:54:43.345117] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-14T17:54:43.345181] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-14T17:54:43.716192] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:54:43.958045] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-14T17:54:44.418472] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T17:54:44.706412] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T17:54:44.758102] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-14T17:54:45.395915] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T17:54:45.558141] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-14T17:54:46.287968] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-14T17:54:46.358121] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-14T17:54:47.158091] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-14T17:54:47.567106] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T17:54:47.697684] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T17:54:47.702555] [INFO ] [REMOTE ] CARS: Full fetch complete (56154 records). [2025-10-14T17:54:47.702687] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-14T17:54:47.963338] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-14T17:54:48.091266] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-14T17:54:48.091339] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-14T17:54:48.092098] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-14T17:54:48.092159] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-14T17:54:48.093268] [DEBUG] [LOCAL ] CARS: Trimmed 56154 records to 39798 (keeping 200 days of data) [2025-10-14T17:54:48.318759] [DEBUG] [LOCAL ] CARS: Primary data saved (39798 records). [2025-10-14T17:54:48.318895] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-14T17:54:48.319602] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CARS took 42.8s. Estimated remaining: 4h 32m 45s. Rate: 7.2 symbols/min [2025-10-14T17:54:48.489041] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:54:48.493823] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T17:54:48.539230] [DEBUG] [LOCAL ] CB: Loaded 49917 existing records from primary storage. [2025-10-14T17:54:48.539525] [INFO ] [MAIN ] CB: Loaded 49917 existing records. [2025-10-14T17:54:48.721228] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:54:48.721446] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-14T17:54:48.721504] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-14T17:54:48.722574] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-14T17:54:48.722631] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-14T17:54:48.765120] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-14T17:54:49.087732] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:54:49.116104] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T17:54:49.558152] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-14T17:54:50.358041] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-14T17:54:50.658334] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T17:54:51.158081] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-14T17:54:51.483817] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T17:54:51.773453] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T17:54:51.958055] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-14T17:54:52.101731] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T17:54:52.758132] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-14T17:54:53.545470] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T17:54:53.558033] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-14T17:54:53.786608] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T17:54:54.280150] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T17:54:54.358082] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-14T17:54:54.971947] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T17:54:54.973373] [INFO ] [REMOTE ] CATO: Full fetch complete (10962 records). [2025-10-14T17:54:54.973446] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-14T17:54:55.163603] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-14T17:54:55.359617] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-14T17:54:55.359749] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-14T17:54:55.360151] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-14T17:54:55.360194] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-14T17:54:55.360710] [DEBUG] [LOCAL ] CATO: Trimmed 10962 records to 6737 (keeping 200 days of data) [2025-10-14T17:54:55.399997] [DEBUG] [LOCAL ] CATO: Primary data saved (6737 records). [2025-10-14T17:54:55.400175] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-14T17:54:55.400270] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CATO took 22.6s. Estimated remaining: 4h 32m 31s. Rate: 7.2 symbols/min [2025-10-14T17:54:55.958126] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-14T17:54:56.552421] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T17:54:56.758116] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-14T17:54:57.558095] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-14T17:54:57.802469] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T17:54:58.007622] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T17:54:58.358089] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-14T17:54:59.158151] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-14T17:54:59.808770] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-14T17:54:59.958115] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-14T17:55:00.197060] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T17:55:00.758103] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-14T17:55:00.946350] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T17:55:01.558106] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-14T17:55:02.083413] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T17:55:02.358115] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-14T17:55:02.712692] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-14T17:55:03.095983] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T17:55:03.158120] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-14T17:55:03.958143] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-14T17:55:04.204719] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T17:55:04.211011] [INFO ] [REMOTE ] CAT: Full fetch complete (76825 records). [2025-10-14T17:55:04.211161] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-14T17:55:04.629961] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-14T17:55:04.630122] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-14T17:55:04.631607] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-14T17:55:04.631731] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-14T17:55:04.633832] [DEBUG] [LOCAL ] CAT: Trimmed 76825 records to 52943 (keeping 200 days of data) [2025-10-14T17:55:05.001982] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T17:55:05.016334] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-14T17:55:05.028322] [DEBUG] [LOCAL ] CAT: Primary data saved (52943 records). [2025-10-14T17:55:05.028537] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-14T17:55:05.028677] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CAT took 39.3s. Estimated remaining: 4h 32m 29s. Rate: 7.2 symbols/min [2025-10-14T17:55:05.640745] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T17:55:05.652013] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-14T17:55:06.881158] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T17:55:06.894304] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-14T17:55:07.647515] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T17:55:07.660352] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-14T17:55:08.100313] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T17:55:08.112284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-14T17:55:09.585336] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T17:55:09.598197] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-14T17:55:09.629627] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:55:09.641153] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-14T17:55:11.404197] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T17:55:11.412491] [INFO ] [REMOTE ] CB: Full fetch complete (72706 records). [2025-10-14T17:55:11.412736] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-14T17:55:11.856142] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-14T17:55:11.856254] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-14T17:55:11.857294] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-14T17:55:11.857390] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-14T17:55:11.889234] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-14T17:55:11.887149] [DEBUG] [LOCAL ] CB: Trimmed 72706 records to 49935 (keeping 200 days of data) [2025-10-14T17:55:11.901442] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-14T17:55:12.247262] [DEBUG] [LOCAL ] CB: Primary data saved (49935 records). [2025-10-14T17:55:12.247409] [INFO ] [MAIN ] CB: Full history saved. [2025-10-14T17:55:12.248214] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CB took 23.9s. Estimated remaining: 4h 32m 16s. Rate: 7.2 symbols/min [2025-10-14T17:55:13.876591] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-14T17:55:13.885153] [INFO ] [REMOTE ] CAVA: Full fetch complete (77064 records). [2025-10-14T17:55:13.885356] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-14T17:55:13.886436] [FATAL] [VALIDATOR ] CAVA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T17:55:13.886551] [FATAL] [MAIN ] CAVA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:55:13.886606] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:55:13.886711] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-14T17:55:13.886800] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-14T17:55:13.886871] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-10-14T17:55:13.887190] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-10-14T17:55:13.887309] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CAVA took 30.9s. Estimated remaining: 4h 31m 34s. Rate: 7.3 symbols/min [2025-10-14T17:55:14.525531] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:14.530112] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:14.563253] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:14.597982] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-14T17:55:14.606073] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-14T17:55:14.625090] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:14.628586] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-14T17:55:14.631596] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-14T17:55:14.632020] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-14T17:55:14.631917] [DEBUG] [LOCAL ] CBNA: Loaded 2916 existing records from primary storage. [2025-10-14T17:55:14.632214] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-14T17:55:14.632424] [INFO ] [MAIN ] CBNA: Loaded 2916 existing records. [2025-10-14T17:55:14.657693] [DEBUG] [LOCAL ] CBAN: Loaded 10523 existing records from primary storage. [2025-10-14T17:55:14.683695] [INFO ] [MAIN ] CBAN: Loaded 10523 existing records. [2025-10-14T17:55:14.884973] [DEBUG] [LOCAL ] CBL: Loaded 16249 existing records from primary storage. [2025-10-14T17:55:14.914195] [INFO ] [MAIN ] CBL: Loaded 16249 existing records. [2025-10-14T17:55:15.120029] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:15.270595] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-14T17:55:15.311632] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-14T17:55:15.351889] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:15.397110] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-14T17:55:15.397333] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-14T17:55:15.497450] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-14T17:55:15.545689] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-14T17:55:15.600687] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:15.627036] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-14T17:55:15.644396] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-14T17:55:15.682145] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-14T17:55:15.696713] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-14T17:55:15.746224] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:15.775562] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-14T17:55:15.775737] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-14T17:55:15.775488] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-14T17:55:16.178551] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:55:16.220780] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-14T17:55:16.264196] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:55:16.383489] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-14T17:55:16.526587] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:16.581628] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-14T17:55:16.581195] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:55:16.602820] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-14T17:55:16.629607] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-14T17:55:16.634912] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-14T17:55:16.645294] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-14T17:55:16.655750] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 2.8s. Estimated remaining: 4h 30m 59s. Rate: 7.3 symbols/min [2025-10-14T17:55:16.766501] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:16.780509] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:16.803844] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-14T17:55:16.780891] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-14T17:55:16.938164] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:16.985238] [DEBUG] [LOCAL ] CBRE: Loaded 50384 existing records from primary storage. [2025-10-14T17:55:16.985561] [INFO ] [MAIN ] CBRE: Loaded 50384 existing records. [2025-10-14T17:55:17.171721] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:17.171994] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-14T17:55:17.172047] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-14T17:55:17.172528] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-14T17:55:17.172586] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-14T17:55:17.385153] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T17:55:17.424264] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-14T17:55:17.532886] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:17.533149] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-14T17:55:17.639547] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T17:55:17.641566] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-14T17:55:18.029786] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T17:55:18.031373] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-14T17:55:18.059816] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T17:55:18.064691] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-14T17:55:18.455620] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T17:55:18.458672] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-14T17:55:18.551335] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T17:55:18.939506] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T17:55:18.972047] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T17:55:19.088224] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T17:55:19.158068] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-14T17:55:19.958100] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-14T17:55:19.992736] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T17:55:20.622305] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T17:55:20.758146] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-14T17:55:21.187097] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T17:55:21.558103] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-14T17:55:22.061177] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T17:55:22.358111] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-14T17:55:22.990328] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T17:55:23.158123] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-14T17:55:23.958132] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-14T17:55:24.733494] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T17:55:24.758059] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-14T17:55:24.868157] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T17:55:25.491511] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T17:55:25.558106] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-14T17:55:26.322187] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T17:55:26.358139] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-14T17:55:26.908485] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T17:55:27.158188] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-14T17:55:27.597625] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T17:55:27.958165] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-14T17:55:28.758157] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-14T17:55:29.374199] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T17:55:29.558060] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-14T17:55:29.604808] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T17:55:30.358156] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-14T17:55:30.897131] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-14T17:55:31.158090] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-14T17:55:31.322220] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T17:55:31.734481] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T17:55:31.958081] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-14T17:55:32.741615] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T17:55:32.743089] [INFO ] [REMOTE ] CBAN: Full fetch complete (16156 records). [2025-10-14T17:55:32.743163] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-14T17:55:32.764788] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-14T17:55:33.123335] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-14T17:55:33.123507] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-14T17:55:33.123946] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-14T17:55:33.124010] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-14T17:55:33.124708] [DEBUG] [LOCAL ] CBAN: Trimmed 16156 records to 10508 (keeping 200 days of data) [2025-10-14T17:55:33.187466] [DEBUG] [LOCAL ] CBAN: Primary data saved (10508 records). [2025-10-14T17:55:33.187592] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-14T17:55:33.187691] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBAN took 19.3s. Estimated remaining: 4h 31m 31s. Rate: 7.2 symbols/min [2025-10-14T17:55:33.355134] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:33.387609] [DEBUG] [LOCAL ] CBT: Loaded 30960 existing records from primary storage. [2025-10-14T17:55:33.387889] [INFO ] [MAIN ] CBT: Loaded 30960 existing records. [2025-10-14T17:55:33.566477] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:33.562969] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-14T17:55:33.567584] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-14T17:55:33.567687] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-14T17:55:33.568001] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-14T17:55:33.568096] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-14T17:55:33.938515] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:33.942370] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-14T17:55:34.227172] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T17:55:34.358079] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-14T17:55:35.158104] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-14T17:55:35.505061] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-14T17:55:35.958072] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-14T17:55:36.095964] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T17:55:36.758104] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-14T17:55:37.371145] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T17:55:37.558063] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-14T17:55:37.796311] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T17:55:38.000218] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T17:55:38.358089] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-14T17:55:38.969634] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-14T17:55:39.158107] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-14T17:55:39.958065] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-14T17:55:40.083517] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T17:55:40.363717] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T17:55:40.364510] [INFO ] [REMOTE ] CBNA: Full fetch complete (4407 records). [2025-10-14T17:55:40.364589] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-14T17:55:40.736196] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-14T17:55:40.736273] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-14T17:55:40.736404] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-14T17:55:40.736488] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-14T17:55:40.736895] [DEBUG] [LOCAL ] CBNA: Trimmed 4407 records to 2912 (keeping 200 days of data) [2025-10-14T17:55:40.754720] [DEBUG] [LOCAL ] CBNA: Primary data saved (2912 records). [2025-10-14T17:55:40.754831] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-14T17:55:40.754906] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBNA took 26.9s. Estimated remaining: 4h 31m 20s. Rate: 7.2 symbols/min [2025-10-14T17:55:40.765268] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-14T17:55:40.927554] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:40.949983] [DEBUG] [LOCAL ] CBU: Loaded 22651 existing records from primary storage. [2025-10-14T17:55:40.950223] [INFO ] [MAIN ] CBU: Loaded 22651 existing records. [2025-10-14T17:55:41.142074] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:41.142339] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-14T17:55:41.142397] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-14T17:55:41.142708] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-14T17:55:41.142778] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-14T17:55:41.501831] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:41.558085] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-14T17:55:42.358085] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-14T17:55:42.472755] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T17:55:42.474011] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T17:55:43.158086] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-14T17:55:43.224808] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T17:55:43.958113] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-14T17:55:44.408114] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T17:55:44.758119] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-14T17:55:45.558076] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-14T17:55:45.618176] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T17:55:45.841469] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T17:55:46.271899] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T17:55:46.358096] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-14T17:55:47.158098] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-14T17:55:47.751287] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T17:55:47.958088] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-14T17:55:48.758099] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-14T17:55:48.889447] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T17:55:48.926687] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T17:55:49.558096] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-14T17:55:49.832446] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T17:55:50.358090] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-14T17:55:50.568694] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T17:55:51.158078] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-14T17:55:51.687133] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T17:55:51.958082] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-14T17:55:52.460392] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T17:55:52.758097] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-14T17:55:53.369168] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T17:55:53.375246] [INFO ] [REMOTE ] CBRE: Full fetch complete (73868 records). [2025-10-14T17:55:53.375403] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-14T17:55:53.563267] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-14T17:55:53.822060] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-14T17:55:53.822157] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-14T17:55:53.823252] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-14T17:55:53.823318] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-14T17:55:53.824853] [DEBUG] [LOCAL ] CBRE: Trimmed 73868 records to 50370 (keeping 200 days of data) [2025-10-14T17:55:54.138670] [DEBUG] [LOCAL ] CBRE: Primary data saved (50370 records). [2025-10-14T17:55:54.138801] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-14T17:55:54.138881] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBRE took 37.4s. Estimated remaining: 4h 31m 36s. Rate: 7.2 symbols/min [2025-10-14T17:55:54.318795] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:55:54.352065] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:54.352778] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-14T17:55:54.352835] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-14T17:55:54.353299] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-14T17:55:54.353343] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-14T17:55:54.353384] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-14T17:55:54.353416] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-14T17:55:54.364767] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-14T17:55:54.522935] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T17:55:54.601332] [INFO ] [REMOTE ] CBL: Full fetch complete (25284 records). [2025-10-14T17:55:54.630343] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-14T17:55:54.880629] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:55.130262] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-14T17:55:55.130341] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-14T17:55:55.130806] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-14T17:55:55.130867] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-14T17:55:55.131534] [DEBUG] [LOCAL ] CBL: Trimmed 25284 records to 16285 (keeping 200 days of data) [2025-10-14T17:55:55.183308] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-14T17:55:55.244124] [DEBUG] [LOCAL ] CBL: Primary data saved (16285 records). [2025-10-14T17:55:55.244271] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-14T17:55:55.244353] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBL took 41.3s. Estimated remaining: 4h 30m 53s. Rate: 7.3 symbols/min [2025-10-14T17:55:55.440546] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:55.476769] [DEBUG] [LOCAL ] CBZ: Loaded 34102 existing records from primary storage. [2025-10-14T17:55:55.477085] [INFO ] [MAIN ] CBZ: Loaded 34102 existing records. [2025-10-14T17:55:55.671464] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:55.671806] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-14T17:55:55.672007] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-14T17:55:55.672728] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-14T17:55:55.672787] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-14T17:55:55.938934] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T17:55:55.966078] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-14T17:55:56.055216] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:56.446279] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T17:55:56.758073] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-14T17:55:56.939327] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:55:56.939622] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-14T17:55:56.939727] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:55:56.939776] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-14T17:55:56.939833] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:55:56.939900] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-14T17:55:56.939960] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-14T17:55:56.939995] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-14T17:55:56.940032] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-14T17:55:56.940076] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBX took 2.8s. Estimated remaining: 4h 30m 13s. Rate: 7.3 symbols/min [2025-10-14T17:55:57.122408] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:55:57.139491] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T17:55:57.193996] [DEBUG] [LOCAL ] CC: Loaded 52999 existing records from primary storage. [2025-10-14T17:55:57.194299] [INFO ] [MAIN ] CC: Loaded 52999 existing records. [2025-10-14T17:55:57.377693] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:55:57.377894] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-14T17:55:57.377949] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-14T17:55:57.378784] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-14T17:55:57.378841] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-14T17:55:57.559716] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-14T17:55:57.754605] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:55:58.358076] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-14T17:55:59.008633] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T17:55:59.158124] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-14T17:55:59.601977] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T17:55:59.958084] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-14T17:56:00.359473] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T17:56:00.758081] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-14T17:56:01.061811] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T17:56:01.558043] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-14T17:56:01.960519] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T17:56:02.358095] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-14T17:56:03.159818] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-14T17:56:03.163224] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T17:56:03.467355] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T17:56:03.958125] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-14T17:56:04.527288] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T17:56:04.758097] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-14T17:56:05.237722] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T17:56:05.558047] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-14T17:56:05.938631] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T17:56:06.358095] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-14T17:56:06.822801] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T17:56:07.158132] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-14T17:56:07.744772] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T17:56:07.748779] [INFO ] [REMOTE ] CBT: Full fetch complete (45739 records). [2025-10-14T17:56:07.748915] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-14T17:56:07.963621] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-14T17:56:08.157067] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-14T17:56:08.157146] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-14T17:56:08.157762] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-14T17:56:08.157823] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-14T17:56:08.158830] [DEBUG] [LOCAL ] CBT: Trimmed 45739 records to 31069 (keeping 200 days of data) [2025-10-14T17:56:08.343215] [DEBUG] [LOCAL ] CBT: Primary data saved (31069 records). [2025-10-14T17:56:08.343342] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-14T17:56:08.343421] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBT took 35.2s. Estimated remaining: 4h 30m 20s. Rate: 7.3 symbols/min [2025-10-14T17:56:08.512754] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:08.565389] [DEBUG] [LOCAL ] CCI: Loaded 53123 existing records from primary storage. [2025-10-14T17:56:08.565740] [INFO ] [MAIN ] CCI: Loaded 53123 existing records. [2025-10-14T17:56:08.755862] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:56:08.756476] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-14T17:56:08.756579] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-14T17:56:08.757356] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-14T17:56:08.757435] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-14T17:56:08.771491] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-14T17:56:09.030637] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T17:56:09.168040] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:09.278462] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T17:56:09.558087] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-14T17:56:10.121010] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T17:56:10.273954] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T17:56:10.358123] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-14T17:56:11.158112] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-14T17:56:11.479423] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T17:56:11.958073] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-14T17:56:12.198201] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T17:56:12.758191] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-14T17:56:13.558093] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-14T17:56:13.865464] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T17:56:14.165989] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T17:56:14.358114] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-14T17:56:15.075871] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T17:56:15.158067] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-14T17:56:15.597074] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T17:56:15.958096] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-14T17:56:16.763199] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-14T17:56:16.781547] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T17:56:17.208904] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T17:56:17.212143] [INFO ] [REMOTE ] CBU: Full fetch complete (32441 records). [2025-10-14T17:56:17.212287] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-14T17:56:17.569538] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-14T17:56:17.584039] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-14T17:56:17.584102] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-14T17:56:17.584781] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-14T17:56:17.584876] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-14T17:56:17.585999] [DEBUG] [LOCAL ] CBU: Trimmed 32441 records to 22672 (keeping 200 days of data) [2025-10-14T17:56:17.725465] [DEBUG] [LOCAL ] CBU: Primary data saved (22672 records). [2025-10-14T17:56:17.725596] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-14T17:56:17.725694] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBU took 37.0s. Estimated remaining: 4h 30m 17s. Rate: 7.3 symbols/min [2025-10-14T17:56:17.896439] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:17.896672] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-14T17:56:17.896746] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-14T17:56:17.896924] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-14T17:56:17.896975] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-14T17:56:17.897018] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-14T17:56:17.897053] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-14T17:56:18.277763] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:18.279374] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T17:56:18.358045] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-14T17:56:19.150851] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T17:56:19.161174] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-14T17:56:19.367098] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T17:56:19.958179] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-14T17:56:20.758098] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-14T17:56:20.885804] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T17:56:21.558099] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-14T17:56:21.702928] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T17:56:21.888229] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T17:56:22.358058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-14T17:56:23.158103] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-14T17:56:23.219565] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T17:56:23.794185] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T17:56:23.798237] [INFO ] [REMOTE ] CBZ: Full fetch complete (45861 records). [2025-10-14T17:56:23.798342] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-14T17:56:23.968857] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-14T17:56:24.170849] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-14T17:56:24.170925] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-14T17:56:24.171533] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-14T17:56:24.171573] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-14T17:56:24.172531] [DEBUG] [LOCAL ] CBZ: Trimmed 45861 records to 34151 (keeping 200 days of data) [2025-10-14T17:56:24.364773] [DEBUG] [LOCAL ] CBZ: Primary data saved (34151 records). [2025-10-14T17:56:24.364902] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-14T17:56:24.365005] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CBZ took 29.1s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-14T17:56:24.535471] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:24.551737] [DEBUG] [LOCAL ] CCIF: Loaded 15647 existing records from primary storage. [2025-10-14T17:56:24.551938] [INFO ] [MAIN ] CCIF: Loaded 15647 existing records. [2025-10-14T17:56:24.730046] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:56:24.730381] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-14T17:56:24.730515] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-14T17:56:24.731412] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-14T17:56:24.731482] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-14T17:56:24.763250] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-14T17:56:25.094809] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:25.123855] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T17:56:25.312793] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T17:56:25.558036] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-14T17:56:25.960914] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-14T17:56:26.358088] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-14T17:56:27.142958] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T17:56:27.158053] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-14T17:56:27.958066] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-14T17:56:28.229585] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T17:56:28.378367] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-14T17:56:28.677527] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T17:56:28.758114] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-14T17:56:29.558140] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-14T17:56:29.659027] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T17:56:30.358138] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-14T17:56:31.158111] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-14T17:56:31.263614] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T17:56:31.508565] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-14T17:56:31.721094] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T17:56:31.729445] [INFO ] [REMOTE ] CC: Full fetch complete (75985 records). [2025-10-14T17:56:31.729624] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-14T17:56:31.963281] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-14T17:56:32.157633] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-14T17:56:32.157750] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-14T17:56:32.158620] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-14T17:56:32.158710] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-14T17:56:32.160253] [DEBUG] [LOCAL ] CC: Trimmed 75985 records to 53008 (keeping 200 days of data) [2025-10-14T17:56:32.392219] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T17:56:32.489144] [DEBUG] [LOCAL ] CC: Primary data saved (53008 records). [2025-10-14T17:56:32.489302] [INFO ] [MAIN ] CC: Full history saved. [2025-10-14T17:56:32.489408] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CC took 35.5s. Estimated remaining: 4h 29m 52s. Rate: 7.3 symbols/min [2025-10-14T17:56:32.661138] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:32.717614] [DEBUG] [LOCAL ] CCJ: Loaded 53684 existing records from primary storage. [2025-10-14T17:56:32.718027] [INFO ] [MAIN ] CCJ: Loaded 53684 existing records. [2025-10-14T17:56:32.763292] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-14T17:56:32.908556] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:56:32.908854] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-14T17:56:32.908912] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-14T17:56:32.909442] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-14T17:56:32.909499] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-14T17:56:32.973145] [DEBUG] [REMOTE ] CCIF: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-14T17:56:32.990237] [WARN ] [REMOTE ] CCIF: No data returned for month 2025-01 [2025-10-14T17:56:33.011304] [FATAL] [REMOTE ] CCIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:56:33.011472] [FATAL] [MAIN ] CCIF: Failed to fetch primary data. [2025-10-14T17:56:33.011838] [WARN ] [MAIN ] CCIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:56:33.022370] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-14T17:56:33.052385] [DEBUG] [LOCAL ] CCIF: No primary data file found to delete. [2025-10-14T17:56:33.087569] [INFO ] [LOCAL ] CCIF: Starting deletion of derivative data. [2025-10-14T17:56:33.123669] [DEBUG] [LOCAL ] CCIF: Deleted derivative data file. [2025-10-14T17:56:33.156163] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CCIF took 8.8s. Estimated remaining: 4h 29m 7s. Rate: 7.3 symbols/min [2025-10-14T17:56:33.418371] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:33.464563] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:33.505314] [DEBUG] [LOCAL ] CCK: Loaded 46359 existing records from primary storage. [2025-10-14T17:56:33.505620] [INFO ] [MAIN ] CCK: Loaded 46359 existing records. [2025-10-14T17:56:33.566339] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-14T17:56:33.683065] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:56:33.683273] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-14T17:56:33.683319] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-14T17:56:33.684150] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-14T17:56:33.684207] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-14T17:56:34.032130] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:34.358145] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-14T17:56:35.158075] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-14T17:56:35.560986] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-14T17:56:35.722153] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-14T17:56:35.958101] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-14T17:56:36.361664] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T17:56:36.758143] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-14T17:56:37.558088] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-14T17:56:37.960180] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-14T17:56:38.004903] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-14T17:56:38.130308] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T17:56:38.358076] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-14T17:56:39.158151] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-14T17:56:39.918490] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T17:56:39.958052] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-14T17:56:40.733769] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T17:56:40.758054] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-14T17:56:41.558054] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-14T17:56:41.789382] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-14T17:56:41.796236] [INFO ] [REMOTE ] CCI: Full fetch complete (77112 records). [2025-10-14T17:56:41.796389] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-14T17:56:42.268395] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-14T17:56:42.268539] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-14T17:56:42.269627] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-14T17:56:42.269748] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-14T17:56:42.271607] [DEBUG] [LOCAL ] CCI: Trimmed 77112 records to 53124 (keeping 200 days of data) [2025-10-14T17:56:42.362906] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-14T17:56:42.393418] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T17:56:42.685507] [DEBUG] [LOCAL ] CCI: Primary data saved (53124 records). [2025-10-14T17:56:42.685682] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-14T17:56:42.685783] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCI took 34.3s. Estimated remaining: 4h 29m 5s. Rate: 7.3 symbols/min [2025-10-14T17:56:42.758635] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-14T17:56:42.878441] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:42.942708] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-14T17:56:42.943081] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-14T17:56:43.123455] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:56:43.123709] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-14T17:56:43.123877] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-14T17:56:43.124993] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-14T17:56:43.125051] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-14T17:56:43.163624] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-14T17:56:43.416548] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T17:56:43.524955] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:43.671670] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-14T17:56:43.958100] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-14T17:56:44.758114] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-14T17:56:45.525118] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T17:56:45.558070] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-14T17:56:46.358124] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-14T17:56:47.012221] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-14T17:56:47.152639] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T17:56:47.158030] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-14T17:56:47.201573] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:56:47.582912] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T17:56:47.958082] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-14T17:56:48.758099] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-14T17:56:49.179935] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T17:56:49.181052] [INFO ] [REMOTE ] CCIA: Full fetch complete (2162 records). [2025-10-14T17:56:49.181143] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-14T17:56:49.378836] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T17:56:49.379180] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T17:56:49.379251] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T17:56:49.379334] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-14T17:56:49.379401] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-14T17:56:49.379437] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-14T17:56:49.379476] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-14T17:56:49.379540] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCIA took 31.7s. Estimated remaining: 4h 28m 50s. Rate: 7.3 symbols/min [2025-10-14T17:56:49.560744] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-14T17:56:49.562549] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:56:49.610509] [DEBUG] [LOCAL ] CCO: Loaded 48214 existing records from primary storage. [2025-10-14T17:56:49.610886] [INFO ] [MAIN ] CCO: Loaded 48214 existing records. [2025-10-14T17:56:49.818002] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:56:49.818429] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-14T17:56:49.818492] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-14T17:56:49.818791] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-14T17:56:49.818880] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-14T17:56:49.970062] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-14T17:56:50.239191] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:56:50.358058] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-14T17:56:51.158192] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-14T17:56:51.795622] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-14T17:56:51.860316] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T17:56:51.958093] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-14T17:56:52.758060] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-14T17:56:53.287574] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-14T17:56:53.334820] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T17:56:53.558107] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-14T17:56:53.781999] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T17:56:54.358133] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-14T17:56:54.868988] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T17:56:55.158140] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-14T17:56:55.958123] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-14T17:56:56.239419] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T17:56:56.329362] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-14T17:56:56.758114] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-14T17:56:57.558086] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-14T17:56:57.819363] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T17:56:58.358171] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-14T17:56:58.572456] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T17:56:59.158068] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-14T17:56:59.212965] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-14T17:56:59.476527] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T17:56:59.958115] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-14T17:57:00.758117] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-14T17:57:01.558091] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-14T17:57:01.811398] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-14T17:57:02.358076] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-14T17:57:02.417965] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-14T17:57:02.463633] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T17:57:02.841747] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T17:57:03.158125] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-14T17:57:03.958083] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-14T17:57:04.157980] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T17:57:04.758090] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-14T17:57:05.558093] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-14T17:57:05.647233] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-14T17:57:05.685241] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T17:57:06.358102] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-14T17:57:06.628463] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T17:57:06.860231] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T17:57:07.158183] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-14T17:57:07.924663] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T17:57:07.958051] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-14T17:57:08.708346] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T17:57:08.758127] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-14T17:57:09.445597] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T17:57:09.450868] [INFO ] [REMOTE ] CCK: Full fetch complete (67728 records). [2025-10-14T17:57:09.450982] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-14T17:57:09.563176] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-14T17:57:09.843538] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-14T17:57:09.843634] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-14T17:57:09.844607] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-14T17:57:09.844706] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-14T17:57:09.846125] [DEBUG] [LOCAL ] CCK: Trimmed 67728 records to 46416 (keeping 200 days of data) [2025-10-14T17:57:10.162221] [DEBUG] [LOCAL ] CCK: Primary data saved (46416 records). [2025-10-14T17:57:10.162366] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-14T17:57:10.162536] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCK took 37.0s. Estimated remaining: 4h 29m 41s. Rate: 7.2 symbols/min [2025-10-14T17:57:10.333636] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:10.371790] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-14T17:57:10.386015] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T17:57:10.381490] [DEBUG] [LOCAL ] CCRD: Loaded 9386 existing records from primary storage. [2025-10-14T17:57:10.396705] [INFO ] [MAIN ] CCRD: Loaded 9386 existing records. [2025-10-14T17:57:10.600718] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:57:10.600985] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-14T17:57:10.601035] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-14T17:57:10.601383] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-14T17:57:10.601451] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-14T17:57:11.039797] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:11.158089] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-14T17:57:11.804050] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-14T17:57:11.813199] [INFO ] [REMOTE ] CCJ: Full fetch complete (77820 records). [2025-10-14T17:57:11.816713] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T17:57:11.816462] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-14T17:57:11.963153] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-14T17:57:12.212817] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-14T17:57:12.212907] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-14T17:57:12.213811] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-14T17:57:12.213874] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-14T17:57:12.215370] [DEBUG] [LOCAL ] CCJ: Trimmed 77820 records to 53686 (keeping 200 days of data) [2025-10-14T17:57:12.538186] [DEBUG] [LOCAL ] CCJ: Primary data saved (53686 records). [2025-10-14T17:57:12.538318] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-14T17:57:12.538394] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCJ took 40.0s. Estimated remaining: 4h 29m 5s. Rate: 7.3 symbols/min [2025-10-14T17:57:12.718994] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:12.719176] [DEBUG] [LOCAL ] CCS: No existing data file found in primary storage. [2025-10-14T17:57:12.716072] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T17:57:12.720852] [WARN ] [MAIN ] CCS: No existing data found, performing full refresh instead. [2025-10-14T17:57:12.721631] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-14T17:57:12.721713] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-14T17:57:12.721765] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-10-14T17:57:12.721797] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-14T17:57:12.764259] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-14T17:57:13.096607] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:13.125547] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-14T17:57:13.431847] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T17:57:13.558103] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-14T17:57:14.358158] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-14T17:57:14.885452] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T17:57:15.158128] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-14T17:57:15.812140] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T17:57:15.958082] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-14T17:57:16.758093] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-14T17:57:17.239011] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T17:57:17.269938] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T17:57:17.524502] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-14T17:57:17.558087] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-14T17:57:18.358085] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-14T17:57:19.158121] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-14T17:57:19.568164] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T17:57:19.587101] [INFO ] [REMOTE ] CCO: Full fetch complete (67021 records). [2025-10-14T17:57:19.611154] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-14T17:57:19.614374] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-14T17:57:19.779822] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T17:57:19.963161] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-14T17:57:20.032829] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-14T17:57:20.032910] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-14T17:57:20.033715] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-14T17:57:20.033775] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-14T17:57:20.035105] [DEBUG] [LOCAL ] CCO: Trimmed 67021 records to 48290 (keeping 200 days of data) [2025-10-14T17:57:20.300592] [DEBUG] [LOCAL ] CCO: Primary data saved (48290 records). [2025-10-14T17:57:20.300742] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-14T17:57:20.301426] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCO took 30.9s. Estimated remaining: 4h 28m 54s. Rate: 7.3 symbols/min [2025-10-14T17:57:20.471838] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:20.496594] [DEBUG] [LOCAL ] CCU: Loaded 22590 existing records from primary storage. [2025-10-14T17:57:20.497025] [INFO ] [MAIN ] CCU: Loaded 22590 existing records. [2025-10-14T17:57:20.687547] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:57:20.687810] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-14T17:57:20.687863] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-14T17:57:20.688256] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-14T17:57:20.688316] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-14T17:57:20.763750] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-14T17:57:21.047161] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:21.327692] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T17:57:21.464672] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T17:57:21.558071] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-14T17:57:22.358076] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-14T17:57:22.903078] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T17:57:23.158085] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-14T17:57:23.814435] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T17:57:23.958060] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-14T17:57:24.445919] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T17:57:24.758073] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-14T17:57:24.870578] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T17:57:25.558111] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-14T17:57:26.155406] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T17:57:26.359220] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-14T17:57:26.360849] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T17:57:27.068816] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T17:57:27.158066] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-14T17:57:27.958115] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-14T17:57:28.057000] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T17:57:28.758093] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-14T17:57:29.414688] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T17:57:29.558148] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-14T17:57:29.733593] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T17:57:30.358119] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-14T17:57:31.158076] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-14T17:57:31.616250] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T17:57:31.857411] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-14T17:57:31.859946] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T17:57:31.958099] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-14T17:57:32.758077] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-14T17:57:33.558109] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-14T17:57:33.980089] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T17:57:34.008444] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-14T17:57:34.014859] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-14T17:57:34.015024] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-14T17:57:34.366453] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-14T17:57:34.427431] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-14T17:57:34.427504] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-14T17:57:34.428457] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-14T17:57:34.428519] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-14T17:57:34.429986] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-14T17:57:34.763923] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-14T17:57:34.764190] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-14T17:57:34.764287] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCL took 52.1s. Estimated remaining: 4h 29m 15s. Rate: 7.2 symbols/min [2025-10-14T17:57:34.931979] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:34.932176] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-14T17:57:34.932220] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-14T17:57:34.932341] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-14T17:57:34.932383] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-14T17:57:34.932424] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-14T17:57:34.932456] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-14T17:57:35.174731] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-14T17:57:35.200713] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T17:57:35.222251] [INFO ] [REMOTE ] CCRD: Full fetch complete (11924 records). [2025-10-14T17:57:35.222566] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-14T17:57:35.377487] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:35.418096] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T17:57:35.753030] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-14T17:57:35.753136] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-14T17:57:35.753486] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-14T17:57:35.753568] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-14T17:57:35.754119] [DEBUG] [LOCAL ] CCRD: Trimmed 11924 records to 9483 (keeping 200 days of data) [2025-10-14T17:57:35.809496] [DEBUG] [LOCAL ] CCRD: Primary data saved (9483 records). [2025-10-14T17:57:35.809624] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-14T17:57:35.809739] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 25.6s. Estimated remaining: 4h 28m 33s. Rate: 7.3 symbols/min [2025-10-14T17:57:35.959754] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-14T17:57:35.980545] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:36.033083] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-14T17:57:36.033445] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-14T17:57:36.208065] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:57:36.208263] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-14T17:57:36.208308] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-14T17:57:36.208822] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-14T17:57:36.208882] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-14T17:57:36.449859] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-14T17:57:36.563979] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:36.640282] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T17:57:36.758089] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-14T17:57:37.558088] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-14T17:57:38.030330] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-14T17:57:38.068092] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T17:57:38.358107] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-14T17:57:39.158141] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-14T17:57:39.454304] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T17:57:39.958125] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-14T17:57:40.191524] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-14T17:57:40.758145] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-14T17:57:40.825723] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T17:57:40.976207] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-14T17:57:41.558080] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-14T17:57:42.320379] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T17:57:42.358056] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-14T17:57:43.093038] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T17:57:43.158103] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-14T17:57:43.958071] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-14T17:57:44.179420] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T17:57:44.758087] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-14T17:57:45.558051] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-14T17:57:45.661876] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T17:57:45.716264] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T17:57:46.358092] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-14T17:57:46.939875] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T17:57:47.158059] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-14T17:57:47.958093] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-14T17:57:48.169822] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T17:57:48.171710] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T17:57:48.184691] [INFO ] [REMOTE ] CCU: Full fetch complete (32403 records). [2025-10-14T17:57:48.185295] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-14T17:57:48.315919] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-14T17:57:48.557175] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-14T17:57:48.557266] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-14T17:57:48.557856] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-14T17:57:48.557919] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-14T17:57:48.558874] [DEBUG] [LOCAL ] CCU: Trimmed 32403 records to 22426 (keeping 200 days of data) [2025-10-14T17:57:48.687997] [DEBUG] [LOCAL ] CCU: Primary data saved (22426 records). [2025-10-14T17:57:48.688164] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-14T17:57:48.688247] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCU took 28.4s. Estimated remaining: 4h 28m 46s. Rate: 7.3 symbols/min [2025-10-14T17:57:48.763243] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-14T17:57:48.859387] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:48.871495] [DEBUG] [LOCAL ] CDLR: Loaded 9992 existing records from primary storage. [2025-10-14T17:57:48.871725] [INFO ] [MAIN ] CDLR: Loaded 9992 existing records. [2025-10-14T17:57:49.048883] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:57:49.052350] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-14T17:57:49.052458] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-14T17:57:49.052165] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-14T17:57:49.053844] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-14T17:57:49.053932] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-14T17:57:49.408203] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:49.558091] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-14T17:57:50.358155] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-14T17:57:50.394810] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T17:57:51.158089] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-14T17:57:51.965049] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-14T17:57:51.986226] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T17:57:52.206892] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:57:52.207190] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-14T17:57:52.207277] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:57:52.207354] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-14T17:57:52.207415] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:57:52.207486] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-14T17:57:52.207546] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-14T17:57:52.207581] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-14T17:57:52.207624] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-14T17:57:52.207702] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCZ took 17.4s. Estimated remaining: 4h 28m 16s. Rate: 7.3 symbols/min [2025-10-14T17:57:52.384304] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:52.422750] [DEBUG] [LOCAL ] CDP: Loaded 42558 existing records from primary storage. [2025-10-14T17:57:52.423079] [INFO ] [MAIN ] CDP: Loaded 42558 existing records. [2025-10-14T17:57:52.607847] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:57:52.608195] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-14T17:57:52.608310] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-14T17:57:52.614373] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-14T17:57:52.624635] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-14T17:57:52.631022] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T17:57:52.763225] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-14T17:57:52.992223] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:53.558100] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-14T17:57:54.174541] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T17:57:54.178200] [INFO ] [REMOTE ] CCS: Full fetch complete (44876 records). [2025-10-14T17:57:54.178295] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-14T17:57:54.364830] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-14T17:57:54.578321] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-14T17:57:54.578407] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-14T17:57:54.579135] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-14T17:57:54.579199] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-14T17:57:54.580263] [DEBUG] [LOCAL ] CCS: Trimmed 44876 records to 30327 (keeping 200 days of data) [2025-10-14T17:57:54.760015] [DEBUG] [LOCAL ] CCS: Primary data saved (30327 records). [2025-10-14T17:57:54.760145] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-14T17:57:54.760216] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CCS took 42.2s. Estimated remaining: 4h 27m 41s. Rate: 7.3 symbols/min [2025-10-14T17:57:54.929879] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:57:54.953892] [DEBUG] [LOCAL ] CDRE: Loaded 24847 existing records from primary storage. [2025-10-14T17:57:54.954167] [INFO ] [MAIN ] CDRE: Loaded 24847 existing records. [2025-10-14T17:57:55.146388] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:57:55.146777] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-14T17:57:55.146930] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-14T17:57:55.147190] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-14T17:57:55.147360] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-14T17:57:55.179304] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-14T17:57:55.545185] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:57:55.548476] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-14T17:57:55.893464] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T17:57:55.958060] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-14T17:57:56.146476] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T17:57:56.521149] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T17:57:56.758172] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-14T17:57:57.558084] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-14T17:57:57.687492] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T17:57:58.358136] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-14T17:57:59.134353] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T17:57:59.158057] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-14T17:57:59.463852] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T17:57:59.958136] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-14T17:58:00.583601] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T17:58:00.611637] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T17:58:00.758064] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-14T17:58:01.558076] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-14T17:58:02.327359] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T17:58:02.358083] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-14T17:58:02.371956] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T17:58:03.158094] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-14T17:58:03.958114] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-14T17:58:03.998155] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T17:58:04.091748] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T17:58:04.758144] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-14T17:58:05.544344] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T17:58:05.558030] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-14T17:58:06.005487] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-14T17:58:06.281862] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T17:58:06.358121] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-14T17:58:07.119844] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T17:58:07.158125] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-14T17:58:07.958084] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-14T17:58:08.758064] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-14T17:58:08.801414] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T17:58:08.925590] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T17:58:08.927611] [INFO ] [REMOTE ] CDLR: Full fetch complete (13779 records). [2025-10-14T17:58:08.927707] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-14T17:58:09.284561] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-14T17:58:09.284630] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-14T17:58:09.284966] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-14T17:58:09.285011] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-14T17:58:09.285463] [DEBUG] [LOCAL ] CDLR: Trimmed 13779 records to 10012 (keeping 200 days of data) [2025-10-14T17:58:09.342155] [DEBUG] [LOCAL ] CDLR: Primary data saved (10012 records). [2025-10-14T17:58:09.342279] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-14T17:58:09.342355] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDLR took 20.7s. Estimated remaining: 4h 28m 2s. Rate: 7.3 symbols/min [2025-10-14T17:58:09.508294] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:09.555532] [DEBUG] [LOCAL ] CE: Loaded 51411 existing records from primary storage. [2025-10-14T17:58:09.555856] [INFO ] [MAIN ] CE: Loaded 51411 existing records. [2025-10-14T17:58:09.567186] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-14T17:58:09.736781] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:58:09.737011] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-14T17:58:09.737059] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-14T17:58:09.738130] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-14T17:58:09.738191] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-14T17:58:10.088340] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:10.358105] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-14T17:58:10.561516] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T17:58:10.837319] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T17:58:11.158156] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-14T17:58:11.787756] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T17:58:11.958056] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-14T17:58:12.685520] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T17:58:12.758037] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-14T17:58:12.803890] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T17:58:13.558075] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-14T17:58:14.358076] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-14T17:58:14.594019] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T17:58:15.158063] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-14T17:58:15.424106] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T17:58:15.488975] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T17:58:15.958067] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-14T17:58:16.349805] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T17:58:16.758102] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-14T17:58:17.288287] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T17:58:17.558153] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-14T17:58:18.358196] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-14T17:58:18.557389] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T17:58:19.025129] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-14T17:58:19.031182] [INFO ] [REMOTE ] CDE: Full fetch complete (77769 records). [2025-10-14T17:58:19.031310] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-14T17:58:19.171262] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-14T17:58:19.430089] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-14T17:58:19.430345] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-14T17:58:19.431355] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-14T17:58:19.431435] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-14T17:58:19.432925] [DEBUG] [LOCAL ] CDE: Trimmed 77769 records to 53643 (keeping 200 days of data) [2025-10-14T17:58:19.560622] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T17:58:19.781692] [DEBUG] [LOCAL ] CDE: Primary data saved (53643 records). [2025-10-14T17:58:19.781850] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-14T17:58:19.781934] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 44.0s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-14T17:58:19.967391] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-14T17:58:19.970107] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:19.978788] [DEBUG] [LOCAL ] CEE: Loaded 5436 existing records from primary storage. [2025-10-14T17:58:19.978958] [INFO ] [MAIN ] CEE: Loaded 5436 existing records. [2025-10-14T17:58:20.158913] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:58:20.159298] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-14T17:58:20.159590] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-14T17:58:20.159891] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-14T17:58:20.159980] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-14T17:58:20.277924] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T17:58:20.537212] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:20.758117] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-14T17:58:21.558158] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-14T17:58:21.831074] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T17:58:22.095694] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T17:58:22.358147] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-14T17:58:22.681884] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T17:58:22.919039] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T17:58:23.158060] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-14T17:58:23.958082] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-14T17:58:24.667917] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T17:58:24.758136] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-14T17:58:24.800782] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T17:58:25.558119] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-14T17:58:26.307428] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T17:58:26.358063] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-14T17:58:26.555145] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T17:58:27.158115] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-14T17:58:27.958069] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-14T17:58:28.108871] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T17:58:28.243491] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T17:58:28.248964] [INFO ] [REMOTE ] CDP: Full fetch complete (61875 records). [2025-10-14T17:58:28.249247] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-14T17:58:28.671337] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-14T17:58:28.671521] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-14T17:58:28.672808] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-14T17:58:28.672996] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-14T17:58:28.674889] [DEBUG] [LOCAL ] CDP: Trimmed 61875 records to 42524 (keeping 200 days of data) [2025-10-14T17:58:28.781394] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-14T17:58:28.807265] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T17:58:28.988743] [DEBUG] [LOCAL ] CDP: Primary data saved (42524 records). [2025-10-14T17:58:28.988935] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-14T17:58:28.989076] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDP took 36.8s. Estimated remaining: 4h 27m 60s. Rate: 7.3 symbols/min [2025-10-14T17:58:29.171692] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:29.205961] [DEBUG] [LOCAL ] CEPU: Loaded 26365 existing records from primary storage. [2025-10-14T17:58:29.206381] [INFO ] [MAIN ] CEPU: Loaded 26365 existing records. [2025-10-14T17:58:29.410870] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:58:29.411162] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-14T17:58:29.411219] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-14T17:58:29.411628] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-14T17:58:29.411740] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-14T17:58:29.567138] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-14T17:58:29.830790] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:30.279396] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T17:58:30.358107] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-14T17:58:30.622818] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T17:58:31.158092] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-14T17:58:31.511306] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T17:58:31.958091] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-14T17:58:32.758083] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-14T17:58:32.845841] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T17:58:32.898926] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T17:58:33.558108] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-14T17:58:33.728971] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T17:58:34.358120] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-14T17:58:34.643737] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T17:58:35.158065] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-14T17:58:35.391917] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T17:58:35.958124] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-14T17:58:36.015456] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T17:58:36.758057] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-14T17:58:37.010603] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T17:58:37.558138] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-14T17:58:37.752381] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T17:58:37.755497] [INFO ] [REMOTE ] CDRE: Full fetch complete (35160 records). [2025-10-14T17:58:37.755568] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-14T17:58:38.122250] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-14T17:58:38.122325] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-14T17:58:38.122893] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-14T17:58:38.122952] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-14T17:58:38.123720] [DEBUG] [LOCAL ] CDRE: Trimmed 35160 records to 24873 (keeping 200 days of data) [2025-10-14T17:58:38.275432] [DEBUG] [LOCAL ] CDRE: Primary data saved (24873 records). [2025-10-14T17:58:38.275568] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-14T17:58:38.275669] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CDRE took 43.5s. Estimated remaining: 4h 27m 56s. Rate: 7.3 symbols/min [2025-10-14T17:58:38.363334] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-14T17:58:38.460858] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:38.509368] [DEBUG] [LOCAL ] CF: Loaded 52116 existing records from primary storage. [2025-10-14T17:58:38.509682] [INFO ] [MAIN ] CF: Loaded 52116 existing records. [2025-10-14T17:58:38.696427] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:58:38.696869] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-14T17:58:38.697052] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-14T17:58:38.713015] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-14T17:58:38.712956] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T17:58:38.713179] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-14T17:58:39.073527] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:39.158038] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-14T17:58:39.958119] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-14T17:58:40.028086] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T17:58:40.449284] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T17:58:40.758118] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-14T17:58:41.192373] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T17:58:41.558073] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-14T17:58:42.136445] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T17:58:42.157762] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T17:58:42.358104] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-14T17:58:42.964814] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-14T17:58:43.158082] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-14T17:58:43.958134] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-14T17:58:44.758121] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-14T17:58:45.080458] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T17:58:45.558095] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-14T17:58:45.641421] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T17:58:45.727925] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T17:58:46.244506] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T17:58:46.358071] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-14T17:58:47.158072] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-14T17:58:47.841667] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T17:58:47.932205] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T17:58:47.958037] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-14T17:58:48.758117] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-14T17:58:49.558061] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-14T17:58:49.619469] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T17:58:49.625325] [INFO ] [REMOTE ] CE: Full fetch complete (74882 records). [2025-10-14T17:58:49.625437] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-14T17:58:49.771695] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T17:58:49.963334] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T17:58:50.056462] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-14T17:58:50.056541] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-14T17:58:50.057426] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-14T17:58:50.057514] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-14T17:58:50.059098] [DEBUG] [LOCAL ] CE: Trimmed 74882 records to 51362 (keeping 200 days of data) [2025-10-14T17:58:50.358268] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-14T17:58:50.364081] [DEBUG] [LOCAL ] CE: Primary data saved (51362 records). [2025-10-14T17:58:50.364154] [INFO ] [MAIN ] CE: Full history saved. [2025-10-14T17:58:50.365033] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CE took 41.0s. Estimated remaining: 4h 28m 5s. Rate: 7.2 symbols/min [2025-10-14T17:58:50.543465] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:50.596633] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-14T17:58:50.597088] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-14T17:58:50.777041] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:58:50.777261] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-14T17:58:50.777329] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-14T17:58:50.777844] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-14T17:58:50.777902] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-14T17:58:51.137831] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:51.158061] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-14T17:58:51.796561] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T17:58:51.958082] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-14T17:58:52.758165] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-14T17:58:52.906946] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T17:58:53.166897] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T17:58:53.167813] [INFO ] [REMOTE ] CEE: Full fetch complete (10138 records). [2025-10-14T17:58:53.167898] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-14T17:58:53.534522] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-14T17:58:53.534590] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-14T17:58:53.534894] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-14T17:58:53.534955] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-14T17:58:53.535415] [DEBUG] [LOCAL ] CEE: Trimmed 10138 records to 5395 (keeping 200 days of data) [2025-10-14T17:58:53.559955] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-14T17:58:53.569659] [DEBUG] [LOCAL ] CEE: Primary data saved (5395 records). [2025-10-14T17:58:53.569730] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-14T17:58:53.569800] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CEE took 33.8s. Estimated remaining: 4h 27m 34s. Rate: 7.3 symbols/min [2025-10-14T17:58:53.746811] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:53.747111] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-14T17:58:53.747196] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-14T17:58:53.747363] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-14T17:58:53.747408] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-14T17:58:53.747448] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-14T17:58:53.747479] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-14T17:58:54.132994] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-14T17:58:54.152204] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:54.358052] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-14T17:58:54.566487] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T17:58:54.566784] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-14T17:58:54.566890] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T17:58:54.566968] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-14T17:58:54.567051] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T17:58:54.567148] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-14T17:58:54.567229] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-14T17:58:54.567266] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-14T17:58:54.567322] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-14T17:58:54.567368] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CFND took 1.0s. Estimated remaining: 4h 26m 53s. Rate: 7.3 symbols/min [2025-10-14T17:58:54.755698] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:58:54.791716] [DEBUG] [LOCAL ] CFR: Loaded 32698 existing records from primary storage. [2025-10-14T17:58:54.792008] [INFO ] [MAIN ] CFR: Loaded 32698 existing records. [2025-10-14T17:58:54.990882] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:58:54.991485] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-14T17:58:54.991636] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-14T17:58:54.992238] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-14T17:58:54.992322] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-14T17:58:55.167289] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-14T17:58:55.305764] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T17:58:55.396825] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:58:55.958140] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-14T17:58:56.655938] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T17:58:56.758077] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-14T17:58:57.243780] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T17:58:57.558079] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-14T17:58:58.065407] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T17:58:58.341749] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T17:58:58.358040] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-14T17:58:59.158058] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-14T17:58:59.339000] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T17:58:59.958103] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-14T17:59:00.701854] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T17:59:00.758050] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-14T17:59:01.338498] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T17:59:01.344869] [INFO ] [REMOTE ] CEPU: Full fetch complete (39734 records). [2025-10-14T17:59:01.345083] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-14T17:59:01.558298] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-14T17:59:01.741683] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-14T17:59:01.741778] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-14T17:59:01.742392] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-14T17:59:01.742434] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-14T17:59:01.743352] [DEBUG] [LOCAL ] CEPU: Trimmed 39734 records to 26472 (keeping 200 days of data) [2025-10-14T17:59:01.919968] [DEBUG] [LOCAL ] CEPU: Primary data saved (26472 records). [2025-10-14T17:59:01.920127] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-14T17:59:01.920211] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CEPU took 32.9s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-14T17:59:02.089691] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:02.089920] [DEBUG] [LOCAL ] CGAU: No existing data file found in primary storage. [2025-10-14T17:59:02.089962] [WARN ] [MAIN ] CGAU: No existing data found, performing full refresh instead. [2025-10-14T17:59:02.090034] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-14T17:59:02.090069] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-14T17:59:02.090108] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-14T17:59:02.090139] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-14T17:59:02.366088] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-14T17:59:02.449829] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:02.721887] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T17:59:03.052472] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T17:59:03.158045] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-14T17:59:03.958138] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-14T17:59:04.022236] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T17:59:04.545195] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T17:59:04.758128] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-14T17:59:05.517387] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T17:59:05.558069] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-14T17:59:06.358147] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-14T17:59:06.640381] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T17:59:06.714619] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T17:59:07.158087] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-14T17:59:07.704024] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T17:59:07.958074] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-14T17:59:08.751867] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T17:59:08.760034] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-14T17:59:09.361166] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T17:59:09.558152] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-14T17:59:10.358132] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-14T17:59:10.624862] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T17:59:10.703425] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T17:59:11.158096] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-14T17:59:11.958089] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-14T17:59:12.120149] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T17:59:12.334906] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T17:59:12.758162] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-14T17:59:13.319292] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T17:59:13.325119] [INFO ] [REMOTE ] CF: Full fetch complete (75432 records). [2025-10-14T17:59:13.325262] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-14T17:59:13.567677] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-14T17:59:13.740583] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-14T17:59:13.740723] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-14T17:59:13.741683] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-14T17:59:13.741745] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-14T17:59:13.743226] [DEBUG] [LOCAL ] CF: Trimmed 75432 records to 52133 (keeping 200 days of data) [2025-10-14T17:59:14.097762] [DEBUG] [LOCAL ] CF: Primary data saved (52133 records). [2025-10-14T17:59:14.098099] [INFO ] [MAIN ] CF: Full history saved. [2025-10-14T17:59:14.098245] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CF took 35.8s. Estimated remaining: 4h 26m 50s. Rate: 7.3 symbols/min [2025-10-14T17:59:14.312539] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T17:59:14.363137] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-14T17:59:14.445163] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:14.450766] [DEBUG] [LOCAL ] CGV: Loaded 1391 existing records from primary storage. [2025-10-14T17:59:14.451046] [INFO ] [MAIN ] CGV: Loaded 1391 existing records. [2025-10-14T17:59:14.748587] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:59:14.748895] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-14T17:59:14.748956] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-14T17:59:14.749156] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-14T17:59:14.749227] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-14T17:59:15.166923] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-14T17:59:15.200327] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T17:59:15.280976] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:15.615759] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T17:59:15.958088] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-14T17:59:16.527784] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T17:59:16.758093] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-14T17:59:17.059486] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T17:59:17.066260] [INFO ] [REMOTE ] CFG: Full fetch complete (77747 records). [2025-10-14T17:59:17.066449] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-14T17:59:17.182444] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-14T17:59:17.478509] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-14T17:59:17.478591] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-14T17:59:17.479528] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-14T17:59:17.479598] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-14T17:59:17.481066] [DEBUG] [LOCAL ] CFG: Trimmed 77747 records to 53622 (keeping 200 days of data) [2025-10-14T17:59:17.575085] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-14T17:59:17.814600] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-14T17:59:17.814766] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-14T17:59:17.815477] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CFG took 27.5s. Estimated remaining: 4h 26m 21s. Rate: 7.3 symbols/min [2025-10-14T17:59:17.993018] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:18.019752] [DEBUG] [LOCAL ] CHCT: Loaded 24096 existing records from primary storage. [2025-10-14T17:59:18.020026] [INFO ] [MAIN ] CHCT: Loaded 24096 existing records. [2025-10-14T17:59:18.200769] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:59:18.200994] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-14T17:59:18.201040] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-14T17:59:18.201363] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-14T17:59:18.201419] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-14T17:59:18.361388] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-14T17:59:18.560151] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:18.890199] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T17:59:19.082078] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T17:59:19.158080] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-14T17:59:19.958104] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-14T17:59:20.268336] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-14T17:59:20.657686] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T17:59:20.758070] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-14T17:59:21.558107] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-14T17:59:22.235295] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T17:59:22.358047] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-14T17:59:22.735928] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T17:59:23.158147] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-14T17:59:23.543186] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T17:59:23.958098] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-14T17:59:24.051776] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T17:59:24.758095] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-14T17:59:25.026208] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T17:59:25.558068] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-14T17:59:25.804843] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T17:59:26.358136] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-14T17:59:26.743896] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T17:59:27.158177] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-14T17:59:27.796735] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T17:59:27.958052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-14T17:59:28.205781] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T17:59:28.460446] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T17:59:28.758134] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-14T17:59:29.558092] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-14T17:59:29.865774] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T17:59:29.890834] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-14T17:59:30.358160] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-14T17:59:30.779256] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T17:59:31.158124] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-14T17:59:31.958101] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-14T17:59:32.758067] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-14T17:59:32.872499] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T17:59:33.146727] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-14T17:59:33.558086] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-14T17:59:33.794435] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T17:59:34.295471] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T17:59:34.358069] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-14T17:59:34.776122] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-14T17:59:35.158148] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-14T17:59:35.389524] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-14T17:59:35.958092] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-14T17:59:36.758057] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-14T17:59:36.798320] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T17:59:37.018832] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-14T17:59:37.558105] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-14T17:59:38.013951] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T17:59:38.014926] [INFO ] [REMOTE ] CGV: Full fetch complete (2272 records). [2025-10-14T17:59:38.014998] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-14T17:59:38.367554] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-14T17:59:38.367762] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-14T17:59:38.368054] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-14T17:59:38.368227] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-14T17:59:38.369065] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-14T17:59:38.369411] [DEBUG] [LOCAL ] CGV: Trimmed 2272 records to 1397 (keeping 200 days of data) [2025-10-14T17:59:38.378466] [DEBUG] [LOCAL ] CGV: Primary data saved (1397 records). [2025-10-14T17:59:38.378525] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-14T17:59:38.378592] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CGV took 24.3s. Estimated remaining: 4h 27m 8s. Rate: 7.3 symbols/min [2025-10-14T17:59:38.545237] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:38.594453] [DEBUG] [LOCAL ] CHD: Loaded 52293 existing records from primary storage. [2025-10-14T17:59:38.594773] [INFO ] [MAIN ] CHD: Loaded 52293 existing records. [2025-10-14T17:59:38.769081] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:59:38.769312] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-14T17:59:38.769358] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-14T17:59:38.769884] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-14T17:59:38.769941] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-14T17:59:39.158151] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:39.158262] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-14T17:59:39.334507] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T17:59:39.958098] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-14T17:59:40.682013] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T17:59:40.746413] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T17:59:40.758033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-14T17:59:41.558076] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-14T17:59:41.818150] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T17:59:42.358136] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-14T17:59:42.674811] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T17:59:43.158089] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-14T17:59:43.958076] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-14T17:59:44.114686] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T17:59:44.507113] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T17:59:44.512869] [INFO ] [REMOTE ] CGAU: Full fetch complete (61401 records). [2025-10-14T17:59:44.513000] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-14T17:59:44.765472] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-14T17:59:44.898311] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-14T17:59:44.898410] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-14T17:59:44.899283] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-14T17:59:44.899347] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-14T17:59:44.900740] [DEBUG] [LOCAL ] CGAU: Trimmed 61401 records to 43482 (keeping 200 days of data) [2025-10-14T17:59:45.120919] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T17:59:45.127317] [INFO ] [REMOTE ] CFR: Full fetch complete (48218 records). [2025-10-14T17:59:45.128249] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-14T17:59:45.338491] [DEBUG] [LOCAL ] CGAU: Primary data saved (43482 records). [2025-10-14T17:59:45.352671] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-14T17:59:45.357912] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGAU took 43.4s. Estimated remaining: 4h 26m 54s. Rate: 7.3 symbols/min [2025-10-14T17:59:45.565272] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-14T17:59:45.706621] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:45.738856] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-14T17:59:45.738937] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-14T17:59:45.739675] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-14T17:59:45.739784] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-14T17:59:45.740825] [DEBUG] [LOCAL ] CFR: Trimmed 48218 records to 32654 (keeping 200 days of data) [2025-10-14T17:59:45.862473] [DEBUG] [LOCAL ] CHE: Loaded 15364 existing records from primary storage. [2025-10-14T17:59:45.874094] [INFO ] [MAIN ] CHE: Loaded 15364 existing records. [2025-10-14T17:59:46.104235] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T17:59:46.145491] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:59:46.151285] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-14T17:59:46.151416] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-14T17:59:46.146187] [INFO ] [REMOTE ] CHCT: Full fetch complete (34752 records). [2025-10-14T17:59:46.152979] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-14T17:59:46.154464] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-14T17:59:46.154386] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-14T17:59:46.163118] [DEBUG] [LOCAL ] CFR: Primary data saved (32654 records). [2025-10-14T17:59:46.201906] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-14T17:59:46.311073] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CFR took 51.7s. Estimated remaining: 4h 26m 13s. Rate: 7.3 symbols/min [2025-10-14T17:59:46.841585] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:47.162937] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-14T17:59:47.174141] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-14T17:59:47.175255] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-14T17:59:47.180166] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:47.181062] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-14T17:59:47.180633] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-14T17:59:47.197346] [DEBUG] [LOCAL ] CHCT: Trimmed 34752 records to 24137 (keeping 200 days of data) [2025-10-14T17:59:47.341982] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T17:59:47.355385] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-14T17:59:47.355066] [DEBUG] [LOCAL ] CHGG: Loaded 47763 existing records from primary storage. [2025-10-14T17:59:47.357761] [INFO ] [MAIN ] CHGG: Loaded 47763 existing records. [2025-10-14T17:59:47.603677] [DEBUG] [LOCAL ] CHCT: Primary data saved (24137 records). [2025-10-14T17:59:47.603486] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T17:59:47.604066] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-14T17:59:47.604274] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-14T17:59:47.604534] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 29.8s. Estimated remaining: 4h 25m 34s. Rate: 7.3 symbols/min [2025-10-14T17:59:47.604395] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-14T17:59:47.610302] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-14T17:59:47.610413] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-14T17:59:48.035777] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T17:59:48.062448] [DEBUG] [LOCAL ] CHH: No existing data file found in primary storage. [2025-10-14T17:59:48.062549] [WARN ] [MAIN ] CHH: No existing data found, performing full refresh instead. [2025-10-14T17:59:48.085959] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-14T17:59:48.091240] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-14T17:59:48.096719] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-10-14T17:59:48.104731] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-14T17:59:48.216450] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T17:59:48.290190] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-14T17:59:48.334931] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:48.618513] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T17:59:48.758100] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-14T17:59:48.902531] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T17:59:48.950921] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T17:59:49.558124] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-14T17:59:49.806972] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T17:59:50.358132] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-14T17:59:50.887174] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T17:59:51.158116] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-14T17:59:51.958125] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-14T17:59:51.978149] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T17:59:52.239013] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T17:59:52.758148] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-14T17:59:53.264992] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T17:59:53.558112] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-14T17:59:54.358136] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-14T17:59:54.607054] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T17:59:55.158144] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-14T17:59:55.215818] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T17:59:55.295214] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T17:59:55.958081] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-14T17:59:56.658839] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T17:59:56.758069] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-14T17:59:57.210587] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T17:59:57.411842] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T17:59:57.558085] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-14T17:59:58.358097] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-14T17:59:58.490019] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T17:59:59.158105] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-14T17:59:59.727492] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T17:59:59.958092] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-14T18:00:00.758119] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-14T18:00:00.791786] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T18:00:01.558141] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-14T18:00:01.736824] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:00:02.358110] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-14T18:00:02.612381] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T18:00:02.674325] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T18:00:03.158165] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-14T18:00:03.963682] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-14T18:00:03.978005] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T18:00:04.002485] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T18:00:04.758118] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-14T18:00:05.558073] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-14T18:00:05.751191] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T18:00:06.358116] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-14T18:00:06.882906] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-14T18:00:06.925706] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T18:00:07.158173] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-14T18:00:07.465166] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T18:00:07.958113] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-14T18:00:08.771861] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-14T18:00:08.774777] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T18:00:08.833774] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T18:00:09.558109] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-14T18:00:10.358131] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-14T18:00:10.534681] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T18:00:10.796906] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T18:00:10.799391] [INFO ] [REMOTE ] CHE: Full fetch complete (20296 records). [2025-10-14T18:00:10.799464] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-14T18:00:11.161148] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-14T18:00:11.161445] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-14T18:00:11.162389] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-14T18:00:11.162949] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-14T18:00:11.163026] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-14T18:00:11.163877] [DEBUG] [LOCAL ] CHE: Trimmed 20296 records to 15380 (keeping 200 days of data) [2025-10-14T18:00:11.264160] [DEBUG] [LOCAL ] CHE: Primary data saved (15380 records). [2025-10-14T18:00:11.264303] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-14T18:00:11.264380] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHE took 25.9s. Estimated remaining: 4h 26m 34s. Rate: 7.3 symbols/min [2025-10-14T18:00:11.436484] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:00:11.456498] [DEBUG] [LOCAL ] CHMI: Loaded 21617 existing records from primary storage. [2025-10-14T18:00:11.456785] [INFO ] [MAIN ] CHMI: Loaded 21617 existing records. [2025-10-14T18:00:11.633173] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:00:11.633418] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-14T18:00:11.633478] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-14T18:00:11.634112] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-14T18:00:11.634225] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-14T18:00:11.966822] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-14T18:00:11.996609] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:00:12.666292] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T18:00:12.672097] [INFO ] [REMOTE ] CHD: Full fetch complete (74709 records). [2025-10-14T18:00:12.672202] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-14T18:00:12.766332] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-14T18:00:13.065308] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-14T18:00:13.065382] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-14T18:00:13.066239] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-14T18:00:13.066336] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-14T18:00:13.067803] [DEBUG] [LOCAL ] CHD: Trimmed 74709 records to 52310 (keeping 200 days of data) [2025-10-14T18:00:13.379764] [DEBUG] [LOCAL ] CHD: Primary data saved (52310 records). [2025-10-14T18:00:13.379893] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-14T18:00:13.379973] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHD took 35.0s. Estimated remaining: 4h 25m 59s. Rate: 7.3 symbols/min [2025-10-14T18:00:14.014571] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (3.66 seconds). [2025-10-14T18:00:14.036496] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-14T18:00:14.045306] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T18:00:14.358189] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-14T18:00:15.325029] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T18:00:15.332058] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-14T18:00:15.345969] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T18:00:15.857452] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (3.89 seconds). [2025-10-14T18:00:15.958127] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-14T18:00:16.403886] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T18:00:16.758170] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-14T18:00:17.558121] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-14T18:00:17.779285] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T18:00:17.988079] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T18:00:18.358084] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-14T18:00:18.616623] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T18:00:19.158215] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-14T18:00:19.644458] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T18:00:19.958148] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-14T18:00:20.758120] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-14T18:00:20.989924] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T18:00:21.059635] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T18:00:21.066091] [INFO ] [REMOTE ] CHH: Full fetch complete (47420 records). [2025-10-14T18:00:21.066255] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-14T18:00:21.445541] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-14T18:00:21.445621] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-14T18:00:21.446301] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-14T18:00:21.446353] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-14T18:00:21.447430] [DEBUG] [LOCAL ] CHH: Trimmed 47420 records to 32451 (keeping 200 days of data) [2025-10-14T18:00:21.558057] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-14T18:00:21.661477] [DEBUG] [LOCAL ] CHH: Primary data saved (32451 records). [2025-10-14T18:00:21.661666] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-14T18:00:21.661760] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHH took 34.1s. Estimated remaining: 4h 25m 50s. Rate: 7.3 symbols/min [2025-10-14T18:00:21.680898] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T18:00:22.358171] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-14T18:00:23.089979] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T18:00:23.158047] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-14T18:00:23.711365] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T18:00:23.958084] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-14T18:00:24.885426] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T18:00:24.894925] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-14T18:00:24.910555] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T18:00:24.916414] [INFO ] [REMOTE ] CHGG: Full fetch complete (70377 records). [2025-10-14T18:00:24.916562] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-14T18:00:25.310237] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-14T18:00:25.310316] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-14T18:00:25.311155] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-14T18:00:25.311218] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-14T18:00:25.312554] [DEBUG] [LOCAL ] CHGG: Trimmed 70377 records to 47711 (keeping 200 days of data) [2025-10-14T18:00:25.583071] [DEBUG] [LOCAL ] CHGG: Primary data saved (47711 records). [2025-10-14T18:00:25.583234] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-14T18:00:25.583360] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHGG took 39.3s. Estimated remaining: 4h 25m 23s. Rate: 7.3 symbols/min [2025-10-14T18:00:25.991346] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T18:00:25.996524] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-14T18:00:27.105915] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T18:00:27.110937] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-14T18:00:28.200109] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T18:00:28.204638] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-14T18:00:29.099396] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T18:00:29.105392] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-14T18:00:30.179005] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T18:00:30.182198] [INFO ] [REMOTE ] CHMI: Full fetch complete (31871 records). [2025-10-14T18:00:30.182311] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-14T18:00:30.565607] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-14T18:00:30.565754] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-14T18:00:30.566306] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-14T18:00:30.566368] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-14T18:00:30.567242] [DEBUG] [LOCAL ] CHMI: Trimmed 31871 records to 21630 (keeping 200 days of data) [2025-10-14T18:00:30.691508] [DEBUG] [LOCAL ] CHMI: Primary data saved (21630 records). [2025-10-14T18:00:30.691659] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-14T18:00:30.691777] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHMI took 19.4s. Estimated remaining: 4h 25m 1s. Rate: 7.3 symbols/min [2025-10-14T18:00:31.298364] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:00:31.347744] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-14T18:00:31.395690] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-14T18:00:31.402966] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-14T18:00:31.402792] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:00:31.400698] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:00:31.418100] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-14T18:00:31.421284] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:00:31.421693] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-14T18:00:31.422098] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-14T18:00:31.618007] [DEBUG] [LOCAL ] CHT: Loaded 19498 existing records from primary storage. [2025-10-14T18:00:31.631492] [INFO ] [MAIN ] CHT: Loaded 19498 existing records. [2025-10-14T18:00:31.775430] [DEBUG] [LOCAL ] CHPT: Loaded 47848 existing records from primary storage. [2025-10-14T18:00:31.866085] [INFO ] [MAIN ] CHPT: Loaded 47848 existing records. [2025-10-14T18:00:31.866890] [DEBUG] [LOCAL ] CHWY: Loaded 53653 existing records from primary storage. [2025-10-14T18:00:31.929341] [INFO ] [MAIN ] CHWY: Loaded 53653 existing records. [2025-10-14T18:00:32.172351] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:00:32.234411] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-14T18:00:32.395068] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:00:32.426091] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-14T18:00:32.478634] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-14T18:00:32.490223] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:00:32.513919] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-14T18:00:32.513695] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:00:32.514125] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-14T18:00:32.514169] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-14T18:00:32.514341] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-14T18:00:32.514808] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-14T18:00:32.515030] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-14T18:00:32.515100] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-14T18:00:32.520462] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-14T18:00:32.520367] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-14T18:00:32.566491] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-14T18:00:33.014151] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T18:00:33.056538] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-14T18:00:33.597074] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:00:33.612193] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:00:33.612513] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-14T18:00:33.646103] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-14T18:00:33.682988] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:00:33.683374] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-14T18:00:33.889073] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T18:00:33.891142] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-14T18:00:34.598721] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T18:00:34.600627] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-14T18:00:34.752413] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T18:00:34.756482] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-14T18:00:34.952259] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-14T18:00:35.158126] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-14T18:00:35.692827] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-14T18:00:35.737988] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T18:00:35.754445] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-14T18:00:35.923369] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-14T18:00:35.958049] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-14T18:00:36.758088] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-14T18:00:37.558095] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-14T18:00:38.147873] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-14T18:00:38.358115] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-14T18:00:38.710350] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-14T18:00:38.732776] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T18:00:38.794611] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T18:00:39.158087] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-14T18:00:39.958094] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-14T18:00:40.758125] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-14T18:00:40.895249] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T18:00:41.558083] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-14T18:00:41.604327] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T18:00:41.684914] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T18:00:42.358073] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-14T18:00:43.158162] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-14T18:00:43.473821] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T18:00:43.958054] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-14T18:00:44.288763] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T18:00:44.466253] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-14T18:00:44.758073] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-14T18:00:45.532688] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T18:00:45.558047] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-14T18:00:45.868862] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T18:00:46.160407] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T18:00:46.358114] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-14T18:00:47.158157] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-14T18:00:47.958105] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-14T18:00:48.544620] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T18:00:48.590724] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-14T18:00:48.758060] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-14T18:00:48.957218] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T18:00:49.558094] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-14T18:00:50.268145] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T18:00:50.358143] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-14T18:00:50.746570] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-14T18:00:51.158135] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-14T18:00:51.958141] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-14T18:00:52.314731] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-14T18:00:52.338168] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T18:00:52.758079] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-14T18:00:53.558273] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-14T18:00:53.826017] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T18:00:54.299702] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T18:00:54.301753] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T18:00:54.358076] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-14T18:00:55.158131] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-14T18:00:55.958068] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-14T18:00:56.322420] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-14T18:00:56.513587] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-14T18:00:56.563699] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T18:00:56.564700] [INFO ] [REMOTE ] CHN: Full fetch complete (7402 records). [2025-10-14T18:00:56.564774] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-14T18:00:56.565172] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:00:56.565253] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:00:56.565294] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:00:56.565358] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-14T18:00:56.565421] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-14T18:00:56.565461] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-14T18:00:56.565501] [DEBUG] [LOCAL ] CHN: No derivative data file found to delete. [2025-10-14T18:00:56.565552] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHN took 25.9s. Estimated remaining: 4h 26m 10s. Rate: 7.2 symbols/min [2025-10-14T18:00:56.753557] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:00:56.758086] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-14T18:00:56.806918] [DEBUG] [LOCAL ] CI: Loaded 49808 existing records from primary storage. [2025-10-14T18:00:56.807243] [INFO ] [MAIN ] CI: Loaded 49808 existing records. [2025-10-14T18:00:56.991933] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:00:56.992162] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-14T18:00:56.992224] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-14T18:00:56.992797] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-14T18:00:56.992854] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-14T18:00:57.354223] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:00:57.558065] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-14T18:00:58.358130] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-14T18:00:58.519730] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T18:00:59.104878] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T18:00:59.158038] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-14T18:00:59.658602] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-14T18:00:59.958114] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-14T18:01:00.030922] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T18:01:00.758117] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-14T18:01:01.558075] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-14T18:01:02.063686] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T18:01:02.111007] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-14T18:01:02.358072] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-14T18:01:02.658188] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T18:01:02.662045] [INFO ] [REMOTE ] CHT: Full fetch complete (27527 records). [2025-10-14T18:01:02.662182] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-14T18:01:03.054661] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-14T18:01:03.054747] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-14T18:01:03.055235] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-14T18:01:03.055274] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-14T18:01:03.056125] [DEBUG] [LOCAL ] CHT: Trimmed 27527 records to 19461 (keeping 200 days of data) [2025-10-14T18:01:03.158759] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-14T18:01:03.173055] [DEBUG] [LOCAL ] CHT: Primary data saved (19461 records). [2025-10-14T18:01:03.173237] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-14T18:01:03.173322] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHT took 32.5s. Estimated remaining: 4h 25m 54s. Rate: 7.2 symbols/min [2025-10-14T18:01:03.345324] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:03.362237] [DEBUG] [LOCAL ] CIA: Loaded 16686 existing records from primary storage. [2025-10-14T18:01:03.362449] [INFO ] [MAIN ] CIA: Loaded 16686 existing records. [2025-10-14T18:01:03.540021] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:01:03.540304] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-14T18:01:03.540351] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-14T18:01:03.540592] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-14T18:01:03.540685] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-14T18:01:03.919306] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:03.958059] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-14T18:01:04.130119] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T18:01:04.637866] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T18:01:04.642169] [INFO ] [REMOTE ] CHPT: Full fetch complete (71586 records). [2025-10-14T18:01:04.642297] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-14T18:01:04.643086] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:01:04.643198] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:01:04.643250] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:01:04.643290] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-14T18:01:04.643345] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-14T18:01:04.643377] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-14T18:01:04.643663] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-10-14T18:01:04.643758] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CHPT took 34.0s. Estimated remaining: 4h 25m 17s. Rate: 7.3 symbols/min [2025-10-14T18:01:04.761727] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-14T18:01:04.838914] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T18:01:04.863510] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:04.863760] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-14T18:01:04.863810] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-14T18:01:04.863930] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-14T18:01:04.863972] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-14T18:01:04.864014] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-14T18:01:04.864048] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-14T18:01:05.220545] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:05.558073] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-14T18:01:06.358097] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-14T18:01:06.474897] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T18:01:06.505857] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T18:01:07.158102] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-14T18:01:07.188813] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T18:01:07.958143] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-14T18:01:08.286986] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T18:01:08.758110] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-14T18:01:09.558049] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-14T18:01:09.627566] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T18:01:09.656907] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T18:01:10.358089] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-14T18:01:11.158117] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-14T18:01:11.615443] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-14T18:01:11.723905] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T18:01:11.958123] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-14T18:01:12.100714] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T18:01:12.758063] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-14T18:01:13.537099] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T18:01:13.558050] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-14T18:01:13.666070] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T18:01:14.358171] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-14T18:01:15.163130] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-14T18:01:15.172542] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T18:01:15.359431] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T18:01:15.958116] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-14T18:01:16.732625] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T18:01:16.743125] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T18:01:16.758073] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-14T18:01:17.558075] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-14T18:01:18.080149] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T18:01:18.242587] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T18:01:18.358065] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-14T18:01:19.158096] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-14T18:01:19.419254] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T18:01:19.958072] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-14T18:01:20.758062] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-14T18:01:20.880449] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T18:01:21.252619] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-14T18:01:21.258759] [INFO ] [REMOTE ] CHWY: Full fetch complete (77775 records). [2025-10-14T18:01:21.258885] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-14T18:01:21.563142] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-14T18:01:21.658972] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-14T18:01:21.659673] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-14T18:01:21.660810] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-14T18:01:21.660935] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-14T18:01:21.662530] [DEBUG] [LOCAL ] CHWY: Trimmed 77775 records to 53654 (keeping 200 days of data) [2025-10-14T18:01:21.785701] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T18:01:22.027620] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-14T18:01:22.027779] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-14T18:01:22.027862] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHWY took 51.3s. Estimated remaining: 4h 25m 48s. Rate: 7.2 symbols/min [2025-10-14T18:01:22.199139] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:22.199299] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-14T18:01:22.199339] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-14T18:01:22.199455] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-14T18:01:22.199497] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-14T18:01:22.199538] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-14T18:01:22.199571] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-14T18:01:22.359211] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-14T18:01:22.573254] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:22.582806] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T18:01:23.158107] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-14T18:01:23.499135] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T18:01:23.511010] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-14T18:01:23.958094] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-14T18:01:24.272611] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-14T18:01:24.758128] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-14T18:01:25.558096] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-14T18:01:25.793052] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T18:01:25.795305] [INFO ] [REMOTE ] CIA: Full fetch complete (23493 records). [2025-10-14T18:01:25.795461] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-14T18:01:26.178987] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-14T18:01:26.179062] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-14T18:01:26.179564] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-14T18:01:26.179603] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-14T18:01:26.180328] [DEBUG] [LOCAL ] CIA: Trimmed 23493 records to 16701 (keeping 200 days of data) [2025-10-14T18:01:26.272383] [DEBUG] [LOCAL ] CIA: Primary data saved (16701 records). [2025-10-14T18:01:26.272523] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-14T18:01:26.272604] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CIA took 23.1s. Estimated remaining: 4h 25m 22s. Rate: 7.3 symbols/min [2025-10-14T18:01:26.371636] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-14T18:01:26.444918] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:26.445211] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-14T18:01:26.445347] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-14T18:01:26.445582] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-14T18:01:26.445773] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-14T18:01:26.445857] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-14T18:01:26.445901] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-14T18:01:26.615670] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T18:01:26.826722] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:27.158117] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-14T18:01:27.958082] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-14T18:01:28.442438] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T18:01:28.457061] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-14T18:01:28.758081] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-14T18:01:29.070585] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T18:01:29.083098] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-14T18:01:29.558077] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-14T18:01:30.358096] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-14T18:01:31.158141] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-14T18:01:31.256421] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T18:01:31.283118] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T18:01:31.958084] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-14T18:01:32.758138] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-14T18:01:33.064872] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-14T18:01:33.104738] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T18:01:33.387157] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T18:01:33.558123] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-14T18:01:34.358085] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-14T18:01:34.528306] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T18:01:34.531798] [INFO ] [REMOTE ] CIB: Full fetch complete (44998 records). [2025-10-14T18:01:34.531882] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-14T18:01:34.908004] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T18:01:34.911346] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-14T18:01:34.911402] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-14T18:01:34.912098] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-14T18:01:34.912158] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-14T18:01:34.913067] [DEBUG] [LOCAL ] CIB: Trimmed 44998 records to 30546 (keeping 200 days of data) [2025-10-14T18:01:35.087223] [DEBUG] [LOCAL ] CIB: Primary data saved (30546 records). [2025-10-14T18:01:35.087352] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-14T18:01:35.087421] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CIB took 30.4s. Estimated remaining: 4h 25m 16s. Rate: 7.2 symbols/min [2025-10-14T18:01:35.163222] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-14T18:01:35.290879] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:35.298281] [DEBUG] [LOCAL ] CIF: Loaded 4061 existing records from primary storage. [2025-10-14T18:01:35.298437] [INFO ] [MAIN ] CIF: Loaded 4061 existing records. [2025-10-14T18:01:35.474582] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:01:35.474844] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-14T18:01:35.474911] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-14T18:01:35.475082] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-14T18:01:35.475140] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-14T18:01:35.848675] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:35.958034] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-14T18:01:36.633214] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T18:01:36.649677] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T18:01:36.758059] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-14T18:01:37.072138] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-14T18:01:37.558101] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-14T18:01:38.358078] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-14T18:01:38.945954] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T18:01:38.981335] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T18:01:39.158048] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-14T18:01:39.958077] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-14T18:01:40.507751] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T18:01:40.758080] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-14T18:01:40.870407] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T18:01:41.485146] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T18:01:41.558097] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-14T18:01:42.125622] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:01:42.358096] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-14T18:01:42.761931] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-14T18:01:43.158135] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-14T18:01:43.649756] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T18:01:43.958126] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-14T18:01:44.442191] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T18:01:44.447572] [INFO ] [REMOTE ] CI: Full fetch complete (72225 records). [2025-10-14T18:01:44.447715] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-14T18:01:44.763230] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-14T18:01:44.841963] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-14T18:01:44.842048] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-14T18:01:44.843004] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-14T18:01:44.843078] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-14T18:01:44.845153] [DEBUG] [LOCAL ] CI: Trimmed 72225 records to 49778 (keeping 200 days of data) [2025-10-14T18:01:45.173452] [DEBUG] [LOCAL ] CI: Primary data saved (49778 records). [2025-10-14T18:01:45.173589] [INFO ] [MAIN ] CI: Full history saved. [2025-10-14T18:01:45.173691] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CI took 48.6s. Estimated remaining: 4h 25m 16s. Rate: 7.2 symbols/min [2025-10-14T18:01:45.342035] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:45.342217] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-14T18:01:45.342255] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-14T18:01:45.342388] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-14T18:01:45.342462] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-14T18:01:45.342540] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-14T18:01:45.342604] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-14T18:01:45.566943] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-14T18:01:45.707367] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:46.294455] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T18:01:46.358101] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-14T18:01:46.566275] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T18:01:46.864002] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-14T18:01:47.158093] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-14T18:01:47.851764] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T18:01:47.958121] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-14T18:01:48.280306] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-14T18:01:48.758071] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-14T18:01:49.089424] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-14T18:01:49.558154] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-14T18:01:50.358148] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-14T18:01:50.843973] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T18:01:51.158117] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-14T18:01:51.556793] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T18:01:51.774154] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T18:01:51.775108] [INFO ] [REMOTE ] CICB: Full fetch complete (1963 records). [2025-10-14T18:01:51.775177] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-14T18:01:51.775746] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:01:51.775826] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:01:51.775869] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:01:51.775920] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-14T18:01:51.775971] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-14T18:01:51.776055] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-14T18:01:51.776099] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-14T18:01:51.776152] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CICB took 29.7s. Estimated remaining: 4h 25m 0s. Rate: 7.2 symbols/min [2025-10-14T18:01:51.966783] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:01:51.964017] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-14T18:01:51.984235] [DEBUG] [LOCAL ] CII: Loaded 15346 existing records from primary storage. [2025-10-14T18:01:51.984496] [INFO ] [MAIN ] CII: Loaded 15346 existing records. [2025-10-14T18:01:52.162908] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:01:52.163123] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-14T18:01:52.163177] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-14T18:01:52.163437] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-14T18:01:52.163492] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-14T18:01:52.516743] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:01:52.758102] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-14T18:01:53.541787] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T18:01:53.558048] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-14T18:01:53.659864] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T18:01:54.358121] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-14T18:01:55.069349] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T18:01:55.158066] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-14T18:01:55.835121] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T18:01:55.958107] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-14T18:01:56.491972] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T18:01:56.758107] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-14T18:01:56.795358] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T18:01:57.558146] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-14T18:01:57.984052] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T18:01:58.265075] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T18:01:58.358068] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-14T18:01:59.158057] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-14T18:01:59.391335] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T18:01:59.958154] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-14T18:02:00.702003] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T18:02:00.702184] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T18:02:00.712252] [INFO ] [REMOTE ] CIF: Full fetch complete (6574 records). [2025-10-14T18:02:00.712725] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-14T18:02:00.763472] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-14T18:02:01.095307] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-14T18:02:01.095385] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-14T18:02:01.095563] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-14T18:02:01.095600] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-14T18:02:01.096016] [DEBUG] [LOCAL ] CIF: Trimmed 6574 records to 4046 (keeping 200 days of data) [2025-10-14T18:02:01.120041] [DEBUG] [LOCAL ] CIF: Primary data saved (4046 records). [2025-10-14T18:02:01.120169] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-14T18:02:01.120253] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIF took 26.0s. Estimated remaining: 4h 24m 56s. Rate: 7.2 symbols/min [2025-10-14T18:02:01.296218] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:01.296425] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-14T18:02:01.296469] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-14T18:02:01.296588] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-14T18:02:01.296633] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-14T18:02:01.296849] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-14T18:02:01.296894] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-14T18:02:01.563287] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-14T18:02:01.660192] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:02.358054] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-14T18:02:02.524023] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T18:02:02.766152] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T18:02:03.158128] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-14T18:02:03.743676] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:02:03.798502] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T18:02:03.958070] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-14T18:02:04.758097] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-14T18:02:05.441152] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T18:02:05.558148] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-14T18:02:05.584707] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T18:02:06.358124] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-14T18:02:06.955856] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T18:02:07.158076] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-14T18:02:07.670715] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T18:02:07.958097] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-14T18:02:08.684221] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T18:02:08.758169] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-14T18:02:09.128991] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T18:02:09.558122] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-14T18:02:09.678070] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T18:02:10.358092] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-14T18:02:11.158099] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-14T18:02:11.291865] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T18:02:11.958119] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-14T18:02:12.256839] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T18:02:12.399329] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T18:02:12.625534] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:02:12.758118] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-14T18:02:13.558155] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-14T18:02:14.358108] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-14T18:02:14.667274] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-14T18:02:14.673139] [INFO ] [REMOTE ] CIEN: Full fetch complete (75756 records). [2025-10-14T18:02:14.673242] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-14T18:02:15.083110] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-14T18:02:15.083224] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-14T18:02:15.084242] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-14T18:02:15.084328] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-14T18:02:15.110470] [DEBUG] [LOCAL ] CIEN: Trimmed 75756 records to 52153 (keeping 200 days of data) [2025-10-14T18:02:15.111280] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T18:02:15.170533] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-14T18:02:15.434691] [DEBUG] [LOCAL ] CIEN: Primary data saved (52153 records). [2025-10-14T18:02:15.434844] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-14T18:02:15.434920] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CIEN took 49.2s. Estimated remaining: 4h 25m 14s. Rate: 7.2 symbols/min [2025-10-14T18:02:15.613393] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:15.618902] [DEBUG] [LOCAL ] CIMN: Loaded 2757 existing records from primary storage. [2025-10-14T18:02:15.619097] [INFO ] [MAIN ] CIMN: Loaded 2757 existing records. [2025-10-14T18:02:15.811838] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:02:15.812513] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-14T18:02:15.812729] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-14T18:02:15.812916] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-14T18:02:15.812957] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-14T18:02:15.962240] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-14T18:02:16.133340] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T18:02:16.216602] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:16.758073] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-14T18:02:16.907788] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:02:16.969369] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T18:02:17.151542] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-14T18:02:17.558149] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-14T18:02:18.005267] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-14T18:02:18.358079] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-14T18:02:18.827132] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T18:02:19.158078] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-14T18:02:19.958098] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-14T18:02:20.758114] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-14T18:02:20.797298] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T18:02:20.825320] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T18:02:21.558072] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-14T18:02:22.168687] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T18:02:22.358082] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-14T18:02:22.809769] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T18:02:22.815104] [INFO ] [REMOTE ] CIG: Full fetch complete (61941 records). [2025-10-14T18:02:22.815212] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-14T18:02:22.905891] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T18:02:23.163217] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-14T18:02:23.236691] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-14T18:02:23.236796] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-14T18:02:23.237631] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-14T18:02:23.237711] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-14T18:02:23.239271] [DEBUG] [LOCAL ] CIG: Trimmed 61941 records to 44270 (keeping 200 days of data) [2025-10-14T18:02:23.491753] [DEBUG] [LOCAL ] CIG: Primary data saved (44270 records). [2025-10-14T18:02:23.491881] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-14T18:02:23.491950] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIG took 38.3s. Estimated remaining: 4h 25m 5s. Rate: 7.2 symbols/min [2025-10-14T18:02:23.659827] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:23.660022] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-14T18:02:23.660077] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-14T18:02:23.660190] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-14T18:02:23.660269] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-14T18:02:23.660334] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-14T18:02:23.660368] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-14T18:02:23.963370] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-14T18:02:24.018762] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:24.129100] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T18:02:24.131437] [INFO ] [REMOTE ] CII: Full fetch complete (22791 records). [2025-10-14T18:02:24.131513] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-14T18:02:24.132234] [FATAL] [VALIDATOR ] CII: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:02:24.132329] [FATAL] [MAIN ] CII: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:02:24.132379] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:02:24.132442] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-14T18:02:24.132505] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-14T18:02:24.132540] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-10-14T18:02:24.132764] [DEBUG] [LOCAL ] CII: Deleted derivative data file. [2025-10-14T18:02:24.132851] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CII took 32.4s. Estimated remaining: 4h 24m 24s. Rate: 7.3 symbols/min [2025-10-14T18:02:24.304387] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:24.304596] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-14T18:02:24.304673] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-14T18:02:24.304786] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-14T18:02:24.304827] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-14T18:02:24.304871] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-14T18:02:24.304943] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-14T18:02:24.671761] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:24.758069] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-14T18:02:24.951396] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:02:24.951733] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-14T18:02:24.951819] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:02:24.951866] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-14T18:02:24.951927] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:02:24.951999] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-14T18:02:24.952062] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-14T18:02:24.952098] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-14T18:02:24.952162] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-14T18:02:24.952232] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMP took 0.8s. Estimated remaining: 4h 23m 44s. Rate: 7.3 symbols/min [2025-10-14T18:02:25.131299] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:25.131479] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-14T18:02:25.131530] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-14T18:02:25.131634] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-14T18:02:25.131712] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-14T18:02:25.131760] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-14T18:02:25.131792] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-14T18:02:25.505086] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:25.528831] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T18:02:25.558054] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-14T18:02:26.358113] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-14T18:02:27.091313] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T18:02:27.158065] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-14T18:02:27.337804] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T18:02:27.958070] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-14T18:02:28.624305] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T18:02:28.758057] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-14T18:02:28.841438] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T18:02:29.558109] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-14T18:02:30.024404] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T18:02:30.029422] [INFO ] [REMOTE ] CIM: Full fetch complete (55091 records). [2025-10-14T18:02:30.029528] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-14T18:02:30.363283] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-14T18:02:30.491799] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-14T18:02:30.491879] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-14T18:02:30.492731] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-14T18:02:30.492803] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-14T18:02:30.494118] [DEBUG] [LOCAL ] CIM: Trimmed 55091 records to 37747 (keeping 200 days of data) [2025-10-14T18:02:30.608786] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T18:02:30.761586] [DEBUG] [LOCAL ] CIM: Primary data saved (37747 records). [2025-10-14T18:02:30.761754] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-14T18:02:30.761836] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 29.6s. Estimated remaining: 4h 23m 25s. Rate: 7.3 symbols/min [2025-10-14T18:02:30.948768] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:30.968697] [DEBUG] [LOCAL ] CIO: Loaded 20708 existing records from primary storage. [2025-10-14T18:02:30.968949] [INFO ] [MAIN ] CIO: Loaded 20708 existing records. [2025-10-14T18:02:31.158258] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:02:31.153225] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T18:02:31.158418] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-14T18:02:31.161421] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-14T18:02:31.162214] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-14T18:02:31.162488] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-14T18:02:31.162556] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-14T18:02:31.561729] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:31.958174] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-14T18:02:31.961098] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T18:02:32.758079] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-14T18:02:33.058077] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T18:02:33.190703] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T18:02:33.558091] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-14T18:02:34.358085] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-14T18:02:34.660341] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T18:02:34.786532] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T18:02:35.158093] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-14T18:02:35.958071] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-14T18:02:36.115833] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T18:02:36.758064] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-14T18:02:36.911084] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-14T18:02:37.260820] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T18:02:37.558087] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-14T18:02:38.358079] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-14T18:02:38.576467] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T18:02:38.816865] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T18:02:39.158079] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-14T18:02:39.958118] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-14T18:02:40.183289] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T18:02:40.413174] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T18:02:40.758094] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-14T18:02:41.558076] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-14T18:02:41.745582] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T18:02:42.293612] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-14T18:02:42.358075] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-14T18:02:43.158123] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-14T18:02:43.386771] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T18:02:43.671910] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T18:02:43.958070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-14T18:02:44.568690] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-14T18:02:44.758083] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-14T18:02:45.310758] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T18:02:45.558070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-14T18:02:46.358050] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-14T18:02:46.684791] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T18:02:46.802397] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T18:02:47.158088] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-14T18:02:47.766105] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T18:02:47.767000] [INFO ] [REMOTE ] CIMN: Full fetch complete (3912 records). [2025-10-14T18:02:47.767065] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-14T18:02:47.967807] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-14T18:02:48.122489] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-14T18:02:48.122598] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-14T18:02:48.122809] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-14T18:02:48.122869] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-14T18:02:48.123865] [DEBUG] [LOCAL ] CIMN: Trimmed 3912 records to 2750 (keeping 200 days of data) [2025-10-14T18:02:48.141003] [DEBUG] [LOCAL ] CIMN: Primary data saved (2750 records). [2025-10-14T18:02:48.141089] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-14T18:02:48.141203] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMN took 32.7s. Estimated remaining: 4h 23m 56s. Rate: 7.3 symbols/min [2025-10-14T18:02:48.308755] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:48.308904] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-14T18:02:48.308941] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-14T18:02:48.309046] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-14T18:02:48.309086] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-14T18:02:48.309127] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-14T18:02:48.309169] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-14T18:02:48.391077] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T18:02:48.664417] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:48.758071] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-14T18:02:49.038109] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-14T18:02:49.558080] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-14T18:02:50.358060] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-14T18:02:50.671815] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T18:02:51.158121] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-14T18:02:51.410738] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T18:02:51.597110] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T18:02:51.958151] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-14T18:02:52.521162] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T18:02:52.758118] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-14T18:02:53.558075] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-14T18:02:53.686839] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T18:02:54.358063] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-14T18:02:54.477196] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T18:02:55.158089] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-14T18:02:55.579496] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T18:02:55.891115] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T18:02:55.958070] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-14T18:02:56.758120] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-14T18:02:57.075252] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:02:57.456189] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T18:02:57.558075] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-14T18:02:58.153519] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T18:02:58.154493] [INFO ] [REMOTE ] CIMO: Full fetch complete (5059 records). [2025-10-14T18:02:58.154563] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-14T18:02:58.154963] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:02:58.155049] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:02:58.155128] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:02:58.155202] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-14T18:02:58.155268] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-14T18:02:58.155304] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-14T18:02:58.155345] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-14T18:02:58.155399] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CIMO took 34.7s. Estimated remaining: 4h 23m 55s. Rate: 7.2 symbols/min [2025-10-14T18:02:58.329500] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:02:58.329737] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-10-14T18:02:58.329790] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-10-14T18:02:58.329904] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-14T18:02:58.329946] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-14T18:02:58.329988] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-10-14T18:02:58.330020] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-14T18:02:58.363200] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-14T18:02:58.700918] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:02:59.158157] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-14T18:02:59.449319] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T18:02:59.958115] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-14T18:03:00.758115] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-14T18:03:01.083522] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T18:03:01.200028] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T18:03:01.204710] [INFO ] [REMOTE ] CINT: Full fetch complete (27894 records). [2025-10-14T18:03:01.204951] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-14T18:03:01.563189] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-14T18:03:01.661132] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-14T18:03:01.661223] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-14T18:03:01.661861] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-14T18:03:01.661930] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-14T18:03:01.662832] [DEBUG] [LOCAL ] CINT: Trimmed 27894 records to 19941 (keeping 200 days of data) [2025-10-14T18:03:01.776390] [DEBUG] [LOCAL ] CINT: Primary data saved (19941 records). [2025-10-14T18:03:01.776544] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-14T18:03:01.776623] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CINT took 36.8s. Estimated remaining: 4h 23m 27s. Rate: 7.3 symbols/min [2025-10-14T18:03:01.987430] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:02.043151] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T18:03:02.047620] [INFO ] [REMOTE ] CIO: Full fetch complete (29423 records). [2025-10-14T18:03:02.047822] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-14T18:03:02.214318] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-14T18:03:02.237477] [INFO ] [MAIN ] CL: Loaded 53648 existing records. [2025-10-14T18:03:02.358873] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-14T18:03:02.889326] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:03:02.929766] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-14T18:03:02.934022] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-14T18:03:02.964859] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-14T18:03:02.965005] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-14T18:03:02.966155] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-14T18:03:02.966103] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-14T18:03:02.966293] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-14T18:03:02.966383] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-14T18:03:03.055206] [DEBUG] [LOCAL ] CIO: Trimmed 29423 records to 20780 (keeping 200 days of data) [2025-10-14T18:03:03.439484] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:03.440585] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-14T18:03:03.480855] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-14T18:03:03.506738] [DEBUG] [LOCAL ] CIO: Primary data saved (20780 records). [2025-10-14T18:03:03.506863] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-14T18:03:03.506954] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CIO took 32.7s. Estimated remaining: 4h 22m 51s. Rate: 7.3 symbols/min [2025-10-14T18:03:03.682052] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:03.682220] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-10-14T18:03:03.682259] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-10-14T18:03:03.682375] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-14T18:03:03.682417] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-14T18:03:03.682458] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-14T18:03:03.682491] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-14T18:03:03.967434] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-14T18:03:04.060420] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:04.074171] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T18:03:04.758106] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-14T18:03:05.319595] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T18:03:05.420026] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T18:03:05.558084] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-14T18:03:05.720955] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T18:03:06.358101] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-14T18:03:06.957581] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T18:03:07.158132] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-14T18:03:07.252529] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T18:03:07.958090] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-14T18:03:08.690820] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T18:03:08.758083] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-14T18:03:09.177258] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T18:03:09.558090] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-14T18:03:10.358138] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-14T18:03:10.517479] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T18:03:10.582362] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T18:03:11.158087] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-14T18:03:11.284606] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T18:03:11.958118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-14T18:03:12.758077] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-14T18:03:13.473117] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-14T18:03:13.558048] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-14T18:03:13.650164] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T18:03:13.919151] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T18:03:14.358129] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-14T18:03:15.158083] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-14T18:03:15.714253] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T18:03:15.958143] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-14T18:03:16.295358] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T18:03:16.423045] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T18:03:16.758091] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-14T18:03:17.164148] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T18:03:17.558146] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-14T18:03:18.309955] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T18:03:18.358050] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-14T18:03:19.158138] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-14T18:03:19.393581] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T18:03:19.613702] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T18:03:19.958052] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-14T18:03:20.433569] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T18:03:20.758117] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-14T18:03:21.529076] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T18:03:21.558045] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-14T18:03:21.712023] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:03:22.358156] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-14T18:03:23.158080] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-14T18:03:23.539893] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T18:03:23.898716] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T18:03:23.958307] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-14T18:03:23.962065] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T18:03:24.758117] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-14T18:03:25.558143] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-14T18:03:25.714824] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T18:03:25.718083] [INFO ] [REMOTE ] CION: Full fetch complete (40332 records). [2025-10-14T18:03:25.718232] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-14T18:03:25.718844] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:03:25.718930] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:03:25.718972] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:03:25.719010] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-14T18:03:25.719065] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-14T18:03:25.719100] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-14T18:03:25.719139] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-14T18:03:25.719192] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CION took 37.6s. Estimated remaining: 4h 23m 41s. Rate: 7.2 symbols/min [2025-10-14T18:03:25.901604] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:25.937396] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-14T18:03:25.954100] [DEBUG] [LOCAL ] CLCO: Loaded 12940 existing records from primary storage. [2025-10-14T18:03:25.954324] [INFO ] [MAIN ] CLCO: Loaded 12940 existing records. [2025-10-14T18:03:26.133913] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:03:26.134121] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-14T18:03:26.134168] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-14T18:03:26.134393] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-14T18:03:26.134442] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-14T18:03:26.368096] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-14T18:03:26.564706] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:26.601442] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T18:03:27.158082] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-14T18:03:27.958107] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-14T18:03:28.432568] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-14T18:03:28.479350] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T18:03:28.758079] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-14T18:03:29.119730] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T18:03:29.558070] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-14T18:03:29.908309] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T18:03:30.358154] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-14T18:03:30.976084] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:03:31.158066] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-14T18:03:31.460723] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T18:03:31.958153] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-14T18:03:32.758073] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-14T18:03:33.054484] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T18:03:33.062829] [INFO ] [REMOTE ] CL: Full fetch complete (77401 records). [2025-10-14T18:03:33.062982] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-14T18:03:33.063922] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:03:33.064017] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:03:33.064069] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:03:33.064146] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-14T18:03:33.064230] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-14T18:03:33.064299] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-10-14T18:03:33.064512] [DEBUG] [LOCAL ] CL: Deleted derivative data file. [2025-10-14T18:03:33.064675] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CL took 31.3s. Estimated remaining: 4h 23m 29s. Rate: 7.2 symbols/min [2025-10-14T18:03:33.248100] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:33.273272] [DEBUG] [LOCAL ] CLDT: Loaded 25453 existing records from primary storage. [2025-10-14T18:03:33.273513] [INFO ] [MAIN ] CLDT: Loaded 25453 existing records. [2025-10-14T18:03:33.459036] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:03:33.459264] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-14T18:03:33.459311] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-14T18:03:33.459725] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-14T18:03:33.459785] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-14T18:03:33.560773] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-14T18:03:33.737346] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T18:03:33.849989] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:33.883274] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T18:03:34.358091] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-14T18:03:34.572694] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T18:03:34.577566] [INFO ] [REMOTE ] CLB: Full fetch complete (46938 records). [2025-10-14T18:03:34.577893] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-14T18:03:34.956178] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-14T18:03:34.956260] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-14T18:03:34.956973] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-14T18:03:34.957035] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-14T18:03:34.958121] [DEBUG] [LOCAL ] CLB: Trimmed 46938 records to 33361 (keeping 200 days of data) [2025-10-14T18:03:35.156196] [DEBUG] [LOCAL ] CLB: Primary data saved (33361 records). [2025-10-14T18:03:35.156327] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-14T18:03:35.156398] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CLB took 31.6s. Estimated remaining: 4h 22m 55s. Rate: 7.3 symbols/min [2025-10-14T18:03:35.168129] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-14T18:03:35.335296] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:35.347954] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T18:03:35.398341] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-14T18:03:35.398701] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-14T18:03:35.574969] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:03:35.575186] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-14T18:03:35.575233] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-14T18:03:35.576210] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-14T18:03:35.576267] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-14T18:03:35.927843] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:35.958094] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-14T18:03:36.758086] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-14T18:03:36.769811] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T18:03:37.188851] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T18:03:37.558128] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-14T18:03:38.358068] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-14T18:03:38.583685] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T18:03:39.143341] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T18:03:39.158055] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-14T18:03:39.333571] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T18:03:39.958067] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-14T18:03:40.106715] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:03:40.758093] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-14T18:03:40.783403] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T18:03:41.330313] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T18:03:41.558078] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-14T18:03:42.310739] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T18:03:42.358160] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-14T18:03:43.158058] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-14T18:03:43.236171] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T18:03:43.958114] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-14T18:03:44.280640] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T18:03:44.758131] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-14T18:03:45.558068] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-14T18:03:45.640907] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T18:03:46.078175] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T18:03:46.358099] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-14T18:03:47.159954] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T18:03:47.159032] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-14T18:03:47.164533] [INFO ] [REMOTE ] CLCO: Full fetch complete (22571 records). [2025-10-14T18:03:47.164635] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-14T18:03:47.165238] [FATAL] [VALIDATOR ] CLCO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:03:47.165455] [FATAL] [MAIN ] CLCO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:03:47.165524] [WARN ] [MAIN ] CLCO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:03:47.165619] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-14T18:03:47.165732] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-14T18:03:47.165777] [INFO ] [LOCAL ] CLCO: Starting deletion of derivative data. [2025-10-14T18:03:47.166011] [DEBUG] [LOCAL ] CLCO: Deleted derivative data file. [2025-10-14T18:03:47.166105] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 21.4s. Estimated remaining: 4h 23m 2s. Rate: 7.2 symbols/min [2025-10-14T18:03:47.338833] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:47.372326] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T18:03:47.405857] [DEBUG] [LOCAL ] CLH: Loaded 27824 existing records from primary storage. [2025-10-14T18:03:47.406158] [INFO ] [MAIN ] CLH: Loaded 27824 existing records. [2025-10-14T18:03:47.579073] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:03:47.579288] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-14T18:03:47.579335] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-14T18:03:47.580005] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-14T18:03:47.580064] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-14T18:03:47.929912] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:47.958063] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-14T18:03:48.693734] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T18:03:48.699938] [INFO ] [REMOTE ] CIVI: Full fetch complete (75945 records). [2025-10-14T18:03:48.700134] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-14T18:03:48.770725] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-14T18:03:49.104613] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-14T18:03:49.104736] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-14T18:03:49.105611] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-14T18:03:49.105678] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-14T18:03:49.107176] [DEBUG] [LOCAL ] CIVI: Trimmed 75945 records to 52673 (keeping 200 days of data) [2025-10-14T18:03:49.343610] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:03:49.449591] [DEBUG] [LOCAL ] CIVI: Primary data saved (52673 records). [2025-10-14T18:03:49.449763] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-14T18:03:49.449862] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CIVI took 51.3s. Estimated remaining: 4h 22m 29s. Rate: 7.3 symbols/min [2025-10-14T18:03:49.563215] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-14T18:03:49.618195] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:03:49.618340] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-14T18:03:49.618376] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-14T18:03:49.618511] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-14T18:03:49.618576] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-14T18:03:49.618625] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-14T18:03:49.618695] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-14T18:03:49.979774] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:03:50.358080] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-14T18:03:50.640446] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T18:03:50.997626] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T18:03:51.158131] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-14T18:03:51.555697] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T18:03:51.958104] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-14T18:03:52.636342] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T18:03:52.758109] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-14T18:03:53.005486] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T18:03:53.558076] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-14T18:03:54.358112] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-14T18:03:54.437009] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T18:03:54.780382] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-14T18:03:55.158231] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-14T18:03:55.735537] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T18:03:55.958080] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-14T18:03:56.010523] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T18:03:56.758074] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-14T18:03:57.564093] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-14T18:03:57.568459] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T18:03:57.608949] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T18:03:58.358081] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-14T18:03:59.108835] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T18:03:59.158092] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-14T18:03:59.756824] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T18:03:59.958127] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-14T18:04:00.135922] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T18:04:00.692944] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T18:04:00.758104] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-14T18:04:01.558132] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-14T18:04:01.780988] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:04:02.358126] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-14T18:04:03.158104] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-14T18:04:03.177579] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T18:04:03.875580] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-14T18:04:03.924099] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T18:04:03.958081] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-14T18:04:04.758060] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-14T18:04:05.084950] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T18:04:05.558151] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-14T18:04:06.302884] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T18:04:06.358154] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-14T18:04:06.585957] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T18:04:07.158117] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-14T18:04:07.229801] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T18:04:07.958162] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-14T18:04:08.209305] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T18:04:08.468277] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T18:04:08.758095] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-14T18:04:09.558071] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-14T18:04:10.358056] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-14T18:04:10.698874] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T18:04:10.842710] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-14T18:04:10.897253] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-14T18:04:11.158109] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-14T18:04:11.958107] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-14T18:04:11.974952] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T18:04:11.976312] [INFO ] [REMOTE ] CLPR: Full fetch complete (16299 records). [2025-10-14T18:04:11.976381] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-14T18:04:11.976870] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:04:11.976951] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:04:11.977018] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:04:11.977090] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-14T18:04:11.977152] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-14T18:04:11.977188] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-14T18:04:11.977227] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-14T18:04:11.977278] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLPR took 22.5s. Estimated remaining: 4h 23m 20s. Rate: 7.2 symbols/min [2025-10-14T18:04:12.148813] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:04:12.201293] [DEBUG] [LOCAL ] CLS: Loaded 53587 existing records from primary storage. [2025-10-14T18:04:12.201675] [INFO ] [MAIN ] CLS: Loaded 53587 existing records. [2025-10-14T18:04:12.381251] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:04:12.381456] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-14T18:04:12.381502] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-14T18:04:12.381830] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-14T18:04:12.381888] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-14T18:04:12.727929] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:04:12.758047] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-14T18:04:13.050901] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T18:04:13.054296] [INFO ] [REMOTE ] CLDT: Full fetch complete (37291 records). [2025-10-14T18:04:13.054401] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-14T18:04:13.436604] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-14T18:04:13.436714] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-14T18:04:13.437340] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-14T18:04:13.437380] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-14T18:04:13.438298] [DEBUG] [LOCAL ] CLDT: Trimmed 37291 records to 25439 (keeping 200 days of data) [2025-10-14T18:04:13.567923] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-14T18:04:13.587573] [DEBUG] [LOCAL ] CLDT: Primary data saved (25439 records). [2025-10-14T18:04:13.587736] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-14T18:04:13.587825] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLDT took 40.5s. Estimated remaining: 4h 22m 44s. Rate: 7.2 symbols/min [2025-10-14T18:04:13.764319] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:04:13.814008] [DEBUG] [LOCAL ] CLVT: Loaded 51978 existing records from primary storage. [2025-10-14T18:04:13.814357] [INFO ] [MAIN ] CLVT: Loaded 51978 existing records. [2025-10-14T18:04:13.989368] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:04:13.989582] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-14T18:04:13.989629] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-14T18:04:13.989977] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-14T18:04:13.990035] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-14T18:04:14.342985] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:04:14.358038] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-14T18:04:14.543761] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T18:04:15.158093] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-14T18:04:15.348168] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T18:04:15.715618] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T18:04:15.958094] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-14T18:04:16.538346] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:04:16.758078] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-14T18:04:17.558070] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-14T18:04:17.614977] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T18:04:18.056479] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T18:04:18.358082] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-14T18:04:18.937531] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T18:04:19.158131] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-14T18:04:19.958125] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-14T18:04:20.247209] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T18:04:20.252783] [INFO ] [REMOTE ] CLF: Full fetch complete (77528 records). [2025-10-14T18:04:20.252918] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-14T18:04:20.253767] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:04:20.253857] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:04:20.253898] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:04:20.253937] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-14T18:04:20.253990] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-14T18:04:20.254023] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-10-14T18:04:20.254229] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-10-14T18:04:20.254318] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLF took 45.1s. Estimated remaining: 4h 22m 29s. Rate: 7.2 symbols/min [2025-10-14T18:04:20.425791] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:04:20.446609] [DEBUG] [LOCAL ] CLW: Loaded 21621 existing records from primary storage. [2025-10-14T18:04:20.446912] [INFO ] [MAIN ] CLW: Loaded 21621 existing records. [2025-10-14T18:04:20.621556] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:04:20.621779] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-14T18:04:20.621826] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-14T18:04:20.622292] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-14T18:04:20.622348] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-14T18:04:20.760804] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-14T18:04:21.001577] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:04:21.019090] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T18:04:21.056618] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-14T18:04:21.558084] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-14T18:04:22.065310] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T18:04:22.358165] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-14T18:04:23.059710] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T18:04:23.158078] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-14T18:04:23.665294] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T18:04:23.958085] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-14T18:04:24.400973] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T18:04:24.404716] [INFO ] [REMOTE ] CLH: Full fetch complete (41729 records). [2025-10-14T18:04:24.404824] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-14T18:04:24.405382] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:04:24.405505] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:04:24.405592] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:04:24.405710] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-14T18:04:24.405786] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-14T18:04:24.405855] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-10-14T18:04:24.406046] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-10-14T18:04:24.406136] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLH took 37.2s. Estimated remaining: 4h 22m 4s. Rate: 7.3 symbols/min [2025-10-14T18:04:24.572487] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:04:24.625259] [DEBUG] [LOCAL ] CLX: Loaded 51636 existing records from primary storage. [2025-10-14T18:04:24.625582] [INFO ] [MAIN ] CLX: Loaded 51636 existing records. [2025-10-14T18:04:24.770069] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-14T18:04:24.812832] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:04:24.814485] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-14T18:04:24.814608] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-14T18:04:24.821340] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-14T18:04:24.829322] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-14T18:04:24.911247] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T18:04:25.232934] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:04:25.558105] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-14T18:04:26.358087] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-14T18:04:26.746524] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T18:04:26.777128] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T18:04:27.158088] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-14T18:04:27.958135] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-14T18:04:28.216210] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T18:04:28.758126] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-14T18:04:28.840466] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T18:04:28.869701] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T18:04:29.558069] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-14T18:04:30.358089] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-14T18:04:30.928463] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-14T18:04:31.158094] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-14T18:04:31.485058] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T18:04:31.692329] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-14T18:04:31.958108] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-14T18:04:32.678802] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T18:04:32.758105] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-14T18:04:33.558093] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-14T18:04:33.767205] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T18:04:34.079566] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T18:04:34.358081] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-14T18:04:34.702355] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T18:04:35.158117] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-14T18:04:35.821456] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T18:04:35.958086] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-14T18:04:36.758140] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-14T18:04:37.429587] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-14T18:04:37.515454] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T18:04:37.558053] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-14T18:04:37.647848] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T18:04:38.199212] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T18:04:38.358053] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-14T18:04:39.158121] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-14T18:04:39.926494] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T18:04:39.958053] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-14T18:04:40.758086] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-14T18:04:41.403137] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T18:04:41.558148] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-14T18:04:41.597621] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-14T18:04:41.983151] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T18:04:41.988807] [INFO ] [REMOTE ] CLVT: Full fetch complete (75373 records). [2025-10-14T18:04:41.988917] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-14T18:04:42.374503] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-14T18:04:42.379433] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-14T18:04:42.379516] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-14T18:04:42.380485] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-14T18:04:42.380805] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-14T18:04:42.394702] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T18:04:42.400924] [DEBUG] [LOCAL ] CLVT: Trimmed 75373 records to 51954 (keeping 200 days of data) [2025-10-14T18:04:42.687603] [DEBUG] [LOCAL ] CLVT: Primary data saved (51954 records). [2025-10-14T18:04:42.687760] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-14T18:04:42.687842] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLVT took 29.1s. Estimated remaining: 4h 22m 36s. Rate: 7.2 symbols/min [2025-10-14T18:04:42.857095] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:04:42.899121] [DEBUG] [LOCAL ] CM: Loaded 48771 existing records from primary storage. [2025-10-14T18:04:42.899418] [INFO ] [MAIN ] CM: Loaded 48771 existing records. [2025-10-14T18:04:43.076907] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:04:43.077101] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-14T18:04:43.077148] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-14T18:04:43.077371] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-14T18:04:43.077423] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-14T18:04:43.167415] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-14T18:04:43.427852] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:04:43.958134] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-14T18:04:44.758154] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-14T18:04:44.864719] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-14T18:04:44.942461] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T18:04:45.558076] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-14T18:04:45.629825] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T18:04:45.652906] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T18:04:46.358091] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-14T18:04:47.058081] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T18:04:47.158172] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-14T18:04:47.417628] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T18:04:47.958092] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-14T18:04:48.305561] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T18:04:48.308179] [INFO ] [REMOTE ] CLW: Full fetch complete (34021 records). [2025-10-14T18:04:48.308256] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-14T18:04:48.703574] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-14T18:04:48.703675] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-14T18:04:48.704220] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-14T18:04:48.704287] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-14T18:04:48.705078] [DEBUG] [LOCAL ] CLW: Trimmed 34021 records to 21558 (keeping 200 days of data) [2025-10-14T18:04:48.764151] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-14T18:04:48.838162] [DEBUG] [LOCAL ] CLW: Primary data saved (21558 records). [2025-10-14T18:04:48.838300] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-14T18:04:48.838394] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 28.6s. Estimated remaining: 4h 22m 19s. Rate: 7.2 symbols/min [2025-10-14T18:04:49.007441] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:04:49.007660] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-14T18:04:49.007718] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-14T18:04:49.007830] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-14T18:04:49.007871] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-14T18:04:49.007912] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-14T18:04:49.007944] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-14T18:04:49.380771] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:04:49.558076] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-14T18:04:49.787585] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T18:04:50.358057] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-14T18:04:50.432704] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T18:04:50.845438] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T18:04:51.158093] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-14T18:04:51.958130] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-14T18:04:52.268758] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T18:04:52.452380] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T18:04:52.758130] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-14T18:04:53.558072] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-14T18:04:53.738592] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T18:04:53.955956] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T18:04:54.358085] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-14T18:04:55.158080] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-14T18:04:55.958106] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-14T18:04:56.006684] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T18:04:56.086552] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-14T18:04:56.758081] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-14T18:04:56.792741] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T18:04:57.364628] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T18:04:57.558087] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-14T18:04:58.358153] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-14T18:04:59.026404] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T18:04:59.032125] [INFO ] [REMOTE ] CLX: Full fetch complete (73477 records). [2025-10-14T18:04:59.032237] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-14T18:04:59.161057] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-14T18:04:59.265021] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-14T18:04:59.501935] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-14T18:04:59.502015] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-14T18:04:59.502908] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-14T18:04:59.502969] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-14T18:04:59.504355] [DEBUG] [LOCAL ] CLX: Trimmed 73477 records to 51660 (keeping 200 days of data) [2025-10-14T18:04:59.826248] [DEBUG] [LOCAL ] CLX: Primary data saved (51660 records). [2025-10-14T18:04:59.826383] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-14T18:04:59.827058] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 35.4s. Estimated remaining: 4h 22m 22s. Rate: 7.2 symbols/min [2025-10-14T18:04:59.969693] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-14T18:05:00.004866] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:00.052502] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T18:05:00.073719] [DEBUG] [LOCAL ] CMBT: Loaded 25580 existing records from primary storage. [2025-10-14T18:05:00.074037] [INFO ] [MAIN ] CMBT: Loaded 25580 existing records. [2025-10-14T18:05:00.254435] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:05:00.254764] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-14T18:05:00.254826] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-14T18:05:00.255123] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-14T18:05:00.255194] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-14T18:05:00.606032] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:00.758050] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-14T18:05:00.825706] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T18:05:01.558098] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-14T18:05:02.102908] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T18:05:02.358126] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-14T18:05:02.496545] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-14T18:05:03.158112] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-14T18:05:03.281139] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T18:05:03.723991] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:05:03.958293] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-14T18:05:04.758114] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-14T18:05:04.985396] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T18:05:05.351767] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-14T18:05:05.357628] [INFO ] [REMOTE ] CLS: Full fetch complete (77633 records). [2025-10-14T18:05:05.357760] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-14T18:05:05.568277] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-14T18:05:05.754129] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-14T18:05:05.754214] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-14T18:05:05.755113] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-14T18:05:05.755174] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-14T18:05:05.756765] [DEBUG] [LOCAL ] CLS: Trimmed 77633 records to 53583 (keeping 200 days of data) [2025-10-14T18:05:06.079203] [DEBUG] [LOCAL ] CLS: Primary data saved (53583 records). [2025-10-14T18:05:06.079384] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-14T18:05:06.079474] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CLS took 54.1s. Estimated remaining: 4h 22m 6s. Rate: 7.2 symbols/min [2025-10-14T18:05:06.252935] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:06.281940] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T18:05:06.326695] [DEBUG] [LOCAL ] CMC: Loaded 45377 existing records from primary storage. [2025-10-14T18:05:06.326979] [INFO ] [MAIN ] CMC: Loaded 45377 existing records. [2025-10-14T18:05:06.363251] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-14T18:05:06.508072] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:05:06.508273] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-14T18:05:06.508321] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-14T18:05:06.509120] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-14T18:05:06.509178] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-14T18:05:06.863818] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:07.158098] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-14T18:05:07.242558] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T18:05:07.908797] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T18:05:07.958065] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-14T18:05:08.402083] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T18:05:08.758095] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-14T18:05:09.511480] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T18:05:09.516903] [INFO ] [REMOTE ] CM: Full fetch complete (69714 records). [2025-10-14T18:05:09.517007] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-14T18:05:09.563292] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-14T18:05:09.677846] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T18:05:09.920114] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-14T18:05:09.920193] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-14T18:05:09.921015] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-14T18:05:09.921077] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-14T18:05:09.922522] [DEBUG] [LOCAL ] CM: Trimmed 69714 records to 48743 (keeping 200 days of data) [2025-10-14T18:05:10.222990] [DEBUG] [LOCAL ] CM: Primary data saved (48743 records). [2025-10-14T18:05:10.223118] [INFO ] [MAIN ] CM: Full history saved. [2025-10-14T18:05:10.223199] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CM took 27.5s. Estimated remaining: 4h 21m 41s. Rate: 7.2 symbols/min [2025-10-14T18:05:10.363157] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-14T18:05:10.394704] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:10.401055] [DEBUG] [LOCAL ] CMCM: Loaded 4858 existing records from primary storage. [2025-10-14T18:05:10.401550] [INFO ] [MAIN ] CMCM: Loaded 4858 existing records. [2025-10-14T18:05:10.582228] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:05:10.582478] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-14T18:05:10.582539] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-14T18:05:10.582773] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-14T18:05:10.582833] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-14T18:05:10.940917] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:11.158065] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-14T18:05:11.215933] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T18:05:11.247224] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T18:05:11.958075] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-14T18:05:12.550952] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T18:05:12.758074] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-14T18:05:13.486554] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T18:05:13.558090] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-14T18:05:13.920784] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T18:05:14.111272] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T18:05:14.358132] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-14T18:05:14.721797] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T18:05:15.158110] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-14T18:05:15.958152] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-14T18:05:16.758081] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-14T18:05:17.308527] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-14T18:05:17.343808] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T18:05:17.558070] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-14T18:05:18.022406] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T18:05:18.257854] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T18:05:18.358057] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-14T18:05:19.158091] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-14T18:05:19.958109] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-14T18:05:20.182716] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:05:20.235048] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T18:05:20.292999] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-14T18:05:20.758115] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-14T18:05:21.558091] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-14T18:05:22.000439] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T18:05:22.358105] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-14T18:05:22.508311] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T18:05:22.951629] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T18:05:23.158070] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-14T18:05:23.958056] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-14T18:05:24.048933] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T18:05:24.758150] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-14T18:05:25.497213] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T18:05:25.532385] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T18:05:25.558080] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-14T18:05:25.945721] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-14T18:05:26.358087] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-14T18:05:27.158088] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-14T18:05:27.939789] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:05:27.958045] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-14T18:05:28.462364] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T18:05:28.758097] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-14T18:05:29.558091] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-14T18:05:29.609546] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:05:30.274847] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T18:05:30.358086] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-14T18:05:31.158146] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-14T18:05:31.198912] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T18:05:31.765359] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T18:05:31.826980] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T18:05:31.833583] [INFO ] [REMOTE ] CMA: Full fetch complete (72929 records). [2025-10-14T18:05:31.833863] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-14T18:05:31.835055] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:05:31.835196] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:05:31.835280] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:05:31.835357] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-14T18:05:31.835463] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-14T18:05:31.835531] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-14T18:05:31.835616] [DEBUG] [LOCAL ] CMA: No derivative data file found to delete. [2025-10-14T18:05:31.835764] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMA took 43.0s. Estimated remaining: 4h 22m 26s. Rate: 7.2 symbols/min [2025-10-14T18:05:31.963210] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-14T18:05:32.014022] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:32.014188] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-14T18:05:32.014232] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-14T18:05:32.014344] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-14T18:05:32.014385] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-14T18:05:32.014425] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-14T18:05:32.014482] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-14T18:05:32.384213] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:32.758105] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-14T18:05:32.766983] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T18:05:32.956261] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:05:32.956543] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-14T18:05:32.956626] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:05:32.956712] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-14T18:05:32.956777] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:05:32.956844] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-14T18:05:32.956905] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-14T18:05:32.956939] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-14T18:05:32.956977] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-14T18:05:32.957022] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMDB took 1.1s. Estimated remaining: 4h 21m 49s. Rate: 7.2 symbols/min [2025-10-14T18:05:33.129660] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:33.178972] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-10-14T18:05:33.179410] [INFO ] [MAIN ] CMG: Loaded 53720 existing records. [2025-10-14T18:05:33.355252] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:05:33.355544] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-14T18:05:33.355737] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-14T18:05:33.357206] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-14T18:05:33.357265] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-14T18:05:33.563281] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-14T18:05:33.737741] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:34.358096] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-14T18:05:35.158085] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-14T18:05:35.544223] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T18:05:35.896479] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T18:05:35.897695] [INFO ] [REMOTE ] CMCM: Full fetch complete (6923 records). [2025-10-14T18:05:35.897763] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-14T18:05:35.963368] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-14T18:05:36.278243] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-14T18:05:36.278363] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-14T18:05:36.278794] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-14T18:05:36.278877] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-14T18:05:36.279544] [DEBUG] [LOCAL ] CMCM: Trimmed 6923 records to 4866 (keeping 200 days of data) [2025-10-14T18:05:36.307773] [DEBUG] [LOCAL ] CMCM: Primary data saved (4866 records). [2025-10-14T18:05:36.307918] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-14T18:05:36.308004] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMCM took 26.1s. Estimated remaining: 4h 21m 21s. Rate: 7.2 symbols/min [2025-10-14T18:05:36.490907] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:36.526639] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-14T18:05:36.571619] [DEBUG] [LOCAL ] CMI: Loaded 41651 existing records from primary storage. [2025-10-14T18:05:36.572069] [INFO ] [MAIN ] CMI: Loaded 41651 existing records. [2025-10-14T18:05:36.764458] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-14T18:05:36.771736] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:05:36.772036] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-14T18:05:36.772084] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-14T18:05:36.773064] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-14T18:05:36.773128] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-14T18:05:37.146843] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:37.558110] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-14T18:05:37.621696] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T18:05:38.358179] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-14T18:05:38.903999] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-14T18:05:38.940455] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T18:05:39.158148] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-14T18:05:39.958154] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-14T18:05:40.081619] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T18:05:40.758154] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-14T18:05:41.244291] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-14T18:05:41.558102] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-14T18:05:41.677442] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T18:05:41.683018] [INFO ] [REMOTE ] CMBT: Full fetch complete (32353 records). [2025-10-14T18:05:41.683100] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-14T18:05:42.061727] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-14T18:05:42.061806] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-14T18:05:42.062426] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-14T18:05:42.062487] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-14T18:05:42.063344] [DEBUG] [LOCAL ] CMBT: Trimmed 32353 records to 25911 (keeping 200 days of data) [2025-10-14T18:05:42.221076] [DEBUG] [LOCAL ] CMBT: Primary data saved (25911 records). [2025-10-14T18:05:42.221202] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-14T18:05:42.221282] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMBT took 42.4s. Estimated remaining: 4h 21m 3s. Rate: 7.3 symbols/min [2025-10-14T18:05:42.362783] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-14T18:05:42.424992] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:05:42.445461] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T18:05:42.453770] [INFO ] [REMOTE ] CMC: Full fetch complete (66995 records). [2025-10-14T18:05:42.453932] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-14T18:05:42.677792] [DEBUG] [LOCAL ] CMP: Loaded 35860 existing records from primary storage. [2025-10-14T18:05:42.694937] [INFO ] [MAIN ] CMP: Loaded 35860 existing records. [2025-10-14T18:05:43.069561] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:05:43.086132] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-14T18:05:43.086216] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-14T18:05:43.086440] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-14T18:05:43.086555] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-14T18:05:43.087682] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-14T18:05:43.087760] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-14T18:05:43.087927] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-14T18:05:43.087855] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-14T18:05:43.193265] [DEBUG] [LOCAL ] CMC: Trimmed 66995 records to 45430 (keeping 200 days of data) [2025-10-14T18:05:43.555310] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:05:43.556259] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-14T18:05:43.720931] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-14T18:05:43.768724] [DEBUG] [LOCAL ] CMC: Primary data saved (45430 records). [2025-10-14T18:05:43.768909] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-14T18:05:43.769012] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMC took 37.7s. Estimated remaining: 4h 20m 28s. Rate: 7.3 symbols/min [2025-10-14T18:05:43.958131] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-14T18:05:44.014308] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T18:05:44.758064] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-14T18:05:45.175918] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T18:05:45.558161] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-14T18:05:46.072267] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T18:05:46.240240] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-14T18:05:46.358052] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-14T18:05:46.937218] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T18:05:47.158076] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-14T18:05:47.958156] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-14T18:05:48.532500] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-14T18:05:48.758145] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-14T18:05:48.985106] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T18:05:49.375329] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T18:05:49.558117] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-14T18:05:50.358194] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-14T18:05:50.549239] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T18:05:50.906080] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T18:05:51.158095] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-14T18:05:51.963250] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-14T18:05:51.985639] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T18:05:52.758134] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-14T18:05:53.138780] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T18:05:53.544260] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T18:05:53.558032] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-14T18:05:53.910101] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T18:05:54.358145] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-14T18:05:55.133607] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T18:05:55.158041] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-14T18:05:55.958138] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-14T18:05:56.282786] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T18:05:56.758158] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-14T18:05:56.808527] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:05:57.437899] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:05:57.558120] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-14T18:05:58.358133] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-14T18:05:58.867109] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T18:05:59.163561] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-14T18:05:59.186348] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T18:05:59.545204] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:05:59.551360] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-14T18:05:59.551503] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-14T18:05:59.964799] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-14T18:05:59.965447] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-14T18:05:59.965564] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-14T18:05:59.967373] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-14T18:05:59.967615] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-14T18:05:59.993551] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:06:00.002271] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 53720 (keeping 200 days of data) [2025-10-14T18:06:00.319260] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-10-14T18:06:00.319398] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-14T18:06:00.319477] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMG took 27.4s. Estimated remaining: 4h 20m 53s. Rate: 7.2 symbols/min [2025-10-14T18:06:00.758107] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-14T18:06:01.362731] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T18:06:01.558081] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-14T18:06:01.857824] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T18:06:02.358180] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-14T18:06:03.048617] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T18:06:03.125230] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T18:06:03.158141] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-14T18:06:03.958163] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-14T18:06:04.543487] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T18:06:04.548446] [INFO ] [REMOTE ] CMP: Full fetch complete (51823 records). [2025-10-14T18:06:04.548760] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-14T18:06:04.930700] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-14T18:06:04.930786] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-14T18:06:04.931731] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-14T18:06:04.931791] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-14T18:06:04.932825] [DEBUG] [LOCAL ] CMP: Trimmed 51823 records to 35866 (keeping 200 days of data) [2025-10-14T18:06:05.162246] [DEBUG] [LOCAL ] CMP: Primary data saved (35866 records). [2025-10-14T18:06:05.162397] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-14T18:06:05.162486] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMP took 22.9s. Estimated remaining: 4h 20m 31s. Rate: 7.3 symbols/min [2025-10-14T18:06:05.434457] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T18:06:05.439546] [INFO ] [REMOTE ] CMI: Full fetch complete (60519 records). [2025-10-14T18:06:05.439664] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-14T18:06:05.819699] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-14T18:06:05.819770] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-14T18:06:05.820509] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-14T18:06:05.820546] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-14T18:06:05.821630] [DEBUG] [LOCAL ] CMI: Trimmed 60519 records to 41661 (keeping 200 days of data) [2025-10-14T18:06:06.084201] [DEBUG] [LOCAL ] CMI: Primary data saved (41661 records). [2025-10-14T18:06:06.084334] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-14T18:06:06.084411] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMI took 29.8s. Estimated remaining: 4h 19m 54s. Rate: 7.3 symbols/min [2025-10-14T18:06:06.694230] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:06.763364] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:06.788461] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:06.826176] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:06.830441] [DEBUG] [LOCAL ] CMSA: Loaded 3581 existing records from primary storage. [2025-10-14T18:06:06.830891] [INFO ] [MAIN ] CMSA: Loaded 3581 existing records. [2025-10-14T18:06:07.075877] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:07.077892] [DEBUG] [LOCAL ] CMRE: Loaded 35869 existing records from primary storage. [2025-10-14T18:06:07.078762] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-14T18:06:07.078856] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-14T18:06:07.089338] [INFO ] [MAIN ] CMRE: Loaded 35869 existing records. [2025-10-14T18:06:07.089423] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-14T18:06:07.106506] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-14T18:06:07.112172] [DEBUG] [LOCAL ] CMPO: Loaded 38915 existing records from primary storage. [2025-10-14T18:06:07.171495] [INFO ] [MAIN ] CMPO: Loaded 38915 existing records. [2025-10-14T18:06:07.399191] [DEBUG] [LOCAL ] CMS: Loaded 52606 existing records from primary storage. [2025-10-14T18:06:07.457024] [INFO ] [MAIN ] CMS: Loaded 52606 existing records. [2025-10-14T18:06:07.547233] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:07.676448] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-14T18:06:07.698179] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-14T18:06:07.721958] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-14T18:06:07.733933] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-14T18:06:07.846768] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:08.008034] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-14T18:06:08.032430] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-14T18:06:08.100747] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:08.129554] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-14T18:06:08.153738] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-14T18:06:08.169464] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-14T18:06:08.169365] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-14T18:06:08.187297] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:08.183835] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-14T18:06:08.202061] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-14T18:06:08.256616] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-14T18:06:08.876283] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:08.900579] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-14T18:06:09.039788] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T18:06:09.084763] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-14T18:06:09.126502] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:09.137047] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-14T18:06:09.191282] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:09.191687] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-14T18:06:09.520006] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T18:06:09.521484] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-14T18:06:09.995993] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T18:06:09.997199] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-14T18:06:10.282392] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T18:06:10.303509] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-14T18:06:10.358089] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-14T18:06:10.586265] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:06:10.700357] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T18:06:11.158094] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-14T18:06:11.644384] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T18:06:11.958079] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-14T18:06:12.475032] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-14T18:06:12.758136] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-14T18:06:13.437527] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T18:06:13.558049] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-14T18:06:14.358117] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-14T18:06:14.430325] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T18:06:14.662086] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T18:06:14.930713] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-14T18:06:15.158110] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-14T18:06:15.958094] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-14T18:06:16.381232] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T18:06:16.758062] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-14T18:06:16.921672] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T18:06:17.558084] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-14T18:06:17.820725] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T18:06:18.358083] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-14T18:06:19.158067] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-14T18:06:19.302453] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T18:06:19.611964] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T18:06:19.785331] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T18:06:19.958096] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-14T18:06:20.758083] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-14T18:06:21.538282] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T18:06:21.558051] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-14T18:06:22.009794] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T18:06:22.358072] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-14T18:06:22.682838] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-14T18:06:22.732332] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T18:06:23.158074] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-14T18:06:23.703355] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T18:06:23.958105] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-14T18:06:24.758093] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-14T18:06:25.460397] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T18:06:25.558071] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-14T18:06:26.358104] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-14T18:06:26.513511] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T18:06:26.750928] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T18:06:26.768837] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T18:06:27.158069] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-14T18:06:27.535143] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:06:27.536372] [INFO ] [REMOTE ] CMSA: Full fetch complete (5111 records). [2025-10-14T18:06:27.536457] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-14T18:06:27.537058] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:06:27.537142] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:06:27.537187] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:06:27.537259] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-14T18:06:27.537322] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-14T18:06:27.537358] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-14T18:06:27.537565] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-10-14T18:06:27.537677] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSA took 21.4s. Estimated remaining: 4h 20m 37s. Rate: 7.2 symbols/min [2025-10-14T18:06:27.740764] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:27.748472] [DEBUG] [LOCAL ] CMSC: Loaded 4921 existing records from primary storage. [2025-10-14T18:06:27.748979] [INFO ] [MAIN ] CMSC: Loaded 4921 existing records. [2025-10-14T18:06:27.948701] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:27.948951] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-14T18:06:27.949002] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-14T18:06:27.949282] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-14T18:06:27.949339] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-14T18:06:27.963266] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-14T18:06:28.303877] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:28.758089] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-14T18:06:29.439877] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T18:06:29.558075] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-14T18:06:30.116556] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T18:06:30.358054] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-14T18:06:31.158164] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-14T18:06:31.337592] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T18:06:31.656898] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T18:06:31.958107] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-14T18:06:32.277112] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T18:06:32.758102] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-14T18:06:33.558126] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-14T18:06:33.646289] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T18:06:33.903046] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T18:06:34.296207] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T18:06:34.358124] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-14T18:06:35.158118] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-14T18:06:35.669531] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T18:06:35.958074] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-14T18:06:36.370198] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T18:06:36.657833] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T18:06:36.758135] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-14T18:06:37.558124] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-14T18:06:38.043036] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T18:06:38.224421] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T18:06:38.228478] [INFO ] [REMOTE ] CMPO: Full fetch complete (58613 records). [2025-10-14T18:06:38.228579] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-14T18:06:38.365168] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-14T18:06:38.610221] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-14T18:06:38.610328] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-14T18:06:38.611105] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-14T18:06:38.611166] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-14T18:06:38.612497] [DEBUG] [LOCAL ] CMPO: Trimmed 58613 records to 38842 (keeping 200 days of data) [2025-10-14T18:06:38.839842] [DEBUG] [LOCAL ] CMPO: Primary data saved (38842 records). [2025-10-14T18:06:38.840184] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-14T18:06:38.840282] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMPO took 32.7s. Estimated remaining: 4h 20m 41s. Rate: 7.2 symbols/min [2025-10-14T18:06:39.018285] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:39.023067] [DEBUG] [LOCAL ] CMSD: No existing data file found in primary storage. [2025-10-14T18:06:39.023875] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T18:06:39.023672] [WARN ] [MAIN ] CMSD: No existing data found, performing full refresh instead. [2025-10-14T18:06:39.026306] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-14T18:06:39.026354] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-14T18:06:39.026397] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-10-14T18:06:39.026430] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-14T18:06:39.166725] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-14T18:06:39.381819] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:39.958081] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-14T18:06:40.758087] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-14T18:06:40.891797] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T18:06:41.220270] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T18:06:41.402481] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T18:06:41.558081] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-14T18:06:42.358133] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-14T18:06:42.877947] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T18:06:43.158054] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-14T18:06:43.177625] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T18:06:43.732892] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:06:43.958149] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-14T18:06:44.470304] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-14T18:06:44.758198] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-14T18:06:45.558115] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-14T18:06:46.266282] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T18:06:46.358097] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-14T18:06:46.491957] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T18:06:46.498976] [INFO ] [REMOTE ] CMS: Full fetch complete (76157 records). [2025-10-14T18:06:46.499186] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-14T18:06:46.822521] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T18:06:46.918787] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-14T18:06:46.918887] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-14T18:06:46.919873] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-14T18:06:46.919938] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-14T18:06:46.921468] [DEBUG] [LOCAL ] CMS: Trimmed 76157 records to 52623 (keeping 200 days of data) [2025-10-14T18:06:47.164189] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-14T18:06:47.251698] [DEBUG] [LOCAL ] CMS: Primary data saved (52623 records). [2025-10-14T18:06:47.251865] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-14T18:06:47.251987] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMS took 41.2s. Estimated remaining: 4h 20m 33s. Rate: 7.2 symbols/min [2025-10-14T18:06:47.417922] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:47.452339] [DEBUG] [LOCAL ] CMTG: Loaded 35912 existing records from primary storage. [2025-10-14T18:06:47.452633] [INFO ] [MAIN ] CMTG: Loaded 35912 existing records. [2025-10-14T18:06:47.559543] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-14T18:06:47.638038] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:47.638285] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-14T18:06:47.638335] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-14T18:06:47.638783] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-14T18:06:47.638855] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-14T18:06:47.962293] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-14T18:06:47.989689] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:48.450808] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T18:06:48.758084] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-14T18:06:49.559161] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-14T18:06:49.562075] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T18:06:50.120358] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T18:06:50.358185] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-14T18:06:51.158052] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-14T18:06:51.213907] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T18:06:51.958154] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-14T18:06:52.392609] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T18:06:52.758099] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-14T18:06:53.221505] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T18:06:53.225909] [INFO ] [REMOTE ] CMRE: Full fetch complete (50937 records). [2025-10-14T18:06:53.226012] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-14T18:06:53.355496] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T18:06:53.563219] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-14T18:06:53.615006] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-14T18:06:53.615110] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-14T18:06:53.615871] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-14T18:06:53.615934] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-14T18:06:53.617138] [DEBUG] [LOCAL ] CMRE: Trimmed 50937 records to 35862 (keeping 200 days of data) [2025-10-14T18:06:53.831813] [DEBUG] [LOCAL ] CMRE: Primary data saved (35862 records). [2025-10-14T18:06:53.831958] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-14T18:06:53.832099] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMRE took 47.7s. Estimated remaining: 4h 20m 18s. Rate: 7.2 symbols/min [2025-10-14T18:06:54.031239] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:54.034709] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T18:06:54.036206] [INFO ] [REMOTE ] CMSC: Full fetch complete (7126 records). [2025-10-14T18:06:54.036278] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-14T18:06:54.168785] [DEBUG] [LOCAL ] CMU: Loaded 6355 existing records from primary storage. [2025-10-14T18:06:54.171924] [INFO ] [MAIN ] CMU: Loaded 6355 existing records. [2025-10-14T18:06:54.359216] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-14T18:06:54.537727] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:54.548635] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-14T18:06:54.548746] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-14T18:06:54.564297] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-14T18:06:54.586513] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-14T18:06:54.689735] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-14T18:06:54.695579] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-14T18:06:54.711868] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-14T18:06:54.720098] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-14T18:06:54.723265] [DEBUG] [LOCAL ] CMSC: Trimmed 7126 records to 4884 (keeping 200 days of data) [2025-10-14T18:06:54.832271] [DEBUG] [LOCAL ] CMSC: Primary data saved (4884 records). [2025-10-14T18:06:54.840361] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-14T18:06:54.868050] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMSC took 27.3s. Estimated remaining: 4h 19m 42s. Rate: 7.3 symbols/min [2025-10-14T18:06:55.175486] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:55.193804] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-14T18:06:55.196754] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:06:55.229961] [DEBUG] [LOCAL ] CNA: Loaded 32939 existing records from primary storage. [2025-10-14T18:06:55.230250] [INFO ] [MAIN ] CNA: Loaded 32939 existing records. [2025-10-14T18:06:55.410167] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:06:55.410383] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-14T18:06:55.410431] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-14T18:06:55.410732] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-14T18:06:55.410789] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-14T18:06:55.721626] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T18:06:55.784491] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:06:55.804875] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T18:06:55.958086] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-14T18:06:56.680802] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T18:06:56.758113] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-14T18:06:57.447612] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T18:06:57.558092] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-14T18:06:58.358078] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-14T18:06:58.846949] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T18:06:59.158111] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-14T18:06:59.672187] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T18:06:59.958062] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-14T18:07:00.335918] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T18:07:00.758166] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-14T18:07:01.426390] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:07:01.521783] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T18:07:01.558072] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-14T18:07:02.358052] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-14T18:07:02.383873] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T18:07:03.158077] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-14T18:07:03.963161] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-14T18:07:03.976639] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:07:04.501227] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T18:07:04.758059] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-14T18:07:04.855439] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T18:07:05.558108] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-14T18:07:05.973443] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T18:07:06.358051] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-14T18:07:06.430119] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-14T18:07:06.709843] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-14T18:07:07.158171] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-14T18:07:07.798636] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T18:07:07.800388] [INFO ] [REMOTE ] CMSD: Full fetch complete (11934 records). [2025-10-14T18:07:07.800475] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-14T18:07:07.973194] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-14T18:07:08.160756] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-14T18:07:08.160855] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-14T18:07:08.161225] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-14T18:07:08.161266] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-14T18:07:08.161955] [DEBUG] [LOCAL ] CMSD: Trimmed 11934 records to 7911 (keeping 200 days of data) [2025-10-14T18:07:08.209049] [DEBUG] [LOCAL ] CMSD: Primary data saved (7911 records). [2025-10-14T18:07:08.209187] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-14T18:07:08.209258] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMSD took 29.4s. Estimated remaining: 4h 19m 53s. Rate: 7.2 symbols/min [2025-10-14T18:07:08.379217] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:07:08.426471] [DEBUG] [LOCAL ] CNC: Loaded 53764 existing records from primary storage. [2025-10-14T18:07:08.426815] [INFO ] [MAIN ] CNC: Loaded 53764 existing records. [2025-10-14T18:07:08.601022] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:07:08.601259] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-14T18:07:08.601306] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-14T18:07:08.602342] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-14T18:07:08.602402] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-14T18:07:08.764413] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-14T18:07:08.955181] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:07:09.414236] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T18:07:09.558109] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-14T18:07:10.234437] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T18:07:10.358112] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-14T18:07:10.659382] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T18:07:11.158116] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-14T18:07:11.958100] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-14T18:07:12.242902] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T18:07:12.602174] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T18:07:12.625901] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T18:07:12.758109] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-14T18:07:13.520996] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T18:07:13.558079] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-14T18:07:14.358095] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-14T18:07:14.852625] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-14T18:07:15.158057] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-14T18:07:15.856341] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T18:07:15.958062] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-14T18:07:16.065280] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T18:07:16.758038] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-14T18:07:16.799282] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T18:07:17.558075] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-14T18:07:17.943208] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T18:07:17.943345] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-14T18:07:17.948544] [INFO ] [REMOTE ] CMTG: Full fetch complete (53454 records). [2025-10-14T18:07:17.948635] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-14T18:07:18.348358] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-14T18:07:18.348476] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-14T18:07:18.349703] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-14T18:07:18.349775] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-14T18:07:18.351531] [DEBUG] [LOCAL ] CMTG: Trimmed 53454 records to 35934 (keeping 200 days of data) [2025-10-14T18:07:18.400252] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-14T18:07:18.558975] [DEBUG] [LOCAL ] CMTG: Primary data saved (35934 records). [2025-10-14T18:07:18.559116] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-14T18:07:18.559198] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CMTG took 31.3s. Estimated remaining: 4h 19m 53s. Rate: 7.2 symbols/min [2025-10-14T18:07:18.727609] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:07:18.739632] [DEBUG] [LOCAL ] CNF: Loaded 10620 existing records from primary storage. [2025-10-14T18:07:18.739843] [INFO ] [MAIN ] CNF: Loaded 10620 existing records. [2025-10-14T18:07:18.911520] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:07:18.911743] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-14T18:07:18.911795] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-14T18:07:18.912037] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-14T18:07:18.912094] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-14T18:07:19.164962] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-14T18:07:19.272156] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:07:19.636125] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T18:07:19.889198] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T18:07:19.958073] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-14T18:07:20.758160] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-14T18:07:21.519879] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T18:07:21.558085] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-14T18:07:21.776499] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:07:22.227370] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:07:22.358044] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-14T18:07:23.158083] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-14T18:07:23.927615] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T18:07:23.956368] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T18:07:23.964863] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-14T18:07:24.344163] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-14T18:07:24.758085] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-14T18:07:25.396137] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T18:07:25.558076] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-14T18:07:26.232706] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T18:07:26.233838] [INFO ] [REMOTE ] CMU: Full fetch complete (9544 records). [2025-10-14T18:07:26.233911] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-14T18:07:26.363189] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-14T18:07:26.640694] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-14T18:07:26.640873] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-14T18:07:26.641246] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-14T18:07:26.641402] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-14T18:07:26.641886] [DEBUG] [LOCAL ] CMU: Trimmed 9544 records to 6338 (keeping 200 days of data) [2025-10-14T18:07:26.681006] [DEBUG] [LOCAL ] CMU: Primary data saved (6338 records). [2025-10-14T18:07:26.681159] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-14T18:07:26.681262] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CMU took 32.8s. Estimated remaining: 4h 19m 44s. Rate: 7.2 symbols/min [2025-10-14T18:07:26.853573] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:07:26.905134] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-14T18:07:26.905437] [INFO ] [MAIN ] CNH: Loaded 53551 existing records. [2025-10-14T18:07:27.095285] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:07:27.095533] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-14T18:07:27.095582] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-14T18:07:27.096816] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-14T18:07:27.096892] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-14T18:07:27.163224] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-14T18:07:27.448919] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:07:27.958134] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-14T18:07:28.323169] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T18:07:28.564273] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T18:07:28.758085] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-14T18:07:29.203537] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-14T18:07:29.566150] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-14T18:07:29.596705] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T18:07:30.358088] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-14T18:07:30.710830] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T18:07:31.117812] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T18:07:31.158112] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-14T18:07:31.958117] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-14T18:07:32.758180] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-14T18:07:32.882217] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T18:07:33.558090] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-14T18:07:33.880064] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T18:07:33.884211] [INFO ] [REMOTE ] CNA: Full fetch complete (45962 records). [2025-10-14T18:07:33.884368] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-14T18:07:34.091380] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-14T18:07:34.363290] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-14T18:07:34.433065] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-14T18:07:34.433159] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-14T18:07:34.433943] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-14T18:07:34.434006] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-14T18:07:34.435235] [DEBUG] [LOCAL ] CNA: Trimmed 45962 records to 32938 (keeping 200 days of data) [2025-10-14T18:07:34.655740] [DEBUG] [LOCAL ] CNA: Primary data saved (32938 records). [2025-10-14T18:07:34.656291] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-14T18:07:34.656429] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNA took 39.8s. Estimated remaining: 4h 19m 34s. Rate: 7.2 symbols/min [2025-10-14T18:07:34.864593] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:07:34.917462] [DEBUG] [LOCAL ] CNI: Loaded 51689 existing records from primary storage. [2025-10-14T18:07:34.918228] [INFO ] [MAIN ] CNI: Loaded 51689 existing records. [2025-10-14T18:07:35.143591] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T18:07:35.143169] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:07:35.149319] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T18:07:35.145529] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-14T18:07:35.158936] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-14T18:07:35.160606] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-14T18:07:35.162495] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-14T18:07:35.162569] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-14T18:07:35.548874] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:07:35.958077] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-14T18:07:36.758109] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-14T18:07:36.786297] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T18:07:37.007317] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T18:07:37.558167] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-14T18:07:38.220684] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T18:07:38.358130] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-14T18:07:39.158147] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-14T18:07:39.826211] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T18:07:39.958061] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-14T18:07:40.175276] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:07:40.216386] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-14T18:07:40.758106] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-14T18:07:41.558107] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-14T18:07:41.625008] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T18:07:42.140939] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T18:07:42.151038] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T18:07:42.358113] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-14T18:07:43.158159] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-14T18:07:43.307359] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T18:07:43.958165] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-14T18:07:44.637783] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T18:07:44.758121] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-14T18:07:45.567826] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-14T18:07:45.595614] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T18:07:46.358119] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-14T18:07:46.878132] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T18:07:47.013130] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T18:07:47.158083] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-14T18:07:47.958062] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-14T18:07:48.233932] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T18:07:48.758099] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-14T18:07:48.983383] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T18:07:49.343832] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-14T18:07:49.558099] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-14T18:07:50.108833] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T18:07:50.117548] [INFO ] [REMOTE ] CNC: Full fetch complete (77844 records). [2025-10-14T18:07:50.117802] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-14T18:07:50.360073] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-14T18:07:50.517514] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-14T18:07:50.517625] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-14T18:07:50.518769] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-14T18:07:50.518847] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-14T18:07:50.520383] [DEBUG] [LOCAL ] CNC: Trimmed 77844 records to 53767 (keeping 200 days of data) [2025-10-14T18:07:50.658374] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T18:07:50.882261] [DEBUG] [LOCAL ] CNC: Primary data saved (53767 records). [2025-10-14T18:07:50.882414] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-14T18:07:50.882508] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNC took 42.7s. Estimated remaining: 4h 19m 56s. Rate: 7.2 symbols/min [2025-10-14T18:07:51.049772] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:07:51.098243] [DEBUG] [LOCAL ] CNK: Loaded 52898 existing records from primary storage. [2025-10-14T18:07:51.098551] [INFO ] [MAIN ] CNK: Loaded 52898 existing records. [2025-10-14T18:07:51.162710] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-14T18:07:51.285343] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:07:51.285495] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-14T18:07:51.281678] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T18:07:51.285634] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-14T18:07:51.287867] [INFO ] [REMOTE ] CNF: Full fetch complete (13171 records). [2025-10-14T18:07:51.287949] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-14T18:07:51.288106] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-14T18:07:51.332218] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-14T18:07:51.970079] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-14T18:07:52.030939] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-14T18:07:52.033816] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:07:52.034191] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-14T18:07:52.034523] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-14T18:07:52.034562] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-14T18:07:52.035097] [DEBUG] [LOCAL ] CNF: Trimmed 13171 records to 10639 (keeping 200 days of data) [2025-10-14T18:07:52.092684] [DEBUG] [LOCAL ] CNF: Primary data saved (10639 records). [2025-10-14T18:07:52.092807] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-14T18:07:52.092886] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNF took 33.5s. Estimated remaining: 4h 19m 21s. Rate: 7.2 symbols/min [2025-10-14T18:07:52.278490] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:07:52.325766] [DEBUG] [LOCAL ] CNM: Loaded 51013 existing records from primary storage. [2025-10-14T18:07:52.326078] [INFO ] [MAIN ] CNM: Loaded 51013 existing records. [2025-10-14T18:07:52.505997] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:07:52.506349] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-14T18:07:52.506445] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-14T18:07:52.506914] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-14T18:07:52.506972] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-14T18:07:52.761350] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-14T18:07:52.868064] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:07:52.896422] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T18:07:53.430068] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T18:07:53.558041] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-14T18:07:54.358072] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-14T18:07:54.688629] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T18:07:55.158056] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-14T18:07:55.434424] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T18:07:55.681211] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T18:07:55.958094] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-14T18:07:56.749325] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T18:07:56.760043] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-14T18:07:57.558088] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-14T18:07:57.683147] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T18:07:58.358074] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-14T18:07:58.513377] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T18:07:59.010783] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T18:07:59.158116] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-14T18:07:59.597982] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T18:07:59.958161] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-14T18:08:00.537209] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:08:00.758085] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-14T18:08:01.536671] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T18:08:01.558050] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-14T18:08:02.358157] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-14T18:08:02.553121] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T18:08:02.560010] [INFO ] [REMOTE ] CNH: Full fetch complete (77702 records). [2025-10-14T18:08:02.560209] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-14T18:08:02.967511] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-14T18:08:02.967679] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-14T18:08:02.968889] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-14T18:08:02.968971] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-14T18:08:02.970968] [DEBUG] [LOCAL ] CNH: Trimmed 77702 records to 53552 (keeping 200 days of data) [2025-10-14T18:08:03.092146] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T18:08:03.185924] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-14T18:08:03.336632] [DEBUG] [LOCAL ] CNH: Primary data saved (53552 records). [2025-10-14T18:08:03.336840] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-14T18:08:03.336921] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNH took 36.7s. Estimated remaining: 4h 19m 24s. Rate: 7.2 symbols/min [2025-10-14T18:08:03.512678] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:03.543090] [DEBUG] [LOCAL ] CNMD: Loaded 32170 existing records from primary storage. [2025-10-14T18:08:03.543342] [INFO ] [MAIN ] CNMD: Loaded 32170 existing records. [2025-10-14T18:08:03.718123] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:03.718310] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-14T18:08:03.718354] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-14T18:08:03.718732] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-14T18:08:03.718788] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-14T18:08:03.966223] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-14T18:08:04.090170] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:04.121899] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T18:08:04.758137] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-14T18:08:05.089320] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T18:08:05.334208] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T18:08:05.558088] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-14T18:08:06.063946] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T18:08:06.358093] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-14T18:08:07.158114] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-14T18:08:07.358631] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T18:08:07.967254] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-14T18:08:07.971406] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T18:08:07.977517] [INFO ] [REMOTE ] CNI: Full fetch complete (74752 records). [2025-10-14T18:08:07.977611] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-14T18:08:08.377108] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-14T18:08:08.377358] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-14T18:08:08.378376] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-14T18:08:08.378504] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-14T18:08:08.379905] [DEBUG] [LOCAL ] CNI: Trimmed 74752 records to 51687 (keeping 200 days of data) [2025-10-14T18:08:08.713910] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T18:08:08.744036] [DEBUG] [LOCAL ] CNI: Primary data saved (51687 records). [2025-10-14T18:08:08.744143] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-14T18:08:08.744216] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNI took 34.1s. Estimated remaining: 4h 19m 5s. Rate: 7.2 symbols/min [2025-10-14T18:08:08.765346] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-14T18:08:08.926317] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:08.960875] [DEBUG] [LOCAL ] CNNE: Loaded 35998 existing records from primary storage. [2025-10-14T18:08:08.961170] [INFO ] [MAIN ] CNNE: Loaded 35998 existing records. [2025-10-14T18:08:09.138857] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:09.139141] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-14T18:08:09.139198] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-14T18:08:09.139550] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-14T18:08:09.139606] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-14T18:08:09.504940] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:09.558050] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-14T18:08:09.738186] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T18:08:10.358083] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-14T18:08:10.448451] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T18:08:10.498550] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T18:08:11.158096] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-14T18:08:11.388559] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T18:08:11.958076] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-14T18:08:12.758075] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-14T18:08:12.908404] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T18:08:13.340584] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T18:08:13.558119] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-14T18:08:13.706405] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T18:08:14.358122] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-14T18:08:15.158062] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-14T18:08:15.361876] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T18:08:15.734824] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T18:08:15.958075] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-14T18:08:16.190272] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T18:08:16.758075] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-14T18:08:17.080454] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T18:08:17.558113] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-14T18:08:18.358069] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-14T18:08:18.464452] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T18:08:19.000106] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T18:08:19.158133] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-14T18:08:19.890172] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T18:08:19.958102] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-14T18:08:20.329323] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T18:08:20.758140] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-14T18:08:21.558081] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-14T18:08:21.703574] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T18:08:21.711833] [INFO ] [REMOTE ] CNM: Full fetch complete (73749 records). [2025-10-14T18:08:21.712011] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-14T18:08:22.125003] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-14T18:08:22.125105] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-14T18:08:22.126025] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-14T18:08:22.126088] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-14T18:08:22.127506] [DEBUG] [LOCAL ] CNM: Trimmed 73749 records to 51023 (keeping 200 days of data) [2025-10-14T18:08:22.358283] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-14T18:08:22.430880] [DEBUG] [LOCAL ] CNM: Primary data saved (51023 records). [2025-10-14T18:08:22.431049] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-14T18:08:22.431155] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNM took 30.3s. Estimated remaining: 4h 19m 17s. Rate: 7.2 symbols/min [2025-10-14T18:08:22.608762] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:22.657569] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T18:08:22.669420] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T18:08:22.706443] [DEBUG] [LOCAL ] CNO: Loaded 40746 existing records from primary storage. [2025-10-14T18:08:22.706770] [INFO ] [MAIN ] CNO: Loaded 40746 existing records. [2025-10-14T18:08:22.884461] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:22.884723] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-14T18:08:22.884778] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-14T18:08:22.885094] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-14T18:08:22.885152] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-14T18:08:23.164155] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-14T18:08:23.242236] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:23.605237] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T18:08:23.958083] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-14T18:08:24.415942] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T18:08:24.758097] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-14T18:08:25.189109] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T18:08:25.558098] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-14T18:08:26.083559] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T18:08:26.358065] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-14T18:08:27.027938] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T18:08:27.158097] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-14T18:08:27.958072] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-14T18:08:28.009256] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T18:08:28.758110] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-14T18:08:28.828165] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T18:08:28.835616] [INFO ] [REMOTE ] CNK: Full fetch complete (76062 records). [2025-10-14T18:08:28.835848] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-14T18:08:29.256182] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T18:08:29.288961] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-14T18:08:29.289255] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-14T18:08:29.290285] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-14T18:08:29.290365] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-14T18:08:29.292382] [DEBUG] [LOCAL ] CNK: Trimmed 76062 records to 52891 (keeping 200 days of data) [2025-10-14T18:08:29.575389] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-14T18:08:29.624048] [DEBUG] [LOCAL ] CNK: Primary data saved (52891 records). [2025-10-14T18:08:29.624194] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-14T18:08:29.624285] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNK took 38.7s. Estimated remaining: 4h 19m 5s. Rate: 7.2 symbols/min [2025-10-14T18:08:29.794611] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:29.814970] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T18:08:29.868047] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-14T18:08:29.868428] [INFO ] [MAIN ] CNP: Loaded 53480 existing records. [2025-10-14T18:08:30.077221] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:30.077479] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-14T18:08:30.077528] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-14T18:08:30.077997] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-14T18:08:30.078089] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-14T18:08:30.362123] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-14T18:08:30.443327] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:30.889574] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T18:08:31.158145] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-14T18:08:31.535462] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T18:08:31.958117] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-14T18:08:32.514279] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T18:08:32.517814] [INFO ] [REMOTE ] CNMD: Full fetch complete (47266 records). [2025-10-14T18:08:32.517929] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-14T18:08:32.769983] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-14T18:08:32.904740] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-14T18:08:32.904811] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-14T18:08:32.905459] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-14T18:08:32.905495] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-14T18:08:32.906435] [DEBUG] [LOCAL ] CNMD: Trimmed 47266 records to 32167 (keeping 200 days of data) [2025-10-14T18:08:33.121083] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T18:08:33.131678] [DEBUG] [LOCAL ] CNMD: Primary data saved (32167 records). [2025-10-14T18:08:33.132286] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-14T18:08:33.132667] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNMD took 29.8s. Estimated remaining: 4h 18m 38s. Rate: 7.2 symbols/min [2025-10-14T18:08:33.301585] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:33.349096] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-14T18:08:33.349413] [INFO ] [MAIN ] CNQ: Loaded 53583 existing records. [2025-10-14T18:08:33.522572] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:33.522832] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-14T18:08:33.522878] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-14T18:08:33.523257] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-14T18:08:33.523314] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-14T18:08:33.564547] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-14T18:08:33.871184] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:34.214075] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T18:08:34.358058] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-14T18:08:35.158075] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-14T18:08:35.467078] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T18:08:35.745825] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:08:35.958101] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-14T18:08:36.534423] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:08:36.758082] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-14T18:08:37.304313] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T18:08:37.558077] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-14T18:08:37.797249] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T18:08:38.358096] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-14T18:08:39.158091] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-14T18:08:39.190898] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T18:08:39.701602] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T18:08:39.958071] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-14T18:08:40.568499] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T18:08:40.758108] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-14T18:08:41.013072] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T18:08:41.558093] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-14T18:08:42.230231] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T18:08:42.358064] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-14T18:08:42.458565] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T18:08:43.158092] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-14T18:08:43.635338] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T18:08:43.958090] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-14T18:08:44.719693] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T18:08:44.723759] [INFO ] [REMOTE ] CNNE: Full fetch complete (50386 records). [2025-10-14T18:08:44.723860] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-14T18:08:44.767550] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-14T18:08:45.112828] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-14T18:08:45.112905] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-14T18:08:45.113587] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-14T18:08:45.113626] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-14T18:08:45.114720] [DEBUG] [LOCAL ] CNNE: Trimmed 50386 records to 36021 (keeping 200 days of data) [2025-10-14T18:08:45.333233] [DEBUG] [LOCAL ] CNNE: Primary data saved (36021 records). [2025-10-14T18:08:45.333374] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-14T18:08:45.333454] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNNE took 36.6s. Estimated remaining: 4h 18m 45s. Rate: 7.2 symbols/min [2025-10-14T18:08:45.518844] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:45.519116] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-14T18:08:45.519188] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-14T18:08:45.519319] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-14T18:08:45.519366] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-14T18:08:45.519409] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-14T18:08:45.519443] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-14T18:08:45.570898] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-14T18:08:45.714403] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T18:08:45.945890] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:46.358061] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-14T18:08:46.399332] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T18:08:46.591247] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:08:46.591564] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-14T18:08:46.591684] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:08:46.591749] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-14T18:08:46.591811] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:08:46.591878] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-14T18:08:46.591981] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-14T18:08:46.592023] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-14T18:08:46.592063] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-14T18:08:46.592108] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNR took 1.3s. Estimated remaining: 4h 18m 10s. Rate: 7.2 symbols/min [2025-10-14T18:08:46.761170] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:46.781601] [DEBUG] [LOCAL ] CNS: Loaded 21008 existing records from primary storage. [2025-10-14T18:08:46.781865] [INFO ] [MAIN ] CNS: Loaded 21008 existing records. [2025-10-14T18:08:46.956042] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:46.956224] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-14T18:08:46.956269] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-14T18:08:46.956459] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-14T18:08:46.956514] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-14T18:08:47.162773] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-14T18:08:47.315430] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:47.570463] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T18:08:47.958119] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-14T18:08:48.422702] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T18:08:48.758152] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-14T18:08:48.824219] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T18:08:49.558077] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-14T18:08:50.358080] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-14T18:08:50.415997] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T18:08:51.036103] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T18:08:51.140683] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T18:08:51.158042] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-14T18:08:51.958160] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-14T18:08:52.522056] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T18:08:52.758181] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-14T18:08:53.206796] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T18:08:53.211722] [INFO ] [REMOTE ] CNO: Full fetch complete (60711 records). [2025-10-14T18:08:53.211899] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-14T18:08:53.563190] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-14T18:08:53.645746] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-14T18:08:53.645839] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-14T18:08:53.646591] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-14T18:08:53.646631] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-14T18:08:53.647915] [DEBUG] [LOCAL ] CNO: Trimmed 60711 records to 40696 (keeping 200 days of data) [2025-10-14T18:08:53.910180] [DEBUG] [LOCAL ] CNO: Primary data saved (40696 records). [2025-10-14T18:08:53.910350] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-14T18:08:53.910458] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNO took 31.5s. Estimated remaining: 4h 17m 58s. Rate: 7.2 symbols/min [2025-10-14T18:08:54.076952] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:08:54.126718] [DEBUG] [LOCAL ] CNX: Loaded 51343 existing records from primary storage. [2025-10-14T18:08:54.127035] [INFO ] [MAIN ] CNX: Loaded 51343 existing records. [2025-10-14T18:08:54.337517] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:08:54.338079] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-14T18:08:54.338212] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-14T18:08:54.338791] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-14T18:08:54.338855] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-14T18:08:54.369976] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-14T18:08:54.752019] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T18:08:54.733868] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:08:54.762218] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T18:08:55.158087] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-14T18:08:55.958135] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-14T18:08:56.121207] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T18:08:56.758113] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-14T18:08:56.842567] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T18:08:57.222251] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-14T18:08:57.558095] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-14T18:08:58.358108] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-14T18:08:58.452535] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T18:08:59.158132] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-14T18:08:59.341716] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T18:08:59.958102] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-14T18:09:00.004285] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:09:00.693216] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T18:09:00.758157] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-14T18:09:01.558066] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-14T18:09:01.639305] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T18:09:02.358133] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-14T18:09:02.448339] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T18:09:02.475998] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-14T18:09:03.158079] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-14T18:09:03.902802] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T18:09:03.958052] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-14T18:09:04.166729] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T18:09:04.619357] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T18:09:04.758087] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-14T18:09:05.558087] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-14T18:09:06.312417] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T18:09:06.358068] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-14T18:09:07.158067] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-14T18:09:07.315108] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T18:09:07.712614] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T18:09:07.958141] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-14T18:09:08.758090] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-14T18:09:09.151978] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-14T18:09:09.436902] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T18:09:09.558093] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-14T18:09:10.358134] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-14T18:09:10.468854] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T18:09:10.558951] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T18:09:10.564915] [INFO ] [REMOTE ] CNQ: Full fetch complete (77728 records). [2025-10-14T18:09:10.565043] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-14T18:09:10.955885] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-14T18:09:10.955978] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-14T18:09:10.956901] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-14T18:09:10.956970] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-14T18:09:10.958513] [DEBUG] [LOCAL ] CNQ: Trimmed 77728 records to 53583 (keeping 200 days of data) [2025-10-14T18:09:11.166107] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-14T18:09:11.282419] [DEBUG] [LOCAL ] CNQ: Primary data saved (53583 records). [2025-10-14T18:09:11.282555] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-14T18:09:11.282666] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNQ took 38.1s. Estimated remaining: 4h 18m 24s. Rate: 7.2 symbols/min [2025-10-14T18:09:11.450014] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:11.486810] [DEBUG] [LOCAL ] CODI: Loaded 41051 existing records from primary storage. [2025-10-14T18:09:11.487152] [INFO ] [MAIN ] CODI: Loaded 41051 existing records. [2025-10-14T18:09:11.671620] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:11.672154] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-14T18:09:11.672304] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-14T18:09:11.672733] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-14T18:09:11.672792] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-14T18:09:11.963339] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-14T18:09:12.003748] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T18:09:12.089730] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:12.635711] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T18:09:12.758112] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-14T18:09:13.241152] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T18:09:13.558083] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-14T18:09:14.358074] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-14T18:09:14.432125] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T18:09:14.438664] [INFO ] [REMOTE ] CNP: Full fetch complete (77535 records). [2025-10-14T18:09:14.438810] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-14T18:09:14.893533] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-14T18:09:14.893774] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-14T18:09:14.894729] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-14T18:09:14.894817] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-14T18:09:14.896617] [DEBUG] [LOCAL ] CNP: Trimmed 77535 records to 53480 (keeping 200 days of data) [2025-10-14T18:09:15.038278] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:09:15.158215] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-14T18:09:15.262448] [DEBUG] [LOCAL ] CNP: Primary data saved (53480 records). [2025-10-14T18:09:15.262595] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-14T18:09:15.262700] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNP took 45.6s. Estimated remaining: 4h 17m 59s. Rate: 7.2 symbols/min [2025-10-14T18:09:15.433577] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:15.487754] [DEBUG] [LOCAL ] COF: Loaded 53614 existing records from primary storage. [2025-10-14T18:09:15.488140] [INFO ] [MAIN ] COF: Loaded 53614 existing records. [2025-10-14T18:09:15.627838] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T18:09:15.696570] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:15.696815] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-14T18:09:15.696865] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-14T18:09:15.697402] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-14T18:09:15.697462] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-14T18:09:15.967206] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-14T18:09:16.094686] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:16.758089] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-14T18:09:17.005127] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T18:09:17.034248] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T18:09:17.558105] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-14T18:09:17.873234] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:09:18.358105] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-14T18:09:18.958054] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T18:09:19.158104] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-14T18:09:19.179518] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T18:09:19.182560] [INFO ] [REMOTE ] CNS: Full fetch complete (30636 records). [2025-10-14T18:09:19.182630] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-14T18:09:19.546306] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-14T18:09:19.546419] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-14T18:09:19.546902] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-14T18:09:19.546962] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-14T18:09:19.547727] [DEBUG] [LOCAL ] CNS: Trimmed 30636 records to 21073 (keeping 200 days of data) [2025-10-14T18:09:19.671563] [DEBUG] [LOCAL ] CNS: Primary data saved (21073 records). [2025-10-14T18:09:19.671714] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-14T18:09:19.671801] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. CNS took 33.1s. Estimated remaining: 4h 17m 37s. Rate: 7.2 symbols/min [2025-10-14T18:09:19.844608] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:19.894396] [DEBUG] [LOCAL ] COHR: Loaded 53380 existing records from primary storage. [2025-10-14T18:09:19.894752] [INFO ] [MAIN ] COHR: Loaded 53380 existing records. [2025-10-14T18:09:19.967995] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-14T18:09:20.074194] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:20.074392] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-14T18:09:20.074439] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-14T18:09:20.074767] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-14T18:09:20.074827] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-14T18:09:20.418913] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:20.758117] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-14T18:09:20.812486] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T18:09:21.419193] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T18:09:21.453718] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T18:09:21.558069] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-14T18:09:22.358069] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-14T18:09:22.911402] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T18:09:23.158083] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-14T18:09:23.958087] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-14T18:09:24.142029] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T18:09:24.593452] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T18:09:24.758102] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-14T18:09:25.558060] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-14T18:09:25.815624] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T18:09:26.358096] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-14T18:09:26.568504] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T18:09:26.739884] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T18:09:27.158097] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-14T18:09:27.958098] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-14T18:09:28.054802] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T18:09:28.758089] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-14T18:09:29.105063] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T18:09:29.453610] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T18:09:29.558091] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-14T18:09:29.919428] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T18:09:29.927141] [INFO ] [REMOTE ] CNX: Full fetch complete (74913 records). [2025-10-14T18:09:29.927384] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-14T18:09:30.352757] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-14T18:09:30.352910] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-14T18:09:30.353947] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-14T18:09:30.354013] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-14T18:09:30.355802] [DEBUG] [LOCAL ] CNX: Trimmed 74913 records to 51365 (keeping 200 days of data) [2025-10-14T18:09:30.358121] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-14T18:09:30.680544] [DEBUG] [LOCAL ] CNX: Primary data saved (51365 records). [2025-10-14T18:09:30.680890] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-14T18:09:30.681005] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CNX took 36.8s. Estimated remaining: 4h 17m 38s. Rate: 7.2 symbols/min [2025-10-14T18:09:30.897212] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:30.900373] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T18:09:30.965368] [DEBUG] [LOCAL ] COLD: Loaded 52362 existing records from primary storage. [2025-10-14T18:09:30.965820] [INFO ] [MAIN ] COLD: Loaded 52362 existing records. [2025-10-14T18:09:31.145992] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:31.146346] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-14T18:09:31.146401] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-14T18:09:31.147065] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-14T18:09:31.147157] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-14T18:09:31.163353] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-14T18:09:31.519095] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:31.958114] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-14T18:09:32.052273] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:09:32.758136] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-14T18:09:32.805084] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:09:33.564843] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-14T18:09:33.599139] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T18:09:34.358057] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-14T18:09:34.758201] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T18:09:35.057376] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T18:09:35.158098] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-14T18:09:35.790829] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T18:09:35.958123] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-14T18:09:36.758141] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-14T18:09:37.053006] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T18:09:37.558154] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-14T18:09:37.960826] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T18:09:38.320100] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T18:09:38.358052] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-14T18:09:39.158089] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-14T18:09:39.266590] [DEBUG] [REMOTE ] CODI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-14T18:09:39.267027] [WARN ] [REMOTE ] CODI: No data returned for month 2025-09 [2025-10-14T18:09:39.267140] [FATAL] [REMOTE ] CODI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:09:39.267257] [FATAL] [MAIN ] CODI: Failed to fetch primary data. [2025-10-14T18:09:39.267367] [WARN ] [MAIN ] CODI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:09:39.267464] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-14T18:09:39.267549] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-14T18:09:39.267607] [INFO ] [LOCAL ] CODI: Starting deletion of derivative data. [2025-10-14T18:09:39.267911] [DEBUG] [LOCAL ] CODI: Deleted derivative data file. [2025-10-14T18:09:39.268068] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. CODI took 28.0s. Estimated remaining: 4h 17m 31s. Rate: 7.2 symbols/min [2025-10-14T18:09:39.469806] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T18:09:39.542796] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:39.593454] [DEBUG] [LOCAL ] COMP: Loaded 53405 existing records from primary storage. [2025-10-14T18:09:39.593806] [INFO ] [MAIN ] COMP: Loaded 53405 existing records. [2025-10-14T18:09:39.777118] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:39.777470] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-14T18:09:39.777600] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-14T18:09:39.777932] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-14T18:09:39.778025] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-14T18:09:39.959196] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-14T18:09:40.200232] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:40.203450] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-14T18:09:40.758119] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-14T18:09:41.558128] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-14T18:09:42.048494] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T18:09:42.358065] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-14T18:09:42.749501] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-14T18:09:42.975128] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T18:09:43.158089] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-14T18:09:43.781199] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T18:09:43.958050] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-14T18:09:44.742239] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T18:09:44.758038] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-14T18:09:45.558097] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-14T18:09:45.635382] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T18:09:46.358132] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-14T18:09:46.589593] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T18:09:47.088970] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T18:09:47.158098] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-14T18:09:47.537138] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T18:09:47.958092] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-14T18:09:48.758124] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-14T18:09:49.119693] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-14T18:09:49.423968] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T18:09:49.558065] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-14T18:09:49.891451] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T18:09:50.358096] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-14T18:09:51.158095] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-14T18:09:51.336587] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T18:09:51.538978] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:09:51.544989] [INFO ] [REMOTE ] COF: Full fetch complete (77616 records). [2025-10-14T18:09:51.545145] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-14T18:09:51.951991] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-14T18:09:51.952083] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-14T18:09:51.953008] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-14T18:09:51.953073] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-14T18:09:51.954552] [DEBUG] [LOCAL ] COF: Trimmed 77616 records to 53619 (keeping 200 days of data) [2025-10-14T18:09:52.010009] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-14T18:09:52.307085] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T18:09:52.327568] [DEBUG] [LOCAL ] COF: Primary data saved (53619 records). [2025-10-14T18:09:52.327707] [INFO ] [MAIN ] COF: Full history saved. [2025-10-14T18:09:52.328772] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COF took 37.1s. Estimated remaining: 4h 17m 41s. Rate: 7.2 symbols/min [2025-10-14T18:09:52.497625] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:52.537199] [DEBUG] [LOCAL ] CON: Loaded 38882 existing records from primary storage. [2025-10-14T18:09:52.537544] [INFO ] [MAIN ] CON: Loaded 38882 existing records. [2025-10-14T18:09:52.715953] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:52.716179] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-14T18:09:52.716255] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-14T18:09:52.716826] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-14T18:09:52.716921] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-14T18:09:52.763265] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-14T18:09:53.072541] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:53.558099] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-14T18:09:54.006714] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T18:09:54.134064] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T18:09:54.358087] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-14T18:09:55.158084] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-14T18:09:55.219254] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T18:09:55.958104] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-14T18:09:56.652597] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-14T18:09:56.658855] [INFO ] [REMOTE ] COHR: Full fetch complete (77386 records). [2025-10-14T18:09:56.659018] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-14T18:09:56.760014] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-14T18:09:57.094063] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T18:09:57.094313] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-14T18:09:57.103476] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-14T18:09:57.104629] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-14T18:09:57.104717] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-14T18:09:57.106061] [DEBUG] [LOCAL ] COHR: Trimmed 77386 records to 53376 (keeping 200 days of data) [2025-10-14T18:09:57.429607] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T18:09:57.464952] [DEBUG] [LOCAL ] COHR: Primary data saved (53376 records). [2025-10-14T18:09:57.465465] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-14T18:09:57.465561] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COHR took 37.8s. Estimated remaining: 4h 17m 21s. Rate: 7.2 symbols/min [2025-10-14T18:09:57.564631] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-14T18:09:57.636901] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:09:57.660616] [DEBUG] [LOCAL ] COOK: Loaded 24847 existing records from primary storage. [2025-10-14T18:09:57.660875] [INFO ] [MAIN ] COOK: Loaded 24847 existing records. [2025-10-14T18:09:57.832910] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:09:57.833083] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-14T18:09:57.833130] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-14T18:09:57.833387] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-14T18:09:57.833444] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-14T18:09:58.201085] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:09:58.238705] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T18:09:58.358100] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-14T18:09:59.121368] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:09:59.158070] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-14T18:09:59.800007] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T18:09:59.958154] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-14T18:10:00.511305] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T18:10:00.758103] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-14T18:10:01.107971] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T18:10:01.558066] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-14T18:10:02.358115] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-14T18:10:02.798983] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T18:10:03.144446] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T18:10:03.150951] [INFO ] [REMOTE ] COLD: Full fetch complete (74684 records). [2025-10-14T18:10:03.151139] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-14T18:10:03.163216] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-14T18:10:03.594996] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-14T18:10:03.595225] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-14T18:10:03.597584] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T18:10:03.596553] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-14T18:10:03.604747] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-14T18:10:03.606456] [DEBUG] [LOCAL ] COLD: Trimmed 74684 records to 52370 (keeping 200 days of data) [2025-10-14T18:10:03.949821] [DEBUG] [LOCAL ] COLD: Primary data saved (52370 records). [2025-10-14T18:10:03.949962] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-14T18:10:03.950046] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COLD took 33.3s. Estimated remaining: 4h 17m 6s. Rate: 7.2 symbols/min [2025-10-14T18:10:03.963362] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-14T18:10:04.152894] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:04.208215] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-14T18:10:04.208629] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-14T18:10:04.426849] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:10:04.427082] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-14T18:10:04.427130] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-14T18:10:04.428115] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-14T18:10:04.428181] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-14T18:10:04.760804] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-14T18:10:04.851673] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:04.960225] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T18:10:05.531965] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T18:10:05.533443] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T18:10:05.558037] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-14T18:10:06.358157] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-14T18:10:07.017031] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T18:10:07.158132] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-14T18:10:07.199926] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T18:10:07.958118] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-14T18:10:08.550911] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T18:10:08.758077] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-14T18:10:09.003131] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T18:10:09.558101] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-14T18:10:10.358099] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-14T18:10:10.417541] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T18:10:10.507432] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:10:11.158146] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-14T18:10:11.958065] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-14T18:10:12.380421] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T18:10:12.758055] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-14T18:10:12.780574] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T18:10:13.002262] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T18:10:13.009326] [INFO ] [REMOTE ] COMP: Full fetch complete (77380 records). [2025-10-14T18:10:13.009534] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-14T18:10:13.434873] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-14T18:10:13.435004] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-14T18:10:13.436410] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-14T18:10:13.436481] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-14T18:10:13.438703] [DEBUG] [LOCAL ] COMP: Trimmed 77380 records to 53405 (keeping 200 days of data) [2025-10-14T18:10:13.558227] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-14T18:10:13.789913] [DEBUG] [LOCAL ] COMP: Primary data saved (53405 records). [2025-10-14T18:10:13.790176] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-14T18:10:13.790296] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. COMP took 34.5s. Estimated remaining: 4h 17m 3s. Rate: 7.2 symbols/min [2025-10-14T18:10:13.983798] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:13.984094] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-14T18:10:13.984148] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-14T18:10:13.984293] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-14T18:10:13.984344] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-14T18:10:13.984389] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-14T18:10:13.984424] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-14T18:10:14.364598] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-14T18:10:14.389749] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:14.690688] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T18:10:14.946555] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T18:10:15.158093] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-14T18:10:15.258684] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T18:10:15.958151] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-14T18:10:16.523775] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T18:10:16.758075] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-14T18:10:17.558068] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-14T18:10:17.763611] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T18:10:18.344081] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T18:10:18.358044] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-14T18:10:18.668293] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T18:10:19.158128] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-14T18:10:19.958090] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-14T18:10:20.379942] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-14T18:10:20.758078] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-14T18:10:20.853677] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T18:10:21.125174] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T18:10:21.131816] [INFO ] [REMOTE ] CON: Full fetch complete (56805 records). [2025-10-14T18:10:21.131962] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-14T18:10:21.520276] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-14T18:10:21.520379] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-14T18:10:21.521128] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-14T18:10:21.521188] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-14T18:10:21.522376] [DEBUG] [LOCAL ] CON: Trimmed 56805 records to 38883 (keeping 200 days of data) [2025-10-14T18:10:21.575472] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-14T18:10:21.753005] [DEBUG] [LOCAL ] CON: Primary data saved (38883 records). [2025-10-14T18:10:21.753141] [INFO ] [MAIN ] CON: Full history saved. [2025-10-14T18:10:21.753220] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. CON took 29.4s. Estimated remaining: 4h 16m 54s. Rate: 7.2 symbols/min [2025-10-14T18:10:21.918489] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:21.965676] [DEBUG] [LOCAL ] COTY: Loaded 53263 existing records from primary storage. [2025-10-14T18:10:21.965972] [INFO ] [MAIN ] COTY: Loaded 53263 existing records. [2025-10-14T18:10:22.141156] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:10:22.141314] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-14T18:10:22.141361] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-14T18:10:22.141780] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-14T18:10:22.141845] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-14T18:10:22.366745] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-14T18:10:22.503177] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:22.883511] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T18:10:23.010175] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-14T18:10:23.158178] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-14T18:10:23.958112] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-14T18:10:24.102338] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T18:10:24.728210] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T18:10:24.758057] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-14T18:10:24.872697] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T18:10:25.558119] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-14T18:10:26.330481] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T18:10:26.358045] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-14T18:10:27.158112] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-14T18:10:27.671562] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-14T18:10:27.963196] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-14T18:10:27.983314] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T18:10:28.014765] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T18:10:28.758066] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-14T18:10:29.558116] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-14T18:10:29.876402] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:10:30.115868] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-14T18:10:30.358235] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-14T18:10:31.043759] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T18:10:31.158120] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-14T18:10:31.171485] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T18:10:31.175793] [INFO ] [REMOTE ] COOK: Full fetch complete (33107 records). [2025-10-14T18:10:31.175933] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-14T18:10:31.566390] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-14T18:10:31.566481] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-14T18:10:31.567058] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-14T18:10:31.567117] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-14T18:10:31.568062] [DEBUG] [LOCAL ] COOK: Trimmed 33107 records to 24891 (keeping 200 days of data) [2025-10-14T18:10:31.706070] [DEBUG] [LOCAL ] COOK: Primary data saved (24891 records). [2025-10-14T18:10:31.706210] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-14T18:10:31.706294] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COOK took 34.2s. Estimated remaining: 4h 16m 52s. Rate: 7.2 symbols/min [2025-10-14T18:10:31.878271] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:31.923864] [DEBUG] [LOCAL ] COUR: Loaded 49182 existing records from primary storage. [2025-10-14T18:10:31.924149] [INFO ] [MAIN ] COUR: Loaded 49182 existing records. [2025-10-14T18:10:31.966257] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-14T18:10:32.103022] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:10:32.103224] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-14T18:10:32.103270] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-14T18:10:32.103722] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-14T18:10:32.103778] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-14T18:10:32.448104] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:32.758141] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-14T18:10:32.978684] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T18:10:33.437408] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:10:33.558048] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-14T18:10:34.358148] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-14T18:10:34.941723] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T18:10:35.158076] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-14T18:10:35.367613] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T18:10:35.915131] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T18:10:35.958066] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-14T18:10:36.729940] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T18:10:36.758066] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-14T18:10:37.558048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-14T18:10:37.729408] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T18:10:38.358172] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-14T18:10:38.432125] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T18:10:39.158125] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-14T18:10:39.270291] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T18:10:39.634895] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T18:10:39.958101] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-14T18:10:40.584540] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T18:10:40.758181] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-14T18:10:41.565709] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-14T18:10:41.582345] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T18:10:41.948739] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T18:10:42.089590] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T18:10:42.095488] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-14T18:10:42.095598] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-14T18:10:42.363413] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-14T18:10:42.483898] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-14T18:10:42.483972] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-14T18:10:42.484855] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-14T18:10:42.484913] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-14T18:10:42.486303] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-14T18:10:42.811778] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-14T18:10:42.811904] [INFO ] [MAIN ] COP: Full history saved. [2025-10-14T18:10:42.811979] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COP took 38.9s. Estimated remaining: 4h 16m 54s. Rate: 7.2 symbols/min [2025-10-14T18:10:42.976606] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:43.024606] [DEBUG] [LOCAL ] CP: Loaded 53252 existing records from primary storage. [2025-10-14T18:10:43.024938] [INFO ] [MAIN ] CP: Loaded 53252 existing records. [2025-10-14T18:10:43.163208] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-14T18:10:43.202836] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:10:43.203189] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-14T18:10:43.203252] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-14T18:10:43.204038] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-14T18:10:43.204098] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-14T18:10:43.557422] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:43.958067] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-14T18:10:44.121900] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T18:10:44.544758] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T18:10:44.758086] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-14T18:10:45.495848] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T18:10:45.558129] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-14T18:10:46.078753] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T18:10:46.358158] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-14T18:10:47.158079] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-14T18:10:47.369456] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T18:10:47.958174] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-14T18:10:48.210215] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T18:10:48.586804] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T18:10:48.758137] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-14T18:10:49.429157] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T18:10:49.558111] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-14T18:10:50.358210] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-14T18:10:50.585992] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T18:10:50.994661] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T18:10:51.158143] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-14T18:10:51.781102] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:10:51.958056] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-14T18:10:52.758117] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-14T18:10:52.820326] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T18:10:53.558150] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-14T18:10:53.843450] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T18:10:54.225865] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T18:10:54.232138] [INFO ] [REMOTE ] COTY: Full fetch complete (77282 records). [2025-10-14T18:10:54.232328] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-14T18:10:54.363173] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-14T18:10:54.645630] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-14T18:10:54.645761] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-14T18:10:54.646704] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-14T18:10:54.646857] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-14T18:10:54.648895] [DEBUG] [LOCAL ] COTY: Trimmed 77282 records to 53268 (keeping 200 days of data) [2025-10-14T18:10:54.771305] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T18:10:54.982599] [DEBUG] [LOCAL ] COTY: Primary data saved (53268 records). [2025-10-14T18:10:54.982779] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-14T18:10:54.982866] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COTY took 33.2s. Estimated remaining: 4h 16m 59s. Rate: 7.2 symbols/min [2025-10-14T18:10:55.151514] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:55.158094] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-14T18:10:55.182329] [DEBUG] [LOCAL ] CPA: Loaded 28392 existing records from primary storage. [2025-10-14T18:10:55.182595] [INFO ] [MAIN ] CPA: Loaded 28392 existing records. [2025-10-14T18:10:55.366386] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:10:55.366630] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-14T18:10:55.366712] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-14T18:10:55.367036] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-14T18:10:55.367093] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-14T18:10:55.725635] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:55.958080] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-14T18:10:56.204181] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T18:10:56.392919] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T18:10:56.758133] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-14T18:10:57.384544] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T18:10:57.558088] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-14T18:10:57.967971] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T18:10:57.973851] [INFO ] [REMOTE ] COR: Full fetch complete (68687 records). [2025-10-14T18:10:57.973969] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-14T18:10:58.357960] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-14T18:10:58.358219] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-14T18:10:58.358080] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-14T18:10:58.359303] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-14T18:10:58.360189] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-14T18:10:58.361726] [DEBUG] [LOCAL ] COR: Trimmed 68687 records to 46682 (keeping 200 days of data) [2025-10-14T18:10:58.656203] [DEBUG] [LOCAL ] COR: Primary data saved (46682 records). [2025-10-14T18:10:58.656359] [INFO ] [MAIN ] COR: Full history saved. [2025-10-14T18:10:58.656433] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COR took 44.9s. Estimated remaining: 4h 16m 34s. Rate: 7.2 symbols/min [2025-10-14T18:10:58.831343] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:10:58.831573] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-14T18:10:58.831739] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-14T18:10:58.831932] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-14T18:10:58.832092] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-14T18:10:58.832177] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-14T18:10:58.832244] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-14T18:10:58.952712] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T18:10:59.163279] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-14T18:10:59.239081] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:10:59.958088] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-14T18:11:00.057507] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T18:11:00.417470] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T18:11:00.758088] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-14T18:11:01.381896] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T18:11:01.558086] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-14T18:11:01.989080] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-14T18:11:02.291464] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T18:11:02.358091] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-14T18:11:03.158144] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-14T18:11:03.452070] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T18:11:03.958109] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-14T18:11:04.248164] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-14T18:11:04.758100] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-14T18:11:05.026877] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-14T18:11:05.105487] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-14T18:11:05.558093] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-14T18:11:06.358116] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-14T18:11:06.628476] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-14T18:11:07.158125] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-14T18:11:07.471987] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T18:11:07.687810] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-14T18:11:07.958073] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-14T18:11:08.758095] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-14T18:11:09.558069] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-14T18:11:09.646830] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T18:11:09.844507] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-14T18:11:10.004610] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T18:11:10.358095] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-14T18:11:11.158078] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-14T18:11:11.958111] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-14T18:11:12.185991] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T18:11:12.474452] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T18:11:12.758070] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-14T18:11:13.322758] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T18:11:13.328993] [INFO ] [REMOTE ] CP: Full fetch complete (77283 records). [2025-10-14T18:11:13.329143] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-14T18:11:13.565334] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-14T18:11:13.738306] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-14T18:11:13.738400] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-14T18:11:13.739297] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-14T18:11:13.739360] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-14T18:11:13.740912] [DEBUG] [LOCAL ] CP: Trimmed 77283 records to 53250 (keeping 200 days of data) [2025-10-14T18:11:14.060823] [DEBUG] [LOCAL ] CP: Primary data saved (53250 records). [2025-10-14T18:11:14.060954] [INFO ] [MAIN ] CP: Full history saved. [2025-10-14T18:11:14.061031] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CP took 31.2s. Estimated remaining: 4h 16m 52s. Rate: 7.2 symbols/min [2025-10-14T18:11:14.233599] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:14.262112] [DEBUG] [LOCAL ] CPAY: Loaded 30418 existing records from primary storage. [2025-10-14T18:11:14.262368] [INFO ] [MAIN ] CPAY: Loaded 30418 existing records. [2025-10-14T18:11:14.361485] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-14T18:11:14.445041] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:14.446168] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-14T18:11:14.446307] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-14T18:11:14.446950] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-14T18:11:14.447010] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-14T18:11:14.724723] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-14T18:11:14.830077] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T18:11:14.873070] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:14.884316] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T18:11:15.158088] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-14T18:11:15.958100] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-14T18:11:16.098688] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T18:11:16.390000] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T18:11:16.758111] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-14T18:11:17.558094] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-14T18:11:18.247270] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T18:11:18.358114] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-14T18:11:18.391793] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T18:11:18.637741] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-14T18:11:19.158079] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-14T18:11:19.958103] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-14T18:11:20.638436] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T18:11:20.644819] [INFO ] [REMOTE ] COUR: Full fetch complete (71012 records). [2025-10-14T18:11:20.644957] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-14T18:11:20.761468] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-14T18:11:21.089256] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-14T18:11:21.089344] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-14T18:11:21.090311] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-14T18:11:21.090377] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-14T18:11:21.091818] [DEBUG] [LOCAL ] COUR: Trimmed 71012 records to 49240 (keeping 200 days of data) [2025-10-14T18:11:21.266053] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-14T18:11:21.367133] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T18:11:21.401074] [INFO ] [REMOTE ] CPA: Full fetch complete (41547 records). [2025-10-14T18:11:21.403299] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-14T18:11:21.403133] [DEBUG] [LOCAL ] COUR: Primary data saved (49240 records). [2025-10-14T18:11:21.403589] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-14T18:11:21.403788] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. COUR took 49.7s. Estimated remaining: 4h 16m 40s. Rate: 7.2 symbols/min [2025-10-14T18:11:21.568453] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-14T18:11:21.734958] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:21.933163] [DEBUG] [LOCAL ] CPF: Loaded 15233 existing records from primary storage. [2025-10-14T18:11:21.942184] [INFO ] [MAIN ] CPF: Loaded 15233 existing records. [2025-10-14T18:11:22.045471] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-14T18:11:22.069166] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-14T18:11:22.072131] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-14T18:11:22.072211] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-14T18:11:22.111056] [DEBUG] [LOCAL ] CPA: Trimmed 41547 records to 28481 (keeping 200 days of data) [2025-10-14T18:11:22.203148] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:22.212435] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-14T18:11:22.241951] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-14T18:11:22.246265] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-14T18:11:22.246858] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-14T18:11:22.360121] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-14T18:11:22.637237] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:22.689381] [DEBUG] [LOCAL ] CPA: Primary data saved (28481 records). [2025-10-14T18:11:22.689501] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-14T18:11:22.689579] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPA took 27.7s. Estimated remaining: 4h 16m 6s. Rate: 7.2 symbols/min [2025-10-14T18:11:22.851784] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T18:11:22.866565] [INFO ] [REMOTE ] CPAC: Full fetch complete (1865 records). [2025-10-14T18:11:22.883909] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-14T18:11:22.884979] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:23.114770] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T18:11:23.116081] [DEBUG] [LOCAL ] CPK: Loaded 13769 existing records from primary storage. [2025-10-14T18:11:23.116347] [INFO ] [MAIN ] CPK: Loaded 13769 existing records. [2025-10-14T18:11:23.116771] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:11:23.154783] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:11:23.162956] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-14T18:11:23.174478] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-14T18:11:23.195340] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-14T18:11:23.216756] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-14T18:11:23.217096] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-14T18:11:23.217374] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPAC took 24.6s. Estimated remaining: 4h 15m 30s. Rate: 7.2 symbols/min [2025-10-14T18:11:23.276938] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T18:11:23.347201] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:23.347530] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-14T18:11:23.347583] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-14T18:11:23.348195] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-14T18:11:23.348413] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-14T18:11:23.700230] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:23.958096] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-14T18:11:24.062039] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T18:11:24.758106] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-14T18:11:24.832961] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T18:11:25.558092] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-14T18:11:25.854147] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T18:11:26.000215] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T18:11:26.358127] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-14T18:11:27.158082] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-14T18:11:27.436832] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T18:11:27.754815] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T18:11:27.958127] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-14T18:11:28.758078] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-14T18:11:28.836913] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T18:11:29.558092] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-14T18:11:30.326930] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T18:11:30.358039] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-14T18:11:30.579980] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:11:31.158142] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-14T18:11:31.815904] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T18:11:31.843506] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T18:11:31.958185] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-14T18:11:32.747373] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T18:11:32.758061] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-14T18:11:33.558064] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-14T18:11:33.789204] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T18:11:34.358355] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-14T18:11:34.929409] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T18:11:35.158089] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-14T18:11:35.181810] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T18:11:35.958081] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-14T18:11:36.107192] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T18:11:36.758108] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-14T18:11:37.262552] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T18:11:37.287171] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T18:11:37.558112] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-14T18:11:38.358341] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-14T18:11:38.841019] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T18:11:39.003381] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T18:11:39.158078] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-14T18:11:39.857452] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T18:11:39.958111] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-14T18:11:40.459972] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T18:11:40.758148] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-14T18:11:40.864598] [DEBUG] [REMOTE ] CPF: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-14T18:11:40.865022] [WARN ] [REMOTE ] CPF: No data returned for month 2025-07 [2025-10-14T18:11:40.865140] [FATAL] [REMOTE ] CPF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:11:40.865272] [FATAL] [MAIN ] CPF: Failed to fetch primary data. [2025-10-14T18:11:40.865363] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:11:40.865460] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-14T18:11:40.865551] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-14T18:11:40.865610] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-10-14T18:11:40.865926] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-10-14T18:11:40.866037] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPF took 19.5s. Estimated remaining: 4h 15m 55s. Rate: 7.2 symbols/min [2025-10-14T18:11:41.558109] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-14T18:11:42.198622] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T18:11:42.358156] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-14T18:11:43.158155] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-14T18:11:43.437471] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T18:11:43.958121] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-14T18:11:44.283036] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T18:11:44.286139] [INFO ] [REMOTE ] CPK: Full fetch complete (18314 records). [2025-10-14T18:11:44.286242] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-14T18:11:44.649823] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-14T18:11:44.649893] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-14T18:11:44.650267] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-14T18:11:44.650304] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-14T18:11:44.650842] [DEBUG] [LOCAL ] CPK: Trimmed 18314 records to 13850 (keeping 200 days of data) [2025-10-14T18:11:44.734084] [DEBUG] [LOCAL ] CPK: Primary data saved (13850 records). [2025-10-14T18:11:44.734201] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-14T18:11:44.734273] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPK took 22.0s. Estimated remaining: 4h 15m 31s. Rate: 7.2 symbols/min [2025-10-14T18:11:44.879508] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T18:11:44.888964] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-14T18:11:45.757141] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T18:11:45.760094] [INFO ] [REMOTE ] CPAY: Full fetch complete (44556 records). [2025-10-14T18:11:45.760171] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-14T18:11:45.760739] [FATAL] [VALIDATOR ] CPAY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:11:45.760820] [FATAL] [MAIN ] CPAY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:11:45.760862] [WARN ] [MAIN ] CPAY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:11:45.760899] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-14T18:11:45.760952] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-10-14T18:11:45.760986] [INFO ] [LOCAL ] CPAY: Starting deletion of derivative data. [2025-10-14T18:11:45.761187] [DEBUG] [LOCAL ] CPAY: Deleted derivative data file. [2025-10-14T18:11:45.761280] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPAY took 31.7s. Estimated remaining: 4h 14m 57s. Rate: 7.3 symbols/min [2025-10-14T18:11:46.300163] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:46.404504] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:46.455154] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:46.474225] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:11:46.496565] [DEBUG] [LOCAL ] CPS: Loaded 25382 existing records from primary storage. [2025-10-14T18:11:46.497264] [INFO ] [MAIN ] CPS: Loaded 25382 existing records. [2025-10-14T18:11:46.720757] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:46.721857] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-14T18:11:46.721985] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-14T18:11:46.735460] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-14T18:11:46.735324] [DEBUG] [LOCAL ] CPT: Loaded 44474 existing records from primary storage. [2025-10-14T18:11:46.736054] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-14T18:11:46.757595] [INFO ] [MAIN ] CPT: Loaded 44474 existing records. [2025-10-14T18:11:46.912028] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-14T18:11:46.911320] [DEBUG] [LOCAL ] CPRI: Loaded 52498 existing records from primary storage. [2025-10-14T18:11:46.978415] [INFO ] [MAIN ] CPRI: Loaded 52498 existing records. [2025-10-14T18:11:46.983704] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-14T18:11:47.473492] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:47.514128] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-14T18:11:47.514567] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-14T18:11:47.615784] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:47.639472] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-14T18:11:47.656084] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-14T18:11:47.655982] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-14T18:11:47.692453] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-14T18:11:47.692356] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:11:47.698165] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-14T18:11:47.698042] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-14T18:11:47.733368] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-14T18:11:47.775775] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-14T18:11:47.857783] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:47.854631] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-14T18:11:47.881690] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-14T18:11:47.887129] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-14T18:11:48.747751] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:48.802785] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-14T18:11:48.808478] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:48.855461] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-14T18:11:48.900678] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:11:48.906344] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-14T18:11:48.913342] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T18:11:48.917751] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-14T18:11:49.606864] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T18:11:49.611724] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-14T18:11:50.348620] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T18:11:50.358039] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-14T18:11:50.465599] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T18:11:50.489581] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T18:11:51.158059] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-14T18:11:51.270730] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-14T18:11:51.860778] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T18:11:51.958094] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-14T18:11:52.084087] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T18:11:52.758135] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-14T18:11:53.290365] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T18:11:53.558055] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-14T18:11:53.593502] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T18:11:54.358103] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-14T18:11:55.158114] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-14T18:11:55.349471] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T18:11:55.958179] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-14T18:11:56.214896] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T18:11:56.376299] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T18:11:56.758086] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-14T18:11:57.244018] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T18:11:57.558092] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-14T18:11:58.358160] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-14T18:11:58.428472] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T18:11:59.158105] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-14T18:11:59.308473] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T18:11:59.746158] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T18:11:59.958090] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-14T18:12:00.758070] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-14T18:12:00.982039] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:12:01.462287] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T18:12:01.558062] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-14T18:12:02.358114] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-14T18:12:02.861962] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-14T18:12:02.952454] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T18:12:03.158050] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-14T18:12:03.514629] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T18:12:03.958123] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-14T18:12:04.758126] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-14T18:12:05.155080] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T18:12:05.501800] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T18:12:05.558084] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-14T18:12:05.583557] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T18:12:06.358098] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-14T18:12:07.158170] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-14T18:12:07.793933] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T18:12:07.931507] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-14T18:12:07.958059] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-14T18:12:08.244291] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T18:12:08.758107] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-14T18:12:09.448074] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T18:12:09.558091] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-14T18:12:10.358121] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-14T18:12:10.475402] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T18:12:11.158107] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-14T18:12:11.659388] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:12:11.836486] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-14T18:12:11.958058] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-14T18:12:12.758065] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-14T18:12:12.962824] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T18:12:13.558076] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-14T18:12:14.000571] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T18:12:14.329919] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T18:12:14.358042] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-14T18:12:15.158087] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-14T18:12:15.355765] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T18:12:15.393371] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T18:12:15.396018] [INFO ] [REMOTE ] CPS: Full fetch complete (36349 records). [2025-10-14T18:12:15.396110] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-14T18:12:15.764895] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-14T18:12:15.765196] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-14T18:12:15.765699] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-14T18:12:15.765758] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-14T18:12:15.766515] [DEBUG] [LOCAL ] CPS: Trimmed 36349 records to 25324 (keeping 200 days of data) [2025-10-14T18:12:15.914812] [DEBUG] [LOCAL ] CPS: Primary data saved (25324 records). [2025-10-14T18:12:15.914978] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-14T18:12:15.915121] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CPS took 30.2s. Estimated remaining: 4h 16m 7s. Rate: 7.2 symbols/min [2025-10-14T18:12:15.963379] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-14T18:12:16.096983] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:16.116441] [DEBUG] [LOCAL ] CQP: Loaded 18920 existing records from primary storage. [2025-10-14T18:12:16.116726] [INFO ] [MAIN ] CQP: Loaded 18920 existing records. [2025-10-14T18:12:16.307310] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:12:16.307545] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-14T18:12:16.307592] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-14T18:12:16.308071] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-14T18:12:16.308148] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-14T18:12:16.651490] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:16.758049] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-14T18:12:17.264486] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T18:12:17.558081] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-14T18:12:17.645696] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T18:12:18.056995] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T18:12:18.358073] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-14T18:12:19.158093] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-14T18:12:19.574439] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T18:12:19.958179] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-14T18:12:19.996960] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T18:12:20.002877] [INFO ] [REMOTE ] CPT: Full fetch complete (64192 records). [2025-10-14T18:12:20.003038] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-14T18:12:20.449604] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-14T18:12:20.449744] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-14T18:12:20.456637] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-14T18:12:20.466855] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-14T18:12:20.468491] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T18:12:20.475747] [DEBUG] [LOCAL ] CPT: Trimmed 64192 records to 44529 (keeping 200 days of data) [2025-10-14T18:12:20.758199] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-14T18:12:20.759097] [DEBUG] [LOCAL ] CPT: Primary data saved (44529 records). [2025-10-14T18:12:20.760072] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-14T18:12:20.760171] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CPT took 35.0s. Estimated remaining: 4h 15m 46s. Rate: 7.2 symbols/min [2025-10-14T18:12:20.951011] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:20.974463] [DEBUG] [LOCAL ] CR: Loaded 24133 existing records from primary storage. [2025-10-14T18:12:20.974773] [INFO ] [MAIN ] CR: Loaded 24133 existing records. [2025-10-14T18:12:21.158691] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:12:21.158914] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-14T18:12:21.158963] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-14T18:12:21.159722] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-14T18:12:21.159781] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-14T18:12:21.533241] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:21.558136] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-14T18:12:21.685607] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T18:12:21.691638] [INFO ] [REMOTE ] CPRI: Full fetch complete (76230 records). [2025-10-14T18:12:21.691831] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-14T18:12:22.060502] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T18:12:22.125300] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-14T18:12:22.125396] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-14T18:12:22.126305] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-14T18:12:22.126372] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-14T18:12:22.127846] [DEBUG] [LOCAL ] CPRI: Trimmed 76230 records to 52473 (keeping 200 days of data) [2025-10-14T18:12:22.358347] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-14T18:12:22.436093] [DEBUG] [LOCAL ] CPRI: Primary data saved (52473 records). [2025-10-14T18:12:22.436238] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-14T18:12:22.436319] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPRI took 36.6s. Estimated remaining: 4h 15m 14s. Rate: 7.2 symbols/min [2025-10-14T18:12:22.618824] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:22.635074] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T18:12:22.648213] [DEBUG] [LOCAL ] CRBD: Loaded 8964 existing records from primary storage. [2025-10-14T18:12:22.648460] [INFO ] [MAIN ] CRBD: Loaded 8964 existing records. [2025-10-14T18:12:22.831271] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:12:22.831494] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-14T18:12:22.831541] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-14T18:12:22.831775] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-14T18:12:22.831847] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-14T18:12:23.165818] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-14T18:12:23.189968] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:23.540490] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T18:12:23.958096] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-14T18:12:24.758080] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-14T18:12:24.995759] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T18:12:25.143701] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T18:12:25.558092] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-14T18:12:25.959286] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T18:12:26.358053] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-14T18:12:26.666537] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T18:12:27.158129] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-14T18:12:27.958087] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-14T18:12:28.312358] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T18:12:28.625201] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-14T18:12:28.631504] [INFO ] [REMOTE ] CPNG: Full fetch complete (77779 records). [2025-10-14T18:12:28.631695] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-14T18:12:28.758833] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-14T18:12:28.974876] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T18:12:29.049456] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-14T18:12:29.049536] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-14T18:12:29.050441] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-14T18:12:29.050504] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-14T18:12:29.051977] [DEBUG] [LOCAL ] CPNG: Trimmed 77779 records to 53679 (keeping 200 days of data) [2025-10-14T18:12:29.369304] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-14T18:12:29.369440] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-14T18:12:29.369516] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPNG took 43.6s. Estimated remaining: 4h 15m 1s. Rate: 7.2 symbols/min [2025-10-14T18:12:29.542134] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:29.571050] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-14T18:12:29.603750] [DEBUG] [LOCAL ] CRBG: Loaded 52546 existing records from primary storage. [2025-10-14T18:12:29.605219] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T18:12:29.605372] [INFO ] [MAIN ] CRBG: Loaded 52546 existing records. [2025-10-14T18:12:29.798792] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:12:29.799016] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-14T18:12:29.799064] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-14T18:12:29.799720] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-14T18:12:29.799777] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-14T18:12:30.142043] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:30.358147] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-14T18:12:30.564828] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T18:12:31.067560] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T18:12:31.158060] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-14T18:12:31.958085] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-14T18:12:32.396885] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T18:12:32.441552] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T18:12:32.758097] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-14T18:12:33.481436] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T18:12:33.558068] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-14T18:12:34.358058] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-14T18:12:34.656855] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T18:12:35.158081] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-14T18:12:35.781628] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T18:12:35.830631] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:12:35.958076] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-14T18:12:36.752484] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T18:12:36.758037] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-14T18:12:37.558069] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-14T18:12:37.613082] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T18:12:37.615043] [INFO ] [REMOTE ] CQP: Full fetch complete (30091 records). [2025-10-14T18:12:37.615119] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-14T18:12:37.987550] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-14T18:12:37.987620] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-14T18:12:37.988169] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-14T18:12:37.988229] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-14T18:12:37.989007] [DEBUG] [LOCAL ] CQP: Trimmed 30091 records to 18820 (keeping 200 days of data) [2025-10-14T18:12:38.102819] [DEBUG] [LOCAL ] CQP: Primary data saved (18820 records). [2025-10-14T18:12:38.102960] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-14T18:12:38.103039] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CQP took 22.2s. Estimated remaining: 4h 14m 54s. Rate: 7.2 symbols/min [2025-10-14T18:12:38.267684] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:38.305514] [DEBUG] [LOCAL ] CRC: Loaded 44022 existing records from primary storage. [2025-10-14T18:12:38.305826] [INFO ] [MAIN ] CRC: Loaded 44022 existing records. [2025-10-14T18:12:38.367272] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-14T18:12:38.484209] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:12:38.484405] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-14T18:12:38.484451] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-14T18:12:38.485361] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-14T18:12:38.485418] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-14T18:12:38.848963] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:39.158150] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-14T18:12:39.261768] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T18:12:39.579577] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T18:12:39.958092] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-14T18:12:40.451988] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T18:12:40.758066] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-14T18:12:41.005450] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T18:12:41.558079] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-14T18:12:41.834357] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T18:12:42.356126] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T18:12:42.363439] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-14T18:12:43.158083] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-14T18:12:43.804430] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T18:12:43.958059] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-14T18:12:44.478830] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-14T18:12:44.758077] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-14T18:12:45.558093] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-14T18:12:45.608847] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T18:12:45.907398] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T18:12:46.130447] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:12:46.358102] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-14T18:12:47.158073] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-14T18:12:47.496207] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T18:12:47.911202] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T18:12:47.958088] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-14T18:12:48.693721] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T18:12:48.758093] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-14T18:12:49.558135] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-14T18:12:49.987793] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-14T18:12:50.041715] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-14T18:12:50.358193] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-14T18:12:51.056847] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T18:12:51.158124] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-14T18:12:51.958100] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-14T18:12:52.486594] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T18:12:52.488072] [INFO ] [REMOTE ] CRBD: Full fetch complete (13511 records). [2025-10-14T18:12:52.488158] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-14T18:12:52.763266] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-14T18:12:52.884786] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-14T18:12:52.884976] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-14T18:12:52.885528] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-14T18:12:52.885706] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-14T18:12:52.886542] [DEBUG] [LOCAL ] CRBD: Trimmed 13511 records to 8944 (keeping 200 days of data) [2025-10-14T18:12:52.960162] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T18:12:52.982494] [DEBUG] [LOCAL ] CRBD: Primary data saved (8944 records). [2025-10-14T18:12:52.982614] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-14T18:12:52.982724] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRBD took 30.5s. Estimated remaining: 4h 15m 9s. Rate: 7.2 symbols/min [2025-10-14T18:12:53.151458] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:53.151625] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-14T18:12:53.151694] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-14T18:12:53.151837] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-14T18:12:53.151888] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-14T18:12:53.151938] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-14T18:12:53.151978] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-14T18:12:53.511882] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:53.558058] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-14T18:12:53.644620] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T18:12:53.736318] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:12:53.736573] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-14T18:12:53.736695] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:12:53.736749] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-14T18:12:53.736808] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:12:53.736878] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-14T18:12:53.736939] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-14T18:12:53.736973] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-14T18:12:53.737012] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-14T18:12:53.737055] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRCL took 0.8s. Estimated remaining: 4h 14m 34s. Rate: 7.2 symbols/min [2025-10-14T18:12:53.903886] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:12:53.952496] [DEBUG] [LOCAL ] CRGY: Loaded 52490 existing records from primary storage. [2025-10-14T18:12:53.952928] [INFO ] [MAIN ] CRGY: Loaded 52490 existing records. [2025-10-14T18:12:54.129800] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:12:54.130014] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-14T18:12:54.130061] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-14T18:12:54.130578] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-14T18:12:54.130636] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-14T18:12:54.363498] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-14T18:12:54.502181] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:12:55.158161] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-14T18:12:55.733385] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T18:12:55.958077] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-14T18:12:56.758078] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-14T18:12:57.358877] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-14T18:12:57.464208] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T18:12:57.558074] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-14T18:12:58.358125] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-14T18:12:58.456720] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T18:12:58.800901] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T18:12:59.158100] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-14T18:12:59.746099] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T18:12:59.958090] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-14T18:13:00.441112] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T18:13:00.444295] [INFO ] [REMOTE ] CR: Full fetch complete (34667 records). [2025-10-14T18:13:00.444385] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-14T18:13:00.763230] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-14T18:13:00.826425] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-14T18:13:00.826522] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-14T18:13:00.827146] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-14T18:13:00.827211] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-14T18:13:00.828472] [DEBUG] [LOCAL ] CR: Trimmed 34667 records to 24122 (keeping 200 days of data) [2025-10-14T18:13:00.982448] [DEBUG] [LOCAL ] CR: Primary data saved (24122 records). [2025-10-14T18:13:00.982593] [INFO ] [MAIN ] CR: Full history saved. [2025-10-14T18:13:00.982708] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CR took 40.2s. Estimated remaining: 4h 14m 23s. Rate: 7.2 symbols/min [2025-10-14T18:13:01.154155] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:01.207422] [DEBUG] [LOCAL ] CRH: Loaded 53445 existing records from primary storage. [2025-10-14T18:13:01.207874] [INFO ] [MAIN ] CRH: Loaded 53445 existing records. [2025-10-14T18:13:01.399967] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:13:01.400376] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-14T18:13:01.400462] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-14T18:13:01.401010] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-14T18:13:01.401072] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-14T18:13:01.569111] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-14T18:13:01.802594] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:01.804860] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-14T18:13:02.358104] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-14T18:13:02.529890] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T18:13:02.911170] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T18:13:03.158098] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-14T18:13:03.958106] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-14T18:13:04.180317] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:13:04.758119] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-14T18:13:04.792925] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T18:13:05.558081] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-14T18:13:05.853016] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T18:13:06.358100] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-14T18:13:06.603142] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T18:13:06.964448] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T18:13:06.969470] [INFO ] [REMOTE ] CRC: Full fetch complete (62843 records). [2025-10-14T18:13:06.969565] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-14T18:13:07.163285] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-14T18:13:07.355327] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-14T18:13:07.355402] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-14T18:13:07.356215] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-14T18:13:07.356278] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-14T18:13:07.357765] [DEBUG] [LOCAL ] CRC: Trimmed 62843 records to 44076 (keeping 200 days of data) [2025-10-14T18:13:07.620882] [DEBUG] [LOCAL ] CRC: Primary data saved (44076 records). [2025-10-14T18:13:07.621006] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-14T18:13:07.621082] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRC took 29.5s. Estimated remaining: 4h 14m 8s. Rate: 7.2 symbols/min [2025-10-14T18:13:07.793266] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:07.839408] [DEBUG] [LOCAL ] CRI: Loaded 49698 existing records from primary storage. [2025-10-14T18:13:07.839771] [INFO ] [MAIN ] CRI: Loaded 49698 existing records. [2025-10-14T18:13:07.969770] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-14T18:13:08.021813] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:13:08.022744] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-14T18:13:08.022887] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-14T18:13:08.023590] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-14T18:13:08.023678] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-14T18:13:08.385823] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:08.412457] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-14T18:13:08.758071] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-14T18:13:09.011815] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T18:13:09.558055] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-14T18:13:09.736637] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T18:13:10.077763] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T18:13:10.358152] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-14T18:13:10.938232] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T18:13:11.158073] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-14T18:13:11.958055] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-14T18:13:12.136806] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T18:13:12.758067] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-14T18:13:12.837354] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T18:13:13.214991] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T18:13:13.558087] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-14T18:13:14.134578] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T18:13:14.358082] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-14T18:13:15.158097] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-14T18:13:15.558374] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T18:13:15.958132] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-14T18:13:16.109186] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T18:13:16.117715] [INFO ] [REMOTE ] CRBG: Full fetch complete (75956 records). [2025-10-14T18:13:16.117861] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-14T18:13:16.512913] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-14T18:13:16.513009] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-14T18:13:16.513868] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-14T18:13:16.513994] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-14T18:13:16.515551] [DEBUG] [LOCAL ] CRBG: Trimmed 75956 records to 52568 (keeping 200 days of data) [2025-10-14T18:13:16.634507] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:13:16.758570] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-14T18:13:16.867906] [DEBUG] [LOCAL ] CRBG: Primary data saved (52568 records). [2025-10-14T18:13:16.868055] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-14T18:13:16.868143] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRBG took 47.5s. Estimated remaining: 4h 14m 4s. Rate: 7.2 symbols/min [2025-10-14T18:13:17.035597] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:17.035808] [DEBUG] [LOCAL ] CRK: No existing data file found in primary storage. [2025-10-14T18:13:17.035850] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-10-14T18:13:17.035958] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-14T18:13:17.035998] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-14T18:13:17.036038] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-14T18:13:17.036070] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-14T18:13:17.389430] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:17.558082] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-14T18:13:18.132284] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-14T18:13:18.270747] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T18:13:18.358091] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-14T18:13:18.752384] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T18:13:19.158078] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-14T18:13:19.958126] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-14T18:13:20.304597] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T18:13:20.540388] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T18:13:20.758067] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-14T18:13:21.558127] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-14T18:13:21.827313] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T18:13:22.358097] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-14T18:13:22.527175] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T18:13:22.953161] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T18:13:23.158079] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-14T18:13:23.958146] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-14T18:13:24.200516] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T18:13:24.758164] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-14T18:13:25.089319] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T18:13:25.558124] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-14T18:13:25.629702] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T18:13:26.358074] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-14T18:13:26.692057] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T18:13:27.158076] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-14T18:13:27.307663] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T18:13:27.721900] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:13:27.958130] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-14T18:13:28.690669] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T18:13:28.758081] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-14T18:13:29.558091] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-14T18:13:29.625426] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T18:13:30.358115] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-14T18:13:30.410489] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T18:13:31.158121] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-14T18:13:31.602615] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T18:13:31.958112] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-14T18:13:32.243817] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T18:13:32.251756] [INFO ] [REMOTE ] CRGY: Full fetch complete (76113 records). [2025-10-14T18:13:32.251936] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-14T18:13:32.693360] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-14T18:13:32.693530] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-14T18:13:32.694450] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-14T18:13:32.694529] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-14T18:13:32.722795] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T18:13:32.721493] [DEBUG] [LOCAL ] CRGY: Trimmed 76113 records to 52500 (keeping 200 days of data) [2025-10-14T18:13:32.785388] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-14T18:13:33.049142] [DEBUG] [LOCAL ] CRGY: Primary data saved (52500 records). [2025-10-14T18:13:33.049260] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-14T18:13:33.049343] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRGY took 39.3s. Estimated remaining: 4h 14m 23s. Rate: 7.2 symbols/min [2025-10-14T18:13:33.220850] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:33.263693] [DEBUG] [LOCAL ] CRL: Loaded 42928 existing records from primary storage. [2025-10-14T18:13:33.264018] [INFO ] [MAIN ] CRL: Loaded 42928 existing records. [2025-10-14T18:13:33.444429] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:13:33.444757] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-14T18:13:33.444948] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-14T18:13:33.445325] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-14T18:13:33.445383] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-14T18:13:33.563264] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-14T18:13:33.810551] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:33.857941] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T18:13:34.358155] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-14T18:13:34.469299] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T18:13:35.090106] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T18:13:35.158176] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-14T18:13:35.958128] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-14T18:13:35.993619] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T18:13:36.758074] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-14T18:13:36.781567] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T18:13:36.787526] [INFO ] [REMOTE ] CRH: Full fetch complete (77452 records). [2025-10-14T18:13:36.787719] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-14T18:13:37.199595] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-14T18:13:37.199696] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-14T18:13:37.200665] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-14T18:13:37.200727] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-14T18:13:37.202157] [DEBUG] [LOCAL ] CRH: Trimmed 77452 records to 53443 (keeping 200 days of data) [2025-10-14T18:13:37.541577] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T18:13:37.548116] [INFO ] [REMOTE ] CRI: Full fetch complete (70928 records). [2025-10-14T18:13:37.549846] [DEBUG] [LOCAL ] CRH: Primary data saved (53443 records). [2025-10-14T18:13:37.550003] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-14T18:13:37.550213] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-14T18:13:37.550363] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRH took 36.6s. Estimated remaining: 4h 14m 1s. Rate: 7.2 symbols/min [2025-10-14T18:13:37.574551] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-14T18:13:37.904479] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:38.129705] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-14T18:13:38.129805] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-14T18:13:38.130677] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-14T18:13:38.130928] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-14T18:13:38.132790] [DEBUG] [LOCAL ] CRI: Trimmed 70928 records to 49699 (keeping 200 days of data) [2025-10-14T18:13:38.267482] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T18:13:38.304042] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-14T18:13:38.304891] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-14T18:13:38.369714] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-14T18:13:38.513809] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:13:38.514997] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-14T18:13:38.515116] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-14T18:13:38.516523] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-14T18:13:38.516616] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-14T18:13:38.893166] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:39.060054] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T18:13:39.127951] [DEBUG] [LOCAL ] CRI: Primary data saved (49699 records). [2025-10-14T18:13:39.128342] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-14T18:13:39.128438] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRI took 31.5s. Estimated remaining: 4h 13m 30s. Rate: 7.2 symbols/min [2025-10-14T18:13:39.163286] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-14T18:13:39.305796] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:39.351073] [DEBUG] [LOCAL ] CRS: Loaded 43179 existing records from primary storage. [2025-10-14T18:13:39.351371] [INFO ] [MAIN ] CRS: Loaded 43179 existing records. [2025-10-14T18:13:39.558375] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:13:39.558584] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-14T18:13:39.558631] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-14T18:13:39.559164] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-14T18:13:39.559223] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-14T18:13:39.947379] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:39.963189] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-14T18:13:39.979889] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T18:13:40.758123] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-14T18:13:40.887055] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T18:13:41.047598] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T18:13:41.558098] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-14T18:13:41.643200] [DEBUG] [REMOTE ] CRK: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-14T18:13:41.643489] [WARN ] [REMOTE ] CRK: No data returned for month 2025-07 [2025-10-14T18:13:41.643577] [FATAL] [REMOTE ] CRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:13:41.643697] [FATAL] [MAIN ] CRK: Failed to fetch primary data. [2025-10-14T18:13:41.643765] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:13:41.643836] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-14T18:13:41.643896] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-14T18:13:41.643932] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-10-14T18:13:41.643971] [DEBUG] [LOCAL ] CRK: No derivative data file found to delete. [2025-10-14T18:13:41.644025] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRK took 24.8s. Estimated remaining: 4h 13m 2s. Rate: 7.3 symbols/min [2025-10-14T18:13:41.816943] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:13:41.824538] [DEBUG] [LOCAL ] CRT: Loaded 4929 existing records from primary storage. [2025-10-14T18:13:41.824759] [INFO ] [MAIN ] CRT: Loaded 4929 existing records. [2025-10-14T18:13:42.007230] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:13:42.007389] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-14T18:13:42.007435] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-14T18:13:42.007567] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-14T18:13:42.007606] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-14T18:13:42.359440] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-14T18:13:42.383569] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:13:43.113817] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-14T18:13:43.158122] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-14T18:13:43.968452] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-14T18:13:43.974635] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T18:13:44.758118] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-14T18:13:44.926634] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T18:13:45.457492] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T18:13:45.558079] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-14T18:13:46.131479] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-14T18:13:46.163986] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T18:13:46.358074] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-14T18:13:47.158086] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-14T18:13:47.958067] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-14T18:13:48.092574] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T18:13:48.758067] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-14T18:13:48.942457] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T18:13:49.186517] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T18:13:49.558086] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-14T18:13:49.928586] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-14T18:13:50.358117] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-14T18:13:51.158053] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-14T18:13:51.219793] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T18:13:51.958140] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-14T18:13:52.005940] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T18:13:52.564135] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T18:13:52.758140] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-14T18:13:53.449588] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-14T18:13:53.466895] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T18:13:53.558095] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-14T18:13:54.358080] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-14T18:13:55.158086] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-14T18:13:55.725786] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T18:13:55.921074] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-14T18:13:55.958086] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-14T18:13:56.381415] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T18:13:56.698362] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T18:13:56.758051] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-14T18:13:57.558080] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-14T18:13:58.074012] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T18:13:58.150790] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T18:13:58.358127] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-14T18:13:58.694553] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-14T18:13:59.158070] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-14T18:13:59.958148] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-14T18:14:00.543393] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T18:14:00.758142] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-14T18:14:01.558118] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-14T18:14:01.680058] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-14T18:14:02.184006] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T18:14:02.199295] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T18:14:02.358088] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-14T18:14:03.158117] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-14T18:14:03.917374] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:14:03.958080] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-14T18:14:04.758111] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-14T18:14:05.237735] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T18:14:05.243180] [INFO ] [REMOTE ] CRL: Full fetch complete (63393 records). [2025-10-14T18:14:05.243323] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-14T18:14:05.560528] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-14T18:14:05.678297] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-14T18:14:05.678529] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-14T18:14:05.679520] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-14T18:14:05.679750] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-14T18:14:05.681458] [DEBUG] [LOCAL ] CRL: Trimmed 63393 records to 42908 (keeping 200 days of data) [2025-10-14T18:14:05.831159] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-14T18:14:06.003043] [DEBUG] [LOCAL ] CRL: Primary data saved (42908 records). [2025-10-14T18:14:06.003194] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-14T18:14:06.003281] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRL took 33.0s. Estimated remaining: 4h 13m 48s. Rate: 7.2 symbols/min [2025-10-14T18:14:06.185769] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T18:14:06.211720] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:06.260674] [DEBUG] [LOCAL ] CSAN: Loaded 42131 existing records from primary storage. [2025-10-14T18:14:06.264316] [INFO ] [MAIN ] CSAN: Loaded 42131 existing records. [2025-10-14T18:14:06.264479] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T18:14:06.339416] [INFO ] [REMOTE ] CRT: Full fetch complete (7428 records). [2025-10-14T18:14:06.346590] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-14T18:14:06.369229] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-14T18:14:06.623701] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:06.650105] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-14T18:14:06.659675] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-14T18:14:06.728166] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-14T18:14:06.750552] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-14T18:14:07.013773] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-14T18:14:07.023746] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-14T18:14:07.041460] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-14T18:14:07.073202] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-14T18:14:07.149691] [DEBUG] [LOCAL ] CRT: Trimmed 7428 records to 4916 (keeping 200 days of data) [2025-10-14T18:14:07.176224] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-14T18:14:07.281489] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:07.287984] [DEBUG] [LOCAL ] CRT: Primary data saved (4916 records). [2025-10-14T18:14:07.288092] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-14T18:14:07.288166] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CRT took 25.6s. Estimated remaining: 4h 13m 16s. Rate: 7.2 symbols/min [2025-10-14T18:14:07.460691] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:07.492585] [DEBUG] [LOCAL ] CSL: Loaded 31512 existing records from primary storage. [2025-10-14T18:14:07.492899] [INFO ] [MAIN ] CSL: Loaded 31512 existing records. [2025-10-14T18:14:07.667247] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:07.667499] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-14T18:14:07.667569] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-14T18:14:07.668141] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-14T18:14:07.668206] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-14T18:14:07.963255] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-14T18:14:08.020722] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:08.525300] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T18:14:08.758092] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-14T18:14:08.830578] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-14T18:14:09.337290] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T18:14:09.558076] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-14T18:14:10.332207] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T18:14:10.358044] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-14T18:14:10.580041] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T18:14:11.158097] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-14T18:14:11.617560] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T18:14:11.958138] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-14T18:14:12.758229] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-14T18:14:13.446440] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T18:14:13.562337] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-14T18:14:13.570052] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-14T18:14:14.189757] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T18:14:14.358080] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-14T18:14:14.649990] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T18:14:15.158093] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-14T18:14:15.834602] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T18:14:15.839434] [INFO ] [REMOTE ] CRS: Full fetch complete (62597 records). [2025-10-14T18:14:15.839573] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-14T18:14:15.963293] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-14T18:14:16.242037] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-14T18:14:16.242241] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-14T18:14:16.243073] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-14T18:14:16.243145] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-14T18:14:16.244751] [DEBUG] [LOCAL ] CRS: Trimmed 62597 records to 43223 (keeping 200 days of data) [2025-10-14T18:14:16.372233] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T18:14:16.550947] [DEBUG] [LOCAL ] CRS: Primary data saved (43223 records). [2025-10-14T18:14:16.551074] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-14T18:14:16.552178] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CRS took 37.4s. Estimated remaining: 4h 13m 11s. Rate: 7.2 symbols/min [2025-10-14T18:14:16.734294] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:16.750409] [DEBUG] [LOCAL ] CSR: Loaded 13229 existing records from primary storage. [2025-10-14T18:14:16.750632] [INFO ] [MAIN ] CSR: Loaded 13229 existing records. [2025-10-14T18:14:16.763520] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-14T18:14:16.931394] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:16.931629] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-14T18:14:16.931709] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-14T18:14:16.932116] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-14T18:14:16.932173] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-14T18:14:17.292247] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:17.324905] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:14:17.558077] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-14T18:14:18.358099] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-14T18:14:18.941274] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T18:14:19.158065] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-14T18:14:19.290894] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T18:14:19.423860] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-14T18:14:19.958126] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-14T18:14:20.512360] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T18:14:20.758088] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-14T18:14:21.558066] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-14T18:14:21.611838] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T18:14:21.679563] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T18:14:22.358058] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-14T18:14:22.417489] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T18:14:23.158078] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-14T18:14:23.687936] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T18:14:23.958075] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-14T18:14:23.974578] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T18:14:24.758100] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-14T18:14:25.335535] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:14:25.391632] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T18:14:25.558095] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-14T18:14:26.358097] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-14T18:14:26.538441] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T18:14:27.158256] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-14T18:14:27.801074] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T18:14:27.951796] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T18:14:27.961514] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-14T18:14:28.758183] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-14T18:14:29.558101] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-14T18:14:29.817231] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T18:14:30.358099] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-14T18:14:30.494467] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T18:14:30.590031] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-14T18:14:31.158094] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-14T18:14:31.379789] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T18:14:31.653064] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-14T18:14:31.958097] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-14T18:14:32.627817] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:14:32.758118] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-14T18:14:33.558066] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-14T18:14:34.237316] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:14:34.358094] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-14T18:14:34.472559] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T18:14:35.117397] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T18:14:35.123554] [INFO ] [REMOTE ] CRM: Full fetch complete (77944 records). [2025-10-14T18:14:35.123711] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-14T18:14:35.163148] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-14T18:14:35.517831] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-14T18:14:35.517906] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-14T18:14:35.518758] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-14T18:14:35.518819] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-14T18:14:35.520236] [DEBUG] [LOCAL ] CRM: Trimmed 77944 records to 53770 (keeping 200 days of data) [2025-10-14T18:14:35.852796] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-14T18:14:35.852923] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-14T18:14:35.853443] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CRM took 58.3s. Estimated remaining: 4h 13m 40s. Rate: 7.2 symbols/min [2025-10-14T18:14:35.963313] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-14T18:14:36.023222] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:36.068503] [DEBUG] [LOCAL ] CSTM: Loaded 47634 existing records from primary storage. [2025-10-14T18:14:36.068833] [INFO ] [MAIN ] CSTM: Loaded 47634 existing records. [2025-10-14T18:14:36.244204] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:36.244435] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-14T18:14:36.244494] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-14T18:14:36.244799] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-14T18:14:36.244857] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-14T18:14:36.579478] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:14:36.619029] [INFO ] [REMOTE ] CSL: Full fetch complete (45407 records). [2025-10-14T18:14:36.636831] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-14T18:14:36.639999] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:36.763261] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-14T18:14:37.029990] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-14T18:14:37.030110] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-14T18:14:37.031044] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-14T18:14:37.031109] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-14T18:14:37.032189] [DEBUG] [LOCAL ] CSL: Trimmed 45407 records to 31497 (keeping 200 days of data) [2025-10-14T18:14:37.222922] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T18:14:37.273536] [DEBUG] [LOCAL ] CSL: Primary data saved (31497 records). [2025-10-14T18:14:37.273692] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-14T18:14:37.273782] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 30.0s. Estimated remaining: 4h 13m 9s. Rate: 7.2 symbols/min [2025-10-14T18:14:37.439725] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:37.454145] [DEBUG] [LOCAL ] CSV: Loaded 12750 existing records from primary storage. [2025-10-14T18:14:37.454369] [INFO ] [MAIN ] CSV: Loaded 12750 existing records. [2025-10-14T18:14:37.563162] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-14T18:14:37.636634] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:37.636922] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-14T18:14:37.636969] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-14T18:14:37.637118] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-14T18:14:37.637168] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-14T18:14:38.004692] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:38.358212] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-14T18:14:38.385261] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T18:14:38.563242] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T18:14:38.565546] [INFO ] [REMOTE ] CSR: Full fetch complete (17859 records). [2025-10-14T18:14:38.565636] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-14T18:14:38.931046] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-14T18:14:38.931145] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-14T18:14:38.931515] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-14T18:14:38.931554] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-14T18:14:38.932091] [DEBUG] [LOCAL ] CSR: Trimmed 17859 records to 13282 (keeping 200 days of data) [2025-10-14T18:14:39.015747] [DEBUG] [LOCAL ] CSR: Primary data saved (13282 records). [2025-10-14T18:14:39.015890] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-14T18:14:39.015967] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSR took 22.5s. Estimated remaining: 4h 12m 38s. Rate: 7.2 symbols/min [2025-10-14T18:14:39.166517] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-14T18:14:39.193229] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:39.193428] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-14T18:14:39.194274] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-14T18:14:39.194424] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-14T18:14:39.194493] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-14T18:14:39.194560] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-14T18:14:39.194606] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-14T18:14:39.579995] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:39.709891] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T18:14:39.958090] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-14T18:14:40.443959] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T18:14:40.758110] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-14T18:14:40.959327] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:14:40.959624] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-14T18:14:40.959756] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:14:40.959861] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-14T18:14:40.959943] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:14:40.960037] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-14T18:14:40.960117] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-14T18:14:40.960154] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-14T18:14:40.960193] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-14T18:14:40.960237] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSW took 1.9s. Estimated remaining: 4h 12m 8s. Rate: 7.2 symbols/min [2025-10-14T18:14:41.127159] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:41.136471] [DEBUG] [LOCAL ] CTBB: Loaded 6924 existing records from primary storage. [2025-10-14T18:14:41.136707] [INFO ] [MAIN ] CTBB: Loaded 6924 existing records. [2025-10-14T18:14:41.325004] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:41.325214] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-14T18:14:41.325261] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-14T18:14:41.325450] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-14T18:14:41.325506] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-14T18:14:41.558522] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-14T18:14:41.747586] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T18:14:41.751303] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:42.358085] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-14T18:14:42.636384] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T18:14:43.103012] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T18:14:43.158048] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-14T18:14:43.958080] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-14T18:14:44.735124] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T18:14:44.758045] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-14T18:14:45.263112] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T18:14:45.268525] [INFO ] [REMOTE ] CSAN: Full fetch complete (60433 records). [2025-10-14T18:14:45.268744] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-14T18:14:45.565218] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-14T18:14:45.683291] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-14T18:14:45.683374] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-14T18:14:45.684211] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-14T18:14:45.684273] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-14T18:14:45.685449] [DEBUG] [LOCAL ] CSAN: Trimmed 60433 records to 42149 (keeping 200 days of data) [2025-10-14T18:14:45.919583] [DEBUG] [LOCAL ] CSAN: Primary data saved (42149 records). [2025-10-14T18:14:45.919742] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-14T18:14:45.919846] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSAN took 39.9s. Estimated remaining: 4h 11m 49s. Rate: 7.3 symbols/min [2025-10-14T18:14:46.074997] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T18:14:46.127213] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:14:46.135284] [DEBUG] [LOCAL ] CTDD: Loaded 5638 existing records from primary storage. [2025-10-14T18:14:46.135484] [INFO ] [MAIN ] CTDD: Loaded 5638 existing records. [2025-10-14T18:14:46.312750] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:14:46.312945] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-14T18:14:46.312991] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-14T18:14:46.313196] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-14T18:14:46.313252] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-14T18:14:46.367169] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-14T18:14:46.604615] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T18:14:46.682937] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:14:47.128804] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T18:14:47.158062] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-14T18:14:47.958077] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-14T18:14:47.983391] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T18:14:48.551854] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T18:14:48.758084] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-14T18:14:49.505790] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T18:14:49.558102] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-14T18:14:50.326177] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T18:14:50.358084] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-14T18:14:50.860261] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T18:14:51.158137] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-14T18:14:51.958073] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-14T18:14:52.100930] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T18:14:52.601378] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T18:14:52.758111] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-14T18:14:53.558064] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-14T18:14:53.751934] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T18:14:53.940834] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-14T18:14:54.358084] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-14T18:14:55.129051] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T18:14:55.158039] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-14T18:14:55.961381] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-14T18:14:55.962294] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T18:14:56.524191] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T18:14:56.758157] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-14T18:14:57.558080] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-14T18:14:57.656441] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T18:14:58.076510] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T18:14:58.358092] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-14T18:14:58.922149] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T18:14:59.158090] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-14T18:14:59.860840] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T18:14:59.958109] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-14T18:15:00.758058] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-14T18:15:00.870737] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T18:15:00.872683] [INFO ] [REMOTE ] CSV: Full fetch complete (19283 records). [2025-10-14T18:15:00.872756] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-14T18:15:01.235477] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-14T18:15:01.235583] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-14T18:15:01.236128] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-14T18:15:01.236188] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-14T18:15:01.236901] [DEBUG] [LOCAL ] CSV: Trimmed 19283 records to 12742 (keeping 200 days of data) [2025-10-14T18:15:01.315766] [DEBUG] [LOCAL ] CSV: Primary data saved (12742 records). [2025-10-14T18:15:01.315907] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-14T18:15:01.315993] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CSV took 24.0s. Estimated remaining: 4h 12m 5s. Rate: 7.2 symbols/min [2025-10-14T18:15:01.534943] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:01.535147] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-14T18:15:01.535186] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-14T18:15:01.535310] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-14T18:15:01.535352] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-14T18:15:01.535393] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-14T18:15:01.535426] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-14T18:15:01.563293] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-14T18:15:01.672260] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T18:15:01.933710] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:02.358078] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-14T18:15:03.014095] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T18:15:03.158060] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-14T18:15:03.368218] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:15:03.368682] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-14T18:15:03.368779] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:15:03.368833] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-14T18:15:03.368869] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:15:03.368937] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-14T18:15:03.369028] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-14T18:15:03.369071] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-14T18:15:03.369119] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-14T18:15:03.369176] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CTEV took 2.1s. Estimated remaining: 4h 11m 35s. Rate: 7.3 symbols/min [2025-10-14T18:15:03.569391] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:03.605560] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T18:15:03.653555] [DEBUG] [LOCAL ] CTO: Loaded 27753 existing records from primary storage. [2025-10-14T18:15:03.654046] [INFO ] [MAIN ] CTO: Loaded 27753 existing records. [2025-10-14T18:15:03.860781] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:15:03.861094] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-14T18:15:03.861172] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-14T18:15:03.861856] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-14T18:15:03.861914] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-14T18:15:03.965140] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-14T18:15:04.236338] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:04.758095] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-14T18:15:05.427275] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T18:15:05.558077] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-14T18:15:05.658153] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T18:15:05.991133] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T18:15:06.358080] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-14T18:15:06.927111] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:15:07.158064] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-14T18:15:07.915902] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T18:15:07.958054] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-14T18:15:08.559726] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T18:15:08.560958] [INFO ] [REMOTE ] CTBB: Full fetch complete (10422 records). [2025-10-14T18:15:08.561028] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-14T18:15:08.763276] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-14T18:15:08.932968] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-14T18:15:08.933040] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-14T18:15:08.933306] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-14T18:15:08.933344] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-14T18:15:08.933797] [DEBUG] [LOCAL ] CTBB: Trimmed 10422 records to 6891 (keeping 200 days of data) [2025-10-14T18:15:08.975514] [DEBUG] [LOCAL ] CTBB: Primary data saved (6891 records). [2025-10-14T18:15:08.975600] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-14T18:15:08.975689] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTBB took 28.0s. Estimated remaining: 4h 11m 18s. Rate: 7.3 symbols/min [2025-10-14T18:15:09.143127] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:09.177890] [DEBUG] [LOCAL ] CTOS: Loaded 37028 existing records from primary storage. [2025-10-14T18:15:09.178183] [INFO ] [MAIN ] CTOS: Loaded 37028 existing records. [2025-10-14T18:15:09.372020] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:15:09.372317] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-14T18:15:09.372386] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-14T18:15:09.373277] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-14T18:15:09.373347] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-14T18:15:09.558069] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-14T18:15:09.764199] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:10.273260] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T18:15:10.358056] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-14T18:15:11.158088] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-14T18:15:11.329549] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T18:15:11.518806] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T18:15:11.958095] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-14T18:15:12.411917] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T18:15:12.758067] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-14T18:15:13.524188] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T18:15:13.558034] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-14T18:15:13.994886] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T18:15:13.995691] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T18:15:14.358082] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-14T18:15:15.158100] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-14T18:15:15.958094] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-14T18:15:16.133190] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T18:15:16.609571] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T18:15:16.646203] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T18:15:16.758093] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-14T18:15:17.349742] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T18:15:17.558096] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-14T18:15:17.993003] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T18:15:18.358083] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-14T18:15:18.971207] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T18:15:18.972208] [INFO ] [REMOTE ] CTDD: Full fetch complete (8154 records). [2025-10-14T18:15:18.972278] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-14T18:15:18.972635] [FATAL] [VALIDATOR ] CTDD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:15:18.972739] [FATAL] [MAIN ] CTDD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:15:18.972802] [WARN ] [MAIN ] CTDD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:15:18.972868] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-14T18:15:18.972928] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-14T18:15:18.972963] [INFO ] [LOCAL ] CTDD: Starting deletion of derivative data. [2025-10-14T18:15:18.973164] [DEBUG] [LOCAL ] CTDD: Deleted derivative data file. [2025-10-14T18:15:18.973250] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTDD took 33.1s. Estimated remaining: 4h 11m 16s. Rate: 7.3 symbols/min [2025-10-14T18:15:19.142639] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:19.169602] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-14T18:15:19.190879] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-14T18:15:19.191173] [INFO ] [MAIN ] CTRA: Loaded 53646 existing records. [2025-10-14T18:15:19.365687] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:15:19.365887] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-14T18:15:19.365933] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-14T18:15:19.366994] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-14T18:15:19.367053] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-14T18:15:19.735832] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:19.958165] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-14T18:15:20.558516] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T18:15:20.758159] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-14T18:15:21.558070] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-14T18:15:21.664829] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T18:15:22.338458] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:15:22.358035] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-14T18:15:22.845497] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T18:15:23.158133] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-14T18:15:23.958135] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-14T18:15:24.020770] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T18:15:24.313812] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T18:15:24.758093] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-14T18:15:25.149001] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T18:15:25.558141] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-14T18:15:26.358120] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-14T18:15:26.418265] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T18:15:26.423549] [INFO ] [REMOTE ] CSTM: Full fetch complete (69410 records). [2025-10-14T18:15:26.423681] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-14T18:15:26.803622] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-14T18:15:26.803726] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-14T18:15:26.804493] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-14T18:15:26.804534] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-14T18:15:26.805817] [DEBUG] [LOCAL ] CSTM: Trimmed 69410 records to 47568 (keeping 200 days of data) [2025-10-14T18:15:27.079332] [DEBUG] [LOCAL ] CSTM: Primary data saved (47568 records). [2025-10-14T18:15:27.079448] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-14T18:15:27.079620] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CSTM took 51.2s. Estimated remaining: 4h 11m 7s. Rate: 7.3 symbols/min [2025-10-14T18:15:27.159095] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-14T18:15:27.249994] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:27.250127] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-14T18:15:27.250165] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-14T18:15:27.250271] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-14T18:15:27.250312] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-14T18:15:27.250352] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-14T18:15:27.250384] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-14T18:15:27.613030] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:27.643486] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T18:15:27.678716] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T18:15:27.958055] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-14T18:15:28.499803] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T18:15:28.758084] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-14T18:15:29.381220] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T18:15:29.558100] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-14T18:15:30.358131] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-14T18:15:30.395209] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T18:15:31.030691] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T18:15:31.158066] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-14T18:15:31.260263] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T18:15:31.958116] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-14T18:15:32.758132] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-14T18:15:33.138057] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T18:15:33.457227] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T18:15:33.558110] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-14T18:15:34.224530] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T18:15:34.358103] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-14T18:15:34.679190] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T18:15:35.158070] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-14T18:15:35.962112] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-14T18:15:35.968099] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T18:15:36.413298] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T18:15:36.758098] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-14T18:15:37.226327] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T18:15:37.558124] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-14T18:15:38.173474] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:15:38.177424] [INFO ] [REMOTE ] CTO: Full fetch complete (41656 records). [2025-10-14T18:15:38.177500] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-14T18:15:38.362966] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-14T18:15:38.573366] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-14T18:15:38.573456] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-14T18:15:38.574276] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-14T18:15:38.574343] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-14T18:15:38.575550] [DEBUG] [LOCAL ] CTO: Trimmed 41656 records to 27742 (keeping 200 days of data) [2025-10-14T18:15:38.679290] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T18:15:38.764795] [DEBUG] [LOCAL ] CTO: Primary data saved (27742 records). [2025-10-14T18:15:38.764932] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-14T18:15:38.765011] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTO took 35.4s. Estimated remaining: 4h 11m 10s. Rate: 7.3 symbols/min [2025-10-14T18:15:38.932413] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:38.970227] [DEBUG] [LOCAL ] CTRI: Loaded 39822 existing records from primary storage. [2025-10-14T18:15:38.970549] [INFO ] [MAIN ] CTRI: Loaded 39822 existing records. [2025-10-14T18:15:39.146347] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:15:39.146585] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-14T18:15:39.146632] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-14T18:15:39.146965] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-14T18:15:39.147011] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-14T18:15:39.163361] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-14T18:15:39.507015] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:39.609440] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T18:15:39.958062] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-14T18:15:40.580623] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:15:40.758093] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-14T18:15:41.385684] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T18:15:41.558101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-14T18:15:41.975366] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T18:15:41.980060] [INFO ] [REMOTE ] CTOS: Full fetch complete (53809 records). [2025-10-14T18:15:41.980169] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-14T18:15:42.356436] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-14T18:15:42.356513] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-14T18:15:42.357260] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-14T18:15:42.357319] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-14T18:15:42.358164] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-14T18:15:42.359881] [DEBUG] [LOCAL ] CTOS: Trimmed 53809 records to 37068 (keeping 200 days of data) [2025-10-14T18:15:42.574027] [DEBUG] [LOCAL ] CTOS: Primary data saved (37068 records). [2025-10-14T18:15:42.574158] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-14T18:15:42.574235] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTOS took 33.6s. Estimated remaining: 4h 10m 47s. Rate: 7.3 symbols/min [2025-10-14T18:15:42.750397] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:15:42.771175] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T18:15:42.799984] [DEBUG] [LOCAL ] CTS: Loaded 19511 existing records from primary storage. [2025-10-14T18:15:42.800247] [INFO ] [MAIN ] CTS: Loaded 19511 existing records. [2025-10-14T18:15:42.985017] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:15:42.985232] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-14T18:15:42.985279] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-14T18:15:42.985521] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-14T18:15:42.985579] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-14T18:15:43.166841] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-14T18:15:43.352274] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:15:43.958067] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-14T18:15:44.394623] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T18:15:44.758059] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-14T18:15:44.915993] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T18:15:45.099085] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T18:15:45.558278] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-14T18:15:46.113818] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T18:15:46.358082] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-14T18:15:46.706846] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T18:15:47.158074] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-14T18:15:47.457721] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T18:15:47.958122] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-14T18:15:48.703701] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T18:15:48.758071] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-14T18:15:48.787513] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T18:15:49.558108] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-14T18:15:50.358245] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-14T18:15:50.557745] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T18:15:50.660636] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T18:15:51.158087] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-14T18:15:51.804262] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T18:15:51.958070] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-14T18:15:52.110441] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T18:15:52.758087] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-14T18:15:53.558077] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-14T18:15:53.772197] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T18:15:54.358153] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-14T18:15:54.525389] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T18:15:54.793896] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T18:15:55.162039] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-14T18:15:55.958130] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-14T18:15:56.039946] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T18:15:56.758062] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-14T18:15:56.922508] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T18:15:56.977978] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T18:15:57.558066] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-14T18:15:57.762817] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T18:15:58.358088] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-14T18:15:58.645538] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T18:15:59.158072] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-14T18:15:59.958079] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-14T18:16:00.118375] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T18:16:00.125195] [INFO ] [REMOTE ] CTRA: Full fetch complete (77818 records). [2025-10-14T18:16:00.125391] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-14T18:16:00.542906] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-14T18:16:00.542988] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-14T18:16:00.543854] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-14T18:16:00.543923] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-14T18:16:00.545504] [DEBUG] [LOCAL ] CTRA: Trimmed 77818 records to 53647 (keeping 200 days of data) [2025-10-14T18:16:00.685294] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T18:16:00.760211] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-14T18:16:00.906580] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-14T18:16:00.906759] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-14T18:16:00.906887] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRA took 41.9s. Estimated remaining: 4h 11m 12s. Rate: 7.2 symbols/min [2025-10-14T18:16:01.073297] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:01.122387] [DEBUG] [LOCAL ] CTVA: Loaded 53277 existing records from primary storage. [2025-10-14T18:16:01.122731] [INFO ] [MAIN ] CTVA: Loaded 53277 existing records. [2025-10-14T18:16:01.300821] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:16:01.301132] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-14T18:16:01.301193] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-14T18:16:01.301578] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-14T18:16:01.301725] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-14T18:16:01.392507] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T18:16:01.563311] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-14T18:16:01.711895] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:02.311328] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T18:16:02.358062] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-14T18:16:02.748266] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T18:16:03.158069] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-14T18:16:03.716124] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T18:16:03.958077] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-14T18:16:04.758054] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-14T18:16:05.093946] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T18:16:05.558051] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-14T18:16:05.602631] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T18:16:06.203732] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T18:16:06.210574] [INFO ] [REMOTE ] CTRE: Full fetch complete (71304 records). [2025-10-14T18:16:06.210771] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-14T18:16:06.370421] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-14T18:16:06.633718] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-14T18:16:06.633809] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-14T18:16:06.634817] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-14T18:16:06.634881] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-14T18:16:06.636344] [DEBUG] [LOCAL ] CTRE: Trimmed 71304 records to 49413 (keeping 200 days of data) [2025-10-14T18:16:06.963559] [DEBUG] [LOCAL ] CTRE: Primary data saved (49413 records). [2025-10-14T18:16:06.963933] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-14T18:16:06.964036] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRE took 39.9s. Estimated remaining: 4h 10m 56s. Rate: 7.2 symbols/min [2025-10-14T18:16:07.159608] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-14T18:16:07.159536] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:07.159862] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-14T18:16:07.160593] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-14T18:16:07.160763] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-14T18:16:07.160840] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-14T18:16:07.160935] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-14T18:16:07.160998] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-14T18:16:07.439221] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T18:16:07.565254] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:07.595261] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-14T18:16:07.958082] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-14T18:16:08.300439] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-14T18:16:08.616224] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T18:16:08.622348] [INFO ] [REMOTE ] CTRI: Full fetch complete (53232 records). [2025-10-14T18:16:08.622535] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-14T18:16:08.769851] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-14T18:16:09.019477] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-14T18:16:09.019568] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-14T18:16:09.020324] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-14T18:16:09.020388] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-14T18:16:09.021598] [DEBUG] [LOCAL ] CTRI: Trimmed 53232 records to 39942 (keeping 200 days of data) [2025-10-14T18:16:09.112792] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-14T18:16:09.265990] [DEBUG] [LOCAL ] CTRI: Primary data saved (39942 records). [2025-10-14T18:16:09.266133] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-14T18:16:09.266210] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTRI took 30.5s. Estimated remaining: 4h 10m 28s. Rate: 7.3 symbols/min [2025-10-14T18:16:09.433492] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:09.481297] [DEBUG] [LOCAL ] CUBE: Loaded 50841 existing records from primary storage. [2025-10-14T18:16:09.481608] [INFO ] [MAIN ] CUBE: Loaded 50841 existing records. [2025-10-14T18:16:09.563203] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-14T18:16:09.678389] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:16:09.678735] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-14T18:16:09.678800] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-14T18:16:09.679267] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-14T18:16:09.679328] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-14T18:16:09.972282] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T18:16:10.051603] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:10.358078] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-14T18:16:11.158123] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-14T18:16:11.511366] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-14T18:16:11.958072] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-14T18:16:11.996085] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T18:16:12.758075] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-14T18:16:13.111669] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-14T18:16:13.571193] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-14T18:16:13.598113] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T18:16:14.358056] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-14T18:16:14.730980] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-14T18:16:15.158135] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-14T18:16:15.958099] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-14T18:16:16.140803] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:16:16.306386] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T18:16:16.758137] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-14T18:16:16.897077] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T18:16:17.002096] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-14T18:16:17.558085] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-14T18:16:17.814606] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-14T18:16:18.358144] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-14T18:16:19.105314] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T18:16:19.158053] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-14T18:16:19.958057] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-14T18:16:20.213316] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T18:16:20.758087] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-14T18:16:21.558084] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-14T18:16:21.785616] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T18:16:21.954007] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-14T18:16:21.982513] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T18:16:22.358126] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-14T18:16:23.158136] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-14T18:16:23.950022] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T18:16:23.953520] [INFO ] [REMOTE ] CTS: Full fetch complete (26919 records). [2025-10-14T18:16:23.953743] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-14T18:16:23.959632] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-14T18:16:24.126254] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T18:16:24.431717] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-14T18:16:24.431852] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-14T18:16:24.432430] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-14T18:16:24.432472] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-14T18:16:24.433192] [DEBUG] [LOCAL ] CTS: Trimmed 26919 records to 19598 (keeping 200 days of data) [2025-10-14T18:16:24.563764] [DEBUG] [LOCAL ] CTS: Primary data saved (19598 records). [2025-10-14T18:16:24.563917] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-14T18:16:24.564043] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CTS took 42.0s. Estimated remaining: 4h 10m 43s. Rate: 7.2 symbols/min [2025-10-14T18:16:24.757579] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:24.757807] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-10-14T18:16:24.757851] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-10-14T18:16:24.757964] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-14T18:16:24.758031] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-14T18:16:24.758076] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-14T18:16:24.758236] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-14T18:16:24.759254] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-14T18:16:25.162597] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:25.166630] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T18:16:25.558097] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-14T18:16:25.905443] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-14T18:16:25.906173] [INFO ] [REMOTE ] CUBB: Full fetch complete (917 records). [2025-10-14T18:16:25.906242] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-14T18:16:26.119757] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-14T18:16:26.120044] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:16:26.131396] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:16:26.151046] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-14T18:16:26.151249] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-14T18:16:26.151325] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-14T18:16:26.151505] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-14T18:16:26.153417] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-14T18:16:26.152164] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CUBB took 19.2s. Estimated remaining: 4h 10m 13s. Rate: 7.3 symbols/min [2025-10-14T18:16:26.359960] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:26.359145] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-14T18:16:26.413405] [DEBUG] [LOCAL ] CUK: Loaded 51023 existing records from primary storage. [2025-10-14T18:16:26.413882] [INFO ] [MAIN ] CUK: Loaded 51023 existing records. [2025-10-14T18:16:26.619380] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:16:26.619574] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-14T18:16:26.619623] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-14T18:16:26.619838] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-14T18:16:26.619904] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-14T18:16:27.027885] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:27.158061] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-14T18:16:27.544372] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T18:16:27.958076] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-14T18:16:28.758066] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-14T18:16:28.898454] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T18:16:29.558162] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-14T18:16:29.827370] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T18:16:30.256748] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T18:16:30.358174] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-14T18:16:30.802858] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T18:16:31.158135] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-14T18:16:31.958109] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-14T18:16:32.147459] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T18:16:32.751162] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T18:16:32.758031] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-14T18:16:33.021038] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T18:16:33.558081] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-14T18:16:33.927043] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T18:16:34.358073] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-14T18:16:35.094556] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T18:16:35.158094] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-14T18:16:35.864120] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T18:16:35.958078] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-14T18:16:36.593128] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T18:16:36.758108] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-14T18:16:37.558071] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-14T18:16:37.823044] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T18:16:38.231511] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:16:38.342497] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T18:16:38.358028] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-14T18:16:39.158090] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-14T18:16:39.480688] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T18:16:39.958128] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-14T18:16:40.758060] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-14T18:16:40.793698] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T18:16:40.799591] [INFO ] [REMOTE ] CTVA: Full fetch complete (77183 records). [2025-10-14T18:16:40.799739] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-14T18:16:41.187813] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-14T18:16:41.187910] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-14T18:16:41.188829] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-14T18:16:41.188889] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-14T18:16:41.190235] [DEBUG] [LOCAL ] CTVA: Trimmed 77183 records to 53288 (keeping 200 days of data) [2025-10-14T18:16:41.514802] [DEBUG] [LOCAL ] CTVA: Primary data saved (53288 records). [2025-10-14T18:16:41.514924] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-14T18:16:41.514999] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CTVA took 40.6s. Estimated remaining: 4h 10m 28s. Rate: 7.2 symbols/min [2025-10-14T18:16:41.560631] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-14T18:16:41.694469] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:41.699906] [DEBUG] [LOCAL ] CULP: Loaded 2895 existing records from primary storage. [2025-10-14T18:16:41.700066] [INFO ] [MAIN ] CULP: Loaded 2895 existing records. [2025-10-14T18:16:41.890408] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:16:41.890966] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-14T18:16:41.891242] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-14T18:16:41.916550] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-14T18:16:41.916825] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-14T18:16:41.933174] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-14T18:16:42.188673] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T18:16:42.334864] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:42.358030] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-14T18:16:43.158051] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-14T18:16:43.458593] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T18:16:43.628940] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T18:16:43.958083] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-14T18:16:44.578518] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T18:16:44.758067] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-14T18:16:45.254290] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:16:45.558079] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-14T18:16:46.145977] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T18:16:46.253069] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T18:16:46.358104] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-14T18:16:47.158104] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-14T18:16:47.789870] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T18:16:47.958079] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-14T18:16:47.970607] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T18:16:47.973998] [INFO ] [REMOTE ] CUBI: Full fetch complete (39144 records). [2025-10-14T18:16:47.974087] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-14T18:16:48.399600] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-14T18:16:48.399732] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-14T18:16:48.400461] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-14T18:16:48.400504] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-14T18:16:48.401378] [DEBUG] [LOCAL ] CUBI: Trimmed 39144 records to 27208 (keeping 200 days of data) [2025-10-14T18:16:48.563816] [DEBUG] [LOCAL ] CUBI: Primary data saved (27208 records). [2025-10-14T18:16:48.563954] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-14T18:16:48.564025] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUBI took 24.0s. Estimated remaining: 4h 10m 16s. Rate: 7.2 symbols/min [2025-10-14T18:16:48.734973] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:16:48.735139] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-14T18:16:48.735177] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-14T18:16:48.735286] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-14T18:16:48.735327] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-14T18:16:48.735366] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-14T18:16:48.735397] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-14T18:16:48.766617] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-14T18:16:49.097083] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:16:49.558046] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-14T18:16:49.883314] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T18:16:49.964339] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T18:16:50.358085] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-14T18:16:50.417442] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:16:50.823742] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T18:16:51.158074] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-14T18:16:51.795186] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T18:16:51.958086] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-14T18:16:52.758065] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-14T18:16:53.388697] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T18:16:53.558101] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-14T18:16:54.339072] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T18:16:54.344632] [INFO ] [REMOTE ] CUBE: Full fetch complete (73224 records). [2025-10-14T18:16:54.344786] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-14T18:16:54.366360] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-14T18:16:54.735495] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-14T18:16:54.735596] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-14T18:16:54.736455] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-14T18:16:54.736532] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-14T18:16:54.738013] [DEBUG] [LOCAL ] CUBE: Trimmed 73224 records to 50859 (keeping 200 days of data) [2025-10-14T18:16:54.846157] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T18:16:55.023269] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T18:16:55.101477] [DEBUG] [LOCAL ] CUBE: Primary data saved (50859 records). [2025-10-14T18:16:55.101636] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-14T18:16:55.101772] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUBE took 45.8s. Estimated remaining: 4h 10m 2s. Rate: 7.2 symbols/min [2025-10-14T18:16:55.158120] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-14T18:16:55.958120] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-14T18:16:56.097267] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T18:16:56.529918] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:16:56.758148] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-14T18:16:57.226688] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T18:16:57.558127] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-14T18:16:58.090499] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-14T18:16:58.358120] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-14T18:16:59.158094] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-14T18:16:59.958048] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-14T18:17:00.146059] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T18:17:00.335998] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-14T18:17:00.522510] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T18:17:00.758075] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-14T18:17:01.558049] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-14T18:17:02.269308] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T18:17:02.358057] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-14T18:17:03.007913] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T18:17:03.169297] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-14T18:17:03.174976] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T18:17:03.551661] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:17:03.552459] [INFO ] [REMOTE ] CULP: Full fetch complete (4557 records). [2025-10-14T18:17:03.552526] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-14T18:17:03.552907] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:17:03.552987] [FATAL] [MAIN ] CULP: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:17:03.553029] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:17:03.553089] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-14T18:17:03.553150] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-14T18:17:03.553184] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-14T18:17:03.553383] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-10-14T18:17:03.553470] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CULP took 22.0s. Estimated remaining: 4h 9m 54s. Rate: 7.2 symbols/min [2025-10-14T18:17:03.958075] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-14T18:17:04.758141] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-14T18:17:05.767678] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-14T18:17:05.774257] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-14T18:17:05.807457] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T18:17:06.358077] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-14T18:17:07.018488] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T18:17:07.158071] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-14T18:17:07.871474] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T18:17:07.958085] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-14T18:17:07.996603] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T18:17:08.758066] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-14T18:17:09.475061] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T18:17:09.484320] [INFO ] [REMOTE ] CUK: Full fetch complete (74219 records). [2025-10-14T18:17:09.484494] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-14T18:17:09.903350] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-14T18:17:09.903533] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-14T18:17:09.904421] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-14T18:17:09.904580] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-14T18:17:09.926840] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T18:17:09.934769] [DEBUG] [LOCAL ] CUK: Trimmed 74219 records to 51044 (keeping 200 days of data) [2025-10-14T18:17:09.935908] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-14T18:17:10.242039] [DEBUG] [LOCAL ] CUK: Primary data saved (51044 records). [2025-10-14T18:17:10.242181] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-14T18:17:10.242259] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CUK took 44.1s. Estimated remaining: 4h 9m 40s. Rate: 7.2 symbols/min [2025-10-14T18:17:11.306973] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T18:17:11.317710] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-14T18:17:12.409492] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T18:17:12.414404] [INFO ] [REMOTE ] CURB: Full fetch complete (46965 records). [2025-10-14T18:17:12.414629] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-14T18:17:12.415920] [FATAL] [VALIDATOR ] CURB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:17:12.416033] [FATAL] [MAIN ] CURB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:17:12.416078] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:17:12.416121] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-14T18:17:12.416188] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-14T18:17:12.416224] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-14T18:17:12.416264] [DEBUG] [LOCAL ] CURB: No derivative data file found to delete. [2025-10-14T18:17:12.416333] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURB took 23.9s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-14T18:17:13.058694] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:13.122662] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:13.176755] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:13.204101] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:13.204399] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-14T18:17:13.204622] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-14T18:17:13.204762] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-14T18:17:13.204804] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-14T18:17:13.204843] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-14T18:17:13.204916] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-14T18:17:13.444792] [DEBUG] [LOCAL ] CURV: Loaded 26844 existing records from primary storage. [2025-10-14T18:17:13.480580] [INFO ] [MAIN ] CURV: Loaded 26844 existing records. [2025-10-14T18:17:13.595555] [DEBUG] [LOCAL ] CVE: Loaded 53561 existing records from primary storage. [2025-10-14T18:17:13.648349] [DEBUG] [LOCAL ] CUZ: Loaded 49541 existing records from primary storage. [2025-10-14T18:17:13.637352] [INFO ] [MAIN ] CVE: Loaded 53561 existing records. [2025-10-14T18:17:13.664694] [INFO ] [MAIN ] CUZ: Loaded 49541 existing records. [2025-10-14T18:17:13.866158] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:13.886158] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-14T18:17:14.083639] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:17:14.101829] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-14T18:17:14.157351] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-14T18:17:14.222117] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-14T18:17:14.216859] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:17:14.239686] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-14T18:17:14.239778] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-14T18:17:14.262055] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-14T18:17:14.266022] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-14T18:17:14.286143] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-14T18:17:14.265962] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:17:14.308344] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-14T18:17:14.348935] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-14T18:17:14.386880] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-14T18:17:14.400954] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-14T18:17:14.954261] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T18:17:15.035449] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-14T18:17:15.383915] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:15.412905] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-14T18:17:15.379766] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:15.443262] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-14T18:17:15.446436] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:15.447590] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-14T18:17:15.963819] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T18:17:15.966099] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-14T18:17:16.921582] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T18:17:16.929637] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-14T18:17:16.938451] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T18:17:16.941873] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-14T18:17:17.122156] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T18:17:17.220431] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T18:17:17.512042] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T18:17:17.558095] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-14T18:17:17.820417] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T18:17:18.358160] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-14T18:17:19.090855] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T18:17:19.158032] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-14T18:17:19.289130] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-14T18:17:19.958092] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-14T18:17:20.545414] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T18:17:20.590933] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T18:17:20.758084] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-14T18:17:21.558115] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-14T18:17:22.213078] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T18:17:22.358148] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-14T18:17:23.164146] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-14T18:17:23.186488] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T18:17:23.809409] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T18:17:23.958138] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-14T18:17:24.612958] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T18:17:24.758165] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-14T18:17:25.558085] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-14T18:17:25.607718] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T18:17:25.884048] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T18:17:26.358097] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-14T18:17:26.640460] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T18:17:27.158116] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-14T18:17:27.964983] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-14T18:17:27.967310] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T18:17:28.105963] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T18:17:28.758057] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-14T18:17:28.954326] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T18:17:29.558040] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-14T18:17:29.940291] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T18:17:30.358103] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-14T18:17:31.158121] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-14T18:17:31.338630] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T18:17:31.864683] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T18:17:31.958146] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-14T18:17:32.535764] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:17:32.758096] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-14T18:17:33.558057] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-14T18:17:33.759190] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T18:17:34.248605] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T18:17:34.358052] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-14T18:17:35.167066] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-14T18:17:35.173000] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T18:17:35.958143] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-14T18:17:36.190183] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T18:17:36.193174] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T18:17:36.758135] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-14T18:17:37.133615] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T18:17:37.558086] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-14T18:17:38.177245] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:17:38.358083] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-14T18:17:38.892021] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T18:17:39.158095] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-14T18:17:39.249249] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T18:17:39.253154] [INFO ] [REMOTE ] CURV: Full fetch complete (39011 records). [2025-10-14T18:17:39.253257] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-14T18:17:39.628765] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-14T18:17:39.628847] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-14T18:17:39.629501] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-14T18:17:39.629562] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-14T18:17:39.630463] [DEBUG] [LOCAL ] CURV: Trimmed 39011 records to 26882 (keeping 200 days of data) [2025-10-14T18:17:39.784124] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T18:17:39.789922] [DEBUG] [LOCAL ] CURV: Primary data saved (26882 records). [2025-10-14T18:17:39.790273] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-14T18:17:39.790352] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CURV took 27.4s. Estimated remaining: 4h 10m 6s. Rate: 7.2 symbols/min [2025-10-14T18:17:39.956472] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:39.956676] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-14T18:17:39.956731] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-14T18:17:39.956841] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-14T18:17:39.956883] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-14T18:17:39.956925] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-14T18:17:39.956958] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-14T18:17:39.967943] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-14T18:17:40.340626] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:40.692469] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T18:17:40.758067] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-14T18:17:41.558073] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-14T18:17:42.358128] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-14T18:17:42.801399] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T18:17:42.892616] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T18:17:43.158124] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-14T18:17:43.958079] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-14T18:17:44.086335] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T18:17:44.687126] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T18:17:44.689450] [INFO ] [REMOTE ] CVEO: Full fetch complete (20761 records). [2025-10-14T18:17:44.689519] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-14T18:17:44.764747] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-14T18:17:45.066621] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-14T18:17:45.066747] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-14T18:17:45.067283] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-14T18:17:45.067361] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-14T18:17:45.068188] [DEBUG] [LOCAL ] CVEO: Trimmed 20761 records to 15396 (keeping 200 days of data) [2025-10-14T18:17:45.173803] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T18:17:45.207564] [DEBUG] [LOCAL ] CVEO: Primary data saved (15396 records). [2025-10-14T18:17:45.207709] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-14T18:17:45.207786] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVEO took 32.8s. Estimated remaining: 4h 9m 48s. Rate: 7.2 symbols/min [2025-10-14T18:17:45.374036] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:45.374221] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-14T18:17:45.374260] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-14T18:17:45.374372] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-14T18:17:45.374411] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-14T18:17:45.374450] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-14T18:17:45.374482] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-14T18:17:45.566702] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-14T18:17:45.726157] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:46.366137] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-14T18:17:46.384958] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T18:17:47.158050] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-14T18:17:47.265331] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T18:17:47.320413] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T18:17:47.958111] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-14T18:17:48.338431] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T18:17:48.758094] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-14T18:17:49.558068] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-14T18:17:49.705581] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T18:17:49.711501] [INFO ] [REMOTE ] CVE: Full fetch complete (77712 records). [2025-10-14T18:17:49.711620] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-14T18:17:50.106508] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-14T18:17:50.106580] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-14T18:17:50.107426] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-14T18:17:50.107486] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-14T18:17:50.108961] [DEBUG] [LOCAL ] CVE: Trimmed 77712 records to 53562 (keeping 200 days of data) [2025-10-14T18:17:50.388169] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-14T18:17:50.457923] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T18:17:50.467758] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T18:17:50.488373] [DEBUG] [LOCAL ] CVE: Primary data saved (53562 records). [2025-10-14T18:17:50.488515] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-14T18:17:50.488621] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CVE took 38.1s. Estimated remaining: 4h 9m 30s. Rate: 7.2 symbols/min [2025-10-14T18:17:50.676538] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:50.722617] [DEBUG] [LOCAL ] CVNA: Loaded 52878 existing records from primary storage. [2025-10-14T18:17:50.722944] [INFO ] [MAIN ] CVNA: Loaded 52878 existing records. [2025-10-14T18:17:50.896605] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:17:50.896839] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-14T18:17:50.896894] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-14T18:17:50.897811] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-14T18:17:50.897873] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-14T18:17:51.163150] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-14T18:17:51.255543] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:51.931997] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T18:17:51.937880] [INFO ] [REMOTE ] CUZ: Full fetch complete (70861 records). [2025-10-14T18:17:51.938007] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-14T18:17:51.968828] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-14T18:17:52.057583] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T18:17:52.336747] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-14T18:17:52.336833] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-14T18:17:52.337791] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-14T18:17:52.337853] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-14T18:17:52.339354] [DEBUG] [LOCAL ] CUZ: Trimmed 70861 records to 49608 (keeping 200 days of data) [2025-10-14T18:17:52.634483] [DEBUG] [LOCAL ] CUZ: Primary data saved (49608 records). [2025-10-14T18:17:52.634607] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-14T18:17:52.634705] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CUZ took 40.2s. Estimated remaining: 4h 9m 2s. Rate: 7.2 symbols/min [2025-10-14T18:17:52.772917] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-14T18:17:52.803857] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:17:52.852802] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-14T18:17:52.853115] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-14T18:17:53.027058] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:17:53.027320] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-14T18:17:53.027373] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-14T18:17:53.028346] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-14T18:17:53.028406] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-14T18:17:53.375479] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:17:53.558049] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-14T18:17:53.725012] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T18:17:54.358127] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-14T18:17:54.904030] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-14T18:17:55.158097] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-14T18:17:55.618722] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T18:17:55.824331] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-14T18:17:55.958057] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-14T18:17:56.758054] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-14T18:17:57.228719] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T18:17:57.267538] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-14T18:17:57.558089] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-14T18:17:58.263142] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T18:17:58.358075] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-14T18:17:58.491278] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T18:17:59.158213] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-14T18:17:59.928384] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T18:17:59.958055] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-14T18:18:00.359414] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T18:18:00.758095] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-14T18:18:01.558069] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-14T18:18:01.802199] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T18:18:01.850596] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T18:18:02.358162] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-14T18:18:03.158044] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-14T18:18:03.708535] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-14T18:18:03.958064] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-14T18:18:04.291013] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-14T18:18:04.345364] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T18:18:04.758102] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-14T18:18:05.558092] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-14T18:18:06.002747] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-14T18:18:06.358106] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-14T18:18:06.560879] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T18:18:07.158113] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-14T18:18:07.380089] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T18:18:07.958107] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-14T18:18:08.168720] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T18:18:08.195842] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T18:18:08.758098] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-14T18:18:09.323869] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T18:18:09.329454] [INFO ] [REMOTE ] CVI: Full fetch complete (67326 records). [2025-10-14T18:18:09.329810] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-14T18:18:09.569080] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-14T18:18:09.741201] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-14T18:18:09.741284] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-14T18:18:09.742123] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-14T18:18:09.742185] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-14T18:18:09.743713] [DEBUG] [LOCAL ] CVI: Trimmed 67326 records to 46631 (keeping 200 days of data) [2025-10-14T18:18:10.016121] [DEBUG] [LOCAL ] CVI: Primary data saved (46631 records). [2025-10-14T18:18:10.016265] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-14T18:18:10.016404] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVI took 30.2s. Estimated remaining: 4h 9m 23s. Rate: 7.2 symbols/min [2025-10-14T18:18:10.192416] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:10.193513] [DEBUG] [LOCAL ] CVX: No existing data file found in primary storage. [2025-10-14T18:18:10.193568] [WARN ] [MAIN ] CVX: No existing data found, performing full refresh instead. [2025-10-14T18:18:10.193778] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-14T18:18:10.193832] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-14T18:18:10.193877] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-14T18:18:10.193921] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-14T18:18:10.365714] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-14T18:18:10.564833] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:10.621181] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T18:18:10.775348] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T18:18:11.158069] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-14T18:18:11.958079] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-14T18:18:12.001692] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T18:18:12.687909] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-14T18:18:12.758048] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-14T18:18:13.558098] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-14T18:18:14.358102] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-14T18:18:14.442788] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-14T18:18:14.838470] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-14T18:18:15.046504] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T18:18:15.049248] [INFO ] [REMOTE ] CVLG: Full fetch complete (21265 records). [2025-10-14T18:18:15.049430] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-14T18:18:15.165105] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-14T18:18:15.638736] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-14T18:18:15.658172] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-14T18:18:15.681904] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-14T18:18:15.682377] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-14T18:18:15.688939] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-14T18:18:15.689783] [DEBUG] [LOCAL ] CVLG: Trimmed 21265 records to 15571 (keeping 200 days of data) [2025-10-14T18:18:15.831013] [DEBUG] [LOCAL ] CVLG: Primary data saved (15571 records). [2025-10-14T18:18:15.831169] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-14T18:18:15.831249] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVLG took 30.6s. Estimated remaining: 4h 9m 7s. Rate: 7.2 symbols/min [2025-10-14T18:18:15.962165] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-14T18:18:16.038348] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:16.062469] [DEBUG] [LOCAL ] CW: Loaded 22235 existing records from primary storage. [2025-10-14T18:18:16.062736] [INFO ] [MAIN ] CW: Loaded 22235 existing records. [2025-10-14T18:18:16.253695] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:18:16.253944] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-14T18:18:16.254007] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-14T18:18:16.254319] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-14T18:18:16.254394] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-14T18:18:16.631613] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:16.758076] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-14T18:18:17.507880] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-14T18:18:17.558082] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-14T18:18:17.774408] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T18:18:18.358136] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-14T18:18:18.889945] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-14T18:18:19.100153] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T18:18:19.158106] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-14T18:18:19.958065] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-14T18:18:20.342917] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T18:18:20.521461] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-14T18:18:20.758096] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-14T18:18:21.558095] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-14T18:18:21.679524] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T18:18:22.358089] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-14T18:18:23.006740] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-14T18:18:23.158072] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-14T18:18:23.569818] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-14T18:18:23.963583] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-14T18:18:23.990401] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T18:18:24.758108] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-14T18:18:25.115921] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-14T18:18:25.154639] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-14T18:18:25.161333] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-14T18:18:25.161508] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-14T18:18:25.378291] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T18:18:25.565234] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-14T18:18:25.584856] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-14T18:18:25.584909] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-14T18:18:25.585771] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-14T18:18:25.585941] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-14T18:18:25.587361] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-14T18:18:25.916615] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-14T18:18:25.916775] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-14T18:18:25.916854] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVS took 33.3s. Estimated remaining: 4h 9m 4s. Rate: 7.2 symbols/min [2025-10-14T18:18:26.093754] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:26.093936] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-10-14T18:18:26.093975] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-10-14T18:18:26.094083] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-14T18:18:26.094124] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-14T18:18:26.094166] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-14T18:18:26.094199] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-14T18:18:26.363392] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-14T18:18:26.461376] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:27.158099] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-14T18:18:27.493986] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-14T18:18:27.500227] [INFO ] [REMOTE ] CVNA: Full fetch complete (76774 records). [2025-10-14T18:18:27.500392] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-14T18:18:27.923918] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-14T18:18:27.924043] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-14T18:18:27.925203] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-14T18:18:27.925702] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-14T18:18:27.926972] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T18:18:27.934375] [DEBUG] [LOCAL ] CVNA: Trimmed 76774 records to 52872 (keeping 200 days of data) [2025-10-14T18:18:27.985273] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-14T18:18:28.263415] [DEBUG] [LOCAL ] CVNA: Primary data saved (52872 records). [2025-10-14T18:18:28.263565] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-14T18:18:28.263691] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CVNA took 37.8s. Estimated remaining: 4h 8m 37s. Rate: 7.2 symbols/min [2025-10-14T18:18:28.434638] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:28.475995] [DEBUG] [LOCAL ] CWEN: Loaded 45292 existing records from primary storage. [2025-10-14T18:18:28.476282] [INFO ] [MAIN ] CWEN: Loaded 45292 existing records. [2025-10-14T18:18:28.653264] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:18:28.653455] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-14T18:18:28.653500] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-14T18:18:28.653878] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-14T18:18:28.653935] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-14T18:18:28.772988] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-14T18:18:29.031213] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:29.059851] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T18:18:29.212168] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T18:18:29.558097] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-14T18:18:30.358134] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-14T18:18:31.158166] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-14T18:18:31.202521] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T18:18:31.298128] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-14T18:18:31.624059] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T18:18:31.958108] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-14T18:18:32.354013] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T18:18:32.758089] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-14T18:18:33.558089] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-14T18:18:33.988581] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T18:18:34.067968] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T18:18:34.358162] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-14T18:18:34.885378] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T18:18:35.158075] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-14T18:18:35.176716] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T18:18:35.958089] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-14T18:18:36.758053] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-14T18:18:36.967083] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T18:18:37.558084] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-14T18:18:38.326948] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-14T18:18:38.358063] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-14T18:18:38.400495] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T18:18:39.158066] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-14T18:18:39.230512] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T18:18:39.958123] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-14T18:18:40.298391] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T18:18:40.374826] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T18:18:40.758097] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-14T18:18:41.565300] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-14T18:18:41.585590] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T18:18:42.358128] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-14T18:18:42.634527] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T18:18:43.144922] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-14T18:18:43.158033] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-14T18:18:43.958063] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-14T18:18:44.156088] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T18:18:44.758054] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-14T18:18:45.147820] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T18:18:45.413819] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-14T18:18:45.558072] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-14T18:18:45.930331] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T18:18:46.298984] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T18:18:46.301403] [INFO ] [REMOTE ] CW: Full fetch complete (33085 records). [2025-10-14T18:18:46.301487] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-14T18:18:46.367467] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-14T18:18:46.685562] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-14T18:18:46.685636] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-14T18:18:46.686179] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-14T18:18:46.686220] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-14T18:18:46.686966] [DEBUG] [LOCAL ] CW: Trimmed 33085 records to 22123 (keeping 200 days of data) [2025-10-14T18:18:46.825547] [DEBUG] [LOCAL ] CW: Primary data saved (22123 records). [2025-10-14T18:18:46.825692] [INFO ] [MAIN ] CW: Full history saved. [2025-10-14T18:18:46.825781] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CW took 31.0s. Estimated remaining: 4h 9m 1s. Rate: 7.2 symbols/min [2025-10-14T18:18:47.005359] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:47.055553] [DEBUG] [LOCAL ] CWH: Loaded 51335 existing records from primary storage. [2025-10-14T18:18:47.055879] [INFO ] [MAIN ] CWH: Loaded 51335 existing records. [2025-10-14T18:18:47.158064] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-14T18:18:47.240312] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:18:47.240529] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-14T18:18:47.240575] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-14T18:18:47.240988] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-14T18:18:47.241047] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-14T18:18:47.609816] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:47.958127] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-14T18:18:47.995811] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T18:18:48.758078] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-14T18:18:48.920465] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T18:18:48.948886] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T18:18:48.955050] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-14T18:18:48.955238] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-14T18:18:49.374481] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-14T18:18:49.374574] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-14T18:18:49.375522] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-14T18:18:49.375587] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-14T18:18:49.377196] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-14T18:18:49.569090] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-14T18:18:49.728422] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-14T18:18:49.728561] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-14T18:18:49.728636] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CVX took 39.7s. Estimated remaining: 4h 8m 36s. Rate: 7.2 symbols/min [2025-10-14T18:18:49.907242] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:49.955827] [DEBUG] [LOCAL ] CWK: Loaded 49523 existing records from primary storage. [2025-10-14T18:18:49.956204] [INFO ] [MAIN ] CWK: Loaded 49523 existing records. [2025-10-14T18:18:50.136058] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:18:50.136283] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-14T18:18:50.136330] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-14T18:18:50.136829] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-14T18:18:50.136889] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-14T18:18:50.358943] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-14T18:18:50.500332] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:50.526097] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T18:18:51.004994] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T18:18:51.158076] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-14T18:18:51.942665] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:18:51.958063] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-14T18:18:52.758069] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-14T18:18:52.875620] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T18:18:53.558046] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-14T18:18:53.767072] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T18:18:54.034017] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T18:18:54.358098] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-14T18:18:54.659344] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T18:18:55.158078] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-14T18:18:55.958062] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-14T18:18:56.209138] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T18:18:56.215141] [INFO ] [REMOTE ] CWAN: Full fetch complete (75430 records). [2025-10-14T18:18:56.215290] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-14T18:18:56.627153] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-14T18:18:56.627232] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-14T18:18:56.628179] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-14T18:18:56.628245] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-14T18:18:56.629731] [DEBUG] [LOCAL ] CWAN: Trimmed 75430 records to 52586 (keeping 200 days of data) [2025-10-14T18:18:56.797894] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-14T18:18:56.941042] [DEBUG] [LOCAL ] CWAN: Primary data saved (52586 records). [2025-10-14T18:18:56.941179] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-14T18:18:56.941248] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWAN took 31.0s. Estimated remaining: 4h 8m 24s. Rate: 7.2 symbols/min [2025-10-14T18:18:57.128487] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:18:57.141465] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-14T18:18:57.176530] [DEBUG] [LOCAL ] CWT: Loaded 28118 existing records from primary storage. [2025-10-14T18:18:57.176815] [INFO ] [MAIN ] CWT: Loaded 28118 existing records. [2025-10-14T18:18:57.361079] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:18:57.361415] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-14T18:18:57.361508] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-14T18:18:57.372177] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-14T18:18:57.391348] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-14T18:18:57.466030] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T18:18:57.563836] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-14T18:18:57.781580] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:18:58.156432] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:18:58.358093] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-14T18:18:59.158710] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-14T18:18:59.368756] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T18:18:59.567040] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T18:18:59.958101] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-14T18:19:00.710119] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T18:19:00.758076] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-14T18:19:01.348150] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T18:19:01.558161] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-14T18:19:02.326057] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T18:19:02.358079] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-14T18:19:03.136547] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:19:03.158076] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-14T18:19:03.958103] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-14T18:19:04.178800] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:19:04.490510] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T18:19:04.758100] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-14T18:19:05.179505] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T18:19:05.558070] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-14T18:19:06.017787] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T18:19:06.022908] [INFO ] [REMOTE ] CWEN: Full fetch complete (64917 records). [2025-10-14T18:19:06.023081] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-14T18:19:06.023737] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:19:06.023822] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:19:06.023864] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:19:06.023901] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-14T18:19:06.023956] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-14T18:19:06.023990] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-14T18:19:06.024226] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-10-14T18:19:06.024314] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWEN took 37.8s. Estimated remaining: 4h 8m 19s. Rate: 7.2 symbols/min [2025-10-14T18:19:06.190517] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:06.238947] [DEBUG] [LOCAL ] CX: Loaded 52816 existing records from primary storage. [2025-10-14T18:19:06.239292] [INFO ] [MAIN ] CX: Loaded 52816 existing records. [2025-10-14T18:19:06.363261] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-14T18:19:06.416559] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:19:06.416750] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-14T18:19:06.416827] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-14T18:19:06.417288] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-14T18:19:06.417345] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-14T18:19:06.777566] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:06.884049] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T18:19:07.158090] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-14T18:19:07.299191] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T18:19:07.958096] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-14T18:19:08.758107] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-14T18:19:09.392429] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-14T18:19:09.558104] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-14T18:19:10.358079] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-14T18:19:12.300430] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (4.34 seconds). [2025-10-14T18:19:12.308160] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-14T18:19:12.870115] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-10-14T18:19:12.879791] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-14T18:19:13.585825] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (3.23 seconds). [2025-10-14T18:19:13.597134] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-14T18:19:13.779791] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T18:19:13.787058] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-14T18:19:14.254107] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:19:14.358079] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-14T18:19:14.980348] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T18:19:15.016771] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T18:19:15.158092] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-14T18:19:15.812973] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T18:19:15.958099] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-14T18:19:16.246836] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (7.49 seconds). [2025-10-14T18:19:16.621587] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T18:19:16.758090] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-14T18:19:16.952489] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T18:19:17.558051] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-14T18:19:18.358186] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-14T18:19:19.158093] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-14T18:19:19.388460] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-14T18:19:19.958122] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-14T18:19:20.458616] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T18:19:20.680852] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (3.12 seconds). [2025-10-14T18:19:20.765683] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-14T18:19:20.785183] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-14T18:19:21.552481] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T18:19:21.557631] [INFO ] [REMOTE ] CWK: Full fetch complete (70828 records). [2025-10-14T18:19:21.557761] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-14T18:19:21.558569] [FATAL] [VALIDATOR ] CWK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:19:21.558092] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-14T18:19:21.559579] [FATAL] [MAIN ] CWK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:19:21.559688] [WARN ] [MAIN ] CWK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:19:21.559761] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-14T18:19:21.559827] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-14T18:19:21.559861] [INFO ] [LOCAL ] CWK: Starting deletion of derivative data. [2025-10-14T18:19:21.560332] [DEBUG] [LOCAL ] CWK: Deleted derivative data file. [2025-10-14T18:19:21.560808] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 31.8s. Estimated remaining: 4h 8m 33s. Rate: 7.2 symbols/min [2025-10-14T18:19:21.740777] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:21.750125] [DEBUG] [LOCAL ] CXE: Loaded 6159 existing records from primary storage. [2025-10-14T18:19:21.750370] [INFO ] [MAIN ] CXE: Loaded 6159 existing records. [2025-10-14T18:19:21.934028] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:19:21.934244] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-14T18:19:21.934293] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-14T18:19:21.934465] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-14T18:19:21.934506] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-14T18:19:22.299936] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:22.358042] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-14T18:19:22.605580] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T18:19:22.899081] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T18:19:23.017240] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T18:19:23.158190] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-14T18:19:23.958138] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-14T18:19:24.758166] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-14T18:19:24.938708] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:19:25.558147] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-14T18:19:25.794267] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T18:19:26.118908] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T18:19:26.122438] [INFO ] [REMOTE ] CWT: Full fetch complete (40938 records). [2025-10-14T18:19:26.122554] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-14T18:19:26.368861] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-14T18:19:26.537569] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-14T18:19:26.537669] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-14T18:19:26.538284] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-14T18:19:26.538346] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-14T18:19:26.539269] [DEBUG] [LOCAL ] CWT: Trimmed 40938 records to 28136 (keeping 200 days of data) [2025-10-14T18:19:26.728870] [DEBUG] [LOCAL ] CWT: Primary data saved (28136 records). [2025-10-14T18:19:26.729187] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-14T18:19:26.729288] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CWT took 29.8s. Estimated remaining: 4h 8m 15s. Rate: 7.2 symbols/min [2025-10-14T18:19:26.900265] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:26.907051] [DEBUG] [LOCAL ] CXH: Loaded 4435 existing records from primary storage. [2025-10-14T18:19:26.907257] [INFO ] [MAIN ] CXH: Loaded 4435 existing records. [2025-10-14T18:19:27.088742] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:19:27.089007] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-14T18:19:27.089068] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-14T18:19:27.089243] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-14T18:19:27.089301] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-14T18:19:27.166591] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-14T18:19:27.221910] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T18:19:27.476043] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:27.536144] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T18:19:27.958135] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-14T18:19:28.758082] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-14T18:19:28.804163] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T18:19:29.459495] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-14T18:19:29.558085] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-14T18:19:29.877798] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T18:19:30.358077] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-14T18:19:30.629280] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T18:19:31.158095] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-14T18:19:31.958093] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-14T18:19:32.028547] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T18:19:32.034393] [INFO ] [REMOTE ] CWH: Full fetch complete (72848 records). [2025-10-14T18:19:32.034536] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-14T18:19:32.035398] [FATAL] [VALIDATOR ] CWH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:19:32.035486] [FATAL] [MAIN ] CWH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:19:32.035530] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:19:32.035572] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-14T18:19:32.035636] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-14T18:19:32.035718] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-14T18:19:32.035996] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-14T18:19:32.036103] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWH took 45.2s. Estimated remaining: 4h 7m 57s. Rate: 7.2 symbols/min [2025-10-14T18:19:32.163090] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T18:19:32.233827] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:32.278639] [DEBUG] [LOCAL ] CXM: Loaded 47604 existing records from primary storage. [2025-10-14T18:19:32.279078] [INFO ] [MAIN ] CXM: Loaded 47604 existing records. [2025-10-14T18:19:32.471995] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:19:32.472180] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-14T18:19:32.472229] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-14T18:19:32.473089] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-14T18:19:32.473151] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-14T18:19:32.763326] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-14T18:19:32.857423] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:33.232173] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T18:19:33.558113] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-14T18:19:33.736242] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T18:19:33.835486] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-14T18:19:34.358128] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-14T18:19:34.799954] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T18:19:35.158128] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-14T18:19:35.958147] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-14T18:19:36.758081] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-14T18:19:37.241753] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T18:19:37.269841] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T18:19:37.558120] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-14T18:19:37.654292] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T18:19:38.358112] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-14T18:19:39.158064] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-14T18:19:39.212989] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T18:19:39.611236] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T18:19:39.821485] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T18:19:39.958118] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-14T18:19:40.758116] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-14T18:19:41.099302] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T18:19:41.558099] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-14T18:19:42.332007] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T18:19:42.358151] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-14T18:19:42.500324] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T18:19:42.825250] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-14T18:19:43.158101] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-14T18:19:43.958144] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-14T18:19:44.543072] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T18:19:44.551522] [INFO ] [REMOTE ] CX: Full fetch complete (76549 records). [2025-10-14T18:19:44.551732] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-14T18:19:44.765716] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-14T18:19:44.944314] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-14T18:19:44.944392] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-14T18:19:44.945326] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-14T18:19:44.945393] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-14T18:19:44.948157] [DEBUG] [LOCAL ] CX: Trimmed 76549 records to 52837 (keeping 200 days of data) [2025-10-14T18:19:45.256539] [DEBUG] [LOCAL ] CX: Primary data saved (52837 records). [2025-10-14T18:19:45.256702] [INFO ] [MAIN ] CX: Full history saved. [2025-10-14T18:19:45.256810] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CX took 39.2s. Estimated remaining: 4h 8m 4s. Rate: 7.2 symbols/min [2025-10-14T18:19:45.345551] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T18:19:45.439703] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:45.471280] [DEBUG] [LOCAL ] CXT: Loaded 30997 existing records from primary storage. [2025-10-14T18:19:45.471561] [INFO ] [MAIN ] CXT: Loaded 30997 existing records. [2025-10-14T18:19:45.562128] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-14T18:19:45.657827] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:19:45.658212] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-14T18:19:45.658338] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-14T18:19:45.658820] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-14T18:19:45.658942] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-14T18:19:45.788883] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T18:19:45.981149] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T18:19:46.058845] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:46.358135] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-14T18:19:47.158125] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-14T18:19:47.719238] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T18:19:47.958117] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-14T18:19:48.559082] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T18:19:48.763248] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-14T18:19:48.780176] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:19:49.285949] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-14T18:19:49.558120] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-14T18:19:50.303563] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T18:19:50.358114] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-14T18:19:51.158116] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-14T18:19:51.658373] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T18:19:51.891910] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T18:19:51.958069] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-14T18:19:52.758143] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-14T18:19:53.468319] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T18:19:53.555730] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T18:19:53.565100] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-14T18:19:54.238580] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T18:19:54.358080] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-14T18:19:54.810998] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T18:19:54.811800] [INFO ] [REMOTE ] CXH: Full fetch complete (5358 records). [2025-10-14T18:19:54.811866] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-14T18:19:55.165457] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-14T18:19:55.166722] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-14T18:19:55.166810] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-14T18:19:55.166964] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-14T18:19:55.167002] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-14T18:19:55.167367] [DEBUG] [LOCAL ] CXH: Trimmed 5358 records to 4435 (keeping 200 days of data) [2025-10-14T18:19:55.192963] [DEBUG] [LOCAL ] CXH: Primary data saved (4435 records). [2025-10-14T18:19:55.193070] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-14T18:19:55.193144] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CXH took 28.5s. Estimated remaining: 4h 8m 1s. Rate: 7.2 symbols/min [2025-10-14T18:19:55.365192] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:55.407047] [DEBUG] [LOCAL ] CXW: Loaded 43921 existing records from primary storage. [2025-10-14T18:19:55.407346] [INFO ] [MAIN ] CXW: Loaded 43921 existing records. [2025-10-14T18:19:55.601955] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:19:55.602158] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-14T18:19:55.602204] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-14T18:19:55.602589] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-14T18:19:55.602682] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-14T18:19:55.955322] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:55.958807] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-14T18:19:55.959798] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T18:19:55.960985] [INFO ] [REMOTE ] CXE: Full fetch complete (11485 records). [2025-10-14T18:19:55.961107] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-14T18:19:56.318941] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-14T18:19:56.319020] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-14T18:19:56.319286] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-14T18:19:56.319324] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-14T18:19:56.319816] [DEBUG] [LOCAL ] CXE: Trimmed 11485 records to 6134 (keeping 200 days of data) [2025-10-14T18:19:56.353965] [DEBUG] [LOCAL ] CXE: Primary data saved (6134 records). [2025-10-14T18:19:56.354043] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-14T18:19:56.354113] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXE took 34.8s. Estimated remaining: 4h 7m 31s. Rate: 7.2 symbols/min [2025-10-14T18:19:56.524882] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:19:56.525077] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-14T18:19:56.525127] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-14T18:19:56.525235] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-14T18:19:56.525276] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-14T18:19:56.525316] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-14T18:19:56.525350] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-14T18:19:56.763244] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-14T18:19:56.876488] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:19:57.558070] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-14T18:19:57.846293] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T18:19:58.244151] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T18:19:58.358070] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-14T18:19:58.777896] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T18:19:59.158087] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-14T18:19:59.753388] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T18:19:59.850402] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T18:19:59.958048] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-14T18:20:00.416404] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T18:20:00.758086] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-14T18:20:01.558079] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-14T18:20:02.358109] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-14T18:20:02.484577] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T18:20:02.555991] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T18:20:03.158078] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-14T18:20:03.958068] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-14T18:20:04.081928] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T18:20:04.617233] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T18:20:04.758096] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-14T18:20:05.186674] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T18:20:05.558122] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-14T18:20:06.121409] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T18:20:06.358082] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-14T18:20:06.574720] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:20:07.158092] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-14T18:20:07.890838] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T18:20:07.958041] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-14T18:20:08.204117] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T18:20:08.758066] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-14T18:20:09.528180] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T18:20:09.535981] [INFO ] [REMOTE ] CXM: Full fetch complete (68677 records). [2025-10-14T18:20:09.536150] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-14T18:20:09.570241] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-14T18:20:09.969796] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-14T18:20:09.969962] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-14T18:20:09.970846] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-14T18:20:09.970938] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-14T18:20:09.972492] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T18:20:09.980501] [DEBUG] [LOCAL ] CXM: Trimmed 68677 records to 47569 (keeping 200 days of data) [2025-10-14T18:20:10.273070] [DEBUG] [LOCAL ] CXM: Primary data saved (47569 records). [2025-10-14T18:20:10.273320] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-14T18:20:10.273409] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXM took 38.2s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-14T18:20:10.365601] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-14T18:20:10.471456] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:20:10.516003] [DEBUG] [LOCAL ] CYH: Loaded 47691 existing records from primary storage. [2025-10-14T18:20:10.516375] [INFO ] [MAIN ] CYH: Loaded 47691 existing records. [2025-10-14T18:20:10.692154] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:20:10.692419] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-14T18:20:10.692464] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-14T18:20:10.692925] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-14T18:20:10.692982] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-14T18:20:11.046683] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:20:11.085253] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T18:20:11.158070] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-14T18:20:11.958057] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-14T18:20:12.257163] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T18:20:12.649492] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T18:20:12.758077] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-14T18:20:12.791792] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T18:20:13.558106] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-14T18:20:14.358039] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-14T18:20:14.408702] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T18:20:14.857595] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T18:20:15.158086] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-14T18:20:15.805037] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T18:20:15.958074] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-14T18:20:16.074043] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T18:20:16.758093] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-14T18:20:17.558287] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-14T18:20:17.899523] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T18:20:18.341531] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T18:20:18.358040] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-14T18:20:18.446342] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T18:20:19.158093] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-14T18:20:19.661437] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T18:20:19.958113] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-14T18:20:20.726485] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T18:20:20.758072] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-14T18:20:21.355077] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T18:20:21.558091] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-14T18:20:22.358146] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-14T18:20:22.791862] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-14T18:20:23.158130] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-14T18:20:23.938942] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T18:20:23.958053] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-14T18:20:24.614684] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-14T18:20:24.618544] [INFO ] [REMOTE ] CXT: Full fetch complete (45592 records). [2025-10-14T18:20:24.618638] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-14T18:20:24.764943] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-14T18:20:25.021265] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-14T18:20:25.021361] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-14T18:20:25.022141] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-14T18:20:25.022219] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-14T18:20:25.023584] [DEBUG] [LOCAL ] CXT: Trimmed 45592 records to 31022 (keeping 200 days of data) [2025-10-14T18:20:25.055308] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T18:20:25.261088] [DEBUG] [LOCAL ] CXT: Primary data saved (31022 records). [2025-10-14T18:20:25.261300] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-14T18:20:25.261455] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CXT took 40.0s. Estimated remaining: 4h 7m 52s. Rate: 7.2 symbols/min [2025-10-14T18:20:25.458970] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:20:25.473210] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T18:20:25.532447] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-10-14T18:20:25.532779] [INFO ] [MAIN ] D: Loaded 53646 existing records. [2025-10-14T18:20:25.563615] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-14T18:20:25.730059] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:20:25.730328] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-14T18:20:25.730397] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-14T18:20:25.731003] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-14T18:20:25.731075] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-14T18:20:26.116535] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:20:26.143187] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T18:20:26.358102] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-14T18:20:26.862711] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T18:20:27.158064] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-14T18:20:27.958057] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-14T18:20:28.316351] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-14T18:20:28.442419] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T18:20:28.758123] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-14T18:20:28.902794] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T18:20:29.558078] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-14T18:20:30.358065] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-14T18:20:30.497311] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T18:20:31.041332] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T18:20:31.158036] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-14T18:20:31.958145] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-14T18:20:32.057736] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T18:20:32.710157] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T18:20:32.714840] [INFO ] [REMOTE ] CXW: Full fetch complete (64708 records). [2025-10-14T18:20:32.714981] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-14T18:20:32.715720] [FATAL] [VALIDATOR ] CXW: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:20:32.715816] [FATAL] [MAIN ] CXW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:20:32.715867] [WARN ] [MAIN ] CXW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:20:32.715914] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-14T18:20:32.715996] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-10-14T18:20:32.716050] [INFO ] [LOCAL ] CXW: Starting deletion of derivative data. [2025-10-14T18:20:32.716446] [DEBUG] [LOCAL ] CXW: Deleted derivative data file. [2025-10-14T18:20:32.716552] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CXW took 37.5s. Estimated remaining: 4h 7m 41s. Rate: 7.2 symbols/min [2025-10-14T18:20:32.763178] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-14T18:20:32.904132] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:20:32.917859] [DEBUG] [LOCAL ] DAC: Loaded 12609 existing records from primary storage. [2025-10-14T18:20:32.918132] [INFO ] [MAIN ] DAC: Loaded 12609 existing records. [2025-10-14T18:20:33.132260] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:20:33.133457] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T18:20:33.133707] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-14T18:20:33.136968] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-14T18:20:33.137684] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-14T18:20:33.137768] [INFO ] [REMOTE ] CYD: Full fetch complete (34838 records). [2025-10-14T18:20:33.137956] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-14T18:20:33.138050] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-14T18:20:33.568263] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-14T18:20:33.937740] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-14T18:20:33.935519] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:20:33.937850] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-14T18:20:33.938543] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-14T18:20:33.938633] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-14T18:20:33.940047] [DEBUG] [LOCAL ] CYD: Trimmed 34838 records to 26757 (keeping 200 days of data) [2025-10-14T18:20:34.104359] [DEBUG] [LOCAL ] CYD: Primary data saved (26757 records). [2025-10-14T18:20:34.104522] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-14T18:20:34.104603] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. CYD took 37.8s. Estimated remaining: 4h 7m 12s. Rate: 7.2 symbols/min [2025-10-14T18:20:34.282700] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:20:34.335477] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-14T18:20:34.335849] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-14T18:20:34.367580] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-14T18:20:34.519784] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:20:34.520195] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-14T18:20:34.520268] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-14T18:20:34.520759] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-14T18:20:34.520886] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-14T18:20:34.657673] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-14T18:20:34.990405] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:20:35.158082] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-14T18:20:35.389627] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T18:20:35.435932] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T18:20:35.958090] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-14T18:20:36.758056] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-14T18:20:36.856912] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T18:20:37.431683] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T18:20:37.485333] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T18:20:37.558081] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-14T18:20:38.358084] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-14T18:20:39.149501] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T18:20:39.155122] [INFO ] [REMOTE ] CYH: Full fetch complete (69902 records). [2025-10-14T18:20:39.155241] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-14T18:20:39.167344] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-14T18:20:39.490687] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T18:20:39.589819] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-14T18:20:39.589897] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-14T18:20:39.590767] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-14T18:20:39.590831] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-14T18:20:39.592215] [DEBUG] [LOCAL ] CYH: Trimmed 69902 records to 47721 (keeping 200 days of data) [2025-10-14T18:20:39.879988] [DEBUG] [LOCAL ] CYH: Primary data saved (47721 records). [2025-10-14T18:20:39.880152] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-14T18:20:39.880238] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. CYH took 29.6s. Estimated remaining: 4h 6m 56s. Rate: 7.2 symbols/min [2025-10-14T18:20:39.963188] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-14T18:20:40.054018] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:20:40.100529] [DEBUG] [LOCAL ] DAN: Loaded 49335 existing records from primary storage. [2025-10-14T18:20:40.100869] [INFO ] [MAIN ] DAN: Loaded 49335 existing records. [2025-10-14T18:20:40.274897] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:20:40.275099] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-14T18:20:40.275145] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-14T18:20:40.275383] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-14T18:20:40.275440] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-14T18:20:40.625698] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:20:40.758062] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-14T18:20:40.956326] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T18:20:41.148822] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-14T18:20:41.558099] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-14T18:20:42.358053] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-14T18:20:42.582789] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T18:20:43.168337] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-14T18:20:43.174449] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T18:20:43.382075] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:20:43.958081] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-14T18:20:44.554038] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T18:20:44.622953] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T18:20:44.758201] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-14T18:20:45.558098] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-14T18:20:46.358098] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-14T18:20:46.396383] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T18:20:47.158110] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-14T18:20:47.489733] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-14T18:20:47.533586] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T18:20:47.958073] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-14T18:20:48.513077] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T18:20:48.758067] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-14T18:20:48.827739] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T18:20:49.558095] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-14T18:20:50.358108] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-14T18:20:50.410028] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T18:20:50.716637] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T18:20:51.158108] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-14T18:20:51.958114] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-14T18:20:52.051948] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:20:52.758079] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-14T18:20:53.278917] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T18:20:53.496292] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T18:20:53.558095] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-14T18:20:53.638279] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-14T18:20:54.182193] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T18:20:54.183941] [INFO ] [REMOTE ] DAC: Full fetch complete (19231 records). [2025-10-14T18:20:54.184013] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-14T18:20:54.184445] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:20:54.184531] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:20:54.184573] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:20:54.184610] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-14T18:20:54.184700] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-14T18:20:54.184777] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-10-14T18:20:54.184974] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-10-14T18:20:54.185061] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. DAC took 21.5s. Estimated remaining: 4h 7m 6s. Rate: 7.2 symbols/min [2025-10-14T18:20:54.356953] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:20:54.357146] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-14T18:20:54.357185] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-14T18:20:54.357298] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-14T18:20:54.357339] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-14T18:20:54.357381] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-14T18:20:54.357417] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-14T18:20:54.368298] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-14T18:20:54.716917] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:20:55.158082] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-14T18:20:55.958108] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-14T18:20:56.598543] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T18:20:56.697787] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-14T18:20:56.758074] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-14T18:20:57.558109] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-14T18:20:57.896882] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T18:20:58.358073] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-14T18:20:58.494106] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T18:20:58.734140] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T18:20:59.158071] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-14T18:20:59.731846] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T18:20:59.958076] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-14T18:21:00.287472] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T18:21:00.758090] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-14T18:21:01.558076] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-14T18:21:02.348585] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-14T18:21:02.360504] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-14T18:21:02.419605] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T18:21:02.988219] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T18:21:03.158081] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-14T18:21:03.385615] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T18:21:03.958082] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-14T18:21:04.391061] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-14T18:21:04.758065] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-14T18:21:05.558080] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-14T18:21:06.082702] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T18:21:06.358058] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-14T18:21:07.008155] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T18:21:07.163191] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-14T18:21:07.178456] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-14T18:21:07.958053] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-14T18:21:08.064416] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T18:21:08.093541] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T18:21:08.758100] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-14T18:21:09.558097] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-14T18:21:10.060835] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-14T18:21:10.358057] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-14T18:21:10.451618] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T18:21:10.890267] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T18:21:10.897144] [INFO ] [REMOTE ] DAN: Full fetch complete (70760 records). [2025-10-14T18:21:10.897337] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-14T18:21:10.898266] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:21:10.898391] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:21:10.898446] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:21:10.898500] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-14T18:21:10.898569] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-14T18:21:10.898612] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-14T18:21:10.898897] [DEBUG] [LOCAL ] DAN: Deleted derivative data file. [2025-10-14T18:21:10.899014] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. DAN took 31.0s. Estimated remaining: 4h 7m 23s. Rate: 7.2 symbols/min [2025-10-14T18:21:11.146556] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:11.164561] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-14T18:21:11.166514] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T18:21:11.174937] [INFO ] [REMOTE ] DAL: Full fetch complete (77538 records). [2025-10-14T18:21:11.175135] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-14T18:21:11.176859] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:21:11.177158] [FATAL] [MAIN ] DAL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:21:11.177222] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:21:11.177290] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-14T18:21:11.177368] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-14T18:21:11.177432] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-10-14T18:21:11.177682] [DEBUG] [LOCAL ] DAL: Deleted derivative data file. [2025-10-14T18:21:11.177825] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAL took 37.1s. Estimated remaining: 4h 6m 50s. Rate: 7.2 symbols/min [2025-10-14T18:21:11.455448] [DEBUG] [LOCAL ] DAR: Loaded 51978 existing records from primary storage. [2025-10-14T18:21:11.483451] [INFO ] [MAIN ] DAR: Loaded 51978 existing records. [2025-10-14T18:21:11.483297] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:11.681238] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:21:11.681478] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-14T18:21:11.681764] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-14T18:21:11.694090] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-14T18:21:11.694274] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-14T18:21:11.845311] [DEBUG] [LOCAL ] DAVA: Loaded 41698 existing records from primary storage. [2025-10-14T18:21:11.856399] [INFO ] [MAIN ] DAVA: Loaded 41698 existing records. [2025-10-14T18:21:11.966121] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-14T18:21:12.222543] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:21:12.257488] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-14T18:21:12.262749] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-14T18:21:12.257385] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T18:21:12.320189] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-14T18:21:12.326557] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:12.326949] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-14T18:21:12.696312] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:12.758084] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-14T18:21:13.558087] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-14T18:21:13.837114] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T18:21:14.242316] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T18:21:14.358119] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-14T18:21:15.158075] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-14T18:21:15.560050] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T18:21:15.637821] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T18:21:15.645488] [INFO ] [REMOTE ] D: Full fetch complete (77807 records). [2025-10-14T18:21:15.645770] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-14T18:21:15.961481] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-14T18:21:16.069149] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-14T18:21:16.069254] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-14T18:21:16.070263] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-14T18:21:16.070406] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-14T18:21:16.071902] [DEBUG] [LOCAL ] D: Trimmed 77807 records to 53647 (keeping 200 days of data) [2025-10-14T18:21:16.321614] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T18:21:16.445920] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-10-14T18:21:16.446061] [INFO ] [MAIN ] D: Full history saved. [2025-10-14T18:21:16.446160] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. D took 51.2s. Estimated remaining: 4h 6m 33s. Rate: 7.2 symbols/min [2025-10-14T18:21:16.622844] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:16.634329] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T18:21:16.678330] [DEBUG] [LOCAL ] DAY: Loaded 49187 existing records from primary storage. [2025-10-14T18:21:16.678676] [INFO ] [MAIN ] DAY: Loaded 49187 existing records. [2025-10-14T18:21:16.763161] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-14T18:21:16.863891] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:21:16.864124] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-14T18:21:16.864171] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-14T18:21:16.864525] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-14T18:21:16.864582] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-14T18:21:17.226909] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:17.558097] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-14T18:21:18.054227] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T18:21:18.358062] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-14T18:21:19.159291] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T18:21:19.159383] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-14T18:21:19.206126] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T18:21:19.958090] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-14T18:21:20.758103] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-14T18:21:21.055981] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T18:21:21.284074] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T18:21:21.558092] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-14T18:21:22.071788] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T18:21:22.358106] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-14T18:21:23.158126] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-14T18:21:23.251080] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:21:23.666865] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T18:21:23.958064] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-14T18:21:24.053380] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T18:21:24.758074] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-14T18:21:25.477251] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T18:21:25.558050] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-14T18:21:25.587125] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T18:21:26.358117] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-14T18:21:26.977592] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T18:21:27.158067] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-14T18:21:27.831028] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T18:21:27.958127] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-14T18:21:28.384367] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T18:21:28.758121] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-14T18:21:29.563191] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-14T18:21:29.575901] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T18:21:29.823496] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T18:21:30.358081] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-14T18:21:31.158062] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-14T18:21:31.425017] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T18:21:31.958066] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-14T18:21:32.078631] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T18:21:32.144224] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T18:21:32.147002] [INFO ] [REMOTE ] DAO: Full fetch complete (32309 records). [2025-10-14T18:21:32.147087] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-14T18:21:32.554258] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-14T18:21:32.554346] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-14T18:21:32.554984] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-14T18:21:32.555049] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-14T18:21:32.555935] [DEBUG] [LOCAL ] DAO: Trimmed 32309 records to 19845 (keeping 200 days of data) [2025-10-14T18:21:32.678051] [DEBUG] [LOCAL ] DAO: Primary data saved (19845 records). [2025-10-14T18:21:32.678255] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-14T18:21:32.678367] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAO took 38.5s. Estimated remaining: 4h 6m 48s. Rate: 7.2 symbols/min [2025-10-14T18:21:32.765247] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-14T18:21:32.873448] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:32.924932] [DEBUG] [LOCAL ] DB: Loaded 52505 existing records from primary storage. [2025-10-14T18:21:32.925282] [INFO ] [MAIN ] DB: Loaded 52505 existing records. [2025-10-14T18:21:33.104090] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:21:33.104303] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-14T18:21:33.104351] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-14T18:21:33.104832] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-14T18:21:33.104889] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-14T18:21:33.467768] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:33.510217] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T18:21:33.558068] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-14T18:21:33.784770] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T18:21:34.358088] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-14T18:21:35.158061] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-14T18:21:35.322829] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T18:21:35.958072] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-14T18:21:36.091769] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T18:21:36.538154] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T18:21:36.758123] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-14T18:21:37.199211] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T18:21:37.558082] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-14T18:21:38.161091] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T18:21:38.358151] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-14T18:21:39.136704] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:21:39.158031] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-14T18:21:39.531622] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T18:21:39.958094] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-14T18:21:40.523717] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T18:21:40.758085] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-14T18:21:41.558084] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-14T18:21:41.724895] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T18:21:42.274582] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T18:21:42.358108] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-14T18:21:43.158135] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-14T18:21:43.437283] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-14T18:21:43.445726] [INFO ] [REMOTE ] DAR: Full fetch complete (74856 records). [2025-10-14T18:21:43.445886] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-14T18:21:43.838500] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-14T18:21:43.838796] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-14T18:21:43.839686] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-14T18:21:43.839780] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-14T18:21:43.841769] [DEBUG] [LOCAL ] DAR: Trimmed 74856 records to 51977 (keeping 200 days of data) [2025-10-14T18:21:43.867537] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T18:21:43.958441] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-14T18:21:44.174740] [DEBUG] [LOCAL ] DAR: Primary data saved (51977 records). [2025-10-14T18:21:44.174899] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-14T18:21:44.174981] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 33.3s. Estimated remaining: 4h 6m 50s. Rate: 7.2 symbols/min [2025-10-14T18:21:44.340785] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:44.340962] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-14T18:21:44.341000] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-14T18:21:44.341107] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-14T18:21:44.341147] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-14T18:21:44.341186] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-14T18:21:44.341218] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-14T18:21:44.716704] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:44.758048] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-14T18:21:44.921407] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T18:21:45.455863] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T18:21:45.558083] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-14T18:21:45.606354] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T18:21:46.105850] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T18:21:46.358130] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-14T18:21:47.158077] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-14T18:21:47.566339] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T18:21:47.958082] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-14T18:21:48.758058] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-14T18:21:48.859983] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T18:21:48.865424] [INFO ] [REMOTE ] DAVA: Full fetch complete (56848 records). [2025-10-14T18:21:48.865537] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-14T18:21:49.255727] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-14T18:21:49.255808] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-14T18:21:49.256510] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-14T18:21:49.256552] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-14T18:21:49.257687] [DEBUG] [LOCAL ] DAVA: Trimmed 56848 records to 41776 (keeping 200 days of data) [2025-10-14T18:21:49.499976] [DEBUG] [LOCAL ] DAVA: Primary data saved (41776 records). [2025-10-14T18:21:49.500099] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-14T18:21:49.500172] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAVA took 38.3s. Estimated remaining: 4h 6m 32s. Rate: 7.2 symbols/min [2025-10-14T18:21:49.563826] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-14T18:21:49.707129] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:49.750616] [DEBUG] [LOCAL ] DBI: Loaded 44091 existing records from primary storage. [2025-10-14T18:21:49.751021] [INFO ] [MAIN ] DBI: Loaded 44091 existing records. [2025-10-14T18:21:49.934833] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:21:49.935497] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-14T18:21:49.935951] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-14T18:21:49.964727] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-14T18:21:49.968096] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-14T18:21:49.981938] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T18:21:50.304932] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T18:21:50.365133] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-14T18:21:50.395484] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:50.612247] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T18:21:51.158128] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-14T18:21:51.958077] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-14T18:21:52.516982] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-14T18:21:52.758061] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-14T18:21:53.083027] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T18:21:53.156969] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-14T18:21:53.162886] [INFO ] [REMOTE ] DAY: Full fetch complete (71348 records). [2025-10-14T18:21:53.163043] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-14T18:21:53.163966] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:21:53.164082] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:21:53.164125] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:21:53.164165] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-14T18:21:53.164220] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-14T18:21:53.164255] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-14T18:21:53.164494] [DEBUG] [LOCAL ] DAY: Deleted derivative data file. [2025-10-14T18:21:53.164591] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DAY took 36.7s. Estimated remaining: 4h 6m 10s. Rate: 7.2 symbols/min [2025-10-14T18:21:53.334577] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:21:53.345979] [DEBUG] [LOCAL ] DBL: Loaded 9289 existing records from primary storage. [2025-10-14T18:21:53.346173] [INFO ] [MAIN ] DBL: Loaded 9289 existing records. [2025-10-14T18:21:53.521817] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:21:53.522063] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-14T18:21:53.522111] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-14T18:21:53.522326] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-14T18:21:53.522383] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-14T18:21:53.564816] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-14T18:21:53.909112] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:21:54.358090] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-14T18:21:54.514452] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T18:21:54.722712] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T18:21:54.920526] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T18:21:55.158088] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-14T18:21:55.958055] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-14T18:21:56.024958] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T18:21:56.758174] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-14T18:21:57.537823] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T18:21:57.558038] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-14T18:21:58.358100] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-14T18:21:58.403728] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:21:59.015292] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T18:21:59.073887] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T18:21:59.158092] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-14T18:21:59.958069] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-14T18:22:00.758122] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-14T18:22:00.940757] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:22:01.558104] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-14T18:22:01.610465] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T18:22:02.003736] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-14T18:22:02.308167] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T18:22:02.358113] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-14T18:22:03.158082] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-14T18:22:03.958072] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-14T18:22:04.089851] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T18:22:04.267225] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T18:22:04.758132] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-14T18:22:05.465363] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T18:22:05.558094] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-14T18:22:06.150979] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T18:22:06.358179] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-14T18:22:06.724132] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T18:22:06.838483] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T18:22:07.158158] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-14T18:22:07.928535] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T18:22:07.958118] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-14T18:22:08.758095] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-14T18:22:09.444631] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T18:22:09.558092] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-14T18:22:09.855286] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T18:22:09.971348] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-14T18:22:10.358075] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-14T18:22:11.158157] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-14T18:22:11.958085] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-14T18:22:12.000419] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:22:12.050269] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T18:22:12.053240] [INFO ] [REMOTE ] DBD: Full fetch complete (31374 records). [2025-10-14T18:22:12.053342] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-14T18:22:12.053846] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:22:12.053934] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:22:12.053976] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:22:12.054046] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-14T18:22:12.054107] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-14T18:22:12.054142] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-14T18:22:12.054182] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-14T18:22:12.054236] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBD took 27.9s. Estimated remaining: 4h 6m 33s. Rate: 7.2 symbols/min [2025-10-14T18:22:12.220954] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:22:12.268802] [DEBUG] [LOCAL ] DBRG: Loaded 49849 existing records from primary storage. [2025-10-14T18:22:12.269097] [INFO ] [MAIN ] DBRG: Loaded 49849 existing records. [2025-10-14T18:22:12.450091] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:22:12.450440] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-14T18:22:12.450506] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-14T18:22:12.450998] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-14T18:22:12.451056] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-14T18:22:12.758566] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-14T18:22:12.768783] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T18:22:12.860269] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:22:13.558087] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-14T18:22:14.358096] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-14T18:22:14.546137] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-14T18:22:14.552198] [INFO ] [REMOTE ] DB: Full fetch complete (75171 records). [2025-10-14T18:22:14.552356] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-14T18:22:14.948499] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-14T18:22:14.948637] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-14T18:22:14.949667] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-14T18:22:14.949808] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-14T18:22:14.959044] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T18:22:14.963621] [DEBUG] [LOCAL ] DB: Trimmed 75171 records to 52500 (keeping 200 days of data) [2025-10-14T18:22:15.091491] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T18:22:15.168155] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-14T18:22:15.309576] [DEBUG] [LOCAL ] DB: Primary data saved (52500 records). [2025-10-14T18:22:15.309730] [INFO ] [MAIN ] DB: Full history saved. [2025-10-14T18:22:15.309816] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 42.6s. Estimated remaining: 4h 6m 10s. Rate: 7.2 symbols/min [2025-10-14T18:22:15.475344] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:22:15.512537] [DEBUG] [LOCAL ] DCI: Loaded 37041 existing records from primary storage. [2025-10-14T18:22:15.512862] [INFO ] [MAIN ] DCI: Loaded 37041 existing records. [2025-10-14T18:22:15.693387] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:22:15.693631] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-14T18:22:15.693711] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-14T18:22:15.694092] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-14T18:22:15.694151] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-14T18:22:15.963288] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-14T18:22:16.064783] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:22:16.758100] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-14T18:22:16.906209] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:22:17.339876] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T18:22:17.558076] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-14T18:22:18.309402] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T18:22:18.358102] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-14T18:22:18.863614] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T18:22:19.158087] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-14T18:22:19.449767] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T18:22:19.958120] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-14T18:22:20.758099] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-14T18:22:21.018803] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T18:22:21.558105] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-14T18:22:21.634830] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T18:22:21.799786] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T18:22:22.358070] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-14T18:22:22.618318] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T18:22:23.158193] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-14T18:22:23.797273] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T18:22:23.802108] [INFO ] [REMOTE ] DBI: Full fetch complete (65108 records). [2025-10-14T18:22:23.802251] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-14T18:22:23.803061] [FATAL] [VALIDATOR ] DBI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:22:23.803173] [FATAL] [MAIN ] DBI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:22:23.803216] [WARN ] [MAIN ] DBI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:22:23.803256] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-14T18:22:23.803360] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-14T18:22:23.803403] [INFO ] [LOCAL ] DBI: Starting deletion of derivative data. [2025-10-14T18:22:23.803702] [DEBUG] [LOCAL ] DBI: Deleted derivative data file. [2025-10-14T18:22:23.803797] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBI took 34.3s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-14T18:22:23.971846] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-14T18:22:23.975166] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:22:23.991353] [DEBUG] [LOCAL ] DCO: Loaded 14327 existing records from primary storage. [2025-10-14T18:22:23.991600] [INFO ] [MAIN ] DCO: Loaded 14327 existing records. [2025-10-14T18:22:24.170317] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:22:24.170700] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-14T18:22:24.170757] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-14T18:22:24.170976] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-14T18:22:24.171014] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-14T18:22:24.557137] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:22:24.565925] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T18:22:24.594564] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T18:22:24.758080] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-14T18:22:25.558110] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-14T18:22:26.358124] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-14T18:22:26.567821] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T18:22:26.604669] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T18:22:27.158080] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-14T18:22:27.271109] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T18:22:27.272475] [INFO ] [REMOTE ] DBL: Full fetch complete (12599 records). [2025-10-14T18:22:27.272546] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-14T18:22:27.656321] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-14T18:22:27.656425] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-14T18:22:27.656915] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-14T18:22:27.657096] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-14T18:22:27.657631] [DEBUG] [LOCAL ] DBL: Trimmed 12599 records to 9380 (keeping 200 days of data) [2025-10-14T18:22:27.715252] [DEBUG] [LOCAL ] DBL: Primary data saved (9380 records). [2025-10-14T18:22:27.715478] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-14T18:22:27.724455] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DBL took 34.6s. Estimated remaining: 4h 5m 41s. Rate: 7.2 symbols/min [2025-10-14T18:22:27.785524] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T18:22:27.909530] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:22:27.957414] [DEBUG] [LOCAL ] DD: Loaded 52897 existing records from primary storage. [2025-10-14T18:22:27.957740] [INFO ] [MAIN ] DD: Loaded 52897 existing records. [2025-10-14T18:22:27.963241] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-14T18:22:28.153296] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:22:28.153521] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-14T18:22:28.153569] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-14T18:22:28.153992] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-14T18:22:28.154051] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-14T18:22:28.521144] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:22:28.758063] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-14T18:22:29.558076] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-14T18:22:29.656584] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:22:30.075413] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T18:22:30.358091] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-14T18:22:30.670006] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T18:22:31.158077] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-14T18:22:31.958163] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-14T18:22:32.104621] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T18:22:32.578878] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T18:22:32.758139] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-14T18:22:32.984235] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T18:22:33.246708] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T18:22:33.558089] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-14T18:22:34.358060] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-14T18:22:34.969472] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T18:22:35.158077] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-14T18:22:35.280560] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T18:22:35.958132] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-14T18:22:36.758053] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-14T18:22:37.094670] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-14T18:22:37.141553] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T18:22:37.558120] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-14T18:22:38.358046] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-14T18:22:38.529269] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T18:22:38.929743] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:22:39.158089] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-14T18:22:39.958075] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-14T18:22:40.098891] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T18:22:40.758114] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-14T18:22:40.979790] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T18:22:41.401539] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-14T18:22:41.558096] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-14T18:22:42.253909] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T18:22:42.358091] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-14T18:22:43.158094] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-14T18:22:43.209023] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T18:22:43.819224] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T18:22:43.851585] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T18:22:43.958079] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-14T18:22:44.697072] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T18:22:44.758074] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-14T18:22:45.558062] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-14T18:22:45.799364] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T18:22:46.358075] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-14T18:22:47.051227] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T18:22:47.158032] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-14T18:22:47.904026] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T18:22:47.958038] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-14T18:22:48.758069] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-14T18:22:48.897406] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T18:22:48.903243] [INFO ] [REMOTE ] DBRG: Full fetch complete (72458 records). [2025-10-14T18:22:48.903372] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-14T18:22:49.371696] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T18:22:49.372164] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-14T18:22:49.372334] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-14T18:22:49.382115] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-14T18:22:49.382399] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-14T18:22:49.384419] [DEBUG] [LOCAL ] DBRG: Trimmed 72458 records to 49878 (keeping 200 days of data) [2025-10-14T18:22:49.576706] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-14T18:22:49.715348] [DEBUG] [LOCAL ] DBRG: Primary data saved (49878 records). [2025-10-14T18:22:49.715601] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-14T18:22:49.715732] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DBRG took 37.7s. Estimated remaining: 4h 6m 13s. Rate: 7.2 symbols/min [2025-10-14T18:22:49.921598] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:22:49.932764] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T18:22:49.982840] [DEBUG] [LOCAL ] DDD: Loaded 50954 existing records from primary storage. [2025-10-14T18:22:49.983140] [INFO ] [MAIN ] DDD: Loaded 50954 existing records. [2025-10-14T18:22:50.169347] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:22:50.169609] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-14T18:22:50.169684] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-14T18:22:50.170163] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-14T18:22:50.170219] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-14T18:22:50.367366] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-14T18:22:50.530999] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:22:51.102755] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T18:22:51.158034] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-14T18:22:51.814270] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T18:22:51.818281] [INFO ] [REMOTE ] DCI: Full fetch complete (53699 records). [2025-10-14T18:22:51.818365] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-14T18:22:51.963362] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-14T18:22:52.210548] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-14T18:22:52.210672] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-14T18:22:52.211373] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-14T18:22:52.211433] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-14T18:22:52.212502] [DEBUG] [LOCAL ] DCI: Trimmed 53699 records to 37060 (keeping 200 days of data) [2025-10-14T18:22:52.446025] [DEBUG] [LOCAL ] DCI: Primary data saved (37060 records). [2025-10-14T18:22:52.446164] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-14T18:22:52.446270] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DCI took 37.1s. Estimated remaining: 4h 5m 48s. Rate: 7.2 symbols/min [2025-10-14T18:22:52.758143] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-14T18:23:05.756201] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (13.79 seconds). [2025-10-14T18:23:05.768195] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-14T18:23:06.368040] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (13.61 seconds). [2025-10-14T18:23:06.371515] [INFO ] [REMOTE ] DCO: Full fetch complete (19223 records). [2025-10-14T18:23:06.371857] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-14T18:23:06.372508] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:23:06.372635] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:23:06.372760] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:23:06.372851] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-14T18:23:06.372940] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-14T18:23:06.372998] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-14T18:23:06.373458] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-14T18:23:06.373565] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DCO took 42.6s. Estimated remaining: 4h 5m 56s. Rate: 7.2 symbols/min [2025-10-14T18:23:07.700605] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (16.54 seconds). [2025-10-14T18:23:07.711293] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-14T18:23:08.386992] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-14T18:23:08.398403] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-14T18:23:09.207505] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T18:23:09.217703] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-14T18:23:10.362263] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-14T18:23:10.368487] [INFO ] [REMOTE ] DD: Full fetch complete (76169 records). [2025-10-14T18:23:10.368730] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-14T18:23:10.369666] [FATAL] [VALIDATOR ] DD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:23:10.369763] [FATAL] [MAIN ] DD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:23:10.369808] [WARN ] [MAIN ] DD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:23:10.369850] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-14T18:23:10.369913] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-14T18:23:10.369997] [INFO ] [LOCAL ] DD: Starting deletion of derivative data. [2025-10-14T18:23:10.370277] [DEBUG] [LOCAL ] DD: Deleted derivative data file. [2025-10-14T18:23:10.370395] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DD took 42.6s. Estimated remaining: 4h 5m 35s. Rate: 7.2 symbols/min [2025-10-14T18:23:11.313502] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-14T18:23:11.323145] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-14T18:23:12.862922] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T18:23:12.874609] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-14T18:23:14.678196] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T18:23:14.688864] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-14T18:23:16.127997] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T18:23:16.140453] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-14T18:23:18.072215] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T18:23:18.083484] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-14T18:23:19.984089] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T18:23:19.995211] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-14T18:23:21.809048] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T18:23:21.820460] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-14T18:23:23.623871] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-14T18:23:23.635477] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-14T18:23:25.463305] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-14T18:23:25.468729] [INFO ] [REMOTE ] DDD: Full fetch complete (73513 records). [2025-10-14T18:23:25.468842] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-14T18:23:25.469525] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:23:25.469608] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:23:25.469682] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:23:25.469738] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-14T18:23:25.469795] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-14T18:23:25.469830] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-10-14T18:23:25.470018] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-10-14T18:23:25.470116] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 35.8s. Estimated remaining: 4h 5m 47s. Rate: 7.2 symbols/min [2025-10-14T18:23:26.206201] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:26.204636] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:26.259797] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:26.239517] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:26.264509] [DEBUG] [LOCAL ] DDT: Loaded 2104 existing records from primary storage. [2025-10-14T18:23:26.264948] [INFO ] [MAIN ] DDT: Loaded 2104 existing records. [2025-10-14T18:23:26.401933] [DEBUG] [LOCAL ] DDS: Loaded 12758 existing records from primary storage. [2025-10-14T18:23:26.419251] [INFO ] [MAIN ] DDS: Loaded 12758 existing records. [2025-10-14T18:23:26.596897] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:26.562351] [DEBUG] [LOCAL ] DDL: Loaded 36862 existing records from primary storage. [2025-10-14T18:23:26.611670] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-14T18:23:26.616965] [INFO ] [MAIN ] DDL: Loaded 36862 existing records. [2025-10-14T18:23:26.617063] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-14T18:23:26.732841] [DEBUG] [LOCAL ] DE: Loaded 47658 existing records from primary storage. [2025-10-14T18:23:26.743388] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-14T18:23:26.764805] [INFO ] [MAIN ] DE: Loaded 47658 existing records. [2025-10-14T18:23:26.818772] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-14T18:23:27.071294] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:27.074133] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:27.126867] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-14T18:23:27.158686] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-14T18:23:27.159027] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-14T18:23:27.169859] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-14T18:23:27.205992] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-14T18:23:27.252753] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-14T18:23:27.379567] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:27.410392] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-14T18:23:27.432321] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-14T18:23:27.392953] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-14T18:23:27.467426] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-14T18:23:27.487950] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-14T18:23:27.554525] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-14T18:23:27.957620] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:28.017962] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-14T18:23:28.480759] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:28.502748] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-14T18:23:28.606896] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:28.628012] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-14T18:23:28.651522] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:28.651873] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-14T18:23:28.821089] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T18:23:28.822597] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-14T18:23:29.341684] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-14T18:23:29.342794] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-14T18:23:29.718399] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T18:23:29.719477] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-14T18:23:29.776297] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T18:23:29.779783] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-14T18:23:30.121724] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T18:23:30.131216] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-14T18:23:30.162224] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T18:23:30.163378] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-14T18:23:30.207376] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T18:23:30.217196] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-14T18:23:30.703856] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T18:23:30.708959] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-14T18:23:30.765986] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-14T18:23:30.767502] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-14T18:23:31.048519] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T18:23:31.056004] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-14T18:23:31.071542] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-14T18:23:31.072788] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-14T18:23:31.310241] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T18:23:31.313633] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-14T18:23:31.609619] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-14T18:23:31.610785] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-14T18:23:31.826667] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T18:23:31.836372] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-14T18:23:31.949003] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-14T18:23:31.950283] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-14T18:23:32.124306] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T18:23:32.132903] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-14T18:23:32.189847] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T18:23:32.193713] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-14T18:23:32.228083] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-14T18:23:32.229604] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-14T18:23:32.717216] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T18:23:32.718337] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-14T18:23:33.080199] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-14T18:23:33.080975] [INFO ] [REMOTE ] DDT: Full fetch complete (2837 records). [2025-10-14T18:23:33.081041] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-14T18:23:33.404762] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T18:23:33.487031] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-14T18:23:33.514048] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T18:23:33.522723] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-14T18:23:33.532349] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-14T18:23:33.533468] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-14T18:23:33.534297] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-14T18:23:33.534385] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-14T18:23:33.535235] [DEBUG] [LOCAL ] DDT: Trimmed 2837 records to 2089 (keeping 200 days of data) [2025-10-14T18:23:33.549324] [DEBUG] [LOCAL ] DDT: Primary data saved (2089 records). [2025-10-14T18:23:33.549590] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-14T18:23:33.549742] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 8.1s. Estimated remaining: 4h 5m 38s. Rate: 7.2 symbols/min [2025-10-14T18:23:33.710587] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T18:23:33.764708] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-14T18:23:33.783872] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:33.829897] [DEBUG] [LOCAL ] DEA: Loaded 40492 existing records from primary storage. [2025-10-14T18:23:33.830244] [INFO ] [MAIN ] DEA: Loaded 40492 existing records. [2025-10-14T18:23:34.014993] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:34.015239] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-14T18:23:34.015288] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-14T18:23:34.015960] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-14T18:23:34.016020] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-14T18:23:34.393562] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:34.393958] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-14T18:23:34.483191] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T18:23:34.487624] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-14T18:23:34.813446] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T18:23:34.824228] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-14T18:23:35.477858] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T18:23:35.481033] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-14T18:23:35.596014] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T18:23:35.606458] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-14T18:23:36.087216] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T18:23:36.090786] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-14T18:23:36.277103] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T18:23:36.286956] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-14T18:23:36.342045] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T18:23:36.352773] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-14T18:23:36.761791] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:23:36.766031] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-14T18:23:37.145898] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T18:23:37.156200] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-14T18:23:37.507495] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T18:23:37.515386] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-14T18:23:37.526592] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T18:23:37.530439] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-14T18:23:37.712389] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T18:23:37.721570] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-14T18:23:38.263231] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T18:23:38.264778] [INFO ] [REMOTE ] DDS: Full fetch complete (18651 records). [2025-10-14T18:23:38.264848] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-14T18:23:38.265259] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:23:38.265341] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:23:38.265381] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:23:38.265418] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-14T18:23:38.265469] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-14T18:23:38.265502] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-14T18:23:38.265697] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-10-14T18:23:38.265789] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDS took 12.8s. Estimated remaining: 4h 5m 19s. Rate: 7.2 symbols/min [2025-10-14T18:23:38.436496] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:38.466191] [DEBUG] [LOCAL ] DEC: Loaded 30365 existing records from primary storage. [2025-10-14T18:23:38.466452] [INFO ] [MAIN ] DEC: Loaded 30365 existing records. [2025-10-14T18:23:38.651229] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:38.651513] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-14T18:23:38.651563] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-14T18:23:38.652165] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-14T18:23:38.652222] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-14T18:23:39.047448] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T18:23:39.050568] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:39.057836] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-14T18:23:39.059252] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-14T18:23:39.461752] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-14T18:23:39.471980] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-14T18:23:39.637828] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T18:23:39.647211] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-14T18:23:39.915181] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T18:23:39.920315] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-14T18:23:40.367919] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T18:23:40.374429] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-14T18:23:40.958687] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T18:23:40.968672] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-14T18:23:41.005324] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T18:23:41.015302] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-14T18:23:41.069299] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T18:23:41.074443] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-14T18:23:41.541968] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T18:23:41.558019] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-14T18:23:42.232820] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T18:23:42.358079] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-14T18:23:42.630476] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T18:23:42.682865] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T18:23:42.687749] [INFO ] [REMOTE ] DDL: Full fetch complete (53444 records). [2025-10-14T18:23:42.687875] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-14T18:23:43.063354] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-14T18:23:43.063447] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-14T18:23:43.064331] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-14T18:23:43.064540] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-14T18:23:43.092565] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-14T18:23:43.091408] [DEBUG] [LOCAL ] DDL: Trimmed 53444 records to 36889 (keeping 200 days of data) [2025-10-14T18:23:43.186191] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-14T18:23:43.308418] [DEBUG] [LOCAL ] DDL: Primary data saved (36889 records). [2025-10-14T18:23:43.308547] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-14T18:23:43.308633] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DDL took 17.8s. Estimated remaining: 4h 5m 1s. Rate: 7.2 symbols/min [2025-10-14T18:23:43.477362] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:43.526213] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-10-14T18:23:43.526550] [INFO ] [MAIN ] DECK: Loaded 53297 existing records. [2025-10-14T18:23:43.708305] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:43.708677] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-14T18:23:43.708750] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-14T18:23:43.720029] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-14T18:23:43.739381] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-14T18:23:43.818043] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T18:23:43.963239] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-14T18:23:44.113074] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:44.758090] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-14T18:23:45.054111] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T18:23:45.501633] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T18:23:45.558073] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-14T18:23:45.803801] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T18:23:46.358096] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-14T18:23:46.663895] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T18:23:47.158072] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-14T18:23:47.958096] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-14T18:23:48.268669] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T18:23:48.676009] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T18:23:48.763220] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-14T18:23:48.771522] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T18:23:49.558114] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-14T18:23:50.358077] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-14T18:23:50.622608] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T18:23:50.692758] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T18:23:51.158065] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-14T18:23:51.431576] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T18:23:51.958063] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-14T18:23:52.758040] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-14T18:23:53.273413] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-14T18:23:53.319524] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T18:23:53.558043] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-14T18:23:53.719067] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-14T18:23:54.358075] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-14T18:23:55.158036] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-14T18:23:55.208154] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:23:55.958065] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-14T18:23:56.341124] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T18:23:56.613070] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T18:23:56.617715] [INFO ] [REMOTE ] DEA: Full fetch complete (62097 records). [2025-10-14T18:23:56.617818] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-14T18:23:56.764277] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-14T18:23:57.038720] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T18:23:57.047046] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-14T18:23:57.047626] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-14T18:23:57.048761] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-14T18:23:57.049207] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-14T18:23:57.050481] [DEBUG] [LOCAL ] DEA: Trimmed 62097 records to 40455 (keeping 200 days of data) [2025-10-14T18:23:57.294232] [DEBUG] [LOCAL ] DEA: Primary data saved (40455 records). [2025-10-14T18:23:57.294353] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-14T18:23:57.294424] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DEA took 23.7s. Estimated remaining: 4h 5m 9s. Rate: 7.2 symbols/min [2025-10-14T18:23:57.467826] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:23:57.510837] [DEBUG] [LOCAL ] DEI: Loaded 48334 existing records from primary storage. [2025-10-14T18:23:57.511159] [INFO ] [MAIN ] DEI: Loaded 48334 existing records. [2025-10-14T18:23:57.567034] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-14T18:23:57.694243] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:23:57.694489] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-14T18:23:57.694540] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-14T18:23:57.695633] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-14T18:23:57.695729] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-14T18:23:58.049859] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:23:58.358122] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-14T18:23:58.916401] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T18:23:59.158105] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-14T18:23:59.671866] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-14T18:23:59.860315] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T18:23:59.958114] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-14T18:24:00.343325] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T18:24:00.347489] [INFO ] [REMOTE ] DEC: Full fetch complete (44100 records). [2025-10-14T18:24:00.347604] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-14T18:24:00.739612] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-14T18:24:00.739724] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-14T18:24:00.740391] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-14T18:24:00.740432] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-14T18:24:00.741526] [DEBUG] [LOCAL ] DEC: Trimmed 44100 records to 30408 (keeping 200 days of data) [2025-10-14T18:24:00.793046] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-14T18:24:00.921877] [DEBUG] [LOCAL ] DEC: Primary data saved (30408 records). [2025-10-14T18:24:00.922002] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-14T18:24:00.922074] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 22.7s. Estimated remaining: 4h 4m 47s. Rate: 7.2 symbols/min [2025-10-14T18:24:01.089787] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:01.140262] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-14T18:24:01.140577] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-14T18:24:01.321036] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:01.321299] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-14T18:24:01.321366] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-14T18:24:01.321828] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-14T18:24:01.321886] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-14T18:24:01.565355] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-14T18:24:01.707259] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:02.286493] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-14T18:24:02.358104] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-14T18:24:02.721935] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-14T18:24:02.727331] [INFO ] [REMOTE ] DE: Full fetch complete (69700 records). [2025-10-14T18:24:02.727486] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-14T18:24:03.128305] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-14T18:24:03.128423] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-14T18:24:03.129317] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-14T18:24:03.129402] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-14T18:24:03.130889] [DEBUG] [LOCAL ] DE: Trimmed 69700 records to 47686 (keeping 200 days of data) [2025-10-14T18:24:03.186597] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-14T18:24:03.381417] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T18:24:03.474049] [DEBUG] [LOCAL ] DE: Primary data saved (47686 records). [2025-10-14T18:24:03.474184] [INFO ] [MAIN ] DE: Full history saved. [2025-10-14T18:24:03.474264] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DE took 38.0s. Estimated remaining: 4h 4m 22s. Rate: 7.2 symbols/min [2025-10-14T18:24:03.640885] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:03.688139] [DEBUG] [LOCAL ] DEO: Loaded 49199 existing records from primary storage. [2025-10-14T18:24:03.688466] [INFO ] [MAIN ] DEO: Loaded 49199 existing records. [2025-10-14T18:24:03.862480] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:03.862711] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-14T18:24:03.862765] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-14T18:24:03.863131] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-14T18:24:03.863187] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-14T18:24:03.965025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-14T18:24:04.230294] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:04.259639] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T18:24:04.758079] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-14T18:24:05.558112] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-14T18:24:05.685343] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-14T18:24:05.770623] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T18:24:06.291746] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T18:24:06.358098] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-14T18:24:07.158074] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-14T18:24:07.653120] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-14T18:24:07.701040] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T18:24:07.958294] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-14T18:24:08.426125] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T18:24:08.758074] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-14T18:24:09.505555] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T18:24:09.558072] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-14T18:24:10.358137] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-14T18:24:10.707494] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-14T18:24:11.158098] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-14T18:24:11.412480] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T18:24:11.958049] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-14T18:24:12.697822] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-14T18:24:12.758058] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-14T18:24:13.426214] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-14T18:24:13.558070] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-14T18:24:13.769259] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T18:24:14.242687] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T18:24:14.358085] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-14T18:24:15.158092] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-14T18:24:15.512215] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T18:24:15.958057] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-14T18:24:16.353321] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-14T18:24:16.762166] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-14T18:24:16.915901] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T18:24:17.558099] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-14T18:24:17.644435] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T18:24:18.358094] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-14T18:24:18.525311] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T18:24:18.854286] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T18:24:19.158134] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-14T18:24:19.524845] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T18:24:19.958154] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-14T18:24:20.758084] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-14T18:24:21.545826] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-14T18:24:21.558020] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-14T18:24:21.885217] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T18:24:22.358039] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-14T18:24:22.517690] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T18:24:23.158135] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-14T18:24:23.750570] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T18:24:23.875627] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-14T18:24:23.958098] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-14T18:24:24.758067] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-14T18:24:24.929134] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T18:24:25.558042] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-14T18:24:25.786538] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T18:24:26.236676] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T18:24:26.242471] [INFO ] [REMOTE ] DECK: Full fetch complete (76969 records). [2025-10-14T18:24:26.242624] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-14T18:24:26.363314] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-14T18:24:26.646048] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-14T18:24:26.646164] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-14T18:24:26.647392] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-14T18:24:26.647478] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-14T18:24:26.649352] [DEBUG] [LOCAL ] DECK: Trimmed 76969 records to 53293 (keeping 200 days of data) [2025-10-14T18:24:26.884592] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T18:24:26.892510] [INFO ] [REMOTE ] DEI: Full fetch complete (69818 records). [2025-10-14T18:24:26.895841] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-14T18:24:27.158712] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-14T18:24:27.409255] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-14T18:24:27.409572] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-14T18:24:27.410949] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-14T18:24:27.411323] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-14T18:24:27.417898] [DEBUG] [LOCAL ] DEI: Trimmed 69818 records to 48296 (keeping 200 days of data) [2025-10-14T18:24:27.423596] [DEBUG] [LOCAL ] DECK: Primary data saved (53293 records). [2025-10-14T18:24:27.423742] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-14T18:24:27.424082] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 44.1s. Estimated remaining: 4h 4m 59s. Rate: 7.2 symbols/min [2025-10-14T18:24:27.701302] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:27.912250] [DEBUG] [LOCAL ] DEI: Primary data saved (48296 records). [2025-10-14T18:24:27.912389] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-14T18:24:27.912469] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DEI took 30.6s. Estimated remaining: 4h 4m 28s. Rate: 7.2 symbols/min [2025-10-14T18:24:28.092975] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:28.503328] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-14T18:24:28.514186] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-14T18:24:29.210565] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-14T18:24:29.222502] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-14T18:24:30.486615] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-14T18:24:30.492850] [INFO ] [REMOTE ] DEO: Full fetch complete (71710 records). [2025-10-14T18:24:30.492994] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-14T18:24:30.881402] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-14T18:24:30.881526] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-14T18:24:30.882533] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-14T18:24:30.882595] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-14T18:24:30.884016] [DEBUG] [LOCAL ] DEO: Trimmed 71710 records to 49214 (keeping 200 days of data) [2025-10-14T18:24:31.180468] [DEBUG] [LOCAL ] DEO: Primary data saved (49214 records). [2025-10-14T18:24:31.180601] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-14T18:24:31.180700] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 27.7s. Estimated remaining: 4h 4m 5s. Rate: 7.2 symbols/min [2025-10-14T18:24:31.351724] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:31.451747] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-14T18:24:31.463180] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-14T18:24:31.767688] [DEBUG] [LOCAL ] DFH: Loaded 32203 existing records from primary storage. [2025-10-14T18:24:31.768068] [INFO ] [MAIN ] DFH: Loaded 32203 existing records. [2025-10-14T18:24:31.947190] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:31.947406] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-14T18:24:31.947453] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-14T18:24:31.947719] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-14T18:24:31.947775] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-14T18:24:32.247810] [DEBUG] [LOCAL ] DFIN: Loaded 22684 existing records from primary storage. [2025-10-14T18:24:32.259019] [INFO ] [MAIN ] DFIN: Loaded 22684 existing records. [2025-10-14T18:24:32.437561] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:32.437936] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-14T18:24:32.517757] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:32.518280] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-14T18:24:32.518335] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-14T18:24:32.518505] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-14T18:24:32.518543] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-14T18:24:32.628723] [DEBUG] [LOCAL ] DFP: Loaded 11208 existing records from primary storage. [2025-10-14T18:24:32.639443] [INFO ] [MAIN ] DFP: Loaded 11208 existing records. [2025-10-14T18:24:33.038255] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:33.044193] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-14T18:24:33.044297] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-14T18:24:33.070980] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-14T18:24:33.088295] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-14T18:24:33.153634] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:33.169068] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-14T18:24:33.499162] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:33.499466] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-14T18:24:33.678784] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-14T18:24:33.691185] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-14T18:24:33.715821] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T18:24:33.724182] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-14T18:24:33.955549] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T18:24:34.358115] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-14T18:24:34.433321] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T18:24:35.038672] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T18:24:35.059028] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T18:24:35.158071] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-14T18:24:35.958197] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-14T18:24:36.238828] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-14T18:24:36.244844] [INFO ] [REMOTE ] DELL: Full fetch complete (77913 records). [2025-10-14T18:24:36.245005] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-14T18:24:36.593682] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T18:24:36.674769] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-14T18:24:36.674850] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-14T18:24:36.675791] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-14T18:24:36.675852] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-14T18:24:36.677236] [DEBUG] [LOCAL ] DELL: Trimmed 77913 records to 53736 (keeping 200 days of data) [2025-10-14T18:24:36.767341] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-14T18:24:37.024636] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-14T18:24:37.024828] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-14T18:24:37.024924] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DELL took 36.1s. Estimated remaining: 4h 3m 50s. Rate: 7.2 symbols/min [2025-10-14T18:24:37.207870] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:37.227232] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T18:24:37.241418] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-14T18:24:37.294814] [DEBUG] [LOCAL ] DG: Loaded 53278 existing records from primary storage. [2025-10-14T18:24:37.295138] [INFO ] [MAIN ] DG: Loaded 53278 existing records. [2025-10-14T18:24:37.473662] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:37.473886] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-14T18:24:37.473932] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-14T18:24:37.474486] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-14T18:24:37.474542] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-14T18:24:37.563212] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-14T18:24:37.834583] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:38.358075] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-14T18:24:38.524531] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T18:24:39.158081] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-14T18:24:39.381205] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T18:24:39.925274] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T18:24:39.958061] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-14T18:24:40.758076] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-14T18:24:41.415159] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T18:24:41.558064] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-14T18:24:41.619255] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T18:24:42.358113] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-14T18:24:42.566212] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-14T18:24:43.164056] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-14T18:24:43.168253] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T18:24:43.958052] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-14T18:24:44.758078] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-14T18:24:45.064042] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T18:24:45.557630] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-14T18:24:45.568291] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-14T18:24:45.690207] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T18:24:46.358082] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-14T18:24:46.743152] [DEBUG] [REMOTE ] DFH: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-14T18:24:46.743573] [WARN ] [REMOTE ] DFH: No data returned for month 2025-07 [2025-10-14T18:24:46.743690] [FATAL] [REMOTE ] DFH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:24:46.743792] [FATAL] [MAIN ] DFH: Failed to fetch primary data. [2025-10-14T18:24:46.743856] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:24:46.743933] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-14T18:24:46.744002] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-14T18:24:46.744041] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-14T18:24:46.744502] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-14T18:24:46.744845] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFH took 19.3s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-14T18:24:46.881268] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T18:24:46.939527] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:46.990828] [DEBUG] [LOCAL ] DGX: Loaded 44805 existing records from primary storage. [2025-10-14T18:24:46.991135] [INFO ] [MAIN ] DGX: Loaded 44805 existing records. [2025-10-14T18:24:47.161741] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-14T18:24:47.174898] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:47.175842] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-14T18:24:47.175899] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-14T18:24:47.176255] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-14T18:24:47.176313] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-14T18:24:47.535824] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:47.958073] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-14T18:24:48.267862] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T18:24:48.758104] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-14T18:24:48.808862] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T18:24:49.558058] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-14T18:24:50.130512] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T18:24:50.346119] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T18:24:50.358030] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-14T18:24:51.158077] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-14T18:24:51.635094] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T18:24:51.958043] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-14T18:24:51.967033] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T18:24:52.758063] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-14T18:24:53.558090] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-14T18:24:53.588903] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T18:24:54.227617] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:24:54.358065] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-14T18:24:55.025488] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-14T18:24:55.158081] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-14T18:24:55.958132] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-14T18:24:56.034379] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T18:24:56.076460] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T18:24:56.758046] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-14T18:24:56.875262] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T18:24:57.471379] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T18:24:57.472761] [INFO ] [REMOTE ] DFP: Full fetch complete (15875 records). [2025-10-14T18:24:57.472853] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-14T18:24:57.563367] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-14T18:24:57.862136] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-14T18:24:57.862210] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-14T18:24:57.862539] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-14T18:24:57.862576] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-14T18:24:57.863093] [DEBUG] [LOCAL ] DFP: Trimmed 15875 records to 11209 (keeping 200 days of data) [2025-10-14T18:24:57.929355] [DEBUG] [LOCAL ] DFP: Primary data saved (11209 records). [2025-10-14T18:24:57.929484] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-14T18:24:57.929560] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 26.7s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-14T18:24:58.101737] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:24:58.122032] [DEBUG] [LOCAL ] DHF: Loaded 21235 existing records from primary storage. [2025-10-14T18:24:58.122273] [INFO ] [MAIN ] DHF: Loaded 21235 existing records. [2025-10-14T18:24:58.298725] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:24:58.298971] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-14T18:24:58.299044] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-14T18:24:58.299294] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-14T18:24:58.299359] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-14T18:24:58.363245] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-14T18:24:58.662667] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:24:59.158058] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-14T18:24:59.556404] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T18:24:59.831791] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T18:24:59.958174] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-14T18:25:00.249788] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T18:25:00.758144] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-14T18:25:00.973004] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T18:25:01.558088] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-14T18:25:02.370421] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-14T18:25:02.374253] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T18:25:02.529615] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T18:25:03.158121] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-14T18:25:03.958111] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-14T18:25:04.256009] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T18:25:04.758102] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-14T18:25:05.043630] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T18:25:05.436161] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-14T18:25:05.558066] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-14T18:25:06.363170] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-14T18:25:06.378238] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T18:25:06.434461] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T18:25:07.158063] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-14T18:25:07.958107] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-14T18:25:08.552124] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-14T18:25:08.758122] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-14T18:25:09.115449] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T18:25:09.118142] [INFO ] [REMOTE ] DFIN: Full fetch complete (33381 records). [2025-10-14T18:25:09.118223] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-14T18:25:09.487728] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-14T18:25:09.487878] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-14T18:25:09.488487] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-14T18:25:09.488587] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-14T18:25:09.489886] [DEBUG] [LOCAL ] DFIN: Trimmed 33381 records to 22636 (keeping 200 days of data) [2025-10-14T18:25:09.560780] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-14T18:25:09.599172] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-14T18:25:09.659887] [DEBUG] [LOCAL ] DFIN: Primary data saved (22636 records). [2025-10-14T18:25:09.660004] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-14T18:25:09.660078] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DFIN took 41.7s. Estimated remaining: 4h 3m 47s. Rate: 7.2 symbols/min [2025-10-14T18:25:09.826172] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:09.875728] [DEBUG] [LOCAL ] DHI: Loaded 53356 existing records from primary storage. [2025-10-14T18:25:09.876029] [INFO ] [MAIN ] DHI: Loaded 53356 existing records. [2025-10-14T18:25:10.050144] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:10.050363] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-14T18:25:10.050410] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-14T18:25:10.051499] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-14T18:25:10.051557] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-14T18:25:10.360047] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-14T18:25:10.422740] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:10.458456] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T18:25:10.562433] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T18:25:11.158088] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-14T18:25:11.896348] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T18:25:11.958072] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-14T18:25:12.758088] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-14T18:25:12.893380] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T18:25:13.475742] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T18:25:13.558077] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-14T18:25:14.358055] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-14T18:25:14.532006] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T18:25:14.658505] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:25:15.158083] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-14T18:25:15.958130] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-14T18:25:16.350469] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-14T18:25:16.573854] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T18:25:16.713880] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T18:25:16.719564] [INFO ] [REMOTE ] DGX: Full fetch complete (64941 records). [2025-10-14T18:25:16.719825] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-14T18:25:16.720919] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:25:16.721025] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:25:16.721071] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:25:16.721118] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-14T18:25:16.721198] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-14T18:25:16.721265] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-14T18:25:16.721573] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-10-14T18:25:16.721724] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 30.0s. Estimated remaining: 4h 3m 35s. Rate: 7.2 symbols/min [2025-10-14T18:25:16.763267] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-14T18:25:16.920253] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:16.973389] [DEBUG] [LOCAL ] DHR: Loaded 53378 existing records from primary storage. [2025-10-14T18:25:16.973737] [INFO ] [MAIN ] DHR: Loaded 53378 existing records. [2025-10-14T18:25:17.163088] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:17.163278] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-14T18:25:17.163326] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-14T18:25:17.164382] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-14T18:25:17.164440] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-14T18:25:17.510557] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:17.558034] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-14T18:25:18.358041] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-14T18:25:18.429447] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T18:25:19.158093] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-14T18:25:19.389732] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T18:25:19.446425] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T18:25:19.958063] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-14T18:25:20.758074] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-14T18:25:21.146258] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T18:25:21.558119] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-14T18:25:21.789742] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T18:25:22.153013] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T18:25:22.315823] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T18:25:22.358052] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-14T18:25:23.158091] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-14T18:25:23.958184] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-14T18:25:23.960936] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T18:25:24.758050] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-14T18:25:24.960631] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T18:25:25.120868] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T18:25:25.558074] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-14T18:25:26.358073] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-14T18:25:26.823543] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T18:25:27.158060] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-14T18:25:27.397104] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T18:25:27.450087] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T18:25:27.958091] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-14T18:25:28.758096] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-14T18:25:29.024977] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T18:25:29.564559] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-14T18:25:29.567594] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T18:25:30.363252] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-14T18:25:30.376491] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T18:25:30.383933] [INFO ] [REMOTE ] DG: Full fetch complete (77346 records). [2025-10-14T18:25:30.384173] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-14T18:25:30.725966] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T18:25:30.750550] [INFO ] [REMOTE ] DHF: Full fetch complete (30082 records). [2025-10-14T18:25:30.791095] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-14T18:25:30.832251] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-14T18:25:30.838721] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-14T18:25:30.878234] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-14T18:25:30.911515] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-14T18:25:30.997817] [DEBUG] [LOCAL ] DG: Trimmed 77346 records to 53278 (keeping 200 days of data) [2025-10-14T18:25:31.171048] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-14T18:25:31.325965] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-14T18:25:31.326576] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-14T18:25:31.327698] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-14T18:25:31.328025] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-14T18:25:31.336125] [DEBUG] [LOCAL ] DHF: Trimmed 30082 records to 21165 (keeping 200 days of data) [2025-10-14T18:25:31.593495] [DEBUG] [LOCAL ] DHF: Primary data saved (21165 records). [2025-10-14T18:25:31.594083] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-14T18:25:31.594457] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DHF took 33.7s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-14T18:25:31.836445] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:31.874684] [DEBUG] [LOCAL ] DG: Primary data saved (53278 records). [2025-10-14T18:25:31.874888] [INFO ] [MAIN ] DG: Full history saved. [2025-10-14T18:25:31.875003] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DG took 54.8s. Estimated remaining: 4h 3m 14s. Rate: 7.2 symbols/min [2025-10-14T18:25:32.024385] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T18:25:32.014777] [DEBUG] [LOCAL ] DHT: Loaded 47907 existing records from primary storage. [2025-10-14T18:25:32.043725] [INFO ] [MAIN ] DHT: Loaded 47907 existing records. [2025-10-14T18:25:32.075122] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-14T18:25:32.191502] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:32.296310] [DEBUG] [LOCAL ] DHX: Loaded 13254 existing records from primary storage. [2025-10-14T18:25:32.301180] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:32.301393] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-14T18:25:32.301609] [INFO ] [MAIN ] DHX: Loaded 13254 existing records. [2025-10-14T18:25:32.301470] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-14T18:25:32.347434] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-14T18:25:32.369849] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-14T18:25:32.650945] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:32.718810] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-14T18:25:32.750227] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-14T18:25:32.791215] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-14T18:25:32.796420] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-14T18:25:33.000399] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:33.006460] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-14T18:25:33.258516] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:33.287499] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-14T18:25:33.558081] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-14T18:25:34.101733] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T18:25:34.358141] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-14T18:25:34.650246] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T18:25:34.987912] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-14T18:25:35.158084] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-14T18:25:35.208626] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:25:35.958054] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-14T18:25:36.101705] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T18:25:36.758130] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-14T18:25:37.558048] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-14T18:25:37.630893] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T18:25:37.796509] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T18:25:38.358040] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-14T18:25:39.158098] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-14T18:25:39.521880] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T18:25:39.542917] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T18:25:39.958126] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-14T18:25:40.758284] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-14T18:25:40.994070] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T18:25:41.337530] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T18:25:41.558072] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-14T18:25:42.155960] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-14T18:25:42.358085] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-14T18:25:42.421704] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T18:25:42.931547] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:25:43.158087] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-14T18:25:43.958062] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-14T18:25:44.758081] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-14T18:25:44.797542] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T18:25:45.558080] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-14T18:25:45.934778] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:25:45.940183] [INFO ] [REMOTE ] DHR: Full fetch complete (77039 records). [2025-10-14T18:25:45.940325] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-14T18:25:45.941116] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:25:45.941208] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:25:45.941253] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:25:45.941318] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-14T18:25:45.941381] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-14T18:25:45.941417] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-14T18:25:45.941631] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-14T18:25:45.941747] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHR took 29.2s. Estimated remaining: 4h 3m 22s. Rate: 7.2 symbols/min [2025-10-14T18:25:46.090578] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T18:25:46.164919] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:46.180837] [DEBUG] [LOCAL ] DIAX: Loaded 13102 existing records from primary storage. [2025-10-14T18:25:46.181238] [INFO ] [MAIN ] DIAX: Loaded 13102 existing records. [2025-10-14T18:25:46.369299] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-14T18:25:46.395437] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T18:25:46.418318] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:46.429774] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-14T18:25:46.429842] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-14T18:25:46.430068] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-14T18:25:46.430124] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-14T18:25:46.794631] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:47.158073] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-14T18:25:47.325166] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T18:25:47.958078] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-14T18:25:48.627533] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T18:25:48.712269] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T18:25:48.758043] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-14T18:25:49.259465] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T18:25:49.558070] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-14T18:25:50.149044] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T18:25:50.358076] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-14T18:25:51.158071] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-14T18:25:51.958075] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-14T18:25:52.107602] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T18:25:52.130095] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T18:25:52.758066] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-14T18:25:53.558072] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-14T18:25:53.626887] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T18:25:53.636802] [INFO ] [REMOTE ] DHI: Full fetch complete (77375 records). [2025-10-14T18:25:53.637018] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-14T18:25:53.785420] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T18:25:53.794094] [INFO ] [REMOTE ] DHX: Full fetch complete (21228 records). [2025-10-14T18:25:53.809778] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-14T18:25:54.361720] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-14T18:25:54.573725] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-14T18:25:54.597204] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-14T18:25:54.623407] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-14T18:25:54.635928] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-14T18:25:54.722551] [DEBUG] [LOCAL ] DHI: Trimmed 77375 records to 53364 (keeping 200 days of data) [2025-10-14T18:25:54.733903] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-14T18:25:54.734293] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-14T18:25:54.734615] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-14T18:25:54.734716] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-14T18:25:54.735765] [DEBUG] [LOCAL ] DHX: Trimmed 21228 records to 13307 (keeping 200 days of data) [2025-10-14T18:25:54.972636] [DEBUG] [LOCAL ] DHX: Primary data saved (13307 records). [2025-10-14T18:25:54.973339] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-14T18:25:54.976591] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHX took 23.1s. Estimated remaining: 4h 3m 15s. Rate: 7.2 symbols/min [2025-10-14T18:25:55.263847] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:55.278034] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T18:25:55.304015] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-14T18:25:55.312921] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T18:25:55.361069] [DEBUG] [LOCAL ] DIN: Loaded 37419 existing records from primary storage. [2025-10-14T18:25:55.366173] [INFO ] [MAIN ] DIN: Loaded 37419 existing records. [2025-10-14T18:25:55.651851] [DEBUG] [LOCAL ] DHI: Primary data saved (53364 records). [2025-10-14T18:25:55.656675] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-14T18:25:55.657338] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHI took 46.0s. Estimated remaining: 4h 2m 45s. Rate: 7.2 symbols/min [2025-10-14T18:25:55.656466] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:55.701395] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-14T18:25:55.701504] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-14T18:25:55.728441] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-14T18:25:55.740586] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-14T18:25:55.949524] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:25:55.965143] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-14T18:25:56.089095] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T18:25:56.238641] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:56.257130] [DEBUG] [LOCAL ] DINO: Loaded 52852 existing records from primary storage. [2025-10-14T18:25:56.257435] [INFO ] [MAIN ] DINO: Loaded 52852 existing records. [2025-10-14T18:25:56.433461] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:25:56.433707] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-14T18:25:56.433763] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-14T18:25:56.434222] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-14T18:25:56.434281] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-14T18:25:56.782678] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-14T18:25:56.787712] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:25:57.558038] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-14T18:25:57.669150] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T18:25:57.714497] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T18:25:58.358099] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-14T18:25:59.158107] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-14T18:25:59.332785] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T18:25:59.757892] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T18:25:59.958096] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-14T18:26:00.428139] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T18:26:00.758059] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-14T18:26:01.558082] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-14T18:26:01.626426] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T18:26:01.754903] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T18:26:02.358084] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-14T18:26:02.980667] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:26:03.158069] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-14T18:26:03.728750] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T18:26:03.936044] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T18:26:03.958062] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-14T18:26:04.745141] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T18:26:04.758068] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-14T18:26:05.558036] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-14T18:26:05.637585] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T18:26:06.358105] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-14T18:26:07.158089] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-14T18:26:07.615808] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-14T18:26:07.889151] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T18:26:07.958060] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-14T18:26:08.758128] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-14T18:26:09.564772] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-14T18:26:09.568311] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T18:26:09.707309] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-14T18:26:09.713237] [INFO ] [REMOTE ] DHT: Full fetch complete (70127 records). [2025-10-14T18:26:09.713387] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-14T18:26:10.124176] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-14T18:26:10.124310] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-14T18:26:10.125486] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-14T18:26:10.125744] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-14T18:26:10.148368] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-14T18:26:10.156735] [DEBUG] [LOCAL ] DHT: Trimmed 70127 records to 47891 (keeping 200 days of data) [2025-10-14T18:26:10.365874] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-14T18:26:10.452302] [DEBUG] [LOCAL ] DHT: Primary data saved (47891 records). [2025-10-14T18:26:10.452447] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-14T18:26:10.452531] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DHT took 38.9s. Estimated remaining: 4h 2m 55s. Rate: 7.2 symbols/min [2025-10-14T18:26:10.629788] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:26:10.683314] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-14T18:26:10.683679] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-14T18:26:10.878028] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:26:10.878220] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-14T18:26:10.878266] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-14T18:26:10.879043] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-14T18:26:10.879099] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-14T18:26:11.163127] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-14T18:26:11.241572] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:26:11.338042] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T18:26:11.351443] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T18:26:11.958099] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-14T18:26:12.758071] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-14T18:26:12.984884] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T18:26:13.558078] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-14T18:26:13.850425] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T18:26:14.315772] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T18:26:14.319041] [INFO ] [REMOTE ] DIAX: Full fetch complete (17766 records). [2025-10-14T18:26:14.319118] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-14T18:26:14.363327] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-14T18:26:14.694458] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-14T18:26:14.694534] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-14T18:26:14.694919] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-14T18:26:14.694978] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-14T18:26:14.695479] [DEBUG] [LOCAL ] DIAX: Trimmed 17766 records to 13088 (keeping 200 days of data) [2025-10-14T18:26:14.772708] [DEBUG] [LOCAL ] DIAX: Primary data saved (13088 records). [2025-10-14T18:26:14.772841] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-14T18:26:14.772919] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIAX took 28.8s. Estimated remaining: 4h 2m 36s. Rate: 7.2 symbols/min [2025-10-14T18:26:14.939266] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:26:14.939437] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-14T18:26:14.939486] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-14T18:26:14.939593] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-14T18:26:14.939680] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-14T18:26:14.939770] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-14T18:26:14.939837] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-14T18:26:15.160869] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-14T18:26:15.300766] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:26:15.501520] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-14T18:26:15.958063] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-14T18:26:15.997854] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T18:26:16.613723] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T18:26:16.758044] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-14T18:26:16.995116] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T18:26:17.095323] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-14T18:26:17.558076] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-14T18:26:18.358063] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-14T18:26:19.158126] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-14T18:26:19.671913] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-14T18:26:19.876488] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T18:26:19.958079] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-14T18:26:20.600075] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T18:26:20.758072] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-14T18:26:21.028005] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-14T18:26:21.344345] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T18:26:21.558079] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-14T18:26:22.358062] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-14T18:26:23.158074] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-14T18:26:23.933778] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:26:23.958035] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-14T18:26:24.063728] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-14T18:26:24.758063] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-14T18:26:25.043142] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T18:26:25.079692] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:26:25.092442] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-14T18:26:25.558072] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-14T18:26:25.856947] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-14T18:26:26.358104] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-14T18:26:27.158069] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-14T18:26:27.958113] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-14T18:26:28.411770] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T18:26:28.758074] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-14T18:26:28.873889] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-14T18:26:29.000407] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-14T18:26:29.173672] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-14T18:26:29.558093] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-14T18:26:30.358081] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-14T18:26:31.057834] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T18:26:31.063211] [INFO ] [REMOTE ] DIN: Full fetch complete (55276 records). [2025-10-14T18:26:31.063393] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-14T18:26:31.165609] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-14T18:26:31.468001] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-14T18:26:31.468124] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-14T18:26:31.468922] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-14T18:26:31.468984] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-14T18:26:31.470309] [DEBUG] [LOCAL ] DIN: Trimmed 55276 records to 37391 (keeping 200 days of data) [2025-10-14T18:26:31.712074] [DEBUG] [LOCAL ] DIN: Primary data saved (37391 records). [2025-10-14T18:26:31.712249] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-14T18:26:31.712356] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIN took 36.7s. Estimated remaining: 4h 2m 52s. Rate: 7.2 symbols/min [2025-10-14T18:26:31.914086] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:26:31.946873] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T18:26:31.958089] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-14T18:26:31.998206] [DEBUG] [LOCAL ] DK: Loaded 49383 existing records from primary storage. [2025-10-14T18:26:31.998522] [INFO ] [MAIN ] DK: Loaded 49383 existing records. [2025-10-14T18:26:32.203222] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:26:32.203484] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-14T18:26:32.203533] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-14T18:26:32.204022] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-14T18:26:32.204082] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-14T18:26:32.312318] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-14T18:26:32.604829] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:26:32.758054] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-14T18:26:33.558046] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-14T18:26:33.677336] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-14T18:26:33.823425] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-14T18:26:33.972998] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T18:26:34.358098] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-14T18:26:35.158069] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-14T18:26:35.953793] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T18:26:35.962472] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-14T18:26:36.758075] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-14T18:26:37.363355] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-14T18:26:37.549015] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T18:26:37.555153] [INFO ] [REMOTE ] DINO: Full fetch complete (76723 records). [2025-10-14T18:26:37.555268] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-14T18:26:37.567332] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-14T18:26:37.945291] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-14T18:26:37.945371] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-14T18:26:37.946266] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-14T18:26:37.946327] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-14T18:26:37.947751] [DEBUG] [LOCAL ] DINO: Trimmed 76723 records to 52845 (keeping 200 days of data) [2025-10-14T18:26:38.265285] [DEBUG] [LOCAL ] DINO: Primary data saved (52845 records). [2025-10-14T18:26:38.265429] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-14T18:26:38.265529] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 42.6s. Estimated remaining: 4h 2m 38s. Rate: 7.2 symbols/min [2025-10-14T18:26:38.364079] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-14T18:26:38.467353] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:26:38.465787] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T18:26:38.493344] [DEBUG] [LOCAL ] DKL: Loaded 17768 existing records from primary storage. [2025-10-14T18:26:38.493563] [INFO ] [MAIN ] DKL: Loaded 17768 existing records. [2025-10-14T18:26:38.672723] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:26:38.672940] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-14T18:26:38.672988] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-14T18:26:38.673243] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-14T18:26:38.673301] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-14T18:26:38.785448] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T18:26:39.051387] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:26:39.158038] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-14T18:26:39.608976] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-14T18:26:39.900072] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T18:26:39.958103] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-14T18:26:40.758139] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-14T18:26:41.558105] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-14T18:26:41.727031] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T18:26:41.959819] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-14T18:26:41.960482] [INFO ] [REMOTE ] DIVY: Full fetch complete (1700 records). [2025-10-14T18:26:41.960546] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-14T18:26:42.141232] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T18:26:42.141415] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:26:42.141583] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:26:42.141699] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-14T18:26:42.141859] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-14T18:26:42.142160] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-14T18:26:42.142280] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-14T18:26:42.142354] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIVY took 27.4s. Estimated remaining: 4h 2m 17s. Rate: 7.2 symbols/min [2025-10-14T18:26:42.318470] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:26:42.352289] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-14T18:26:42.363552] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-14T18:26:42.408449] [DEBUG] [LOCAL ] DKS: Loaded 49726 existing records from primary storage. [2025-10-14T18:26:42.408900] [INFO ] [MAIN ] DKS: Loaded 49726 existing records. [2025-10-14T18:26:42.586183] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:26:42.586468] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-14T18:26:42.586523] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-14T18:26:42.586958] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-14T18:26:42.587019] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-14T18:26:42.951116] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:26:43.158079] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-14T18:26:43.958039] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-14T18:26:44.468296] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-14T18:26:44.758071] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-14T18:26:45.039474] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T18:26:45.182956] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T18:26:45.558077] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-14T18:26:46.262887] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T18:26:46.358121] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-14T18:26:47.158085] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-14T18:26:47.442450] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-14T18:26:47.506726] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T18:26:47.958117] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-14T18:26:48.758072] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-14T18:26:49.263801] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T18:26:49.302539] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-14T18:26:49.558057] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-14T18:26:50.358055] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-14T18:26:50.917927] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T18:26:51.158044] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-14T18:26:51.223744] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-14T18:26:51.648709] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T18:26:51.958106] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-14T18:26:52.055925] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T18:26:52.758106] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-14T18:26:53.558130] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-14T18:26:54.223011] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-14T18:26:54.277168] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T18:26:54.358071] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-14T18:26:54.845806] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T18:26:55.158068] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-14T18:26:55.958056] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-14T18:26:56.012387] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T18:26:56.106836] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:26:56.758138] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-14T18:26:57.536633] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:26:57.558038] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-14T18:26:57.676033] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T18:26:58.358060] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-14T18:26:59.158099] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-14T18:26:59.264070] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T18:26:59.658988] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T18:26:59.665381] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-14T18:26:59.665565] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-14T18:26:59.966518] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-14T18:27:00.077057] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-14T18:27:00.077131] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-14T18:27:00.078088] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-14T18:27:00.078150] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-14T18:27:00.079813] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-14T18:27:00.403235] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T18:27:00.463354] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-14T18:27:00.463487] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-14T18:27:00.463569] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DIS took 50.0s. Estimated remaining: 4h 2m 37s. Rate: 7.2 symbols/min [2025-10-14T18:27:00.628572] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:00.659517] [DEBUG] [LOCAL ] DLB: Loaded 32122 existing records from primary storage. [2025-10-14T18:27:00.659818] [INFO ] [MAIN ] DLB: Loaded 32122 existing records. [2025-10-14T18:27:00.758379] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-14T18:27:00.866403] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:00.866752] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-14T18:27:00.866815] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-14T18:27:00.867111] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-14T18:27:00.867173] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-14T18:27:01.294731] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:01.309211] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T18:27:01.314390] [INFO ] [REMOTE ] DK: Full fetch complete (70677 records). [2025-10-14T18:27:01.314493] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-14T18:27:01.315251] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:27:01.315337] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:27:01.315379] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:27:01.315418] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-14T18:27:01.315472] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-14T18:27:01.315507] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-10-14T18:27:01.315746] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-10-14T18:27:01.315843] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 29.6s. Estimated remaining: 4h 2m 8s. Rate: 7.2 symbols/min [2025-10-14T18:27:01.484072] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:01.491954] [DEBUG] [LOCAL ] DLNG: Loaded 6171 existing records from primary storage. [2025-10-14T18:27:01.492161] [INFO ] [MAIN ] DLNG: Loaded 6171 existing records. [2025-10-14T18:27:01.567070] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-14T18:27:01.676522] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:01.676770] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-14T18:27:01.676823] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-14T18:27:01.676972] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-14T18:27:01.677012] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-14T18:27:02.068487] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:02.358083] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-14T18:27:02.493503] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T18:27:02.646086] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T18:27:03.148487] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T18:27:03.158027] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-14T18:27:03.704712] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T18:27:03.958088] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-14T18:27:04.506606] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T18:27:04.758119] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-14T18:27:05.558085] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-14T18:27:05.851472] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T18:27:05.853459] [INFO ] [REMOTE ] DKL: Full fetch complete (27962 records). [2025-10-14T18:27:05.853529] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-14T18:27:06.247994] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-14T18:27:06.248092] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-14T18:27:06.248665] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-14T18:27:06.248727] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-14T18:27:06.249441] [DEBUG] [LOCAL ] DKL: Trimmed 27962 records to 17667 (keeping 200 days of data) [2025-10-14T18:27:06.354583] [DEBUG] [LOCAL ] DKL: Primary data saved (17667 records). [2025-10-14T18:27:06.354745] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-14T18:27:06.354833] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DKL took 28.1s. Estimated remaining: 4h 1m 50s. Rate: 7.2 symbols/min [2025-10-14T18:27:06.365794] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-14T18:27:06.473414] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T18:27:06.548418] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:06.599748] [DEBUG] [LOCAL ] DLR: Loaded 50768 existing records from primary storage. [2025-10-14T18:27:06.600154] [INFO ] [MAIN ] DLR: Loaded 50768 existing records. [2025-10-14T18:27:06.784776] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:06.785030] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-14T18:27:06.785127] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-14T18:27:06.785481] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-14T18:27:06.785560] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-14T18:27:07.141866] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:07.158058] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-14T18:27:07.958124] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-14T18:27:08.244238] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T18:27:08.466752] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T18:27:08.758148] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-14T18:27:08.866000] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T18:27:09.450046] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T18:27:09.558113] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-14T18:27:10.358072] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-14T18:27:11.158060] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-14T18:27:11.365707] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T18:27:11.376353] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:27:11.958044] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-14T18:27:12.490742] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T18:27:12.562497] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T18:27:12.758052] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-14T18:27:13.347317] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T18:27:13.558059] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-14T18:27:14.082273] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-14T18:27:14.358088] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-14T18:27:15.158072] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-14T18:27:15.813164] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T18:27:15.813995] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T18:27:15.958054] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-14T18:27:16.680423] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T18:27:16.758135] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-14T18:27:17.558094] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-14T18:27:18.358065] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-14T18:27:18.772718] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-14T18:27:19.158061] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-14T18:27:19.433962] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T18:27:19.436359] [INFO ] [REMOTE ] DLNG: Full fetch complete (11823 records). [2025-10-14T18:27:19.438342] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-14T18:27:19.438200] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-14T18:27:19.811278] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-14T18:27:19.811586] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-14T18:27:19.811989] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-14T18:27:19.812051] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-14T18:27:19.812623] [DEBUG] [LOCAL ] DLNG: Trimmed 11823 records to 6189 (keeping 200 days of data) [2025-10-14T18:27:19.849003] [DEBUG] [LOCAL ] DLNG: Primary data saved (6189 records). [2025-10-14T18:27:19.849141] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-14T18:27:19.849249] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 18.5s. Estimated remaining: 4h 1m 56s. Rate: 7.2 symbols/min [2025-10-14T18:27:19.963294] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-14T18:27:20.018804] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:20.048627] [DEBUG] [LOCAL ] DLX: Loaded 28464 existing records from primary storage. [2025-10-14T18:27:20.048916] [INFO ] [MAIN ] DLX: Loaded 28464 existing records. [2025-10-14T18:27:20.222333] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:20.222591] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-14T18:27:20.222637] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-14T18:27:20.223098] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-14T18:27:20.223168] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-14T18:27:20.579128] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:20.628096] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:27:20.758060] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-14T18:27:21.453578] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T18:27:21.558077] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-14T18:27:21.616299] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T18:27:22.358097] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-14T18:27:22.892138] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T18:27:23.158082] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-14T18:27:23.958163] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-14T18:27:24.343868] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T18:27:24.758117] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-14T18:27:24.874731] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T18:27:24.880268] [INFO ] [REMOTE ] DKS: Full fetch complete (71800 records). [2025-10-14T18:27:24.880379] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-14T18:27:25.195925] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T18:27:25.296045] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-14T18:27:25.296132] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-14T18:27:25.297049] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-14T18:27:25.297112] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-14T18:27:25.298608] [DEBUG] [LOCAL ] DKS: Trimmed 71800 records to 49710 (keeping 200 days of data) [2025-10-14T18:27:25.571162] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-14T18:27:25.607461] [DEBUG] [LOCAL ] DKS: Primary data saved (49710 records). [2025-10-14T18:27:25.607584] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-14T18:27:25.607686] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 43.5s. Estimated remaining: 4h 1m 41s. Rate: 7.2 symbols/min [2025-10-14T18:27:25.779000] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:25.801302] [DEBUG] [LOCAL ] DLY: Loaded 20376 existing records from primary storage. [2025-10-14T18:27:25.801601] [INFO ] [MAIN ] DLY: Loaded 20376 existing records. [2025-10-14T18:27:25.983513] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:25.983776] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-14T18:27:25.983824] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-14T18:27:25.984085] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-14T18:27:25.984141] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-14T18:27:26.344356] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:26.358023] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-14T18:27:26.401298] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T18:27:27.125988] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T18:27:27.158093] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-14T18:27:27.273678] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T18:27:27.958142] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-14T18:27:28.498263] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T18:27:28.758102] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-14T18:27:29.558087] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-14T18:27:29.797922] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T18:27:29.841982] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T18:27:30.358310] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-14T18:27:30.500264] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T18:27:31.158114] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-14T18:27:31.205719] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T18:27:31.958060] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-14T18:27:32.225306] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T18:27:32.758033] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-14T18:27:33.227322] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T18:27:33.558112] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-14T18:27:33.957820] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T18:27:34.358080] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-14T18:27:34.882364] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T18:27:35.158084] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-14T18:27:35.330123] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T18:27:35.958081] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-14T18:27:36.608476] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T18:27:36.758095] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-14T18:27:37.265279] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T18:27:37.558064] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-14T18:27:37.837201] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T18:27:38.358058] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-14T18:27:38.587985] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T18:27:39.158061] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-14T18:27:39.308199] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T18:27:39.732960] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T18:27:39.958047] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-14T18:27:40.758119] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-14T18:27:40.930741] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T18:27:40.934450] [INFO ] [REMOTE ] DLB: Full fetch complete (46922 records). [2025-10-14T18:27:40.934550] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-14T18:27:40.935198] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:27:40.935283] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:27:40.935325] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:27:40.935364] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-14T18:27:40.935419] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-14T18:27:40.935453] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-10-14T18:27:40.935687] [DEBUG] [LOCAL ] DLB: Deleted derivative data file. [2025-10-14T18:27:40.935796] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLB took 40.5s. Estimated remaining: 4h 1m 52s. Rate: 7.2 symbols/min [2025-10-14T18:27:41.106860] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:41.113696] [DEBUG] [LOCAL ] DMA: Loaded 4704 existing records from primary storage. [2025-10-14T18:27:41.113887] [INFO ] [MAIN ] DMA: Loaded 4704 existing records. [2025-10-14T18:27:41.287001] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:41.287221] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-14T18:27:41.287267] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-14T18:27:41.287404] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-14T18:27:41.287442] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-14T18:27:41.560582] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-14T18:27:41.637523] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:42.358069] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-14T18:27:42.588613] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T18:27:42.614752] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T18:27:43.158060] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-14T18:27:43.391085] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T18:27:43.958069] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-14T18:27:44.585292] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T18:27:44.758046] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-14T18:27:44.932323] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T18:27:45.558060] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-14T18:27:46.363215] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-14T18:27:46.382130] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T18:27:46.525985] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T18:27:47.158108] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-14T18:27:47.610433] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T18:27:47.613806] [INFO ] [REMOTE ] DLX: Full fetch complete (41256 records). [2025-10-14T18:27:47.613904] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-14T18:27:47.968182] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-14T18:27:48.026753] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-14T18:27:48.029923] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-14T18:27:48.031892] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-14T18:27:48.032016] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-14T18:27:48.030685] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T18:27:48.039928] [INFO ] [REMOTE ] DLR: Full fetch complete (74100 records). [2025-10-14T18:27:48.040151] [DEBUG] [LOCAL ] DLX: Trimmed 41256 records to 28438 (keeping 200 days of data) [2025-10-14T18:27:48.040450] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-14T18:27:48.676556] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-14T18:27:48.677002] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-14T18:27:48.680512] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-14T18:27:48.680608] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-14T18:27:48.685849] [DEBUG] [LOCAL ] DLR: Trimmed 74100 records to 50730 (keeping 200 days of data) [2025-10-14T18:27:48.689483] [DEBUG] [LOCAL ] DLX: Primary data saved (28438 records). [2025-10-14T18:27:48.689579] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-14T18:27:48.689747] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DLX took 28.8s. Estimated remaining: 4h 1m 42s. Rate: 7.2 symbols/min [2025-10-14T18:27:48.810289] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-14T18:27:49.021461] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:49.157589] [DEBUG] [LOCAL ] DMB: Loaded 10219 existing records from primary storage. [2025-10-14T18:27:49.161423] [INFO ] [MAIN ] DMB: Loaded 10219 existing records. [2025-10-14T18:27:49.266914] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T18:27:49.394884] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:49.395245] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-14T18:27:49.395317] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-14T18:27:49.426906] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T18:27:49.450194] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-14T18:27:49.452435] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-14T18:27:49.556340] [DEBUG] [LOCAL ] DLR: Primary data saved (50730 records). [2025-10-14T18:27:49.561842] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-14T18:27:49.561580] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-14T18:27:49.567269] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DLR took 43.2s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-14T18:27:49.977105] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:27:50.071496] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:50.071888] [DEBUG] [LOCAL ] DMO: Loaded 9990 existing records from primary storage. [2025-10-14T18:27:50.072638] [INFO ] [MAIN ] DMO: Loaded 9990 existing records. [2025-10-14T18:27:50.179805] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T18:27:50.263129] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:27:50.263369] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-14T18:27:50.263419] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-14T18:27:50.263685] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-14T18:27:50.263742] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-14T18:27:50.362724] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-14T18:27:50.630448] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:27:51.158101] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-14T18:27:51.246188] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T18:27:51.715149] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T18:27:51.958097] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-14T18:27:52.758090] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-14T18:27:52.891003] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T18:27:53.401704] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T18:27:53.558075] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-14T18:27:54.140739] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T18:27:54.358127] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-14T18:27:54.898174] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T18:27:55.158104] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-14T18:27:55.864791] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T18:27:55.958044] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-14T18:27:56.758190] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-14T18:27:56.795595] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T18:27:57.558128] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-14T18:27:57.575196] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T18:27:58.137097] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-14T18:27:58.358076] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-14T18:27:58.906444] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T18:27:59.158081] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-14T18:27:59.931060] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T18:27:59.958032] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-14T18:28:00.413116] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T18:28:00.758136] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-14T18:28:01.295058] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-14T18:28:01.558064] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-14T18:28:02.358125] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-14T18:28:02.864833] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T18:28:02.896550] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T18:28:03.158115] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-14T18:28:03.706630] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T18:28:03.958120] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-14T18:28:04.758077] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-14T18:28:05.168198] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T18:28:05.171637] [INFO ] [REMOTE ] DLY: Full fetch complete (28432 records). [2025-10-14T18:28:05.171734] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-14T18:28:05.538492] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-14T18:28:05.538579] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-14T18:28:05.539155] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-14T18:28:05.539215] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-14T18:28:05.539962] [DEBUG] [LOCAL ] DLY: Trimmed 28432 records to 20477 (keeping 200 days of data) [2025-10-14T18:28:05.594688] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-14T18:28:05.652103] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T18:28:05.683937] [DEBUG] [LOCAL ] DLY: Primary data saved (20477 records). [2025-10-14T18:28:05.684071] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-14T18:28:05.684150] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 40.1s. Estimated remaining: 4h 1m 26s. Rate: 7.2 symbols/min [2025-10-14T18:28:05.855384] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:05.899502] [DEBUG] [LOCAL ] DNA: Loaded 48522 existing records from primary storage. [2025-10-14T18:28:05.899890] [INFO ] [MAIN ] DNA: Loaded 48522 existing records. [2025-10-14T18:28:06.086051] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:06.086257] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-14T18:28:06.086305] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-14T18:28:06.086585] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-14T18:28:06.086670] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-14T18:28:06.363145] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-14T18:28:06.453842] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:28:06.577564] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T18:28:06.760825] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-14T18:28:07.158120] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-14T18:28:07.812572] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T18:28:07.958039] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-14T18:28:08.720035] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T18:28:08.758029] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-14T18:28:09.298091] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T18:28:09.558053] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-14T18:28:10.268795] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T18:28:10.358055] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-14T18:28:11.158075] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-14T18:28:11.690919] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T18:28:11.958053] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-14T18:28:12.200957] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T18:28:12.389805] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T18:28:12.391161] [INFO ] [REMOTE ] DMA: Full fetch complete (6768 records). [2025-10-14T18:28:12.391266] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-14T18:28:12.763175] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-14T18:28:12.801576] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-14T18:28:12.801636] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-14T18:28:12.801855] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-14T18:28:12.801897] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-14T18:28:12.802277] [DEBUG] [LOCAL ] DMA: Trimmed 6768 records to 4725 (keeping 200 days of data) [2025-10-14T18:28:12.830021] [DEBUG] [LOCAL ] DMA: Primary data saved (4725 records). [2025-10-14T18:28:12.830107] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-14T18:28:12.830178] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMA took 31.9s. Estimated remaining: 4h 1m 14s. Rate: 7.2 symbols/min [2025-10-14T18:28:12.994589] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:13.035012] [DEBUG] [LOCAL ] DNOW: Loaded 43595 existing records from primary storage. [2025-10-14T18:28:13.035304] [INFO ] [MAIN ] DNOW: Loaded 43595 existing records. [2025-10-14T18:28:13.210759] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:13.210981] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-14T18:28:13.211029] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-14T18:28:13.211255] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-14T18:28:13.211312] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-14T18:28:13.554773] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:28:13.558023] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-14T18:28:14.358041] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-14T18:28:14.549159] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T18:28:15.051548] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T18:28:15.158054] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-14T18:28:15.187366] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T18:28:15.958073] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-14T18:28:16.758152] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-14T18:28:16.805504] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T18:28:17.558115] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-14T18:28:17.695450] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T18:28:17.992375] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-14T18:28:18.284857] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T18:28:18.358078] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-14T18:28:18.822612] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T18:28:19.158106] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-14T18:28:19.958111] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-14T18:28:19.973858] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T18:28:20.758100] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-14T18:28:21.404541] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T18:28:21.491358] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T18:28:21.493633] [INFO ] [REMOTE ] DMB: Full fetch complete (14690 records). [2025-10-14T18:28:21.493758] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-14T18:28:21.494383] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:28:21.494481] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:28:21.494537] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:28:21.494617] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-14T18:28:21.494732] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-14T18:28:21.494792] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-14T18:28:21.495019] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-14T18:28:21.495126] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMB took 32.8s. Estimated remaining: 4h 1m 7s. Rate: 7.2 symbols/min [2025-10-14T18:28:21.563159] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-14T18:28:21.696319] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:21.696471] [DEBUG] [LOCAL ] DNP: No existing data file found in primary storage. [2025-10-14T18:28:21.696508] [WARN ] [MAIN ] DNP: No existing data found, performing full refresh instead. [2025-10-14T18:28:21.696614] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-14T18:28:21.696718] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-14T18:28:21.696777] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-14T18:28:21.696810] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-14T18:28:22.049363] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:28:22.358082] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-14T18:28:23.158075] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-14T18:28:23.633258] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T18:28:23.716252] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:28:23.958098] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-14T18:28:23.967867] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T18:28:23.970189] [INFO ] [REMOTE ] DMO: Full fetch complete (14531 records). [2025-10-14T18:28:23.970492] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-14T18:28:24.382241] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-14T18:28:24.382348] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-14T18:28:24.382873] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-14T18:28:24.382940] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-14T18:28:24.383859] [DEBUG] [LOCAL ] DMO: Trimmed 14531 records to 9973 (keeping 200 days of data) [2025-10-14T18:28:24.453905] [DEBUG] [LOCAL ] DMO: Primary data saved (9973 records). [2025-10-14T18:28:24.454051] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-14T18:28:24.454132] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DMO took 34.9s. Estimated remaining: 4h 0m 44s. Rate: 7.2 symbols/min [2025-10-14T18:28:24.640553] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:24.695810] [DEBUG] [LOCAL ] DOC: Loaded 53550 existing records from primary storage. [2025-10-14T18:28:24.696169] [INFO ] [MAIN ] DOC: Loaded 53550 existing records. [2025-10-14T18:28:24.763152] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-14T18:28:24.875339] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:24.875529] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-14T18:28:24.875578] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-14T18:28:24.876151] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-14T18:28:24.876209] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-14T18:28:25.225466] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:28:25.329826] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T18:28:25.558131] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-14T18:28:26.196361] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T18:28:26.358087] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-14T18:28:26.748448] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T18:28:27.158069] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-14T18:28:27.707787] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T18:28:27.958065] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-14T18:28:28.712370] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T18:28:28.758027] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-14T18:28:29.558067] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-14T18:28:29.665108] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T18:28:30.192181] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T18:28:30.358093] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-14T18:28:31.158060] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-14T18:28:31.516676] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-14T18:28:31.737035] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T18:28:31.958100] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-14T18:28:32.326935] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T18:28:32.758074] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-14T18:28:33.558076] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-14T18:28:33.719279] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T18:28:34.061247] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T18:28:34.358084] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-14T18:28:35.158070] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-14T18:28:35.303013] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:28:35.684962] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T18:28:35.958068] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-14T18:28:36.489433] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T18:28:36.758072] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-14T18:28:37.558057] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-14T18:28:37.620174] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T18:28:38.024530] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T18:28:38.358068] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-14T18:28:39.060383] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T18:28:39.158115] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-14T18:28:39.958054] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-14T18:28:40.214888] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T18:28:40.249124] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T18:28:40.758123] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-14T18:28:41.515092] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T18:28:41.558030] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-14T18:28:42.169403] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T18:28:42.358051] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-14T18:28:42.696513] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T18:28:43.158091] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-14T18:28:43.385819] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T18:28:43.958065] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-14T18:28:44.705858] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T18:28:44.711172] [INFO ] [REMOTE ] DNOW: Full fetch complete (63071 records). [2025-10-14T18:28:44.711329] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-14T18:28:44.766523] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-14T18:28:45.126016] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T18:28:45.124884] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-14T18:28:45.132695] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-14T18:28:45.133844] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-14T18:28:45.134084] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-14T18:28:45.135310] [DEBUG] [LOCAL ] DNOW: Trimmed 63071 records to 43649 (keeping 200 days of data) [2025-10-14T18:28:45.382000] [DEBUG] [LOCAL ] DNOW: Primary data saved (43649 records). [2025-10-14T18:28:45.382158] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-14T18:28:45.382251] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNOW took 32.6s. Estimated remaining: 4h 1m 10s. Rate: 7.2 symbols/min [2025-10-14T18:28:45.558095] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-14T18:28:46.358078] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-14T18:28:46.692692] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-14T18:28:46.698318] [INFO ] [REMOTE ] DNA: Full fetch complete (71214 records). [2025-10-14T18:28:46.698443] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-14T18:28:47.001882] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T18:28:47.124337] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-14T18:28:47.124416] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-14T18:28:47.125263] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-14T18:28:47.125324] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-14T18:28:47.126611] [DEBUG] [LOCAL ] DNA: Trimmed 71214 records to 48569 (keeping 200 days of data) [2025-10-14T18:28:47.171126] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-14T18:28:47.402726] [DEBUG] [LOCAL ] DNA: Primary data saved (48569 records). [2025-10-14T18:28:47.402883] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-14T18:28:47.402968] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNA took 41.7s. Estimated remaining: 4h 0m 44s. Rate: 7.2 symbols/min [2025-10-14T18:28:48.400907] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T18:28:48.412186] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-14T18:28:48.537833] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T18:28:48.758112] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-14T18:28:50.088341] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T18:28:50.093140] [INFO ] [REMOTE ] DNP: Full fetch complete (48869 records). [2025-10-14T18:28:50.093372] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-14T18:28:50.548713] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-14T18:28:50.549047] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-14T18:28:50.559156] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-14T18:28:50.560340] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-14T18:28:50.560835] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-14T18:28:50.560737] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-14T18:28:50.563092] [DEBUG] [LOCAL ] DNP: Trimmed 48869 records to 33224 (keeping 200 days of data) [2025-10-14T18:28:50.765576] [DEBUG] [LOCAL ] DNP: Primary data saved (33224 records). [2025-10-14T18:28:50.765767] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-14T18:28:50.765862] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DNP took 29.3s. Estimated remaining: 4h 0m 22s. Rate: 7.2 symbols/min [2025-10-14T18:28:52.559020] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T18:28:52.571029] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-14T18:28:54.371873] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T18:28:54.383237] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-14T18:28:55.849018] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T18:28:55.860887] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-14T18:28:57.246811] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T18:28:57.252980] [INFO ] [REMOTE ] DOC: Full fetch complete (77557 records). [2025-10-14T18:28:57.253098] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-14T18:28:57.636872] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-14T18:28:57.636947] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-14T18:28:57.637831] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-14T18:28:57.637893] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-14T18:28:57.639304] [DEBUG] [LOCAL ] DOC: Trimmed 77557 records to 53552 (keeping 200 days of data) [2025-10-14T18:28:57.957874] [DEBUG] [LOCAL ] DOC: Primary data saved (53552 records). [2025-10-14T18:28:57.958028] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-14T18:28:57.958120] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOC took 33.5s. Estimated remaining: 4h 0m 11s. Rate: 7.2 symbols/min [2025-10-14T18:28:58.627515] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:58.579703] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:58.642063] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:58.676755] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:28:58.717055] [DEBUG] [LOCAL ] DOUG: Loaded 34290 existing records from primary storage. [2025-10-14T18:28:58.717424] [INFO ] [MAIN ] DOUG: Loaded 34290 existing records. [2025-10-14T18:28:58.834243] [DEBUG] [LOCAL ] DOLE: Loaded 39143 existing records from primary storage. [2025-10-14T18:28:58.846692] [INFO ] [MAIN ] DOLE: Loaded 39143 existing records. [2025-10-14T18:28:59.061261] [DEBUG] [LOCAL ] DOCN: Loaded 50954 existing records from primary storage. [2025-10-14T18:28:59.086416] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:59.028699] [DEBUG] [LOCAL ] DOCS: Loaded 50877 existing records from primary storage. [2025-10-14T18:28:59.096185] [INFO ] [MAIN ] DOCN: Loaded 50954 existing records. [2025-10-14T18:28:59.096303] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-14T18:28:59.096725] [INFO ] [MAIN ] DOCS: Loaded 50877 existing records. [2025-10-14T18:28:59.117900] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-14T18:28:59.157452] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-14T18:28:59.157610] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-14T18:28:59.341166] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:59.442375] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-14T18:28:59.477560] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-14T18:28:59.612709] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:59.626265] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-14T18:28:59.643380] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-14T18:28:59.643498] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-14T18:28:59.742350] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-14T18:28:59.733730] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:28:59.800735] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-14T18:28:59.810736] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-14T18:28:59.810683] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-14T18:28:59.848082] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-14T18:28:59.906778] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-14T18:28:59.957162] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-14T18:29:00.471521] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:00.516172] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-14T18:29:01.036134] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:01.076179] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:01.065490] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-14T18:29:01.083605] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-14T18:29:01.110881] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:01.111343] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-14T18:29:02.225799] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T18:29:02.234280] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-14T18:29:02.660015] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T18:29:02.667440] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-14T18:29:02.763212] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T18:29:02.772215] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-14T18:29:02.833402] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T18:29:02.844013] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-14T18:29:03.544621] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T18:29:03.552170] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-14T18:29:03.940583] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T18:29:03.949870] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-14T18:29:04.089098] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T18:29:04.096544] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-14T18:29:04.477778] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T18:29:04.488118] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-14T18:29:04.508717] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T18:29:04.516298] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-14T18:29:05.061170] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T18:29:05.068201] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-14T18:29:05.137212] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T18:29:05.146755] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-14T18:29:05.943933] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T18:29:05.951731] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-14T18:29:06.099944] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T18:29:06.107583] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-14T18:29:06.319186] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T18:29:06.358024] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-14T18:29:06.748079] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T18:29:06.920086] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T18:29:07.126606] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:29:07.158052] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-14T18:29:07.687563] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T18:29:07.958114] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-14T18:29:08.752632] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T18:29:08.760732] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-14T18:29:09.558105] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-14T18:29:09.795445] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T18:29:10.241094] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T18:29:10.358055] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-14T18:29:10.707746] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T18:29:11.158070] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-14T18:29:11.958040] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-14T18:29:12.381847] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T18:29:12.657017] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T18:29:12.758037] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-14T18:29:12.949201] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T18:29:13.558060] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-14T18:29:14.197053] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T18:29:14.358057] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-14T18:29:15.076529] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T18:29:15.158032] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-14T18:29:15.621735] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T18:29:15.958051] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-14T18:29:16.758074] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-14T18:29:17.292053] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-14T18:29:17.558097] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-14T18:29:17.844982] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T18:29:18.036478] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-14T18:29:18.358124] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-14T18:29:19.158053] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-14T18:29:19.353782] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T18:29:19.496887] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T18:29:19.958067] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-14T18:29:20.758095] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-14T18:29:20.849090] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T18:29:21.558042] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-14T18:29:21.626758] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T18:29:22.347918] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T18:29:22.358024] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-14T18:29:22.997264] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T18:29:23.158056] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-14T18:29:23.614800] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T18:29:23.619745] [INFO ] [REMOTE ] DOLE: Full fetch complete (54641 records). [2025-10-14T18:29:23.619845] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-14T18:29:23.963256] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-14T18:29:24.039605] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-14T18:29:24.039730] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-14T18:29:24.040613] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-14T18:29:24.040728] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-14T18:29:24.041989] [DEBUG] [LOCAL ] DOLE: Trimmed 54641 records to 39166 (keeping 200 days of data) [2025-10-14T18:29:24.295489] [DEBUG] [LOCAL ] DOLE: Primary data saved (39166 records). [2025-10-14T18:29:24.295677] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-14T18:29:24.295795] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOLE took 26.3s. Estimated remaining: 4h 0m 51s. Rate: 7.2 symbols/min [2025-10-14T18:29:24.495537] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:29:24.541327] [DEBUG] [LOCAL ] DOV: Loaded 45577 existing records from primary storage. [2025-10-14T18:29:24.541619] [INFO ] [MAIN ] DOV: Loaded 45577 existing records. [2025-10-14T18:29:24.725239] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:29:24.725580] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-14T18:29:24.725627] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-14T18:29:24.726021] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-14T18:29:24.726081] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-14T18:29:24.768760] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-14T18:29:24.884735] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T18:29:24.907679] [INFO ] [REMOTE ] DOCS: Full fetch complete (74122 records). [2025-10-14T18:29:24.927345] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-14T18:29:25.252738] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:25.537921] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-14T18:29:25.538015] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-14T18:29:25.538952] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-14T18:29:25.539014] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-14T18:29:25.540429] [DEBUG] [LOCAL ] DOCS: Trimmed 74122 records to 50810 (keeping 200 days of data) [2025-10-14T18:29:25.592773] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-14T18:29:25.651518] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T18:29:25.866754] [DEBUG] [LOCAL ] DOCS: Primary data saved (50810 records). [2025-10-14T18:29:25.866886] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-14T18:29:25.866965] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOCS took 27.9s. Estimated remaining: 4h 0m 24s. Rate: 7.2 symbols/min [2025-10-14T18:29:26.044440] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:29:26.094813] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-14T18:29:26.095133] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-14T18:29:26.281805] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:29:26.282016] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-14T18:29:26.282064] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-14T18:29:26.282497] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-14T18:29:26.282555] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-14T18:29:26.363205] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-14T18:29:26.655943] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:26.690011] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T18:29:27.158059] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-14T18:29:27.237321] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T18:29:27.816912] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T18:29:27.820778] [INFO ] [REMOTE ] DOUG: Full fetch complete (50651 records). [2025-10-14T18:29:27.820920] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-14T18:29:27.965045] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-14T18:29:28.209017] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-14T18:29:28.209091] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-14T18:29:28.209766] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-14T18:29:28.209826] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-14T18:29:28.210970] [DEBUG] [LOCAL ] DOUG: Trimmed 50651 records to 34291 (keeping 200 days of data) [2025-10-14T18:29:28.396692] [DEBUG] [LOCAL ] DOUG: Primary data saved (34291 records). [2025-10-14T18:29:28.396820] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-14T18:29:28.396924] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOUG took 30.4s. Estimated remaining: 4h 0m 0s. Rate: 7.2 symbols/min [2025-10-14T18:29:28.567305] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:29:28.582402] [DEBUG] [LOCAL ] DPG: Loaded 13590 existing records from primary storage. [2025-10-14T18:29:28.582595] [INFO ] [MAIN ] DPG: Loaded 13590 existing records. [2025-10-14T18:29:28.760624] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-14T18:29:28.765337] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:29:28.766806] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-14T18:29:28.766879] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-14T18:29:28.767498] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-14T18:29:28.767630] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-14T18:29:29.042591] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T18:29:29.173562] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:29.219243] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T18:29:29.558078] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-14T18:29:30.256466] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T18:29:30.358051] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-14T18:29:30.541298] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T18:29:30.936562] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T18:29:31.158094] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-14T18:29:31.958060] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-14T18:29:32.689862] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T18:29:32.758044] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-14T18:29:33.001811] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T18:29:33.007785] [INFO ] [REMOTE ] DOCN: Full fetch complete (72453 records). [2025-10-14T18:29:33.007914] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-14T18:29:33.397677] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-14T18:29:33.397768] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-14T18:29:33.398746] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-14T18:29:33.398833] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-14T18:29:33.400275] [DEBUG] [LOCAL ] DOCN: Trimmed 72453 records to 50992 (keeping 200 days of data) [2025-10-14T18:29:33.563102] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-14T18:29:33.701581] [DEBUG] [LOCAL ] DOCN: Primary data saved (50992 records). [2025-10-14T18:29:33.701736] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-14T18:29:33.701873] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCN took 35.7s. Estimated remaining: 3h 59m 44s. Rate: 7.2 symbols/min [2025-10-14T18:29:33.872265] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:29:33.914898] [DEBUG] [LOCAL ] DQ: Loaded 43622 existing records from primary storage. [2025-10-14T18:29:33.915190] [INFO ] [MAIN ] DQ: Loaded 43622 existing records. [2025-10-14T18:29:34.108319] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:29:34.108516] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-14T18:29:34.108563] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-14T18:29:34.108936] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-14T18:29:34.108992] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-14T18:29:34.370253] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-14T18:29:34.468987] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T18:29:34.506170] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:34.540176] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T18:29:35.158075] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-14T18:29:35.889730] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T18:29:35.958039] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-14T18:29:36.758091] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-14T18:29:36.953393] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T18:29:37.558044] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-14T18:29:37.677528] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T18:29:38.159788] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T18:29:38.358084] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-14T18:29:39.158044] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-14T18:29:39.587253] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T18:29:39.958047] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-14T18:29:40.267314] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T18:29:40.340215] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T18:29:40.680016] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T18:29:40.758027] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-14T18:29:41.344035] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T18:29:41.558069] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-14T18:29:42.358154] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-14T18:29:42.869766] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T18:29:43.133540] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T18:29:43.158029] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-14T18:29:43.958115] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-14T18:29:44.125096] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T18:29:44.758106] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-14T18:29:45.219428] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T18:29:45.558086] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-14T18:29:46.358063] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-14T18:29:46.452693] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T18:29:46.793887] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T18:29:47.158061] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-14T18:29:47.958065] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-14T18:29:48.016776] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T18:29:48.079309] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T18:29:48.758075] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-14T18:29:49.558079] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-14T18:29:49.646967] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T18:29:50.358054] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-14T18:29:50.879995] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-14T18:29:50.932210] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T18:29:51.158086] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-14T18:29:51.328300] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T18:29:51.330543] [INFO ] [REMOTE ] DPG: Full fetch complete (18996 records). [2025-10-14T18:29:51.330614] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-14T18:29:51.694841] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-14T18:29:51.694921] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-14T18:29:51.695378] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-14T18:29:51.695437] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-14T18:29:51.696054] [DEBUG] [LOCAL ] DPG: Trimmed 18996 records to 13595 (keeping 200 days of data) [2025-10-14T18:29:51.775718] [DEBUG] [LOCAL ] DPG: Primary data saved (13595 records). [2025-10-14T18:29:51.775845] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-14T18:29:51.775925] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 23.4s. Estimated remaining: 4h 0m 2s. Rate: 7.2 symbols/min [2025-10-14T18:29:51.947066] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:29:51.958046] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-14T18:29:51.984893] [DEBUG] [LOCAL ] DRD: Loaded 37620 existing records from primary storage. [2025-10-14T18:29:51.985154] [INFO ] [MAIN ] DRD: Loaded 37620 existing records. [2025-10-14T18:29:52.192230] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:29:52.192456] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-14T18:29:52.192514] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-14T18:29:52.192835] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-14T18:29:52.192901] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-14T18:29:52.547274] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:52.758035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-14T18:29:53.128501] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T18:29:53.558054] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-14T18:29:53.694598] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T18:29:53.944470] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T18:29:54.358059] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-14T18:29:54.473598] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T18:29:55.158074] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-14T18:29:55.958129] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-14T18:29:56.294317] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T18:29:56.630617] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-14T18:29:56.758060] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-14T18:29:57.500521] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T18:29:57.506427] [INFO ] [REMOTE ] DOV: Full fetch complete (65578 records). [2025-10-14T18:29:57.506612] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-14T18:29:57.570403] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-14T18:29:57.902749] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-14T18:29:57.902832] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-14T18:29:57.903716] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-14T18:29:57.903777] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-14T18:29:57.905143] [DEBUG] [LOCAL ] DOV: Trimmed 65578 records to 45600 (keeping 200 days of data) [2025-10-14T18:29:58.188168] [DEBUG] [LOCAL ] DOV: Primary data saved (45600 records). [2025-10-14T18:29:58.188292] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-14T18:29:58.188369] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DOV took 33.9s. Estimated remaining: 3h 59m 48s. Rate: 7.2 symbols/min [2025-10-14T18:29:58.357557] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:29:58.357756] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-14T18:29:58.357800] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-14T18:29:58.357908] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-14T18:29:58.357947] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-14T18:29:58.358035] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-14T18:29:58.358086] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-14T18:29:58.358181] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-14T18:29:58.720516] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:29:58.932479] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:29:58.972032] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-14T18:29:59.158096] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-14T18:29:59.958058] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-14T18:30:00.128777] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T18:30:00.758052] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-14T18:30:00.820230] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T18:30:01.558122] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-14T18:30:02.234422] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-14T18:30:02.270767] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T18:30:02.358068] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-14T18:30:03.158043] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-14T18:30:03.557369] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-14T18:30:03.951756] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T18:30:03.959513] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-14T18:30:04.758063] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-14T18:30:05.210154] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-14T18:30:05.216387] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-14T18:30:05.216506] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-14T18:30:05.559915] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-14T18:30:05.620395] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-14T18:30:05.620493] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-14T18:30:05.621480] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-14T18:30:05.621597] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-14T18:30:05.643496] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T18:30:05.651303] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-14T18:30:06.009627] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-14T18:30:06.010319] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-14T18:30:06.011899] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DOW took 40.1s. Estimated remaining: 3h 59m 38s. Rate: 7.2 symbols/min [2025-10-14T18:30:06.011674] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T18:30:06.192550] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:30:06.192796] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-14T18:30:06.192843] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-14T18:30:06.192966] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-14T18:30:06.193008] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-14T18:30:06.193048] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-14T18:30:06.193080] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-14T18:30:06.361147] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-14T18:30:06.551665] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:30:07.163134] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-14T18:30:07.177246] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T18:30:07.883026] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T18:30:07.958068] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-14T18:30:08.758129] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-14T18:30:08.985929] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T18:30:09.558092] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-14T18:30:09.729345] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T18:30:09.807116] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T18:30:10.358076] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-14T18:30:11.158130] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-14T18:30:11.958139] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-14T18:30:12.375462] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-14T18:30:12.450312] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T18:30:12.758117] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-14T18:30:13.180147] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (3.62 seconds). [2025-10-14T18:30:13.558123] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-14T18:30:13.729851] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T18:30:13.988887] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T18:30:14.358108] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-14T18:30:15.058564] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T18:30:15.158079] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-14T18:30:15.895877] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T18:30:15.958036] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-14T18:30:16.758101] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-14T18:30:17.558091] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-14T18:30:17.662209] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-14T18:30:17.667977] [INFO ] [REMOTE ] DQ: Full fetch complete (63563 records). [2025-10-14T18:30:17.668149] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-14T18:30:18.064827] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-14T18:30:18.064926] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-14T18:30:18.065770] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-14T18:30:18.065834] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-14T18:30:18.067135] [DEBUG] [LOCAL ] DQ: Trimmed 63563 records to 43704 (keeping 200 days of data) [2025-10-14T18:30:18.373556] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-14T18:30:18.391701] [DEBUG] [LOCAL ] DQ: Primary data saved (43704 records). [2025-10-14T18:30:18.392558] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-14T18:30:18.392731] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DQ took 44.7s. Estimated remaining: 3h 59m 41s. Rate: 7.2 symbols/min [2025-10-14T18:30:18.426781] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-14T18:30:18.567312] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:30:18.567484] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-14T18:30:18.567522] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-14T18:30:18.567636] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-14T18:30:18.567712] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-14T18:30:18.567759] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-14T18:30:18.567792] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-14T18:30:18.917763] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:30:18.981556] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T18:30:19.158039] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-14T18:30:19.963171] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-14T18:30:19.981839] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-10-14T18:30:20.505665] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T18:30:20.520920] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-14T18:30:20.758039] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-14T18:30:21.135149] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T18:30:21.558076] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-14T18:30:22.358028] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-14T18:30:22.426802] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T18:30:22.854924] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T18:30:23.158047] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-14T18:30:23.790597] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T18:30:23.795974] [INFO ] [REMOTE ] DRD: Full fetch complete (51091 records). [2025-10-14T18:30:23.796148] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-14T18:30:23.961109] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-14T18:30:24.189044] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-14T18:30:24.189127] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-14T18:30:24.189829] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-14T18:30:24.189889] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-14T18:30:24.190968] [DEBUG] [LOCAL ] DRD: Trimmed 51091 records to 37699 (keeping 200 days of data) [2025-10-14T18:30:24.423967] [DEBUG] [LOCAL ] DRD: Primary data saved (37699 records). [2025-10-14T18:30:24.424118] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-14T18:30:24.424316] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRD took 32.6s. Estimated remaining: 3h 59m 26s. Rate: 7.2 symbols/min [2025-10-14T18:30:24.630917] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:30:24.632761] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T18:30:24.671453] [DEBUG] [LOCAL ] DSL: Loaded 28681 existing records from primary storage. [2025-10-14T18:30:24.671729] [INFO ] [MAIN ] DSL: Loaded 28681 existing records. [2025-10-14T18:30:24.768155] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-14T18:30:24.858929] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:30:24.859144] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-14T18:30:24.859193] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-14T18:30:24.859527] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-14T18:30:24.859589] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-14T18:30:25.225888] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:30:25.558111] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-14T18:30:25.777756] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T18:30:26.228535] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T18:30:26.358037] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-14T18:30:26.485044] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T18:30:27.158048] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-14T18:30:27.958134] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-14T18:30:28.252150] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T18:30:28.437607] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T18:30:28.565104] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T18:30:28.758086] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-14T18:30:29.558083] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-14T18:30:30.358083] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-14T18:30:30.686475] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T18:30:31.158169] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-14T18:30:31.234030] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T18:30:31.549974] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T18:30:31.958135] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-14T18:30:32.211949] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T18:30:32.758097] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-14T18:30:33.350373] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T18:30:33.356147] [INFO ] [REMOTE ] DRH: Full fetch complete (72048 records). [2025-10-14T18:30:33.356260] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-14T18:30:33.467136] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T18:30:33.563243] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-14T18:30:33.765094] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-14T18:30:33.765169] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-14T18:30:33.766006] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-14T18:30:33.766066] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-14T18:30:33.767381] [DEBUG] [LOCAL ] DRH: Trimmed 72048 records to 50409 (keeping 200 days of data) [2025-10-14T18:30:34.060942] [DEBUG] [LOCAL ] DRH: Primary data saved (50409 records). [2025-10-14T18:30:34.061096] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-14T18:30:34.061175] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DRH took 35.9s. Estimated remaining: 3h 59m 21s. Rate: 7.2 symbols/min [2025-10-14T18:30:34.229614] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:30:34.245245] [DEBUG] [LOCAL ] DSM: Loaded 14307 existing records from primary storage. [2025-10-14T18:30:34.245462] [INFO ] [MAIN ] DSM: Loaded 14307 existing records. [2025-10-14T18:30:34.363216] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-14T18:30:34.440359] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:30:34.440842] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-14T18:30:34.441000] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-14T18:30:34.434760] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T18:30:34.441908] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-14T18:30:34.443884] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-14T18:30:34.947040] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:30:34.968753] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T18:30:34.976521] [INFO ] [REMOTE ] DRI: Full fetch complete (69161 records). [2025-10-14T18:30:34.976778] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-14T18:30:34.977913] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:30:34.978889] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:30:34.979017] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:30:34.979293] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-14T18:30:34.979422] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-14T18:30:34.979495] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-14T18:30:34.979568] [DEBUG] [LOCAL ] DRI: No derivative data file found to delete. [2025-10-14T18:30:34.979723] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DRI took 29.0s. Estimated remaining: 3h 58m 53s. Rate: 7.2 symbols/min [2025-10-14T18:30:35.163334] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-14T18:30:35.200981] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:30:35.206781] [DEBUG] [LOCAL ] DSMC: Loaded 1838 existing records from primary storage. [2025-10-14T18:30:35.207090] [INFO ] [MAIN ] DSMC: Loaded 1838 existing records. [2025-10-14T18:30:35.414051] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:30:35.414262] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-14T18:30:35.414310] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-14T18:30:35.414436] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-14T18:30:35.414475] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-14T18:30:35.799716] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:30:35.958046] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-14T18:30:36.345038] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T18:30:36.424862] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T18:30:36.758068] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-14T18:30:37.492960] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T18:30:37.558087] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-14T18:30:38.332094] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T18:30:38.358050] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-14T18:30:39.158094] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-14T18:30:39.366853] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T18:30:39.957094] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T18:30:39.960270] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-14T18:30:40.758053] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-14T18:30:41.212133] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T18:30:41.558078] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-14T18:30:41.921251] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T18:30:42.358079] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-14T18:30:42.951281] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T18:30:42.968091] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-14T18:30:43.158083] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-14T18:30:43.874813] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T18:30:43.876344] [INFO ] [REMOTE ] DRLL: Full fetch complete (14859 records). [2025-10-14T18:30:43.876415] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-14T18:30:43.963198] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-14T18:30:44.274491] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-14T18:30:44.274609] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-14T18:30:44.275383] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-14T18:30:44.275453] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-14T18:30:44.276449] [DEBUG] [LOCAL ] DRLL: Trimmed 14859 records to 9185 (keeping 200 days of data) [2025-10-14T18:30:44.342583] [DEBUG] [LOCAL ] DRLL: Primary data saved (9185 records). [2025-10-14T18:30:44.342770] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-14T18:30:44.342859] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DRLL took 25.9s. Estimated remaining: 3h 58m 48s. Rate: 7.2 symbols/min [2025-10-14T18:30:44.524182] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:30:44.547349] [DEBUG] [LOCAL ] DSU: Loaded 22953 existing records from primary storage. [2025-10-14T18:30:44.547634] [INFO ] [MAIN ] DSU: Loaded 22953 existing records. [2025-10-14T18:30:44.734741] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:30:44.735035] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-14T18:30:44.735092] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-14T18:30:44.735315] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-14T18:30:44.735378] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-14T18:30:44.765052] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-14T18:30:45.171089] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:30:45.453862] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T18:30:45.558053] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-14T18:30:45.674865] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T18:30:46.358044] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-14T18:30:46.656905] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T18:30:47.158064] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-14T18:30:47.177133] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T18:30:47.958064] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-14T18:30:48.294238] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T18:30:48.758109] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-14T18:30:48.830440] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T18:30:49.558070] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-14T18:30:49.871094] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T18:30:50.130782] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T18:30:50.358108] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-14T18:30:51.158044] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-14T18:30:51.357313] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T18:30:51.596725] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T18:30:51.958114] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-14T18:30:52.430249] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T18:30:52.758072] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-14T18:30:53.390329] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T18:30:53.558075] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-14T18:30:54.358052] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-14T18:30:54.503506] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:30:55.030969] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T18:30:55.158067] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-14T18:30:55.609050] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-14T18:30:55.958077] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-14T18:30:56.676857] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T18:30:56.758098] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-14T18:30:57.118065] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-14T18:30:57.558092] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-14T18:30:58.039715] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T18:30:58.358096] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-14T18:30:59.158061] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-14T18:30:59.745572] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T18:30:59.785152] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T18:30:59.958063] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-14T18:31:00.758046] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-14T18:31:00.884010] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T18:31:01.558094] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-14T18:31:01.679699] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T18:31:02.358118] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-14T18:31:02.558104] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T18:31:03.158129] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-14T18:31:03.256549] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T18:31:03.563036] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-14T18:31:03.958116] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-14T18:31:04.758103] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-14T18:31:04.938572] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T18:31:05.362802] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T18:31:05.364482] [INFO ] [REMOTE ] DSM: Full fetch complete (23902 records). [2025-10-14T18:31:05.364563] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-14T18:31:05.563198] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-14T18:31:05.757354] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-14T18:31:05.757430] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-14T18:31:05.757933] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-14T18:31:05.758016] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-14T18:31:05.758674] [DEBUG] [LOCAL ] DSM: Trimmed 23902 records to 14198 (keeping 200 days of data) [2025-10-14T18:31:05.837861] [DEBUG] [LOCAL ] DSM: Primary data saved (14198 records). [2025-10-14T18:31:05.838016] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-14T18:31:05.838104] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DSM took 31.8s. Estimated remaining: 3h 59m 14s. Rate: 7.2 symbols/min [2025-10-14T18:31:06.031262] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:31:06.061484] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T18:31:06.072485] [DEBUG] [LOCAL ] DSX: Loaded 24104 existing records from primary storage. [2025-10-14T18:31:06.072787] [INFO ] [MAIN ] DSX: Loaded 24104 existing records. [2025-10-14T18:31:06.251727] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:31:06.251955] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-14T18:31:06.252001] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-14T18:31:06.252164] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-14T18:31:06.252203] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-14T18:31:06.363244] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-14T18:31:06.611846] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:31:07.158123] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-14T18:31:07.741356] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T18:31:07.958129] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-14T18:31:08.304228] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T18:31:08.404874] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T18:31:08.758081] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-14T18:31:09.558062] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-14T18:31:09.832301] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T18:31:10.358062] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-14T18:31:10.744942] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T18:31:11.158079] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-14T18:31:11.270807] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T18:31:11.657238] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T18:31:11.658036] [INFO ] [REMOTE ] DSMC: Full fetch complete (2827 records). [2025-10-14T18:31:11.658107] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-14T18:31:11.658446] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:31:11.658526] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:31:11.658567] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:31:11.658604] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-14T18:31:11.658684] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-14T18:31:11.658738] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-14T18:31:11.658964] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-14T18:31:11.659049] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSMC took 36.7s. Estimated remaining: 3h 58m 59s. Rate: 7.2 symbols/min [2025-10-14T18:31:11.827461] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:31:11.877895] [DEBUG] [LOCAL ] DT: Loaded 52943 existing records from primary storage. [2025-10-14T18:31:11.878256] [INFO ] [MAIN ] DT: Loaded 52943 existing records. [2025-10-14T18:31:11.963435] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-14T18:31:12.060522] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:31:12.061378] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-14T18:31:12.061441] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-14T18:31:12.061983] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-14T18:31:12.062042] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-14T18:31:12.413798] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:31:12.758119] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-14T18:31:13.434409] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T18:31:13.438638] [INFO ] [REMOTE ] DSL: Full fetch complete (41603 records). [2025-10-14T18:31:13.438790] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-14T18:31:13.563159] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-14T18:31:13.851093] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-14T18:31:13.851204] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-14T18:31:13.852065] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-14T18:31:13.852136] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-14T18:31:13.853523] [DEBUG] [LOCAL ] DSL: Trimmed 41603 records to 28774 (keeping 200 days of data) [2025-10-14T18:31:14.040714] [DEBUG] [LOCAL ] DSL: Primary data saved (28774 records). [2025-10-14T18:31:14.040870] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-14T18:31:14.040957] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSL took 49.6s. Estimated remaining: 3h 58m 35s. Rate: 7.2 symbols/min [2025-10-14T18:31:14.218133] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:31:14.218316] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-14T18:31:14.218353] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-14T18:31:14.218471] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-14T18:31:14.218511] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-14T18:31:14.218550] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-14T18:31:14.218584] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-14T18:31:14.366465] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-14T18:31:14.597212] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:31:14.635225] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T18:31:14.770862] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T18:31:15.158086] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-14T18:31:15.304086] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T18:31:15.719515] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T18:31:15.958054] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-14T18:31:16.758269] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-14T18:31:17.256787] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:31:17.558062] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-14T18:31:18.102311] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T18:31:18.114311] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T18:31:18.358255] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-14T18:31:18.971701] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T18:31:19.158129] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-14T18:31:19.958107] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-14T18:31:20.450111] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T18:31:20.758299] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-14T18:31:21.236171] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T18:31:21.239342] [INFO ] [REMOTE ] DSU: Full fetch complete (32808 records). [2025-10-14T18:31:21.239448] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-14T18:31:21.239988] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:31:21.240072] [FATAL] [MAIN ] DSU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:31:21.240117] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:31:21.240199] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-14T18:31:21.240295] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-14T18:31:21.240370] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-10-14T18:31:21.240636] [DEBUG] [LOCAL ] DSU: Deleted derivative data file. [2025-10-14T18:31:21.240803] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DSU took 36.9s. Estimated remaining: 3h 58m 23s. Rate: 7.2 symbols/min [2025-10-14T18:31:21.422159] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:31:21.466981] [DEBUG] [LOCAL ] DTE: Loaded 47508 existing records from primary storage. [2025-10-14T18:31:21.467286] [INFO ] [MAIN ] DTE: Loaded 47508 existing records. [2025-10-14T18:31:21.565118] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-14T18:31:21.645406] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:31:21.645591] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-14T18:31:21.645638] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-14T18:31:21.645955] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-14T18:31:21.646015] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-14T18:31:22.027133] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T18:31:22.032359] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:31:22.203300] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T18:31:22.358054] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-14T18:31:23.158071] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-14T18:31:23.958095] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-14T18:31:24.072424] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T18:31:24.124593] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T18:31:24.758085] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-14T18:31:25.558048] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-14T18:31:25.581935] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T18:31:25.655517] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T18:31:26.319033] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T18:31:26.358038] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-14T18:31:27.158051] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-14T18:31:27.736956] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T18:31:27.958084] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-14T18:31:28.082101] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T18:31:28.758068] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-14T18:31:29.198100] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T18:31:29.558094] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-14T18:31:30.358119] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-14T18:31:30.392160] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T18:31:30.964431] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-14T18:31:31.158125] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-14T18:31:31.310527] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T18:31:31.958037] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-14T18:31:32.102846] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T18:31:32.758044] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-14T18:31:33.240257] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T18:31:33.558107] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-14T18:31:33.844554] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T18:31:34.358134] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-14T18:31:35.158100] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-14T18:31:35.309501] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T18:31:35.428574] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T18:31:35.431557] [INFO ] [REMOTE ] DSX: Full fetch complete (35797 records). [2025-10-14T18:31:35.431638] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-14T18:31:35.432185] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:31:35.432267] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:31:35.432310] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:31:35.432349] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-14T18:31:35.432418] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-14T18:31:35.432473] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-10-14T18:31:35.432688] [DEBUG] [LOCAL ] DSX: Deleted derivative data file. [2025-10-14T18:31:35.432796] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSX took 29.6s. Estimated remaining: 3h 58m 30s. Rate: 7.2 symbols/min [2025-10-14T18:31:35.599716] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:31:35.599894] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-14T18:31:35.599934] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-14T18:31:35.600067] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-14T18:31:35.600108] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-14T18:31:35.600148] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-14T18:31:35.600179] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-14T18:31:35.963193] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-14T18:31:35.998287] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:31:36.705459] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T18:31:36.738386] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T18:31:36.758069] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-14T18:31:37.558096] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-14T18:31:38.358124] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-14T18:31:38.447500] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:31:38.762340] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-14T18:31:39.158079] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-14T18:31:39.285723] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T18:31:39.425304] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-14T18:31:39.958066] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-14T18:31:40.218315] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-14T18:31:40.758068] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-14T18:31:41.083167] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-14T18:31:41.558075] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-14T18:31:42.213526] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T18:31:42.358063] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-14T18:31:43.158093] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-14T18:31:43.872002] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T18:31:43.958082] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-14T18:31:44.145990] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T18:31:44.432984] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T18:31:44.434109] [INFO ] [REMOTE ] DTB: Full fetch complete (6681 records). [2025-10-14T18:31:44.434188] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-14T18:31:44.434560] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:31:44.434638] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:31:44.434911] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:31:44.434958] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-14T18:31:44.435047] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-14T18:31:44.435093] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-14T18:31:44.435133] [DEBUG] [LOCAL ] DTB: No derivative data file found to delete. [2025-10-14T18:31:44.435199] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DTB took 30.4s. Estimated remaining: 3h 58m 24s. Rate: 7.2 symbols/min [2025-10-14T18:31:44.665335] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:31:44.675296] [DEBUG] [LOCAL ] DTG: Loaded 5799 existing records from primary storage. [2025-10-14T18:31:44.675558] [INFO ] [MAIN ] DTG: Loaded 5799 existing records. [2025-10-14T18:31:44.763367] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-14T18:31:44.905455] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:31:44.905736] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-14T18:31:44.905986] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-14T18:31:44.906128] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-14T18:31:44.906166] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-14T18:31:45.417007] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:31:45.558105] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-14T18:31:46.025448] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T18:31:46.358105] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-14T18:31:46.411433] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:31:46.899366] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T18:31:47.158082] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-14T18:31:47.762314] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T18:31:47.958062] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-14T18:31:48.758112] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-14T18:31:49.169686] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T18:31:49.558087] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-14T18:31:49.710229] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T18:31:50.249627] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T18:31:50.358075] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-14T18:31:51.025847] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T18:31:51.158070] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-14T18:31:51.958089] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-14T18:31:52.519616] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T18:31:52.535857] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T18:31:52.758084] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-14T18:31:53.558116] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-14T18:31:54.025576] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T18:31:54.358140] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-14T18:31:54.666950] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T18:31:54.795289] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T18:31:55.158119] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-14T18:31:55.958133] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-14T18:31:56.364605] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-14T18:31:56.722683] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:31:56.758069] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-14T18:31:57.254789] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T18:31:57.558087] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-14T18:31:58.154060] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T18:31:58.358127] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-14T18:31:59.118984] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T18:31:59.124702] [INFO ] [REMOTE ] DTE: Full fetch complete (68973 records). [2025-10-14T18:31:59.124865] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-14T18:31:59.163292] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-14T18:31:59.567779] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-14T18:31:59.567865] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-14T18:31:59.568906] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-14T18:31:59.568972] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-14T18:31:59.570573] [DEBUG] [LOCAL ] DTE: Trimmed 68973 records to 47472 (keeping 200 days of data) [2025-10-14T18:31:59.869523] [DEBUG] [LOCAL ] DTE: Primary data saved (47472 records). [2025-10-14T18:31:59.869696] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-14T18:31:59.869805] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTE took 38.6s. Estimated remaining: 3h 58m 34s. Rate: 7.2 symbols/min [2025-10-14T18:31:59.963401] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-14T18:32:00.050318] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:00.050505] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-14T18:32:00.050542] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-14T18:32:00.050681] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-14T18:32:00.050734] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-14T18:32:00.050776] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-14T18:32:00.050807] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-14T18:32:00.418800] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T18:32:00.425345] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:00.734425] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T18:32:00.758033] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-14T18:32:01.558067] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-14T18:32:01.823804] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:32:01.824201] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-14T18:32:01.824351] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:32:01.824430] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-14T18:32:01.824503] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:32:01.824578] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-14T18:32:01.824679] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-14T18:32:01.824746] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-14T18:32:01.824809] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-14T18:32:01.824890] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTK took 2.0s. Estimated remaining: 3h 58m 9s. Rate: 7.2 symbols/min [2025-10-14T18:32:02.030175] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:02.076281] [DEBUG] [LOCAL ] DTM: Loaded 43975 existing records from primary storage. [2025-10-14T18:32:02.076637] [INFO ] [MAIN ] DTM: Loaded 43975 existing records. [2025-10-14T18:32:02.257872] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:32:02.258138] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-14T18:32:02.258188] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-14T18:32:02.258527] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-14T18:32:02.258587] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-14T18:32:02.364422] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-14T18:32:02.641980] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:02.744185] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-14T18:32:02.778841] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T18:32:03.158055] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-14T18:32:03.452590] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-14T18:32:03.958069] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-14T18:32:04.758085] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-14T18:32:05.186724] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T18:32:05.558053] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-14T18:32:05.615436] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T18:32:05.621063] [INFO ] [REMOTE ] DT: Full fetch complete (76444 records). [2025-10-14T18:32:05.621242] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-14T18:32:05.622093] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:32:05.622185] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:32:05.622239] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:32:05.622313] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-14T18:32:05.622375] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-14T18:32:05.622409] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-10-14T18:32:05.622630] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-10-14T18:32:05.622769] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DT took 54.0s. Estimated remaining: 3h 57m 48s. Rate: 7.2 symbols/min [2025-10-14T18:32:05.792930] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:05.793121] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-14T18:32:05.793158] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-14T18:32:05.793272] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-14T18:32:05.793311] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-14T18:32:05.793352] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-14T18:32:05.793404] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-14T18:32:06.174242] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:06.358048] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-14T18:32:06.874169] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T18:32:07.158043] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-14T18:32:07.196414] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T18:32:07.197895] [INFO ] [REMOTE ] DTG: Full fetch complete (8807 records). [2025-10-14T18:32:07.198102] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-14T18:32:07.557662] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-14T18:32:07.557774] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-14T18:32:07.558032] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-14T18:32:07.558099] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-14T18:32:07.558497] [DEBUG] [LOCAL ] DTG: Trimmed 8807 records to 5793 (keeping 200 days of data) [2025-10-14T18:32:07.595412] [DEBUG] [LOCAL ] DTG: Primary data saved (5793 records). [2025-10-14T18:32:07.595549] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-14T18:32:07.595631] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 23.2s. Estimated remaining: 3h 57m 24s. Rate: 7.2 symbols/min [2025-10-14T18:32:07.766761] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:07.820129] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-14T18:32:07.820493] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-14T18:32:07.963235] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-14T18:32:08.000138] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:32:08.000385] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-14T18:32:08.000432] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-14T18:32:08.000946] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-14T18:32:08.001010] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-14T18:32:08.367740] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:08.758083] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-14T18:32:08.793205] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T18:32:08.898235] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T18:32:09.558071] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-14T18:32:10.211184] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-14T18:32:10.358055] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-14T18:32:10.651836] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T18:32:11.158105] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-14T18:32:11.958051] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-14T18:32:12.009453] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T18:32:12.398585] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T18:32:12.399456] [INFO ] [REMOTE ] DTF: Full fetch complete (1813 records). [2025-10-14T18:32:12.399528] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-14T18:32:12.593924] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-14T18:32:12.594264] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:32:12.594474] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:32:12.594627] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-14T18:32:12.594875] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-14T18:32:12.594989] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-14T18:32:12.595112] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-14T18:32:12.595235] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTF took 37.2s. Estimated remaining: 3h 57m 7s. Rate: 7.2 symbols/min [2025-10-14T18:32:12.773461] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:12.769563] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-14T18:32:12.813592] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T18:32:12.817402] [DEBUG] [LOCAL ] DUKB: Loaded 6319 existing records from primary storage. [2025-10-14T18:32:12.830026] [INFO ] [MAIN ] DUKB: Loaded 6319 existing records. [2025-10-14T18:32:13.013158] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:32:13.013400] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-14T18:32:13.013450] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-14T18:32:13.013819] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-14T18:32:13.013879] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-14T18:32:13.310019] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-14T18:32:13.418466] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:13.558074] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-14T18:32:14.358123] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-14T18:32:14.374383] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T18:32:15.158160] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-14T18:32:15.736060] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T18:32:15.958066] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-14T18:32:16.758055] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-14T18:32:17.061038] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T18:32:17.340824] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T18:32:17.558078] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-14T18:32:17.669634] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T18:32:18.358065] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-14T18:32:19.029809] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:32:19.158072] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-14T18:32:19.501805] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T18:32:19.958101] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-14T18:32:20.758090] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-14T18:32:21.081450] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T18:32:21.133129] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T18:32:21.196754] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T18:32:21.558119] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-14T18:32:22.131415] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T18:32:22.358071] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-14T18:32:23.105408] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T18:32:23.158133] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-14T18:32:23.958122] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-14T18:32:24.367383] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T18:32:24.541814] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T18:32:24.758081] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-14T18:32:25.540242] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-14T18:32:25.558031] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-14T18:32:26.362970] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T18:32:26.362101] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-14T18:32:27.158067] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-14T18:32:27.844147] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T18:32:27.958061] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-14T18:32:28.129995] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T18:32:28.758066] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-14T18:32:29.483541] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T18:32:29.558049] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-14T18:32:29.654903] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T18:32:30.358038] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-14T18:32:31.045432] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T18:32:31.158082] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-14T18:32:31.384208] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T18:32:31.958068] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-14T18:32:32.523032] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T18:32:32.718038] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:32:32.758051] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-14T18:32:33.344240] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T18:32:33.558075] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-14T18:32:33.930450] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-14T18:32:34.358078] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-14T18:32:35.158067] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-14T18:32:35.854727] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T18:32:35.938393] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T18:32:35.944276] [INFO ] [REMOTE ] DTM: Full fetch complete (64576 records). [2025-10-14T18:32:35.944584] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-14T18:32:35.945717] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:32:35.945809] [FATAL] [MAIN ] DTM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:32:35.945852] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:32:35.945895] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-14T18:32:35.945954] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-14T18:32:35.946012] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-14T18:32:35.946215] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-14T18:32:35.946322] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DTM took 34.1s. Estimated remaining: 3h 57m 37s. Rate: 7.2 symbols/min [2025-10-14T18:32:35.967363] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-14T18:32:36.140399] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:36.194369] [DEBUG] [LOCAL ] DV: Loaded 51298 existing records from primary storage. [2025-10-14T18:32:36.194753] [INFO ] [MAIN ] DV: Loaded 51298 existing records. [2025-10-14T18:32:36.383443] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:32:36.383633] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-14T18:32:36.383781] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-14T18:32:36.384219] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-14T18:32:36.384269] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-14T18:32:36.748150] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:36.758037] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-14T18:32:37.558066] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-14T18:32:38.038312] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-14T18:32:38.098417] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-14T18:32:38.314180] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T18:32:38.358105] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-14T18:32:39.158068] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-14T18:32:39.786319] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T18:32:39.864614] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T18:32:39.958061] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-14T18:32:40.670791] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T18:32:40.671841] [INFO ] [REMOTE ] DTW: Full fetch complete (7299 records). [2025-10-14T18:32:40.671909] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-14T18:32:40.763162] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-14T18:32:41.029315] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-14T18:32:41.029387] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-14T18:32:41.029567] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-14T18:32:41.029603] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-14T18:32:41.029997] [DEBUG] [LOCAL ] DTW: Trimmed 7299 records to 4895 (keeping 200 days of data) [2025-10-14T18:32:41.058513] [DEBUG] [LOCAL ] DTW: Primary data saved (4895 records). [2025-10-14T18:32:41.058579] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-14T18:32:41.058638] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DTW took 35.4s. Estimated remaining: 3h 57m 20s. Rate: 7.2 symbols/min [2025-10-14T18:32:41.230052] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:41.230246] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-10-14T18:32:41.230287] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-10-14T18:32:41.230421] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-14T18:32:41.230515] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-14T18:32:41.230577] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-14T18:32:41.230615] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-14T18:32:41.564924] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-14T18:32:41.587204] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:42.235710] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T18:32:42.261216] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T18:32:42.262210] [INFO ] [REMOTE ] DUKB: Full fetch complete (9302 records). [2025-10-14T18:32:42.262276] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-14T18:32:42.363238] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-14T18:32:42.648922] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-14T18:32:42.648994] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-14T18:32:42.649212] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-14T18:32:42.649248] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-14T18:32:42.649638] [DEBUG] [LOCAL ] DUKB: Trimmed 9302 records to 6297 (keeping 200 days of data) [2025-10-14T18:32:42.689893] [DEBUG] [LOCAL ] DUKB: Primary data saved (6297 records). [2025-10-14T18:32:42.690014] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-14T18:32:42.690092] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DUKB took 30.1s. Estimated remaining: 3h 56m 55s. Rate: 7.2 symbols/min [2025-10-14T18:32:42.855522] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:42.855711] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-14T18:32:42.855759] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-14T18:32:42.855879] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-14T18:32:42.855919] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-14T18:32:42.855959] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-14T18:32:42.855991] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-14T18:32:43.165358] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-14T18:32:43.208405] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:43.958111] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-14T18:32:44.758085] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-14T18:32:44.808722] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-14T18:32:45.017472] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T18:32:45.558115] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-14T18:32:46.358089] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-14T18:32:47.008513] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-14T18:32:47.158161] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-14T18:32:47.191756] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (3.23 seconds). [2025-10-14T18:32:47.497995] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-14T18:32:47.958086] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-14T18:32:48.291491] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T18:32:48.758078] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-14T18:32:48.820033] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T18:32:49.558101] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-14T18:32:49.818558] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T18:32:50.016444] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-14T18:32:50.306528] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T18:32:50.312086] [INFO ] [REMOTE ] DUK: Full fetch complete (77163 records). [2025-10-14T18:32:50.312220] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-14T18:32:50.312927] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:32:50.313030] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:32:50.313100] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:32:50.313186] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-14T18:32:50.313261] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-14T18:32:50.313297] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-14T18:32:50.313538] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-10-14T18:32:50.314263] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DUK took 42.7s. Estimated remaining: 3h 56m 45s. Rate: 7.2 symbols/min [2025-10-14T18:32:50.363167] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-14T18:32:50.497783] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:32:50.556213] [DEBUG] [LOCAL ] DX: Loaded 52474 existing records from primary storage. [2025-10-14T18:32:50.556564] [INFO ] [MAIN ] DX: Loaded 52474 existing records. [2025-10-14T18:32:50.736635] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:32:50.736862] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-14T18:32:50.736910] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-14T18:32:50.737363] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-14T18:32:50.737421] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-14T18:32:51.091333] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:32:51.158037] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-14T18:32:51.958043] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-14T18:32:52.076702] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T18:32:52.758110] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-14T18:32:52.893018] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T18:32:53.289677] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T18:32:53.558074] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-14T18:32:54.358086] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-14T18:32:54.496834] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T18:32:54.885868] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T18:32:55.158093] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-14T18:32:55.958110] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-14T18:32:56.090667] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T18:32:56.758132] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-14T18:32:56.792756] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T18:32:57.558042] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-14T18:32:57.622299] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T18:32:58.165594] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T18:32:58.358059] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-14T18:32:58.663634] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T18:32:59.158080] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-14T18:32:59.958084] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-14T18:33:00.290461] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T18:33:00.758084] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-14T18:33:00.977677] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T18:33:01.332730] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:33:01.558085] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-14T18:33:02.312419] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T18:33:02.358055] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-14T18:33:03.144982] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T18:33:03.158025] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-14T18:33:03.918169] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:33:03.958083] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-14T18:33:04.270272] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T18:33:04.758116] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-14T18:33:05.558041] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-14T18:33:05.996594] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T18:33:06.150865] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T18:33:06.157285] [INFO ] [REMOTE ] DV: Full fetch complete (73763 records). [2025-10-14T18:33:06.157480] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-14T18:33:06.364531] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-14T18:33:06.568082] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-14T18:33:06.568221] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-14T18:33:06.569104] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-14T18:33:06.569168] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-14T18:33:06.570863] [DEBUG] [LOCAL ] DV: Trimmed 73763 records to 51304 (keeping 200 days of data) [2025-10-14T18:33:06.866430] [DEBUG] [LOCAL ] DV: Primary data saved (51304 records). [2025-10-14T18:33:06.866565] [INFO ] [MAIN ] DV: Full history saved. [2025-10-14T18:33:06.866667] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DV took 30.9s. Estimated remaining: 3h 56m 57s. Rate: 7.2 symbols/min [2025-10-14T18:33:07.040454] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:07.079671] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T18:33:07.126615] [DEBUG] [LOCAL ] DXC: Loaded 49851 existing records from primary storage. [2025-10-14T18:33:07.126974] [INFO ] [MAIN ] DXC: Loaded 49851 existing records. [2025-10-14T18:33:07.163259] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-14T18:33:07.310826] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:33:07.311079] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-14T18:33:07.311126] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-14T18:33:07.311444] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-14T18:33:07.311501] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-14T18:33:07.664797] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:07.958065] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-14T18:33:08.243168] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T18:33:08.763176] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-14T18:33:08.781476] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:33:09.103050] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T18:33:09.107869] [INFO ] [REMOTE ] DVA: Full fetch complete (59698 records). [2025-10-14T18:33:09.108040] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-14T18:33:09.526397] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-14T18:33:09.526481] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-14T18:33:09.527312] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-14T18:33:09.527375] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-14T18:33:09.528637] [DEBUG] [LOCAL ] DVA: Trimmed 59698 records to 40980 (keeping 200 days of data) [2025-10-14T18:33:09.586060] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-14T18:33:09.782260] [DEBUG] [LOCAL ] DVA: Primary data saved (40980 records). [2025-10-14T18:33:09.782396] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-14T18:33:09.782472] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DVA took 28.7s. Estimated remaining: 3h 56m 35s. Rate: 7.2 symbols/min [2025-10-14T18:33:09.955621] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:09.990620] [DEBUG] [LOCAL ] DXYZ: Loaded 37107 existing records from primary storage. [2025-10-14T18:33:09.990946] [INFO ] [MAIN ] DXYZ: Loaded 37107 existing records. [2025-10-14T18:33:10.175832] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:33:10.176147] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-14T18:33:10.176205] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-14T18:33:10.176823] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-14T18:33:10.176886] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-14T18:33:10.309736] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T18:33:10.364032] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-14T18:33:10.580572] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:11.158083] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-14T18:33:11.361133] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T18:33:11.424111] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T18:33:11.958087] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-14T18:33:12.758066] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-14T18:33:13.558063] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-14T18:33:13.982360] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T18:33:14.105447] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-10-14T18:33:14.183578] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T18:33:14.358087] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-14T18:33:15.158081] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-14T18:33:15.345587] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T18:33:15.958076] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-14T18:33:16.046766] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T18:33:16.758094] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-14T18:33:16.899000] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T18:33:17.558152] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-14T18:33:18.358096] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-14T18:33:18.468843] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-14T18:33:18.837353] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T18:33:19.082507] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-14T18:33:19.158084] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-14T18:33:19.958068] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-14T18:33:20.324616] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T18:33:20.758111] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-14T18:33:21.210640] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-14T18:33:21.255794] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T18:33:21.558068] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-14T18:33:22.256952] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T18:33:22.358101] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-14T18:33:23.158071] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-14T18:33:23.292920] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T18:33:23.958153] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-14T18:33:24.667421] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-14T18:33:24.758070] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-14T18:33:25.211040] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-14T18:33:25.558091] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-14T18:33:25.663291] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T18:33:25.952299] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T18:33:25.958849] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-14T18:33:25.959080] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-14T18:33:25.960310] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:33:25.960410] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:33:25.960456] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:33:25.960503] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-14T18:33:25.960571] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-14T18:33:25.960609] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-14T18:33:25.960733] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-14T18:33:25.960820] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DVN took 43.3s. Estimated remaining: 3h 56m 46s. Rate: 7.2 symbols/min [2025-10-14T18:33:26.162734] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:26.200756] [DEBUG] [LOCAL ] DY: Loaded 28501 existing records from primary storage. [2025-10-14T18:33:26.201284] [INFO ] [MAIN ] DY: Loaded 28501 existing records. [2025-10-14T18:33:26.364128] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-14T18:33:26.358837] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T18:33:26.444019] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:33:26.444775] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-14T18:33:26.444840] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-14T18:33:26.445183] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-14T18:33:26.445250] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-14T18:33:26.818875] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:27.158116] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-14T18:33:27.958577] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-14T18:33:27.967633] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T18:33:27.973930] [INFO ] [REMOTE ] DX: Full fetch complete (75748 records). [2025-10-14T18:33:27.974089] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-14T18:33:28.368110] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-14T18:33:28.368188] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-14T18:33:28.369088] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-14T18:33:28.369150] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-14T18:33:28.370681] [DEBUG] [LOCAL ] DX: Trimmed 75748 records to 52505 (keeping 200 days of data) [2025-10-14T18:33:28.693937] [DEBUG] [LOCAL ] DX: Primary data saved (52505 records). [2025-10-14T18:33:28.694211] [INFO ] [MAIN ] DX: Full history saved. [2025-10-14T18:33:28.694317] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DX took 38.4s. Estimated remaining: 3h 56m 24s. Rate: 7.2 symbols/min [2025-10-14T18:33:28.764618] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-14T18:33:28.909551] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:28.913007] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T18:33:28.954983] [DEBUG] [LOCAL ] E: Loaded 33186 existing records from primary storage. [2025-10-14T18:33:28.955291] [INFO ] [MAIN ] E: Loaded 33186 existing records. [2025-10-14T18:33:29.129508] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:33:29.129771] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-14T18:33:29.129822] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-14T18:33:29.130000] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-14T18:33:29.130037] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-14T18:33:29.481582] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:29.558044] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-14T18:33:29.644966] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:33:29.976005] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T18:33:30.358095] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-14T18:33:31.162687] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-14T18:33:31.171223] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T18:33:31.654513] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:33:31.958064] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-14T18:33:32.225416] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T18:33:32.758121] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-14T18:33:33.252778] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T18:33:33.558100] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-14T18:33:33.956049] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T18:33:33.961330] [INFO ] [REMOTE ] DXC: Full fetch complete (69602 records). [2025-10-14T18:33:33.961440] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-14T18:33:33.962078] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:33:33.962186] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:33:33.962229] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:33:33.962266] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-14T18:33:33.962322] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-14T18:33:33.962361] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-14T18:33:33.962633] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-14T18:33:33.962751] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DXC took 27.1s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-14T18:33:34.141080] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:34.179638] [DEBUG] [LOCAL ] EAF: Loaded 41883 existing records from primary storage. [2025-10-14T18:33:34.179952] [INFO ] [MAIN ] EAF: Loaded 41883 existing records. [2025-10-14T18:33:34.357470] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:33:34.357745] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-14T18:33:34.357796] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-14T18:33:34.358082] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-14T18:33:34.358197] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-14T18:33:34.358037] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-14T18:33:34.718084] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:35.158045] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-14T18:33:35.632441] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-14T18:33:35.657218] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T18:33:35.958070] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-14T18:33:36.275286] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T18:33:36.758066] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-14T18:33:37.475870] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T18:33:37.558063] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-14T18:33:38.232624] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:33:38.358060] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-14T18:33:39.158064] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-14T18:33:39.277431] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T18:33:39.970388] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-14T18:33:39.972608] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T18:33:40.436112] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T18:33:40.758065] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-14T18:33:41.558069] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-14T18:33:41.781567] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T18:33:41.980358] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T18:33:42.358150] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-14T18:33:43.126751] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T18:33:43.158029] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-14T18:33:43.362003] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T18:33:43.958114] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-14T18:33:44.758042] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-14T18:33:44.862019] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T18:33:45.558097] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-14T18:33:45.897934] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T18:33:46.363831] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-14T18:33:46.366297] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T18:33:47.158122] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-14T18:33:47.333574] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:33:47.803956] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T18:33:47.958066] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-14T18:33:48.038962] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T18:33:48.758086] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-14T18:33:49.558064] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-14T18:33:50.032950] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-14T18:33:50.037984] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57277 records). [2025-10-14T18:33:50.038130] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-14T18:33:50.360243] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-14T18:33:50.485054] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-14T18:33:50.485215] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-14T18:33:50.486385] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-14T18:33:50.486862] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-14T18:33:50.488285] [DEBUG] [LOCAL ] DXYZ: Trimmed 57277 records to 37165 (keeping 200 days of data) [2025-10-14T18:33:50.571241] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T18:33:50.735628] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T18:33:50.772861] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37165 records). [2025-10-14T18:33:50.773040] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-14T18:33:50.773145] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DXYZ took 41.0s. Estimated remaining: 3h 56m 21s. Rate: 7.2 symbols/min [2025-10-14T18:33:50.949628] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:50.956532] [DEBUG] [LOCAL ] EAI: Loaded 4003 existing records from primary storage. [2025-10-14T18:33:50.956792] [INFO ] [MAIN ] EAI: Loaded 4003 existing records. [2025-10-14T18:33:51.133566] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:33:51.133827] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-14T18:33:51.133875] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-14T18:33:51.134037] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-14T18:33:51.134092] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-14T18:33:51.164594] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-14T18:33:51.526355] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:51.548227] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T18:33:51.958077] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-14T18:33:52.676727] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T18:33:52.758102] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-14T18:33:53.398267] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T18:33:53.558060] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-14T18:33:54.297972] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T18:33:54.358089] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-14T18:33:54.464292] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T18:33:55.158070] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-14T18:33:55.732441] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:33:55.958084] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-14T18:33:56.156480] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T18:33:56.758084] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-14T18:33:57.558062] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-14T18:33:57.699405] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T18:33:57.895057] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T18:33:57.898036] [INFO ] [REMOTE ] DY: Full fetch complete (43629 records). [2025-10-14T18:33:57.898137] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-14T18:33:58.292064] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-14T18:33:58.292152] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-14T18:33:58.292866] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-14T18:33:58.292931] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-14T18:33:58.294101] [DEBUG] [LOCAL ] DY: Trimmed 43629 records to 28437 (keeping 200 days of data) [2025-10-14T18:33:58.385080] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-14T18:33:58.482263] [DEBUG] [LOCAL ] DY: Primary data saved (28437 records). [2025-10-14T18:33:58.482410] [INFO ] [MAIN ] DY: Full history saved. [2025-10-14T18:33:58.482490] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. DY took 32.5s. Estimated remaining: 3h 56m 11s. Rate: 7.2 symbols/min [2025-10-14T18:33:58.653764] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:33:58.653917] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-14T18:33:58.653953] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-14T18:33:58.654058] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-14T18:33:58.654099] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-14T18:33:58.654138] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-14T18:33:58.654169] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-14T18:33:59.007155] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:33:59.012118] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T18:33:59.158044] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-14T18:33:59.246191] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T18:33:59.958086] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-14T18:34:00.395105] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T18:34:00.758104] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-14T18:34:01.499397] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T18:34:01.558074] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-14T18:34:01.846083] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T18:34:02.358065] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-14T18:34:02.440417] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T18:34:03.158094] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-14T18:34:03.711567] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T18:34:03.733032] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T18:34:03.958104] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-14T18:34:04.758066] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-14T18:34:05.236138] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-14T18:34:05.381329] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T18:34:05.558085] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-14T18:34:06.358081] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-14T18:34:07.008844] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T18:34:07.158075] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-14T18:34:07.346713] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T18:34:07.350409] [INFO ] [REMOTE ] EAF: Full fetch complete (62822 records). [2025-10-14T18:34:07.350535] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-14T18:34:07.744704] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-14T18:34:07.744795] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-14T18:34:07.745544] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-14T18:34:07.745585] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-14T18:34:07.746802] [DEBUG] [LOCAL ] EAF: Trimmed 62822 records to 41759 (keeping 200 days of data) [2025-10-14T18:34:07.958792] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-14T18:34:07.976587] [DEBUG] [LOCAL ] EAF: Primary data saved (41759 records). [2025-10-14T18:34:07.976760] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-14T18:34:07.976864] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAF took 34.0s. Estimated remaining: 3h 56m 5s. Rate: 7.2 symbols/min [2025-10-14T18:34:08.150268] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:08.150467] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-10-14T18:34:08.150505] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-10-14T18:34:08.150615] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-14T18:34:08.150704] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-14T18:34:08.150760] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-14T18:34:08.150794] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-14T18:34:08.508139] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:08.736416] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T18:34:08.758066] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-14T18:34:09.077003] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T18:34:09.081435] [INFO ] [REMOTE ] E: Full fetch complete (47908 records). [2025-10-14T18:34:09.081611] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-14T18:34:09.458357] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-14T18:34:09.458441] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-14T18:34:09.459267] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-14T18:34:09.459335] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-14T18:34:09.460506] [DEBUG] [LOCAL ] E: Trimmed 47908 records to 33236 (keeping 200 days of data) [2025-10-14T18:34:09.558248] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-14T18:34:09.663702] [DEBUG] [LOCAL ] E: Primary data saved (33236 records). [2025-10-14T18:34:09.663838] [INFO ] [MAIN ] E: Full history saved. [2025-10-14T18:34:09.663923] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. E took 41.0s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-14T18:34:09.829937] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:09.863698] [DEBUG] [LOCAL ] EB: Loaded 36701 existing records from primary storage. [2025-10-14T18:34:09.864020] [INFO ] [MAIN ] EB: Loaded 36701 existing records. [2025-10-14T18:34:10.052178] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:34:10.052761] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-14T18:34:10.052831] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-14T18:34:10.053389] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-14T18:34:10.053463] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-14T18:34:10.184673] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T18:34:10.367062] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-14T18:34:10.448491] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:10.905199] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T18:34:11.133411] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T18:34:11.158062] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-14T18:34:11.958082] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-14T18:34:12.758088] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-14T18:34:12.888094] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T18:34:13.112617] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T18:34:13.558035] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-14T18:34:13.790353] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T18:34:14.149544] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T18:34:14.358084] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-14T18:34:15.158100] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-14T18:34:15.958050] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-14T18:34:16.000629] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T18:34:16.350676] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T18:34:16.758089] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-14T18:34:17.318918] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T18:34:17.558041] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-14T18:34:17.592018] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T18:34:18.117467] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T18:34:18.358058] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-14T18:34:19.003583] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T18:34:19.004496] [INFO ] [REMOTE ] EAI: Full fetch complete (6061 records). [2025-10-14T18:34:19.004563] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-14T18:34:19.164204] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-14T18:34:19.377374] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-14T18:34:19.377445] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-14T18:34:19.377598] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-14T18:34:19.377634] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-14T18:34:19.378051] [DEBUG] [LOCAL ] EAI: Trimmed 6061 records to 3991 (keeping 200 days of data) [2025-10-14T18:34:19.401884] [DEBUG] [LOCAL ] EAI: Primary data saved (3991 records). [2025-10-14T18:34:19.401950] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-14T18:34:19.402018] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAI took 28.6s. Estimated remaining: 3h 55m 35s. Rate: 7.2 symbols/min [2025-10-14T18:34:19.958092] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-14T18:34:20.758052] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-14T18:34:20.951715] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T18:34:21.007267] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T18:34:21.548810] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T18:34:21.558031] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-14T18:34:22.358055] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-14T18:34:22.783542] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T18:34:23.158162] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-14T18:34:23.958188] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-14T18:34:24.285184] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T18:34:24.314720] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T18:34:24.758094] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-14T18:34:25.415856] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T18:34:25.558059] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-14T18:34:26.358167] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-14T18:34:26.545374] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T18:34:27.035914] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T18:34:27.158102] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-14T18:34:27.410011] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T18:34:27.958112] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-14T18:34:28.758067] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-14T18:34:28.883039] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T18:34:28.906156] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T18:34:28.909892] [INFO ] [REMOTE ] EARN: Full fetch complete (45658 records). [2025-10-14T18:34:28.909995] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-14T18:34:29.301966] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-14T18:34:29.302050] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-14T18:34:29.302810] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-14T18:34:29.302874] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-14T18:34:29.303982] [DEBUG] [LOCAL ] EARN: Trimmed 45658 records to 28749 (keeping 200 days of data) [2025-10-14T18:34:29.486215] [DEBUG] [LOCAL ] EARN: Primary data saved (28749 records). [2025-10-14T18:34:29.486359] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-14T18:34:29.486449] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EARN took 31.0s. Estimated remaining: 3h 55m 31s. Rate: 7.2 symbols/min [2025-10-14T18:34:29.558106] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-14T18:34:29.945244] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T18:34:30.358079] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-14T18:34:30.968113] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T18:34:31.158094] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-14T18:34:31.704249] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T18:34:31.958064] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-14T18:34:32.611311] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T18:34:32.758057] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-14T18:34:33.422589] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T18:34:33.558091] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-14T18:34:34.488140] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T18:34:34.500173] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-14T18:34:34.885377] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T18:34:35.158066] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-14T18:34:36.216752] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T18:34:36.223393] [INFO ] [REMOTE ] EAT: Full fetch complete (72338 records). [2025-10-14T18:34:36.223506] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-14T18:34:36.618050] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-14T18:34:36.618136] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-14T18:34:36.619098] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-14T18:34:36.619162] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-14T18:34:36.620636] [DEBUG] [LOCAL ] EAT: Trimmed 72338 records to 49892 (keeping 200 days of data) [2025-10-14T18:34:36.727527] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T18:34:36.738131] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-14T18:34:36.948275] [DEBUG] [LOCAL ] EAT: Primary data saved (49892 records). [2025-10-14T18:34:36.948398] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-14T18:34:36.948504] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EAT took 29.0s. Estimated remaining: 3h 55m 20s. Rate: 7.2 symbols/min [2025-10-14T18:34:38.184469] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T18:34:38.189387] [INFO ] [REMOTE ] EB: Full fetch complete (55534 records). [2025-10-14T18:34:38.189512] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-14T18:34:38.591892] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-14T18:34:38.591970] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-14T18:34:38.593022] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-14T18:34:38.593114] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-14T18:34:38.594444] [DEBUG] [LOCAL ] EB: Trimmed 55534 records to 36591 (keeping 200 days of data) [2025-10-14T18:34:38.817261] [DEBUG] [LOCAL ] EB: Primary data saved (36591 records). [2025-10-14T18:34:38.817394] [INFO ] [MAIN ] EB: Full history saved. [2025-10-14T18:34:38.817473] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EB took 29.2s. Estimated remaining: 3h 54m 56s. Rate: 7.2 symbols/min [2025-10-14T18:34:39.403422] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:39.489433] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:39.484478] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:39.563191] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:39.563601] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-14T18:34:39.563770] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-14T18:34:39.563881] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-14T18:34:39.563919] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-14T18:34:39.563958] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-14T18:34:39.563991] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-14T18:34:39.811307] [DEBUG] [LOCAL ] EBR: Loaded 43212 existing records from primary storage. [2025-10-14T18:34:39.828979] [DEBUG] [LOCAL ] EBS: Loaded 46756 existing records from primary storage. [2025-10-14T18:34:39.844004] [INFO ] [MAIN ] EBR: Loaded 43212 existing records. [2025-10-14T18:34:39.930334] [DEBUG] [LOCAL ] EC: Loaded 49023 existing records from primary storage. [2025-10-14T18:34:39.965716] [INFO ] [MAIN ] EBS: Loaded 46756 existing records. [2025-10-14T18:34:39.991604] [INFO ] [MAIN ] EC: Loaded 49023 existing records. [2025-10-14T18:34:40.286296] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:40.355977] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-14T18:34:40.521203] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:34:40.577789] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:34:40.578023] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-14T18:34:40.578217] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-14T18:34:40.573707] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:34:40.578164] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-14T18:34:40.578573] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-14T18:34:40.578516] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-14T18:34:40.578727] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-14T18:34:40.578812] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-14T18:34:40.578703] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-14T18:34:40.590071] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-14T18:34:40.599517] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-14T18:34:40.625572] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-14T18:34:40.701671] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-14T18:34:41.546713] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:41.594451] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:41.589101] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-14T18:34:41.598670] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-14T18:34:41.680764] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:41.689906] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-14T18:34:41.693136] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T18:34:41.698306] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-14T18:34:42.291477] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T18:34:42.295824] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-14T18:34:43.371691] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T18:34:43.376439] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-14T18:34:43.402501] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T18:34:43.411778] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-14T18:34:43.615973] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T18:34:43.626210] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-14T18:34:43.740074] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-14T18:34:43.958160] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-14T18:34:44.194868] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T18:34:44.750575] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T18:34:44.760122] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-14T18:34:44.907893] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T18:34:45.558086] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-14T18:34:45.720344] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T18:34:45.908697] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T18:34:46.358090] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-14T18:34:46.942886] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T18:34:47.158053] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-14T18:34:47.372271] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-14T18:34:47.958101] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-14T18:34:48.691899] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T18:34:48.758104] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-14T18:34:49.532917] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T18:34:49.558025] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-14T18:34:49.754581] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T18:34:50.358084] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-14T18:34:51.158147] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-14T18:34:51.199792] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T18:34:51.714799] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:34:51.958124] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-14T18:34:52.494310] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T18:34:52.758107] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-14T18:34:53.558061] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-14T18:34:53.876639] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T18:34:54.013391] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T18:34:54.358110] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-14T18:34:54.895867] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T18:34:55.158128] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-14T18:34:55.850066] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T18:34:55.958043] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-14T18:34:56.199780] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T18:34:56.758052] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-14T18:34:56.958411] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T18:34:57.558067] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-14T18:34:58.351973] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T18:34:58.360546] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-14T18:34:58.552740] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T18:34:58.555876] [INFO ] [REMOTE ] EBF: Full fetch complete (27772 records). [2025-10-14T18:34:58.555954] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-14T18:34:58.944352] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-14T18:34:58.944456] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-14T18:34:58.945166] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-14T18:34:58.945240] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-14T18:34:58.945989] [DEBUG] [LOCAL ] EBF: Trimmed 27772 records to 18912 (keeping 200 days of data) [2025-10-14T18:34:59.062279] [DEBUG] [LOCAL ] EBF: Primary data saved (18912 records). [2025-10-14T18:34:59.062425] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-14T18:34:59.062497] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. EBF took 20.2s. Estimated remaining: 3h 55m 17s. Rate: 7.2 symbols/min [2025-10-14T18:34:59.162764] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-14T18:34:59.232548] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:34:59.262610] [DEBUG] [LOCAL ] ECAT: Loaded 29435 existing records from primary storage. [2025-10-14T18:34:59.262928] [INFO ] [MAIN ] ECAT: Loaded 29435 existing records. [2025-10-14T18:34:59.439811] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:34:59.440048] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-14T18:34:59.440099] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-14T18:34:59.440381] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-14T18:34:59.440441] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-14T18:34:59.812244] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:34:59.965982] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-14T18:34:59.968919] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T18:35:00.758081] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-14T18:35:00.805034] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T18:35:01.311698] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T18:35:01.558085] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-14T18:35:02.315328] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T18:35:02.358031] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-14T18:35:03.135813] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T18:35:03.158114] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-14T18:35:03.584965] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T18:35:03.958087] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-14T18:35:04.758200] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-14T18:35:05.159509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T18:35:05.558066] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-14T18:35:05.750064] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T18:35:06.085460] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T18:35:06.358063] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-14T18:35:07.158052] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-14T18:35:07.216410] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T18:35:07.433477] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-14T18:35:07.958037] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-14T18:35:08.647519] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T18:35:08.758068] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-14T18:35:09.223287] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T18:35:09.558066] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-14T18:35:10.358042] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-14T18:35:10.605610] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T18:35:11.158032] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-14T18:35:11.219068] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T18:35:11.958054] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-14T18:35:12.010218] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:35:12.750660] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T18:35:12.760927] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-14T18:35:13.143904] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T18:35:13.558098] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-14T18:35:14.332081] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T18:35:14.337291] [INFO ] [REMOTE ] EBS: Full fetch complete (67402 records). [2025-10-14T18:35:14.337405] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-14T18:35:14.363178] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-14T18:35:14.726517] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-14T18:35:14.726614] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-14T18:35:14.727499] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-14T18:35:14.727635] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-14T18:35:14.729174] [DEBUG] [LOCAL ] EBS: Trimmed 67402 records to 46752 (keeping 200 days of data) [2025-10-14T18:35:14.825682] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T18:35:15.004827] [DEBUG] [LOCAL ] EBS: Primary data saved (46752 records). [2025-10-14T18:35:15.004959] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-14T18:35:15.005037] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. EBS took 36.2s. Estimated remaining: 3h 55m 28s. Rate: 7.2 symbols/min [2025-10-14T18:35:15.173081] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-14T18:35:15.175510] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:15.213745] [DEBUG] [LOCAL ] ECC: Loaded 43166 existing records from primary storage. [2025-10-14T18:35:15.214049] [INFO ] [MAIN ] ECC: Loaded 43166 existing records. [2025-10-14T18:35:15.388977] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:35:15.389190] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-14T18:35:15.389236] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-14T18:35:15.389437] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-14T18:35:15.389492] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-14T18:35:15.741515] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:15.799024] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T18:35:15.958064] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-14T18:35:16.759891] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-14T18:35:16.762227] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T18:35:17.471948] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T18:35:17.558076] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-14T18:35:18.056832] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T18:35:18.358066] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-14T18:35:19.001820] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T18:35:19.158112] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-14T18:35:19.963320] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-14T18:35:19.972396] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T18:35:19.977807] [INFO ] [REMOTE ] EBR: Full fetch complete (62644 records). [2025-10-14T18:35:19.977945] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-14T18:35:20.393104] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-14T18:35:20.393179] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-14T18:35:20.393945] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-14T18:35:20.394004] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-14T18:35:20.395174] [DEBUG] [LOCAL ] EBR: Trimmed 62644 records to 43246 (keeping 200 days of data) [2025-10-14T18:35:20.644246] [DEBUG] [LOCAL ] EBR: Primary data saved (43246 records). [2025-10-14T18:35:20.644365] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-14T18:35:20.644468] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EBR took 41.8s. Estimated remaining: 3h 55m 12s. Rate: 7.2 symbols/min [2025-10-14T18:35:20.766714] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-14T18:35:20.814882] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:20.814983] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-14T18:35:20.815059] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-14T18:35:20.815137] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-14T18:35:20.815173] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-14T18:35:20.815213] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-14T18:35:20.815243] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-14T18:35:21.007151] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T18:35:21.086955] [INFO ] [REMOTE ] EC: Full fetch complete (71967 records). [2025-10-14T18:35:21.118294] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-14T18:35:21.311252] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:21.567867] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-14T18:35:21.606958] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-14T18:35:21.607222] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-14T18:35:21.608211] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-14T18:35:21.627859] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-14T18:35:21.629883] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T18:35:21.639388] [DEBUG] [LOCAL ] EC: Trimmed 71967 records to 49029 (keeping 200 days of data) [2025-10-14T18:35:21.894136] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T18:35:21.965437] [DEBUG] [LOCAL ] EC: Primary data saved (49029 records). [2025-10-14T18:35:21.965582] [INFO ] [MAIN ] EC: Full history saved. [2025-10-14T18:35:21.965685] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EC took 43.1s. Estimated remaining: 3h 54m 47s. Rate: 7.2 symbols/min [2025-10-14T18:35:22.135660] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:22.140139] [DEBUG] [LOCAL ] ECCU: Loaded 2215 existing records from primary storage. [2025-10-14T18:35:22.140290] [INFO ] [MAIN ] ECCU: Loaded 2215 existing records. [2025-10-14T18:35:22.222600] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T18:35:22.319674] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:35:22.319914] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-14T18:35:22.319960] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-14T18:35:22.320170] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-14T18:35:22.320228] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-14T18:35:22.363216] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-14T18:35:22.672512] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:22.788400] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T18:35:23.158067] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-14T18:35:23.416465] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-14T18:35:23.958083] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-14T18:35:24.214526] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-14T18:35:24.758067] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-14T18:35:25.073873] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-14T18:35:25.558071] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-14T18:35:26.358081] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-14T18:35:26.955911] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T18:35:27.158068] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-14T18:35:27.647155] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-14T18:35:27.782084] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T18:35:27.958043] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-14T18:35:28.301312] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-14T18:35:28.758065] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-14T18:35:29.558083] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-14T18:35:30.358076] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-14T18:35:30.491742] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T18:35:30.839833] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-14T18:35:30.839718] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T18:35:30.844578] [INFO ] [REMOTE ] ECAT: Full fetch complete (42979 records). [2025-10-14T18:35:30.844696] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-14T18:35:31.163316] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-14T18:35:31.245719] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-14T18:35:31.245804] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-14T18:35:31.246436] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-14T18:35:31.246477] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-14T18:35:31.247321] [DEBUG] [LOCAL ] ECAT: Trimmed 42979 records to 29496 (keeping 200 days of data) [2025-10-14T18:35:31.425753] [DEBUG] [LOCAL ] ECAT: Primary data saved (29496 records). [2025-10-14T18:35:31.425891] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-14T18:35:31.425978] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECAT took 32.4s. Estimated remaining: 3h 54m 41s. Rate: 7.2 symbols/min [2025-10-14T18:35:31.594186] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:31.594398] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-14T18:35:31.594454] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-14T18:35:31.594564] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-14T18:35:31.594629] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-14T18:35:31.594710] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-14T18:35:31.594753] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-14T18:35:31.946581] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:31.958026] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-14T18:35:32.554423] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T18:35:32.758130] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-14T18:35:32.815461] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T18:35:33.339498] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T18:35:33.558064] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-14T18:35:34.358081] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-14T18:35:34.918380] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T18:35:35.158046] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-14T18:35:35.201285] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T18:35:35.596978] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T18:35:35.958065] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-14T18:35:36.285210] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-14T18:35:36.758075] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-14T18:35:37.074114] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-14T18:35:37.558084] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-14T18:35:38.358104] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-14T18:35:38.785213] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T18:35:39.158073] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-14T18:35:39.411913] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T18:35:39.740321] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T18:35:39.958085] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-14T18:35:40.294170] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T18:35:40.758076] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-14T18:35:41.136937] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:35:41.137673] [INFO ] [REMOTE ] ECCC: Full fetch complete (1310 records). [2025-10-14T18:35:41.137742] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-14T18:35:41.313291] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-14T18:35:41.313493] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:35:41.313560] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:35:41.313632] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-14T18:35:41.313733] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-14T18:35:41.313775] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-14T18:35:41.313816] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-14T18:35:41.313870] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCC took 20.7s. Estimated remaining: 3h 54m 36s. Rate: 7.2 symbols/min [2025-10-14T18:35:41.479383] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:41.479582] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-14T18:35:41.479620] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-14T18:35:41.479747] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-14T18:35:41.479786] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-14T18:35:41.479828] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-14T18:35:41.479859] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-14T18:35:41.563316] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-14T18:35:41.829828] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:42.358098] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-14T18:35:42.873069] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T18:35:42.874850] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T18:35:43.158064] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-14T18:35:43.958116] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-14T18:35:44.740721] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-14T18:35:44.766311] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-14T18:35:44.771235] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T18:35:45.119858] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T18:35:45.558073] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-14T18:35:45.844412] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-14T18:35:46.358063] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-14T18:35:46.789553] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T18:35:47.158037] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-14T18:35:47.958109] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-14T18:35:48.388419] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T18:35:48.755950] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T18:35:48.760912] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-14T18:35:48.762209] [INFO ] [REMOTE ] ECC: Full fetch complete (61266 records). [2025-10-14T18:35:48.762329] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-14T18:35:49.149910] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-14T18:35:49.149986] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-14T18:35:49.150827] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-14T18:35:49.150893] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-14T18:35:49.152165] [DEBUG] [LOCAL ] ECC: Trimmed 61266 records to 43220 (keeping 200 days of data) [2025-10-14T18:35:49.242166] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-14T18:35:49.400722] [DEBUG] [LOCAL ] ECC: Primary data saved (43220 records). [2025-10-14T18:35:49.400839] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-14T18:35:49.400915] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECC took 34.4s. Estimated remaining: 3h 54m 27s. Rate: 7.2 symbols/min [2025-10-14T18:35:49.573550] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:49.570219] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-14T18:35:49.606464] [DEBUG] [LOCAL ] ECG: Loaded 33411 existing records from primary storage. [2025-10-14T18:35:49.606786] [INFO ] [MAIN ] ECG: Loaded 33411 existing records. [2025-10-14T18:35:49.790436] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:35:49.790694] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-14T18:35:49.790750] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-14T18:35:49.791057] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-14T18:35:49.791114] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-14T18:35:49.948605] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-14T18:35:50.166783] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:50.358072] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-14T18:35:50.789183] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T18:35:51.158108] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-14T18:35:51.482743] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-14T18:35:51.958121] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-14T18:35:52.313326] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-14T18:35:52.314091] [INFO ] [REMOTE ] ECCU: Full fetch complete (4390 records). [2025-10-14T18:35:52.314160] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-14T18:35:52.679262] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-14T18:35:52.679369] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-14T18:35:52.679512] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-14T18:35:52.679552] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-14T18:35:52.679917] [DEBUG] [LOCAL ] ECCU: Trimmed 4390 records to 2215 (keeping 200 days of data) [2025-10-14T18:35:52.693548] [DEBUG] [LOCAL ] ECCU: Primary data saved (2215 records). [2025-10-14T18:35:52.693636] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-14T18:35:52.693751] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCU took 30.7s. Estimated remaining: 3h 54m 7s. Rate: 7.2 symbols/min [2025-10-14T18:35:52.763215] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-14T18:35:52.865944] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:35:52.908999] [DEBUG] [LOCAL ] ECL: Loaded 46627 existing records from primary storage. [2025-10-14T18:35:52.909312] [INFO ] [MAIN ] ECL: Loaded 46627 existing records. [2025-10-14T18:35:53.097668] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:35:53.097875] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-14T18:35:53.097930] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-14T18:35:53.098333] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-14T18:35:53.098392] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-14T18:35:53.457031] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:35:53.558030] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-14T18:35:54.358061] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-14T18:35:54.454952] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T18:35:54.890413] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-14T18:35:54.951120] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:35:55.158145] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-14T18:35:55.514534] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T18:35:55.958087] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-14T18:35:56.758083] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-14T18:35:56.997617] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-14T18:35:57.558041] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-14T18:35:57.612465] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T18:35:57.983827] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T18:35:58.358095] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-14T18:35:59.158080] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-14T18:35:59.555797] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-14T18:35:59.958037] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-14T18:36:00.039122] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T18:36:00.234034] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-14T18:36:00.758082] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-14T18:36:01.558081] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-14T18:36:01.873243] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-14T18:36:01.902583] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T18:36:02.358046] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-14T18:36:02.789142] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T18:36:02.789884] [INFO ] [REMOTE ] ECCW: Full fetch complete (1425 records). [2025-10-14T18:36:02.789952] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-14T18:36:02.981913] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-14T18:36:02.982117] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:36:02.982184] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:36:02.982254] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-14T18:36:02.982314] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-14T18:36:02.982347] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-14T18:36:02.982389] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-14T18:36:02.982440] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECCW took 31.6s. Estimated remaining: 3h 54m 3s. Rate: 7.2 symbols/min [2025-10-14T18:36:03.153279] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:36:03.158063] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-14T18:36:03.172117] [DEBUG] [LOCAL ] ECO: Loaded 18380 existing records from primary storage. [2025-10-14T18:36:03.172311] [INFO ] [MAIN ] ECO: Loaded 18380 existing records. [2025-10-14T18:36:03.350168] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:36:03.350373] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-14T18:36:03.350418] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-14T18:36:03.350612] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-14T18:36:03.350703] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-14T18:36:03.528917] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-14T18:36:03.740433] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:36:03.958068] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-14T18:36:04.758092] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-14T18:36:05.163433] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-14T18:36:05.558107] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-14T18:36:05.774105] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T18:36:06.358118] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-14T18:36:07.090890] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T18:36:07.158105] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-14T18:36:07.535886] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T18:36:07.534344] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-14T18:36:07.958143] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-14T18:36:08.758101] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-14T18:36:09.170070] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-14T18:36:09.185861] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T18:36:09.558070] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-14T18:36:09.822390] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-14T18:36:10.358115] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-14T18:36:11.158071] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-14T18:36:11.573565] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T18:36:11.964784] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-14T18:36:11.971042] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T18:36:12.758072] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-14T18:36:13.115571] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T18:36:13.558079] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-14T18:36:13.925376] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T18:36:13.926114] [INFO ] [REMOTE ] ECCX: Full fetch complete (1452 records). [2025-10-14T18:36:13.926182] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-14T18:36:14.114281] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-14T18:36:14.114520] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:36:14.114799] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:36:14.114917] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-14T18:36:14.115028] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-14T18:36:14.115097] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-14T18:36:14.115182] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-14T18:36:14.115348] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECCX took 32.8s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-14T18:36:14.312395] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:36:14.314584] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T18:36:14.364833] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-14T18:36:14.367601] [DEBUG] [LOCAL ] ECVT: Loaded 43268 existing records from primary storage. [2025-10-14T18:36:14.368017] [INFO ] [MAIN ] ECVT: Loaded 43268 existing records. [2025-10-14T18:36:14.551884] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:36:14.552105] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-14T18:36:14.552151] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-14T18:36:14.552325] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-14T18:36:14.552363] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-14T18:36:14.916109] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:36:15.158126] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-14T18:36:15.958074] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-14T18:36:16.042766] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T18:36:16.568330] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-14T18:36:16.758075] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-14T18:36:17.166750] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T18:36:17.558118] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-14T18:36:18.029385] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T18:36:18.358077] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-14T18:36:18.963012] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T18:36:19.158103] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-14T18:36:19.174474] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T18:36:19.958037] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-14T18:36:20.410406] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T18:36:20.758082] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-14T18:36:21.309130] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T18:36:21.558041] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-14T18:36:21.953141] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T18:36:22.358068] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-14T18:36:23.163123] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-14T18:36:23.168936] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T18:36:23.224004] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T18:36:23.958109] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-14T18:36:24.569883] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T18:36:24.758102] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-14T18:36:25.414422] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T18:36:25.459720] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T18:36:25.558108] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-14T18:36:26.358097] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-14T18:36:27.029203] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T18:36:27.158041] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-14T18:36:27.450460] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T18:36:27.958065] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-14T18:36:28.758075] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-14T18:36:28.914421] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T18:36:28.955177] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T18:36:29.558050] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-14T18:36:30.131257] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T18:36:30.358071] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-14T18:36:30.465059] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T18:36:30.468771] [INFO ] [REMOTE ] ECG: Full fetch complete (50908 records). [2025-10-14T18:36:30.468862] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-14T18:36:30.856551] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-14T18:36:30.856687] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-14T18:36:30.857731] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-14T18:36:30.857799] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-14T18:36:30.859203] [DEBUG] [LOCAL ] ECG: Trimmed 50908 records to 33259 (keeping 200 days of data) [2025-10-14T18:36:31.049356] [DEBUG] [LOCAL ] ECG: Primary data saved (33259 records). [2025-10-14T18:36:31.049507] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-14T18:36:31.049589] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECG took 41.6s. Estimated remaining: 3h 54m 14s. Rate: 7.2 symbols/min [2025-10-14T18:36:31.163192] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-14T18:36:31.226587] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:36:31.278417] [DEBUG] [LOCAL ] ED: Loaded 52680 existing records from primary storage. [2025-10-14T18:36:31.278763] [INFO ] [MAIN ] ED: Loaded 52680 existing records. [2025-10-14T18:36:31.457460] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:36:31.457717] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-14T18:36:31.457773] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-14T18:36:31.458109] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-14T18:36:31.458166] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-14T18:36:31.832067] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:36:31.879132] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T18:36:31.958034] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-14T18:36:32.683381] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T18:36:32.758053] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-14T18:36:33.558098] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-14T18:36:33.804070] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T18:36:34.211209] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T18:36:34.358073] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-14T18:36:34.978637] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:36:34.984782] [INFO ] [REMOTE ] ECL: Full fetch complete (68158 records). [2025-10-14T18:36:34.984893] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-14T18:36:35.164578] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-14T18:36:35.387149] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-14T18:36:35.387242] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-14T18:36:35.388142] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-14T18:36:35.388208] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-14T18:36:35.389639] [DEBUG] [LOCAL ] ECL: Trimmed 68158 records to 46660 (keeping 200 days of data) [2025-10-14T18:36:35.684896] [DEBUG] [LOCAL ] ECL: Primary data saved (46660 records). [2025-10-14T18:36:35.685227] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-14T18:36:35.686128] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECL took 43.0s. Estimated remaining: 3h 53m 56s. Rate: 7.2 symbols/min [2025-10-14T18:36:35.864068] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:36:35.900708] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T18:36:35.934407] [DEBUG] [LOCAL ] EDD: Loaded 26815 existing records from primary storage. [2025-10-14T18:36:35.934749] [INFO ] [MAIN ] EDD: Loaded 26815 existing records. [2025-10-14T18:36:35.964056] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-14T18:36:36.120170] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:36:36.120506] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-14T18:36:36.120556] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-14T18:36:36.120901] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-14T18:36:36.120979] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-14T18:36:36.440292] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T18:36:36.504277] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:36:36.758080] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-14T18:36:37.254110] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T18:36:37.558130] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-14T18:36:37.842457] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T18:36:37.844933] [INFO ] [REMOTE ] ECO: Full fetch complete (28515 records). [2025-10-14T18:36:37.845004] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-14T18:36:38.215293] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-14T18:36:38.215390] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-14T18:36:38.216244] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-14T18:36:38.216306] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-14T18:36:38.216993] [DEBUG] [LOCAL ] ECO: Trimmed 28515 records to 18316 (keeping 200 days of data) [2025-10-14T18:36:38.323808] [DEBUG] [LOCAL ] ECO: Primary data saved (18316 records). [2025-10-14T18:36:38.323938] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-14T18:36:38.324016] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECO took 35.3s. Estimated remaining: 3h 53m 34s. Rate: 7.2 symbols/min [2025-10-14T18:36:38.367257] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-14T18:36:38.499981] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:36:38.500202] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-14T18:36:38.500260] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-14T18:36:38.500371] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-14T18:36:38.500434] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-14T18:36:38.500477] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-14T18:36:38.500511] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-14T18:36:38.914384] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T18:36:38.947833] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:36:39.158124] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-14T18:36:39.827222] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T18:36:39.963160] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-14T18:36:39.973997] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T18:36:40.758125] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-14T18:36:41.558057] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-14T18:36:41.694270] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T18:36:42.119021] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T18:36:42.358040] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-14T18:36:42.668240] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T18:36:43.158056] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-14T18:36:43.585586] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-14T18:36:43.958044] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-14T18:36:44.224989] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T18:36:44.758078] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-14T18:36:45.558039] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-14T18:36:45.683393] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T18:36:45.862282] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T18:36:46.307803] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T18:36:46.358028] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-14T18:36:47.158046] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-14T18:36:47.501409] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T18:36:47.958116] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-14T18:36:48.611011] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T18:36:48.616058] [INFO ] [REMOTE ] ECVT: Full fetch complete (60198 records). [2025-10-14T18:36:48.616167] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-14T18:36:48.773691] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-14T18:36:48.799113] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T18:36:49.043150] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-14T18:36:49.043477] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-14T18:36:49.044332] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-14T18:36:49.044402] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-14T18:36:49.045616] [DEBUG] [LOCAL ] ECVT: Trimmed 60198 records to 43323 (keeping 200 days of data) [2025-10-14T18:36:49.284680] [DEBUG] [LOCAL ] ECVT: Primary data saved (43323 records). [2025-10-14T18:36:49.284813] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-14T18:36:49.284892] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. ECVT took 35.2s. Estimated remaining: 3h 53m 32s. Rate: 7.2 symbols/min [2025-10-14T18:36:49.451483] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:36:49.469740] [DEBUG] [LOCAL ] EDN: Loaded 18698 existing records from primary storage. [2025-10-14T18:36:49.469950] [INFO ] [MAIN ] EDN: Loaded 18698 existing records. [2025-10-14T18:36:49.564788] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-14T18:36:49.645990] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:36:49.646223] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-14T18:36:49.646271] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-14T18:36:49.646699] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-14T18:36:49.646756] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-14T18:36:50.002263] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:36:50.070944] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T18:36:50.358164] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-14T18:36:51.158040] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-14T18:36:51.276031] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T18:36:51.277204] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T18:36:51.958070] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-14T18:36:52.683672] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T18:36:52.758032] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-14T18:36:53.558039] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-14T18:36:53.734660] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T18:36:54.219445] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T18:36:54.358040] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-14T18:36:54.488020] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T18:36:55.158097] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-14T18:36:55.511560] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T18:36:55.958084] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-14T18:36:56.655970] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T18:36:56.679082] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T18:36:56.758051] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-14T18:36:57.558080] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-14T18:36:57.709515] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-14T18:36:58.358080] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-14T18:36:58.852618] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T18:36:59.158080] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-14T18:36:59.874482] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T18:36:59.958041] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-14T18:37:00.353316] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T18:37:00.758097] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-14T18:37:01.014468] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T18:37:01.558078] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-14T18:37:01.867070] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T18:37:02.300810] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T18:37:02.358091] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-14T18:37:02.917529] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T18:37:03.158104] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-14T18:37:03.958081] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-14T18:37:04.101861] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T18:37:04.758098] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-14T18:37:04.884075] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T18:37:04.887379] [INFO ] [REMOTE ] EDD: Full fetch complete (38584 records). [2025-10-14T18:37:04.887453] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-14T18:37:05.255263] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-14T18:37:05.255347] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-14T18:37:05.255958] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-14T18:37:05.256020] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-14T18:37:05.257024] [DEBUG] [LOCAL ] EDD: Trimmed 38584 records to 26812 (keeping 200 days of data) [2025-10-14T18:37:05.407275] [DEBUG] [LOCAL ] EDD: Primary data saved (26812 records). [2025-10-14T18:37:05.407401] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-14T18:37:05.407481] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. EDD took 29.7s. Estimated remaining: 3h 53m 42s. Rate: 7.2 symbols/min [2025-10-14T18:37:05.580010] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:05.580396] [DEBUG] [LOCAL ] EDU: No existing data file found in primary storage. [2025-10-14T18:37:05.562817] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-14T18:37:05.581916] [WARN ] [MAIN ] EDU: No existing data found, performing full refresh instead. [2025-10-14T18:37:05.592902] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-14T18:37:05.593025] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-14T18:37:05.594125] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T18:37:05.593102] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-10-14T18:37:05.598515] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-14T18:37:05.956931] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:06.358046] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-14T18:37:06.436594] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T18:37:07.158108] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-14T18:37:07.958083] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-14T18:37:08.200579] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T18:37:08.242760] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T18:37:08.758096] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-14T18:37:09.558060] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-14T18:37:09.861066] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T18:37:09.957597] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T18:37:10.358159] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-14T18:37:11.011426] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T18:37:11.158154] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-14T18:37:11.958052] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-14T18:37:12.046965] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T18:37:12.125153] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T18:37:12.590820] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T18:37:12.593999] [INFO ] [REMOTE ] EDF: Full fetch complete (20448 records). [2025-10-14T18:37:12.594132] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-14T18:37:12.767319] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-14T18:37:13.004036] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-14T18:37:13.004137] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-14T18:37:13.004740] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-14T18:37:13.004804] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-14T18:37:13.005600] [DEBUG] [LOCAL ] EDF: Trimmed 20448 records to 13096 (keeping 200 days of data) [2025-10-14T18:37:13.088036] [DEBUG] [LOCAL ] EDF: Primary data saved (13096 records). [2025-10-14T18:37:13.088222] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-14T18:37:13.088309] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDF took 34.8s. Estimated remaining: 3h 53m 32s. Rate: 7.2 symbols/min [2025-10-14T18:37:13.263439] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:13.301327] [DEBUG] [LOCAL ] EE: Loaded 33066 existing records from primary storage. [2025-10-14T18:37:13.301746] [INFO ] [MAIN ] EE: Loaded 33066 existing records. [2025-10-14T18:37:13.487037] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:37:13.487241] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-14T18:37:13.487291] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-14T18:37:13.487782] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-14T18:37:13.487842] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-14T18:37:13.563265] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-14T18:37:13.847206] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:14.358103] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-14T18:37:14.541399] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-14T18:37:14.547269] [INFO ] [REMOTE ] ED: Full fetch complete (76437 records). [2025-10-14T18:37:14.547398] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-14T18:37:14.770034] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T18:37:14.976246] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-14T18:37:14.976322] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-14T18:37:14.977204] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-14T18:37:14.977266] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-14T18:37:14.979041] [DEBUG] [LOCAL ] ED: Trimmed 76437 records to 52685 (keeping 200 days of data) [2025-10-14T18:37:15.164759] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-14T18:37:15.299839] [DEBUG] [LOCAL ] ED: Primary data saved (52685 records). [2025-10-14T18:37:15.299973] [INFO ] [MAIN ] ED: Full history saved. [2025-10-14T18:37:15.300055] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. ED took 44.3s. Estimated remaining: 3h 53m 9s. Rate: 7.2 symbols/min [2025-10-14T18:37:15.471534] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:15.471789] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-14T18:37:15.471832] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-14T18:37:15.471903] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-14T18:37:15.471938] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-14T18:37:15.471977] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-14T18:37:15.472008] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-14T18:37:15.826465] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:15.958038] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-14T18:37:16.091831] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T18:37:16.758111] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-14T18:37:16.803497] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T18:37:16.834881] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T18:37:17.558072] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-14T18:37:18.075738] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T18:37:18.256132] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T18:37:18.358129] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-14T18:37:19.158116] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-14T18:37:19.693936] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T18:37:19.695226] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T18:37:19.958071] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-14T18:37:20.758041] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-14T18:37:21.054192] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T18:37:21.430576] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T18:37:21.558062] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-14T18:37:22.358043] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-14T18:37:22.685461] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T18:37:22.791623] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T18:37:23.158068] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-14T18:37:23.958070] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-14T18:37:24.220891] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T18:37:24.439821] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T18:37:24.758093] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-14T18:37:25.201773] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T18:37:25.558082] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-14T18:37:26.019475] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T18:37:26.358093] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-14T18:37:27.158069] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-14T18:37:27.785116] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T18:37:27.958065] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-14T18:37:28.535187] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T18:37:28.538298] [INFO ] [REMOTE ] EDN: Full fetch complete (29902 records). [2025-10-14T18:37:28.538378] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-14T18:37:28.763247] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-14T18:37:28.913926] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-14T18:37:28.913998] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-14T18:37:28.914502] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-14T18:37:28.914539] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-14T18:37:28.915212] [DEBUG] [LOCAL ] EDN: Trimmed 29902 records to 18885 (keeping 200 days of data) [2025-10-14T18:37:29.023043] [DEBUG] [LOCAL ] EDN: Primary data saved (18885 records). [2025-10-14T18:37:29.023193] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-14T18:37:29.023284] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EDN took 39.7s. Estimated remaining: 3h 53m 14s. Rate: 7.2 symbols/min [2025-10-14T18:37:29.192573] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:29.203928] [DEBUG] [LOCAL ] EEX: Loaded 10407 existing records from primary storage. [2025-10-14T18:37:29.204102] [INFO ] [MAIN ] EEX: Loaded 10407 existing records. [2025-10-14T18:37:29.383756] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:37:29.384038] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-14T18:37:29.388005] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T18:37:29.388154] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-14T18:37:29.390180] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-14T18:37:29.390275] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-14T18:37:29.520636] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T18:37:29.565836] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-14T18:37:29.778798] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:30.171349] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T18:37:30.358068] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-14T18:37:31.158082] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-14T18:37:31.524033] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T18:37:31.958064] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-14T18:37:32.403782] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T18:37:32.758095] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-14T18:37:33.558038] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-14T18:37:33.627417] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T18:37:33.947082] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-14T18:37:34.032829] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T18:37:34.358069] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-14T18:37:35.158107] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-14T18:37:35.963349] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-14T18:37:35.998775] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:37:36.525211] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:37:36.643635] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-14T18:37:36.758059] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-14T18:37:37.558091] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-14T18:37:37.748588] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T18:37:38.033771] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-14T18:37:38.358110] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-14T18:37:39.158137] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-14T18:37:39.753941] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T18:37:39.754690] [INFO ] [REMOTE ] EEA: Full fetch complete (3837 records). [2025-10-14T18:37:39.754758] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-14T18:37:39.943197] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T18:37:39.943481] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:37:39.943568] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:37:39.943842] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-14T18:37:39.943930] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-14T18:37:39.963080] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-14T18:37:39.965480] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-14T18:37:39.966383] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-14T18:37:39.967059] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EEA took 24.7s. Estimated remaining: 3h 53m 11s. Rate: 7.2 symbols/min [2025-10-14T18:37:39.968028] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T18:37:40.149412] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:40.193983] [DEBUG] [LOCAL ] EFC: Loaded 46412 existing records from primary storage. [2025-10-14T18:37:40.194291] [INFO ] [MAIN ] EFC: Loaded 46412 existing records. [2025-10-14T18:37:40.374333] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:37:40.374546] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-14T18:37:40.374595] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-14T18:37:40.374818] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-14T18:37:40.374876] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-14T18:37:40.742078] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:40.758032] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-14T18:37:41.447935] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T18:37:41.558101] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-14T18:37:42.358045] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-14T18:37:42.537370] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T18:37:43.096690] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T18:37:43.158025] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-14T18:37:43.596636] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T18:37:43.958054] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-14T18:37:44.758088] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-14T18:37:44.794982] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T18:37:44.800549] [INFO ] [REMOTE ] EDU: Full fetch complete (66769 records). [2025-10-14T18:37:44.800730] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-14T18:37:45.199274] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-14T18:37:45.199554] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-14T18:37:45.200456] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-14T18:37:45.200598] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-14T18:37:45.221436] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T18:37:45.228503] [DEBUG] [LOCAL ] EDU: Trimmed 66769 records to 44755 (keeping 200 days of data) [2025-10-14T18:37:45.415351] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T18:37:45.509014] [DEBUG] [LOCAL ] EDU: Primary data saved (44755 records). [2025-10-14T18:37:45.509121] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-14T18:37:45.509190] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EDU took 40.1s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-10-14T18:37:45.563350] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-14T18:37:45.683173] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:45.700073] [DEBUG] [LOCAL ] EFR: Loaded 15082 existing records from primary storage. [2025-10-14T18:37:45.700313] [INFO ] [MAIN ] EFR: Loaded 15082 existing records. [2025-10-14T18:37:45.882358] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:37:45.882608] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-14T18:37:45.882685] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-14T18:37:45.882865] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-14T18:37:45.882905] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-14T18:37:46.261419] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:46.358036] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-14T18:37:47.147420] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T18:37:47.158024] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-14T18:37:47.268428] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T18:37:47.958068] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-14T18:37:48.362539] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T18:37:48.557767] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T18:37:48.758075] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-14T18:37:49.558073] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-14T18:37:50.132500] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T18:37:50.358080] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-14T18:37:50.460266] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T18:37:51.158060] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-14T18:37:51.780405] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:37:51.784465] [INFO ] [REMOTE ] EE: Full fetch complete (44077 records). [2025-10-14T18:37:51.784575] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-14T18:37:51.943175] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T18:37:51.967252] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-14T18:37:52.238504] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-14T18:37:52.238595] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-14T18:37:52.239303] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-14T18:37:52.239363] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-14T18:37:52.240283] [DEBUG] [LOCAL ] EE: Trimmed 44077 records to 32960 (keeping 200 days of data) [2025-10-14T18:37:52.439910] [DEBUG] [LOCAL ] EE: Primary data saved (32960 records). [2025-10-14T18:37:52.440049] [INFO ] [MAIN ] EE: Full history saved. [2025-10-14T18:37:52.440128] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EE took 39.4s. Estimated remaining: 3h 52m 44s. Rate: 7.2 symbols/min [2025-10-14T18:37:52.610701] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:37:52.625860] [DEBUG] [LOCAL ] EFT: Loaded 13195 existing records from primary storage. [2025-10-14T18:37:52.626102] [INFO ] [MAIN ] EFT: Loaded 13195 existing records. [2025-10-14T18:37:52.769524] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-14T18:37:52.810901] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:37:52.811347] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-14T18:37:52.811396] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-14T18:37:52.811555] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-14T18:37:52.811594] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-14T18:37:52.932237] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T18:37:53.189762] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:37:53.558080] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-14T18:37:54.358152] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-14T18:37:54.537349] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T18:37:54.659133] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T18:37:55.158107] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-14T18:37:55.198430] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T18:37:55.958077] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-14T18:37:56.009061] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T18:37:56.758112] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-14T18:37:57.558046] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-14T18:37:57.572681] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T18:37:57.660018] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T18:37:58.361886] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-14T18:37:58.364101] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T18:37:59.158112] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-14T18:37:59.252048] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T18:37:59.958093] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-14T18:38:00.764213] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-14T18:38:00.769126] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T18:38:00.819310] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T18:38:01.257433] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T18:38:01.558112] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-14T18:38:02.119834] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T18:38:02.358099] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-14T18:38:03.158129] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-14T18:38:03.741017] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:38:03.921574] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T18:38:03.958109] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-14T18:38:04.758102] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-14T18:38:04.848227] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T18:38:05.558073] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-14T18:38:06.293135] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T18:38:06.294623] [INFO ] [REMOTE ] EEX: Full fetch complete (18629 records). [2025-10-14T18:38:06.294728] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-14T18:38:06.361390] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-14T18:38:06.700353] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-14T18:38:06.700490] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-14T18:38:06.701018] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-14T18:38:06.701089] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-14T18:38:06.702087] [DEBUG] [LOCAL ] EEX: Trimmed 18629 records to 10260 (keeping 200 days of data) [2025-10-14T18:38:06.784027] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-14T18:38:06.800630] [DEBUG] [LOCAL ] EEX: Primary data saved (10260 records). [2025-10-14T18:38:06.800818] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-14T18:38:06.800909] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EEX took 37.8s. Estimated remaining: 3h 52m 50s. Rate: 7.2 symbols/min [2025-10-14T18:38:06.977482] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:06.977673] [DEBUG] [LOCAL ] EFX: No existing data file found in primary storage. [2025-10-14T18:38:06.977728] [WARN ] [MAIN ] EFX: No existing data found, performing full refresh instead. [2025-10-14T18:38:06.977844] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-14T18:38:06.977885] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-14T18:38:06.977927] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-14T18:38:06.977991] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-14T18:38:07.157006] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T18:38:07.167196] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-14T18:38:07.378479] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:07.958074] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-14T18:38:08.145866] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T18:38:08.758079] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-14T18:38:09.558079] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-14T18:38:09.695601] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T18:38:09.744064] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T18:38:10.358098] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-14T18:38:10.545013] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T18:38:11.158115] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-14T18:38:11.958083] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-14T18:38:12.065022] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T18:38:12.070275] [INFO ] [REMOTE ] EFC: Full fetch complete (66406 records). [2025-10-14T18:38:12.070396] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-14T18:38:12.071090] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:38:12.071168] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:38:12.071203] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:38:12.071241] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-14T18:38:12.071294] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-14T18:38:12.071328] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-14T18:38:12.071532] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-10-14T18:38:12.071631] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFC took 32.1s. Estimated remaining: 3h 52m 35s. Rate: 7.2 symbols/min [2025-10-14T18:38:12.257786] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:12.287350] [DEBUG] [LOCAL ] EFXT: Loaded 29521 existing records from primary storage. [2025-10-14T18:38:12.287595] [INFO ] [MAIN ] EFXT: Loaded 29521 existing records. [2025-10-14T18:38:12.469694] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:38:12.470083] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-14T18:38:12.470192] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-14T18:38:12.470512] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-14T18:38:12.470569] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-14T18:38:12.608764] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T18:38:12.758917] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-14T18:38:12.814476] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T18:38:12.889049] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:13.558064] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-14T18:38:13.768470] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T18:38:14.339170] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T18:38:14.341976] [INFO ] [REMOTE ] EFR: Full fetch complete (19376 records). [2025-10-14T18:38:14.342080] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-14T18:38:14.364190] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-14T18:38:14.706222] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-14T18:38:14.706301] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-14T18:38:14.706743] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-14T18:38:14.706803] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-14T18:38:14.707333] [DEBUG] [LOCAL ] EFR: Trimmed 19376 records to 15055 (keeping 200 days of data) [2025-10-14T18:38:14.795195] [DEBUG] [LOCAL ] EFR: Primary data saved (15055 records). [2025-10-14T18:38:14.795323] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-14T18:38:14.795406] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFR took 29.3s. Estimated remaining: 3h 52m 13s. Rate: 7.2 symbols/min [2025-10-14T18:38:14.961743] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:14.989046] [DEBUG] [LOCAL ] EG: Loaded 27796 existing records from primary storage. [2025-10-14T18:38:14.989283] [INFO ] [MAIN ] EG: Loaded 27796 existing records. [2025-10-14T18:38:15.163095] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-14T18:38:15.166626] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:38:15.167009] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-14T18:38:15.167916] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-14T18:38:15.168313] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-14T18:38:15.168371] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-14T18:38:15.519951] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:15.958124] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-14T18:38:16.090789] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T18:38:16.453247] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T18:38:16.758095] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-14T18:38:16.925261] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T18:38:17.558063] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-14T18:38:18.326249] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T18:38:18.358038] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-14T18:38:18.738202] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T18:38:19.158066] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-14T18:38:19.881489] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T18:38:19.958061] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-14T18:38:20.157476] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T18:38:20.758076] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-14T18:38:21.558054] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-14T18:38:21.698235] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T18:38:21.749114] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T18:38:22.358063] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-14T18:38:23.047272] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T18:38:23.158046] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-14T18:38:23.952190] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T18:38:23.960891] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-14T18:38:24.206444] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T18:38:24.534924] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T18:38:24.758082] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-14T18:38:25.558061] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-14T18:38:26.283447] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T18:38:26.358056] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-14T18:38:26.831376] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T18:38:27.158047] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-14T18:38:27.445820] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T18:38:27.958076] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-14T18:38:28.262138] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:38:28.758075] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-14T18:38:29.099962] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T18:38:29.558066] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-14T18:38:30.358059] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-14T18:38:30.516511] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T18:38:30.564700] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T18:38:30.792627] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T18:38:31.158106] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-14T18:38:31.958077] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-14T18:38:32.758099] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-14T18:38:33.082858] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T18:38:33.149365] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T18:38:33.558098] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-14T18:38:34.358080] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-14T18:38:34.388274] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T18:38:34.829524] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T18:38:35.158092] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-14T18:38:35.286297] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T18:38:35.958069] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-14T18:38:36.160867] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T18:38:36.758064] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-14T18:38:37.338301] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T18:38:37.558044] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-14T18:38:37.929402] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T18:38:38.358070] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-14T18:38:38.487856] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T18:38:38.492815] [INFO ] [REMOTE ] EFXT: Full fetch complete (44199 records). [2025-10-14T18:38:38.492931] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-14T18:38:38.971734] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-14T18:38:38.971812] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-14T18:38:38.972464] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-14T18:38:38.972503] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-14T18:38:38.973446] [DEBUG] [LOCAL ] EFXT: Trimmed 44199 records to 29628 (keeping 200 days of data) [2025-10-14T18:38:39.152153] [DEBUG] [LOCAL ] EFXT: Primary data saved (29628 records). [2025-10-14T18:38:39.152278] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-14T18:38:39.152373] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFXT took 27.1s. Estimated remaining: 3h 52m 42s. Rate: 7.2 symbols/min [2025-10-14T18:38:39.163627] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-14T18:38:39.332472] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:39.390089] [DEBUG] [LOCAL ] EGO: Loaded 51689 existing records from primary storage. [2025-10-14T18:38:39.391616] [INFO ] [MAIN ] EGO: Loaded 51689 existing records. [2025-10-14T18:38:39.391429] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T18:38:39.570583] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:38:39.570836] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-14T18:38:39.570884] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-14T18:38:39.571167] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-14T18:38:39.571227] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-14T18:38:39.916105] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:39.958030] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-14T18:38:40.467173] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:38:40.758038] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-14T18:38:41.165387] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T18:38:41.558062] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-14T18:38:42.358081] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-14T18:38:42.390877] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T18:38:42.396418] [INFO ] [REMOTE ] EFX: Full fetch complete (64762 records). [2025-10-14T18:38:42.396524] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-14T18:38:42.783255] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-14T18:38:42.783440] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-14T18:38:42.784328] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-14T18:38:42.784402] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-14T18:38:42.785714] [DEBUG] [LOCAL ] EFX: Trimmed 64762 records to 44621 (keeping 200 days of data) [2025-10-14T18:38:43.057787] [DEBUG] [LOCAL ] EFX: Primary data saved (44621 records). [2025-10-14T18:38:43.057916] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-14T18:38:43.058007] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EFX took 36.3s. Estimated remaining: 3h 52m 23s. Rate: 7.2 symbols/min [2025-10-14T18:38:43.160345] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-14T18:38:43.255479] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:43.260166] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T18:38:43.299064] [DEBUG] [LOCAL ] EGP: Loaded 30338 existing records from primary storage. [2025-10-14T18:38:43.299313] [INFO ] [MAIN ] EGP: Loaded 30338 existing records. [2025-10-14T18:38:43.479583] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:38:43.479899] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-14T18:38:43.479969] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-14T18:38:43.480190] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-14T18:38:43.480247] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-14T18:38:43.628567] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T18:38:43.869381] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:43.958060] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-14T18:38:44.092674] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T18:38:44.094756] [INFO ] [REMOTE ] EFT: Full fetch complete (18064 records). [2025-10-14T18:38:44.094840] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-14T18:38:44.458331] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-14T18:38:44.458415] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-14T18:38:44.458834] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-14T18:38:44.458895] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-14T18:38:44.459493] [DEBUG] [LOCAL ] EFT: Trimmed 18064 records to 13142 (keeping 200 days of data) [2025-10-14T18:38:44.542844] [DEBUG] [LOCAL ] EFT: Primary data saved (13142 records). [2025-10-14T18:38:44.542987] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-14T18:38:44.543094] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EFT took 52.1s. Estimated remaining: 3h 51m 59s. Rate: 7.2 symbols/min [2025-10-14T18:38:44.710884] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:44.711068] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-10-14T18:38:44.711105] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-10-14T18:38:44.711237] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-14T18:38:44.711303] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-14T18:38:44.711360] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-14T18:38:44.711394] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-14T18:38:44.764747] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-14T18:38:45.063369] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:45.513829] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T18:38:45.558031] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-14T18:38:45.721570] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T18:38:46.358094] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-14T18:38:46.708166] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T18:38:46.711240] [INFO ] [REMOTE ] EG: Full fetch complete (43176 records). [2025-10-14T18:38:46.711317] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-14T18:38:47.086733] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-14T18:38:47.086812] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-14T18:38:47.087431] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-14T18:38:47.087470] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-14T18:38:47.088348] [DEBUG] [LOCAL ] EG: Trimmed 43176 records to 27796 (keeping 200 days of data) [2025-10-14T18:38:47.177228] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-14T18:38:47.260410] [DEBUG] [LOCAL ] EG: Primary data saved (27796 records). [2025-10-14T18:38:47.260532] [INFO ] [MAIN ] EG: Full history saved. [2025-10-14T18:38:47.260607] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EG took 32.5s. Estimated remaining: 3h 51m 37s. Rate: 7.2 symbols/min [2025-10-14T18:38:47.429441] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:38:47.456685] [DEBUG] [LOCAL ] EHAB: Loaded 29307 existing records from primary storage. [2025-10-14T18:38:47.456929] [INFO ] [MAIN ] EHAB: Loaded 29307 existing records. [2025-10-14T18:38:47.643134] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:38:47.643720] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-14T18:38:47.643809] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-14T18:38:47.644252] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-14T18:38:47.644347] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-14T18:38:47.958991] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-14T18:38:48.011144] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:38:48.039746] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T18:38:48.599126] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T18:38:48.758036] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-14T18:38:48.905862] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T18:38:49.558117] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-14T18:38:50.295898] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T18:38:50.358106] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-14T18:38:50.929549] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T18:38:51.158071] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-14T18:38:51.800037] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T18:38:51.958136] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-14T18:38:52.257875] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T18:38:52.758081] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-14T18:38:53.558108] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-14T18:38:53.600339] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T18:38:53.794779] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T18:38:54.358043] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-14T18:38:55.158055] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-14T18:38:55.346848] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T18:38:55.568718] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T18:38:55.958123] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-14T18:38:56.258828] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:38:56.758099] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-14T18:38:57.558080] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-14T18:38:57.656555] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T18:38:57.775040] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T18:38:58.358108] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-14T18:38:59.057496] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T18:38:59.158150] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-14T18:38:59.647024] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T18:38:59.958074] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-14T18:39:00.758116] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-14T18:39:00.915405] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T18:39:00.984697] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T18:39:01.558054] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-14T18:39:01.956144] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T18:39:02.358078] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-14T18:39:03.042838] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T18:39:03.158044] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-14T18:39:03.576822] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T18:39:03.958062] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-14T18:39:04.174158] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T18:39:04.758070] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-14T18:39:05.501197] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T18:39:05.558026] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-14T18:39:05.939863] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T18:39:06.358141] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-14T18:39:06.802976] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T18:39:07.158081] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-14T18:39:07.653084] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T18:39:07.958060] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-14T18:39:08.668710] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T18:39:08.758027] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-14T18:39:09.228410] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T18:39:09.558060] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-14T18:39:10.249764] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T18:39:10.358045] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-14T18:39:10.790491] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T18:39:11.158072] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-14T18:39:11.958093] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-14T18:39:12.094987] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T18:39:12.491139] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T18:39:12.758111] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-14T18:39:13.009777] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T18:39:13.013112] [INFO ] [REMOTE ] EGP: Full fetch complete (45448 records). [2025-10-14T18:39:13.013199] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-14T18:39:13.388195] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-14T18:39:13.388278] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-14T18:39:13.389041] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-14T18:39:13.389102] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-14T18:39:13.390218] [DEBUG] [LOCAL ] EGP: Trimmed 45448 records to 30391 (keeping 200 days of data) [2025-10-14T18:39:13.559155] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-14T18:39:13.579060] [DEBUG] [LOCAL ] EGP: Primary data saved (30391 records). [2025-10-14T18:39:13.579533] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-14T18:39:13.579628] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGP took 30.5s. Estimated remaining: 3h 52m 11s. Rate: 7.1 symbols/min [2025-10-14T18:39:13.745901] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:13.783947] [DEBUG] [LOCAL ] EHC: Loaded 41048 existing records from primary storage. [2025-10-14T18:39:13.784252] [INFO ] [MAIN ] EHC: Loaded 41048 existing records. [2025-10-14T18:39:13.959341] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:39:13.959561] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-14T18:39:13.959607] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-14T18:39:13.960027] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-14T18:39:13.960085] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-14T18:39:14.319216] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:14.358050] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-14T18:39:14.540223] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-14T18:39:14.546051] [INFO ] [REMOTE ] EGO: Full fetch complete (74190 records). [2025-10-14T18:39:14.546150] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-14T18:39:14.942147] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-14T18:39:14.942229] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-14T18:39:14.943205] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-14T18:39:14.943402] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-14T18:39:14.945114] [DEBUG] [LOCAL ] EGO: Trimmed 74190 records to 51710 (keeping 200 days of data) [2025-10-14T18:39:15.054819] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T18:39:15.173158] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-14T18:39:15.272517] [DEBUG] [LOCAL ] EGO: Primary data saved (51710 records). [2025-10-14T18:39:15.272672] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-14T18:39:15.272772] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EGO took 36.1s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-14T18:39:15.441670] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:15.454061] [DEBUG] [LOCAL ] EHI: Loaded 10658 existing records from primary storage. [2025-10-14T18:39:15.454310] [INFO ] [MAIN ] EHI: Loaded 10658 existing records. [2025-10-14T18:39:15.662632] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T18:39:15.667274] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:39:15.676677] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-14T18:39:15.676757] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-14T18:39:15.676952] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-14T18:39:15.676994] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-14T18:39:15.965556] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-14T18:39:16.053228] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:16.662980] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T18:39:16.667584] [INFO ] [REMOTE ] EGY: Full fetch complete (61093 records). [2025-10-14T18:39:16.667712] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-14T18:39:16.763178] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-14T18:39:17.054946] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-14T18:39:17.055038] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-14T18:39:17.055879] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-14T18:39:17.055940] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-14T18:39:17.057207] [DEBUG] [LOCAL ] EGY: Trimmed 61093 records to 41537 (keeping 200 days of data) [2025-10-14T18:39:17.303782] [DEBUG] [LOCAL ] EGY: Primary data saved (41537 records). [2025-10-14T18:39:17.317480] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-14T18:39:17.318214] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EGY took 32.8s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-14T18:39:17.319359] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T18:39:17.495982] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:17.522514] [DEBUG] [LOCAL ] EIC: Loaded 22931 existing records from primary storage. [2025-10-14T18:39:17.522823] [INFO ] [MAIN ] EIC: Loaded 22931 existing records. [2025-10-14T18:39:17.564275] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-14T18:39:17.702601] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:39:17.703040] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-14T18:39:17.703137] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-14T18:39:17.703618] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-14T18:39:17.703704] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-14T18:39:18.073960] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:18.089271] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T18:39:18.358037] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-14T18:39:18.431454] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T18:39:19.158084] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-14T18:39:19.405038] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T18:39:19.958148] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-14T18:39:20.456745] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T18:39:20.758079] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-14T18:39:21.342101] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T18:39:21.558047] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-14T18:39:22.256403] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T18:39:22.345543] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T18:39:22.358028] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-14T18:39:23.158064] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-14T18:39:23.825473] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T18:39:23.958069] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-14T18:39:24.217052] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T18:39:24.440533] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T18:39:24.758097] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-14T18:39:25.558071] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-14T18:39:26.358046] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-14T18:39:26.530599] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T18:39:26.812763] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T18:39:27.158060] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-14T18:39:27.320860] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T18:39:27.324039] [INFO ] [REMOTE ] EHAB: Full fetch complete (40981 records). [2025-10-14T18:39:27.324117] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-14T18:39:27.695624] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-14T18:39:27.695730] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-14T18:39:27.696351] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-14T18:39:27.696393] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-14T18:39:27.697402] [DEBUG] [LOCAL ] EHAB: Trimmed 40981 records to 29326 (keeping 200 days of data) [2025-10-14T18:39:27.855489] [DEBUG] [LOCAL ] EHAB: Primary data saved (29326 records). [2025-10-14T18:39:27.855616] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-14T18:39:27.855723] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHAB took 40.6s. Estimated remaining: 3h 51m 20s. Rate: 7.2 symbols/min [2025-10-14T18:39:27.963163] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-14T18:39:28.029404] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:28.029547] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-14T18:39:28.029584] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-14T18:39:28.029738] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-14T18:39:28.029782] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-14T18:39:28.029823] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-14T18:39:28.029855] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-14T18:39:28.415575] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:28.426619] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T18:39:28.758071] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-14T18:39:29.205482] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T18:39:29.413132] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T18:39:29.558023] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-14T18:39:30.358180] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-14T18:39:30.595070] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T18:39:31.158109] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-14T18:39:31.625467] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T18:39:31.958114] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-14T18:39:32.679490] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T18:39:32.701808] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T18:39:32.758068] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-14T18:39:33.265765] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T18:39:33.558050] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-14T18:39:34.094705] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T18:39:34.358075] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-14T18:39:35.137613] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T18:39:35.158026] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-14T18:39:35.958072] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-14T18:39:35.998481] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T18:39:36.758096] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-14T18:39:37.555097] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T18:39:37.563535] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-14T18:39:37.663516] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T18:39:38.324035] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T18:39:38.358027] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-14T18:39:39.158066] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-14T18:39:39.202614] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T18:39:39.958055] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-14T18:39:40.279392] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:39:40.758033] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-14T18:39:40.799427] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T18:39:40.801297] [INFO ] [REMOTE ] EHI: Full fetch complete (16156 records). [2025-10-14T18:39:40.801368] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-14T18:39:41.202890] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-14T18:39:41.202968] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-14T18:39:41.203392] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-14T18:39:41.203463] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-14T18:39:41.204195] [DEBUG] [LOCAL ] EHI: Trimmed 16156 records to 10642 (keeping 200 days of data) [2025-10-14T18:39:41.272362] [DEBUG] [LOCAL ] EHI: Primary data saved (10642 records). [2025-10-14T18:39:41.272490] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-14T18:39:41.272569] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EHI took 26.0s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-14T18:39:41.463056] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:41.463241] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-14T18:39:41.463278] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-14T18:39:41.463390] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-14T18:39:41.463432] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-14T18:39:41.463476] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-14T18:39:41.463511] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-14T18:39:41.566199] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-14T18:39:41.869013] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:42.013590] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T18:39:42.018632] [INFO ] [REMOTE ] EHC: Full fetch complete (58760 records). [2025-10-14T18:39:42.018777] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-14T18:39:42.095885] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-14T18:39:42.358980] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-14T18:39:42.469165] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-14T18:39:42.469278] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-14T18:39:42.470174] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-14T18:39:42.470249] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-14T18:39:42.471580] [DEBUG] [LOCAL ] EHC: Trimmed 58760 records to 40988 (keeping 200 days of data) [2025-10-14T18:39:42.753274] [DEBUG] [LOCAL ] EHC: Primary data saved (40988 records). [2025-10-14T18:39:42.753401] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-14T18:39:42.753478] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EHC took 29.2s. Estimated remaining: 3h 50m 59s. Rate: 7.2 symbols/min [2025-10-14T18:39:42.855232] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-14T18:39:42.952916] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:42.953107] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-14T18:39:42.953173] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-14T18:39:42.953330] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-14T18:39:42.953393] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-14T18:39:42.953445] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-14T18:39:42.953481] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-14T18:39:43.167798] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-14T18:39:43.363892] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:43.498062] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-14T18:39:43.958082] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-14T18:39:44.611807] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T18:39:44.758050] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-14T18:39:45.314328] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T18:39:45.558073] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-14T18:39:45.972053] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T18:39:46.358106] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-14T18:39:46.741721] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T18:39:47.158113] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-14T18:39:47.958126] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-14T18:39:48.488395] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T18:39:48.518851] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T18:39:48.758061] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-14T18:39:49.558060] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-14T18:39:49.653669] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-14T18:39:49.982242] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T18:39:50.358121] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-14T18:39:50.724718] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-14T18:39:51.158153] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-14T18:39:51.471960] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-14T18:39:51.958078] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-14T18:39:52.758084] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-14T18:39:52.808287] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T18:39:53.252431] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T18:39:53.558108] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-14T18:39:54.293073] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T18:39:54.358143] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-14T18:39:54.761802] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-14T18:39:55.158115] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-14T18:39:55.554698] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-14T18:39:55.958105] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-14T18:39:56.662395] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T18:39:56.758099] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-14T18:39:57.558062] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-14T18:39:57.835539] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T18:39:57.837905] [INFO ] [REMOTE ] EIC: Full fetch complete (34424 records). [2025-10-14T18:39:57.838010] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-14T18:39:57.923481] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-14T18:39:58.219195] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-14T18:39:58.219278] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-14T18:39:58.219870] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-14T18:39:58.219930] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-14T18:39:58.220782] [DEBUG] [LOCAL ] EIC: Trimmed 34424 records to 22893 (keeping 200 days of data) [2025-10-14T18:39:58.363327] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-14T18:39:58.375299] [DEBUG] [LOCAL ] EIC: Primary data saved (22893 records). [2025-10-14T18:39:58.375436] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-14T18:39:58.375537] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 41.1s. Estimated remaining: 3h 51m 7s. Rate: 7.2 symbols/min [2025-10-14T18:39:58.570052] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:39:58.591936] [DEBUG] [LOCAL ] EIG: Loaded 20178 existing records from primary storage. [2025-10-14T18:39:58.592228] [INFO ] [MAIN ] EIG: Loaded 20178 existing records. [2025-10-14T18:39:58.788559] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:39:58.788788] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-14T18:39:58.788838] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-14T18:39:58.789006] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-14T18:39:58.789045] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-14T18:39:59.057424] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T18:39:59.174272] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-14T18:39:59.181252] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:39:59.724740] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T18:39:59.958085] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-14T18:40:00.371747] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T18:40:00.758050] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-14T18:40:01.224698] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T18:40:01.558067] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-14T18:40:02.058206] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-14T18:40:02.358101] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-14T18:40:03.158107] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-14T18:40:03.457837] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T18:40:03.621022] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T18:40:03.958077] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-14T18:40:04.312876] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-14T18:40:04.758078] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-14T18:40:05.198826] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T18:40:05.558099] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-14T18:40:06.313739] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T18:40:06.314546] [INFO ] [REMOTE ] EICB: Full fetch complete (2737 records). [2025-10-14T18:40:06.314613] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-14T18:40:06.366862] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-14T18:40:06.492803] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T18:40:06.493008] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:40:06.493076] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:40:06.493148] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-14T18:40:06.493211] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-14T18:40:06.493289] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-14T18:40:06.493341] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-14T18:40:06.493398] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICB took 25.2s. Estimated remaining: 3h 50m 58s. Rate: 7.2 symbols/min [2025-10-14T18:40:06.660184] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:40:06.710806] [DEBUG] [LOCAL ] EIX: Loaded 53364 existing records from primary storage. [2025-10-14T18:40:06.711133] [INFO ] [MAIN ] EIX: Loaded 53364 existing records. [2025-10-14T18:40:06.824738] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T18:40:06.901221] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:40:06.901434] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-14T18:40:06.901481] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-14T18:40:06.901955] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-14T18:40:06.902013] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-14T18:40:07.163229] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-14T18:40:07.277710] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:40:07.907346] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T18:40:07.958026] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-14T18:40:08.429315] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T18:40:08.758078] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-14T18:40:09.463327] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T18:40:09.558060] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-14T18:40:09.989814] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T18:40:09.991035] [INFO ] [REMOTE ] EICC: Full fetch complete (8431 records). [2025-10-14T18:40:09.991103] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-14T18:40:09.991450] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:40:09.991530] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:40:09.991571] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:40:09.991632] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-14T18:40:09.991730] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-14T18:40:09.991769] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-14T18:40:09.991809] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-14T18:40:09.991859] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EICC took 27.2s. Estimated remaining: 3h 50m 39s. Rate: 7.2 symbols/min [2025-10-14T18:40:10.358067] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-14T18:40:11.158077] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-14T18:40:11.489634] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-14T18:40:11.958041] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-14T18:40:12.175932] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T18:40:12.321001] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-14T18:40:12.322072] [INFO ] [REMOTE ] EICA: Full fetch complete (1277 records). [2025-10-14T18:40:12.322147] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-14T18:40:12.585439] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-14T18:40:12.585741] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:40:12.585828] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:40:12.585919] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-14T18:40:12.586011] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-14T18:40:12.586072] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-14T18:40:12.586144] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-14T18:40:12.586229] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EICA took 44.7s. Estimated remaining: 3h 50m 17s. Rate: 7.2 symbols/min [2025-10-14T18:40:12.758129] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-14T18:40:13.558166] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-14T18:40:13.946403] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T18:40:14.358089] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-14T18:40:15.403493] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T18:40:15.414180] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-14T18:40:16.507663] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-14T18:40:16.511353] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-14T18:40:16.916128] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T18:40:16.929540] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-14T18:40:17.518755] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T18:40:17.558060] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-14T18:40:18.422186] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T18:40:18.433084] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-14T18:40:18.655585] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:40:19.158049] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-14T18:40:20.186286] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T18:40:20.191353] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-14T18:40:20.363084] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T18:40:20.758102] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-14T18:40:21.321156] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T18:40:21.558097] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-14T18:40:22.623991] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T18:40:22.628900] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-14T18:40:22.772357] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-14T18:40:23.158075] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-14T18:40:23.422141] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T18:40:23.958107] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-14T18:40:24.618587] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T18:40:24.758060] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-14T18:40:25.126038] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T18:40:25.558072] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-14T18:40:26.428343] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T18:40:26.440325] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-14T18:40:26.586506] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T18:40:26.588601] [INFO ] [REMOTE ] EIG: Full fetch complete (27037 records). [2025-10-14T18:40:26.588732] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-14T18:40:26.959407] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-14T18:40:26.959479] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-14T18:40:26.960004] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-14T18:40:26.960063] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-14T18:40:26.960745] [DEBUG] [LOCAL ] EIG: Trimmed 27037 records to 20149 (keeping 200 days of data) [2025-10-14T18:40:27.080591] [DEBUG] [LOCAL ] EIG: Primary data saved (20149 records). [2025-10-14T18:40:27.080748] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-14T18:40:27.080828] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIG took 28.7s. Estimated remaining: 3h 50m 23s. Rate: 7.2 symbols/min [2025-10-14T18:40:28.259249] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T18:40:28.272056] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-14T18:40:30.313436] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-14T18:40:30.324677] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-14T18:40:31.126905] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T18:40:31.132912] [INFO ] [REMOTE ] EIX: Full fetch complete (77331 records). [2025-10-14T18:40:31.133052] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-14T18:40:31.529238] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-14T18:40:31.529313] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-14T18:40:31.530208] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-14T18:40:31.530268] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-14T18:40:31.531622] [DEBUG] [LOCAL ] EIX: Trimmed 77331 records to 53370 (keeping 200 days of data) [2025-10-14T18:40:31.850631] [DEBUG] [LOCAL ] EIX: Primary data saved (53370 records). [2025-10-14T18:40:31.850782] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-14T18:40:31.850859] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EIX took 25.4s. Estimated remaining: 3h 50m 6s. Rate: 7.2 symbols/min [2025-10-14T18:40:32.497750] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:40:32.570999] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:40:32.574773] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:40:32.533236] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:40:32.581915] [DEBUG] [LOCAL ] ELC: Loaded 3505 existing records from primary storage. [2025-10-14T18:40:32.582207] [INFO ] [MAIN ] ELC: Loaded 3505 existing records. [2025-10-14T18:40:32.830524] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:40:32.843995] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-14T18:40:32.844051] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-14T18:40:32.844201] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-14T18:40:32.844257] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-14T18:40:32.980591] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-14T18:40:33.012351] [DEBUG] [LOCAL ] ELAN: Loaded 53299 existing records from primary storage. [2025-10-14T18:40:33.016603] [INFO ] [MAIN ] EL: Loaded 53376 existing records. [2025-10-14T18:40:33.017381] [DEBUG] [LOCAL ] ELF: Loaded 52038 existing records from primary storage. [2025-10-14T18:40:33.028712] [INFO ] [MAIN ] ELAN: Loaded 53299 existing records. [2025-10-14T18:40:33.064113] [INFO ] [MAIN ] ELF: Loaded 52038 existing records. [2025-10-14T18:40:33.777409] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:40:33.739084] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:40:33.829268] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:40:33.824150] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-14T18:40:33.837559] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-14T18:40:33.824253] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-14T18:40:33.843318] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-14T18:40:33.838001] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-14T18:40:33.843435] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-14T18:40:33.862031] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-14T18:40:33.862931] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-14T18:40:33.866039] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-14T18:40:33.865880] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:40:33.883480] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-14T18:40:33.883211] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-14T18:40:33.871334] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-14T18:40:33.909596] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-14T18:40:34.788509] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T18:40:34.818932] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-14T18:40:34.954516] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:40:34.990996] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:40:35.038369] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-14T18:40:35.043840] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:40:35.044143] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-14T18:40:35.045266] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-14T18:40:35.479465] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T18:40:35.481081] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-14T18:40:35.939390] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T18:40:35.941194] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-14T18:40:36.476748] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T18:40:36.478148] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-14T18:40:36.642397] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T18:40:36.653067] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-14T18:40:36.931462] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T18:40:36.942007] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-14T18:40:36.946722] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T18:40:36.948777] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-14T18:40:37.052669] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-14T18:40:37.256792] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-14T18:40:37.558095] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-14T18:40:38.211260] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T18:40:38.358053] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-14T18:40:38.423840] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T18:40:39.116996] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T18:40:39.158031] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-14T18:40:39.559204] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T18:40:39.958083] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-14T18:40:40.538141] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T18:40:40.758083] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-14T18:40:41.019584] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T18:40:41.558056] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-14T18:40:42.358078] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-14T18:40:42.410610] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T18:40:42.908087] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T18:40:43.158043] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-14T18:40:43.418414] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T18:40:43.958082] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-14T18:40:44.758099] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-14T18:40:45.266489] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-14T18:40:45.345874] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T18:40:45.558061] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-14T18:40:46.358045] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-14T18:40:46.924933] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-14T18:40:47.158064] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-14T18:40:47.864097] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T18:40:47.958058] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-14T18:40:48.040500] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-14T18:40:48.611299] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T18:40:48.758143] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-14T18:40:49.493885] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-14T18:40:49.558029] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-14T18:40:50.358103] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-14T18:40:50.721361] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T18:40:50.879991] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T18:40:51.158047] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-14T18:40:51.307844] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T18:40:51.958140] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-14T18:40:52.493812] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T18:40:52.494700] [INFO ] [REMOTE ] ELC: Full fetch complete (5027 records). [2025-10-14T18:40:52.494770] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-14T18:40:52.763582] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-14T18:40:52.875428] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-14T18:40:52.875518] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-14T18:40:52.875732] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-14T18:40:52.875795] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-14T18:40:52.876156] [DEBUG] [LOCAL ] ELC: Trimmed 5027 records to 3486 (keeping 200 days of data) [2025-10-14T18:40:52.896906] [DEBUG] [LOCAL ] ELC: Primary data saved (3486 records). [2025-10-14T18:40:52.896981] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-14T18:40:52.897058] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 21.0s. Estimated remaining: 3h 50m 27s. Rate: 7.2 symbols/min [2025-10-14T18:40:53.067760] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:40:53.099462] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-14T18:40:53.141950] [DEBUG] [LOCAL ] ELME: Loaded 39410 existing records from primary storage. [2025-10-14T18:40:53.142250] [INFO ] [MAIN ] ELME: Loaded 39410 existing records. [2025-10-14T18:40:53.315904] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:40:53.316129] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-14T18:40:53.316176] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-14T18:40:53.316689] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-14T18:40:53.316746] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-14T18:40:53.565727] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-14T18:40:53.671158] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:40:54.218449] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T18:40:54.358073] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-14T18:40:55.158117] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-14T18:40:55.650505] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T18:40:55.958050] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-14T18:40:56.448162] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-14T18:40:56.520740] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T18:40:56.758069] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-14T18:40:57.197902] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T18:40:57.558067] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-14T18:40:58.358094] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-14T18:40:59.017745] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T18:40:59.109378] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T18:40:59.158035] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-14T18:40:59.946668] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T18:40:59.958406] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-14T18:41:00.758149] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-14T18:41:01.265497] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T18:41:01.558065] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-14T18:41:01.707977] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T18:41:02.358099] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-14T18:41:02.386624] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T18:41:02.392391] [INFO ] [REMOTE ] EL: Full fetch complete (77414 records). [2025-10-14T18:41:02.392496] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-14T18:41:02.796011] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-14T18:41:02.796248] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-14T18:41:02.797197] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-14T18:41:02.797276] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-14T18:41:02.798819] [DEBUG] [LOCAL ] EL: Trimmed 77414 records to 53376 (keeping 200 days of data) [2025-10-14T18:41:02.927279] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-14T18:41:03.158152] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-14T18:41:03.164296] [DEBUG] [LOCAL ] EL: Primary data saved (53376 records). [2025-10-14T18:41:03.164377] [INFO ] [MAIN ] EL: Full history saved. [2025-10-14T18:41:03.164451] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. EL took 31.3s. Estimated remaining: 3h 50m 23s. Rate: 7.1 symbols/min [2025-10-14T18:41:03.343666] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:03.369003] [DEBUG] [LOCAL ] ELP: Loaded 25644 existing records from primary storage. [2025-10-14T18:41:03.369240] [INFO ] [MAIN ] ELP: Loaded 25644 existing records. [2025-10-14T18:41:03.554427] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:41:03.555513] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-14T18:41:03.555572] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-14T18:41:03.555761] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-14T18:41:03.555818] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-14T18:41:03.817207] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T18:41:03.954381] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:03.958025] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-14T18:41:04.758049] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-14T18:41:04.789225] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T18:41:04.794859] [INFO ] [REMOTE ] ELF: Full fetch complete (75426 records). [2025-10-14T18:41:04.794994] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-14T18:41:05.294352] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-14T18:41:05.294499] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-14T18:41:05.296139] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-14T18:41:05.296265] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-14T18:41:05.326671] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T18:41:05.337863] [DEBUG] [LOCAL ] ELF: Trimmed 75426 records to 52038 (keeping 200 days of data) [2025-10-14T18:41:05.560249] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-14T18:41:05.739614] [DEBUG] [LOCAL ] ELF: Primary data saved (52038 records). [2025-10-14T18:41:05.739827] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-14T18:41:05.739945] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELF took 33.9s. Estimated remaining: 3h 50m 1s. Rate: 7.2 symbols/min [2025-10-14T18:41:05.963857] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:05.964134] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-14T18:41:05.964291] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-14T18:41:05.964636] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-14T18:41:05.964726] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-14T18:41:05.964805] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-14T18:41:05.964885] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-14T18:41:06.359559] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-14T18:41:06.359488] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:06.394689] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T18:41:06.436610] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T18:41:07.158053] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-14T18:41:07.596377] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T18:41:07.763051] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T18:41:07.958082] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-14T18:41:08.758101] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-14T18:41:09.004090] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T18:41:09.029444] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-14T18:41:09.558072] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-14T18:41:10.358119] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-14T18:41:10.692221] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T18:41:11.158124] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-14T18:41:11.707484] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T18:41:11.712986] [INFO ] [REMOTE ] ELAN: Full fetch complete (76667 records). [2025-10-14T18:41:11.713158] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-14T18:41:11.713918] [FATAL] [VALIDATOR ] ELAN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:41:11.714002] [FATAL] [MAIN ] ELAN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:41:11.714044] [WARN ] [MAIN ] ELAN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:41:11.714081] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-14T18:41:11.714138] [DEBUG] [LOCAL ] ELAN: No primary data file found to delete. [2025-10-14T18:41:11.714172] [INFO ] [LOCAL ] ELAN: Starting deletion of derivative data. [2025-10-14T18:41:11.714392] [DEBUG] [LOCAL ] ELAN: Deleted derivative data file. [2025-10-14T18:41:11.714482] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELAN took 39.8s. Estimated remaining: 3h 49m 47s. Rate: 7.2 symbols/min [2025-10-14T18:41:11.882664] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:11.928697] [DEBUG] [LOCAL ] ELS: Loaded 49898 existing records from primary storage. [2025-10-14T18:41:11.929106] [INFO ] [MAIN ] ELS: Loaded 49898 existing records. [2025-10-14T18:41:11.971065] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-14T18:41:12.065049] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T18:41:12.131379] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:41:12.131605] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-14T18:41:12.131678] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-14T18:41:12.132023] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-14T18:41:12.132081] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-14T18:41:12.345697] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-14T18:41:12.490789] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:12.758068] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-14T18:41:13.558049] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-14T18:41:13.810560] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-14T18:41:13.957173] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T18:41:14.358100] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-14T18:41:14.846390] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T18:41:15.158075] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-14T18:41:15.958078] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-14T18:41:16.308689] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T18:41:16.591093] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T18:41:16.758064] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-14T18:41:17.558064] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-14T18:41:18.364741] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-14T18:41:18.386851] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T18:41:18.778899] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T18:41:19.158071] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-14T18:41:19.958090] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-14T18:41:20.036786] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T18:41:20.414551] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T18:41:20.758064] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-14T18:41:20.924675] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T18:41:21.219616] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T18:41:21.558048] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-14T18:41:21.889455] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T18:41:22.358057] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-14T18:41:23.158097] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-14T18:41:23.964995] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-14T18:41:23.970089] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T18:41:24.496983] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T18:41:24.661887] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T18:41:24.758108] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-14T18:41:25.001319] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-14T18:41:25.558166] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-14T18:41:26.358066] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-14T18:41:27.164449] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-14T18:41:27.168269] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T18:41:27.412473] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T18:41:27.958117] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-14T18:41:28.758034] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-14T18:41:28.805679] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:41:29.073301] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T18:41:29.076140] [INFO ] [REMOTE ] ELP: Full fetch complete (36838 records). [2025-10-14T18:41:29.076225] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-14T18:41:29.467345] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-14T18:41:29.467434] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-14T18:41:29.468061] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-14T18:41:29.468150] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-14T18:41:29.469158] [DEBUG] [LOCAL ] ELP: Trimmed 36838 records to 25653 (keeping 200 days of data) [2025-10-14T18:41:29.561034] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-14T18:41:29.617400] [DEBUG] [LOCAL ] ELP: Primary data saved (25653 records). [2025-10-14T18:41:29.617535] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-14T18:41:29.617614] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELP took 26.5s. Estimated remaining: 3h 50m 0s. Rate: 7.1 symbols/min [2025-10-14T18:41:29.796093] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:29.803246] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-14T18:41:29.844951] [DEBUG] [LOCAL ] ELV: Loaded 50650 existing records from primary storage. [2025-10-14T18:41:29.845270] [INFO ] [MAIN ] ELV: Loaded 50650 existing records. [2025-10-14T18:41:30.022658] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:41:30.022891] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-14T18:41:30.022938] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-14T18:41:30.023440] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-14T18:41:30.023497] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-14T18:41:30.363147] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-14T18:41:30.383456] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:30.410513] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T18:41:31.158093] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-14T18:41:31.929574] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T18:41:31.958026] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-14T18:41:32.498026] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T18:41:32.758073] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-14T18:41:33.521874] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:41:33.558033] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-14T18:41:34.365095] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-14T18:41:34.373316] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T18:41:34.900494] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T18:41:34.901159] [INFO ] [REMOTE ] ELPC: Full fetch complete (1411 records). [2025-10-14T18:41:34.901225] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-14T18:41:35.052452] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T18:41:35.097342] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-14T18:41:35.097514] [INFO ] [REMOTE ] ELME: Full fetch complete (56069 records). [2025-10-14T18:41:35.097736] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:41:35.098005] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-14T18:41:35.097882] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:41:35.098298] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-14T18:41:35.098478] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-14T18:41:35.098536] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-14T18:41:35.167822] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-14T18:41:35.162553] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-14T18:41:35.183509] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. ELPC took 29.4s. Estimated remaining: 3h 49m 46s. Rate: 7.2 symbols/min [2025-10-14T18:41:35.589796] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:35.595842] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-14T18:41:35.601027] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-14T18:41:35.616584] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-14T18:41:35.640254] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-14T18:41:35.650424] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-14T18:41:35.658922] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-14T18:41:35.759960] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-14T18:41:35.767406] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-14T18:41:35.773539] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-14T18:41:35.773698] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-14T18:41:35.812024] [DEBUG] [LOCAL ] ELME: Trimmed 56069 records to 39385 (keeping 200 days of data) [2025-10-14T18:41:35.969920] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-14T18:41:36.314778] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:36.349089] [DEBUG] [LOCAL ] ELME: Primary data saved (39385 records). [2025-10-14T18:41:36.349238] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-14T18:41:36.349319] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELME took 43.5s. Estimated remaining: 3h 49m 21s. Rate: 7.2 symbols/min [2025-10-14T18:41:36.517324] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:36.517520] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-14T18:41:36.517558] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-14T18:41:36.517694] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-14T18:41:36.517746] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-14T18:41:36.517787] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-14T18:41:36.517820] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-14T18:41:36.768472] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-14T18:41:36.899674] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:37.149024] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:41:37.149393] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-14T18:41:37.149486] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:41:37.149533] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-14T18:41:37.149593] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:41:37.149690] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-14T18:41:37.149763] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-14T18:41:37.149801] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-14T18:41:37.149840] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-14T18:41:37.149933] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. EMA took 1.9s. Estimated remaining: 3h 48m 55s. Rate: 7.2 symbols/min [2025-10-14T18:41:37.345213] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:37.392890] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-14T18:41:37.411414] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T18:41:37.445398] [DEBUG] [LOCAL ] EME: Loaded 31109 existing records from primary storage. [2025-10-14T18:41:37.445717] [INFO ] [MAIN ] EME: Loaded 31109 existing records. [2025-10-14T18:41:37.563160] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-14T18:41:37.652610] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:41:37.652849] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-14T18:41:37.652897] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-14T18:41:37.653175] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-14T18:41:37.653232] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-14T18:41:38.017255] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:38.358102] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-14T18:41:39.025464] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T18:41:39.158080] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-14T18:41:39.958097] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-14T18:41:40.207917] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T18:41:40.463263] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T18:41:40.718349] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T18:41:40.758074] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-14T18:41:41.490829] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T18:41:41.558095] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-14T18:41:42.358071] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-14T18:41:42.945273] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:41:43.158082] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-14T18:41:43.958046] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-14T18:41:44.039469] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T18:41:44.669732] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T18:41:44.758028] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-14T18:41:45.558058] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-14T18:41:45.692913] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T18:41:46.358074] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-14T18:41:46.394905] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T18:41:46.461031] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T18:41:47.158082] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-14T18:41:47.958061] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-14T18:41:47.987559] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T18:41:47.993967] [INFO ] [REMOTE ] ELS: Full fetch complete (71200 records). [2025-10-14T18:41:47.994149] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-14T18:41:48.415099] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T18:41:48.447850] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-14T18:41:48.448365] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-14T18:41:48.449426] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-14T18:41:48.449491] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-14T18:41:48.450964] [DEBUG] [LOCAL ] ELS: Trimmed 71200 records to 49892 (keeping 200 days of data) [2025-10-14T18:41:48.752451] [DEBUG] [LOCAL ] ELS: Primary data saved (49892 records). [2025-10-14T18:41:48.752602] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-14T18:41:48.752710] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. ELS took 37.0s. Estimated remaining: 3h 48m 54s. Rate: 7.2 symbols/min [2025-10-14T18:41:48.764337] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-14T18:41:48.922376] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:41:48.928158] [DEBUG] [LOCAL ] EMF: Loaded 3279 existing records from primary storage. [2025-10-14T18:41:48.928315] [INFO ] [MAIN ] EMF: Loaded 3279 existing records. [2025-10-14T18:41:49.112284] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:41:49.112667] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-14T18:41:49.112802] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-14T18:41:49.112953] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-14T18:41:49.112991] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-14T18:41:49.483664] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:41:49.504630] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T18:41:49.558030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-14T18:41:49.702262] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T18:41:50.358118] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-14T18:41:51.074702] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T18:41:51.158112] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-14T18:41:51.753869] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T18:41:51.958114] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-14T18:41:52.179421] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T18:41:52.758086] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-14T18:41:53.413588] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T18:41:53.458438] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T18:41:53.558060] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-14T18:41:54.358121] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-14T18:41:55.158057] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-14T18:41:55.402476] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T18:41:55.569875] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T18:41:55.883836] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T18:41:55.958083] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-14T18:41:56.758103] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-14T18:41:57.279062] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T18:41:57.558090] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-14T18:41:58.109081] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T18:41:58.306086] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T18:41:58.358151] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-14T18:41:59.158087] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-14T18:41:59.958097] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-14T18:42:00.330955] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T18:42:00.513499] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T18:42:00.554139] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-14T18:42:00.758090] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-14T18:42:01.558062] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-14T18:42:02.358124] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-14T18:42:02.642787] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T18:42:02.669322] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T18:42:02.673105] [INFO ] [REMOTE ] EME: Full fetch complete (46946 records). [2025-10-14T18:42:02.673289] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-14T18:42:03.062249] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-14T18:42:03.062348] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-14T18:42:03.063109] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-14T18:42:03.063170] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-14T18:42:03.064112] [DEBUG] [LOCAL ] EME: Trimmed 46946 records to 30969 (keeping 200 days of data) [2025-10-14T18:42:03.159700] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-14T18:42:03.263321] [DEBUG] [LOCAL ] EME: Primary data saved (30969 records). [2025-10-14T18:42:03.263446] [INFO ] [MAIN ] EME: Full history saved. [2025-10-14T18:42:03.263519] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EME took 26.1s. Estimated remaining: 3h 48m 60s. Rate: 7.2 symbols/min [2025-10-14T18:42:03.440755] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:03.492927] [DEBUG] [LOCAL ] EMN: Loaded 50714 existing records from primary storage. [2025-10-14T18:42:03.493227] [INFO ] [MAIN ] EMN: Loaded 50714 existing records. [2025-10-14T18:42:03.647316] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T18:42:03.691310] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:42:03.691898] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-14T18:42:03.692211] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-14T18:42:03.692778] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-14T18:42:03.692838] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-14T18:42:03.811229] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T18:42:03.963170] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-14T18:42:04.058163] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:04.758053] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-14T18:42:05.017359] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T18:42:05.558063] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-14T18:42:06.146888] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:42:06.358055] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-14T18:42:06.652089] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T18:42:07.158086] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-14T18:42:07.958028] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-14T18:42:08.167965] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T18:42:08.258847] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T18:42:08.758087] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-14T18:42:09.558097] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-14T18:42:09.596321] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T18:42:10.358040] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-14T18:42:10.434031] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T18:42:10.575140] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T18:42:10.581276] [INFO ] [REMOTE ] ELV: Full fetch complete (73214 records). [2025-10-14T18:42:10.581447] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-14T18:42:11.026311] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-14T18:42:11.026424] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-14T18:42:11.027620] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-14T18:42:11.027711] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-14T18:42:11.029688] [DEBUG] [LOCAL ] ELV: Trimmed 73214 records to 50685 (keeping 200 days of data) [2025-10-14T18:42:11.158333] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-14T18:42:11.381276] [DEBUG] [LOCAL ] ELV: Primary data saved (50685 records). [2025-10-14T18:42:11.381510] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-14T18:42:11.381639] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. ELV took 41.8s. Estimated remaining: 3h 48m 51s. Rate: 7.2 symbols/min [2025-10-14T18:42:11.570321] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:11.588318] [DEBUG] [LOCAL ] EMO: Loaded 13184 existing records from primary storage. [2025-10-14T18:42:11.588638] [INFO ] [MAIN ] EMO: Loaded 13184 existing records. [2025-10-14T18:42:11.786097] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:42:11.786490] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-14T18:42:11.786596] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-14T18:42:11.787004] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-14T18:42:11.787071] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-14T18:42:11.972907] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-14T18:42:12.181049] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:12.215944] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T18:42:12.220985] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T18:42:12.230204] [INFO ] [REMOTE ] EMD: Full fetch complete (32156 records). [2025-10-14T18:42:12.231305] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-14T18:42:12.647639] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-14T18:42:12.647793] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-14T18:42:12.649326] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-14T18:42:12.649692] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-14T18:42:12.649593] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T18:42:12.652942] [DEBUG] [LOCAL ] EMD: Trimmed 32156 records to 20965 (keeping 200 days of data) [2025-10-14T18:42:12.761449] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-14T18:42:12.786787] [DEBUG] [LOCAL ] EMD: Primary data saved (20965 records). [2025-10-14T18:42:12.786924] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-14T18:42:12.786994] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMD took 36.4s. Estimated remaining: 3h 48m 27s. Rate: 7.2 symbols/min [2025-10-14T18:42:12.964961] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:12.970226] [DEBUG] [LOCAL ] EMP: Loaded 3063 existing records from primary storage. [2025-10-14T18:42:12.970382] [INFO ] [MAIN ] EMP: Loaded 3063 existing records. [2025-10-14T18:42:13.141977] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:42:13.142156] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-14T18:42:13.142203] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-14T18:42:13.142332] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-14T18:42:13.142368] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-14T18:42:13.482365] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:13.558058] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-14T18:42:14.358051] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-14T18:42:14.455771] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T18:42:14.634680] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T18:42:15.067313] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T18:42:15.158072] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-14T18:42:15.936347] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T18:42:15.958048] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-14T18:42:16.634227] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-14T18:42:16.758040] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-14T18:42:17.246484] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-14T18:42:17.558065] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-14T18:42:18.358128] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-14T18:42:18.851387] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T18:42:19.158050] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-14T18:42:19.303237] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T18:42:19.763520] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T18:42:19.958065] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-14T18:42:20.694105] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T18:42:20.758060] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-14T18:42:21.257030] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-14T18:42:21.558053] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-14T18:42:22.346990] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T18:42:22.358024] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-14T18:42:22.873924] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T18:42:23.158047] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-14T18:42:23.958061] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-14T18:42:24.531261] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T18:42:24.758042] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-14T18:42:24.956889] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T18:42:25.558036] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-14T18:42:25.666891] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T18:42:26.358057] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-14T18:42:26.995832] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-14T18:42:27.158101] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-14T18:42:27.205884] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:42:27.776584] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T18:42:27.958077] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-14T18:42:28.498248] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-14T18:42:28.758066] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-14T18:42:29.106763] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T18:42:29.558093] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-14T18:42:29.915509] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T18:42:30.358084] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-14T18:42:31.158064] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-14T18:42:31.180807] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T18:42:31.763184] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T18:42:31.764188] [INFO ] [REMOTE ] EMF: Full fetch complete (6603 records). [2025-10-14T18:42:31.764269] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-14T18:42:31.967168] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-14T18:42:32.183067] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-14T18:42:32.183149] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-14T18:42:32.183348] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-14T18:42:32.183388] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-14T18:42:32.183857] [DEBUG] [LOCAL ] EMF: Trimmed 6603 records to 3283 (keeping 200 days of data) [2025-10-14T18:42:32.205437] [DEBUG] [LOCAL ] EMF: Primary data saved (3283 records). [2025-10-14T18:42:32.205517] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-14T18:42:32.205593] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMF took 43.5s. Estimated remaining: 3h 48m 43s. Rate: 7.2 symbols/min [2025-10-14T18:42:32.393783] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:32.393951] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-10-14T18:42:32.393988] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-10-14T18:42:32.394098] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-14T18:42:32.394139] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-14T18:42:32.394180] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-14T18:42:32.394254] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-14T18:42:32.655346] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T18:42:32.753881] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:32.758035] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-14T18:42:33.558082] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-14T18:42:34.003573] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T18:42:34.358037] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-14T18:42:34.504903] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T18:42:35.158045] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-14T18:42:35.284134] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T18:42:35.552098] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-14T18:42:35.958115] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-14T18:42:36.758084] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-14T18:42:37.558086] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-14T18:42:37.739215] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T18:42:37.758909] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T18:42:38.358095] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-14T18:42:39.158076] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-14T18:42:39.263568] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T18:42:39.426092] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T18:42:39.645270] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T18:42:39.646141] [INFO ] [REMOTE ] EMP: Full fetch complete (4250 records). [2025-10-14T18:42:39.646207] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-14T18:42:39.963368] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-14T18:42:40.001791] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-14T18:42:40.001859] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-14T18:42:40.002013] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-14T18:42:40.002052] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-14T18:42:40.002400] [DEBUG] [LOCAL ] EMP: Trimmed 4250 records to 3054 (keeping 200 days of data) [2025-10-14T18:42:40.021989] [DEBUG] [LOCAL ] EMP: Primary data saved (3054 records). [2025-10-14T18:42:40.022055] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-14T18:42:40.022125] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMP took 27.2s. Estimated remaining: 3h 48m 33s. Rate: 7.2 symbols/min [2025-10-14T18:42:40.187762] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:40.187985] [DEBUG] [LOCAL ] ENB: No existing data file found in primary storage. [2025-10-14T18:42:40.188046] [WARN ] [MAIN ] ENB: No existing data found, performing full refresh instead. [2025-10-14T18:42:40.188157] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-14T18:42:40.188198] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-14T18:42:40.188238] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-14T18:42:40.188269] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-14T18:42:40.541353] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:40.758060] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-14T18:42:41.558055] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-14T18:42:41.706277] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:42:42.248413] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T18:42:42.265926] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T18:42:42.268768] [INFO ] [REMOTE ] EMO: Full fetch complete (17700 records). [2025-10-14T18:42:42.268862] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-14T18:42:42.363250] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-14T18:42:42.668105] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-14T18:42:42.668182] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-14T18:42:42.668628] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-14T18:42:42.668701] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-14T18:42:42.669250] [DEBUG] [LOCAL ] EMO: Trimmed 17700 records to 13223 (keeping 200 days of data) [2025-10-14T18:42:42.753733] [DEBUG] [LOCAL ] EMO: Primary data saved (13223 records). [2025-10-14T18:42:42.754028] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-14T18:42:42.754130] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. EMO took 31.4s. Estimated remaining: 3h 48m 12s. Rate: 7.2 symbols/min [2025-10-14T18:42:42.922451] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:42.956378] [DEBUG] [LOCAL ] ENIC: Loaded 36489 existing records from primary storage. [2025-10-14T18:42:42.956670] [INFO ] [MAIN ] ENIC: Loaded 36489 existing records. [2025-10-14T18:42:43.130700] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:42:43.130946] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-14T18:42:43.130993] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-14T18:42:43.131309] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-14T18:42:43.131369] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-14T18:42:43.163275] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-14T18:42:43.486521] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:43.958077] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-14T18:42:44.254187] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T18:42:44.758174] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-14T18:42:45.244121] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T18:42:45.341458] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-14T18:42:45.558103] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-14T18:42:46.358078] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-14T18:42:46.444824] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:42:46.995418] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T18:42:47.158063] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-14T18:42:47.706792] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T18:42:47.958125] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-14T18:42:48.758049] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-14T18:42:48.952604] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T18:42:49.558072] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-14T18:42:49.702613] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T18:42:50.358088] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-14T18:42:50.599751] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T18:42:51.158104] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-14T18:42:51.362305] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T18:42:51.385629] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T18:42:51.958101] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-14T18:42:52.481279] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T18:42:52.486964] [INFO ] [REMOTE ] EMN: Full fetch complete (72316 records). [2025-10-14T18:42:52.487106] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-14T18:42:52.763325] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-14T18:42:52.878679] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-14T18:42:52.878778] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-14T18:42:52.879715] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-14T18:42:52.879779] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-14T18:42:52.881248] [DEBUG] [LOCAL ] EMN: Trimmed 72316 records to 50738 (keeping 200 days of data) [2025-10-14T18:42:53.198463] [DEBUG] [LOCAL ] EMN: Primary data saved (50738 records). [2025-10-14T18:42:53.198595] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-14T18:42:53.198696] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMN took 49.9s. Estimated remaining: 3h 48m 9s. Rate: 7.2 symbols/min [2025-10-14T18:42:53.339719] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T18:42:53.409110] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:42:53.413514] [DEBUG] [LOCAL ] ENO: Loaded 1870 existing records from primary storage. [2025-10-14T18:42:53.413700] [INFO ] [MAIN ] ENO: Loaded 1870 existing records. [2025-10-14T18:42:53.563377] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-14T18:42:53.621596] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:42:53.621986] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-14T18:42:53.622039] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-14T18:42:53.622241] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-14T18:42:53.622301] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-14T18:42:54.047033] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:42:54.358067] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-14T18:42:54.629378] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T18:42:54.901363] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T18:42:55.043185] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:42:55.158066] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-14T18:42:55.958079] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-14T18:42:56.758152] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-14T18:42:57.063220] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T18:42:57.097073] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T18:42:57.212216] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-14T18:42:57.558080] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-14T18:42:58.358109] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-14T18:42:59.163144] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-14T18:42:59.169709] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T18:42:59.897715] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T18:42:59.958030] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-14T18:43:00.758052] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-14T18:43:00.993366] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T18:43:01.558055] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-14T18:43:01.619109] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T18:43:01.861963] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-14T18:43:02.325512] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T18:43:02.358073] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-14T18:43:03.158133] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-14T18:43:03.632050] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-14T18:43:03.965981] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-14T18:43:03.993744] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:43:04.561615] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-14T18:43:04.758123] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-14T18:43:05.558064] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-14T18:43:06.108136] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T18:43:06.358131] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-14T18:43:06.512952] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T18:43:07.158116] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-14T18:43:07.507974] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T18:43:07.958063] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-14T18:43:08.758135] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-14T18:43:09.044872] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T18:43:09.090061] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T18:43:09.176266] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T18:43:09.558083] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-14T18:43:09.993097] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T18:43:10.358104] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-14T18:43:11.158065] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-14T18:43:11.958046] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-14T18:43:12.173365] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T18:43:12.203113] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T18:43:12.758060] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-14T18:43:13.558038] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-14T18:43:13.736410] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-14T18:43:13.742485] [INFO ] [REMOTE ] ENB: Full fetch complete (77638 records). [2025-10-14T18:43:13.742603] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-14T18:43:14.084868] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T18:43:14.132244] [INFO ] [REMOTE ] ENIC: Full fetch complete (51578 records). [2025-10-14T18:43:14.153617] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-14T18:43:14.172474] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-14T18:43:14.172672] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-14T18:43:14.173806] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-14T18:43:14.250968] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-14T18:43:14.295482] [DEBUG] [LOCAL ] ENB: Trimmed 77638 records to 53512 (keeping 200 days of data) [2025-10-14T18:43:14.392060] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-14T18:43:14.694855] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-14T18:43:14.696054] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-14T18:43:14.697408] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-14T18:43:14.697488] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-14T18:43:14.703036] [DEBUG] [LOCAL ] ENIC: Trimmed 51578 records to 36677 (keeping 200 days of data) [2025-10-14T18:43:14.945457] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T18:43:15.071883] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T18:43:15.146782] [INFO ] [REMOTE ] EMR: Full fetch complete (77232 records). [2025-10-14T18:43:15.150417] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-14T18:43:15.168900] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-14T18:43:15.203458] [DEBUG] [LOCAL ] ENIC: Primary data saved (36677 records). [2025-10-14T18:43:15.225516] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-14T18:43:15.284757] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 32.5s. Estimated remaining: 3h 48m 31s. Rate: 7.1 symbols/min [2025-10-14T18:43:15.294533] [DEBUG] [LOCAL ] ENB: Primary data saved (53512 records). [2025-10-14T18:43:15.311340] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-14T18:43:15.311531] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 35.3s. Estimated remaining: 3h 48m 4s. Rate: 7.2 symbols/min [2025-10-14T18:43:15.800107] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:15.796635] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T18:43:15.848466] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:15.966769] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-14T18:43:15.971093] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-14T18:43:15.971432] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-14T18:43:15.973167] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-14T18:43:15.973380] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-14T18:43:15.975570] [DEBUG] [LOCAL ] EMR: Trimmed 77232 records to 53209 (keeping 200 days of data) [2025-10-14T18:43:16.104316] [DEBUG] [LOCAL ] ENOV: Loaded 44876 existing records from primary storage. [2025-10-14T18:43:16.118093] [INFO ] [MAIN ] ENOV: Loaded 44876 existing records. [2025-10-14T18:43:16.142624] [DEBUG] [LOCAL ] ENR: Loaded 43561 existing records from primary storage. [2025-10-14T18:43:16.160158] [INFO ] [MAIN ] ENR: Loaded 43561 existing records. [2025-10-14T18:43:16.435499] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:16.501490] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-14T18:43:16.501884] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-14T18:43:16.501398] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:16.502335] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-14T18:43:16.502684] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-14T18:43:16.502782] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-14T18:43:16.502873] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-14T18:43:16.515206] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-14T18:43:16.525769] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-14T18:43:16.659683] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T18:43:16.706176] [INFO ] [REMOTE ] ENO: Full fetch complete (3061 records). [2025-10-14T18:43:16.721691] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-14T18:43:17.563454] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:17.572238] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-14T18:43:17.718588] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:17.767759] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-14T18:43:17.774043] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-14T18:43:17.775696] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-14T18:43:17.776151] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-14T18:43:17.777031] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-14T18:43:17.779586] [DEBUG] [LOCAL ] ENO: Trimmed 3061 records to 1862 (keeping 200 days of data) [2025-10-14T18:43:17.799531] [DEBUG] [LOCAL ] ENO: Primary data saved (1862 records). [2025-10-14T18:43:17.800800] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-14T18:43:17.800919] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 24.6s. Estimated remaining: 3h 47m 42s. Rate: 7.2 symbols/min [2025-10-14T18:43:18.069281] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:18.066628] [DEBUG] [LOCAL ] EMR: Primary data saved (53209 records). [2025-10-14T18:43:18.069708] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-14T18:43:18.069800] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. EMR took 45.9s. Estimated remaining: 3h 47m 16s. Rate: 7.2 symbols/min [2025-10-14T18:43:18.246629] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:18.255941] [DEBUG] [LOCAL ] ENS: Loaded 29433 existing records from primary storage. [2025-10-14T18:43:18.256138] [INFO ] [MAIN ] ENS: Loaded 29433 existing records. [2025-10-14T18:43:18.448169] [DEBUG] [LOCAL ] ENVA: Loaded 25436 existing records from primary storage. [2025-10-14T18:43:18.453679] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:18.454096] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-14T18:43:18.454011] [INFO ] [MAIN ] ENVA: Loaded 25436 existing records. [2025-10-14T18:43:18.454214] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-14T18:43:18.529059] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-14T18:43:18.544988] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-14T18:43:18.742323] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:18.763023] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-14T18:43:18.768380] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-14T18:43:18.792483] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-14T18:43:18.792590] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-14T18:43:19.121038] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:19.179926] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-14T18:43:19.338735] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T18:43:19.384546] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-14T18:43:19.386255] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T18:43:19.423072] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:19.958096] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-14T18:43:20.411635] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T18:43:20.711969] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T18:43:20.758029] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-14T18:43:21.019011] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T18:43:21.558091] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-14T18:43:21.961086] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T18:43:22.358094] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-14T18:43:22.656822] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T18:43:23.158064] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-14T18:43:23.215288] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T18:43:23.958066] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-14T18:43:24.652333] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T18:43:24.758065] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-14T18:43:24.801621] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T18:43:25.558096] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-14T18:43:26.219425] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T18:43:26.358071] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-14T18:43:27.164796] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-14T18:43:27.171676] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T18:43:27.921787] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T18:43:27.958086] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-14T18:43:28.025049] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T18:43:28.758087] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-14T18:43:29.435808] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T18:43:29.558078] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-14T18:43:29.658751] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T18:43:30.358081] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-14T18:43:30.865308] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T18:43:31.158104] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-14T18:43:31.726149] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T18:43:31.958085] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-14T18:43:32.489967] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T18:43:32.758096] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-14T18:43:33.414693] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T18:43:33.558057] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-14T18:43:33.848431] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T18:43:34.358124] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-14T18:43:35.036558] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:43:35.158048] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-14T18:43:35.472823] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T18:43:35.958089] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-14T18:43:36.538284] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T18:43:36.758065] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-14T18:43:37.442052] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T18:43:37.558059] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-14T18:43:37.692358] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T18:43:38.358037] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-14T18:43:38.793103] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T18:43:39.158088] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-14T18:43:39.666181] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T18:43:39.958103] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-14T18:43:40.234597] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T18:43:40.758077] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-14T18:43:41.560980] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-14T18:43:41.560798] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T18:43:42.171016] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T18:43:42.358032] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-14T18:43:42.485032] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T18:43:43.158103] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-14T18:43:43.615581] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T18:43:43.958068] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-14T18:43:44.734048] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T18:43:44.758034] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-14T18:43:45.009178] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T18:43:45.558092] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-14T18:43:46.191209] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T18:43:46.358040] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-14T18:43:46.829008] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T18:43:46.833767] [INFO ] [REMOTE ] ENR: Full fetch complete (59216 records). [2025-10-14T18:43:46.833865] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-14T18:43:47.167286] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-14T18:43:47.225041] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-14T18:43:47.225112] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-14T18:43:47.225893] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-14T18:43:47.225953] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-14T18:43:47.227103] [DEBUG] [LOCAL ] ENR: Trimmed 59216 records to 43622 (keeping 200 days of data) [2025-10-14T18:43:47.514350] [DEBUG] [LOCAL ] ENR: Primary data saved (43622 records). [2025-10-14T18:43:47.514484] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-14T18:43:47.514574] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENR took 32.2s. Estimated remaining: 3h 47m 54s. Rate: 7.1 symbols/min [2025-10-14T18:43:47.705232] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:47.721148] [DEBUG] [LOCAL ] EOD: Loaded 14986 existing records from primary storage. [2025-10-14T18:43:47.721368] [INFO ] [MAIN ] EOD: Loaded 14986 existing records. [2025-10-14T18:43:47.908289] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:47.908591] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-14T18:43:47.908698] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-14T18:43:47.909050] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-14T18:43:47.909123] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-14T18:43:47.973135] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-14T18:43:48.087089] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T18:43:48.319124] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:48.431083] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T18:43:48.758086] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-14T18:43:49.094484] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:43:49.303762] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T18:43:49.558136] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-14T18:43:50.358074] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-14T18:43:51.107716] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T18:43:51.158086] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-14T18:43:51.450537] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T18:43:51.454227] [INFO ] [REMOTE ] ENS: Full fetch complete (42352 records). [2025-10-14T18:43:51.454300] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-14T18:43:51.823090] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-14T18:43:51.823166] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-14T18:43:51.823818] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-14T18:43:51.823879] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-14T18:43:51.824791] [DEBUG] [LOCAL ] ENS: Trimmed 42352 records to 29567 (keeping 200 days of data) [2025-10-14T18:43:51.970224] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-14T18:43:52.005272] [DEBUG] [LOCAL ] ENS: Primary data saved (29567 records). [2025-10-14T18:43:52.005373] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-14T18:43:52.005472] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 34.2s. Estimated remaining: 3h 47m 37s. Rate: 7.1 symbols/min [2025-10-14T18:43:52.173618] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:52.227838] [DEBUG] [LOCAL ] EOG: Loaded 53349 existing records from primary storage. [2025-10-14T18:43:52.228185] [INFO ] [MAIN ] EOG: Loaded 53349 existing records. [2025-10-14T18:43:52.407216] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:52.407460] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-14T18:43:52.407507] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-14T18:43:52.407902] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-14T18:43:52.407978] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-14T18:43:52.642277] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T18:43:52.695104] [INFO ] [REMOTE ] ENOV: Full fetch complete (63430 records). [2025-10-14T18:43:52.705463] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-14T18:43:52.764212] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-14T18:43:52.885118] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:53.176462] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-14T18:43:53.176545] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-14T18:43:53.177351] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-14T18:43:53.177410] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-14T18:43:53.178613] [DEBUG] [LOCAL ] ENOV: Trimmed 63430 records to 44904 (keeping 200 days of data) [2025-10-14T18:43:53.269130] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T18:43:53.273871] [INFO ] [REMOTE ] ENVA: Full fetch complete (36698 records). [2025-10-14T18:43:53.274461] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-14T18:43:53.558668] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-14T18:43:53.620337] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T18:43:53.806858] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-14T18:43:53.809083] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-14T18:43:53.812896] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-14T18:43:53.813283] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-14T18:43:53.823952] [DEBUG] [LOCAL ] ENVA: Trimmed 36698 records to 25448 (keeping 200 days of data) [2025-10-14T18:43:53.958254] [DEBUG] [LOCAL ] ENOV: Primary data saved (44904 records). [2025-10-14T18:43:53.959230] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-14T18:43:53.959572] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENOV took 38.7s. Estimated remaining: 3h 47m 14s. Rate: 7.2 symbols/min [2025-10-14T18:43:54.146796] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:54.194948] [DEBUG] [LOCAL ] EOI: Loaded 10791 existing records from primary storage. [2025-10-14T18:43:54.196499] [INFO ] [MAIN ] EOI: Loaded 10791 existing records. [2025-10-14T18:43:54.330719] [DEBUG] [LOCAL ] ENVA: Primary data saved (25448 records). [2025-10-14T18:43:54.350357] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-14T18:43:54.361263] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. ENVA took 36.3s. Estimated remaining: 3h 46m 49s. Rate: 7.2 symbols/min [2025-10-14T18:43:54.361374] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-14T18:43:54.391681] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:54.403419] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-14T18:43:54.468906] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-14T18:43:54.492935] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-14T18:43:54.496297] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-14T18:43:54.695274] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:43:54.897888] [DEBUG] [LOCAL ] EOS: Loaded 15359 existing records from primary storage. [2025-10-14T18:43:54.918503] [INFO ] [MAIN ] EOS: Loaded 15359 existing records. [2025-10-14T18:43:54.937798] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:55.120625] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:43:55.120966] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-14T18:43:55.121054] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-14T18:43:55.121434] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-14T18:43:55.121525] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-14T18:43:55.164236] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-14T18:43:55.241579] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T18:43:55.509714] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:43:55.545934] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T18:43:55.958103] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-14T18:43:56.116298] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T18:43:56.758063] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-14T18:43:57.316276] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T18:43:57.558044] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-14T18:43:57.779587] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T18:43:58.224392] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T18:43:58.358119] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-14T18:43:59.158081] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-14T18:43:59.184787] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T18:43:59.958140] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-14T18:44:00.520056] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T18:44:00.758084] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-14T18:44:01.035866] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T18:44:01.558073] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-14T18:44:01.580421] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T18:44:02.358267] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-14T18:44:02.520764] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T18:44:03.158116] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-14T18:44:03.300572] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T18:44:03.958116] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-14T18:44:04.758049] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-14T18:44:04.845904] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T18:44:05.071840] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T18:44:05.293036] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T18:44:05.558057] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-14T18:44:06.358089] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-14T18:44:06.657483] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:44:07.158115] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-14T18:44:07.958110] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-14T18:44:07.971464] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T18:44:08.075607] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T18:44:08.609960] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T18:44:08.758065] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-14T18:44:09.525483] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T18:44:09.558047] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-14T18:44:10.284332] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T18:44:10.358035] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-14T18:44:10.961738] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T18:44:11.158079] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-14T18:44:11.906237] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T18:44:11.958024] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-14T18:44:12.509000] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T18:44:12.758088] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-14T18:44:13.558145] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-14T18:44:14.358060] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-14T18:44:14.384401] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T18:44:14.386419] [INFO ] [REMOTE ] EOI: Full fetch complete (16249 records). [2025-10-14T18:44:14.386492] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-14T18:44:14.792205] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-14T18:44:14.792386] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-14T18:44:14.793049] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-14T18:44:14.793222] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-14T18:44:14.794110] [DEBUG] [LOCAL ] EOI: Trimmed 16249 records to 10770 (keeping 200 days of data) [2025-10-14T18:44:14.883483] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-14T18:44:14.913575] [DEBUG] [LOCAL ] EOI: Primary data saved (10770 records). [2025-10-14T18:44:14.913760] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-14T18:44:14.913848] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOI took 21.0s. Estimated remaining: 3h 47m 7s. Rate: 7.2 symbols/min [2025-10-14T18:44:15.111151] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:44:15.120099] [DEBUG] [LOCAL ] EOT: Loaded 6803 existing records from primary storage. [2025-10-14T18:44:15.120320] [INFO ] [MAIN ] EOT: Loaded 6803 existing records. [2025-10-14T18:44:15.163477] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-14T18:44:15.263896] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T18:44:15.321866] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:44:15.322084] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-14T18:44:15.322132] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-14T18:44:15.322311] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-14T18:44:15.322369] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-14T18:44:15.677455] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:44:15.958072] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-14T18:44:16.301225] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T18:44:16.758100] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-14T18:44:17.524290] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T18:44:17.558062] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-14T18:44:17.782554] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T18:44:18.225938] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T18:44:18.358071] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-14T18:44:19.158100] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-14T18:44:19.391487] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T18:44:19.958050] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-14T18:44:19.974726] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T18:44:20.758073] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-14T18:44:21.558114] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-14T18:44:21.650024] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T18:44:21.889110] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T18:44:22.240506] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T18:44:22.358057] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-14T18:44:23.158068] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-14T18:44:23.547439] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T18:44:23.958040] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-14T18:44:24.015105] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T18:44:24.482820] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-14T18:44:24.758071] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-14T18:44:25.558062] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-14T18:44:25.877256] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T18:44:25.879995] [INFO ] [REMOTE ] EOD: Full fetch complete (20976 records). [2025-10-14T18:44:25.880067] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-14T18:44:26.255787] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-14T18:44:26.255862] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-14T18:44:26.256280] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-14T18:44:26.256317] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-14T18:44:26.256922] [DEBUG] [LOCAL ] EOD: Trimmed 20976 records to 15024 (keeping 200 days of data) [2025-10-14T18:44:26.344307] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T18:44:26.347888] [INFO ] [REMOTE ] EOS: Full fetch complete (23167 records). [2025-10-14T18:44:26.349049] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-14T18:44:26.363450] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-14T18:44:26.522899] [DEBUG] [LOCAL ] EOD: Primary data saved (15024 records). [2025-10-14T18:44:26.560999] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-14T18:44:26.576844] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOD took 39.1s. Estimated remaining: 3h 47m 6s. Rate: 7.1 symbols/min [2025-10-14T18:44:26.939502] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:44:26.949781] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-14T18:44:26.949865] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-14T18:44:26.950479] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-14T18:44:26.950564] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-14T18:44:26.951751] [DEBUG] [LOCAL ] EOS: Trimmed 23167 records to 15287 (keeping 200 days of data) [2025-10-14T18:44:27.047733] [DEBUG] [LOCAL ] EPAC: Loaded 26461 existing records from primary storage. [2025-10-14T18:44:27.049305] [INFO ] [MAIN ] EPAC: Loaded 26461 existing records. [2025-10-14T18:44:27.163578] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-14T18:44:27.249599] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:44:27.251840] [DEBUG] [LOCAL ] EOS: Primary data saved (15287 records). [2025-10-14T18:44:27.252230] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-14T18:44:27.252173] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-14T18:44:27.252477] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOS took 32.9s. Estimated remaining: 3h 46m 40s. Rate: 7.2 symbols/min [2025-10-14T18:44:27.252365] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-14T18:44:27.285272] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-14T18:44:27.328753] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-14T18:44:27.559941] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:44:27.750712] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T18:44:27.834086] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:44:27.851037] [DEBUG] [LOCAL ] EPAM: Loaded 39518 existing records from primary storage. [2025-10-14T18:44:27.851614] [INFO ] [MAIN ] EPAM: Loaded 39518 existing records. [2025-10-14T18:44:27.958318] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-14T18:44:28.061614] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:44:28.074374] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-14T18:44:28.074498] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-14T18:44:28.075151] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-14T18:44:28.075218] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-14T18:44:28.076452] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T18:44:28.452608] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:44:28.758078] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-14T18:44:29.558064] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-14T18:44:29.661743] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T18:44:29.668242] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T18:44:30.358093] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-14T18:44:31.122429] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T18:44:31.158027] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-14T18:44:31.209818] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:44:31.746081] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T18:44:31.958077] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-14T18:44:32.457025] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T18:44:32.463266] [INFO ] [REMOTE ] EOG: Full fetch complete (77447 records). [2025-10-14T18:44:32.463406] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-14T18:44:32.765170] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-14T18:44:32.866285] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-14T18:44:32.866369] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-14T18:44:32.867271] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-14T18:44:32.867332] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-14T18:44:32.869173] [DEBUG] [LOCAL ] EOG: Trimmed 77447 records to 53364 (keeping 200 days of data) [2025-10-14T18:44:33.197007] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T18:44:33.210822] [DEBUG] [LOCAL ] EOG: Primary data saved (53364 records). [2025-10-14T18:44:33.210913] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-14T18:44:33.211944] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOG took 41.2s. Estimated remaining: 3h 46m 27s. Rate: 7.2 symbols/min [2025-10-14T18:44:33.387452] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:44:33.428256] [DEBUG] [LOCAL ] EPC: Loaded 39804 existing records from primary storage. [2025-10-14T18:44:33.428532] [INFO ] [MAIN ] EPC: Loaded 39804 existing records. [2025-10-14T18:44:33.563186] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-14T18:44:33.616543] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:44:33.616934] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-14T18:44:33.616983] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-14T18:44:33.617390] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-14T18:44:33.617447] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-14T18:44:33.964857] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:44:34.358050] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-14T18:44:34.512426] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T18:44:35.158083] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-14T18:44:35.772937] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T18:44:35.958082] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-14T18:44:36.183406] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T18:44:36.435210] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-14T18:44:36.758161] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-14T18:44:37.472016] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T18:44:37.558074] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-14T18:44:38.257017] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T18:44:38.358029] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-14T18:44:39.091156] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T18:44:39.092626] [INFO ] [REMOTE ] EOT: Full fetch complete (10797 records). [2025-10-14T18:44:39.092718] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-14T18:44:39.163209] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-14T18:44:39.449536] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-14T18:44:39.449616] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-14T18:44:39.449895] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-14T18:44:39.449951] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-14T18:44:39.450476] [DEBUG] [LOCAL ] EOT: Trimmed 10797 records to 6895 (keeping 200 days of data) [2025-10-14T18:44:39.492419] [DEBUG] [LOCAL ] EOT: Primary data saved (6895 records). [2025-10-14T18:44:39.492542] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-14T18:44:39.492618] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EOT took 24.6s. Estimated remaining: 3h 46m 14s. Rate: 7.2 symbols/min [2025-10-14T18:44:39.659167] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:44:39.711394] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-14T18:44:39.711740] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-14T18:44:39.886900] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:44:39.887112] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-14T18:44:39.887159] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-14T18:44:39.887348] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-14T18:44:39.887386] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-14T18:44:39.963208] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-14T18:44:40.238442] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:44:40.671854] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T18:44:40.758111] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-14T18:44:41.206091] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T18:44:41.558106] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-14T18:44:42.290956] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T18:44:42.358028] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-14T18:44:42.839244] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T18:44:43.158117] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-14T18:44:43.681953] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T18:44:43.958112] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-14T18:44:44.268996] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T18:44:44.758037] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-14T18:44:45.228744] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T18:44:45.558170] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-14T18:44:46.358070] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-14T18:44:46.414590] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T18:44:47.138362] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T18:44:47.164310] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-14T18:44:47.169770] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T18:44:47.958075] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-14T18:44:48.753723] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T18:44:48.762608] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-14T18:44:49.506276] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T18:44:49.558063] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-14T18:44:49.825391] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T18:44:50.358097] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-14T18:44:51.158063] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-14T18:44:51.373418] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T18:44:51.444488] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T18:44:51.958134] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-14T18:44:52.497912] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T18:44:52.758140] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-14T18:44:53.336761] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T18:44:53.558082] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-14T18:44:54.358072] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-14T18:44:54.533281] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T18:44:54.854740] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T18:44:55.158068] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-14T18:44:55.533063] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T18:44:55.958093] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-14T18:44:56.758100] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-14T18:44:56.970329] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T18:44:57.130240] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T18:44:57.558067] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-14T18:44:57.994992] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T18:44:58.358074] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-14T18:44:59.158096] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-14T18:44:59.313500] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T18:44:59.865424] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T18:44:59.958067] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-14T18:45:00.584598] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T18:45:00.758075] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-14T18:45:01.335078] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T18:45:01.558149] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-14T18:45:02.363252] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-14T18:45:02.390750] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T18:45:03.158117] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-14T18:45:03.363574] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T18:45:03.883082] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T18:45:03.886350] [INFO ] [REMOTE ] EPAC: Full fetch complete (38654 records). [2025-10-14T18:45:03.886456] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-14T18:45:03.963265] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-14T18:45:04.278865] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-14T18:45:04.278943] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-14T18:45:04.279567] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-14T18:45:04.279607] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-14T18:45:04.280526] [DEBUG] [LOCAL ] EPAC: Trimmed 38654 records to 26413 (keeping 200 days of data) [2025-10-14T18:45:04.444693] [DEBUG] [LOCAL ] EPAC: Primary data saved (26413 records). [2025-10-14T18:45:04.444832] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-14T18:45:04.444911] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPAC took 37.9s. Estimated remaining: 3h 46m 41s. Rate: 7.1 symbols/min [2025-10-14T18:45:04.651372] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:04.679246] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T18:45:04.723993] [DEBUG] [LOCAL ] EPR: Loaded 43903 existing records from primary storage. [2025-10-14T18:45:04.724324] [INFO ] [MAIN ] EPR: Loaded 43903 existing records. [2025-10-14T18:45:04.763235] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-14T18:45:04.917529] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:45:04.917796] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-14T18:45:04.917845] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-14T18:45:04.918053] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-14T18:45:04.918109] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-14T18:45:05.269420] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:05.558067] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-14T18:45:06.014013] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-14T18:45:06.358044] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-14T18:45:06.481892] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T18:45:07.158057] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-14T18:45:07.251910] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T18:45:07.908331] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T18:45:07.958066] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-14T18:45:08.758071] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-14T18:45:09.038534] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T18:45:09.463439] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T18:45:09.467717] [INFO ] [REMOTE ] EPAM: Full fetch complete (55954 records). [2025-10-14T18:45:09.467859] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-14T18:45:09.468622] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:45:09.468754] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:45:09.468798] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:45:09.468865] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-14T18:45:09.468944] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-14T18:45:09.468999] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-14T18:45:09.469211] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-14T18:45:09.469304] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPAM took 42.2s. Estimated remaining: 3h 46m 26s. Rate: 7.1 symbols/min [2025-10-14T18:45:09.567754] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-14T18:45:09.651424] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:09.651589] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-10-14T18:45:09.651626] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-10-14T18:45:09.651762] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-14T18:45:09.651802] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-14T18:45:09.651841] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-14T18:45:09.651872] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-14T18:45:10.006790] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:10.231252] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T18:45:10.236711] [INFO ] [REMOTE ] EPC: Full fetch complete (56953 records). [2025-10-14T18:45:10.236970] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-14T18:45:10.238231] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T18:45:10.238321] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:45:10.238364] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:45:10.238408] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-14T18:45:10.238470] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-14T18:45:10.238505] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-10-14T18:45:10.238916] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-10-14T18:45:10.239023] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPC took 37.0s. Estimated remaining: 3h 46m 1s. Rate: 7.2 symbols/min [2025-10-14T18:45:10.363313] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-14T18:45:10.410025] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:10.422917] [DEBUG] [LOCAL ] EQBK: Loaded 11061 existing records from primary storage. [2025-10-14T18:45:10.423147] [INFO ] [MAIN ] EQBK: Loaded 11061 existing records. [2025-10-14T18:45:10.599265] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:45:10.599448] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-14T18:45:10.599494] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-14T18:45:10.599805] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-14T18:45:10.599980] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-14T18:45:10.953436] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:11.158036] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-14T18:45:11.259780] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T18:45:11.958047] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-14T18:45:11.997563] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T18:45:12.466485] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-14T18:45:12.758073] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-14T18:45:13.223964] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T18:45:13.558089] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-14T18:45:13.814280] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T18:45:14.358062] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-14T18:45:15.158096] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-14T18:45:15.558320] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T18:45:15.825971] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T18:45:15.958057] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-14T18:45:16.308706] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T18:45:16.758093] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-14T18:45:17.464082] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T18:45:17.558038] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-14T18:45:17.576812] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T18:45:18.358078] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-14T18:45:19.025439] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T18:45:19.155989] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T18:45:19.158480] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-14T18:45:19.904596] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T18:45:19.958040] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-14T18:45:20.758054] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-14T18:45:20.794932] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T18:45:21.558056] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-14T18:45:21.945013] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T18:45:22.358064] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-14T18:45:23.158042] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-14T18:45:23.315730] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T18:45:23.321870] [INFO ] [REMOTE ] EPD: Full fetch complete (77770 records). [2025-10-14T18:45:23.322032] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-14T18:45:23.732487] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-14T18:45:23.732603] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-14T18:45:23.733691] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-14T18:45:23.733864] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-14T18:45:23.735593] [DEBUG] [LOCAL ] EPD: Trimmed 77770 records to 53611 (keeping 200 days of data) [2025-10-14T18:45:23.872530] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T18:45:23.980683] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-14T18:45:24.099173] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-14T18:45:24.099326] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-14T18:45:24.099409] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 44.6s. Estimated remaining: 3h 46m 4s. Rate: 7.1 symbols/min [2025-10-14T18:45:24.269792] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:24.318312] [DEBUG] [LOCAL ] EQH: Loaded 52685 existing records from primary storage. [2025-10-14T18:45:24.318619] [INFO ] [MAIN ] EQH: Loaded 52685 existing records. [2025-10-14T18:45:24.498969] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:45:24.499269] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-14T18:45:24.499426] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-14T18:45:24.499805] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-14T18:45:24.499867] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-14T18:45:24.764416] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-14T18:45:24.806799] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T18:45:24.904866] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:25.403185] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T18:45:25.558052] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-14T18:45:25.645539] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T18:45:26.055714] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-14T18:45:26.358066] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-14T18:45:27.158034] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-14T18:45:27.387597] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T18:45:27.958126] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-14T18:45:28.632591] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T18:45:28.758048] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-14T18:45:28.875440] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T18:45:29.558056] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-14T18:45:30.358090] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-14T18:45:30.502054] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:45:30.538245] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T18:45:31.158067] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-14T18:45:31.760883] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T18:45:31.958104] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-14T18:45:32.628439] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T18:45:32.630316] [INFO ] [REMOTE ] EQBK: Full fetch complete (15480 records). [2025-10-14T18:45:32.630387] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-14T18:45:32.763215] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-14T18:45:33.027191] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-14T18:45:33.027390] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-14T18:45:33.027822] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-14T18:45:33.028003] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-14T18:45:33.028892] [DEBUG] [LOCAL ] EQBK: Trimmed 15480 records to 11133 (keeping 200 days of data) [2025-10-14T18:45:33.114150] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T18:45:33.144268] [DEBUG] [LOCAL ] EQBK: Primary data saved (11133 records). [2025-10-14T18:45:33.144414] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-14T18:45:33.144495] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EQBK took 22.9s. Estimated remaining: 3h 45m 57s. Rate: 7.1 symbols/min [2025-10-14T18:45:33.314340] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:33.376591] [DEBUG] [LOCAL ] EQNR: Loaded 53028 existing records from primary storage. [2025-10-14T18:45:33.376959] [INFO ] [MAIN ] EQNR: Loaded 53028 existing records. [2025-10-14T18:45:33.558352] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-14T18:45:33.561772] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:45:33.562163] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-14T18:45:33.563089] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-14T18:45:33.563455] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-14T18:45:33.563511] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-14T18:45:33.982076] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:34.202951] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T18:45:34.358058] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-14T18:45:35.158055] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-14T18:45:35.303230] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T18:45:35.834730] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T18:45:35.958055] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-14T18:45:36.400693] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T18:45:36.758070] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-14T18:45:37.525743] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T18:45:37.558046] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-14T18:45:38.271627] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T18:45:38.276352] [INFO ] [REMOTE ] EPR: Full fetch complete (63195 records). [2025-10-14T18:45:38.276466] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-14T18:45:38.367590] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-14T18:45:38.682874] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-14T18:45:38.682955] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-14T18:45:38.683852] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-14T18:45:38.683915] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-14T18:45:38.685305] [DEBUG] [LOCAL ] EPR: Trimmed 63195 records to 43858 (keeping 200 days of data) [2025-10-14T18:45:38.973845] [DEBUG] [LOCAL ] EPR: Primary data saved (43858 records). [2025-10-14T18:45:38.973968] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-14T18:45:38.974047] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPR took 34.5s. Estimated remaining: 3h 45m 43s. Rate: 7.2 symbols/min [2025-10-14T18:45:39.179288] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:39.174319] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-14T18:45:39.219720] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T18:45:39.265995] [DEBUG] [LOCAL ] EQR: Loaded 51677 existing records from primary storage. [2025-10-14T18:45:39.266327] [INFO ] [MAIN ] EQR: Loaded 51677 existing records. [2025-10-14T18:45:39.443116] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:45:39.443272] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-14T18:45:39.443320] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-14T18:45:39.443987] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-14T18:45:39.444045] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-14T18:45:39.801013] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:39.934322] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T18:45:39.958031] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-14T18:45:40.758335] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-14T18:45:41.067438] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T18:45:41.329659] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:45:41.558070] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-14T18:45:42.238192] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T18:45:42.358047] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-14T18:45:43.008690] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T18:45:43.158064] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-14T18:45:43.605376] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T18:45:43.958105] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-14T18:45:44.758097] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-14T18:45:44.904339] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T18:45:45.558116] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-14T18:45:45.653561] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T18:45:45.949505] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T18:45:46.358111] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-14T18:45:47.158063] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-14T18:45:47.329356] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T18:45:47.958106] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-14T18:45:47.988825] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T18:45:48.758114] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-14T18:45:48.855412] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T18:45:48.861042] [INFO ] [REMOTE ] EPRT: Full fetch complete (69210 records). [2025-10-14T18:45:48.861156] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-14T18:45:49.241862] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-14T18:45:49.241947] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-14T18:45:49.242783] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-14T18:45:49.242845] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-14T18:45:49.244187] [DEBUG] [LOCAL ] EPRT: Trimmed 69210 records to 48439 (keeping 200 days of data) [2025-10-14T18:45:49.537661] [DEBUG] [LOCAL ] EPRT: Primary data saved (48439 records). [2025-10-14T18:45:49.537874] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-14T18:45:49.538090] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EPRT took 40.1s. Estimated remaining: 3h 45m 40s. Rate: 7.1 symbols/min [2025-10-14T18:45:49.569508] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-14T18:45:49.712986] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:45:49.713329] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-14T18:45:49.713397] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-14T18:45:49.713721] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-14T18:45:49.713822] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-14T18:45:49.713892] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-14T18:45:49.714138] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-14T18:45:49.874752] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T18:45:50.134409] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:45:50.188282] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T18:45:50.358087] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-14T18:45:51.155682] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T18:45:51.165382] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-14T18:45:51.713024] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T18:45:51.958048] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-14T18:45:52.128779] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T18:45:52.243256] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-14T18:45:52.758081] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-14T18:45:53.558081] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-14T18:45:54.358041] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-14T18:45:54.409444] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T18:45:55.158093] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-14T18:45:55.487202] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-14T18:45:55.566800] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-14T18:45:55.958054] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-14T18:45:56.258591] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T18:45:56.758093] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-14T18:45:57.558027] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-14T18:45:57.812589] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T18:45:58.358076] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-14T18:45:58.429399] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T18:45:58.923410] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T18:45:59.158056] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-14T18:45:59.958038] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-14T18:46:00.019718] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T18:46:00.298059] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-14T18:46:00.743275] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T18:46:00.758038] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-14T18:46:01.558057] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-14T18:46:02.358091] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-14T18:46:02.671426] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T18:46:02.747520] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-14T18:46:03.158042] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-14T18:46:03.281084] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T18:46:03.958057] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-14T18:46:04.741279] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T18:46:04.747360] [INFO ] [REMOTE ] EQH: Full fetch complete (76572 records). [2025-10-14T18:46:04.747517] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-14T18:46:04.763149] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-14T18:46:05.180009] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-14T18:46:05.179763] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T18:46:05.180165] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-14T18:46:05.182388] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-14T18:46:05.182461] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-14T18:46:05.184015] [DEBUG] [LOCAL ] EQH: Trimmed 76572 records to 52687 (keeping 200 days of data) [2025-10-14T18:46:05.507515] [DEBUG] [LOCAL ] EQH: Primary data saved (52687 records). [2025-10-14T18:46:05.507973] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-14T18:46:05.508126] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQH took 41.4s. Estimated remaining: 3h 45m 47s. Rate: 7.1 symbols/min [2025-10-14T18:46:05.558044] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-14T18:46:05.591395] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T18:46:05.939140] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-14T18:46:06.358065] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-14T18:46:07.158078] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-14T18:46:07.585170] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T18:46:07.958093] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-14T18:46:08.176422] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T18:46:08.182309] [INFO ] [REMOTE ] EQNR: Full fetch complete (76991 records). [2025-10-14T18:46:08.182429] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-14T18:46:08.587342] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-14T18:46:08.587435] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-14T18:46:08.588417] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-14T18:46:08.588484] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-14T18:46:08.590120] [DEBUG] [LOCAL ] EQNR: Trimmed 76991 records to 53039 (keeping 200 days of data) [2025-10-14T18:46:08.686804] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T18:46:08.775180] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-14T18:46:08.941991] [DEBUG] [LOCAL ] EQNR: Primary data saved (53039 records). [2025-10-14T18:46:08.942120] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-14T18:46:08.942194] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQNR took 35.8s. Estimated remaining: 3h 45m 28s. Rate: 7.1 symbols/min [2025-10-14T18:46:09.558075] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-14T18:46:10.134748] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T18:46:10.358139] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-14T18:46:10.464243] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T18:46:10.789784] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T18:46:10.790824] [INFO ] [REMOTE ] EQS: Full fetch complete (2476 records). [2025-10-14T18:46:10.790905] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-14T18:46:10.985579] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-14T18:46:10.985814] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:46:10.985882] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:46:10.985955] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-14T18:46:10.986018] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-14T18:46:10.986055] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-14T18:46:10.986094] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-14T18:46:10.986149] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQS took 21.4s. Estimated remaining: 3h 45m 6s. Rate: 7.2 symbols/min [2025-10-14T18:46:11.158110] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-14T18:46:12.889149] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T18:46:12.901572] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-14T18:46:14.305783] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T18:46:14.313446] [INFO ] [REMOTE ] EQR: Full fetch complete (74337 records). [2025-10-14T18:46:14.313729] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-14T18:46:14.712127] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-14T18:46:14.712243] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-14T18:46:14.713291] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-14T18:46:14.713358] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-14T18:46:14.714828] [DEBUG] [LOCAL ] EQR: Trimmed 74337 records to 51695 (keeping 200 days of data) [2025-10-14T18:46:15.037462] [DEBUG] [LOCAL ] EQR: Primary data saved (51695 records). [2025-10-14T18:46:15.037609] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-14T18:46:15.037760] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQR took 36.1s. Estimated remaining: 3h 44m 49s. Rate: 7.2 symbols/min [2025-10-14T18:46:15.705508] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:15.721516] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:15.764048] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:15.763222] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:15.770948] [DEBUG] [LOCAL ] EQV: Loaded 2666 existing records from primary storage. [2025-10-14T18:46:15.771229] [INFO ] [MAIN ] EQV: Loaded 2666 existing records. [2025-10-14T18:46:15.977182] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:15.987105] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-14T18:46:15.987185] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-14T18:46:15.987389] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-14T18:46:15.987464] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-14T18:46:16.135123] [DEBUG] [LOCAL ] ERO: Loaded 41700 existing records from primary storage. [2025-10-14T18:46:16.121622] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-14T18:46:16.141770] [INFO ] [MAIN ] ERO: Loaded 41700 existing records. [2025-10-14T18:46:16.152632] [DEBUG] [LOCAL ] ERJ: Loaded 50324 existing records from primary storage. [2025-10-14T18:46:16.168701] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-14T18:46:16.241014] [INFO ] [MAIN ] ERJ: Loaded 50324 existing records. [2025-10-14T18:46:16.823996] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:16.828274] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:16.857469] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-14T18:46:16.867826] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-14T18:46:16.857418] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-14T18:46:16.917690] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-14T18:46:16.906626] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-14T18:46:16.917811] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-14T18:46:16.978093] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:16.975184] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:17.001737] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-14T18:46:17.012364] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-14T18:46:17.002027] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-14T18:46:17.012590] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-14T18:46:17.012515] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-14T18:46:17.094783] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-14T18:46:17.149062] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-14T18:46:17.863852] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:17.930244] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T18:46:17.935721] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-14T18:46:17.991031] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-14T18:46:17.990538] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:17.991322] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-14T18:46:18.073621] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:18.073906] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-14T18:46:18.760061] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T18:46:18.762268] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-14T18:46:19.171235] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T18:46:19.180093] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-14T18:46:19.340432] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T18:46:19.342082] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-14T18:46:19.603267] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T18:46:19.612391] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-14T18:46:19.668156] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-14T18:46:19.955372] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-14T18:46:19.963172] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-14T18:46:20.307309] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-14T18:46:20.309622] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T18:46:20.758029] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-14T18:46:20.862247] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T18:46:21.274866] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-14T18:46:21.558066] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-14T18:46:22.358084] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-14T18:46:22.997459] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T18:46:23.158050] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-14T18:46:23.958111] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-14T18:46:24.333639] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-14T18:46:24.697469] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T18:46:24.729812] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T18:46:24.758044] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-14T18:46:25.558056] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-14T18:46:26.358084] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-14T18:46:26.595938] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T18:46:27.158054] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-14T18:46:27.259954] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T18:46:27.486610] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T18:46:27.958108] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-14T18:46:28.412762] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T18:46:28.746594] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T18:46:28.758021] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-14T18:46:29.558067] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-14T18:46:30.358077] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-14T18:46:30.741987] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T18:46:31.158175] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-14T18:46:31.336094] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:46:31.632796] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T18:46:31.740596] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T18:46:31.958107] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-14T18:46:32.388736] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T18:46:32.758127] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-14T18:46:33.558050] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-14T18:46:33.920210] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-14T18:46:33.920948] [INFO ] [REMOTE ] EQV: Full fetch complete (5716 records). [2025-10-14T18:46:33.921014] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-14T18:46:34.312164] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-14T18:46:34.313435] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T18:46:34.312740] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-14T18:46:34.321353] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-14T18:46:34.321536] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-14T18:46:34.322293] [DEBUG] [LOCAL ] EQV: Trimmed 5716 records to 2660 (keeping 200 days of data) [2025-10-14T18:46:34.337435] [DEBUG] [LOCAL ] EQV: Primary data saved (2660 records). [2025-10-14T18:46:34.337493] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-14T18:46:34.337557] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 19.3s. Estimated remaining: 3h 45m 4s. Rate: 7.1 symbols/min [2025-10-14T18:46:34.366832] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-14T18:46:34.507838] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:34.556111] [DEBUG] [LOCAL ] ES: Loaded 52672 existing records from primary storage. [2025-10-14T18:46:34.556417] [INFO ] [MAIN ] ES: Loaded 52672 existing records. [2025-10-14T18:46:34.733043] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:34.733238] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-14T18:46:34.733284] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-14T18:46:34.733525] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-14T18:46:34.733565] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-14T18:46:35.092292] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:35.158027] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-14T18:46:35.958090] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-14T18:46:36.129997] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T18:46:36.512451] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T18:46:36.758063] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-14T18:46:37.499632] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T18:46:37.558034] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-14T18:46:38.358047] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-14T18:46:38.389707] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T18:46:39.155880] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T18:46:39.165679] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-14T18:46:39.951402] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T18:46:39.961464] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-14T18:46:40.499432] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T18:46:40.758068] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-14T18:46:41.326499] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T18:46:41.558087] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-14T18:46:42.172695] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T18:46:42.358067] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-14T18:46:43.158098] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-14T18:46:43.628182] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T18:46:43.958044] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-14T18:46:44.343776] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T18:46:44.758068] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-14T18:46:44.910489] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T18:46:45.558116] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-14T18:46:46.013342] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T18:46:46.213589] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T18:46:46.358030] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-14T18:46:47.158108] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-14T18:46:47.502178] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T18:46:47.958051] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-14T18:46:48.133725] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T18:46:48.768142] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-14T18:46:48.773435] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T18:46:49.535551] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T18:46:49.558028] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-14T18:46:50.099220] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T18:46:50.358065] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-14T18:46:51.158052] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-14T18:46:51.223800] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T18:46:51.229192] [INFO ] [REMOTE ] ERO: Full fetch complete (60141 records). [2025-10-14T18:46:51.229302] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-14T18:46:51.619550] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-14T18:46:51.619681] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-14T18:46:51.620581] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-14T18:46:51.620764] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-14T18:46:51.622027] [DEBUG] [LOCAL ] ERO: Trimmed 60141 records to 41797 (keeping 200 days of data) [2025-10-14T18:46:51.860573] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T18:46:51.913438] [DEBUG] [LOCAL ] ERO: Primary data saved (41797 records). [2025-10-14T18:46:51.913569] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-14T18:46:51.913668] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 36.9s. Estimated remaining: 3h 45m 14s. Rate: 7.1 symbols/min [2025-10-14T18:46:51.963190] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-14T18:46:52.088659] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:52.115707] [DEBUG] [LOCAL ] ESAB: Loaded 26029 existing records from primary storage. [2025-10-14T18:46:52.115962] [INFO ] [MAIN ] ESAB: Loaded 26029 existing records. [2025-10-14T18:46:52.291009] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:52.291229] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-14T18:46:52.291275] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-14T18:46:52.291767] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-14T18:46:52.291823] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-14T18:46:52.659776] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:52.758085] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-14T18:46:52.896593] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T18:46:52.902535] [INFO ] [REMOTE ] EQT: Full fetch complete (77858 records). [2025-10-14T18:46:52.902673] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-14T18:46:53.301585] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-14T18:46:53.301819] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-14T18:46:53.302885] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-14T18:46:53.302993] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-14T18:46:53.304794] [DEBUG] [LOCAL ] EQT: Trimmed 77858 records to 53685 (keeping 200 days of data) [2025-10-14T18:46:53.426221] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T18:46:53.564316] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-14T18:46:53.671417] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-14T18:46:53.671549] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-14T18:46:53.671662] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. EQT took 38.6s. Estimated remaining: 3h 44m 52s. Rate: 7.1 symbols/min [2025-10-14T18:46:53.853434] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:46:53.875378] [DEBUG] [LOCAL ] ESE: Loaded 16500 existing records from primary storage. [2025-10-14T18:46:53.875716] [INFO ] [MAIN ] ESE: Loaded 16500 existing records. [2025-10-14T18:46:54.090841] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:46:54.091112] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-14T18:46:54.091176] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-14T18:46:54.091410] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-14T18:46:54.091479] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-14T18:46:54.373880] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-14T18:46:54.628320] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:46:54.666673] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T18:46:54.695723] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T18:46:55.158058] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-14T18:46:55.958098] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-14T18:46:56.023555] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:46:56.579178] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:46:56.710754] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T18:46:56.758120] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-14T18:46:57.533034] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T18:46:57.558039] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-14T18:46:58.288783] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T18:46:58.358044] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-14T18:46:59.158077] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-14T18:46:59.621999] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T18:46:59.925927] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T18:46:59.931948] [INFO ] [REMOTE ] ES: Full fetch complete (76437 records). [2025-10-14T18:46:59.932110] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-14T18:46:59.963188] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-14T18:47:00.330742] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-14T18:47:00.330833] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-14T18:47:00.331770] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-14T18:47:00.331833] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-14T18:47:00.333267] [DEBUG] [LOCAL ] ES: Trimmed 76437 records to 52697 (keeping 200 days of data) [2025-10-14T18:47:00.650751] [DEBUG] [LOCAL ] ES: Primary data saved (52697 records). [2025-10-14T18:47:00.650901] [INFO ] [MAIN ] ES: Full history saved. [2025-10-14T18:47:00.650990] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ES took 26.3s. Estimated remaining: 3h 44m 41s. Rate: 7.1 symbols/min [2025-10-14T18:47:00.763144] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-14T18:47:00.823615] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:00.871283] [DEBUG] [LOCAL ] ESI: Loaded 50681 existing records from primary storage. [2025-10-14T18:47:00.871570] [INFO ] [MAIN ] ESI: Loaded 50681 existing records. [2025-10-14T18:47:01.050070] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:01.050236] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-14T18:47:01.050281] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-14T18:47:01.050687] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-14T18:47:01.050745] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-14T18:47:01.408334] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:01.424968] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T18:47:01.488141] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T18:47:01.558030] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-14T18:47:02.358051] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-14T18:47:02.644226] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T18:47:03.158084] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-14T18:47:03.574546] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T18:47:03.958094] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-14T18:47:04.673449] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T18:47:04.758096] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-14T18:47:04.899459] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T18:47:04.907023] [INFO ] [REMOTE ] ERJ: Full fetch complete (72679 records). [2025-10-14T18:47:04.907212] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-14T18:47:05.296805] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-14T18:47:05.296891] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-14T18:47:05.297740] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-14T18:47:05.297800] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-14T18:47:05.299235] [DEBUG] [LOCAL ] ERJ: Trimmed 72679 records to 50329 (keeping 200 days of data) [2025-10-14T18:47:05.559520] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-14T18:47:05.592120] [DEBUG] [LOCAL ] ERJ: Primary data saved (50329 records). [2025-10-14T18:47:05.592229] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-14T18:47:05.592304] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ERJ took 50.5s. Estimated remaining: 3h 44m 25s. Rate: 7.1 symbols/min [2025-10-14T18:47:05.759260] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:05.795626] [DEBUG] [LOCAL ] ESNT: Loaded 38336 existing records from primary storage. [2025-10-14T18:47:05.795937] [INFO ] [MAIN ] ESNT: Loaded 38336 existing records. [2025-10-14T18:47:05.978498] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:05.978742] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-14T18:47:05.978794] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-14T18:47:05.979170] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-14T18:47:05.979226] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-14T18:47:06.330780] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:06.363266] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-14T18:47:06.374701] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T18:47:06.429557] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-14T18:47:07.158066] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-14T18:47:07.449980] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T18:47:07.958112] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-14T18:47:08.672898] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T18:47:08.758078] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-14T18:47:08.958987] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T18:47:09.558051] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-14T18:47:09.607434] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T18:47:10.358068] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-14T18:47:10.671067] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T18:47:11.158125] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-14T18:47:11.867324] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T18:47:11.958061] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-14T18:47:12.078544] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T18:47:12.758042] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-14T18:47:13.080752] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T18:47:13.558088] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-14T18:47:14.358095] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-14T18:47:14.530987] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T18:47:14.737851] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T18:47:15.158079] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-14T18:47:15.217265] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T18:47:15.958059] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-14T18:47:16.585942] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T18:47:16.758058] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-14T18:47:17.066125] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T18:47:17.558043] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-14T18:47:17.813009] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T18:47:18.358039] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-14T18:47:18.512829] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T18:47:18.514905] [INFO ] [REMOTE ] ESE: Full fetch complete (22569 records). [2025-10-14T18:47:18.514976] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-14T18:47:18.903595] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-14T18:47:18.903687] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-14T18:47:18.904156] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-14T18:47:18.904194] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-14T18:47:18.904787] [DEBUG] [LOCAL ] ESE: Trimmed 22569 records to 16489 (keeping 200 days of data) [2025-10-14T18:47:19.005982] [DEBUG] [LOCAL ] ESE: Primary data saved (16489 records). [2025-10-14T18:47:19.006109] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-14T18:47:19.006185] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 25.3s. Estimated remaining: 3h 44m 27s. Rate: 7.1 symbols/min [2025-10-14T18:47:19.161251] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-14T18:47:19.179879] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:19.220047] [DEBUG] [LOCAL ] ESRT: Loaded 46391 existing records from primary storage. [2025-10-14T18:47:19.220368] [INFO ] [MAIN ] ESRT: Loaded 46391 existing records. [2025-10-14T18:47:19.397536] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:19.397762] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-14T18:47:19.397809] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-14T18:47:19.398012] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-14T18:47:19.398068] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-14T18:47:19.746344] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T18:47:19.782869] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:19.958048] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-14T18:47:20.375440] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T18:47:20.758062] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-14T18:47:21.558522] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T18:47:21.558630] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-14T18:47:22.034178] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-14T18:47:22.358068] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-14T18:47:22.872112] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T18:47:23.158093] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-14T18:47:23.958085] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-14T18:47:23.987883] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T18:47:24.501052] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T18:47:24.758063] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-14T18:47:25.073843] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T18:47:25.558065] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-14T18:47:26.358049] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-14T18:47:26.602306] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T18:47:26.913714] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T18:47:27.158100] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-14T18:47:27.209151] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T18:47:27.213834] [INFO ] [REMOTE ] ESAB: Full fetch complete (35926 records). [2025-10-14T18:47:27.213936] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-14T18:47:27.590190] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-14T18:47:27.590288] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-14T18:47:27.590898] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-14T18:47:27.591331] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-14T18:47:27.592242] [DEBUG] [LOCAL ] ESAB: Trimmed 35926 records to 26055 (keeping 200 days of data) [2025-10-14T18:47:27.755015] [DEBUG] [LOCAL ] ESAB: Primary data saved (26055 records). [2025-10-14T18:47:27.755138] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-14T18:47:27.755213] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESAB took 35.8s. Estimated remaining: 3h 44m 19s. Rate: 7.1 symbols/min [2025-10-14T18:47:27.924418] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:27.953556] [DEBUG] [LOCAL ] ESS: Loaded 29854 existing records from primary storage. [2025-10-14T18:47:27.953835] [INFO ] [MAIN ] ESS: Loaded 29854 existing records. [2025-10-14T18:47:27.964943] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-14T18:47:28.132902] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:28.133212] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-14T18:47:28.133265] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-14T18:47:28.133547] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-14T18:47:28.133604] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-14T18:47:28.491576] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T18:47:28.512993] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:28.758099] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-14T18:47:29.427613] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T18:47:29.558047] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-14T18:47:29.949807] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T18:47:30.358070] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-14T18:47:30.815187] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T18:47:31.158069] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-14T18:47:31.614710] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T18:47:31.958085] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-14T18:47:32.454121] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:47:32.758064] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-14T18:47:33.026518] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T18:47:33.558055] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-14T18:47:34.123221] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T18:47:34.128828] [INFO ] [REMOTE ] ESI: Full fetch complete (73072 records). [2025-10-14T18:47:34.128940] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-14T18:47:34.366012] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-14T18:47:34.567143] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-14T18:47:34.567229] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-14T18:47:34.568346] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-14T18:47:34.568410] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-14T18:47:34.569794] [DEBUG] [LOCAL ] ESI: Trimmed 73072 records to 50665 (keeping 200 days of data) [2025-10-14T18:47:34.872061] [DEBUG] [LOCAL ] ESI: Primary data saved (50665 records). [2025-10-14T18:47:34.872207] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-14T18:47:34.872310] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 34.2s. Estimated remaining: 3h 44m 8s. Rate: 7.1 symbols/min [2025-10-14T18:47:35.044271] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:35.089882] [DEBUG] [LOCAL ] ESTC: Loaded 50268 existing records from primary storage. [2025-10-14T18:47:35.090295] [INFO ] [MAIN ] ESTC: Loaded 50268 existing records. [2025-10-14T18:47:35.167223] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-14T18:47:35.195833] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T18:47:35.302936] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:35.303159] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-14T18:47:35.303206] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-14T18:47:35.303753] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-14T18:47:35.303822] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-14T18:47:35.658943] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:35.736922] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T18:47:35.958119] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-14T18:47:36.519825] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T18:47:36.758071] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-14T18:47:37.407184] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T18:47:37.558045] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-14T18:47:38.051892] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T18:47:38.358094] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-14T18:47:39.158099] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-14T18:47:39.198190] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T18:47:39.946981] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T18:47:39.958031] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-14T18:47:40.700021] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T18:47:40.758066] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-14T18:47:41.484259] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T18:47:41.558051] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-14T18:47:41.803237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T18:47:42.358072] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-14T18:47:43.163240] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-14T18:47:43.180997] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T18:47:43.725213] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T18:47:43.958100] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-14T18:47:44.550348] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T18:47:44.758102] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-14T18:47:44.999781] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T18:47:45.558075] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-14T18:47:46.055736] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T18:47:46.358051] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-14T18:47:47.066586] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T18:47:47.158125] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-14T18:47:47.958098] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-14T18:47:48.073911] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T18:47:48.294013] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T18:47:48.758087] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-14T18:47:49.475186] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T18:47:49.558039] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-14T18:47:50.358042] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-14T18:47:50.491616] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T18:47:50.988869] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T18:47:50.994688] [INFO ] [REMOTE ] ESRT: Full fetch complete (66575 records). [2025-10-14T18:47:50.994879] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-14T18:47:51.165031] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-14T18:47:51.427384] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-14T18:47:51.427572] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-14T18:47:51.428518] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-14T18:47:51.428606] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-14T18:47:51.430185] [DEBUG] [LOCAL ] ESRT: Trimmed 66575 records to 46416 (keeping 200 days of data) [2025-10-14T18:47:51.534067] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T18:47:51.723943] [DEBUG] [LOCAL ] ESRT: Primary data saved (46416 records). [2025-10-14T18:47:51.724094] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-14T18:47:51.724178] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESRT took 32.7s. Estimated remaining: 3h 44m 18s. Rate: 7.1 symbols/min [2025-10-14T18:47:51.894143] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:51.947592] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-14T18:47:51.947986] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-14T18:47:51.968457] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-14T18:47:52.126932] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:52.127147] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-14T18:47:52.127196] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-14T18:47:52.127785] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-14T18:47:52.127843] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-14T18:47:52.492528] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:52.507289] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T18:47:52.511921] [INFO ] [REMOTE ] ESNT: Full fetch complete (57188 records). [2025-10-14T18:47:52.512016] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-14T18:47:52.767848] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-14T18:47:52.905289] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-14T18:47:52.905441] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-14T18:47:52.906318] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-14T18:47:52.906382] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-14T18:47:52.907546] [DEBUG] [LOCAL ] ESNT: Trimmed 57188 records to 38293 (keeping 200 days of data) [2025-10-14T18:47:53.037516] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T18:47:53.173791] [DEBUG] [LOCAL ] ESNT: Primary data saved (38293 records). [2025-10-14T18:47:53.173945] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-14T18:47:53.174025] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESNT took 47.6s. Estimated remaining: 3h 43m 55s. Rate: 7.1 symbols/min [2025-10-14T18:47:53.345151] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:53.358766] [DEBUG] [LOCAL ] ETB: Loaded 12121 existing records from primary storage. [2025-10-14T18:47:53.358971] [INFO ] [MAIN ] ETB: Loaded 12121 existing records. [2025-10-14T18:47:53.548033] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:53.548292] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-14T18:47:53.548384] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-14T18:47:53.548620] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-14T18:47:53.548722] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-14T18:47:53.563296] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-14T18:47:53.927306] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:54.358069] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-14T18:47:54.829073] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T18:47:54.832383] [INFO ] [REMOTE ] ESS: Full fetch complete (43415 records). [2025-10-14T18:47:54.832460] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-14T18:47:55.167795] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-14T18:47:55.244218] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-14T18:47:55.244512] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-14T18:47:55.245633] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-14T18:47:55.247082] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-14T18:47:55.257462] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-14T18:47:55.259544] [DEBUG] [LOCAL ] ESS: Trimmed 43415 records to 29971 (keeping 200 days of data) [2025-10-14T18:47:55.444392] [DEBUG] [LOCAL ] ESS: Primary data saved (29971 records). [2025-10-14T18:47:55.444486] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-14T18:47:55.444563] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESS took 27.7s. Estimated remaining: 3h 43m 34s. Rate: 7.1 symbols/min [2025-10-14T18:47:55.612507] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:47:55.639697] [DEBUG] [LOCAL ] ETD: Loaded 27310 existing records from primary storage. [2025-10-14T18:47:55.639981] [INFO ] [MAIN ] ETD: Loaded 27310 existing records. [2025-10-14T18:47:55.816535] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:47:55.816749] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-14T18:47:55.816801] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-14T18:47:55.817017] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-14T18:47:55.817071] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-14T18:47:55.961697] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-14T18:47:56.159448] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T18:47:56.204179] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:47:56.235847] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T18:47:56.758080] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-14T18:47:57.558090] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-14T18:47:57.772309] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T18:47:58.098031] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-14T18:47:58.136111] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T18:47:58.358084] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-14T18:47:59.158058] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-14T18:47:59.189342] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T18:47:59.958069] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-14T18:48:00.112108] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T18:48:00.758106] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-14T18:48:01.558069] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-14T18:48:01.819570] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T18:48:02.358037] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-14T18:48:02.402929] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T18:48:02.779022] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-14T18:48:03.002563] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T18:48:03.158073] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-14T18:48:03.958089] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-14T18:48:04.124076] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T18:48:04.758059] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-14T18:48:05.082868] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T18:48:05.558102] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-14T18:48:06.358083] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-14T18:48:06.511896] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T18:48:06.887878] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T18:48:07.158107] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-14T18:48:07.958074] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-14T18:48:08.455092] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T18:48:08.570110] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-14T18:48:08.758100] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-14T18:48:08.808429] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T18:48:09.558052] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-14T18:48:09.975897] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T18:48:10.358078] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-14T18:48:11.023740] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T18:48:11.158064] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-14T18:48:11.187880] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T18:48:11.958063] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-14T18:48:12.758105] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-14T18:48:12.938315] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T18:48:12.971866] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T18:48:13.558040] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-14T18:48:13.942855] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T18:48:14.358100] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-14T18:48:14.892081] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-14T18:48:15.158086] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-14T18:48:15.202309] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T18:48:15.208487] [INFO ] [REMOTE ] ESTC: Full fetch complete (72352 records). [2025-10-14T18:48:15.208692] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-14T18:48:15.630146] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-14T18:48:15.630244] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-14T18:48:15.631288] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-14T18:48:15.631357] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-14T18:48:15.632836] [DEBUG] [LOCAL ] ESTC: Trimmed 72352 records to 50322 (keeping 200 days of data) [2025-10-14T18:48:15.731736] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T18:48:15.958156] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-14T18:48:15.970923] [DEBUG] [LOCAL ] ESTC: Primary data saved (50322 records). [2025-10-14T18:48:15.971021] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-14T18:48:15.971098] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ESTC took 41.1s. Estimated remaining: 3h 43m 50s. Rate: 7.1 symbols/min [2025-10-14T18:48:16.157529] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:48:16.174588] [DEBUG] [LOCAL ] ETG: Loaded 16585 existing records from primary storage. [2025-10-14T18:48:16.174916] [INFO ] [MAIN ] ETG: Loaded 16585 existing records. [2025-10-14T18:48:16.349426] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:48:16.349720] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-14T18:48:16.349774] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-14T18:48:16.350326] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-14T18:48:16.350397] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-14T18:48:16.629273] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T18:48:16.653772] [INFO ] [REMOTE ] ETB: Full fetch complete (18309 records). [2025-10-14T18:48:16.673508] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-14T18:48:16.766930] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-14T18:48:16.756494] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:48:17.077753] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-14T18:48:17.077841] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-14T18:48:17.078256] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-14T18:48:17.078316] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-14T18:48:17.079053] [DEBUG] [LOCAL ] ETB: Trimmed 18309 records to 12065 (keeping 200 days of data) [2025-10-14T18:48:17.150301] [DEBUG] [LOCAL ] ETB: Primary data saved (12065 records). [2025-10-14T18:48:17.150423] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-14T18:48:17.150499] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ETB took 24.0s. Estimated remaining: 3h 43m 27s. Rate: 7.1 symbols/min [2025-10-14T18:48:17.318069] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:48:17.335011] [DEBUG] [LOCAL ] ETJ: Loaded 16965 existing records from primary storage. [2025-10-14T18:48:17.335214] [INFO ] [MAIN ] ETJ: Loaded 16965 existing records. [2025-10-14T18:48:17.512066] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:48:17.512276] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-14T18:48:17.512322] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-14T18:48:17.512478] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-14T18:48:17.512514] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-14T18:48:17.566377] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-14T18:48:17.864925] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:48:18.358054] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-14T18:48:18.922381] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T18:48:19.029174] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-14T18:48:19.158073] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-14T18:48:19.356037] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T18:48:19.958063] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-14T18:48:20.698208] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T18:48:20.758024] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-14T18:48:21.109208] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-14T18:48:21.412138] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-14T18:48:21.558062] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-14T18:48:22.358058] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-14T18:48:22.611391] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T18:48:23.158105] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-14T18:48:23.958050] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-14T18:48:24.097319] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T18:48:24.628386] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-14T18:48:24.650544] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T18:48:24.758047] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-14T18:48:25.558052] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-14T18:48:25.787956] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T18:48:26.358062] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-14T18:48:26.639244] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-14T18:48:27.158088] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-14T18:48:27.958100] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-14T18:48:28.202504] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T18:48:28.383603] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T18:48:28.758070] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-14T18:48:28.869437] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T18:48:29.534486] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T18:48:29.558028] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-14T18:48:30.358110] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-14T18:48:30.539143] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T18:48:31.158054] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-14T18:48:31.399074] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T18:48:31.958049] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-14T18:48:31.994325] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T18:48:31.997488] [INFO ] [REMOTE ] ETD: Full fetch complete (38566 records). [2025-10-14T18:48:31.997564] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-14T18:48:32.396051] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-14T18:48:32.396135] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-14T18:48:32.396774] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-14T18:48:32.396837] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-14T18:48:32.397777] [DEBUG] [LOCAL ] ETD: Trimmed 38566 records to 27280 (keeping 200 days of data) [2025-10-14T18:48:32.567055] [DEBUG] [LOCAL ] ETD: Primary data saved (27280 records). [2025-10-14T18:48:32.567192] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-14T18:48:32.567460] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETD took 37.1s. Estimated remaining: 3h 43m 33s. Rate: 7.1 symbols/min [2025-10-14T18:48:32.735489] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:48:32.765263] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-14T18:48:32.786440] [DEBUG] [LOCAL ] ETN: Loaded 52670 existing records from primary storage. [2025-10-14T18:48:32.786758] [INFO ] [MAIN ] ETN: Loaded 52670 existing records. [2025-10-14T18:48:32.966514] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:48:32.966877] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-14T18:48:32.967059] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-14T18:48:32.967617] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-14T18:48:32.967710] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-14T18:48:33.132394] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T18:48:33.347138] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:48:33.496420] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T18:48:33.558091] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-14T18:48:34.358076] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-14T18:48:35.158043] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-14T18:48:35.410333] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T18:48:35.958064] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-14T18:48:36.106477] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T18:48:36.309358] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T18:48:36.758070] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-14T18:48:36.980856] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T18:48:37.558074] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-14T18:48:38.358111] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-14T18:48:38.676028] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-14T18:48:39.158042] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-14T18:48:39.339591] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T18:48:39.393808] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T18:48:39.958141] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-14T18:48:40.723526] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T18:48:40.758022] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-14T18:48:40.838229] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T18:48:41.558096] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-14T18:48:42.358082] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-14T18:48:42.559128] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T18:48:42.561635] [INFO ] [REMOTE ] ETJ: Full fetch complete (25585 records). [2025-10-14T18:48:42.561755] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-14T18:48:42.877166] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-14T18:48:42.968555] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-14T18:48:42.968629] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-14T18:48:42.969147] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-14T18:48:42.969194] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-14T18:48:42.969884] [DEBUG] [LOCAL ] ETJ: Trimmed 25585 records to 16926 (keeping 200 days of data) [2025-10-14T18:48:43.072947] [DEBUG] [LOCAL ] ETJ: Primary data saved (16926 records). [2025-10-14T18:48:43.073092] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-14T18:48:43.073185] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETJ took 25.9s. Estimated remaining: 3h 43m 29s. Rate: 7.1 symbols/min [2025-10-14T18:48:43.168338] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-14T18:48:43.231078] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T18:48:43.255846] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:48:43.269006] [DEBUG] [LOCAL ] ETO: Loaded 6923 existing records from primary storage. [2025-10-14T18:48:43.269204] [INFO ] [MAIN ] ETO: Loaded 6923 existing records. [2025-10-14T18:48:43.444431] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:48:43.444672] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-14T18:48:43.444733] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-14T18:48:43.444902] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-14T18:48:43.444975] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-14T18:48:43.794982] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:48:43.958072] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-14T18:48:44.541812] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T18:48:44.758031] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-14T18:48:44.793342] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:48:45.558110] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-14T18:48:45.718705] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T18:48:46.358127] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-14T18:48:47.158083] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-14T18:48:47.600480] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T18:48:47.619307] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T18:48:47.958071] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-14T18:48:48.520217] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-14T18:48:48.526328] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-14T18:48:48.526463] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-14T18:48:48.767475] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-14T18:48:48.925387] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-14T18:48:48.925466] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-14T18:48:48.926361] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-14T18:48:48.926421] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-14T18:48:48.927849] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-14T18:48:49.247052] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T18:48:49.266564] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-14T18:48:49.266714] [INFO ] [MAIN ] ET: Full history saved. [2025-10-14T18:48:49.266912] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ET took 57.5s. Estimated remaining: 3h 43m 16s. Rate: 7.1 symbols/min [2025-10-14T18:48:49.439199] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:48:49.469592] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T18:48:49.525057] [DEBUG] [LOCAL ] ETR: Loaded 53213 existing records from primary storage. [2025-10-14T18:48:49.525380] [INFO ] [MAIN ] ETR: Loaded 53213 existing records. [2025-10-14T18:48:49.563680] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-14T18:48:49.705982] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:48:49.706258] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-14T18:48:49.706347] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-14T18:48:49.706808] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-14T18:48:49.706868] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-14T18:48:50.083585] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:48:50.239175] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-14T18:48:50.358084] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-14T18:48:51.158097] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-14T18:48:51.958102] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-14T18:48:52.024712] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T18:48:52.758045] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-14T18:48:52.843682] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T18:48:52.845883] [INFO ] [REMOTE ] ETG: Full fetch complete (24831 records). [2025-10-14T18:48:52.845950] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-14T18:48:53.248585] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-14T18:48:53.249007] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-14T18:48:53.250930] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-14T18:48:53.249905] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-14T18:48:53.261566] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-14T18:48:53.263094] [DEBUG] [LOCAL ] ETG: Trimmed 24831 records to 16697 (keeping 200 days of data) [2025-10-14T18:48:53.364080] [DEBUG] [LOCAL ] ETG: Primary data saved (16697 records). [2025-10-14T18:48:53.364210] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-14T18:48:53.364286] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETG took 37.4s. Estimated remaining: 3h 42m 59s. Rate: 7.1 symbols/min [2025-10-14T18:48:53.533804] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:48:53.561323] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-14T18:48:53.585276] [DEBUG] [LOCAL ] ETSY: Loaded 53582 existing records from primary storage. [2025-10-14T18:48:53.585579] [INFO ] [MAIN ] ETSY: Loaded 53582 existing records. [2025-10-14T18:48:53.772223] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:48:53.772469] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-14T18:48:53.772524] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-14T18:48:53.772790] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-14T18:48:53.772848] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-14T18:48:54.148904] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:48:54.196972] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T18:48:54.335534] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T18:48:54.358030] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-14T18:48:55.158087] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-14T18:48:55.958090] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-14T18:48:56.043369] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T18:48:56.442492] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T18:48:56.758065] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-14T18:48:56.950392] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T18:48:57.538837] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T18:48:57.558031] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-14T18:48:58.358082] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-14T18:48:59.066480] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T18:48:59.158038] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-14T18:48:59.699796] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-14T18:48:59.958039] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-14T18:49:00.758106] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-14T18:49:00.894637] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T18:49:00.931815] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T18:49:01.558056] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-14T18:49:02.358110] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-14T18:49:02.831702] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-14T18:49:02.837399] [INFO ] [REMOTE ] ETN: Full fetch complete (76629 records). [2025-10-14T18:49:02.837541] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-14T18:49:03.104287] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T18:49:03.158297] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-14T18:49:03.257223] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-14T18:49:03.257376] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-14T18:49:03.258361] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-14T18:49:03.258442] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-14T18:49:03.259962] [DEBUG] [LOCAL ] ETN: Trimmed 76629 records to 52656 (keeping 200 days of data) [2025-10-14T18:49:03.399994] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T18:49:03.645239] [DEBUG] [LOCAL ] ETN: Primary data saved (52656 records). [2025-10-14T18:49:03.645375] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-14T18:49:03.645449] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETN took 31.1s. Estimated remaining: 3h 42m 54s. Rate: 7.1 symbols/min [2025-10-14T18:49:03.822604] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:49:03.846850] [DEBUG] [LOCAL ] ETV: Loaded 22265 existing records from primary storage. [2025-10-14T18:49:03.847132] [INFO ] [MAIN ] ETV: Loaded 22265 existing records. [2025-10-14T18:49:03.963280] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-14T18:49:04.050842] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:49:04.051066] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-14T18:49:04.051114] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-14T18:49:04.051281] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-14T18:49:04.051320] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-14T18:49:04.406901] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:49:04.727764] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T18:49:04.758087] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-14T18:49:05.526542] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T18:49:05.528295] [INFO ] [REMOTE ] ETO: Full fetch complete (9737 records). [2025-10-14T18:49:05.528361] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-14T18:49:05.563239] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-14T18:49:05.900925] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-14T18:49:05.901029] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-14T18:49:05.901395] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-14T18:49:05.901519] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-14T18:49:05.902209] [DEBUG] [LOCAL ] ETO: Trimmed 9737 records to 6995 (keeping 200 days of data) [2025-10-14T18:49:05.968976] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-14T18:49:05.993250] [DEBUG] [LOCAL ] ETO: Primary data saved (6995 records). [2025-10-14T18:49:05.993403] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-14T18:49:05.993488] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETO took 22.9s. Estimated remaining: 3h 42m 33s. Rate: 7.1 symbols/min [2025-10-14T18:49:06.164315] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:49:06.189347] [DEBUG] [LOCAL ] ETW: Loaded 25671 existing records from primary storage. [2025-10-14T18:49:06.189613] [INFO ] [MAIN ] ETW: Loaded 25671 existing records. [2025-10-14T18:49:06.364569] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-14T18:49:06.370312] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:49:06.371434] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-14T18:49:06.371501] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-14T18:49:06.371743] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-14T18:49:06.371804] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-14T18:49:06.754756] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:49:07.076179] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T18:49:07.158033] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-14T18:49:07.559572] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T18:49:07.958071] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-14T18:49:08.758072] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-14T18:49:08.893471] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T18:49:09.302329] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T18:49:09.558083] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-14T18:49:09.955307] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T18:49:10.358118] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-14T18:49:11.158140] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-14T18:49:11.196260] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T18:49:11.429250] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T18:49:11.958052] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-14T18:49:12.252971] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T18:49:12.748077] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T18:49:12.758022] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-14T18:49:13.558153] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-14T18:49:13.571998] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T18:49:14.358111] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-14T18:49:15.158072] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-14T18:49:15.274477] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T18:49:15.915305] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T18:49:15.958034] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-14T18:49:16.004028] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T18:49:16.758072] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-14T18:49:17.558029] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-14T18:49:17.759533] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T18:49:18.197014] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T18:49:18.358065] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-14T18:49:18.979055] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T18:49:19.158040] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-14T18:49:19.311144] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T18:49:19.958039] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-14T18:49:20.051977] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-14T18:49:20.758082] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-14T18:49:21.558088] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-14T18:49:21.899199] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T18:49:21.978782] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T18:49:22.358086] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-14T18:49:23.037063] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T18:49:23.068225] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T18:49:23.158080] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-14T18:49:23.958058] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-14T18:49:24.250144] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T18:49:24.758111] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-14T18:49:25.430852] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T18:49:25.558029] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-14T18:49:25.948864] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T18:49:26.358076] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-14T18:49:27.158044] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-14T18:49:27.485737] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T18:49:27.507080] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T18:49:27.958081] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-14T18:49:28.726239] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T18:49:28.758048] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-14T18:49:29.103789] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T18:49:29.558084] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-14T18:49:30.358081] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-14T18:49:30.635971] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-14T18:49:30.641778] [INFO ] [REMOTE ] ETSY: Full fetch complete (77668 records). [2025-10-14T18:49:30.641891] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-14T18:49:31.050676] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-14T18:49:31.050776] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-14T18:49:31.051818] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-14T18:49:31.051974] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-14T18:49:31.068056] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T18:49:31.074576] [INFO ] [REMOTE ] ETR: Full fetch complete (77248 records). [2025-10-14T18:49:31.074747] [DEBUG] [LOCAL ] ETSY: Trimmed 77668 records to 53577 (keeping 200 days of data) [2025-10-14T18:49:31.074997] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-14T18:49:31.162889] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-14T18:49:31.477722] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T18:49:31.631725] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-14T18:49:31.632050] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-14T18:49:31.633632] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-14T18:49:31.633740] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-14T18:49:31.642389] [DEBUG] [LOCAL ] ETR: Trimmed 77248 records to 53213 (keeping 200 days of data) [2025-10-14T18:49:31.986675] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-14T18:49:32.107542] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T18:49:32.167221] [DEBUG] [LOCAL ] ETSY: Primary data saved (53577 records). [2025-10-14T18:49:32.168220] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-14T18:49:32.168758] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETSY took 38.8s. Estimated remaining: 3h 43m 1s. Rate: 7.1 symbols/min [2025-10-14T18:49:32.440700] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:49:32.526433] [DEBUG] [LOCAL ] ETX: Loaded 5243 existing records from primary storage. [2025-10-14T18:49:32.527214] [INFO ] [MAIN ] ETX: Loaded 5243 existing records. [2025-10-14T18:49:32.769685] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-14T18:49:32.824878] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:49:32.826318] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-14T18:49:32.826950] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-14T18:49:32.828710] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-14T18:49:32.829302] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-14T18:49:32.953914] [DEBUG] [LOCAL ] ETR: Primary data saved (53213 records). [2025-10-14T18:49:32.964575] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-14T18:49:32.994418] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETR took 43.7s. Estimated remaining: 3h 42m 37s. Rate: 7.1 symbols/min [2025-10-14T18:49:33.364879] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:49:33.381992] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T18:49:33.420992] [INFO ] [REMOTE ] ETW: Full fetch complete (36837 records). [2025-10-14T18:49:33.444530] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:49:33.444817] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-14T18:49:33.560284] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-14T18:49:33.672211] [DEBUG] [LOCAL ] ETY: Loaded 23106 existing records from primary storage. [2025-10-14T18:49:33.682638] [INFO ] [MAIN ] ETY: Loaded 23106 existing records. [2025-10-14T18:49:34.047544] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-14T18:49:34.027809] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T18:49:34.057337] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-14T18:49:34.066186] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-14T18:49:34.077345] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-14T18:49:34.091316] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:49:34.091909] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-14T18:49:34.092046] [DEBUG] [LOCAL ] ETW: Trimmed 36837 records to 25635 (keeping 200 days of data) [2025-10-14T18:49:34.092193] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-14T18:49:34.092685] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-14T18:49:34.092990] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-14T18:49:34.261818] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T18:49:34.362601] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-14T18:49:34.583948] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:49:34.633895] [DEBUG] [LOCAL ] ETW: Primary data saved (25635 records). [2025-10-14T18:49:34.634030] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-14T18:49:34.634106] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETW took 28.6s. Estimated remaining: 3h 42m 15s. Rate: 7.1 symbols/min [2025-10-14T18:49:34.825815] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:49:34.843495] [DEBUG] [LOCAL ] EVC: Loaded 18112 existing records from primary storage. [2025-10-14T18:49:34.843759] [INFO ] [MAIN ] EVC: Loaded 18112 existing records. [2025-10-14T18:49:35.031801] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:49:35.032060] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-14T18:49:35.032123] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-14T18:49:35.032379] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-14T18:49:35.032445] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-14T18:49:35.163247] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-14T18:49:35.403072] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:49:35.591196] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T18:49:35.599543] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T18:49:35.958073] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-14T18:49:36.758086] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-14T18:49:37.382966] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T18:49:37.558039] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-14T18:49:37.837385] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T18:49:38.358040] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-14T18:49:38.754865] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T18:49:39.158071] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-14T18:49:39.217028] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T18:49:39.883789] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T18:49:39.958082] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-14T18:49:40.758131] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-14T18:49:41.326878] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T18:49:41.558092] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-14T18:49:41.918327] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T18:49:41.922486] [INFO ] [REMOTE ] ETV: Full fetch complete (32485 records). [2025-10-14T18:49:41.922614] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-14T18:49:42.199820] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T18:49:42.313260] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-14T18:49:42.313335] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-14T18:49:42.313927] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-14T18:49:42.313990] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-14T18:49:42.314737] [DEBUG] [LOCAL ] ETV: Trimmed 32485 records to 22316 (keeping 200 days of data) [2025-10-14T18:49:42.365280] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-14T18:49:42.447594] [DEBUG] [LOCAL ] ETV: Primary data saved (22316 records). [2025-10-14T18:49:42.447743] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-14T18:49:42.447823] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETV took 38.8s. Estimated remaining: 3h 42m 6s. Rate: 7.1 symbols/min [2025-10-14T18:49:42.613997] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:49:42.643705] [DEBUG] [LOCAL ] EVEX: Loaded 31962 existing records from primary storage. [2025-10-14T18:49:42.643960] [INFO ] [MAIN ] EVEX: Loaded 31962 existing records. [2025-10-14T18:49:42.822955] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:49:42.823108] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-14T18:49:42.823155] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-14T18:49:42.823357] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-14T18:49:42.823412] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-14T18:49:42.906776] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T18:49:43.174080] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:49:43.167109] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-14T18:49:43.958040] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-14T18:49:44.276692] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T18:49:44.758075] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-14T18:49:45.041818] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T18:49:45.558082] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-14T18:49:46.121300] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T18:49:46.286440] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T18:49:46.358033] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-14T18:49:47.158037] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-14T18:49:47.360268] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T18:49:47.958110] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-14T18:49:48.097493] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T18:49:48.758050] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-14T18:49:49.036738] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T18:49:49.558041] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-14T18:49:49.819000] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T18:49:50.144054] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T18:49:50.358131] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-14T18:49:51.158093] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-14T18:49:51.529140] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T18:49:51.958070] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-14T18:49:52.153266] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T18:49:52.758097] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-14T18:49:52.957520] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T18:49:53.141631] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-14T18:49:53.558093] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-14T18:49:54.358072] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-14T18:49:54.654726] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T18:49:55.158055] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-14T18:49:55.513207] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T18:49:55.709686] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T18:49:55.958138] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-14T18:49:56.758176] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-14T18:49:57.015385] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T18:49:57.558063] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-14T18:49:57.942972] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T18:49:58.358047] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-14T18:49:58.509425] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T18:49:59.158063] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-14T18:49:59.435928] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T18:49:59.958085] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-14T18:50:00.252566] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T18:50:00.758117] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-14T18:50:01.133467] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T18:50:01.226634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-14T18:50:01.558102] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-14T18:50:02.358072] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-14T18:50:02.975187] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T18:50:03.158077] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-14T18:50:03.457484] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T18:50:03.460516] [INFO ] [REMOTE ] ETY: Full fetch complete (34342 records). [2025-10-14T18:50:03.460589] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-14T18:50:03.845162] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-14T18:50:03.845247] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-14T18:50:03.845900] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-14T18:50:03.845962] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-14T18:50:03.846756] [DEBUG] [LOCAL ] ETY: Trimmed 34342 records to 23026 (keeping 200 days of data) [2025-10-14T18:50:03.958292] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-14T18:50:03.987545] [DEBUG] [LOCAL ] ETY: Primary data saved (23026 records). [2025-10-14T18:50:03.987706] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-14T18:50:03.987819] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. ETY took 31.0s. Estimated remaining: 3h 42m 24s. Rate: 7.1 symbols/min [2025-10-14T18:50:04.153292] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:04.164978] [DEBUG] [LOCAL ] EVF: Loaded 9881 existing records from primary storage. [2025-10-14T18:50:04.165179] [INFO ] [MAIN ] EVF: Loaded 9881 existing records. [2025-10-14T18:50:04.341548] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:04.341870] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-14T18:50:04.341925] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-14T18:50:04.342151] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-14T18:50:04.342207] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-14T18:50:04.718802] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:04.742499] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T18:50:04.758017] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-14T18:50:05.005702] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T18:50:05.558121] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-14T18:50:06.198533] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T18:50:06.276741] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T18:50:06.358026] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-14T18:50:07.003231] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T18:50:07.158043] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-14T18:50:07.958079] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-14T18:50:08.104514] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T18:50:08.758071] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-14T18:50:09.206592] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T18:50:09.296019] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T18:50:09.301285] [INFO ] [REMOTE ] EVEX: Full fetch complete (43211 records). [2025-10-14T18:50:09.301371] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-14T18:50:09.563255] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-14T18:50:09.716232] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-14T18:50:09.716321] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-14T18:50:09.717102] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-14T18:50:09.717185] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-14T18:50:09.718186] [DEBUG] [LOCAL ] EVEX: Trimmed 43211 records to 32175 (keeping 200 days of data) [2025-10-14T18:50:09.905679] [DEBUG] [LOCAL ] EVEX: Primary data saved (32175 records). [2025-10-14T18:50:09.905870] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-14T18:50:09.905973] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVEX took 27.5s. Estimated remaining: 3h 42m 10s. Rate: 7.1 symbols/min [2025-10-14T18:50:10.082451] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:10.091015] [DEBUG] [LOCAL ] EVG: Loaded 5949 existing records from primary storage. [2025-10-14T18:50:10.091213] [INFO ] [MAIN ] EVG: Loaded 5949 existing records. [2025-10-14T18:50:10.287046] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T18:50:10.286521] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:10.289579] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-14T18:50:10.289668] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-14T18:50:10.289866] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-14T18:50:10.289923] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-14T18:50:10.363233] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-14T18:50:10.672147] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:11.158042] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-14T18:50:11.254391] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T18:50:11.256352] [INFO ] [REMOTE ] EVC: Full fetch complete (29079 records). [2025-10-14T18:50:11.256420] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-14T18:50:11.630376] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-14T18:50:11.630529] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-14T18:50:11.631102] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-14T18:50:11.631163] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-14T18:50:11.631924] [DEBUG] [LOCAL ] EVC: Trimmed 29079 records to 18136 (keeping 200 days of data) [2025-10-14T18:50:11.710307] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T18:50:11.712869] [INFO ] [REMOTE ] ETX: Full fetch complete (6928 records). [2025-10-14T18:50:11.712947] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-14T18:50:11.963284] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-14T18:50:12.040437] [DEBUG] [LOCAL ] EVC: Primary data saved (18136 records). [2025-10-14T18:50:12.046243] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-14T18:50:12.051492] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVC took 37.4s. Estimated remaining: 3h 41m 49s. Rate: 7.1 symbols/min [2025-10-14T18:50:12.227300] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-14T18:50:12.227624] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-14T18:50:12.233227] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-14T18:50:12.238437] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-14T18:50:12.267569] [DEBUG] [LOCAL ] ETX: Trimmed 6928 records to 5253 (keeping 200 days of data) [2025-10-14T18:50:12.314936] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:12.331803] [DEBUG] [LOCAL ] ETX: Primary data saved (5253 records). [2025-10-14T18:50:12.331903] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-14T18:50:12.331990] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. ETX took 40.2s. Estimated remaining: 3h 41m 24s. Rate: 7.1 symbols/min [2025-10-14T18:50:12.521927] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:12.543016] [DEBUG] [LOCAL ] EVH: Loaded 49622 existing records from primary storage. [2025-10-14T18:50:12.543354] [INFO ] [MAIN ] EVH: Loaded 49622 existing records. [2025-10-14T18:50:12.603316] [DEBUG] [LOCAL ] EVN: Loaded 10781 existing records from primary storage. [2025-10-14T18:50:12.633874] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T18:50:12.634032] [INFO ] [MAIN ] EVN: Loaded 10781 existing records. [2025-10-14T18:50:12.760743] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-14T18:50:12.847152] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:12.869412] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-14T18:50:12.874597] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-14T18:50:12.898202] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-14T18:50:12.900953] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-14T18:50:12.974151] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:12.996363] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-14T18:50:13.002307] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-14T18:50:13.034060] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-14T18:50:13.036658] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-14T18:50:13.493876] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T18:50:13.567826] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-14T18:50:13.634611] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:13.673995] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:14.249065] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T18:50:14.358075] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-14T18:50:14.856124] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T18:50:15.158075] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-14T18:50:15.958061] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-14T18:50:16.758079] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-14T18:50:16.885891] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T18:50:16.970509] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T18:50:17.360933] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T18:50:17.558053] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-14T18:50:18.127356] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T18:50:18.358068] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-14T18:50:18.878352] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-14T18:50:19.158056] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-14T18:50:19.780187] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T18:50:19.958132] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-14T18:50:20.758050] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-14T18:50:20.990057] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T18:50:21.241304] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-14T18:50:21.558061] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-14T18:50:22.358065] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-14T18:50:22.378212] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T18:50:23.136525] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T18:50:23.158025] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-14T18:50:23.603921] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T18:50:23.958079] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-14T18:50:24.612129] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T18:50:24.758071] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-14T18:50:25.558046] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-14T18:50:25.697452] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T18:50:26.358049] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-14T18:50:27.002721] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T18:50:27.039230] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T18:50:27.158077] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-14T18:50:27.856132] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T18:50:27.958056] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-14T18:50:28.610810] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T18:50:28.758089] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-14T18:50:29.486409] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T18:50:29.558046] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-14T18:50:30.315948] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T18:50:30.358030] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-14T18:50:31.158062] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-14T18:50:31.256230] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T18:50:31.258346] [INFO ] [REMOTE ] EVF: Full fetch complete (12872 records). [2025-10-14T18:50:31.258413] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-14T18:50:31.628132] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-14T18:50:31.628209] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-14T18:50:31.628517] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-14T18:50:31.628555] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-14T18:50:31.629032] [DEBUG] [LOCAL ] EVF: Trimmed 12872 records to 9853 (keeping 200 days of data) [2025-10-14T18:50:31.686287] [DEBUG] [LOCAL ] EVF: Primary data saved (9853 records). [2025-10-14T18:50:31.686411] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-14T18:50:31.686484] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVF took 27.7s. Estimated remaining: 3h 41m 38s. Rate: 7.1 symbols/min [2025-10-14T18:50:31.852172] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:31.889842] [DEBUG] [LOCAL ] EVR: Loaded 34612 existing records from primary storage. [2025-10-14T18:50:31.890128] [INFO ] [MAIN ] EVR: Loaded 34612 existing records. [2025-10-14T18:50:31.964323] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-14T18:50:32.067586] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:32.067814] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-14T18:50:32.067859] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-14T18:50:32.068263] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-14T18:50:32.068319] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-14T18:50:32.425464] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:32.728700] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T18:50:32.758023] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-14T18:50:32.828819] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T18:50:33.558563] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-14T18:50:33.560254] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T18:50:34.358061] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-14T18:50:35.158045] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-14T18:50:35.342167] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:50:35.360890] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T18:50:35.665893] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T18:50:35.958114] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-14T18:50:36.536811] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T18:50:36.758066] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-14T18:50:37.558074] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-14T18:50:38.311329] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T18:50:38.313941] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T18:50:38.315518] [INFO ] [REMOTE ] EVG: Full fetch complete (8159 records). [2025-10-14T18:50:38.315667] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-14T18:50:38.359682] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-14T18:50:38.691733] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-14T18:50:38.691822] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-14T18:50:38.692074] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-14T18:50:38.692120] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-14T18:50:38.692561] [DEBUG] [LOCAL ] EVG: Trimmed 8159 records to 5939 (keeping 200 days of data) [2025-10-14T18:50:38.728888] [DEBUG] [LOCAL ] EVG: Primary data saved (5939 records). [2025-10-14T18:50:38.729027] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-14T18:50:38.729109] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVG took 28.8s. Estimated remaining: 3h 41m 27s. Rate: 7.1 symbols/min [2025-10-14T18:50:38.895284] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:38.913291] [DEBUG] [LOCAL ] EVT: Loaded 16812 existing records from primary storage. [2025-10-14T18:50:38.913532] [INFO ] [MAIN ] EVT: Loaded 16812 existing records. [2025-10-14T18:50:39.095213] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:39.095471] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-14T18:50:39.103477] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-14T18:50:39.104362] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T18:50:39.105595] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-14T18:50:39.108066] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-14T18:50:39.163476] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-14T18:50:39.483718] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:39.958118] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-14T18:50:40.586165] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T18:50:40.600626] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T18:50:40.758072] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-14T18:50:41.558055] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-14T18:50:41.962226] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T18:50:42.358124] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-14T18:50:42.730138] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T18:50:43.158130] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-14T18:50:43.384362] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T18:50:43.958077] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-14T18:50:44.734933] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T18:50:44.758025] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-14T18:50:45.145397] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T18:50:45.558059] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-14T18:50:46.046431] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T18:50:46.340986] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T18:50:46.342847] [INFO ] [REMOTE ] EVN: Full fetch complete (17469 records). [2025-10-14T18:50:46.342980] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-14T18:50:46.364542] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-14T18:50:46.735312] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-14T18:50:46.735389] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-14T18:50:46.735846] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-14T18:50:46.735906] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-14T18:50:46.736488] [DEBUG] [LOCAL ] EVN: Trimmed 17469 records to 10794 (keeping 200 days of data) [2025-10-14T18:50:46.802104] [DEBUG] [LOCAL ] EVN: Primary data saved (10794 records). [2025-10-14T18:50:46.802235] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-14T18:50:46.802316] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVN took 34.5s. Estimated remaining: 3h 41m 18s. Rate: 7.1 symbols/min [2025-10-14T18:50:46.978086] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:47.004319] [DEBUG] [LOCAL ] EVTC: Loaded 26524 existing records from primary storage. [2025-10-14T18:50:47.004575] [INFO ] [MAIN ] EVTC: Loaded 26524 existing records. [2025-10-14T18:50:47.163948] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-14T18:50:47.187980] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:47.188316] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-14T18:50:47.188380] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-14T18:50:47.188704] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-14T18:50:47.188765] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-14T18:50:47.552453] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:47.958090] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-14T18:50:48.033844] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T18:50:48.758101] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-14T18:50:48.857548] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T18:50:48.914320] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T18:50:49.558057] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-14T18:50:50.363199] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-14T18:50:50.382037] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:50:50.679454] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T18:50:51.158068] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-14T18:50:51.958054] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-14T18:50:52.140814] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T18:50:52.296040] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T18:50:52.758074] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-14T18:50:53.190880] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T18:50:53.558046] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-14T18:50:54.107307] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T18:50:54.358031] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-14T18:50:54.553627] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T18:50:55.158061] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-14T18:50:55.273362] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T18:50:55.958109] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-14T18:50:56.650073] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T18:50:56.655892] [INFO ] [REMOTE ] EVH: Full fetch complete (71863 records). [2025-10-14T18:50:56.656018] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-14T18:50:56.760914] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-14T18:50:57.049633] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-14T18:50:57.049736] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-14T18:50:57.050585] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-14T18:50:57.050623] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-14T18:50:57.052269] [DEBUG] [LOCAL ] EVH: Trimmed 71863 records to 49624 (keeping 200 days of data) [2025-10-14T18:50:57.336083] [DEBUG] [LOCAL ] EVH: Primary data saved (49624 records). [2025-10-14T18:50:57.336199] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-14T18:50:57.336273] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVH took 45.3s. Estimated remaining: 3h 41m 14s. Rate: 7.1 symbols/min [2025-10-14T18:50:57.531563] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:50:57.528631] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T18:50:57.558067] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-14T18:50:57.573766] [DEBUG] [LOCAL ] EVTL: Loaded 39852 existing records from primary storage. [2025-10-14T18:50:57.574070] [INFO ] [MAIN ] EVTL: Loaded 39852 existing records. [2025-10-14T18:50:57.753115] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:50:57.753290] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-14T18:50:57.753336] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-14T18:50:57.753548] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-14T18:50:57.753608] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-14T18:50:57.868355] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T18:50:58.121706] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:50:58.358030] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-14T18:50:58.518685] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T18:50:59.158033] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-14T18:50:59.476726] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T18:50:59.958091] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-14T18:51:00.215388] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T18:51:00.649588] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T18:51:00.758092] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-14T18:51:01.558065] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-14T18:51:02.005546] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T18:51:02.178493] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T18:51:02.358114] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-14T18:51:03.158129] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-14T18:51:03.867319] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T18:51:03.871192] [INFO ] [REMOTE ] EVR: Full fetch complete (50814 records). [2025-10-14T18:51:03.871320] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-14T18:51:03.963923] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-14T18:51:04.253517] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-14T18:51:04.253591] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-14T18:51:04.254306] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-14T18:51:04.254365] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-14T18:51:04.255384] [DEBUG] [LOCAL ] EVR: Trimmed 50814 records to 34470 (keeping 200 days of data) [2025-10-14T18:51:04.467109] [DEBUG] [LOCAL ] EVR: Primary data saved (34470 records). [2025-10-14T18:51:04.467228] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-14T18:51:04.467302] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVR took 32.8s. Estimated remaining: 3h 41m 3s. Rate: 7.1 symbols/min [2025-10-14T18:51:04.637147] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:51:04.672735] [DEBUG] [LOCAL ] EVTR: Loaded 24474 existing records from primary storage. [2025-10-14T18:51:04.672965] [INFO ] [MAIN ] EVTR: Loaded 24474 existing records. [2025-10-14T18:51:04.763207] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-14T18:51:04.814130] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T18:51:04.876617] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:51:04.876858] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-14T18:51:04.876911] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-14T18:51:04.877169] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-14T18:51:04.877226] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-14T18:51:05.234321] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:51:05.280057] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T18:51:05.558031] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-14T18:51:05.908756] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T18:51:06.358037] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-14T18:51:06.479902] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T18:51:07.158051] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-14T18:51:07.322409] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T18:51:07.958096] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-14T18:51:08.256528] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:51:08.758074] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-14T18:51:08.870730] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T18:51:09.558056] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-14T18:51:10.229750] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T18:51:10.266274] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T18:51:10.358054] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-14T18:51:10.933267] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T18:51:11.158078] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-14T18:51:11.958076] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-14T18:51:12.175578] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T18:51:12.758061] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-14T18:51:13.546017] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T18:51:13.558018] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-14T18:51:13.602958] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T18:51:14.358064] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-14T18:51:15.158078] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-14T18:51:15.580416] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T18:51:15.866295] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T18:51:15.931939] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T18:51:15.958046] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-14T18:51:16.758072] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-14T18:51:16.981975] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T18:51:17.558035] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-14T18:51:17.973732] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T18:51:18.358048] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-14T18:51:18.623384] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T18:51:19.158122] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-14T18:51:19.958057] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-14T18:51:20.042365] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T18:51:20.128986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T18:51:20.758102] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-14T18:51:21.034515] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T18:51:21.558093] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-14T18:51:22.086843] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T18:51:22.358048] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-14T18:51:22.446694] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T18:51:23.158045] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-14T18:51:23.218573] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T18:51:23.958067] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-14T18:51:24.049846] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T18:51:24.052031] [INFO ] [REMOTE ] EVT: Full fetch complete (25237 records). [2025-10-14T18:51:24.052112] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-14T18:51:24.425606] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-14T18:51:24.425716] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-14T18:51:24.426296] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-14T18:51:24.426338] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-14T18:51:24.427073] [DEBUG] [LOCAL ] EVT: Trimmed 25237 records to 16854 (keeping 200 days of data) [2025-10-14T18:51:24.531601] [DEBUG] [LOCAL ] EVT: Primary data saved (16854 records). [2025-10-14T18:51:24.531754] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-14T18:51:24.531839] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVT took 45.8s. Estimated remaining: 3h 41m 17s. Rate: 7.1 symbols/min [2025-10-14T18:51:24.703928] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:51:24.754682] [DEBUG] [LOCAL ] EW: Loaded 53401 existing records from primary storage. [2025-10-14T18:51:24.754985] [INFO ] [MAIN ] EW: Loaded 53401 existing records. [2025-10-14T18:51:24.766155] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-14T18:51:24.948921] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:51:24.949226] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-14T18:51:24.949418] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-14T18:51:24.955114] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-14T18:51:24.964459] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-14T18:51:24.965037] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T18:51:25.326076] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:51:25.558047] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-14T18:51:26.361675] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-14T18:51:26.518469] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T18:51:27.150892] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T18:51:27.161143] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-14T18:51:27.460611] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T18:51:27.958072] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-14T18:51:28.758061] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-14T18:51:29.056868] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T18:51:29.062877] [INFO ] [REMOTE ] EVTL: Full fetch complete (54241 records). [2025-10-14T18:51:29.063017] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-14T18:51:29.448350] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T18:51:29.490609] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-14T18:51:29.491000] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-14T18:51:29.491889] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-14T18:51:29.491954] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-14T18:51:29.493115] [DEBUG] [LOCAL ] EVTL: Trimmed 54241 records to 40083 (keeping 200 days of data) [2025-10-14T18:51:29.572216] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-14T18:51:29.720759] [DEBUG] [LOCAL ] EVTL: Primary data saved (40083 records). [2025-10-14T18:51:29.720884] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-14T18:51:29.720958] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTL took 32.4s. Estimated remaining: 3h 41m 3s. Rate: 7.1 symbols/min [2025-10-14T18:51:29.914482] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:51:29.915403] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T18:51:29.921226] [INFO ] [REMOTE ] EVTC: Full fetch complete (38265 records). [2025-10-14T18:51:29.921375] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-14T18:51:30.207827] [DEBUG] [LOCAL ] EXG: Loaded 34103 existing records from primary storage. [2025-10-14T18:51:30.224715] [INFO ] [MAIN ] EXG: Loaded 34103 existing records. [2025-10-14T18:51:30.363153] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-14T18:51:30.444301] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-14T18:51:30.450204] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-14T18:51:30.466522] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-14T18:51:30.472091] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-14T18:51:30.528876] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:51:30.529283] [DEBUG] [LOCAL ] EVTC: Trimmed 38265 records to 26612 (keeping 200 days of data) [2025-10-14T18:51:30.529433] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-14T18:51:30.529755] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-14T18:51:30.529986] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-14T18:51:30.530074] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-14T18:51:30.765154] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T18:51:30.840406] [INFO ] [REMOTE ] EVTR: Full fetch complete (33224 records). [2025-10-14T18:51:30.863908] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-14T18:51:31.157026] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:51:31.181036] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-14T18:51:31.440223] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-14T18:51:31.441815] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-14T18:51:31.442739] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-14T18:51:31.443095] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-14T18:51:31.448204] [DEBUG] [LOCAL ] EVTR: Trimmed 33224 records to 24584 (keeping 200 days of data) [2025-10-14T18:51:31.593319] [DEBUG] [LOCAL ] EVTC: Primary data saved (26612 records). [2025-10-14T18:51:31.594488] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-14T18:51:31.594611] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EVTC took 44.8s. Estimated remaining: 3h 40m 41s. Rate: 7.1 symbols/min [2025-10-14T18:51:31.809410] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:51:31.875421] [DEBUG] [LOCAL ] EVTR: Primary data saved (24584 records). [2025-10-14T18:51:31.875564] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-14T18:51:31.875671] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EVTR took 27.4s. Estimated remaining: 3h 40m 17s. Rate: 7.1 symbols/min [2025-10-14T18:51:32.017244] [DEBUG] [LOCAL ] EXK: Loaded 53166 existing records from primary storage. [2025-10-14T18:51:32.023565] [INFO ] [MAIN ] EXK: Loaded 53166 existing records. [2025-10-14T18:51:32.110909] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:51:32.354871] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:51:32.356359] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-14T18:51:32.356541] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-14T18:51:32.367440] [DEBUG] [LOCAL ] EXP: Loaded 29534 existing records from primary storage. [2025-10-14T18:51:32.367499] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-14T18:51:32.367901] [INFO ] [MAIN ] EXP: Loaded 29534 existing records. [2025-10-14T18:51:32.368092] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-14T18:51:32.546517] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-14T18:51:32.630408] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-14T18:51:32.875402] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:51:32.892232] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-14T18:51:32.892379] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-14T18:51:32.899563] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-14T18:51:32.925920] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-14T18:51:32.994289] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T18:51:33.054096] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:51:33.076610] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-14T18:51:33.370176] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:51:33.558076] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-14T18:51:34.358048] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-14T18:51:34.394148] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T18:51:34.466925] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T18:51:34.496071] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T18:51:35.158133] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-14T18:51:35.871785] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T18:51:35.958083] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-14T18:51:36.758112] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-14T18:51:36.891924] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T18:51:37.267439] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T18:51:37.558068] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-14T18:51:38.256876] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T18:51:38.358067] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-14T18:51:39.158091] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-14T18:51:39.445290] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T18:51:39.958092] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-14T18:51:40.048015] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T18:51:40.511381] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T18:51:40.758047] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-14T18:51:40.794695] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T18:51:41.558060] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-14T18:51:41.874832] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T18:51:42.358103] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-14T18:51:42.597617] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T18:51:43.158066] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-14T18:51:43.958111] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-14T18:51:44.758078] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-14T18:51:44.927324] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-14T18:51:45.474487] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T18:51:45.558039] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-14T18:51:46.003335] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-10-14T18:51:46.358030] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-14T18:51:47.158077] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-14T18:51:47.333856] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T18:51:47.395407] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T18:51:47.700791] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-14T18:51:47.958050] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-14T18:51:48.176158] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T18:51:48.758093] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-14T18:51:49.558082] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-14T18:51:49.717563] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T18:51:50.160395] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T18:51:50.358085] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-14T18:51:50.674801] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T18:51:51.158108] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-14T18:51:51.958108] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-14T18:51:52.124273] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T18:51:52.758114] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-14T18:51:52.944773] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T18:51:52.981490] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T18:51:53.558299] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-14T18:51:54.358121] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-14T18:51:54.512950] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T18:51:55.158093] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-14T18:51:55.754693] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T18:51:55.958076] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-14T18:51:56.251317] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-14T18:51:56.758128] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-14T18:51:56.971794] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T18:51:57.212562] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T18:51:57.558112] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-14T18:51:58.286802] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T18:51:58.358034] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-14T18:51:58.733869] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T18:51:58.739632] [INFO ] [REMOTE ] EW: Full fetch complete (77513 records). [2025-10-14T18:51:58.748322] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-14T18:51:58.749227] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T18:51:58.821896] [INFO ] [REMOTE ] EXG: Full fetch complete (49905 records). [2025-10-14T18:51:58.843503] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-14T18:51:59.160786] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-14T18:51:59.497821] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-14T18:51:59.515823] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-14T18:51:59.526225] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-14T18:51:59.528878] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-14T18:51:59.528823] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-14T18:51:59.529080] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-14T18:51:59.529600] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-14T18:51:59.529937] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-14T18:51:59.531143] [DEBUG] [LOCAL ] EXG: Trimmed 49905 records to 34136 (keeping 200 days of data) [2025-10-14T18:51:59.531066] [DEBUG] [LOCAL ] EW: Trimmed 77513 records to 53406 (keeping 200 days of data) [2025-10-14T18:51:59.943952] [DEBUG] [LOCAL ] EXG: Primary data saved (34136 records). [2025-10-14T18:51:59.944898] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-14T18:51:59.945836] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXG took 30.2s. Estimated remaining: 3h 40m 47s. Rate: 7.1 symbols/min [2025-10-14T18:51:59.958071] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-14T18:52:00.037319] [DEBUG] [LOCAL ] EW: Primary data saved (53406 records). [2025-10-14T18:52:00.037451] [INFO ] [MAIN ] EW: Full history saved. [2025-10-14T18:52:00.037528] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EW took 35.5s. Estimated remaining: 3h 40m 22s. Rate: 7.1 symbols/min [2025-10-14T18:52:00.732889] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T18:52:00.758022] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-14T18:52:01.514739] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T18:52:01.558029] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-14T18:52:01.965893] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T18:52:02.358066] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-14T18:52:03.340904] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T18:52:03.349209] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-14T18:52:03.635946] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-14T18:52:03.958105] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-14T18:52:04.660149] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T18:52:04.663430] [INFO ] [REMOTE ] EXP: Full fetch complete (42870 records). [2025-10-14T18:52:04.663513] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-14T18:52:05.028104] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-14T18:52:05.028237] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-14T18:52:05.028970] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-14T18:52:05.029034] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-14T18:52:05.029949] [DEBUG] [LOCAL ] EXP: Trimmed 42870 records to 29541 (keeping 200 days of data) [2025-10-14T18:52:05.213082] [DEBUG] [LOCAL ] EXP: Primary data saved (29541 records). [2025-10-14T18:52:05.213212] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-14T18:52:05.213287] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXP took 33.3s. Estimated remaining: 3h 40m 8s. Rate: 7.1 symbols/min [2025-10-14T18:52:05.803434] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T18:52:05.809355] [INFO ] [REMOTE ] EXK: Full fetch complete (76782 records). [2025-10-14T18:52:05.809472] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-14T18:52:06.198210] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-14T18:52:06.198286] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-14T18:52:06.199216] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-14T18:52:06.199277] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-14T18:52:06.200784] [DEBUG] [LOCAL ] EXK: Trimmed 76782 records to 53169 (keeping 200 days of data) [2025-10-14T18:52:06.496753] [DEBUG] [LOCAL ] EXK: Primary data saved (53169 records). [2025-10-14T18:52:06.496878] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-14T18:52:06.496952] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXK took 34.9s. Estimated remaining: 3h 39m 45s. Rate: 7.1 symbols/min [2025-10-14T18:52:07.093757] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:07.124747] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:07.174061] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:07.207287] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:07.263923] [DEBUG] [LOCAL ] FAF: Loaded 41545 existing records from primary storage. [2025-10-14T18:52:07.276680] [INFO ] [MAIN ] FAF: Loaded 41545 existing records. [2025-10-14T18:52:07.376175] [DEBUG] [LOCAL ] EXPD: Loaded 47915 existing records from primary storage. [2025-10-14T18:52:07.424309] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-14T18:52:07.424680] [INFO ] [MAIN ] EXPD: Loaded 47915 existing records. [2025-10-14T18:52:07.435409] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-14T18:52:07.486561] [DEBUG] [LOCAL ] EXR: Loaded 45363 existing records from primary storage. [2025-10-14T18:52:07.586616] [INFO ] [MAIN ] EXR: Loaded 45363 existing records. [2025-10-14T18:52:07.699328] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:07.721521] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-14T18:52:07.734535] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-14T18:52:07.808168] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-14T18:52:07.873039] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-14T18:52:07.934065] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:07.964258] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-14T18:52:08.027493] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-14T18:52:08.108900] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:08.120240] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-14T18:52:08.130687] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-14T18:52:08.130593] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-14T18:52:08.155854] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-14T18:52:08.165011] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-14T18:52:08.170963] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-14T18:52:08.257429] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:08.366309] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-14T18:52:08.388692] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-14T18:52:08.494943] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-14T18:52:08.536071] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-14T18:52:09.293909] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:09.405109] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:09.415934] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-14T18:52:09.371933] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-14T18:52:09.555191] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:09.555580] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-14T18:52:09.635695] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:09.636002] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-14T18:52:11.167433] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T18:52:11.174403] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-14T18:52:11.287284] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T18:52:11.296265] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-14T18:52:11.331000] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T18:52:11.339679] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-14T18:52:12.654979] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (3.24 seconds). [2025-10-14T18:52:12.666156] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-14T18:52:12.913859] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T18:52:12.923059] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-14T18:52:12.953385] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T18:52:12.962603] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-14T18:52:13.181599] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-14T18:52:13.188865] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-14T18:52:14.251390] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T18:52:14.260616] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-14T18:52:14.562009] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T18:52:14.569102] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-14T18:52:14.618273] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T18:52:15.161557] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-14T18:52:15.166686] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-14T18:52:15.906627] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T18:52:15.958029] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-14T18:52:16.209291] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T18:52:16.448218] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T18:52:16.758066] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-14T18:52:17.393453] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T18:52:17.558074] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-14T18:52:18.195229] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T18:52:18.358072] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-14T18:52:19.158119] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-14T18:52:19.910523] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-14T18:52:19.958072] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-14T18:52:20.003237] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T18:52:20.478458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T18:52:20.758132] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-14T18:52:21.280149] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T18:52:21.558069] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-14T18:52:22.279960] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T18:52:22.358063] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-14T18:52:23.158032] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-14T18:52:23.240230] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T18:52:23.958070] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-14T18:52:24.353611] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T18:52:24.758101] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-14T18:52:24.874539] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-14T18:52:25.329266] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T18:52:25.558084] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-14T18:52:26.174515] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T18:52:26.358067] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-14T18:52:27.158046] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-14T18:52:27.215132] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T18:52:27.822937] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T18:52:27.958138] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-14T18:52:28.758145] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-14T18:52:29.521812] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-14T18:52:29.560915] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-14T18:52:29.567804] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T18:52:30.358039] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-14T18:52:30.391886] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T18:52:31.142719] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T18:52:31.158029] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-14T18:52:31.958099] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-14T18:52:32.499842] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T18:52:32.506156] [INFO ] [REMOTE ] EXPD: Full fetch complete (69508 records). [2025-10-14T18:52:32.506408] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-14T18:52:32.760681] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-14T18:52:32.886015] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T18:52:33.014918] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-14T18:52:33.047581] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-14T18:52:33.047835] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-14T18:52:33.048822] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-14T18:52:33.049238] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-14T18:52:33.050736] [DEBUG] [LOCAL ] EXPD: Trimmed 69508 records to 47953 (keeping 200 days of data) [2025-10-14T18:52:33.337054] [DEBUG] [LOCAL ] EXPD: Primary data saved (47953 records). [2025-10-14T18:52:33.337182] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-14T18:52:33.337257] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. EXPD took 26.8s. Estimated remaining: 3h 40m 13s. Rate: 7.1 symbols/min [2025-10-14T18:52:33.501989] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:33.547129] [DEBUG] [LOCAL ] FBIN: Loaded 50364 existing records from primary storage. [2025-10-14T18:52:33.547428] [INFO ] [MAIN ] FBIN: Loaded 50364 existing records. [2025-10-14T18:52:33.567596] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-14T18:52:33.725506] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:33.725754] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-14T18:52:33.725805] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-14T18:52:33.726182] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-14T18:52:33.726239] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-14T18:52:34.076463] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:34.181877] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:52:34.187096] [INFO ] [REMOTE ] EXR: Full fetch complete (66069 records). [2025-10-14T18:52:34.187227] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-14T18:52:34.366692] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-14T18:52:34.588460] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-14T18:52:34.588536] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-14T18:52:34.589440] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-14T18:52:34.589500] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-14T18:52:34.590768] [DEBUG] [LOCAL ] EXR: Trimmed 66069 records to 45464 (keeping 200 days of data) [2025-10-14T18:52:34.871537] [DEBUG] [LOCAL ] EXR: Primary data saved (45464 records). [2025-10-14T18:52:34.871707] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-14T18:52:34.871872] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. EXR took 28.4s. Estimated remaining: 3h 39m 51s. Rate: 7.1 symbols/min [2025-10-14T18:52:35.048894] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:35.076025] [DEBUG] [LOCAL ] FBK: Loaded 27039 existing records from primary storage. [2025-10-14T18:52:35.076290] [INFO ] [MAIN ] FBK: Loaded 27039 existing records. [2025-10-14T18:52:35.165996] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-14T18:52:35.254419] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:35.254622] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-14T18:52:35.254698] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-14T18:52:35.255085] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-14T18:52:35.255141] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-14T18:52:35.642125] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:35.960780] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-14T18:52:35.970337] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T18:52:35.982976] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-14T18:52:36.429897] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T18:52:36.758055] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-14T18:52:36.962852] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T18:52:37.558142] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-14T18:52:38.165347] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T18:52:38.170943] [INFO ] [REMOTE ] FAF: Full fetch complete (57831 records). [2025-10-14T18:52:38.171151] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-14T18:52:38.363468] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-14T18:52:38.641604] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-14T18:52:38.641748] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-14T18:52:38.642883] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-14T18:52:38.642949] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-14T18:52:38.644674] [DEBUG] [LOCAL ] FAF: Trimmed 57831 records to 41537 (keeping 200 days of data) [2025-10-14T18:52:38.925243] [DEBUG] [LOCAL ] FAF: Primary data saved (41537 records). [2025-10-14T18:52:38.925417] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-14T18:52:38.925512] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. FAF took 32.4s. Estimated remaining: 3h 39m 34s. Rate: 7.1 symbols/min [2025-10-14T18:52:39.106481] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:39.161470] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-14T18:52:39.164134] [DEBUG] [LOCAL ] FBP: Loaded 45728 existing records from primary storage. [2025-10-14T18:52:39.164602] [INFO ] [MAIN ] FBP: Loaded 45728 existing records. [2025-10-14T18:52:39.376349] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:39.376667] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-14T18:52:39.376735] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-14T18:52:39.377260] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-14T18:52:39.377320] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-14T18:52:39.772752] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:39.870825] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-14T18:52:39.958041] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-14T18:52:40.126442] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T18:52:40.161076] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T18:52:40.758103] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-14T18:52:41.558071] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-14T18:52:41.675949] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T18:52:42.240023] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-14T18:52:42.358061] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-14T18:52:42.877571] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T18:52:43.158083] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-14T18:52:43.958125] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-14T18:52:44.620548] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T18:52:44.758027] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-14T18:52:44.793155] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-14T18:52:45.558058] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-14T18:52:45.656986] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T18:52:46.056481] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T18:52:46.216989] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T18:52:46.358129] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-14T18:52:47.158076] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-14T18:52:47.547927] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T18:52:47.958037] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-14T18:52:48.758087] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-14T18:52:49.308079] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-14T18:52:49.553401] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T18:52:49.563376] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-14T18:52:50.036041] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T18:52:50.358094] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-14T18:52:51.158877] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T18:52:51.158089] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-14T18:52:51.165824] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-14T18:52:51.165934] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-14T18:52:51.508794] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T18:52:51.619006] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-14T18:52:51.619085] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-14T18:52:51.620019] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-14T18:52:51.620138] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-14T18:52:51.621803] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-14T18:52:51.951168] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T18:52:51.958389] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-14T18:52:51.982617] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-14T18:52:51.982750] [INFO ] [MAIN ] F: Full history saved. [2025-10-14T18:52:51.982831] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 45.4s. Estimated remaining: 3h 39m 35s. Rate: 7.1 symbols/min [2025-10-14T18:52:52.154924] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:52.191816] [DEBUG] [LOCAL ] FBRT: Loaded 35334 existing records from primary storage. [2025-10-14T18:52:52.192115] [INFO ] [MAIN ] FBRT: Loaded 35334 existing records. [2025-10-14T18:52:52.370079] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:52.370298] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-14T18:52:52.370344] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-14T18:52:52.370743] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-14T18:52:52.370801] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-14T18:52:52.763274] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-14T18:52:52.798725] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:53.416185] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T18:52:53.501684] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T18:52:53.558036] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-14T18:52:54.358052] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-14T18:52:54.704262] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T18:52:55.158069] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-14T18:52:55.963314] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-14T18:52:55.976941] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:52:56.489973] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T18:52:56.758054] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-14T18:52:56.970365] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T18:52:57.558052] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-14T18:52:57.852373] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T18:52:58.358073] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-14T18:52:58.461731] [DEBUG] [REMOTE ] FBRT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-14T18:52:58.462031] [WARN ] [REMOTE ] FBRT: No data returned for month 2025-01 [2025-10-14T18:52:58.462121] [FATAL] [REMOTE ] FBRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:52:58.462213] [FATAL] [MAIN ] FBRT: Failed to fetch primary data. [2025-10-14T18:52:58.462254] [WARN ] [MAIN ] FBRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:52:58.462305] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-14T18:52:58.462368] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-14T18:52:58.462407] [INFO ] [LOCAL ] FBRT: Starting deletion of derivative data. [2025-10-14T18:52:58.462606] [DEBUG] [LOCAL ] FBRT: Deleted derivative data file. [2025-10-14T18:52:58.462718] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBRT took 6.5s. Estimated remaining: 3h 39m 22s. Rate: 7.1 symbols/min [2025-10-14T18:52:58.638003] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:52:58.653534] [DEBUG] [LOCAL ] FC: Loaded 14956 existing records from primary storage. [2025-10-14T18:52:58.653779] [INFO ] [MAIN ] FC: Loaded 14956 existing records. [2025-10-14T18:52:58.839051] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:52:58.855421] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-14T18:52:58.860773] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-14T18:52:58.870149] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-14T18:52:58.870683] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-14T18:52:58.872564] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T18:52:59.164043] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-14T18:52:59.253423] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:52:59.958081] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-14T18:53:00.758056] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-14T18:53:00.810445] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T18:53:01.248849] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T18:53:01.558099] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-14T18:53:02.176414] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:53:02.180408] [INFO ] [REMOTE ] FBK: Full fetch complete (34683 records). [2025-10-14T18:53:02.180494] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-14T18:53:02.358159] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-14T18:53:02.555906] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-14T18:53:02.555978] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-14T18:53:02.556528] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-14T18:53:02.556565] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-14T18:53:02.557333] [DEBUG] [LOCAL ] FBK: Trimmed 34683 records to 27211 (keeping 200 days of data) [2025-10-14T18:53:02.716145] [DEBUG] [LOCAL ] FBK: Primary data saved (27211 records). [2025-10-14T18:53:02.716268] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-14T18:53:02.716344] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FBK took 27.8s. Estimated remaining: 3h 39m 6s. Rate: 7.1 symbols/min [2025-10-14T18:53:02.885673] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:02.927231] [DEBUG] [LOCAL ] FCF: Loaded 39256 existing records from primary storage. [2025-10-14T18:53:02.927532] [INFO ] [MAIN ] FCF: Loaded 39256 existing records. [2025-10-14T18:53:03.140768] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:53:03.141178] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-14T18:53:03.141254] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-14T18:53:03.141814] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-14T18:53:03.141883] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-14T18:53:03.164984] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-14T18:53:03.306282] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T18:53:03.618195] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:03.890449] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T18:53:03.958025] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-14T18:53:04.078163] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T18:53:04.758122] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-14T18:53:05.543815] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T18:53:05.558024] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-14T18:53:06.013311] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T18:53:06.358061] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-14T18:53:06.980352] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:53:07.158050] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-14T18:53:07.275710] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T18:53:07.958099] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-14T18:53:08.758010] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T18:53:08.758097] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-14T18:53:09.345335] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:53:09.558060] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-14T18:53:10.298894] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T18:53:10.304158] [INFO ] [REMOTE ] FBP: Full fetch complete (66601 records). [2025-10-14T18:53:10.304307] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-14T18:53:10.370511] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-14T18:53:10.705987] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-14T18:53:10.706077] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-14T18:53:10.706993] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-14T18:53:10.707072] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-14T18:53:10.708450] [DEBUG] [LOCAL ] FBP: Trimmed 66601 records to 45726 (keeping 200 days of data) [2025-10-14T18:53:10.987134] [DEBUG] [LOCAL ] FBP: Primary data saved (45726 records). [2025-10-14T18:53:10.987263] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-14T18:53:10.987341] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBP took 32.1s. Estimated remaining: 3h 38m 57s. Rate: 7.1 symbols/min [2025-10-14T18:53:11.168083] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:11.168288] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-14T18:53:11.189058] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T18:53:11.195243] [INFO ] [REMOTE ] FBIN: Full fetch complete (72916 records). [2025-10-14T18:53:11.195451] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-14T18:53:11.334619] [DEBUG] [LOCAL ] FCN: Loaded 26021 existing records from primary storage. [2025-10-14T18:53:11.363971] [INFO ] [MAIN ] FCN: Loaded 26021 existing records. [2025-10-14T18:53:11.789407] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:53:11.813426] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-14T18:53:11.813816] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-14T18:53:11.814003] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-14T18:53:11.814228] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-14T18:53:11.815243] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-14T18:53:11.815348] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-14T18:53:11.815485] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-14T18:53:11.815551] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-14T18:53:11.903988] [DEBUG] [LOCAL ] FBIN: Trimmed 72916 records to 50395 (keeping 200 days of data) [2025-10-14T18:53:12.094722] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T18:53:12.159944] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-14T18:53:12.254628] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T18:53:12.363316] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:12.579461] [DEBUG] [LOCAL ] FBIN: Primary data saved (50395 records). [2025-10-14T18:53:12.579582] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-14T18:53:12.579680] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FBIN took 39.2s. Estimated remaining: 3h 38m 36s. Rate: 7.1 symbols/min [2025-10-14T18:53:12.763524] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:12.763588] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-14T18:53:12.800043] [DEBUG] [LOCAL ] FCPT: Loaded 37317 existing records from primary storage. [2025-10-14T18:53:12.800309] [INFO ] [MAIN ] FCPT: Loaded 37317 existing records. [2025-10-14T18:53:12.980727] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:53:12.980954] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-14T18:53:12.981004] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-14T18:53:12.981435] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-14T18:53:12.981493] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-14T18:53:13.373971] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:13.558036] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-14T18:53:13.615344] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T18:53:13.687492] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T18:53:14.358065] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-14T18:53:14.920575] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T18:53:15.158079] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-14T18:53:15.431793] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T18:53:15.958060] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-14T18:53:16.677045] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T18:53:16.727556] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T18:53:16.758027] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-14T18:53:17.558065] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-14T18:53:18.041187] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T18:53:18.287367] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T18:53:18.358023] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-14T18:53:19.158057] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-14T18:53:19.380867] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:53:19.958083] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-14T18:53:20.200162] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T18:53:20.758127] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-14T18:53:21.325948] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T18:53:21.558084] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-14T18:53:22.074139] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-14T18:53:22.108772] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T18:53:22.358106] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-14T18:53:23.158127] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-14T18:53:23.500242] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T18:53:23.940024] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T18:53:23.958058] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-14T18:53:24.758070] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-14T18:53:25.014188] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T18:53:25.558059] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-14T18:53:25.796839] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T18:53:26.358059] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-14T18:53:26.512484] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T18:53:27.158083] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-14T18:53:27.350728] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T18:53:27.958053] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-14T18:53:28.082129] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T18:53:28.758090] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-14T18:53:29.403830] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T18:53:29.558037] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-14T18:53:29.738118] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T18:53:30.358064] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-14T18:53:31.085333] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T18:53:31.158064] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-14T18:53:31.454381] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T18:53:31.958074] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-14T18:53:32.656923] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T18:53:32.758068] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-14T18:53:33.210726] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T18:53:33.451703] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T18:53:33.453750] [INFO ] [REMOTE ] FC: Full fetch complete (21756 records). [2025-10-14T18:53:33.453834] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-14T18:53:33.563191] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-14T18:53:33.844168] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-14T18:53:33.844252] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-14T18:53:33.844822] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-14T18:53:33.844886] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-14T18:53:33.845503] [DEBUG] [LOCAL ] FC: Trimmed 21756 records to 14892 (keeping 200 days of data) [2025-10-14T18:53:33.932070] [DEBUG] [LOCAL ] FC: Primary data saved (14892 records). [2025-10-14T18:53:33.932230] [INFO ] [MAIN ] FC: Full history saved. [2025-10-14T18:53:33.932313] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FC took 35.5s. Estimated remaining: 3h 38m 52s. Rate: 7.1 symbols/min [2025-10-14T18:53:34.104896] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:34.105114] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-14T18:53:34.105170] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-14T18:53:34.105283] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-14T18:53:34.105326] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-14T18:53:34.105368] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-14T18:53:34.105401] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-14T18:53:34.363152] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-14T18:53:34.460148] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:34.720730] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T18:53:35.158122] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-14T18:53:35.502295] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T18:53:35.958098] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-14T18:53:36.305956] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T18:53:36.758060] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-14T18:53:37.365051] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T18:53:37.558060] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-14T18:53:37.762889] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T18:53:38.358072] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-14T18:53:38.680034] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-14T18:53:38.736716] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T18:53:38.741121] [INFO ] [REMOTE ] FCF: Full fetch complete (58115 records). [2025-10-14T18:53:38.741222] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-14T18:53:39.121156] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-14T18:53:39.121235] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-14T18:53:39.122081] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-14T18:53:39.122143] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-14T18:53:39.123318] [DEBUG] [LOCAL ] FCF: Trimmed 58115 records to 39283 (keeping 200 days of data) [2025-10-14T18:53:39.177748] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-14T18:53:39.375275] [DEBUG] [LOCAL ] FCF: Primary data saved (39283 records). [2025-10-14T18:53:39.375447] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-14T18:53:39.375526] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCF took 36.7s. Estimated remaining: 3h 38m 38s. Rate: 7.1 symbols/min [2025-10-14T18:53:39.542618] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:39.558420] [DEBUG] [LOCAL ] FCT: Loaded 14759 existing records from primary storage. [2025-10-14T18:53:39.558628] [INFO ] [MAIN ] FCT: Loaded 14759 existing records. [2025-10-14T18:53:39.731589] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:53:39.731816] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-14T18:53:39.731862] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-14T18:53:39.732038] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-14T18:53:39.732094] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-14T18:53:39.970724] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-14T18:53:40.085490] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:40.366842] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T18:53:40.567735] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T18:53:40.758032] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-14T18:53:41.558074] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-14T18:53:41.926349] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T18:53:41.930121] [INFO ] [REMOTE ] FCN: Full fetch complete (35822 records). [2025-10-14T18:53:41.930270] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-14T18:53:41.934259] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T18:53:42.311589] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-14T18:53:42.311699] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-14T18:53:42.312393] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-14T18:53:42.312439] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-14T18:53:42.313303] [DEBUG] [LOCAL ] FCN: Trimmed 35822 records to 25989 (keeping 200 days of data) [2025-10-14T18:53:42.363267] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-14T18:53:42.470524] [DEBUG] [LOCAL ] FCN: Primary data saved (25989 records). [2025-10-14T18:53:42.470688] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-14T18:53:42.470789] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCN took 31.5s. Estimated remaining: 3h 38m 19s. Rate: 7.1 symbols/min [2025-10-14T18:53:42.638295] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:42.689898] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-14T18:53:42.690219] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-14T18:53:42.769131] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-14T18:53:42.873835] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:53:42.874072] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-14T18:53:42.874121] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-14T18:53:42.874852] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-14T18:53:42.874911] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-14T18:53:43.163441] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-14T18:53:43.246227] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:43.613957] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-14T18:53:43.958094] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-14T18:53:44.758047] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-14T18:53:44.896207] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T18:53:45.061733] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-14T18:53:45.558078] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-14T18:53:46.358100] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-14T18:53:47.158051] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-14T18:53:47.589622] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-14T18:53:47.650584] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T18:53:47.958106] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-14T18:53:48.094016] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T18:53:48.758060] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-14T18:53:49.558138] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-14T18:53:49.588759] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T18:53:49.834096] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-14T18:53:49.871542] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T18:53:50.358058] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-14T18:53:50.683836] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T18:53:51.158063] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-14T18:53:51.958058] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-14T18:53:52.317160] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-14T18:53:52.579714] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T18:53:52.758146] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-14T18:53:53.207254] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T18:53:53.558070] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-14T18:53:54.358100] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-14T18:53:54.981456] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T18:53:55.158087] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-14T18:53:55.502062] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T18:53:55.502730] [INFO ] [REMOTE ] FCRX: Full fetch complete (1668 records). [2025-10-14T18:53:55.502797] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-14T18:53:55.675096] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-14T18:53:55.675291] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:53:55.675338] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:53:55.675376] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-14T18:53:55.675429] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-14T18:53:55.675469] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-14T18:53:55.675525] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-14T18:53:55.675579] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCRX took 21.7s. Estimated remaining: 3h 38m 20s. Rate: 7.1 symbols/min [2025-10-14T18:53:55.842978] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:53:55.873128] [DEBUG] [LOCAL ] FDP: Loaded 29912 existing records from primary storage. [2025-10-14T18:53:55.873392] [INFO ] [MAIN ] FDP: Loaded 29912 existing records. [2025-10-14T18:53:55.963176] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-14T18:53:56.059633] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:53:56.059953] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-14T18:53:56.060188] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-14T18:53:56.060809] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-14T18:53:56.060919] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-14T18:53:56.414852] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-14T18:53:56.459145] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:53:56.758051] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-14T18:53:56.888573] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T18:53:57.558117] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-14T18:53:58.358101] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-14T18:53:58.777432] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T18:53:58.992966] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-14T18:53:59.014247] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T18:53:59.158060] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-14T18:53:59.958076] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-14T18:54:00.072167] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T18:54:00.758098] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-14T18:54:00.813759] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T18:54:01.558106] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-14T18:54:02.358045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-14T18:54:02.503845] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:54:02.798125] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T18:54:03.158094] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-14T18:54:03.303925] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T18:54:03.958104] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-14T18:54:04.612336] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T18:54:04.758050] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-14T18:54:05.219850] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-14T18:54:05.558076] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-14T18:54:05.654958] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T18:54:06.358074] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-14T18:54:07.140398] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T18:54:07.158040] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-14T18:54:07.456849] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T18:54:07.958068] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-14T18:54:08.244198] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T18:54:08.246548] [INFO ] [REMOTE ] FCT: Full fetch complete (21056 records). [2025-10-14T18:54:08.246662] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-14T18:54:08.618003] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-14T18:54:08.618086] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-14T18:54:08.618518] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-14T18:54:08.618556] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-14T18:54:08.619163] [DEBUG] [LOCAL ] FCT: Trimmed 21056 records to 14666 (keeping 200 days of data) [2025-10-14T18:54:08.706066] [DEBUG] [LOCAL ] FCT: Primary data saved (14666 records). [2025-10-14T18:54:08.706201] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-14T18:54:08.706281] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCT took 29.3s. Estimated remaining: 3h 38m 21s. Rate: 7.1 symbols/min [2025-10-14T18:54:08.767104] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-14T18:54:08.877244] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:08.904020] [DEBUG] [LOCAL ] FDS: Loaded 27413 existing records from primary storage. [2025-10-14T18:54:08.904285] [INFO ] [MAIN ] FDS: Loaded 27413 existing records. [2025-10-14T18:54:09.087451] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:54:09.088129] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-14T18:54:09.088348] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-14T18:54:09.088839] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-14T18:54:09.088917] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-14T18:54:09.440753] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T18:54:09.525822] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:09.558065] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-14T18:54:10.218345] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T18:54:10.222909] [INFO ] [REMOTE ] FCPT: Full fetch complete (53820 records). [2025-10-14T18:54:10.223018] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-14T18:54:10.363174] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-14T18:54:10.634199] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-14T18:54:10.634271] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-14T18:54:10.635044] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-14T18:54:10.635105] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-14T18:54:10.636157] [DEBUG] [LOCAL ] FCPT: Trimmed 53820 records to 37291 (keeping 200 days of data) [2025-10-14T18:54:10.873959] [DEBUG] [LOCAL ] FCPT: Primary data saved (37291 records). [2025-10-14T18:54:10.874103] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-14T18:54:10.874179] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FCPT took 58.3s. Estimated remaining: 3h 38m 0s. Rate: 7.1 symbols/min [2025-10-14T18:54:11.046864] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:11.101568] [DEBUG] [LOCAL ] FDX: Loaded 51396 existing records from primary storage. [2025-10-14T18:54:11.101981] [INFO ] [MAIN ] FDX: Loaded 51396 existing records. [2025-10-14T18:54:11.169166] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-14T18:54:11.288062] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:54:11.288313] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-14T18:54:11.288374] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-14T18:54:11.289100] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-14T18:54:11.289160] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-14T18:54:11.669546] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:11.690473] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T18:54:11.894535] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-14T18:54:11.958067] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-14T18:54:12.447674] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T18:54:12.758067] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-14T18:54:13.558071] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-14T18:54:13.933025] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T18:54:14.200365] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T18:54:14.358095] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-14T18:54:14.381163] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T18:54:15.158101] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-14T18:54:15.561912] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T18:54:15.958076] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-14T18:54:16.758062] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-14T18:54:16.804477] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T18:54:17.053867] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T18:54:17.558078] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-14T18:54:17.828827] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T18:54:18.358132] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-14T18:54:19.158112] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-14T18:54:19.500930] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T18:54:19.958077] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-14T18:54:20.221154] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T18:54:20.254328] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T18:54:20.758099] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-14T18:54:21.277287] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T18:54:21.558074] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-14T18:54:22.358032] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-14T18:54:22.399414] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T18:54:22.405335] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-14T18:54:22.405454] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-14T18:54:22.737724] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-14T18:54:22.840869] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-14T18:54:22.840972] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-14T18:54:22.841890] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-14T18:54:22.841950] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-14T18:54:22.843367] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53700 (keeping 200 days of data) [2025-10-14T18:54:23.158211] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-14T18:54:23.162185] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-14T18:54:23.162863] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-14T18:54:23.162986] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FCX took 40.7s. Estimated remaining: 3h 37m 59s. Rate: 7.1 symbols/min [2025-10-14T18:54:23.339045] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:23.355692] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T18:54:23.406850] [DEBUG] [LOCAL ] FE: Loaded 53432 existing records from primary storage. [2025-10-14T18:54:23.407187] [INFO ] [MAIN ] FE: Loaded 53432 existing records. [2025-10-14T18:54:23.590138] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:54:23.590353] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-14T18:54:23.590401] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-14T18:54:23.591000] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-14T18:54:23.591058] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-14T18:54:23.955922] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:23.958026] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-14T18:54:24.758073] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-14T18:54:25.154565] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T18:54:25.558067] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-14T18:54:25.733710] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T18:54:25.799162] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T18:54:26.358047] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-14T18:54:26.419473] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T18:54:27.158071] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-14T18:54:27.958046] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-14T18:54:28.035970] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T18:54:28.114301] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T18:54:28.758075] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-14T18:54:29.100864] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T18:54:29.105277] [INFO ] [REMOTE ] FDP: Full fetch complete (42673 records). [2025-10-14T18:54:29.105456] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-14T18:54:29.563235] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-14T18:54:29.682271] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-14T18:54:29.682387] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-14T18:54:29.683548] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-14T18:54:29.683664] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-14T18:54:29.685121] [DEBUG] [LOCAL ] FDP: Trimmed 42673 records to 29846 (keeping 200 days of data) [2025-10-14T18:54:29.904211] [DEBUG] [LOCAL ] FDP: Primary data saved (29846 records). [2025-10-14T18:54:29.904364] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-14T18:54:29.904447] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDP took 34.2s. Estimated remaining: 3h 37m 48s. Rate: 7.1 symbols/min [2025-10-14T18:54:30.101448] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:30.101674] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-14T18:54:30.101729] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-14T18:54:30.101845] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-14T18:54:30.101886] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-14T18:54:30.101926] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-14T18:54:30.101957] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-14T18:54:30.368108] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-14T18:54:30.542294] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:30.560059] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T18:54:30.596982] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T18:54:31.158083] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-14T18:54:31.426276] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-14T18:54:31.958075] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-14T18:54:32.186098] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T18:54:32.374725] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-14T18:54:32.758097] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-14T18:54:33.558068] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-14T18:54:34.000325] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T18:54:34.358083] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-14T18:54:35.158099] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-14T18:54:35.420596] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T18:54:35.493506] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T18:54:35.958071] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-14T18:54:36.497369] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T18:54:36.758086] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-14T18:54:37.558096] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-14T18:54:37.860448] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T18:54:37.988607] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T18:54:38.358180] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-14T18:54:38.459382] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T18:54:38.466373] [INFO ] [REMOTE ] FDS: Full fetch complete (38454 records). [2025-10-14T18:54:38.466598] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-14T18:54:38.737064] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-14T18:54:38.858921] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-14T18:54:38.859001] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-14T18:54:38.859606] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-14T18:54:38.859664] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-14T18:54:38.860604] [DEBUG] [LOCAL ] FDS: Trimmed 38454 records to 27588 (keeping 200 days of data) [2025-10-14T18:54:39.047709] [DEBUG] [LOCAL ] FDS: Primary data saved (27588 records). [2025-10-14T18:54:39.047837] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-14T18:54:39.047940] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDS took 30.3s. Estimated remaining: 3h 37m 41s. Rate: 7.1 symbols/min [2025-10-14T18:54:39.163239] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-14T18:54:39.223765] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:39.270389] [DEBUG] [LOCAL ] FERG: Loaded 48791 existing records from primary storage. [2025-10-14T18:54:39.270737] [INFO ] [MAIN ] FERG: Loaded 48791 existing records. [2025-10-14T18:54:39.456833] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:54:39.457094] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-14T18:54:39.457141] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-14T18:54:39.458015] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-14T18:54:39.458077] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-14T18:54:39.721249] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-14T18:54:39.819205] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:39.958035] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-14T18:54:40.758108] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-14T18:54:41.184260] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T18:54:41.540943] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T18:54:41.558013] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-14T18:54:42.358067] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-14T18:54:42.690385] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-14T18:54:43.158040] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-14T18:54:43.236244] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T18:54:43.958064] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-14T18:54:44.763175] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-14T18:54:44.778725] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T18:54:45.566456] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-14T18:54:45.586462] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T18:54:46.358159] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-14T18:54:46.363169] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T18:54:46.661029] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-14T18:54:46.883349] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T18:54:47.158109] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-14T18:54:47.540927] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-14T18:54:47.958097] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-14T18:54:48.758127] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-14T18:54:49.464475] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T18:54:49.558028] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-14T18:54:50.227139] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T18:54:50.358107] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-14T18:54:50.808284] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T18:54:51.158069] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-14T18:54:51.243105] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:54:51.958120] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-14T18:54:52.758084] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-14T18:54:53.125032] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-14T18:54:53.418493] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T18:54:53.558037] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-14T18:54:54.358074] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-14T18:54:54.441310] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T18:54:54.872157] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T18:54:54.873045] [INFO ] [REMOTE ] FENG: Full fetch complete (2275 records). [2025-10-14T18:54:54.873233] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-14T18:54:55.056570] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T18:54:55.056943] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T18:54:55.057013] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T18:54:55.066138] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-14T18:54:55.081544] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-14T18:54:55.081698] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-14T18:54:55.081793] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-14T18:54:55.081861] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FENG took 25.2s. Estimated remaining: 3h 37m 47s. Rate: 7.1 symbols/min [2025-10-14T18:54:55.094850] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T18:54:55.163168] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-14T18:54:55.272637] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:55.287290] [DEBUG] [LOCAL ] FET: Loaded 12840 existing records from primary storage. [2025-10-14T18:54:55.287480] [INFO ] [MAIN ] FET: Loaded 12840 existing records. [2025-10-14T18:54:55.460509] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:54:55.460740] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-14T18:54:55.460792] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-14T18:54:55.460945] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-14T18:54:55.460981] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-14T18:54:55.811972] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:55.958045] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-14T18:54:56.758081] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-14T18:54:57.156440] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-14T18:54:57.162283] [INFO ] [REMOTE ] FDX: Full fetch complete (74439 records). [2025-10-14T18:54:57.162399] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-14T18:54:57.560420] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-14T18:54:57.560302] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-14T18:54:57.561681] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-14T18:54:57.563052] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-14T18:54:57.563389] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-14T18:54:57.565228] [DEBUG] [LOCAL ] FDX: Trimmed 74439 records to 51393 (keeping 200 days of data) [2025-10-14T18:54:57.714079] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T18:54:57.750953] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T18:54:57.960886] [DEBUG] [LOCAL ] FDX: Primary data saved (51393 records). [2025-10-14T18:54:57.961020] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-14T18:54:57.961637] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FDX took 47.1s. Estimated remaining: 3h 37m 28s. Rate: 7.1 symbols/min [2025-10-14T18:54:58.139699] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:54:58.163888] [DEBUG] [LOCAL ] FF: Loaded 24334 existing records from primary storage. [2025-10-14T18:54:58.164155] [INFO ] [MAIN ] FF: Loaded 24334 existing records. [2025-10-14T18:54:58.353711] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:54:58.353980] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-14T18:54:58.354035] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-14T18:54:58.354227] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-14T18:54:58.354303] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-14T18:54:58.363167] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-14T18:54:58.723632] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:54:59.158044] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-14T18:54:59.390488] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T18:54:59.958038] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-14T18:55:00.027047] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T18:55:00.205212] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T18:55:00.758053] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-14T18:55:01.558052] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-14T18:55:01.646161] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T18:55:01.672270] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T18:55:02.358121] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-14T18:55:03.158094] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-14T18:55:03.691074] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T18:55:03.956390] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T18:55:03.959128] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-14T18:55:04.277106] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T18:55:04.717722] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T18:55:04.758074] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-14T18:55:05.546451] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T18:55:05.558031] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-14T18:55:06.201570] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T18:55:06.358078] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-14T18:55:07.158052] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-14T18:55:07.327190] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T18:55:07.910494] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T18:55:07.918405] [INFO ] [REMOTE ] FE: Full fetch complete (77455 records). [2025-10-14T18:55:07.918716] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-14T18:55:07.963324] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-14T18:55:08.310213] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-14T18:55:08.310287] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-14T18:55:08.311195] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-14T18:55:08.311257] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-14T18:55:08.312615] [DEBUG] [LOCAL ] FE: Trimmed 77455 records to 53434 (keeping 200 days of data) [2025-10-14T18:55:08.632068] [DEBUG] [LOCAL ] FE: Primary data saved (53434 records). [2025-10-14T18:55:08.632243] [INFO ] [MAIN ] FE: Full history saved. [2025-10-14T18:55:08.632336] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FE took 45.5s. Estimated remaining: 3h 37m 24s. Rate: 7.1 symbols/min [2025-10-14T18:55:08.760508] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-14T18:55:08.804875] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:08.813421] [DEBUG] [LOCAL ] FFA: Loaded 6060 existing records from primary storage. [2025-10-14T18:55:08.813616] [INFO ] [MAIN ] FFA: Loaded 6060 existing records. [2025-10-14T18:55:08.995107] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:55:09.004664] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-14T18:55:09.004552] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T18:55:09.004872] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-14T18:55:09.008689] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-14T18:55:09.008763] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-14T18:55:09.369186] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:09.558063] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-14T18:55:09.962499] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-14T18:55:10.358057] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-14T18:55:10.530368] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-14T18:55:10.535813] [INFO ] [REMOTE ] FERG: Full fetch complete (70943 records). [2025-10-14T18:55:10.535946] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-14T18:55:10.966010] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-14T18:55:10.966133] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-14T18:55:10.967280] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-14T18:55:10.972870] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-14T18:55:10.974057] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T18:55:10.977460] [DEBUG] [LOCAL ] FERG: Trimmed 70943 records to 48763 (keeping 200 days of data) [2025-10-14T18:55:11.159818] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-14T18:55:11.298401] [DEBUG] [LOCAL ] FERG: Primary data saved (48763 records). [2025-10-14T18:55:11.298559] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-14T18:55:11.298678] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FERG took 32.3s. Estimated remaining: 3h 37m 4s. Rate: 7.1 symbols/min [2025-10-14T18:55:11.468136] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:11.485635] [DEBUG] [LOCAL ] FFC: Loaded 16800 existing records from primary storage. [2025-10-14T18:55:11.485900] [INFO ] [MAIN ] FFC: Loaded 16800 existing records. [2025-10-14T18:55:11.660787] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:55:11.661014] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-14T18:55:11.661060] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-14T18:55:11.661343] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-14T18:55:11.661401] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-14T18:55:11.963227] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-14T18:55:12.020463] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:12.152284] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T18:55:12.758065] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-14T18:55:12.814732] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T18:55:13.558043] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-14T18:55:13.619319] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T18:55:14.139096] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T18:55:14.358062] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-14T18:55:15.158062] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-14T18:55:15.188105] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T18:55:15.859817] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T18:55:15.958065] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-14T18:55:16.667787] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T18:55:16.758066] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-14T18:55:17.558032] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-14T18:55:17.612556] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T18:55:18.063001] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T18:55:18.358098] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-14T18:55:19.158067] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-14T18:55:19.196719] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T18:55:19.958076] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-14T18:55:20.758084] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-14T18:55:20.815982] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T18:55:21.396877] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T18:55:21.558087] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-14T18:55:22.217009] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T18:55:22.358153] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-14T18:55:22.953232] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T18:55:23.158060] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-14T18:55:23.740113] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (4.58 seconds). [2025-10-14T18:55:23.765127] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T18:55:23.958079] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-14T18:55:24.534758] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T18:55:24.758097] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-14T18:55:25.558071] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-14T18:55:25.702273] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T18:55:26.358066] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-14T18:55:26.835009] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T18:55:27.146969] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T18:55:27.158049] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-14T18:55:27.958032] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-14T18:55:28.261587] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T18:55:28.758102] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-14T18:55:28.839947] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T18:55:28.841911] [INFO ] [REMOTE ] FET: Full fetch complete (18300 records). [2025-10-14T18:55:28.842004] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-14T18:55:29.214468] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-14T18:55:29.214558] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-14T18:55:29.215006] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-14T18:55:29.215069] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-14T18:55:29.215717] [DEBUG] [LOCAL ] FET: Trimmed 18300 records to 12800 (keeping 200 days of data) [2025-10-14T18:55:29.289017] [DEBUG] [LOCAL ] FET: Primary data saved (12800 records). [2025-10-14T18:55:29.289154] [INFO ] [MAIN ] FET: Full history saved. [2025-10-14T18:55:29.289234] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FET took 34.2s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-14T18:55:29.463950] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:29.498435] [DEBUG] [LOCAL ] FFWM: Loaded 35828 existing records from primary storage. [2025-10-14T18:55:29.498734] [INFO ] [MAIN ] FFWM: Loaded 35828 existing records. [2025-10-14T18:55:29.566305] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-14T18:55:29.703357] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T18:55:29.708561] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:55:29.713538] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-14T18:55:29.713623] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-14T18:55:29.714306] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-14T18:55:29.714371] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-14T18:55:30.062932] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:30.134751] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T18:55:30.358089] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-14T18:55:31.158048] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-14T18:55:31.379959] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:55:31.958063] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-14T18:55:32.164239] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T18:55:32.166863] [INFO ] [REMOTE ] FF: Full fetch complete (36422 records). [2025-10-14T18:55:32.166938] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-14T18:55:32.543602] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T18:55:32.543839] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-14T18:55:32.545431] [INFO ] [REMOTE ] FFA: Full fetch complete (8785 records). [2025-10-14T18:55:32.545359] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-14T18:55:32.546123] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-14T18:55:32.546220] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-14T18:55:32.546293] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-14T18:55:32.651630] [DEBUG] [LOCAL ] FF: Trimmed 36422 records to 24316 (keeping 200 days of data) [2025-10-14T18:55:32.758149] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-14T18:55:33.103304] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-14T18:55:33.103036] [DEBUG] [LOCAL ] FF: Primary data saved (24316 records). [2025-10-14T18:55:33.103540] [INFO ] [MAIN ] FF: Full history saved. [2025-10-14T18:55:33.103731] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FF took 35.1s. Estimated remaining: 3h 36m 57s. Rate: 7.1 symbols/min [2025-10-14T18:55:33.109194] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-14T18:55:33.168760] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-14T18:55:33.195288] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-14T18:55:33.224376] [DEBUG] [LOCAL ] FFA: Trimmed 8785 records to 6023 (keeping 200 days of data) [2025-10-14T18:55:33.345536] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:33.353978] [DEBUG] [LOCAL ] FFA: Primary data saved (6023 records). [2025-10-14T18:55:33.354242] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-14T18:55:33.354375] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FFA took 24.7s. Estimated remaining: 3h 36m 33s. Rate: 7.1 symbols/min [2025-10-14T18:55:33.536508] [DEBUG] [LOCAL ] FG: Loaded 22312 existing records from primary storage. [2025-10-14T18:55:33.566918] [INFO ] [MAIN ] FG: Loaded 22312 existing records. [2025-10-14T18:55:33.566477] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-14T18:55:33.569102] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:33.649211] [DEBUG] [LOCAL ] FGN: Loaded 3758 existing records from primary storage. [2025-10-14T18:55:33.658405] [INFO ] [MAIN ] FGN: Loaded 3758 existing records. [2025-10-14T18:55:33.823111] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T18:55:33.942828] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:55:33.952725] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-14T18:55:33.972537] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-14T18:55:33.972426] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:55:33.972799] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-14T18:55:33.972862] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-14T18:55:33.972970] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-14T18:55:33.973053] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-14T18:55:33.973092] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-14T18:55:34.016555] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-14T18:55:34.362885] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-14T18:55:34.710942] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:34.735310] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:34.784073] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T18:55:35.158078] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-14T18:55:35.175717] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T18:55:35.722880] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T18:55:35.958095] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-14T18:55:36.758134] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-14T18:55:37.384939] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T18:55:37.544685] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T18:55:37.558023] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-14T18:55:38.318826] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T18:55:38.358090] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-14T18:55:39.120539] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T18:55:39.158027] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-14T18:55:39.958040] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-14T18:55:40.204837] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T18:55:40.758051] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-14T18:55:41.267446] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T18:55:41.320792] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T18:55:41.558089] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-14T18:55:42.358138] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-14T18:55:42.553197] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T18:55:43.158178] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-14T18:55:43.437619] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-14T18:55:43.742408] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T18:55:43.958161] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-14T18:55:44.758146] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-14T18:55:45.558101] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-14T18:55:45.614305] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T18:55:45.672720] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T18:55:46.358107] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-14T18:55:46.709144] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T18:55:47.158129] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-14T18:55:47.678833] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T18:55:47.958113] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-14T18:55:48.136363] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T18:55:48.139121] [INFO ] [REMOTE ] FFC: Full fetch complete (24594 records). [2025-10-14T18:55:48.139205] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-14T18:55:48.428897] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T18:55:48.514607] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-14T18:55:48.514710] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-14T18:55:48.515253] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-14T18:55:48.515293] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-14T18:55:48.515929] [DEBUG] [LOCAL ] FFC: Trimmed 24594 records to 16759 (keeping 200 days of data) [2025-10-14T18:55:48.615267] [DEBUG] [LOCAL ] FFC: Primary data saved (16759 records). [2025-10-14T18:55:48.615401] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-14T18:55:48.615477] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FFC took 37.3s. Estimated remaining: 3h 36m 38s. Rate: 7.1 symbols/min [2025-10-14T18:55:48.781035] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-14T18:55:48.784300] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:48.785467] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-14T18:55:48.785516] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-14T18:55:48.785629] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-14T18:55:48.785709] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-14T18:55:48.785761] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-14T18:55:48.785793] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-14T18:55:49.136439] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:49.558055] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-14T18:55:50.040180] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T18:55:50.358081] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-14T18:55:50.836521] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T18:55:51.080697] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T18:55:51.158131] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-14T18:55:51.741703] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T18:55:51.958108] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-14T18:55:52.165312] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:55:52.165784] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-14T18:55:52.165881] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:55:52.165929] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-14T18:55:52.165987] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:55:52.166062] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-14T18:55:52.166134] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-14T18:55:52.166170] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-14T18:55:52.166210] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-14T18:55:52.166266] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FGSN took 3.6s. Estimated remaining: 3h 36m 20s. Rate: 7.1 symbols/min [2025-10-14T18:55:52.367884] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:55:52.404966] [DEBUG] [LOCAL ] FHI: Loaded 39869 existing records from primary storage. [2025-10-14T18:55:52.405242] [INFO ] [MAIN ] FHI: Loaded 39869 existing records. [2025-10-14T18:55:52.582963] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:55:52.583167] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-14T18:55:52.583215] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-14T18:55:52.583524] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-14T18:55:52.583581] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-14T18:55:52.758753] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-14T18:55:52.938793] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:55:53.437197] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T18:55:53.558062] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-14T18:55:54.358078] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-14T18:55:54.843554] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T18:55:55.158068] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-14T18:55:55.451597] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T18:55:55.958091] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-14T18:55:56.559864] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T18:55:56.758078] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-14T18:55:57.431189] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T18:55:57.558043] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-14T18:55:57.688912] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T18:55:57.846006] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-14T18:55:58.358064] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-14T18:55:59.158082] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-14T18:55:59.434606] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T18:55:59.958092] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-14T18:56:00.182749] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T18:56:00.758061] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-14T18:56:01.037753] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T18:56:01.558048] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-14T18:56:02.107247] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T18:56:02.358065] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-14T18:56:02.421626] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T18:56:02.425554] [INFO ] [REMOTE ] FFWM: Full fetch complete (51815 records). [2025-10-14T18:56:02.425675] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-14T18:56:02.808749] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-14T18:56:02.808837] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-14T18:56:02.809676] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-14T18:56:02.809741] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-14T18:56:02.810957] [DEBUG] [LOCAL ] FFWM: Trimmed 51815 records to 35818 (keeping 200 days of data) [2025-10-14T18:56:03.008861] [DEBUG] [LOCAL ] FFWM: Primary data saved (35818 records). [2025-10-14T18:56:03.008994] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-14T18:56:03.009069] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FFWM took 33.7s. Estimated remaining: 3h 36m 16s. Rate: 7.1 symbols/min [2025-10-14T18:56:03.158066] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-14T18:56:03.176519] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:03.230310] [DEBUG] [LOCAL ] FHN: Loaded 53388 existing records from primary storage. [2025-10-14T18:56:03.230620] [INFO ] [MAIN ] FHN: Loaded 53388 existing records. [2025-10-14T18:56:03.404406] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:03.404613] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-14T18:56:03.404704] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-14T18:56:03.405549] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-14T18:56:03.405607] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-14T18:56:03.760369] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:03.930881] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T18:56:03.958027] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-14T18:56:04.145993] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T18:56:04.758065] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-14T18:56:04.836411] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T18:56:04.839267] [INFO ] [REMOTE ] FG: Full fetch complete (28444 records). [2025-10-14T18:56:04.839379] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-14T18:56:05.204300] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-14T18:56:05.204381] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-14T18:56:05.205006] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-14T18:56:05.205071] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-14T18:56:05.205884] [DEBUG] [LOCAL ] FG: Trimmed 28444 records to 22259 (keeping 200 days of data) [2025-10-14T18:56:05.343919] [DEBUG] [LOCAL ] FG: Primary data saved (22259 records). [2025-10-14T18:56:05.344046] [INFO ] [MAIN ] FG: Full history saved. [2025-10-14T18:56:05.344121] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FG took 32.2s. Estimated remaining: 3h 35m 56s. Rate: 7.1 symbols/min [2025-10-14T18:56:05.514038] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:05.568517] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-14T18:56:05.571360] [DEBUG] [LOCAL ] FI: Loaded 53574 existing records from primary storage. [2025-10-14T18:56:05.571740] [INFO ] [MAIN ] FI: Loaded 53574 existing records. [2025-10-14T18:56:05.749238] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:05.749459] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-14T18:56:05.749505] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-14T18:56:05.750094] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-14T18:56:05.750151] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-14T18:56:06.103800] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:06.199903] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T18:56:06.358105] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-14T18:56:07.158093] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-14T18:56:07.320958] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T18:56:07.752106] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T18:56:07.958055] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-14T18:56:08.546763] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T18:56:08.758078] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-14T18:56:09.253235] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T18:56:09.558060] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-14T18:56:10.195182] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T18:56:10.358067] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-14T18:56:11.157064] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T18:56:11.166349] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-14T18:56:11.576521] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T18:56:11.958070] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-14T18:56:12.130820] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T18:56:12.349320] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-14T18:56:12.758072] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-14T18:56:13.558078] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-14T18:56:14.090288] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-14T18:56:14.358104] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-14T18:56:14.437437] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T18:56:15.158138] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-14T18:56:15.922734] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T18:56:15.958093] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-14T18:56:16.758054] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-14T18:56:16.928033] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T18:56:17.472456] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T18:56:17.558080] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-14T18:56:18.007272] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T18:56:18.296489] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T18:56:18.358028] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-14T18:56:19.158104] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-14T18:56:19.665411] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T18:56:19.666233] [INFO ] [REMOTE ] FGN: Full fetch complete (5645 records). [2025-10-14T18:56:19.666299] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-14T18:56:19.958837] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T18:56:19.964052] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-14T18:56:20.067383] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-14T18:56:20.067461] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-14T18:56:20.067664] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-14T18:56:20.067726] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-14T18:56:20.068140] [DEBUG] [LOCAL ] FGN: Trimmed 5645 records to 3718 (keeping 200 days of data) [2025-10-14T18:56:20.090380] [DEBUG] [LOCAL ] FGN: Primary data saved (3718 records). [2025-10-14T18:56:20.090464] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-14T18:56:20.090535] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FGN took 46.7s. Estimated remaining: 3h 35m 60s. Rate: 7.1 symbols/min [2025-10-14T18:56:20.258424] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:20.282088] [DEBUG] [LOCAL ] FICO: Loaded 21625 existing records from primary storage. [2025-10-14T18:56:20.282320] [INFO ] [MAIN ] FICO: Loaded 21625 existing records. [2025-10-14T18:56:20.457826] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:20.458083] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-14T18:56:20.458145] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-14T18:56:20.458575] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-14T18:56:20.458634] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-14T18:56:20.763145] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-14T18:56:20.816760] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:21.558108] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-14T18:56:21.646008] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T18:56:22.358027] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-14T18:56:22.472829] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T18:56:22.539057] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T18:56:22.543801] [INFO ] [REMOTE ] FHI: Full fetch complete (57670 records). [2025-10-14T18:56:22.544002] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-14T18:56:22.967195] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-14T18:56:22.967279] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-14T18:56:22.968197] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-14T18:56:22.968270] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-14T18:56:22.969639] [DEBUG] [LOCAL ] FHI: Trimmed 57670 records to 39897 (keeping 200 days of data) [2025-10-14T18:56:23.159489] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-14T18:56:23.229487] [DEBUG] [LOCAL ] FHI: Primary data saved (39897 records). [2025-10-14T18:56:23.229639] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-14T18:56:23.229762] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FHI took 31.1s. Estimated remaining: 3h 35m 42s. Rate: 7.1 symbols/min [2025-10-14T18:56:23.407513] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:23.407712] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-14T18:56:23.407763] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-14T18:56:23.407882] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-14T18:56:23.407962] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-14T18:56:23.408011] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-14T18:56:23.408044] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-14T18:56:23.779114] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:23.958102] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-14T18:56:24.184321] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T18:56:24.198171] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-10-14T18:56:24.321608] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T18:56:24.758084] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-14T18:56:24.981814] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-14T18:56:25.558107] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-14T18:56:26.358063] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-14T18:56:27.158108] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-14T18:56:27.419030] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T18:56:27.573430] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T18:56:27.958077] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-14T18:56:28.414757] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T18:56:28.758092] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-14T18:56:28.992589] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-14T18:56:29.558055] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-14T18:56:29.855478] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T18:56:30.358061] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-14T18:56:30.409383] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T18:56:31.158123] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-14T18:56:31.958068] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-14T18:56:32.106179] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T18:56:32.133966] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T18:56:32.758124] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-14T18:56:33.558075] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-14T18:56:33.799189] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T18:56:33.862143] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-14T18:56:33.862474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T18:56:34.358128] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-14T18:56:35.158125] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-14T18:56:35.581096] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T18:56:35.958072] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-14T18:56:36.758089] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-14T18:56:36.787741] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T18:56:37.066290] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T18:56:37.558065] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-14T18:56:38.358083] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-14T18:56:38.514077] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T18:56:38.593846] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T18:56:39.158107] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-14T18:56:39.409121] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-14T18:56:39.922221] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:56:39.958048] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-14T18:56:40.758029] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-14T18:56:41.558091] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-14T18:56:41.666297] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T18:56:41.672335] [INFO ] [REMOTE ] FI: Full fetch complete (77398 records). [2025-10-14T18:56:41.672465] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-14T18:56:41.805973] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T18:56:41.853794] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-14T18:56:41.951944] [INFO ] [REMOTE ] FHN: Full fetch complete (77469 records). [2025-10-14T18:56:41.978562] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-14T18:56:42.302698] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-14T18:56:42.307965] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-14T18:56:42.338174] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-14T18:56:42.362626] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-14T18:56:42.362929] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-14T18:56:42.429379] [DEBUG] [LOCAL ] FI: Trimmed 77398 records to 53575 (keeping 200 days of data) [2025-10-14T18:56:42.632611] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-14T18:56:42.641678] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-14T18:56:42.646343] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-14T18:56:42.646423] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-14T18:56:42.664880] [DEBUG] [LOCAL ] FHN: Trimmed 77469 records to 53391 (keeping 200 days of data) [2025-10-14T18:56:43.160531] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-14T18:56:43.177153] [DEBUG] [LOCAL ] FHN: Primary data saved (53391 records). [2025-10-14T18:56:43.177824] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-14T18:56:43.177956] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FHN took 40.2s. Estimated remaining: 3h 35m 55s. Rate: 7.1 symbols/min [2025-10-14T18:56:43.364436] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:56:43.367005] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:43.368129] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-14T18:56:43.368866] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:56:43.369809] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-14T18:56:43.370442] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:56:43.370838] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-14T18:56:43.371547] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-14T18:56:43.371979] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-14T18:56:43.372584] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-14T18:56:43.373001] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FIG took 20.1s. Estimated remaining: 3h 35m 31s. Rate: 7.1 symbols/min [2025-10-14T18:56:43.480751] [DEBUG] [LOCAL ] FI: Primary data saved (53575 records). [2025-10-14T18:56:43.484834] [INFO ] [MAIN ] FI: Full history saved. [2025-10-14T18:56:43.485219] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FI took 38.1s. Estimated remaining: 3h 35m 7s. Rate: 7.1 symbols/min [2025-10-14T18:56:43.625822] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:43.738797] [DEBUG] [LOCAL ] FIGS: Loaded 48637 existing records from primary storage. [2025-10-14T18:56:43.764902] [INFO ] [MAIN ] FIGS: Loaded 48637 existing records. [2025-10-14T18:56:43.775214] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:43.894797] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T18:56:43.908796] [DEBUG] [LOCAL ] FINS: Loaded 8300 existing records from primary storage. [2025-10-14T18:56:43.954330] [DEBUG] [LOCAL ] FIHL: Loaded 39496 existing records from primary storage. [2025-10-14T18:56:43.954574] [INFO ] [MAIN ] FINS: Loaded 8300 existing records. [2025-10-14T18:56:43.972023] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-14T18:56:43.971518] [INFO ] [MAIN ] FIHL: Loaded 39496 existing records. [2025-10-14T18:56:44.183163] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:44.240200] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-14T18:56:44.251285] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-14T18:56:44.292893] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-14T18:56:44.315894] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-14T18:56:44.430515] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:44.456035] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-14T18:56:44.417861] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:44.462935] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-14T18:56:44.468179] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-14T18:56:44.492007] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-14T18:56:44.511025] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-14T18:56:44.517203] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-14T18:56:44.525056] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-14T18:56:44.548954] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-14T18:56:45.358930] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:45.418739] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-14T18:56:45.455517] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:45.536888] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:45.548380] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T18:56:45.558022] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-14T18:56:46.358108] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-14T18:56:46.892638] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T18:56:46.989925] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-14T18:56:47.153053] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T18:56:47.162948] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-14T18:56:47.873931] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T18:56:47.958079] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-14T18:56:48.758094] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-14T18:56:49.497855] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T18:56:49.558056] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-14T18:56:49.736459] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T18:56:49.740206] [INFO ] [REMOTE ] FICO: Full fetch complete (29751 records). [2025-10-14T18:56:49.740286] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-14T18:56:50.125179] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-14T18:56:50.125279] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-14T18:56:50.125871] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-14T18:56:50.125934] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-14T18:56:50.126769] [DEBUG] [LOCAL ] FICO: Trimmed 29751 records to 21736 (keeping 200 days of data) [2025-10-14T18:56:50.259427] [DEBUG] [LOCAL ] FICO: Primary data saved (21736 records). [2025-10-14T18:56:50.259548] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-14T18:56:50.259622] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FICO took 30.2s. Estimated remaining: 3h 34m 56s. Rate: 7.1 symbols/min [2025-10-14T18:56:50.360723] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-14T18:56:50.430819] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:56:50.471885] [DEBUG] [LOCAL ] FINV: Loaded 45299 existing records from primary storage. [2025-10-14T18:56:50.472195] [INFO ] [MAIN ] FINV: Loaded 45299 existing records. [2025-10-14T18:56:50.657159] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:56:50.657500] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-14T18:56:50.657605] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-14T18:56:50.657931] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-14T18:56:50.657990] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-14T18:56:51.032674] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T18:56:51.067780] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:56:51.111960] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T18:56:51.158102] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-14T18:56:51.958102] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-14T18:56:52.702967] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T18:56:52.758074] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-14T18:56:52.814333] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T18:56:53.558095] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-14T18:56:54.182286] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T18:56:54.358064] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-14T18:56:54.876188] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T18:56:55.158072] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-14T18:56:55.460450] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T18:56:55.747489] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T18:56:55.958107] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-14T18:56:56.763074] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-14T18:56:56.765519] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T18:56:57.558071] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-14T18:56:58.367529] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-14T18:56:58.373013] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T18:56:58.679374] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T18:56:59.158105] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-14T18:56:59.919549] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T18:56:59.958034] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-14T18:57:00.537397] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T18:57:00.758094] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-14T18:57:01.179322] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T18:57:01.558102] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-14T18:57:02.125420] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:57:02.358046] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-14T18:57:02.466198] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T18:57:03.158054] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-14T18:57:03.656357] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T18:57:03.958067] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-14T18:57:04.391068] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T18:57:04.704573] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T18:57:04.758073] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-14T18:57:05.558072] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-14T18:57:06.325128] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T18:57:06.326246] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T18:57:06.358095] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-14T18:57:06.814277] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T18:57:07.158107] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-14T18:57:07.958065] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-14T18:57:08.758065] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-14T18:57:08.803423] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T18:57:08.996201] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T18:57:09.424968] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T18:57:09.558062] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-14T18:57:10.358100] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-14T18:57:11.158097] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-14T18:57:11.262254] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T18:57:11.750789] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T18:57:11.958101] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-14T18:57:12.181267] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T18:57:12.594249] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T18:57:12.595624] [INFO ] [REMOTE ] FINS: Full fetch complete (11841 records). [2025-10-14T18:57:12.595720] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-14T18:57:12.760186] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-14T18:57:12.968618] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-14T18:57:12.968724] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-14T18:57:12.969012] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-14T18:57:12.969050] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-14T18:57:12.969504] [DEBUG] [LOCAL ] FINS: Trimmed 11841 records to 8322 (keeping 200 days of data) [2025-10-14T18:57:13.025296] [DEBUG] [LOCAL ] FINS: Primary data saved (8322 records). [2025-10-14T18:57:13.025438] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-14T18:57:13.025517] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FINS took 29.5s. Estimated remaining: 3h 35m 14s. Rate: 7.1 symbols/min [2025-10-14T18:57:13.202330] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:13.250888] [DEBUG] [LOCAL ] FIS: Loaded 53345 existing records from primary storage. [2025-10-14T18:57:13.251199] [INFO ] [MAIN ] FIS: Loaded 53345 existing records. [2025-10-14T18:57:13.426814] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:57:13.427019] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-14T18:57:13.427066] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-14T18:57:13.428130] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-14T18:57:13.428191] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-14T18:57:13.567273] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-14T18:57:13.813404] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:14.243124] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T18:57:14.358035] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-14T18:57:15.158072] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-14T18:57:15.319028] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T18:57:15.765985] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T18:57:15.958069] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-14T18:57:16.327240] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T18:57:16.758115] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-14T18:57:17.361975] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T18:57:17.558131] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-14T18:57:17.736142] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T18:57:18.358125] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-14T18:57:19.158083] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-14T18:57:19.226225] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T18:57:19.534960] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T18:57:19.539315] [INFO ] [REMOTE ] FIHL: Full fetch complete (56286 records). [2025-10-14T18:57:19.539409] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-14T18:57:19.916855] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-14T18:57:19.916941] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-14T18:57:19.917717] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-14T18:57:19.917782] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-14T18:57:19.919013] [DEBUG] [LOCAL ] FIHL: Trimmed 56286 records to 39429 (keeping 200 days of data) [2025-10-14T18:57:19.972180] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-14T18:57:20.157203] [DEBUG] [LOCAL ] FIHL: Primary data saved (39429 records). [2025-10-14T18:57:20.157332] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-14T18:57:20.157406] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FIHL took 36.8s. Estimated remaining: 3h 35m 3s. Rate: 7.1 symbols/min [2025-10-14T18:57:20.325620] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:20.351804] [DEBUG] [LOCAL ] FIX: Loaded 29043 existing records from primary storage. [2025-10-14T18:57:20.352048] [INFO ] [MAIN ] FIX: Loaded 29043 existing records. [2025-10-14T18:57:20.538464] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:57:20.538724] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-14T18:57:20.538779] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-14T18:57:20.544514] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-14T18:57:20.546107] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-14T18:57:20.617151] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T18:57:20.671758] [INFO ] [REMOTE ] FIGS: Full fetch complete (70870 records). [2025-10-14T18:57:20.687223] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-14T18:57:20.762116] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-14T18:57:21.159992] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:21.308455] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-14T18:57:21.308576] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-14T18:57:21.309428] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-14T18:57:21.309487] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-14T18:57:21.310752] [DEBUG] [LOCAL ] FIGS: Trimmed 70870 records to 48563 (keeping 200 days of data) [2025-10-14T18:57:21.564422] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-14T18:57:21.579030] [DEBUG] [LOCAL ] FIGS: Primary data saved (48563 records). [2025-10-14T18:57:21.579134] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-14T18:57:21.579226] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIGS took 38.4s. Estimated remaining: 3h 34m 42s. Rate: 7.1 symbols/min [2025-10-14T18:57:21.716275] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:57:22.358058] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-14T18:57:22.560137] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T18:57:22.628408] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T18:57:23.158048] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-14T18:57:23.917749] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T18:57:23.958034] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-14T18:57:24.584827] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T18:57:24.758077] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-14T18:57:25.044023] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T18:57:25.049902] [INFO ] [REMOTE ] FINV: Full fetch complete (64418 records). [2025-10-14T18:57:25.050061] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-14T18:57:25.459080] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-14T18:57:25.459195] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-14T18:57:25.460119] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-14T18:57:25.460184] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-14T18:57:25.461469] [DEBUG] [LOCAL ] FINV: Trimmed 64418 records to 45286 (keeping 200 days of data) [2025-10-14T18:57:25.562430] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-14T18:57:25.715574] [DEBUG] [LOCAL ] FINV: Primary data saved (45286 records). [2025-10-14T18:57:25.715754] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-14T18:57:25.715847] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FINV took 35.5s. Estimated remaining: 3h 34m 26s. Rate: 7.1 symbols/min [2025-10-14T18:57:26.205240] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T18:57:26.358069] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-14T18:57:27.209391] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T18:57:27.216612] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-14T18:57:28.487417] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-14T18:57:28.500001] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-14T18:57:28.686309] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T18:57:28.758122] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-14T18:57:29.805432] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T18:57:29.817906] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-14T18:57:30.369561] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T18:57:30.378334] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-14T18:57:31.206807] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T18:57:31.219006] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-14T18:57:32.028969] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T18:57:32.040693] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-14T18:57:33.000409] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T18:57:33.011795] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-14T18:57:33.190396] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T18:57:33.558061] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-14T18:57:34.604816] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T18:57:34.616687] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-14T18:57:34.756738] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T18:57:34.955254] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T18:57:34.961283] [INFO ] [REMOTE ] FIS: Full fetch complete (77365 records). [2025-10-14T18:57:34.961429] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-14T18:57:35.163151] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-14T18:57:35.369852] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-14T18:57:35.369959] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-14T18:57:35.371284] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-14T18:57:35.371388] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-14T18:57:35.373327] [DEBUG] [LOCAL ] FIS: Trimmed 77365 records to 53343 (keeping 200 days of data) [2025-10-14T18:57:35.714575] [DEBUG] [LOCAL ] FIS: Primary data saved (53343 records). [2025-10-14T18:57:35.714732] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-14T18:57:35.714838] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIS took 22.7s. Estimated remaining: 3h 34m 20s. Rate: 7.1 symbols/min [2025-10-14T18:57:36.692215] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T18:57:36.698861] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-14T18:57:37.747907] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T18:57:37.754119] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-14T18:57:38.654232] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T18:57:38.660628] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-14T18:57:39.859566] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T18:57:39.862619] [INFO ] [REMOTE ] FIX: Full fetch complete (45299 records). [2025-10-14T18:57:39.862776] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-14T18:57:40.252799] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-14T18:57:40.252874] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-14T18:57:40.253530] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-14T18:57:40.253568] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-14T18:57:40.254464] [DEBUG] [LOCAL ] FIX: Trimmed 45299 records to 28900 (keeping 200 days of data) [2025-10-14T18:57:40.433232] [DEBUG] [LOCAL ] FIX: Primary data saved (28900 records). [2025-10-14T18:57:40.433362] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-14T18:57:40.433438] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIX took 20.3s. Estimated remaining: 3h 34m 5s. Rate: 7.1 symbols/min [2025-10-14T18:57:40.986767] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:41.096957] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:41.126443] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-14T18:57:41.138388] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-14T18:57:41.138307] [DEBUG] [LOCAL ] FLC: Loaded 5442 existing records from primary storage. [2025-10-14T18:57:41.148809] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-14T18:57:41.156481] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:41.155398] [INFO ] [MAIN ] FLC: Loaded 5442 existing records. [2025-10-14T18:57:41.155613] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-14T18:57:41.167694] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-14T18:57:41.155179] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:41.186664] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-14T18:57:41.456737] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:57:41.457196] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-14T18:57:41.457265] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-14T18:57:41.477102] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-14T18:57:41.483247] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-14T18:57:41.560437] [DEBUG] [LOCAL ] FLNG: Loaded 33739 existing records from primary storage. [2025-10-14T18:57:41.627524] [INFO ] [MAIN ] FLNG: Loaded 33739 existing records. [2025-10-14T18:57:41.932335] [DEBUG] [LOCAL ] FLG: Loaded 53323 existing records from primary storage. [2025-10-14T18:57:42.017122] [INFO ] [MAIN ] FLG: Loaded 53323 existing records. [2025-10-14T18:57:42.261118] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:57:42.279995] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:42.333910] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-14T18:57:42.328472] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-14T18:57:42.334104] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-14T18:57:42.369443] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-14T18:57:42.391915] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-14T18:57:42.480199] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:42.507137] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-14T18:57:42.566561] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:57:42.567350] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-14T18:57:42.573198] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-14T18:57:42.596520] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-14T18:57:42.607523] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-14T18:57:42.641851] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:57:42.688742] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-14T18:57:42.714882] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:57:42.746418] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-14T18:57:42.768872] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:57:42.818329] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-14T18:57:42.873342] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-14T18:57:42.902363] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-14T18:57:42.934575] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-14T18:57:42.942382] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FIXT took 2.5s. Estimated remaining: 3h 33m 46s. Rate: 7.1 symbols/min [2025-10-14T18:57:43.246403] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:43.279722] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-14T18:57:43.368543] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T18:57:43.385212] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-14T18:57:43.407333] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:43.445705] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:43.446014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-14T18:57:43.492872] [DEBUG] [LOCAL ] FLO: Loaded 52028 existing records from primary storage. [2025-10-14T18:57:43.493188] [INFO ] [MAIN ] FLO: Loaded 52028 existing records. [2025-10-14T18:57:43.665471] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:57:43.665693] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-14T18:57:43.665751] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-14T18:57:43.666733] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-14T18:57:43.666793] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-14T18:57:44.016505] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:44.016827] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-14T18:57:44.037520] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-14T18:57:44.039264] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-14T18:57:44.427733] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-14T18:57:44.429329] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-14T18:57:44.890797] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T18:57:44.898414] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-14T18:57:45.242367] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T18:57:45.277197] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T18:57:45.369597] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T18:57:45.558033] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-14T18:57:45.969924] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T18:57:46.235981] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T18:57:46.358077] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-14T18:57:46.738144] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-14T18:57:47.158078] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-14T18:57:47.958080] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-14T18:57:48.366634] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T18:57:48.606278] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T18:57:48.758054] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-14T18:57:49.346965] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T18:57:49.558036] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-14T18:57:50.060978] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T18:57:50.358077] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-14T18:57:50.806712] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T18:57:51.158092] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-14T18:57:51.958087] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-14T18:57:52.549103] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T18:57:52.758064] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-14T18:57:53.424187] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T18:57:53.558101] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-14T18:57:54.358048] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-14T18:57:54.393791] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T18:57:54.878978] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T18:57:55.158152] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-14T18:57:55.396211] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T18:57:55.958113] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-14T18:57:56.462787] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T18:57:56.758073] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-14T18:57:57.558048] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-14T18:57:57.682940] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T18:57:57.725389] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T18:57:57.987415] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T18:57:57.988564] [INFO ] [REMOTE ] FLC: Full fetch complete (7845 records). [2025-10-14T18:57:57.988635] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-14T18:57:58.357031] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-14T18:57:58.357113] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-14T18:57:58.357331] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-14T18:57:58.357370] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-14T18:57:58.357798] [DEBUG] [LOCAL ] FLC: Trimmed 7845 records to 5437 (keeping 200 days of data) [2025-10-14T18:57:58.358168] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-14T18:57:58.391678] [DEBUG] [LOCAL ] FLC: Primary data saved (5437 records). [2025-10-14T18:57:58.391778] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-14T18:57:58.391850] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLC took 18.0s. Estimated remaining: 3h 33m 50s. Rate: 7.1 symbols/min [2025-10-14T18:57:58.566709] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:57:58.566909] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-14T18:57:58.566951] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-14T18:57:58.567027] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-14T18:57:58.567063] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-14T18:57:58.567103] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-14T18:57:58.567135] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-14T18:57:58.917379] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:57:59.158088] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-14T18:57:59.425424] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T18:57:59.958078] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-14T18:58:00.181747] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T18:58:00.182059] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-14T18:58:00.182144] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T18:58:00.182192] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-14T18:58:00.182247] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T18:58:00.182316] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-14T18:58:00.182389] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-14T18:58:00.182485] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-14T18:58:00.182560] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-14T18:58:00.182618] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLOC took 1.8s. Estimated remaining: 3h 33m 30s. Rate: 7.1 symbols/min [2025-10-14T18:58:00.358110] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:00.408279] [DEBUG] [LOCAL ] FLR: Loaded 53204 existing records from primary storage. [2025-10-14T18:58:00.408582] [INFO ] [MAIN ] FLR: Loaded 53204 existing records. [2025-10-14T18:58:00.591931] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:00.592126] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-14T18:58:00.592172] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-14T18:58:00.592498] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-14T18:58:00.592556] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-14T18:58:00.771722] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-14T18:58:00.996002] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:01.312602] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-14T18:58:01.558069] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-14T18:58:02.279686] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T18:58:02.358028] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-14T18:58:02.901736] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T18:58:03.158105] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-14T18:58:03.803100] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T18:58:03.958071] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-14T18:58:04.509528] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T18:58:04.758047] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-14T18:58:05.388065] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T18:58:05.558065] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-14T18:58:06.060116] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T18:58:06.358067] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-14T18:58:07.025214] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T18:58:07.158055] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-14T18:58:07.958049] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-14T18:58:08.049086] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T18:58:08.620722] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T18:58:08.758076] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-14T18:58:08.833511] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T18:58:08.837297] [INFO ] [REMOTE ] FLNG: Full fetch complete (50266 records). [2025-10-14T18:58:08.837437] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-14T18:58:09.248813] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-14T18:58:09.248911] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-14T18:58:09.249630] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-14T18:58:09.249713] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-14T18:58:09.250887] [DEBUG] [LOCAL ] FLNG: Trimmed 50266 records to 33716 (keeping 200 days of data) [2025-10-14T18:58:09.449954] [DEBUG] [LOCAL ] FLNG: Primary data saved (33716 records). [2025-10-14T18:58:09.450077] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-14T18:58:09.450158] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLNG took 29.0s. Estimated remaining: 3h 33m 23s. Rate: 7.1 symbols/min [2025-10-14T18:58:09.563190] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-14T18:58:09.620499] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:09.664515] [DEBUG] [LOCAL ] FLS: Loaded 50339 existing records from primary storage. [2025-10-14T18:58:09.664844] [INFO ] [MAIN ] FLS: Loaded 50339 existing records. [2025-10-14T18:58:09.840633] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:09.840864] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-14T18:58:09.840910] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-14T18:58:09.841733] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-14T18:58:09.841792] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-14T18:58:10.197627] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:10.322996] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T18:58:10.358069] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-14T18:58:11.118677] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T18:58:11.158022] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-14T18:58:11.873868] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T18:58:11.958032] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-14T18:58:12.390718] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T18:58:12.758130] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-14T18:58:13.558693] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-14T18:58:13.564853] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T18:58:14.152732] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T18:58:14.358039] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-14T18:58:15.022747] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T18:58:15.158030] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-14T18:58:15.958069] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-14T18:58:16.037822] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T18:58:16.758052] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-14T18:58:16.944952] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T18:58:17.558068] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-14T18:58:17.768262] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T18:58:18.037391] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T18:58:18.358106] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-14T18:58:19.110991] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T18:58:19.158086] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-14T18:58:19.777514] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T18:58:19.958093] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-14T18:58:20.439982] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T18:58:20.758295] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-14T18:58:21.558062] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-14T18:58:21.600994] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T18:58:21.607674] [INFO ] [REMOTE ] FLO: Full fetch complete (75255 records). [2025-10-14T18:58:21.607845] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-14T18:58:22.035360] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-14T18:58:22.035444] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-14T18:58:22.036370] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-14T18:58:22.036432] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-14T18:58:22.037866] [DEBUG] [LOCAL ] FLO: Trimmed 75255 records to 52059 (keeping 200 days of data) [2025-10-14T18:58:22.358465] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-14T18:58:22.365258] [DEBUG] [LOCAL ] FLO: Primary data saved (52059 records). [2025-10-14T18:58:22.365367] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-14T18:58:22.365445] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLO took 39.4s. Estimated remaining: 3h 33m 23s. Rate: 7.1 symbols/min [2025-10-14T18:58:22.549191] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:22.598522] [DEBUG] [LOCAL ] FLUT: Loaded 50771 existing records from primary storage. [2025-10-14T18:58:22.625047] [INFO ] [MAIN ] FLUT: Loaded 50771 existing records. [2025-10-14T18:58:22.699485] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T18:58:22.821933] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:22.822159] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-14T18:58:22.822204] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-14T18:58:22.822607] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-14T18:58:22.822711] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-14T18:58:23.159267] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-14T18:58:23.187810] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:23.219186] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T18:58:23.676126] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T18:58:23.958082] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-14T18:58:24.618232] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T18:58:24.758116] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-14T18:58:25.558087] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-14T18:58:25.913111] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T18:58:25.960786] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T18:58:26.358115] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-14T18:58:27.032508] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T18:58:27.158116] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-14T18:58:27.958075] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-14T18:58:28.220050] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T18:58:28.758125] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-14T18:58:28.829009] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T18:58:28.834999] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-14T18:58:28.835113] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-14T18:58:29.231353] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-14T18:58:29.231464] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-14T18:58:29.232418] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-14T18:58:29.232493] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-14T18:58:29.234219] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 53324 (keeping 200 days of data) [2025-10-14T18:58:29.471405] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T18:58:29.572202] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-14T18:58:29.597097] [DEBUG] [LOCAL ] FLG: Primary data saved (53324 records). [2025-10-14T18:58:29.597186] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-14T18:58:29.597258] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLG took 49.2s. Estimated remaining: 3h 33m 12s. Rate: 7.1 symbols/min [2025-10-14T18:58:29.770987] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:29.790379] [DEBUG] [LOCAL ] FLXR: Loaded 20860 existing records from primary storage. [2025-10-14T18:58:29.790618] [INFO ] [MAIN ] FLXR: Loaded 20860 existing records. [2025-10-14T18:58:29.969801] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:29.970011] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-14T18:58:29.970058] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-14T18:58:29.970530] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-14T18:58:29.970590] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-14T18:58:30.331488] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:30.358031] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-14T18:58:30.395731] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T18:58:30.817503] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T18:58:30.836969] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-14T18:58:31.158107] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-14T18:58:31.958116] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-14T18:58:32.758121] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-14T18:58:32.757752] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T18:58:32.873797] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T18:58:33.558064] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-14T18:58:34.304722] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T18:58:34.358113] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-14T18:58:34.504692] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T18:58:34.904104] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T18:58:35.158122] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-14T18:58:35.958052] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-14T18:58:36.758077] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-14T18:58:37.023049] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-14T18:58:37.028884] [INFO ] [REMOTE ] FLR: Full fetch complete (76740 records). [2025-10-14T18:58:37.028997] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-14T18:58:37.422355] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-14T18:58:37.422548] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-14T18:58:37.423510] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-14T18:58:37.423665] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-14T18:58:37.425376] [DEBUG] [LOCAL ] FLR: Trimmed 76740 records to 53229 (keeping 200 days of data) [2025-10-14T18:58:37.548256] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T18:58:37.561988] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-14T18:58:37.772132] [DEBUG] [LOCAL ] FLR: Primary data saved (53229 records). [2025-10-14T18:58:37.772256] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-14T18:58:37.772330] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLR took 37.6s. Estimated remaining: 3h 33m 4s. Rate: 7.1 symbols/min [2025-10-14T18:58:37.938547] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:37.983705] [DEBUG] [LOCAL ] FMC: Loaded 51819 existing records from primary storage. [2025-10-14T18:58:37.984011] [INFO ] [MAIN ] FMC: Loaded 51819 existing records. [2025-10-14T18:58:38.165305] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:38.165487] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-14T18:58:38.165532] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-14T18:58:38.166561] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-14T18:58:38.166619] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-14T18:58:38.366672] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-14T18:58:38.549126] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:38.580638] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T18:58:38.587584] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T18:58:39.158071] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-14T18:58:39.958046] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-14T18:58:40.243206] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T18:58:40.490224] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T18:58:40.758060] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-14T18:58:41.214596] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T18:58:41.365712] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-14T18:58:41.558041] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-14T18:58:42.358048] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-14T18:58:42.508821] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T18:58:43.158125] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-14T18:58:43.777982] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T18:58:43.783748] [INFO ] [REMOTE ] FLS: Full fetch complete (72219 records). [2025-10-14T18:58:43.783857] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-14T18:58:43.963997] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-14T18:58:44.184106] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-14T18:58:44.184215] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-14T18:58:44.185247] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-14T18:58:44.185315] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-14T18:58:44.186980] [DEBUG] [LOCAL ] FLS: Trimmed 72219 records to 50337 (keeping 200 days of data) [2025-10-14T18:58:44.505043] [DEBUG] [LOCAL ] FLS: Primary data saved (50337 records). [2025-10-14T18:58:44.505182] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-14T18:58:44.505264] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLS took 35.1s. Estimated remaining: 3h 32m 52s. Rate: 7.1 symbols/min [2025-10-14T18:58:44.687772] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:44.694787] [DEBUG] [LOCAL ] FMN: Loaded 5362 existing records from primary storage. [2025-10-14T18:58:44.695002] [INFO ] [MAIN ] FMN: Loaded 5362 existing records. [2025-10-14T18:58:44.758441] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-14T18:58:44.878531] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:44.878912] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-14T18:58:44.878993] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-14T18:58:44.879324] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-14T18:58:44.879400] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-14T18:58:45.089949] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T18:58:45.287440] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:45.558041] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-14T18:58:45.833967] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T18:58:45.860994] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T18:58:46.274831] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T18:58:46.358114] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-14T18:58:47.158075] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-14T18:58:47.919987] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T18:58:47.943230] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T18:58:47.958031] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-14T18:58:48.758037] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-14T18:58:49.107185] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T18:58:49.558088] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-14T18:58:50.221166] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T18:58:50.310199] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T18:58:50.358044] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-14T18:58:51.158065] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-14T18:58:51.958124] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-14T18:58:52.145755] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T18:58:52.321108] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T18:58:52.324701] [INFO ] [REMOTE ] FLXR: Full fetch complete (26664 records). [2025-10-14T18:58:52.324849] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-14T18:58:52.699467] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-14T18:58:52.699557] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-14T18:58:52.700158] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-14T18:58:52.700224] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-14T18:58:52.701146] [DEBUG] [LOCAL ] FLXR: Trimmed 26664 records to 20956 (keeping 200 days of data) [2025-10-14T18:58:52.762379] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-14T18:58:52.831550] [DEBUG] [LOCAL ] FLXR: Primary data saved (20956 records). [2025-10-14T18:58:52.831717] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-14T18:58:52.831808] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FLXR took 23.2s. Estimated remaining: 3h 32m 44s. Rate: 7.1 symbols/min [2025-10-14T18:58:53.009494] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:58:53.038920] [DEBUG] [LOCAL ] FMS: Loaded 30169 existing records from primary storage. [2025-10-14T18:58:53.039190] [INFO ] [MAIN ] FMS: Loaded 30169 existing records. [2025-10-14T18:58:53.220194] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:58:53.220452] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-14T18:58:53.220505] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-14T18:58:53.221285] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-14T18:58:53.221345] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-14T18:58:53.578536] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-14T18:58:53.585590] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:58:53.734778] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T18:58:53.753198] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T18:58:54.358101] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-14T18:58:54.939290] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T18:58:55.158065] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-14T18:58:55.958094] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-14T18:58:56.107236] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T18:58:56.651749] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T18:58:56.758062] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-14T18:58:56.805159] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T18:58:57.535785] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T18:58:57.558021] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-14T18:58:58.123371] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T18:58:58.358081] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-14T18:58:59.158160] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-14T18:58:59.958107] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-14T18:59:00.101091] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T18:59:00.107534] [INFO ] [REMOTE ] FLUT: Full fetch complete (73215 records). [2025-10-14T18:59:00.107708] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-14T18:59:00.495700] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-14T18:59:00.495871] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-14T18:59:00.496970] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-14T18:59:00.497053] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-14T18:59:00.498592] [DEBUG] [LOCAL ] FLUT: Trimmed 73215 records to 50767 (keeping 200 days of data) [2025-10-14T18:59:00.758459] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-14T18:59:00.761276] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T18:59:00.807424] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T18:59:00.886700] [DEBUG] [LOCAL ] FLUT: Primary data saved (50767 records). [2025-10-14T18:59:00.886855] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-14T18:59:00.886935] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FLUT took 38.5s. Estimated remaining: 3h 32m 35s. Rate: 7.1 symbols/min [2025-10-14T18:59:01.062418] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:01.098125] [DEBUG] [LOCAL ] FMX: Loaded 40458 existing records from primary storage. [2025-10-14T18:59:01.098436] [INFO ] [MAIN ] FMX: Loaded 40458 existing records. [2025-10-14T18:59:01.283931] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:01.284165] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-14T18:59:01.284217] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-14T18:59:01.285025] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-14T18:59:01.285084] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-14T18:59:01.399747] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-14T18:59:01.563176] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-14T18:59:01.692775] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:02.073632] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-14T18:59:02.358063] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-14T18:59:03.158067] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-14T18:59:03.581253] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T18:59:03.760256] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T18:59:03.958112] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-14T18:59:04.598859] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T18:59:04.758051] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-14T18:59:05.511127] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T18:59:05.512595] [INFO ] [REMOTE ] FMN: Full fetch complete (10098 records). [2025-10-14T18:59:05.512688] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-14T18:59:05.563198] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-14T18:59:05.933391] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-14T18:59:05.933464] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-14T18:59:05.933763] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-14T18:59:05.933823] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-14T18:59:05.934236] [DEBUG] [LOCAL ] FMN: Trimmed 10098 records to 5384 (keeping 200 days of data) [2025-10-14T18:59:05.966523] [DEBUG] [LOCAL ] FMN: Primary data saved (5384 records). [2025-10-14T18:59:05.966592] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-14T18:59:05.966680] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMN took 21.5s. Estimated remaining: 3h 32m 20s. Rate: 7.1 symbols/min [2025-10-14T18:59:06.134135] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:06.137087] [DEBUG] [LOCAL ] FMY: Loaded 1389 existing records from primary storage. [2025-10-14T18:59:06.137216] [INFO ] [MAIN ] FMY: Loaded 1389 existing records. [2025-10-14T18:59:06.326594] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:06.326912] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-14T18:59:06.326997] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-14T18:59:06.327309] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-14T18:59:06.327370] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-14T18:59:06.363149] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-14T18:59:06.728294] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:07.066304] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T18:59:07.158083] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-14T18:59:07.958048] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-14T18:59:08.071092] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T18:59:08.255935] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T18:59:08.758122] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-14T18:59:09.099117] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T18:59:09.558076] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-14T18:59:10.197963] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T18:59:10.358061] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-14T18:59:10.958373] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T18:59:11.158078] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-14T18:59:11.505193] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-14T18:59:11.855036] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T18:59:11.958069] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-14T18:59:12.758078] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-14T18:59:13.268166] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T18:59:13.558047] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-14T18:59:13.882790] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T18:59:14.358043] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-14T18:59:14.496761] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T18:59:15.158064] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-14T18:59:15.590183] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T18:59:15.958079] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-14T18:59:16.758137] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-14T18:59:16.818894] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T18:59:17.063949] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-14T18:59:17.558071] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-14T18:59:17.783143] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T18:59:18.358081] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-14T18:59:18.677914] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T18:59:19.158109] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-14T18:59:19.821101] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T18:59:19.958072] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-14T18:59:20.754153] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T18:59:20.762329] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-14T18:59:20.764934] [INFO ] [REMOTE ] FMC: Full fetch complete (75327 records). [2025-10-14T18:59:20.765111] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-14T18:59:21.127865] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-14T18:59:21.228257] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-14T18:59:21.228520] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-14T18:59:21.229625] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-14T18:59:21.229786] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-14T18:59:21.252745] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T18:59:21.261961] [DEBUG] [LOCAL ] FMC: Trimmed 75327 records to 51832 (keeping 200 days of data) [2025-10-14T18:59:21.560434] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-14T18:59:21.581821] [DEBUG] [LOCAL ] FMC: Primary data saved (51832 records). [2025-10-14T18:59:21.581953] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-14T18:59:21.582030] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMC took 43.8s. Estimated remaining: 3h 32m 25s. Rate: 7.1 symbols/min [2025-10-14T18:59:21.752142] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:21.786665] [DEBUG] [LOCAL ] FN: Loaded 37947 existing records from primary storage. [2025-10-14T18:59:21.786985] [INFO ] [MAIN ] FN: Loaded 37947 existing records. [2025-10-14T18:59:21.963968] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:21.964162] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-14T18:59:21.964208] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-14T18:59:21.964898] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-14T18:59:21.964956] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-14T18:59:22.048185] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T18:59:22.314932] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:22.358084] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-14T18:59:22.704584] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T18:59:23.158081] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-14T18:59:23.958083] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-14T18:59:24.296982] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-14T18:59:24.435536] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T18:59:24.758072] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-14T18:59:25.558062] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-14T18:59:25.834532] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T18:59:26.358070] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-14T18:59:26.805488] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T18:59:27.024847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T18:59:27.158060] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-14T18:59:27.958071] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-14T18:59:28.623869] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T18:59:28.758020] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-14T18:59:29.103981] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-14T18:59:29.558044] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-14T18:59:29.584596] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T18:59:30.358037] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-14T18:59:30.694351] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T18:59:31.158122] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-14T18:59:31.567312] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T18:59:31.582759] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T18:59:31.958071] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-14T18:59:32.389681] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T18:59:32.390353] [INFO ] [REMOTE ] FMY: Full fetch complete (1973 records). [2025-10-14T18:59:32.390418] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-14T18:59:32.746399] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-14T18:59:32.746474] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-14T18:59:32.746569] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-14T18:59:32.746605] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-14T18:59:32.746936] [DEBUG] [LOCAL ] FMY: Trimmed 1973 records to 1390 (keeping 200 days of data) [2025-10-14T18:59:32.755731] [DEBUG] [LOCAL ] FMY: Primary data saved (1390 records). [2025-10-14T18:59:32.755789] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-14T18:59:32.755852] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMY took 26.8s. Estimated remaining: 3h 32m 21s. Rate: 7.1 symbols/min [2025-10-14T18:59:32.766847] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-14T18:59:32.935939] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:32.989576] [DEBUG] [LOCAL ] FNB: Loaded 52572 existing records from primary storage. [2025-10-14T18:59:32.989919] [INFO ] [MAIN ] FNB: Loaded 52572 existing records. [2025-10-14T18:59:33.171598] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:33.171836] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-14T18:59:33.171882] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-14T18:59:33.172979] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-14T18:59:33.173039] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-14T18:59:33.535234] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:33.558063] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-14T18:59:34.111272] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T18:59:34.358127] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-14T18:59:34.810830] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T18:59:35.158145] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-14T18:59:35.616475] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T18:59:35.958097] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-14T18:59:36.645686] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T18:59:36.650800] [INFO ] [REMOTE ] FMX: Full fetch complete (57663 records). [2025-10-14T18:59:36.651026] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-14T18:59:36.763362] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-14T18:59:37.095522] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-14T18:59:37.095668] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-14T18:59:37.096935] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-14T18:59:37.097039] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-14T18:59:37.099196] [DEBUG] [LOCAL ] FMX: Trimmed 57663 records to 40494 (keeping 200 days of data) [2025-10-14T18:59:37.246547] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T18:59:37.408291] [DEBUG] [LOCAL ] FMX: Primary data saved (40494 records). [2025-10-14T18:59:37.408478] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-14T18:59:37.408574] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FMX took 36.5s. Estimated remaining: 3h 32m 6s. Rate: 7.1 symbols/min [2025-10-14T18:59:37.563365] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-14T18:59:37.593496] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:37.654619] [DEBUG] [LOCAL ] FND: Loaded 52147 existing records from primary storage. [2025-10-14T18:59:37.655091] [INFO ] [MAIN ] FND: Loaded 52147 existing records. [2025-10-14T18:59:37.850941] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:37.851276] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-14T18:59:37.851328] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-14T18:59:37.851933] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-14T18:59:37.851994] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-14T18:59:38.226958] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T18:59:38.266174] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:38.358049] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-14T18:59:38.761079] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T18:59:39.158167] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-14T18:59:39.757158] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T18:59:39.761364] [INFO ] [REMOTE ] FMS: Full fetch complete (42489 records). [2025-10-14T18:59:39.761488] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-14T18:59:39.965001] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-14T18:59:40.148029] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-14T18:59:40.148139] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-14T18:59:40.149217] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-14T18:59:40.149281] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-14T18:59:40.150510] [DEBUG] [LOCAL ] FMS: Trimmed 42489 records to 30222 (keeping 200 days of data) [2025-10-14T18:59:40.342505] [DEBUG] [LOCAL ] FMS: Primary data saved (30222 records). [2025-10-14T18:59:40.342825] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-14T18:59:40.342947] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FMS took 47.5s. Estimated remaining: 3h 31m 48s. Rate: 7.1 symbols/min [2025-10-14T18:59:40.523786] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:40.577700] [DEBUG] [LOCAL ] FNF: Loaded 48986 existing records from primary storage. [2025-10-14T18:59:40.578142] [INFO ] [MAIN ] FNF: Loaded 48986 existing records. [2025-10-14T18:59:40.764308] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-14T18:59:40.768585] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:40.770250] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-14T18:59:40.770342] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-14T18:59:40.771473] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-14T18:59:40.771544] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-14T18:59:40.992553] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T18:59:41.198316] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:41.558047] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-14T18:59:41.690237] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T18:59:42.177279] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T18:59:42.358041] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-14T18:59:43.164787] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-14T18:59:43.182336] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T18:59:43.964488] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-14T18:59:43.981739] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T18:59:44.630755] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T18:59:44.758072] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-14T18:59:45.558093] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-14T18:59:45.626741] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T18:59:46.358097] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-14T18:59:46.398114] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T18:59:46.778882] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T18:59:47.158069] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-14T18:59:47.945474] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T18:59:47.958026] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-14T18:59:48.655701] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T18:59:48.758080] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-14T18:59:49.172213] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T18:59:49.558130] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-14T18:59:49.902286] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T18:59:50.358117] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-14T18:59:51.020506] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T18:59:51.158040] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-14T18:59:51.958070] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-14T18:59:52.195572] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T18:59:52.758050] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-14T18:59:52.839159] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T18:59:53.558075] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-14T18:59:53.719754] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T18:59:53.871375] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T18:59:53.874881] [INFO ] [REMOTE ] FN: Full fetch complete (56048 records). [2025-10-14T18:59:53.874983] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-14T18:59:54.252578] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-14T18:59:54.252687] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-14T18:59:54.253488] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-14T18:59:54.253535] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-14T18:59:54.254716] [DEBUG] [LOCAL ] FN: Trimmed 56048 records to 37848 (keeping 200 days of data) [2025-10-14T18:59:54.363190] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-14T18:59:54.483931] [DEBUG] [LOCAL ] FN: Primary data saved (37848 records). [2025-10-14T18:59:54.484054] [INFO ] [MAIN ] FN: Full history saved. [2025-10-14T18:59:54.484128] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FN took 32.9s. Estimated remaining: 3h 31m 50s. Rate: 7.1 symbols/min [2025-10-14T18:59:54.651062] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T18:59:54.697841] [DEBUG] [LOCAL ] FNV: Loaded 46111 existing records from primary storage. [2025-10-14T18:59:54.698159] [INFO ] [MAIN ] FNV: Loaded 46111 existing records. [2025-10-14T18:59:54.874939] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T18:59:54.875153] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-14T18:59:54.875205] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-14T18:59:54.875580] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-14T18:59:54.875637] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-14T18:59:55.160599] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-14T18:59:55.240309] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T18:59:55.273120] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T18:59:55.801444] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T18:59:55.958084] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-14T18:59:56.758049] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-14T18:59:56.978760] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T18:59:57.261226] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T18:59:57.558057] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-14T18:59:58.350932] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T18:59:58.361016] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-14T18:59:59.127337] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T18:59:59.158037] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-14T18:59:59.958083] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-14T19:00:00.089020] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T19:00:00.758042] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-14T19:00:00.909234] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T19:00:01.558189] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-14T19:00:01.610213] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T19:00:02.199358] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T19:00:02.358091] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-14T19:00:03.158071] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-14T19:00:03.328515] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T19:00:03.958069] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-14T19:00:03.989154] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T19:00:04.682450] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T19:00:04.758115] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-14T19:00:05.463040] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T19:00:05.558122] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-14T19:00:06.358044] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-14T19:00:06.620768] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T19:00:06.719446] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T19:00:07.158097] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-14T19:00:07.958053] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-14T19:00:08.045025] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T19:00:08.758107] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-14T19:00:08.924590] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T19:00:09.475166] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T19:00:09.558048] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-14T19:00:10.363797] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-14T19:00:10.366686] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T19:00:11.158126] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-14T19:00:11.266024] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T19:00:11.275063] [INFO ] [REMOTE ] FNB: Full fetch complete (76086 records). [2025-10-14T19:00:11.275231] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-14T19:00:11.669570] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-14T19:00:11.669667] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-14T19:00:11.670572] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-14T19:00:11.670613] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-14T19:00:11.672017] [DEBUG] [LOCAL ] FNB: Trimmed 76086 records to 52591 (keeping 200 days of data) [2025-10-14T19:00:11.980455] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-14T19:00:12.026526] [DEBUG] [LOCAL ] FNB: Primary data saved (52591 records). [2025-10-14T19:00:12.026782] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-14T19:00:12.026898] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FNB took 39.3s. Estimated remaining: 3h 31m 58s. Rate: 7.1 symbols/min [2025-10-14T19:00:12.234421] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T19:00:12.236046] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:12.266764] [DEBUG] [LOCAL ] FOA: Loaded 13120 existing records from primary storage. [2025-10-14T19:00:12.267019] [INFO ] [MAIN ] FOA: Loaded 13120 existing records. [2025-10-14T19:00:12.442551] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:00:12.442808] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-14T19:00:12.442858] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-14T19:00:12.443079] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-14T19:00:12.443139] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-14T19:00:12.762068] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-14T19:00:12.820385] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:12.850699] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T19:00:13.558060] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-14T19:00:13.649840] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T19:00:13.655311] [INFO ] [REMOTE ] FNF: Full fetch complete (69843 records). [2025-10-14T19:00:13.655434] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-14T19:00:14.053345] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-14T19:00:14.053436] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-14T19:00:14.054407] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-14T19:00:14.054473] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-14T19:00:14.056007] [DEBUG] [LOCAL ] FNF: Trimmed 69843 records to 48980 (keeping 200 days of data) [2025-10-14T19:00:14.361826] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-14T19:00:14.364186] [DEBUG] [LOCAL ] FNF: Primary data saved (48980 records). [2025-10-14T19:00:14.364366] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-14T19:00:14.365239] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FNF took 34.0s. Estimated remaining: 3h 31m 39s. Rate: 7.1 symbols/min [2025-10-14T19:00:14.558540] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T19:00:14.557609] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:14.564871] [INFO ] [REMOTE ] FND: Full fetch complete (74945 records). [2025-10-14T19:00:14.564987] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-14T19:00:14.686210] [DEBUG] [LOCAL ] FOF: Loaded 8585 existing records from primary storage. [2025-10-14T19:00:14.696890] [INFO ] [MAIN ] FOF: Loaded 8585 existing records. [2025-10-14T19:00:15.091135] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:00:15.152993] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-14T19:00:15.192287] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-14T19:00:15.192555] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-14T19:00:15.193036] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-14T19:00:15.194335] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-14T19:00:15.194259] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-14T19:00:15.194516] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-14T19:00:15.209994] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-14T19:00:15.320269] [DEBUG] [LOCAL ] FND: Trimmed 74945 records to 52153 (keeping 200 days of data) [2025-10-14T19:00:15.555615] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T19:00:15.616587] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-14T19:00:15.842840] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-14T19:00:15.993752] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-14T19:00:16.053192] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:16.091570] [DEBUG] [LOCAL ] FND: Primary data saved (52153 records). [2025-10-14T19:00:16.091840] [INFO ] [MAIN ] FND: Full history saved. [2025-10-14T19:00:16.091930] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FND took 38.7s. Estimated remaining: 3h 31m 18s. Rate: 7.1 symbols/min [2025-10-14T19:00:16.256450] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:16.276219] [DEBUG] [LOCAL ] FOR: Loaded 19785 existing records from primary storage. [2025-10-14T19:00:16.276511] [INFO ] [MAIN ] FOR: Loaded 19785 existing records. [2025-10-14T19:00:16.448181] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:00:16.448449] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-14T19:00:16.448498] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-14T19:00:16.448849] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-14T19:00:16.448906] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-14T19:00:16.760968] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-14T19:00:16.858510] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:16.895511] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T19:00:17.479974] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:00:17.501517] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T19:00:17.558037] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-14T19:00:18.182529] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T19:00:18.358069] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-14T19:00:19.158068] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-14T19:00:19.829776] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T19:00:19.958086] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-14T19:00:19.999482] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T19:00:20.758071] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-14T19:00:21.055929] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T19:00:21.465664] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T19:00:21.558083] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-14T19:00:22.358067] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-14T19:00:22.985358] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T19:00:23.125733] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T19:00:23.158023] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-14T19:00:23.958087] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-14T19:00:24.758085] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-14T19:00:24.894326] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T19:00:24.938552] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T19:00:25.558061] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-14T19:00:25.849699] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T19:00:26.358164] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-14T19:00:26.382611] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T19:00:27.158130] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-14T19:00:27.860748] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T19:00:27.866258] [INFO ] [REMOTE ] FNV: Full fetch complete (66652 records). [2025-10-14T19:00:27.866416] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-14T19:00:27.960969] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-14T19:00:28.167694] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T19:00:28.270320] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-14T19:00:28.270391] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-14T19:00:28.271213] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-14T19:00:28.271273] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-14T19:00:28.272449] [DEBUG] [LOCAL ] FNV: Trimmed 66652 records to 46127 (keeping 200 days of data) [2025-10-14T19:00:28.553577] [DEBUG] [LOCAL ] FNV: Primary data saved (46127 records). [2025-10-14T19:00:28.553739] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-14T19:00:28.554603] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FNV took 34.1s. Estimated remaining: 3h 31m 17s. Rate: 7.1 symbols/min [2025-10-14T19:00:28.729729] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:28.753666] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T19:00:28.767020] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-14T19:00:28.789785] [DEBUG] [LOCAL ] FOUR: Loaded 49672 existing records from primary storage. [2025-10-14T19:00:28.790104] [INFO ] [MAIN ] FOUR: Loaded 49672 existing records. [2025-10-14T19:00:28.968988] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:00:28.969194] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-14T19:00:28.969239] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-14T19:00:28.969735] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-14T19:00:28.969791] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-14T19:00:29.318797] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:29.482618] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T19:00:29.558042] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-14T19:00:30.358099] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-14T19:00:31.096412] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T19:00:31.118835] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T19:00:31.158039] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-14T19:00:31.958043] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-14T19:00:32.183796] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:00:32.758065] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-14T19:00:33.558054] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-14T19:00:33.713118] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T19:00:33.775319] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T19:00:34.247458] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T19:00:34.358181] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-14T19:00:35.158085] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-14T19:00:35.234582] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T19:00:35.658575] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-14T19:00:35.958104] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-14T19:00:36.698414] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T19:00:36.758036] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-14T19:00:37.558087] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-14T19:00:37.715455] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T19:00:38.358071] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-14T19:00:39.071397] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T19:00:39.158028] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-14T19:00:39.219455] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T19:00:39.910900] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T19:00:39.912331] [INFO ] [REMOTE ] FOF: Full fetch complete (11911 records). [2025-10-14T19:00:39.912397] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-14T19:00:39.964742] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-14T19:00:40.274038] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-14T19:00:40.274131] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-14T19:00:40.274439] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-14T19:00:40.274498] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-14T19:00:40.274984] [DEBUG] [LOCAL ] FOF: Trimmed 11911 records to 8607 (keeping 200 days of data) [2025-10-14T19:00:40.325665] [DEBUG] [LOCAL ] FOF: Primary data saved (8607 records). [2025-10-14T19:00:40.325769] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-14T19:00:40.325844] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOF took 26.0s. Estimated remaining: 3h 31m 15s. Rate: 7.1 symbols/min [2025-10-14T19:00:40.490460] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:40.509721] [DEBUG] [LOCAL ] FPF: Loaded 18766 existing records from primary storage. [2025-10-14T19:00:40.509973] [INFO ] [MAIN ] FPF: Loaded 18766 existing records. [2025-10-14T19:00:40.684815] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:00:40.684986] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-14T19:00:40.685031] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-14T19:00:40.685200] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-14T19:00:40.685238] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-14T19:00:40.763278] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-14T19:00:41.038702] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:41.534684] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T19:00:41.554938] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T19:00:41.559837] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-14T19:00:42.358126] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-14T19:00:43.158088] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-14T19:00:43.408319] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T19:00:43.433955] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T19:00:43.796687] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T19:00:43.958083] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-14T19:00:44.758094] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-14T19:00:44.933787] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T19:00:45.480395] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T19:00:45.558084] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-14T19:00:46.358039] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-14T19:00:46.519940] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T19:00:47.158072] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-14T19:00:47.898855] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T19:00:47.900856] [INFO ] [REMOTE ] FOA: Full fetch complete (21859 records). [2025-10-14T19:00:47.900923] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-14T19:00:47.963726] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-14T19:00:48.273353] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T19:00:48.307169] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-14T19:00:48.307426] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-14T19:00:48.308038] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-14T19:00:48.308143] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-14T19:00:48.308964] [DEBUG] [LOCAL ] FOA: Trimmed 21859 records to 13105 (keeping 200 days of data) [2025-10-14T19:00:48.383102] [DEBUG] [LOCAL ] FOA: Primary data saved (13105 records). [2025-10-14T19:00:48.383232] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-14T19:00:48.383306] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FOA took 36.4s. Estimated remaining: 3h 31m 6s. Rate: 7.1 symbols/min [2025-10-14T19:00:48.552242] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:48.571399] [DEBUG] [LOCAL ] FPH: Loaded 19370 existing records from primary storage. [2025-10-14T19:00:48.571626] [INFO ] [MAIN ] FPH: Loaded 19370 existing records. [2025-10-14T19:00:48.751149] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:00:48.751412] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-14T19:00:48.751465] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-14T19:00:48.751796] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-14T19:00:48.751853] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-14T19:00:48.763252] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-14T19:00:49.153621] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:49.155811] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T19:00:49.558094] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-14T19:00:49.577907] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T19:00:50.360510] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-14T19:00:50.363934] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T19:00:51.158090] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-14T19:00:51.453994] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:00:51.958079] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-14T19:00:52.758041] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-14T19:00:52.831621] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T19:00:53.022598] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:00:53.025745] [INFO ] [REMOTE ] FOR: Full fetch complete (29845 records). [2025-10-14T19:00:53.025995] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-14T19:00:53.415143] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-14T19:00:53.415288] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-14T19:00:53.415893] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-14T19:00:53.415957] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-14T19:00:53.416870] [DEBUG] [LOCAL ] FOR: Trimmed 29845 records to 19838 (keeping 200 days of data) [2025-10-14T19:00:53.510194] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T19:00:53.547424] [DEBUG] [LOCAL ] FOR: Primary data saved (19838 records). [2025-10-14T19:00:53.547576] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-14T19:00:53.547680] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOR took 37.5s. Estimated remaining: 3h 30m 52s. Rate: 7.1 symbols/min [2025-10-14T19:00:53.568187] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-14T19:00:53.719382] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:00:53.719541] [DEBUG] [LOCAL ] FPI: No existing data file found in primary storage. [2025-10-14T19:00:53.719579] [WARN ] [MAIN ] FPI: No existing data found, performing full refresh instead. [2025-10-14T19:00:53.719712] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-14T19:00:53.719762] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-14T19:00:53.719805] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-10-14T19:00:53.719837] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-14T19:00:54.088529] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:00:54.358114] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-14T19:00:54.879678] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T19:00:55.158086] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-14T19:00:55.414832] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T19:00:55.958079] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-14T19:00:56.135736] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T19:00:56.758064] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-14T19:00:57.522022] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:00:57.563182] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-14T19:00:57.570406] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T19:00:58.358060] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-14T19:00:59.047396] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T19:00:59.158072] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-14T19:00:59.464840] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:00:59.958035] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-14T19:01:00.349181] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T19:01:00.758182] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-14T19:01:01.558084] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-14T19:01:01.941549] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T19:01:01.976810] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T19:01:02.358065] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-14T19:01:02.783466] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T19:01:03.157994] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-14T19:01:03.385573] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T19:01:03.958064] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-14T19:01:04.179060] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T19:01:04.758130] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-14T19:01:04.992371] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:01:05.407504] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T19:01:05.558090] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-14T19:01:06.358113] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-14T19:01:07.158088] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-14T19:01:07.404433] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T19:01:07.494894] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-14T19:01:07.501080] [INFO ] [REMOTE ] FOUR: Full fetch complete (72198 records). [2025-10-14T19:01:07.501254] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-14T19:01:07.929531] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-14T19:01:07.929621] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-14T19:01:07.930557] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-14T19:01:07.930616] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-14T19:01:07.932110] [DEBUG] [LOCAL ] FOUR: Trimmed 72198 records to 49680 (keeping 200 days of data) [2025-10-14T19:01:07.985148] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-14T19:01:08.227175] [DEBUG] [LOCAL ] FOUR: Primary data saved (49680 records). [2025-10-14T19:01:08.227302] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-14T19:01:08.227377] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FOUR took 39.7s. Estimated remaining: 3h 30m 54s. Rate: 7.1 symbols/min [2025-10-14T19:01:08.397937] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:08.441204] [DEBUG] [LOCAL ] FR: Loaded 46458 existing records from primary storage. [2025-10-14T19:01:08.441519] [INFO ] [MAIN ] FR: Loaded 46458 existing records. [2025-10-14T19:01:08.627152] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:08.627469] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-14T19:01:08.627573] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-14T19:01:08.646101] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-14T19:01:08.646171] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-14T19:01:08.646939] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:01:08.762833] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-14T19:01:08.856017] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T19:01:09.048123] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:09.558051] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-14T19:01:09.824895] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:01:09.827840] [INFO ] [REMOTE ] FPF: Full fetch complete (26672 records). [2025-10-14T19:01:09.827945] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-14T19:01:10.237133] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-14T19:01:10.237210] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-14T19:01:10.237745] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-14T19:01:10.237804] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-14T19:01:10.238566] [DEBUG] [LOCAL ] FPF: Trimmed 26672 records to 18807 (keeping 200 days of data) [2025-10-14T19:01:10.348000] [DEBUG] [LOCAL ] FPF: Primary data saved (18807 records). [2025-10-14T19:01:10.348136] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-14T19:01:10.348210] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPF took 30.0s. Estimated remaining: 3h 30m 35s. Rate: 7.1 symbols/min [2025-10-14T19:01:10.363253] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-14T19:01:10.531018] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:10.546735] [DEBUG] [LOCAL ] FRA: Loaded 14428 existing records from primary storage. [2025-10-14T19:01:10.546952] [INFO ] [MAIN ] FRA: Loaded 14428 existing records. [2025-10-14T19:01:10.731104] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:10.731922] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-14T19:01:10.731970] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-14T19:01:10.732208] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-14T19:01:10.732266] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-14T19:01:11.133050] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:11.129421] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T19:01:11.158034] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-14T19:01:11.181394] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T19:01:11.958071] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-14T19:01:12.563889] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T19:01:12.758058] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-14T19:01:13.523678] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T19:01:13.558081] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-14T19:01:13.581486] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T19:01:14.358076] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-14T19:01:14.550141] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T19:01:15.158089] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-14T19:01:15.660117] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T19:01:15.774107] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T19:01:15.958064] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-14T19:01:16.758062] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-14T19:01:17.076090] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T19:01:17.558084] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-14T19:01:18.221255] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T19:01:18.276218] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T19:01:18.358106] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-14T19:01:19.158072] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-14T19:01:19.381114] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T19:01:19.958077] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-14T19:01:20.425394] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T19:01:20.706854] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T19:01:20.709319] [INFO ] [REMOTE ] FPH: Full fetch complete (31199 records). [2025-10-14T19:01:20.709400] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-14T19:01:20.766685] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-14T19:01:21.087277] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-14T19:01:21.087358] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-14T19:01:21.087981] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-14T19:01:21.088042] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-14T19:01:21.088824] [DEBUG] [LOCAL ] FPH: Trimmed 31199 records to 19342 (keeping 200 days of data) [2025-10-14T19:01:21.194329] [DEBUG] [LOCAL ] FPH: Primary data saved (19342 records). [2025-10-14T19:01:21.194464] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-14T19:01:21.194540] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FPH took 32.8s. Estimated remaining: 3h 30m 31s. Rate: 7.1 symbols/min [2025-10-14T19:01:21.363315] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:21.379209] [DEBUG] [LOCAL ] FRGE: Loaded 16319 existing records from primary storage. [2025-10-14T19:01:21.379444] [INFO ] [MAIN ] FRGE: Loaded 16319 existing records. [2025-10-14T19:01:21.554392] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:21.554594] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-14T19:01:21.554659] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-14T19:01:21.555056] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-14T19:01:21.555112] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-14T19:01:21.566190] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-14T19:01:21.909076] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:22.103076] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T19:01:22.358098] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-14T19:01:22.391484] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T19:01:23.158082] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-14T19:01:23.715988] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T19:01:23.958075] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-14T19:01:24.115719] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T19:01:24.758066] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-14T19:01:24.906501] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T19:01:25.369779] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:01:25.558064] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-14T19:01:26.358066] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-14T19:01:27.050341] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T19:01:27.144359] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T19:01:27.158035] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-14T19:01:27.958059] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-14T19:01:28.491290] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T19:01:28.495229] [INFO ] [REMOTE ] FPI: Full fetch complete (43906 records). [2025-10-14T19:01:28.495330] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-14T19:01:28.765163] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-14T19:01:28.845475] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T19:01:28.945383] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-14T19:01:28.945463] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-14T19:01:28.946215] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-14T19:01:28.946278] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-14T19:01:28.947281] [DEBUG] [LOCAL ] FPI: Trimmed 43906 records to 31275 (keeping 200 days of data) [2025-10-14T19:01:29.141611] [DEBUG] [LOCAL ] FPI: Primary data saved (31275 records). [2025-10-14T19:01:29.141772] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-14T19:01:29.141850] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FPI took 35.6s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-14T19:01:29.312545] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:29.361510] [DEBUG] [LOCAL ] FRO: Loaded 51695 existing records from primary storage. [2025-10-14T19:01:29.361845] [INFO ] [MAIN ] FRO: Loaded 51695 existing records. [2025-10-14T19:01:29.541068] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:29.541326] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-14T19:01:29.541384] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-14T19:01:29.542207] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-14T19:01:29.542265] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-14T19:01:29.563206] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-14T19:01:29.937922] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:30.358117] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-14T19:01:30.517781] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:01:30.904831] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T19:01:31.158046] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-14T19:01:31.958044] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-14T19:01:32.095554] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T19:01:32.535095] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T19:01:32.758041] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-14T19:01:32.908480] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T19:01:33.558063] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-14T19:01:34.358065] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-14T19:01:34.543593] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T19:01:34.953388] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T19:01:35.158086] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-14T19:01:35.275101] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T19:01:35.958082] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-14T19:01:36.758039] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-14T19:01:37.000749] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T19:01:37.137803] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T19:01:37.558048] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-14T19:01:37.741921] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T19:01:38.358123] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-14T19:01:38.968327] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T19:01:39.158127] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-14T19:01:39.958082] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-14T19:01:40.111284] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T19:01:40.151055] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T19:01:40.758106] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-14T19:01:41.559039] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T19:01:41.558750] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-14T19:01:41.888944] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T19:01:42.358068] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-14T19:01:43.008210] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T19:01:43.158101] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-14T19:01:43.217850] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T19:01:43.220127] [INFO ] [REMOTE ] FRA: Full fetch complete (23731 records). [2025-10-14T19:01:43.220204] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-14T19:01:43.582243] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-14T19:01:43.582327] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-14T19:01:43.582844] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-14T19:01:43.582904] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-14T19:01:43.583715] [DEBUG] [LOCAL ] FRA: Trimmed 23731 records to 14371 (keeping 200 days of data) [2025-10-14T19:01:43.674429] [DEBUG] [LOCAL ] FRA: Primary data saved (14371 records). [2025-10-14T19:01:43.674571] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-14T19:01:43.674672] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FRA took 33.3s. Estimated remaining: 3h 30m 24s. Rate: 7.1 symbols/min [2025-10-14T19:01:43.849368] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:43.888883] [DEBUG] [LOCAL ] FRT: Loaded 41675 existing records from primary storage. [2025-10-14T19:01:43.889183] [INFO ] [MAIN ] FRT: Loaded 41675 existing records. [2025-10-14T19:01:43.963331] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-14T19:01:44.070499] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:44.070728] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-14T19:01:44.070831] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-14T19:01:44.071801] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-14T19:01:44.071858] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-14T19:01:44.424151] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:44.758079] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-14T19:01:44.889791] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T19:01:45.088464] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T19:01:45.558078] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-14T19:01:45.877565] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T19:01:46.358088] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-14T19:01:46.371242] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T19:01:47.158094] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-14T19:01:47.958050] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-14T19:01:48.034345] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T19:01:48.681439] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T19:01:48.758090] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-14T19:01:48.891355] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T19:01:49.558091] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-14T19:01:50.345266] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T19:01:50.358028] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-14T19:01:51.158071] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-14T19:01:51.270919] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T19:01:51.756244] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T19:01:51.824210] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T19:01:51.958062] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-14T19:01:52.758056] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-14T19:01:53.518054] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T19:01:53.558045] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-14T19:01:54.063615] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T19:01:54.070015] [INFO ] [REMOTE ] FR: Full fetch complete (66883 records). [2025-10-14T19:01:54.070476] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-14T19:01:54.363479] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-14T19:01:54.516406] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-14T19:01:54.516501] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-14T19:01:54.517373] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-14T19:01:54.517438] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-14T19:01:54.519035] [DEBUG] [LOCAL ] FR: Trimmed 66883 records to 46500 (keeping 200 days of data) [2025-10-14T19:01:54.808242] [DEBUG] [LOCAL ] FR: Primary data saved (46500 records). [2025-10-14T19:01:54.808384] [INFO ] [MAIN ] FR: Full history saved. [2025-10-14T19:01:54.808467] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FR took 46.6s. Estimated remaining: 3h 30m 20s. Rate: 7.1 symbols/min [2025-10-14T19:01:54.997616] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:55.032282] [DEBUG] [LOCAL ] FSCO: Loaded 38370 existing records from primary storage. [2025-10-14T19:01:55.043286] [INFO ] [MAIN ] FSCO: Loaded 38370 existing records. [2025-10-14T19:01:55.157289] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T19:01:55.165808] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-14T19:01:55.242776] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T19:01:55.302134] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:55.302406] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-14T19:01:55.302456] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-14T19:01:55.303203] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-14T19:01:55.303264] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-14T19:01:55.663984] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:55.958080] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-14T19:01:56.758078] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-14T19:01:56.819966] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T19:01:56.841672] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T19:01:56.843321] [INFO ] [REMOTE ] FRGE: Full fetch complete (31255 records). [2025-10-14T19:01:56.843390] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-14T19:01:57.221147] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-14T19:01:57.221227] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-14T19:01:57.221808] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-14T19:01:57.221867] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-14T19:01:57.222544] [DEBUG] [LOCAL ] FRGE: Trimmed 31255 records to 16201 (keeping 200 days of data) [2025-10-14T19:01:57.320002] [DEBUG] [LOCAL ] FRGE: Primary data saved (16201 records). [2025-10-14T19:01:57.320142] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-14T19:01:57.320222] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FRGE took 36.1s. Estimated remaining: 3h 30m 1s. Rate: 7.1 symbols/min [2025-10-14T19:01:57.487967] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:01:57.532385] [DEBUG] [LOCAL ] FSK: Loaded 49449 existing records from primary storage. [2025-10-14T19:01:57.532724] [INFO ] [MAIN ] FSK: Loaded 49449 existing records. [2025-10-14T19:01:57.563494] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-14T19:01:57.725059] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:01:57.725280] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-14T19:01:57.725334] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-14T19:01:57.726198] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-14T19:01:57.726257] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-14T19:01:58.115479] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:01:58.137398] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T19:01:58.358043] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-14T19:01:59.024382] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T19:01:59.158066] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-14T19:01:59.958096] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-14T19:02:00.080346] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T19:02:00.580270] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T19:02:00.758117] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-14T19:02:01.309404] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T19:02:01.558069] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-14T19:02:02.358071] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-14T19:02:02.749347] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T19:02:03.028063] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T19:02:03.158136] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-14T19:02:03.393540] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T19:02:03.958130] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-14T19:02:04.150390] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T19:02:04.758074] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-14T19:02:05.558109] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-14T19:02:05.761886] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T19:02:05.953674] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T19:02:06.358074] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-14T19:02:07.064208] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T19:02:07.158072] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-14T19:02:07.590817] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T19:02:07.958076] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-14T19:02:08.762320] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-14T19:02:08.768440] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T19:02:09.257569] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T19:02:09.558081] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-14T19:02:10.079600] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T19:02:10.358085] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-14T19:02:10.861405] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T19:02:11.158073] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-14T19:02:11.958137] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-14T19:02:11.982238] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T19:02:12.259081] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T19:02:12.758057] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-14T19:02:13.558047] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-14T19:02:13.768303] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T19:02:13.774432] [INFO ] [REMOTE ] FRO: Full fetch complete (75362 records). [2025-10-14T19:02:13.774562] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-14T19:02:14.276411] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-14T19:02:14.276519] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-14T19:02:14.277628] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-14T19:02:14.277792] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-14T19:02:14.300315] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T19:02:14.308074] [DEBUG] [LOCAL ] FRO: Trimmed 75362 records to 51699 (keeping 200 days of data) [2025-10-14T19:02:14.368323] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-14T19:02:14.665179] [DEBUG] [LOCAL ] FRO: Primary data saved (51699 records). [2025-10-14T19:02:14.665333] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-14T19:02:14.665425] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRO took 45.5s. Estimated remaining: 3h 30m 8s. Rate: 7.1 symbols/min [2025-10-14T19:02:14.861636] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:02:14.911337] [DEBUG] [LOCAL ] FSLY: Loaded 51276 existing records from primary storage. [2025-10-14T19:02:14.911831] [INFO ] [MAIN ] FSLY: Loaded 51276 existing records. [2025-10-14T19:02:15.051477] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T19:02:15.101211] [INFO ] [REMOTE ] FRT: Full fetch complete (60444 records). [2025-10-14T19:02:15.122710] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-14T19:02:15.122452] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:02:15.123798] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-14T19:02:15.123900] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-14T19:02:15.176377] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-14T19:02:15.181687] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-14T19:02:15.176272] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-14T19:02:16.019463] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:02:16.020341] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-14T19:02:16.020003] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-14T19:02:16.021219] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-14T19:02:16.022921] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-14T19:02:16.023105] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-14T19:02:16.025248] [DEBUG] [LOCAL ] FRT: Trimmed 60444 records to 41743 (keeping 200 days of data) [2025-10-14T19:02:16.336230] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T19:02:16.391484] [DEBUG] [LOCAL ] FRT: Primary data saved (41743 records). [2025-10-14T19:02:16.391706] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-14T19:02:16.391838] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FRT took 32.7s. Estimated remaining: 3h 29m 48s. Rate: 7.1 symbols/min [2025-10-14T19:02:16.578259] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:02:16.627033] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-14T19:02:16.627419] [INFO ] [MAIN ] FSM: Loaded 53298 existing records. [2025-10-14T19:02:16.791434] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-14T19:02:16.812182] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:02:16.813474] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-14T19:02:16.813627] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-14T19:02:16.823106] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-14T19:02:16.828826] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-14T19:02:16.913382] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T19:02:17.220903] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:02:17.558108] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-14T19:02:17.692356] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T19:02:18.358119] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-14T19:02:18.502941] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T19:02:18.810375] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T19:02:18.819137] [INFO ] [REMOTE ] FSCO: Full fetch complete (55140 records). [2025-10-14T19:02:18.819394] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-14T19:02:19.163382] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-14T19:02:19.333934] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-14T19:02:19.334055] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-14T19:02:19.335141] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-14T19:02:19.335208] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-14T19:02:19.336952] [DEBUG] [LOCAL ] FSCO: Trimmed 55140 records to 38493 (keeping 200 days of data) [2025-10-14T19:02:19.596528] [DEBUG] [LOCAL ] FSCO: Primary data saved (38493 records). [2025-10-14T19:02:19.596756] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-14T19:02:19.596886] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSCO took 24.8s. Estimated remaining: 3h 29m 31s. Rate: 7.1 symbols/min [2025-10-14T19:02:19.817424] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:02:19.859345] [DEBUG] [LOCAL ] FSS: Loaded 33816 existing records from primary storage. [2025-10-14T19:02:19.860131] [INFO ] [MAIN ] FSS: Loaded 33816 existing records. [2025-10-14T19:02:19.966893] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-14T19:02:20.084180] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:02:20.084501] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-14T19:02:20.084673] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-14T19:02:20.086027] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-14T19:02:20.086095] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-14T19:02:20.425804] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-14T19:02:20.556348] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:02:20.596790] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:02:20.758068] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-14T19:02:21.350018] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T19:02:21.558073] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-14T19:02:22.119775] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T19:02:22.358132] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-14T19:02:22.920444] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T19:02:23.158144] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-14T19:02:23.958111] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-14T19:02:24.035165] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T19:02:24.062445] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T19:02:24.758167] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-14T19:02:25.563269] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-14T19:02:25.582444] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T19:02:26.098740] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:02:26.358107] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-14T19:02:27.158049] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-14T19:02:27.336358] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T19:02:27.958077] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-14T19:02:28.144530] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T19:02:28.172947] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T19:02:28.758088] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-14T19:02:29.551419] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T19:02:29.558067] [INFO ] [REMOTE ] FSK: Full fetch complete (71949 records). [2025-10-14T19:02:29.558151] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-14T19:02:29.558469] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-14T19:02:30.005281] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-14T19:02:30.005375] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-14T19:02:30.006626] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-14T19:02:30.006716] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-14T19:02:30.008230] [DEBUG] [LOCAL ] FSK: Trimmed 71949 records to 49496 (keeping 200 days of data) [2025-10-14T19:02:30.317855] [DEBUG] [LOCAL ] FSK: Primary data saved (49496 records). [2025-10-14T19:02:30.318031] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-14T19:02:30.318115] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSK took 33.0s. Estimated remaining: 3h 29m 27s. Rate: 7.1 symbols/min [2025-10-14T19:02:30.363384] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-14T19:02:30.499346] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:02:30.507634] [DEBUG] [LOCAL ] FT: Loaded 6748 existing records from primary storage. [2025-10-14T19:02:30.507913] [INFO ] [MAIN ] FT: Loaded 6748 existing records. [2025-10-14T19:02:30.678311] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T19:02:30.742403] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:02:30.742620] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-14T19:02:30.742703] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-14T19:02:30.743059] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-14T19:02:30.743120] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-14T19:02:31.101728] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:02:31.158089] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-14T19:02:31.345389] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T19:02:31.608853] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T19:02:31.809396] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T19:02:31.958103] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-14T19:02:32.758099] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-14T19:02:33.558104] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-14T19:02:33.828235] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T19:02:34.171408] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T19:02:34.329007] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T19:02:34.358095] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-14T19:02:34.948045] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T19:02:35.158118] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-14T19:02:35.745041] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T19:02:35.958079] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-14T19:02:36.758091] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-14T19:02:37.357509] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T19:02:37.558079] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-14T19:02:38.358296] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-14T19:02:38.358675] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T19:02:38.504668] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:02:39.158082] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-14T19:02:39.828342] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T19:02:39.958082] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-14T19:02:40.518223] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T19:02:40.758052] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-14T19:02:41.428028] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T19:02:41.558084] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-14T19:02:42.358119] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-14T19:02:42.580191] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T19:02:42.868515] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T19:02:43.158111] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-14T19:02:43.869459] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T19:02:43.958059] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-14T19:02:44.665627] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T19:02:44.758066] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-14T19:02:44.880792] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:02:45.118749] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T19:02:45.558070] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-14T19:02:46.358092] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-14T19:02:47.169331] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-14T19:02:47.175425] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T19:02:47.452356] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T19:02:47.958099] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-14T19:02:48.758110] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-14T19:02:49.155332] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T19:02:49.210627] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T19:02:49.558066] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-14T19:02:50.292950] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T19:02:50.358062] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-14T19:02:50.568767] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T19:02:51.158096] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-14T19:02:51.866811] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T19:02:51.872773] [INFO ] [REMOTE ] FSM: Full fetch complete (77045 records). [2025-10-14T19:02:51.872929] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-14T19:02:51.963353] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-14T19:02:52.273464] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-14T19:02:52.273557] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-14T19:02:52.274496] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-14T19:02:52.274559] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-14T19:02:52.276138] [DEBUG] [LOCAL ] FSM: Trimmed 77045 records to 53300 (keeping 200 days of data) [2025-10-14T19:02:52.537122] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T19:02:52.636601] [DEBUG] [LOCAL ] FSM: Primary data saved (53300 records). [2025-10-14T19:02:52.636765] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-14T19:02:52.636860] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FSM took 36.2s. Estimated remaining: 3h 29m 42s. Rate: 7.1 symbols/min [2025-10-14T19:02:52.763201] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-14T19:02:52.812940] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:02:52.827958] [DEBUG] [LOCAL ] FTHY: Loaded 12332 existing records from primary storage. [2025-10-14T19:02:52.828187] [INFO ] [MAIN ] FTHY: Loaded 12332 existing records. [2025-10-14T19:02:53.016031] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:02:53.016271] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-14T19:02:53.016326] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-14T19:02:53.016693] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-14T19:02:53.016752] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-14T19:02:53.333627] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T19:02:53.384226] [INFO ] [REMOTE ] FSS: Full fetch complete (48465 records). [2025-10-14T19:02:53.400061] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-14T19:02:53.405034] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:02:53.563200] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-14T19:02:53.642688] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T19:02:53.837456] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-14T19:02:53.837552] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-14T19:02:53.838449] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-14T19:02:53.838518] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-14T19:02:53.839930] [DEBUG] [LOCAL ] FSS: Trimmed 48465 records to 33656 (keeping 200 days of data) [2025-10-14T19:02:54.064402] [DEBUG] [LOCAL ] FSS: Primary data saved (33656 records). [2025-10-14T19:02:54.064547] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-14T19:02:54.064675] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FSS took 34.5s. Estimated remaining: 3h 29m 22s. Rate: 7.1 symbols/min [2025-10-14T19:02:54.237533] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:02:54.294325] [DEBUG] [LOCAL ] FTI: Loaded 53299 existing records from primary storage. [2025-10-14T19:02:54.294728] [INFO ] [MAIN ] FTI: Loaded 53299 existing records. [2025-10-14T19:02:54.363305] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-14T19:02:54.476004] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:02:54.476253] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-14T19:02:54.476301] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-14T19:02:54.476890] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-14T19:02:54.476947] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-14T19:02:54.832286] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:02:55.158101] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-14T19:02:55.203575] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T19:02:55.344539] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T19:02:55.691680] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-14T19:02:55.958132] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-14T19:02:56.758121] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-14T19:02:57.540800] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T19:02:57.542358] [INFO ] [REMOTE ] FT: Full fetch complete (9269 records). [2025-10-14T19:02:57.542429] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-14T19:02:57.563232] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-14T19:02:57.846347] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T19:02:57.878756] [INFO ] [REMOTE ] FSLY: Full fetch complete (75000 records). [2025-10-14T19:02:57.901465] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-14T19:02:58.000540] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-14T19:02:58.017354] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-14T19:02:58.039314] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-14T19:02:58.039452] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-14T19:02:58.040327] [DEBUG] [LOCAL ] FT: Trimmed 9269 records to 6802 (keeping 200 days of data) [2025-10-14T19:02:58.367516] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-14T19:02:58.395844] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-14T19:02:58.397902] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-14T19:02:58.400609] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-14T19:02:58.400768] [DEBUG] [LOCAL ] FT: Primary data saved (6802 records). [2025-10-14T19:02:58.400860] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-14T19:02:58.400954] [INFO ] [MAIN ] FT: Full history saved. [2025-10-14T19:02:58.401240] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FT took 28.1s. Estimated remaining: 3h 29m 6s. Rate: 7.1 symbols/min [2025-10-14T19:02:58.402569] [DEBUG] [LOCAL ] FSLY: Trimmed 75000 records to 51306 (keeping 200 days of data) [2025-10-14T19:02:58.698437] [DEBUG] [LOCAL ] FSLY: Primary data saved (51306 records). [2025-10-14T19:02:58.698581] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-14T19:02:58.698689] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FSLY took 44.0s. Estimated remaining: 3h 28m 44s. Rate: 7.1 symbols/min [2025-10-14T19:02:59.337742] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T19:02:59.350267] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-14T19:02:59.388266] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T19:02:59.958232] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-14T19:03:00.552080] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T19:03:00.758030] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-14T19:03:00.962256] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T19:03:01.367723] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:03:01.558078] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-14T19:03:02.358092] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-14T19:03:02.513237] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T19:03:03.158150] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-14T19:03:04.056399] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:03:04.067985] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-14T19:03:04.092683] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T19:03:04.758174] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-14T19:03:05.433918] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T19:03:05.558071] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-14T19:03:05.937079] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T19:03:06.097239] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T19:03:06.358129] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-14T19:03:07.158122] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-14T19:03:07.940082] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T19:03:07.958188] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-14T19:03:08.241748] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T19:03:08.524174] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T19:03:08.758091] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-14T19:03:09.558100] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-14T19:03:10.506266] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T19:03:10.509964] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T19:03:10.520678] [INFO ] [REMOTE ] FTHY: Full fetch complete (17451 records). [2025-10-14T19:03:10.521202] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-14T19:03:10.521636] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-14T19:03:10.888250] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-14T19:03:10.888322] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-14T19:03:10.888704] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-14T19:03:10.888785] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-14T19:03:10.889357] [DEBUG] [LOCAL ] FTHY: Trimmed 17451 records to 12287 (keeping 200 days of data) [2025-10-14T19:03:10.964807] [DEBUG] [LOCAL ] FTHY: Primary data saved (12287 records). [2025-10-14T19:03:10.964906] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-14T19:03:10.964979] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTHY took 18.3s. Estimated remaining: 3h 28m 42s. Rate: 7.1 symbols/min [2025-10-14T19:03:11.943669] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T19:03:11.954615] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-14T19:03:13.588885] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T19:03:13.600582] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-14T19:03:15.356989] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T19:03:15.371940] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-14T19:03:17.128345] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T19:03:17.139949] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-14T19:03:18.822861] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T19:03:18.828821] [INFO ] [REMOTE ] FTI: Full fetch complete (77300 records). [2025-10-14T19:03:18.828965] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-14T19:03:19.220868] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-14T19:03:19.220952] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-14T19:03:19.221935] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-14T19:03:19.221996] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-14T19:03:19.223412] [DEBUG] [LOCAL ] FTI: Trimmed 77300 records to 53300 (keeping 200 days of data) [2025-10-14T19:03:19.542346] [DEBUG] [LOCAL ] FTI: Primary data saved (53300 records). [2025-10-14T19:03:19.542467] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-14T19:03:19.542539] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTI took 25.5s. Estimated remaining: 3h 28m 34s. Rate: 7.1 symbols/min [2025-10-14T19:03:20.198751] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:20.240990] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:20.266010] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:20.245583] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:20.272211] [DEBUG] [LOCAL ] FTWO: Loaded 1896 existing records from primary storage. [2025-10-14T19:03:20.272615] [INFO ] [MAIN ] FTWO: Loaded 1896 existing records. [2025-10-14T19:03:20.498002] [DEBUG] [LOCAL ] FTK: Loaded 32807 existing records from primary storage. [2025-10-14T19:03:20.496580] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:20.498323] [INFO ] [MAIN ] FTK: Loaded 32807 existing records. [2025-10-14T19:03:20.499243] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-14T19:03:20.510285] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-14T19:03:20.587862] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-14T19:03:20.597210] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-14T19:03:20.663433] [DEBUG] [LOCAL ] FTS: Loaded 42510 existing records from primary storage. [2025-10-14T19:03:20.726870] [DEBUG] [LOCAL ] FTV: Loaded 53035 existing records from primary storage. [2025-10-14T19:03:20.725045] [INFO ] [MAIN ] FTS: Loaded 42510 existing records. [2025-10-14T19:03:20.781566] [INFO ] [MAIN ] FTV: Loaded 53035 existing records. [2025-10-14T19:03:20.896413] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:21.025178] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-14T19:03:21.097929] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-14T19:03:21.183370] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-14T19:03:21.300810] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-14T19:03:21.567051] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:21.533306] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:21.630703] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-14T19:03:21.668452] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:21.674464] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-14T19:03:21.662394] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-14T19:03:21.695323] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-14T19:03:21.695791] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-14T19:03:21.695406] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-14T19:03:21.724752] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-14T19:03:21.751084] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-14T19:03:21.791431] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-14T19:03:22.234054] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:22.265324] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-14T19:03:22.491235] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T19:03:22.524162] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-14T19:03:22.711850] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:22.716723] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:22.717023] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-14T19:03:22.717251] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-14T19:03:23.162902] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T19:03:23.164467] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-14T19:03:23.491860] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T19:03:23.496793] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-14T19:03:23.624216] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T19:03:23.625445] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-14T19:03:23.965223] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T19:03:23.973338] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-14T19:03:24.190671] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T19:03:24.191845] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-14T19:03:24.235600] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T19:03:24.246288] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-14T19:03:24.517021] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-14T19:03:24.518131] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-14T19:03:24.571723] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T19:03:24.577169] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-14T19:03:24.783831] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-14T19:03:24.784813] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-14T19:03:25.106051] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T19:03:25.138640] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T19:03:25.231472] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T19:03:25.481146] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:03:25.558044] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-14T19:03:25.871904] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-14T19:03:26.358119] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-14T19:03:27.158066] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-14T19:03:27.690053] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T19:03:27.958082] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-14T19:03:28.660114] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T19:03:28.687600] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T19:03:28.758093] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-14T19:03:29.558090] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-14T19:03:30.260708] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T19:03:30.358051] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-14T19:03:30.804699] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T19:03:31.158077] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-14T19:03:31.625364] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-14T19:03:31.934347] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T19:03:31.958079] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-14T19:03:32.758075] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-14T19:03:33.558059] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-14T19:03:33.670295] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T19:03:33.720734] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T19:03:33.955799] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-14T19:03:33.956779] [INFO ] [REMOTE ] FTWO: Full fetch complete (3319 records). [2025-10-14T19:03:33.956850] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-14T19:03:34.339951] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-14T19:03:34.340033] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-14T19:03:34.340149] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-14T19:03:34.340187] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-14T19:03:34.340511] [DEBUG] [LOCAL ] FTWO: Trimmed 3319 records to 1904 (keeping 200 days of data) [2025-10-14T19:03:34.352416] [DEBUG] [LOCAL ] FTWO: Primary data saved (1904 records). [2025-10-14T19:03:34.352484] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-14T19:03:34.352552] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 14.8s. Estimated remaining: 3h 28m 37s. Rate: 7.1 symbols/min [2025-10-14T19:03:34.363258] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-14T19:03:34.533233] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:34.587567] [DEBUG] [LOCAL ] FUBO: Loaded 53715 existing records from primary storage. [2025-10-14T19:03:34.587996] [INFO ] [MAIN ] FUBO: Loaded 53715 existing records. [2025-10-14T19:03:34.795223] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:34.795428] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-14T19:03:34.795476] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-14T19:03:34.795963] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-14T19:03:34.796022] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-14T19:03:35.165204] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-14T19:03:35.172858] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:35.811610] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T19:03:35.958085] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-14T19:03:36.758047] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-14T19:03:36.928588] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T19:03:37.558115] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-14T19:03:38.236068] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-14T19:03:38.358030] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-14T19:03:38.448469] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T19:03:39.051442] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T19:03:39.158069] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-14T19:03:39.958102] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-14T19:03:40.502096] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-14T19:03:40.562411] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T19:03:40.758091] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-14T19:03:41.558045] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-14T19:03:41.662890] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T19:03:42.358066] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-14T19:03:42.907703] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T19:03:42.948441] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-14T19:03:43.158060] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-14T19:03:43.958067] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-14T19:03:44.117479] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T19:03:44.758127] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-14T19:03:44.938918] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T19:03:45.416955] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T19:03:45.558083] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-14T19:03:46.365057] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-14T19:03:46.368295] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T19:03:47.158048] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-14T19:03:47.346832] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T19:03:47.846726] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T19:03:47.958069] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-14T19:03:48.625898] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T19:03:48.758080] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-14T19:03:49.558098] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-14T19:03:50.196306] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-14T19:03:50.264862] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:03:50.358049] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-14T19:03:51.074630] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T19:03:51.158101] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-14T19:03:51.958067] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-14T19:03:52.186584] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T19:03:52.295087] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T19:03:52.300431] [INFO ] [REMOTE ] FTS: Full fetch complete (60423 records). [2025-10-14T19:03:52.300598] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-14T19:03:52.682753] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-14T19:03:52.682838] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-14T19:03:52.683689] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-14T19:03:52.683754] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-14T19:03:52.685338] [DEBUG] [LOCAL ] FTS: Trimmed 60423 records to 42555 (keeping 200 days of data) [2025-10-14T19:03:52.772457] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-14T19:03:52.945864] [DEBUG] [LOCAL ] FTS: Primary data saved (42555 records). [2025-10-14T19:03:52.945994] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-14T19:03:52.946072] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTS took 33.4s. Estimated remaining: 3h 28m 45s. Rate: 7.1 symbols/min [2025-10-14T19:03:53.121558] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:53.153583] [DEBUG] [LOCAL ] FUL: Loaded 32704 existing records from primary storage. [2025-10-14T19:03:53.153895] [INFO ] [MAIN ] FUL: Loaded 32704 existing records. [2025-10-14T19:03:53.355347] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:53.363229] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-14T19:03:53.363381] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-14T19:03:53.363992] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-14T19:03:53.364053] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-14T19:03:53.365084] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T19:03:53.568281] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-14T19:03:53.727622] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:54.358095] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-14T19:03:55.083034] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-14T19:03:55.112738] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T19:03:55.119141] [INFO ] [REMOTE ] FTV: Full fetch complete (76601 records). [2025-10-14T19:03:55.119288] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-14T19:03:55.163415] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-14T19:03:55.517614] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-14T19:03:55.517812] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-14T19:03:55.518906] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-14T19:03:55.518982] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-14T19:03:55.538947] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T19:03:55.538037] [DEBUG] [LOCAL ] FTV: Trimmed 76601 records to 53038 (keeping 200 days of data) [2025-10-14T19:03:55.867236] [DEBUG] [LOCAL ] FTV: Primary data saved (53038 records). [2025-10-14T19:03:55.867378] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-14T19:03:55.867456] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 36.3s. Estimated remaining: 3h 28m 28s. Rate: 7.1 symbols/min [2025-10-14T19:03:55.964957] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-14T19:03:56.038767] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:56.091607] [DEBUG] [LOCAL ] FUN: Loaded 51875 existing records from primary storage. [2025-10-14T19:03:56.091962] [INFO ] [MAIN ] FUN: Loaded 51875 existing records. [2025-10-14T19:03:56.277677] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:56.278152] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-14T19:03:56.278237] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-14T19:03:56.278784] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-14T19:03:56.278897] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-14T19:03:56.404422] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T19:03:56.669444] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:56.758083] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-14T19:03:57.558077] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-14T19:03:58.124702] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T19:03:58.246729] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-14T19:03:58.358051] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-14T19:03:58.478929] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T19:03:58.484316] [INFO ] [REMOTE ] FTK: Full fetch complete (44186 records). [2025-10-14T19:03:58.484526] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-14T19:03:58.952461] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-14T19:03:58.952577] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-14T19:03:58.954163] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-14T19:03:58.954238] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-14T19:03:58.955724] [DEBUG] [LOCAL ] FTK: Trimmed 44186 records to 32864 (keeping 200 days of data) [2025-10-14T19:03:59.153166] [DEBUG] [LOCAL ] FTK: Primary data saved (32864 records). [2025-10-14T19:03:59.153309] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-14T19:03:59.153388] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FTK took 39.6s. Estimated remaining: 3h 28m 11s. Rate: 7.1 symbols/min [2025-10-14T19:03:59.164920] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-14T19:03:59.325790] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:03:59.348898] [DEBUG] [LOCAL ] FVR: Loaded 21321 existing records from primary storage. [2025-10-14T19:03:59.349143] [INFO ] [MAIN ] FVR: Loaded 21321 existing records. [2025-10-14T19:03:59.530434] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:03:59.530669] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-14T19:03:59.530729] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-14T19:03:59.531020] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-14T19:03:59.531076] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-14T19:03:59.891008] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:03:59.958084] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-14T19:04:00.053888] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T19:04:00.603999] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T19:04:00.758079] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-14T19:04:01.558064] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-14T19:04:01.635143] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T19:04:01.863393] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T19:04:02.358103] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-14T19:04:02.584136] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T19:04:03.158089] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-14T19:04:03.700913] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:04:03.958067] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-14T19:04:04.620624] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T19:04:04.758079] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-14T19:04:04.938213] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:04:05.558076] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-14T19:04:06.358054] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-14T19:04:06.437948] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T19:04:06.608416] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T19:04:06.614412] [INFO ] [REMOTE ] FUBO: Full fetch complete (77858 records). [2025-10-14T19:04:06.614546] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-14T19:04:07.032717] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-14T19:04:07.032843] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-14T19:04:07.034003] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-14T19:04:07.034064] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-14T19:04:07.035700] [DEBUG] [LOCAL ] FUBO: Trimmed 77858 records to 53718 (keeping 200 days of data) [2025-10-14T19:04:07.195001] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-14T19:04:07.357478] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-14T19:04:07.357675] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-14T19:04:07.357803] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FUBO took 33.0s. Estimated remaining: 3h 28m 2s. Rate: 7.1 symbols/min [2025-10-14T19:04:07.563260] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:04:07.601198] [DEBUG] [LOCAL ] FVRR: Loaded 40494 existing records from primary storage. [2025-10-14T19:04:07.601461] [INFO ] [MAIN ] FVRR: Loaded 40494 existing records. [2025-10-14T19:04:07.717144] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T19:04:07.802539] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:04:07.802725] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-14T19:04:07.802778] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-14T19:04:07.803182] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-14T19:04:07.803240] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-14T19:04:07.958240] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-14T19:04:08.173062] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:04:08.174075] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T19:04:08.758095] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-14T19:04:09.316961] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T19:04:09.413014] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T19:04:09.558060] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-14T19:04:10.358052] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-14T19:04:10.674583] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T19:04:11.158100] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-14T19:04:11.694390] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T19:04:11.958074] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-14T19:04:12.229400] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T19:04:12.758108] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-14T19:04:13.554686] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T19:04:13.564134] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-14T19:04:13.800379] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T19:04:14.358049] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-14T19:04:14.932740] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T19:04:15.158106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-14T19:04:15.381008] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T19:04:15.958079] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-14T19:04:16.758062] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-14T19:04:16.917209] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T19:04:17.500428] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T19:04:17.563161] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-14T19:04:17.580469] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T19:04:18.358106] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-14T19:04:18.796167] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T19:04:19.074006] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T19:04:19.158094] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-14T19:04:19.950724] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T19:04:19.958017] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-14T19:04:20.758071] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-14T19:04:20.879395] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T19:04:20.881861] [INFO ] [REMOTE ] FVR: Full fetch complete (29550 records). [2025-10-14T19:04:20.881959] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-14T19:04:21.257207] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-14T19:04:21.257286] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-14T19:04:21.257957] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-14T19:04:21.258018] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-14T19:04:21.258885] [DEBUG] [LOCAL ] FVR: Trimmed 29550 records to 21188 (keeping 200 days of data) [2025-10-14T19:04:21.387166] [DEBUG] [LOCAL ] FVR: Primary data saved (21188 records). [2025-10-14T19:04:21.387291] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-14T19:04:21.387364] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FVR took 22.2s. Estimated remaining: 3h 28m 3s. Rate: 7.1 symbols/min [2025-10-14T19:04:21.554673] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:04:21.558244] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-14T19:04:21.558336] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-14T19:04:21.559296] [INFO ] [MAIN ] FXED: Loaded 1252 existing records. [2025-10-14T19:04:21.739425] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:04:21.739693] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-14T19:04:21.739751] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-14T19:04:21.739894] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-14T19:04:21.739934] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-14T19:04:22.124154] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:04:22.145936] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T19:04:22.358090] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-14T19:04:22.639441] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-14T19:04:22.976587] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T19:04:23.158088] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-14T19:04:23.588455] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T19:04:23.958085] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-14T19:04:24.758092] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-14T19:04:25.522133] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T19:04:25.558030] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-14T19:04:26.179542] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T19:04:26.358059] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-14T19:04:26.970849] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T19:04:27.158107] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-14T19:04:27.481076] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-14T19:04:27.827704] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T19:04:27.831474] [INFO ] [REMOTE ] FUL: Full fetch complete (47819 records). [2025-10-14T19:04:27.831556] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-14T19:04:27.963314] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-14T19:04:28.238360] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-14T19:04:28.238465] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-14T19:04:28.239220] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-14T19:04:28.239283] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-14T19:04:28.240358] [DEBUG] [LOCAL ] FUL: Trimmed 47819 records to 32507 (keeping 200 days of data) [2025-10-14T19:04:28.433534] [DEBUG] [LOCAL ] FUL: Primary data saved (32507 records). [2025-10-14T19:04:28.433682] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-14T19:04:28.433774] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FUL took 35.5s. Estimated remaining: 3h 27m 52s. Rate: 7.1 symbols/min [2025-10-14T19:04:28.599580] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:04:28.640718] [DEBUG] [LOCAL ] G: Loaded 50010 existing records from primary storage. [2025-10-14T19:04:28.641014] [INFO ] [MAIN ] G: Loaded 50010 existing records. [2025-10-14T19:04:28.763204] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-14T19:04:28.817408] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:04:28.817556] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-14T19:04:28.817625] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-14T19:04:28.818751] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-14T19:04:28.818810] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-14T19:04:29.118023] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-14T19:04:29.190051] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:04:29.452182] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:04:29.558049] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-14T19:04:30.358084] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-14T19:04:30.948946] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T19:04:31.158073] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-14T19:04:31.640078] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-14T19:04:31.958056] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-14T19:04:32.758084] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-14T19:04:32.895904] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:04:33.349812] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T19:04:33.558072] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-14T19:04:33.970883] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T19:04:34.358070] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-14T19:04:35.114778] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:04:35.158034] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-14T19:04:35.958106] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-14T19:04:36.123189] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T19:04:36.375805] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T19:04:36.440988] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-14T19:04:36.758054] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-14T19:04:37.558100] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-14T19:04:38.212525] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T19:04:38.218402] [INFO ] [REMOTE ] FUN: Full fetch complete (73271 records). [2025-10-14T19:04:38.218527] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-14T19:04:38.363202] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-14T19:04:38.618811] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-14T19:04:38.618898] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-14T19:04:38.619833] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-14T19:04:38.619900] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-14T19:04:38.621330] [DEBUG] [LOCAL ] FUN: Trimmed 73271 records to 51869 (keeping 200 days of data) [2025-10-14T19:04:38.709127] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T19:04:38.880832] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T19:04:38.961451] [DEBUG] [LOCAL ] FUN: Primary data saved (51869 records). [2025-10-14T19:04:38.961579] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-14T19:04:38.961673] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FUN took 43.1s. Estimated remaining: 3h 27m 47s. Rate: 7.1 symbols/min [2025-10-14T19:04:39.132486] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:04:39.157771] [DEBUG] [LOCAL ] GAB: Loaded 27677 existing records from primary storage. [2025-10-14T19:04:39.158142] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-14T19:04:39.158081] [INFO ] [MAIN ] GAB: Loaded 27677 existing records. [2025-10-14T19:04:39.338031] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:04:39.338249] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-14T19:04:39.338295] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-14T19:04:39.338854] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-14T19:04:39.338916] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-14T19:04:39.690983] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:04:39.958035] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-14T19:04:40.758049] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-14T19:04:40.829118] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T19:04:40.997439] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T19:04:41.558038] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-14T19:04:41.901277] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-14T19:04:42.293269] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T19:04:42.358121] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-14T19:04:42.792014] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T19:04:43.158068] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-14T19:04:43.571532] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-14T19:04:43.958062] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-14T19:04:44.758066] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-14T19:04:45.191501] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T19:04:45.191399] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:04:45.558060] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-14T19:04:46.010637] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T19:04:46.011387] [INFO ] [REMOTE ] FXED: Full fetch complete (1806 records). [2025-10-14T19:04:46.011453] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-14T19:04:46.362700] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-14T19:04:46.367372] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-14T19:04:46.368302] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-14T19:04:46.368423] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-14T19:04:46.368464] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-14T19:04:46.368822] [DEBUG] [LOCAL ] FXED: Trimmed 1806 records to 1253 (keeping 200 days of data) [2025-10-14T19:04:46.376887] [DEBUG] [LOCAL ] FXED: Primary data saved (1253 records). [2025-10-14T19:04:46.376952] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-14T19:04:46.377022] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FXED took 25.0s. Estimated remaining: 3h 27m 37s. Rate: 7.1 symbols/min [2025-10-14T19:04:46.546316] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:04:46.553176] [DEBUG] [LOCAL ] GAM: Loaded 3987 existing records from primary storage. [2025-10-14T19:04:46.553361] [INFO ] [MAIN ] GAM: Loaded 3987 existing records. [2025-10-14T19:04:46.727466] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:04:46.727718] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-14T19:04:46.727772] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-14T19:04:46.727979] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-14T19:04:46.728035] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-14T19:04:47.081013] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:04:47.158048] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-14T19:04:47.755795] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T19:04:47.820695] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:04:47.825482] [INFO ] [REMOTE ] FVRR: Full fetch complete (59355 records). [2025-10-14T19:04:47.825572] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-14T19:04:47.963177] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-14T19:04:48.216061] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-14T19:04:48.216146] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-14T19:04:48.216975] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-14T19:04:48.217036] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-14T19:04:48.218141] [DEBUG] [LOCAL ] FVRR: Trimmed 59355 records to 40624 (keeping 200 days of data) [2025-10-14T19:04:48.448139] [DEBUG] [LOCAL ] FVRR: Primary data saved (40624 records). [2025-10-14T19:04:48.448317] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-14T19:04:48.448396] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. FVRR took 41.1s. Estimated remaining: 3h 27m 18s. Rate: 7.1 symbols/min [2025-10-14T19:04:48.615502] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:04:48.664908] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-14T19:04:48.665213] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-14T19:04:48.767488] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-14T19:04:48.853153] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:04:48.853554] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-14T19:04:48.853681] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-14T19:04:48.867100] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-14T19:04:48.867038] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T19:04:48.867221] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-14T19:04:49.221698] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:04:49.412088] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T19:04:49.558043] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-14T19:04:50.358063] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-14T19:04:50.869990] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T19:04:50.871255] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T19:04:51.158071] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-14T19:04:51.958081] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-14T19:04:52.594139] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T19:04:52.606573] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T19:04:52.758089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-14T19:04:53.558061] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-14T19:04:54.357485] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T19:04:54.361159] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-14T19:04:54.386489] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T19:04:55.158073] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-14T19:04:55.647441] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T19:04:55.958094] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-14T19:04:56.522509] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T19:04:56.694790] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T19:04:56.758041] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-14T19:04:57.558084] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-14T19:04:58.277710] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T19:04:58.358096] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-14T19:04:58.866434] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T19:04:59.158069] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-14T19:04:59.958079] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-14T19:05:00.096001] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T19:05:00.702322] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T19:05:00.758026] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-14T19:05:00.855042] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T19:05:01.558066] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-14T19:05:02.220603] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T19:05:02.358052] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-14T19:05:02.919205] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T19:05:03.158060] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-14T19:05:03.799892] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-14T19:05:03.958046] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-14T19:05:04.184161] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T19:05:04.758089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-14T19:05:05.558089] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-14T19:05:05.605997] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T19:05:06.077691] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T19:05:06.212806] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T19:05:06.358142] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-14T19:05:06.981265] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T19:05:07.158082] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-14T19:05:07.692082] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-14T19:05:07.958137] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-14T19:05:08.758039] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-14T19:05:09.066917] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T19:05:09.558063] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-14T19:05:10.064598] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T19:05:10.065618] [INFO ] [REMOTE ] GAM: Full fetch complete (6570 records). [2025-10-14T19:05:10.065725] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-14T19:05:10.358093] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-14T19:05:10.444876] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-14T19:05:10.444993] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-14T19:05:10.445337] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-14T19:05:10.445432] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-14T19:05:10.446220] [DEBUG] [LOCAL ] GAM: Trimmed 6570 records to 3927 (keeping 200 days of data) [2025-10-14T19:05:10.471119] [DEBUG] [LOCAL ] GAM: Primary data saved (3927 records). [2025-10-14T19:05:10.471307] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-14T19:05:10.471485] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAM took 24.1s. Estimated remaining: 3h 27m 32s. Rate: 7.1 symbols/min [2025-10-14T19:05:10.659007] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T19:05:10.679613] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:10.712433] [DEBUG] [LOCAL ] GATX: Loaded 18135 existing records from primary storage. [2025-10-14T19:05:10.712724] [INFO ] [MAIN ] GATX: Loaded 18135 existing records. [2025-10-14T19:05:10.887310] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:05:10.887526] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-14T19:05:10.887596] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-14T19:05:10.887959] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-14T19:05:10.888033] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-14T19:05:11.164024] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-14T19:05:11.247792] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:11.724488] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T19:05:11.958080] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-14T19:05:12.558445] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T19:05:12.758064] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-14T19:05:12.898087] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T19:05:13.558094] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-14T19:05:14.196562] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T19:05:14.202495] [INFO ] [REMOTE ] G: Full fetch complete (71980 records). [2025-10-14T19:05:14.202676] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-14T19:05:14.360639] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-14T19:05:14.623503] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-14T19:05:14.623579] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-14T19:05:14.624522] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-14T19:05:14.624585] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-14T19:05:14.626065] [DEBUG] [LOCAL ] G: Trimmed 71980 records to 50036 (keeping 200 days of data) [2025-10-14T19:05:14.926584] [DEBUG] [LOCAL ] G: Primary data saved (50036 records). [2025-10-14T19:05:14.926733] [INFO ] [MAIN ] G: Full history saved. [2025-10-14T19:05:14.926816] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. G took 46.5s. Estimated remaining: 3h 27m 17s. Rate: 7.1 symbols/min [2025-10-14T19:05:15.099396] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:15.113362] [DEBUG] [LOCAL ] GBAB: Loaded 13018 existing records from primary storage. [2025-10-14T19:05:15.113587] [INFO ] [MAIN ] GBAB: Loaded 13018 existing records. [2025-10-14T19:05:15.172069] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-14T19:05:15.302090] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:05:15.302401] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-14T19:05:15.302452] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-14T19:05:15.302700] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-14T19:05:15.302758] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-14T19:05:15.665014] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:15.697159] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-14T19:05:15.788256] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T19:05:15.791840] [INFO ] [REMOTE ] GAB: Full fetch complete (39385 records). [2025-10-14T19:05:15.791932] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-14T19:05:15.963770] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-14T19:05:16.090833] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T19:05:16.240168] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-14T19:05:16.240248] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-14T19:05:16.240956] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-14T19:05:16.241018] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-14T19:05:16.242072] [DEBUG] [LOCAL ] GAB: Trimmed 39385 records to 27719 (keeping 200 days of data) [2025-10-14T19:05:16.402346] [DEBUG] [LOCAL ] GAB: Primary data saved (27719 records). [2025-10-14T19:05:16.402480] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-14T19:05:16.402560] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GAB took 37.4s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-14T19:05:16.577146] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:16.614793] [DEBUG] [LOCAL ] GBCI: Loaded 40690 existing records from primary storage. [2025-10-14T19:05:16.615085] [INFO ] [MAIN ] GBCI: Loaded 40690 existing records. [2025-10-14T19:05:16.760915] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-14T19:05:16.800329] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:05:16.800731] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-14T19:05:16.800799] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-14T19:05:16.801126] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-14T19:05:16.801166] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-14T19:05:17.159702] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:17.173351] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T19:05:17.558060] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-14T19:05:17.709443] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T19:05:18.358069] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-14T19:05:19.148696] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T19:05:19.162736] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-14T19:05:19.166857] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T19:05:19.958088] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-14T19:05:20.582686] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T19:05:20.758115] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-14T19:05:21.558043] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-14T19:05:21.591684] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T19:05:21.741297] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T19:05:22.358044] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-14T19:05:22.604237] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T19:05:23.158089] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-14T19:05:23.958051] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-14T19:05:24.031456] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T19:05:24.297585] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-14T19:05:24.758070] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-14T19:05:25.335603] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:05:25.352208] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T19:05:25.558039] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-14T19:05:26.322242] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T19:05:26.358063] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-14T19:05:27.158106] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-14T19:05:27.958056] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-14T19:05:28.254809] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T19:05:28.282520] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T19:05:28.758055] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-14T19:05:29.480362] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T19:05:29.558035] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-14T19:05:29.759788] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T19:05:30.252819] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T19:05:30.358060] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-14T19:05:31.158075] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-14T19:05:31.958042] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-14T19:05:32.255079] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T19:05:32.261743] [INFO ] [REMOTE ] GAP: Full fetch complete (77802 records). [2025-10-14T19:05:32.261875] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-14T19:05:32.682099] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-14T19:05:32.682316] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-14T19:05:32.683406] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-14T19:05:32.683495] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-14T19:05:32.711665] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T19:05:32.721295] [DEBUG] [LOCAL ] GAP: Trimmed 77802 records to 53653 (keeping 200 days of data) [2025-10-14T19:05:32.738033] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T19:05:32.793527] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-14T19:05:33.072023] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-14T19:05:33.072165] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-14T19:05:33.072247] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GAP took 44.6s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-14T19:05:33.238764] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:33.238938] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-14T19:05:33.238976] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-14T19:05:33.239085] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-14T19:05:33.239128] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-14T19:05:33.239169] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-14T19:05:33.239202] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-14T19:05:33.565172] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-14T19:05:33.589457] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:33.848372] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T19:05:34.358083] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-14T19:05:34.639898] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T19:05:34.780471] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-14T19:05:35.158064] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-14T19:05:35.958052] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-14T19:05:36.294086] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-14T19:05:36.575200] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T19:05:36.758077] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-14T19:05:37.558063] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-14T19:05:37.775002] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T19:05:38.358080] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-14T19:05:38.602901] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-14T19:05:38.805549] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T19:05:39.158077] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-14T19:05:39.958058] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-14T19:05:39.969781] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T19:05:40.307928] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-14T19:05:40.758064] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-14T19:05:41.181505] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-14T19:05:41.558081] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-14T19:05:42.331608] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T19:05:42.358028] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-14T19:05:43.158146] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-14T19:05:43.165235] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T19:05:43.168229] [INFO ] [REMOTE ] GBAB: Full fetch complete (19078 records). [2025-10-14T19:05:43.168374] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-14T19:05:43.581091] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-14T19:05:43.581188] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-14T19:05:43.581762] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-14T19:05:43.581825] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-14T19:05:43.582624] [DEBUG] [LOCAL ] GBAB: Trimmed 19078 records to 12962 (keeping 200 days of data) [2025-10-14T19:05:43.679490] [DEBUG] [LOCAL ] GBAB: Primary data saved (12962 records). [2025-10-14T19:05:43.679637] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-14T19:05:43.679764] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBAB took 28.8s. Estimated remaining: 3h 26m 58s. Rate: 7.1 symbols/min [2025-10-14T19:05:43.848138] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:43.885597] [DEBUG] [LOCAL ] GBTG: Loaded 40089 existing records from primary storage. [2025-10-14T19:05:43.885935] [INFO ] [MAIN ] GBTG: Loaded 40089 existing records. [2025-10-14T19:05:43.963213] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-14T19:05:44.068279] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:05:44.068505] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-14T19:05:44.068605] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-14T19:05:44.069160] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-14T19:05:44.069232] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-14T19:05:44.412540] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T19:05:44.438154] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:44.736423] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T19:05:44.758030] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-14T19:05:45.558094] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-14T19:05:45.818173] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-14T19:05:46.223899] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T19:05:46.358059] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-14T19:05:47.158108] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-14T19:05:47.520871] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T19:05:47.827999] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T19:05:47.958065] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-14T19:05:48.758068] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-14T19:05:49.311812] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T19:05:49.317430] [INFO ] [REMOTE ] GBCI: Full fetch complete (58824 records). [2025-10-14T19:05:49.317603] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-14T19:05:49.569190] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-14T19:05:49.721790] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-14T19:05:49.721884] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-14T19:05:49.722733] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-14T19:05:49.722803] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-14T19:05:49.724094] [DEBUG] [LOCAL ] GBCI: Trimmed 58824 records to 40713 (keeping 200 days of data) [2025-10-14T19:05:49.818618] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:05:49.826192] [INFO ] [REMOTE ] GATX: Full fetch complete (24910 records). [2025-10-14T19:05:49.836056] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-14T19:05:50.227103] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-14T19:05:50.227817] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-14T19:05:50.228920] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-14T19:05:50.229245] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-14T19:05:50.232553] [DEBUG] [LOCAL ] GATX: Trimmed 24910 records to 18097 (keeping 200 days of data) [2025-10-14T19:05:50.372741] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-14T19:05:50.465067] [DEBUG] [LOCAL ] GATX: Primary data saved (18097 records). [2025-10-14T19:05:50.467499] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-14T19:05:50.467926] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GATX took 40.0s. Estimated remaining: 3h 26m 47s. Rate: 7.1 symbols/min [2025-10-14T19:05:50.593183] [DEBUG] [LOCAL ] GBCI: Primary data saved (40713 records). [2025-10-14T19:05:50.593780] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-14T19:05:50.599255] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBCI took 34.2s. Estimated remaining: 3h 26m 25s. Rate: 7.1 symbols/min [2025-10-14T19:05:50.794589] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:50.913155] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T19:05:50.955378] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:50.999789] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T19:05:51.025601] [DEBUG] [LOCAL ] GBX: Loaded 29077 existing records from primary storage. [2025-10-14T19:05:51.026081] [INFO ] [MAIN ] GBX: Loaded 29077 existing records. [2025-10-14T19:05:51.160253] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-14T19:05:51.266981] [DEBUG] [LOCAL ] GCI: Loaded 43935 existing records from primary storage. [2025-10-14T19:05:51.297062] [INFO ] [MAIN ] GCI: Loaded 43935 existing records. [2025-10-14T19:05:51.396492] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:05:51.441125] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-14T19:05:51.459585] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-14T19:05:51.492287] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-14T19:05:51.509171] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-14T19:05:51.754898] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:05:51.797695] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-14T19:05:51.815561] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-14T19:05:51.836902] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-14T19:05:51.890419] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-14T19:05:51.963804] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-14T19:05:52.220337] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:52.407490] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:05:52.417126] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T19:05:52.470458] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T19:05:52.758066] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-14T19:05:53.558083] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-14T19:05:53.828289] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T19:05:54.358075] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-14T19:05:54.657321] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T19:05:55.158074] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-14T19:05:55.776592] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T19:05:55.958079] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-14T19:05:56.737404] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:05:56.758027] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-14T19:05:56.950577] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T19:05:57.090200] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-14T19:05:57.558098] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-14T19:05:58.358077] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-14T19:05:59.067816] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T19:05:59.158084] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-14T19:05:59.295339] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T19:05:59.544055] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T19:05:59.544740] [INFO ] [REMOTE ] GBLI: Full fetch complete (1287 records). [2025-10-14T19:05:59.544806] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-14T19:05:59.735914] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-14T19:05:59.736064] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:05:59.736131] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:05:59.736218] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-14T19:05:59.736280] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-14T19:05:59.736318] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-14T19:05:59.736357] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-14T19:05:59.736413] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBLI took 26.7s. Estimated remaining: 3h 26m 17s. Rate: 7.1 symbols/min [2025-10-14T19:05:59.906240] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:05:59.906432] [DEBUG] [LOCAL ] GCO: No existing data file found in primary storage. [2025-10-14T19:05:59.906471] [WARN ] [MAIN ] GCO: No existing data found, performing full refresh instead. [2025-10-14T19:05:59.906580] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-14T19:05:59.906620] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-14T19:05:59.906698] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-14T19:05:59.906743] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-14T19:05:59.965252] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-14T19:06:00.283310] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:00.758104] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-14T19:06:01.482892] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T19:06:01.558046] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-14T19:06:01.740416] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:06:02.358130] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-14T19:06:03.054248] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T19:06:03.119471] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T19:06:03.158037] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-14T19:06:03.958083] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-14T19:06:04.335536] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T19:06:04.758102] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-14T19:06:04.875411] [DEBUG] [REMOTE ] GCO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-14T19:06:04.876010] [WARN ] [REMOTE ] GCO: No data returned for month 2025-01 [2025-10-14T19:06:04.876095] [FATAL] [REMOTE ] GCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:06:04.876186] [FATAL] [MAIN ] GCO: Failed to fetch primary data. [2025-10-14T19:06:04.876252] [WARN ] [MAIN ] GCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:06:04.876321] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-14T19:06:04.876397] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-14T19:06:04.876452] [INFO ] [LOCAL ] GCO: Starting deletion of derivative data. [2025-10-14T19:06:04.876495] [DEBUG] [LOCAL ] GCO: No derivative data file found to delete. [2025-10-14T19:06:04.876542] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GCO took 5.1s. Estimated remaining: 3h 26m 4s. Rate: 7.1 symbols/min [2025-10-14T19:06:05.045289] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:05.064406] [DEBUG] [LOCAL ] GCTS: Loaded 20410 existing records from primary storage. [2025-10-14T19:06:05.064623] [INFO ] [MAIN ] GCTS: Loaded 20410 existing records. [2025-10-14T19:06:05.251172] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:06:05.251499] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-14T19:06:05.251559] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-14T19:06:05.252116] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-14T19:06:05.252176] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-14T19:06:05.567756] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-14T19:06:05.608045] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:06.358101] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-14T19:06:06.991727] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T19:06:07.158133] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-14T19:06:07.190702] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T19:06:07.958078] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-14T19:06:08.671081] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:06:08.692483] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T19:06:08.758046] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-14T19:06:09.242690] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (5.28 seconds). [2025-10-14T19:06:09.558068] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-14T19:06:09.748105] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T19:06:10.358096] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-14T19:06:10.907160] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T19:06:11.158063] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-14T19:06:11.761920] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:06:11.958066] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-14T19:06:12.483039] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T19:06:12.758067] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-14T19:06:13.265529] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T19:06:13.270034] [INFO ] [REMOTE ] GBTG: Full fetch complete (56570 records). [2025-10-14T19:06:13.270132] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-14T19:06:13.561931] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-14T19:06:13.654475] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-14T19:06:13.654551] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-14T19:06:13.655343] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-14T19:06:13.655403] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-14T19:06:13.656499] [DEBUG] [LOCAL ] GBTG: Trimmed 56570 records to 40171 (keeping 200 days of data) [2025-10-14T19:06:13.876624] [DEBUG] [LOCAL ] GBTG: Primary data saved (40171 records). [2025-10-14T19:06:13.876831] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-14T19:06:13.876921] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GBTG took 30.2s. Estimated remaining: 3h 25m 56s. Rate: 7.1 symbols/min [2025-10-14T19:06:14.046053] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:14.054356] [DEBUG] [LOCAL ] GCV: Loaded 7706 existing records from primary storage. [2025-10-14T19:06:14.054533] [INFO ] [MAIN ] GCV: Loaded 7706 existing records. [2025-10-14T19:06:14.230276] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:06:14.230485] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-14T19:06:14.230531] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-14T19:06:14.230777] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-14T19:06:14.230835] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-14T19:06:14.362567] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-14T19:06:14.637495] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:14.645711] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T19:06:14.679454] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T19:06:15.158061] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-14T19:06:15.809269] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T19:06:15.958060] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-14T19:06:15.984454] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T19:06:16.440870] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T19:06:16.758104] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-14T19:06:17.558071] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-14T19:06:17.914291] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T19:06:18.226541] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T19:06:18.358105] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-14T19:06:19.158110] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-14T19:06:19.419837] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T19:06:19.958085] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-14T19:06:20.189039] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T19:06:20.758117] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-14T19:06:21.326555] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T19:06:21.558041] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-14T19:06:21.647732] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T19:06:22.358046] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-14T19:06:22.750247] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T19:06:23.158097] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-14T19:06:23.588182] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T19:06:23.618096] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T19:06:23.958063] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-14T19:06:24.758047] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-14T19:06:25.272805] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T19:06:25.558063] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-14T19:06:26.097768] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T19:06:26.270999] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T19:06:26.358094] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-14T19:06:27.091065] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T19:06:27.158140] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-14T19:06:27.958071] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-14T19:06:28.236599] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T19:06:28.758080] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-14T19:06:28.776990] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T19:06:29.558066] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-14T19:06:29.826878] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T19:06:29.830495] [INFO ] [REMOTE ] GBX: Full fetch complete (42827 records). [2025-10-14T19:06:29.830677] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-14T19:06:30.219263] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-14T19:06:30.219386] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-14T19:06:30.220261] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-14T19:06:30.220422] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-14T19:06:30.221417] [DEBUG] [LOCAL ] GBX: Trimmed 42827 records to 28986 (keeping 200 days of data) [2025-10-14T19:06:30.328463] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T19:06:30.358033] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-14T19:06:30.416783] [DEBUG] [LOCAL ] GBX: Primary data saved (28986 records). [2025-10-14T19:06:30.416913] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-14T19:06:30.416991] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GBX took 39.9s. Estimated remaining: 3h 26m 1s. Rate: 7.1 symbols/min [2025-10-14T19:06:30.588398] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:30.631623] [DEBUG] [LOCAL ] GD: Loaded 46773 existing records from primary storage. [2025-10-14T19:06:30.631932] [INFO ] [MAIN ] GD: Loaded 46773 existing records. [2025-10-14T19:06:30.805121] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:06:30.805339] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-14T19:06:30.805384] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-14T19:06:30.805839] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-14T19:06:30.805896] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-14T19:06:31.139918] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T19:06:31.159001] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-14T19:06:31.180728] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:31.741480] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T19:06:31.958173] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-14T19:06:32.758046] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-14T19:06:32.973784] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T19:06:33.558076] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-14T19:06:34.229439] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T19:06:34.358056] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-14T19:06:34.661179] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T19:06:34.663741] [INFO ] [REMOTE ] GCTS: Full fetch complete (26954 records). [2025-10-14T19:06:34.663817] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-14T19:06:35.033142] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-14T19:06:35.033218] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-14T19:06:35.033786] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-14T19:06:35.033845] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-14T19:06:35.034510] [DEBUG] [LOCAL ] GCTS: Trimmed 26954 records to 20462 (keeping 200 days of data) [2025-10-14T19:06:35.154366] [DEBUG] [LOCAL ] GCTS: Primary data saved (20462 records). [2025-10-14T19:06:35.154498] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-14T19:06:35.154578] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCTS took 30.3s. Estimated remaining: 3h 25m 47s. Rate: 7.1 symbols/min [2025-10-14T19:06:35.166177] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-14T19:06:35.331267] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:35.377203] [DEBUG] [LOCAL ] GDDY: Loaded 49810 existing records from primary storage. [2025-10-14T19:06:35.377504] [INFO ] [MAIN ] GDDY: Loaded 49810 existing records. [2025-10-14T19:06:35.558018] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:06:35.558219] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-14T19:06:35.558266] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-14T19:06:35.558889] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-14T19:06:35.558945] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-14T19:06:35.925511] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:35.958043] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-14T19:06:36.009939] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T19:06:36.278458] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T19:06:36.642117] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-14T19:06:36.758057] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-14T19:06:37.558113] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-14T19:06:38.278895] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:06:38.288393] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T19:06:38.290556] [INFO ] [REMOTE ] GCI: Full fetch complete (63323 records). [2025-10-14T19:06:38.291239] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-14T19:06:38.363198] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-14T19:06:38.671595] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-14T19:06:38.671701] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-14T19:06:38.672619] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-14T19:06:38.672690] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-14T19:06:38.673925] [DEBUG] [LOCAL ] GCI: Trimmed 63323 records to 43904 (keeping 200 days of data) [2025-10-14T19:06:38.911751] [DEBUG] [LOCAL ] GCI: Primary data saved (43904 records). [2025-10-14T19:06:38.911877] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-14T19:06:38.911965] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCI took 48.3s. Estimated remaining: 3h 25m 31s. Rate: 7.1 symbols/min [2025-10-14T19:06:39.079452] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:39.079620] [DEBUG] [LOCAL ] GDIV: No existing data file found in primary storage. [2025-10-14T19:06:39.079691] [WARN ] [MAIN ] GDIV: No existing data found, performing full refresh instead. [2025-10-14T19:06:39.079823] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-14T19:06:39.079864] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-14T19:06:39.079903] [DEBUG] [LOCAL ] GDIV: No primary data file found to delete. [2025-10-14T19:06:39.079934] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-14T19:06:39.163232] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-14T19:06:39.429905] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:39.958056] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-14T19:06:39.989698] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T19:06:39.991913] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T19:06:40.558439] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T19:06:40.758056] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-14T19:06:41.558060] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-14T19:06:42.145567] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T19:06:42.358058] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-14T19:06:43.158092] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-14T19:06:43.355297] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T19:06:43.707943] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T19:06:43.958088] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-14T19:06:44.057948] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:06:44.758067] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-14T19:06:45.558042] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-14T19:06:45.657440] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T19:06:46.087596] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T19:06:46.105177] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T19:06:46.358058] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-14T19:06:46.750238] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-14T19:06:47.158069] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-14T19:06:47.958092] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-14T19:06:48.758041] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-14T19:06:48.890536] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T19:06:48.892547] [INFO ] [REMOTE ] GCV: Full fetch complete (9743 records). [2025-10-14T19:06:48.892623] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-14T19:06:49.274900] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-14T19:06:49.275081] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-14T19:06:49.275394] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-14T19:06:49.275469] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-14T19:06:49.302947] [DEBUG] [LOCAL ] GCV: Trimmed 9743 records to 7738 (keeping 200 days of data) [2025-10-14T19:06:49.304933] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-14T19:06:49.364482] [DEBUG] [LOCAL ] GCV: Primary data saved (7738 records). [2025-10-14T19:06:49.364621] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-14T19:06:49.364736] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GCV took 35.5s. Estimated remaining: 3h 25m 26s. Rate: 7.1 symbols/min [2025-10-14T19:06:49.473393] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T19:06:49.544596] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:49.548422] [DEBUG] [LOCAL ] GDL: Loaded 2501 existing records from primary storage. [2025-10-14T19:06:49.548568] [INFO ] [MAIN ] GDL: Loaded 2501 existing records. [2025-10-14T19:06:49.563235] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-14T19:06:49.732449] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:06:49.732749] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-14T19:06:49.732805] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-14T19:06:49.732993] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-14T19:06:49.733053] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-14T19:06:50.133300] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:50.358123] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-14T19:06:51.158044] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-14T19:06:51.260909] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:06:51.626673] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-14T19:06:51.661297] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T19:06:51.958084] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-14T19:06:52.354776] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-14T19:06:52.758061] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-14T19:06:53.558064] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-14T19:06:54.358042] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-14T19:06:54.485562] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T19:06:54.896867] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-14T19:06:55.158046] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-14T19:06:55.278603] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T19:06:55.529155] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-14T19:06:55.958083] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-14T19:06:56.341708] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-14T19:06:56.758099] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-14T19:06:57.558043] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-14T19:06:57.963467] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:06:58.015133] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T19:06:58.358083] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-14T19:06:58.854284] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T19:06:58.855202] [INFO ] [REMOTE ] GDIV: Full fetch complete (5439 records). [2025-10-14T19:06:58.855268] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-14T19:06:59.163184] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-14T19:06:59.218102] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-14T19:06:59.218175] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-14T19:06:59.218354] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-14T19:06:59.218441] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-14T19:06:59.218857] [DEBUG] [LOCAL ] GDIV: Trimmed 5439 records to 3599 (keeping 200 days of data) [2025-10-14T19:06:59.241055] [DEBUG] [LOCAL ] GDIV: Primary data saved (3599 records). [2025-10-14T19:06:59.241134] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-14T19:06:59.241194] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GDIV took 20.3s. Estimated remaining: 3h 25m 20s. Rate: 7.1 symbols/min [2025-10-14T19:06:59.413899] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:06:59.422330] [DEBUG] [LOCAL ] GDO: Loaded 5913 existing records from primary storage. [2025-10-14T19:06:59.422516] [INFO ] [MAIN ] GDO: Loaded 5913 existing records. [2025-10-14T19:06:59.600118] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:06:59.600386] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-14T19:06:59.600434] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-14T19:06:59.600637] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-14T19:06:59.600761] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-14T19:06:59.957067] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:06:59.958022] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-14T19:07:00.758073] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-14T19:07:00.859281] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T19:07:01.160417] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T19:07:01.301120] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-14T19:07:01.558065] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-14T19:07:02.358065] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-14T19:07:03.054852] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T19:07:03.133678] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T19:07:03.158028] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-14T19:07:03.958084] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-14T19:07:04.758065] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-14T19:07:04.894238] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:07:05.035508] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-14T19:07:05.558099] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-14T19:07:05.614827] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T19:07:06.145205] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T19:07:06.358127] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-14T19:07:07.021567] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T19:07:07.158139] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-14T19:07:07.958079] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-14T19:07:08.544193] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T19:07:08.650583] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T19:07:08.758118] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-14T19:07:09.558088] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-14T19:07:10.029284] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-14T19:07:10.358067] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-14T19:07:10.474039] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T19:07:10.825427] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T19:07:11.158164] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-14T19:07:11.590571] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T19:07:11.958127] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-14T19:07:12.758049] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-14T19:07:13.213888] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T19:07:13.558041] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-14T19:07:13.582971] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:07:13.588541] [INFO ] [REMOTE ] GDDY: Full fetch complete (71979 records). [2025-10-14T19:07:13.588682] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-14T19:07:13.978198] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-14T19:07:13.978275] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-14T19:07:13.979201] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-14T19:07:13.979263] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-14T19:07:13.980598] [DEBUG] [LOCAL ] GDDY: Trimmed 71979 records to 49797 (keeping 200 days of data) [2025-10-14T19:07:14.191414] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-14T19:07:14.285103] [DEBUG] [LOCAL ] GDDY: Primary data saved (49797 records). [2025-10-14T19:07:14.285228] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-14T19:07:14.285301] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDDY took 39.1s. Estimated remaining: 3h 25m 22s. Rate: 7.1 symbols/min [2025-10-14T19:07:14.363196] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-14T19:07:14.466122] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:07:14.501014] [DEBUG] [LOCAL ] GDOT: Loaded 37679 existing records from primary storage. [2025-10-14T19:07:14.501279] [INFO ] [MAIN ] GDOT: Loaded 37679 existing records. [2025-10-14T19:07:14.678256] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:07:14.678479] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-14T19:07:14.678525] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-14T19:07:14.678784] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-14T19:07:14.678840] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-14T19:07:14.944784] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T19:07:15.042550] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:07:15.158041] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-14T19:07:15.958071] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-14T19:07:16.552095] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T19:07:16.554705] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:07:16.758071] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-14T19:07:17.510488] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T19:07:17.558083] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-14T19:07:17.874763] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-14T19:07:18.358076] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-14T19:07:19.158139] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-14T19:07:19.640076] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T19:07:19.958102] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-14T19:07:20.403611] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T19:07:20.758097] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-14T19:07:20.873262] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T19:07:20.878363] [INFO ] [REMOTE ] GD: Full fetch complete (69857 records). [2025-10-14T19:07:20.878482] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-14T19:07:21.271350] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-14T19:07:21.271433] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-14T19:07:21.272323] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-14T19:07:21.272382] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-14T19:07:21.273599] [DEBUG] [LOCAL ] GD: Trimmed 69857 records to 46751 (keeping 200 days of data) [2025-10-14T19:07:21.558048] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-14T19:07:21.567241] [DEBUG] [LOCAL ] GD: Primary data saved (46751 records). [2025-10-14T19:07:21.567307] [INFO ] [MAIN ] GD: Full history saved. [2025-10-14T19:07:21.567376] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GD took 51.2s. Estimated remaining: 3h 25m 12s. Rate: 7.1 symbols/min [2025-10-14T19:07:21.743685] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:07:21.763155] [DEBUG] [LOCAL ] GDV: Loaded 19548 existing records from primary storage. [2025-10-14T19:07:21.763370] [INFO ] [MAIN ] GDV: Loaded 19548 existing records. [2025-10-14T19:07:21.958682] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T19:07:21.970105] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:07:21.970669] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-14T19:07:21.970965] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-14T19:07:21.971192] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-14T19:07:21.971235] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-14T19:07:22.156907] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T19:07:22.227090] [INFO ] [REMOTE ] GDO: Full fetch complete (8621 records). [2025-10-14T19:07:22.238437] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-14T19:07:22.362676] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-14T19:07:22.466510] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:07:22.705729] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-14T19:07:22.705807] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-14T19:07:22.706030] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-14T19:07:22.706068] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-14T19:07:22.706458] [DEBUG] [LOCAL ] GDO: Trimmed 8621 records to 5877 (keeping 200 days of data) [2025-10-14T19:07:22.741805] [DEBUG] [LOCAL ] GDO: Primary data saved (5877 records). [2025-10-14T19:07:22.741899] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-14T19:07:22.741971] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDO took 23.5s. Estimated remaining: 3h 24m 51s. Rate: 7.1 symbols/min [2025-10-14T19:07:22.911487] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:07:22.960915] [DEBUG] [LOCAL ] GE: Loaded 53706 existing records from primary storage. [2025-10-14T19:07:22.961205] [INFO ] [MAIN ] GE: Loaded 53706 existing records. [2025-10-14T19:07:23.158925] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-14T19:07:23.158821] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:07:23.159816] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-14T19:07:23.159864] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-14T19:07:23.160125] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-14T19:07:23.160164] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-14T19:07:23.511210] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:07:23.958100] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-14T19:07:24.105535] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T19:07:24.164911] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T19:07:24.419540] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T19:07:24.758055] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-14T19:07:25.380630] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T19:07:25.558063] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-14T19:07:26.358123] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-14T19:07:27.158038] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-14T19:07:27.671102] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-14T19:07:27.753578] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T19:07:27.958117] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-14T19:07:28.143467] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T19:07:28.451999] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T19:07:28.453124] [INFO ] [REMOTE ] GDL: Full fetch complete (3485 records). [2025-10-14T19:07:28.453199] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-14T19:07:28.763179] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-14T19:07:28.836523] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-14T19:07:28.836622] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-14T19:07:28.836882] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-14T19:07:28.836941] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-14T19:07:28.837329] [DEBUG] [LOCAL ] GDL: Trimmed 3485 records to 2513 (keeping 200 days of data) [2025-10-14T19:07:28.853819] [DEBUG] [LOCAL ] GDL: Primary data saved (2513 records). [2025-10-14T19:07:28.853924] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-14T19:07:28.854014] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDL took 39.5s. Estimated remaining: 3h 24m 39s. Rate: 7.1 symbols/min [2025-10-14T19:07:29.026502] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:07:29.055047] [DEBUG] [LOCAL ] GEF: Loaded 20781 existing records from primary storage. [2025-10-14T19:07:29.055397] [INFO ] [MAIN ] GEF: Loaded 20781 existing records. [2025-10-14T19:07:29.243843] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:07:29.244186] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-14T19:07:29.244238] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-14T19:07:29.244527] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-14T19:07:29.244588] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-14T19:07:29.563254] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-14T19:07:29.639660] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:07:30.358057] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-14T19:07:30.917082] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-14T19:07:31.045830] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T19:07:31.065233] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T19:07:31.158080] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-14T19:07:31.958139] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-14T19:07:32.218532] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T19:07:32.675010] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T19:07:32.758106] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-14T19:07:33.558107] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-14T19:07:33.615818] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T19:07:34.358074] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-14T19:07:34.907402] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T19:07:35.158046] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-14T19:07:35.175588] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T19:07:35.958133] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-14T19:07:36.758088] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-14T19:07:37.061378] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T19:07:37.098339] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T19:07:37.558059] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-14T19:07:38.013815] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T19:07:38.358087] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-14T19:07:38.627479] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T19:07:39.158070] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-14T19:07:39.958058] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-14T19:07:40.187758] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T19:07:40.693839] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T19:07:40.758079] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-14T19:07:40.953718] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T19:07:41.558060] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-14T19:07:42.265119] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:07:42.358038] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-14T19:07:42.747714] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T19:07:43.158063] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-14T19:07:43.765096] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T19:07:43.769892] [INFO ] [REMOTE ] GDOT: Full fetch complete (53335 records). [2025-10-14T19:07:43.769971] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-14T19:07:43.965502] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-14T19:07:44.173830] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T19:07:44.174133] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-14T19:07:44.177627] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-14T19:07:44.178671] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-14T19:07:44.178750] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-14T19:07:44.180444] [DEBUG] [LOCAL ] GDOT: Trimmed 53335 records to 37743 (keeping 200 days of data) [2025-10-14T19:07:44.391518] [DEBUG] [LOCAL ] GDOT: Primary data saved (37743 records). [2025-10-14T19:07:44.391675] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-14T19:07:44.391771] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDOT took 30.1s. Estimated remaining: 3h 24m 42s. Rate: 7.1 symbols/min [2025-10-14T19:07:44.561395] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:07:44.593515] [DEBUG] [LOCAL ] GEL: Loaded 31996 existing records from primary storage. [2025-10-14T19:07:44.593799] [INFO ] [MAIN ] GEL: Loaded 31996 existing records. [2025-10-14T19:07:44.777734] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:07:44.774536] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-14T19:07:44.778281] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-14T19:07:44.778537] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-14T19:07:44.791624] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-14T19:07:44.793419] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-14T19:07:44.806080] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T19:07:45.151790] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:07:45.558052] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-14T19:07:46.358079] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-14T19:07:46.705441] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T19:07:46.891408] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-14T19:07:47.158077] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-14T19:07:47.282810] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T19:07:47.958088] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-14T19:07:48.309051] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T19:07:48.758085] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-14T19:07:49.558032] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-14T19:07:49.807241] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T19:07:50.095150] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:07:50.110101] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T19:07:50.358081] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-14T19:07:51.158086] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-14T19:07:51.958030] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-14T19:07:52.107263] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T19:07:52.111013] [INFO ] [REMOTE ] GDV: Full fetch complete (28489 records). [2025-10-14T19:07:52.111112] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-14T19:07:52.518146] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-14T19:07:52.518316] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-14T19:07:52.518991] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-14T19:07:52.519076] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-14T19:07:52.519972] [DEBUG] [LOCAL ] GDV: Trimmed 28489 records to 19583 (keeping 200 days of data) [2025-10-14T19:07:52.642685] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-14T19:07:52.686388] [DEBUG] [LOCAL ] GDV: Primary data saved (19583 records). [2025-10-14T19:07:52.686522] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-14T19:07:52.686599] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GDV took 31.1s. Estimated remaining: 3h 24m 34s. Rate: 7.1 symbols/min [2025-10-14T19:07:52.761543] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-14T19:07:52.870398] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:07:52.921386] [DEBUG] [LOCAL ] GENI: Loaded 52939 existing records from primary storage. [2025-10-14T19:07:52.921696] [INFO ] [MAIN ] GENI: Loaded 52939 existing records. [2025-10-14T19:07:53.098627] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:07:53.098975] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-14T19:07:53.099048] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-14T19:07:53.099531] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-14T19:07:53.099583] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-14T19:07:53.334437] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T19:07:53.476211] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:07:53.558023] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-14T19:07:54.101191] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T19:07:54.358081] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-14T19:07:55.158044] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-14T19:07:55.422249] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T19:07:55.958036] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-14T19:07:56.340056] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T19:07:56.615132] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-14T19:07:56.758068] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-14T19:07:57.226225] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T19:07:57.558071] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-14T19:07:58.224956] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T19:07:58.358055] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-14T19:07:58.738412] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T19:07:59.158108] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-14T19:07:59.177485] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T19:07:59.958069] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-14T19:08:00.758054] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-14T19:08:00.981423] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T19:08:01.352095] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:08:01.558105] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-14T19:08:02.358219] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-14T19:08:02.641813] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T19:08:03.158105] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-14T19:08:03.274311] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T19:08:03.527666] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T19:08:03.958096] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-14T19:08:04.758089] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-14T19:08:04.986549] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T19:08:05.169773] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-14T19:08:05.558113] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-14T19:08:06.027361] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T19:08:06.358071] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-14T19:08:06.840965] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T19:08:06.847224] [INFO ] [REMOTE ] GE: Full fetch complete (77863 records). [2025-10-14T19:08:06.847386] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-14T19:08:07.160143] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-14T19:08:07.270891] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-14T19:08:07.270984] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-14T19:08:07.271996] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-14T19:08:07.272075] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-14T19:08:07.273746] [DEBUG] [LOCAL ] GE: Trimmed 77863 records to 53701 (keeping 200 days of data) [2025-10-14T19:08:07.393626] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T19:08:07.642456] [DEBUG] [LOCAL ] GE: Primary data saved (53701 records). [2025-10-14T19:08:07.642579] [INFO ] [MAIN ] GE: Full history saved. [2025-10-14T19:08:07.643159] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GE took 44.9s. Estimated remaining: 3h 24m 36s. Rate: 7.1 symbols/min [2025-10-14T19:08:07.814321] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:08:07.864422] [DEBUG] [LOCAL ] GEO: Loaded 51877 existing records from primary storage. [2025-10-14T19:08:07.864736] [INFO ] [MAIN ] GEO: Loaded 51877 existing records. [2025-10-14T19:08:07.959771] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-14T19:08:08.069668] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:08:08.069873] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-14T19:08:08.069920] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-14T19:08:08.070271] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-14T19:08:08.070328] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-14T19:08:08.276555] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T19:08:08.484956] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:08:08.758029] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-14T19:08:09.558068] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-14T19:08:09.621897] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T19:08:10.358052] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-14T19:08:10.671204] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T19:08:10.896817] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T19:08:11.158103] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-14T19:08:11.367486] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T19:08:11.370404] [INFO ] [REMOTE ] GEF: Full fetch complete (29347 records). [2025-10-14T19:08:11.370485] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-14T19:08:11.739533] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-14T19:08:11.739623] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-14T19:08:11.740220] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-14T19:08:11.740268] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-14T19:08:11.740979] [DEBUG] [LOCAL ] GEF: Trimmed 29347 records to 20792 (keeping 200 days of data) [2025-10-14T19:08:11.867822] [DEBUG] [LOCAL ] GEF: Primary data saved (20792 records). [2025-10-14T19:08:11.867995] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-14T19:08:11.868075] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GEF took 43.0s. Estimated remaining: 3h 24m 21s. Rate: 7.1 symbols/min [2025-10-14T19:08:11.965799] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-14T19:08:12.039627] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:08:12.075135] [DEBUG] [LOCAL ] GES: Loaded 38436 existing records from primary storage. [2025-10-14T19:08:12.075420] [INFO ] [MAIN ] GES: Loaded 38436 existing records. [2025-10-14T19:08:12.250900] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:08:12.251093] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-14T19:08:12.251140] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-14T19:08:12.251310] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-14T19:08:12.251347] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-14T19:08:12.608122] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:08:12.758037] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-14T19:08:12.989201] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T19:08:13.558076] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-14T19:08:13.687019] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T19:08:14.363202] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-14T19:08:14.377295] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T19:08:15.158118] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-14T19:08:15.340271] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T19:08:15.958093] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-14T19:08:16.074118] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T19:08:16.129479] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T19:08:16.758061] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-14T19:08:17.554018] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T19:08:17.563346] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-14T19:08:18.193300] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T19:08:18.358043] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-14T19:08:19.093500] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T19:08:19.158068] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-14T19:08:19.958065] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-14T19:08:20.259170] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T19:08:20.262775] [INFO ] [REMOTE ] GEL: Full fetch complete (48155 records). [2025-10-14T19:08:20.262938] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-14T19:08:20.674769] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-14T19:08:20.674891] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-14T19:08:20.676157] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-14T19:08:20.676226] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-14T19:08:20.708917] [DEBUG] [LOCAL ] GEL: Trimmed 48155 records to 31852 (keeping 200 days of data) [2025-10-14T19:08:20.711272] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-14T19:08:20.780006] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-14T19:08:20.916704] [DEBUG] [LOCAL ] GEL: Primary data saved (31852 records). [2025-10-14T19:08:20.916841] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-14T19:08:20.916922] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEL took 36.5s. Estimated remaining: 3h 24m 13s. Rate: 7.1 symbols/min [2025-10-14T19:08:21.087959] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:08:21.120322] [DEBUG] [LOCAL ] GETY: Loaded 35067 existing records from primary storage. [2025-10-14T19:08:21.120585] [INFO ] [MAIN ] GETY: Loaded 35067 existing records. [2025-10-14T19:08:21.302011] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:08:21.302370] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-14T19:08:21.302443] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-14T19:08:21.302770] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-14T19:08:21.302929] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-14T19:08:21.430305] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T19:08:21.571040] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-14T19:08:21.696027] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:08:22.220109] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T19:08:22.358052] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-14T19:08:23.158039] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-14T19:08:23.410046] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T19:08:23.416065] [INFO ] [REMOTE ] GENI: Full fetch complete (75882 records). [2025-10-14T19:08:23.416209] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-14T19:08:23.950601] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-14T19:08:23.950832] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-14T19:08:23.951943] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-14T19:08:23.952027] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-14T19:08:23.962582] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-14T19:08:23.980021] [DEBUG] [LOCAL ] GENI: Trimmed 75882 records to 52934 (keeping 200 days of data) [2025-10-14T19:08:23.981709] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T19:08:24.314262] [DEBUG] [LOCAL ] GENI: Primary data saved (52934 records). [2025-10-14T19:08:24.314422] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-14T19:08:24.314506] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GENI took 31.6s. Estimated remaining: 3h 23m 57s. Rate: 7.1 symbols/min [2025-10-14T19:08:24.497030] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:08:24.546423] [DEBUG] [LOCAL ] GEV: Loaded 53002 existing records from primary storage. [2025-10-14T19:08:24.546754] [INFO ] [MAIN ] GEV: Loaded 53002 existing records. [2025-10-14T19:08:24.748684] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:08:24.751357] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-14T19:08:24.751627] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-14T19:08:24.753124] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-14T19:08:24.753051] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T19:08:24.753265] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-14T19:08:24.760819] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-14T19:08:25.120229] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:08:25.355128] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T19:08:25.558113] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-14T19:08:26.358058] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-14T19:08:26.503290] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T19:08:27.158060] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-14T19:08:27.644288] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-14T19:08:27.769211] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T19:08:27.958059] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-14T19:08:28.660060] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T19:08:28.758075] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-14T19:08:29.558079] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-14T19:08:29.943966] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-14T19:08:30.249952] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:08:30.358092] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-14T19:08:31.163209] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-14T19:08:31.184391] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T19:08:31.958136] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-14T19:08:32.434926] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T19:08:32.544617] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-14T19:08:32.758071] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-14T19:08:33.563609] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-14T19:08:33.568969] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T19:08:34.233999] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T19:08:34.358086] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-14T19:08:35.158066] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-14T19:08:35.913744] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-14T19:08:35.958544] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T19:08:35.958613] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-14T19:08:36.625745] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:08:36.758041] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-14T19:08:36.949227] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T19:08:37.558065] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-14T19:08:38.362105] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-14T19:08:38.367506] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T19:08:39.158098] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-14T19:08:39.529809] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T19:08:39.712239] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T19:08:39.958054] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-14T19:08:40.759062] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-14T19:08:40.762694] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T19:08:40.768746] [INFO ] [REMOTE ] GEO: Full fetch complete (75580 records). [2025-10-14T19:08:40.768853] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-14T19:08:41.194057] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-14T19:08:41.194217] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-14T19:08:41.195621] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-14T19:08:41.195787] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-14T19:08:41.216908] [DEBUG] [LOCAL ] GEO: Trimmed 75580 records to 51866 (keeping 200 days of data) [2025-10-14T19:08:41.222273] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T19:08:41.535074] [DEBUG] [LOCAL ] GEO: Primary data saved (51866 records). [2025-10-14T19:08:41.535217] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-14T19:08:41.535306] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GEO took 33.9s. Estimated remaining: 3h 24m 2s. Rate: 7.1 symbols/min [2025-10-14T19:08:41.564874] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-14T19:08:41.707483] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:08:41.712532] [DEBUG] [LOCAL ] GF: Loaded 2724 existing records from primary storage. [2025-10-14T19:08:41.712719] [INFO ] [MAIN ] GF: Loaded 2724 existing records. [2025-10-14T19:08:41.893138] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:08:41.893354] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-14T19:08:41.893401] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-14T19:08:41.893522] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-14T19:08:41.893560] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-14T19:08:42.253149] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T19:08:42.299434] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:08:42.358064] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-14T19:08:42.932871] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T19:08:43.163234] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-14T19:08:43.176474] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T19:08:43.958068] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-14T19:08:44.517713] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T19:08:44.758063] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-14T19:08:45.208695] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T19:08:45.558069] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-14T19:08:45.715361] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T19:08:45.719855] [INFO ] [REMOTE ] GES: Full fetch complete (58854 records). [2025-10-14T19:08:45.719996] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-14T19:08:46.109892] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-14T19:08:46.109967] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-14T19:08:46.110775] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-14T19:08:46.110835] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-14T19:08:46.111946] [DEBUG] [LOCAL ] GES: Trimmed 58854 records to 38327 (keeping 200 days of data) [2025-10-14T19:08:46.346497] [DEBUG] [LOCAL ] GES: Primary data saved (38327 records). [2025-10-14T19:08:46.346688] [INFO ] [MAIN ] GES: Full history saved. [2025-10-14T19:08:46.346784] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GES took 34.5s. Estimated remaining: 3h 23m 48s. Rate: 7.1 symbols/min [2025-10-14T19:08:46.358117] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-14T19:08:46.922402] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T19:08:46.991922] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T19:08:47.158113] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-14T19:08:47.958069] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-14T19:08:47.977186] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T19:08:48.758095] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-14T19:08:49.558128] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-14T19:08:50.128336] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-14T19:08:50.232145] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-14T19:08:50.270131] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:08:50.358064] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-14T19:08:51.158086] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-14T19:08:51.661311] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T19:08:51.666201] [INFO ] [REMOTE ] GETY: Full fetch complete (55511 records). [2025-10-14T19:08:51.666393] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-14T19:08:51.963576] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-14T19:08:52.107454] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-14T19:08:52.107571] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-14T19:08:52.108857] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-14T19:08:52.108934] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-14T19:08:52.110836] [DEBUG] [LOCAL ] GETY: Trimmed 55511 records to 35043 (keeping 200 days of data) [2025-10-14T19:08:52.351753] [DEBUG] [LOCAL ] GETY: Primary data saved (35043 records). [2025-10-14T19:08:52.351984] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-14T19:08:52.352093] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GETY took 31.4s. Estimated remaining: 3h 23m 36s. Rate: 7.1 symbols/min [2025-10-14T19:08:52.660444] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T19:08:52.758056] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-14T19:08:53.217489] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T19:08:53.394519] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-14T19:08:53.558103] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-14T19:08:54.358134] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-14T19:08:54.682077] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-14T19:08:55.158066] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-14T19:08:55.652511] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T19:08:55.958137] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-14T19:08:56.015779] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-14T19:08:56.398131] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T19:08:56.758064] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-14T19:08:57.230538] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T19:08:57.231328] [INFO ] [REMOTE ] GF: Full fetch complete (4986 records). [2025-10-14T19:08:57.231396] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-14T19:08:57.563336] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-14T19:08:57.622846] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-14T19:08:57.622946] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-14T19:08:57.623139] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-14T19:08:57.623179] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-14T19:08:57.623588] [DEBUG] [LOCAL ] GF: Trimmed 4986 records to 2706 (keeping 200 days of data) [2025-10-14T19:08:57.640251] [DEBUG] [LOCAL ] GF: Primary data saved (2706 records). [2025-10-14T19:08:57.640313] [INFO ] [MAIN ] GF: Full history saved. [2025-10-14T19:08:57.640392] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GF took 16.1s. Estimated remaining: 3h 23m 23s. Rate: 7.1 symbols/min [2025-10-14T19:09:00.105101] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-14T19:09:00.121676] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-14T19:09:02.733884] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-14T19:09:02.739763] [INFO ] [REMOTE ] GEV: Full fetch complete (77000 records). [2025-10-14T19:09:02.739887] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-14T19:09:03.125727] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-14T19:09:03.125823] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-14T19:09:03.126819] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-14T19:09:03.126901] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-14T19:09:03.128502] [DEBUG] [LOCAL ] GEV: Trimmed 77000 records to 52998 (keeping 200 days of data) [2025-10-14T19:09:03.461589] [DEBUG] [LOCAL ] GEV: Primary data saved (52998 records). [2025-10-14T19:09:03.461764] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-14T19:09:03.461863] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GEV took 39.1s. Estimated remaining: 3h 23m 10s. Rate: 7.1 symbols/min [2025-10-14T19:09:04.034175] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:04.127107] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:04.131301] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:04.164231] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:04.180817] [DEBUG] [LOCAL ] GFR: Loaded 7832 existing records from primary storage. [2025-10-14T19:09:04.181362] [INFO ] [MAIN ] GFR: Loaded 7832 existing records. [2025-10-14T19:09:04.359024] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-14T19:09:04.379430] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-14T19:09:04.460737] [DEBUG] [LOCAL ] GFF: Loaded 30038 existing records from primary storage. [2025-10-14T19:09:04.550969] [DEBUG] [LOCAL ] GFL: Loaded 47788 existing records from primary storage. [2025-10-14T19:09:04.564471] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:04.561360] [INFO ] [MAIN ] GFF: Loaded 30038 existing records. [2025-10-14T19:09:04.572670] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-14T19:09:04.576963] [INFO ] [MAIN ] GFL: Loaded 47788 existing records. [2025-10-14T19:09:04.594053] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-14T19:09:04.719544] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-14T19:09:04.775454] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:04.801175] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-14T19:09:04.868272] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-14T19:09:04.873670] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-14T19:09:04.928116] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-14T19:09:04.969274] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-14T19:09:05.167365] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:05.238856] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:05.289915] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-14T19:09:05.290007] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-14T19:09:05.289761] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-14T19:09:05.324203] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-14T19:09:05.341457] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-14T19:09:05.348921] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-14T19:09:05.475335] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-14T19:09:05.512452] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-14T19:09:06.025172] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:06.077199] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-14T19:09:06.289129] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:06.313057] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-14T19:09:06.478036] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:06.488819] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-14T19:09:06.549035] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:06.549304] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-14T19:09:06.940440] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T19:09:06.943707] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-14T19:09:07.640816] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T19:09:07.643880] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-14T19:09:07.807876] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T19:09:07.813910] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-14T19:09:07.839024] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T19:09:07.848601] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-14T19:09:07.877782] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T19:09:07.887861] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-14T19:09:08.356153] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T19:09:08.358414] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-14T19:09:08.792117] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:09:08.798579] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-14T19:09:08.904908] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T19:09:08.909703] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-14T19:09:09.226594] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:09:09.236942] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-14T19:09:09.441783] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T19:09:09.558047] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-14T19:09:09.774609] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T19:09:09.911467] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T19:09:10.358067] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-14T19:09:11.007436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T19:09:11.020266] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T19:09:11.057828] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T19:09:11.158104] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-14T19:09:11.958070] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-14T19:09:12.758059] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-14T19:09:13.106178] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T19:09:13.174268] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T19:09:13.292843] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T19:09:13.558058] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-14T19:09:14.358092] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-14T19:09:14.973762] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T19:09:15.158135] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-14T19:09:15.380571] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T19:09:15.958074] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-14T19:09:16.562990] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:09:16.758090] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-14T19:09:17.558045] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-14T19:09:17.976835] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T19:09:18.094892] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T19:09:18.358067] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-14T19:09:18.813222] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T19:09:18.981733] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T19:09:19.158051] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-14T19:09:19.958123] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-14T19:09:20.647718] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T19:09:20.758076] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-14T19:09:20.873268] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:09:21.558061] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-14T19:09:22.358085] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-14T19:09:22.457060] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T19:09:22.644228] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T19:09:23.158124] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-14T19:09:23.664814] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T19:09:23.829713] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T19:09:23.831080] [INFO ] [REMOTE ] GFR: Full fetch complete (12253 records). [2025-10-14T19:09:23.831156] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-14T19:09:23.963280] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-14T19:09:24.215188] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-14T19:09:24.215276] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-14T19:09:24.215580] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-14T19:09:24.215618] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-14T19:09:24.216082] [DEBUG] [LOCAL ] GFR: Trimmed 12253 records to 7814 (keeping 200 days of data) [2025-10-14T19:09:24.259686] [DEBUG] [LOCAL ] GFR: Primary data saved (7814 records). [2025-10-14T19:09:24.259828] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-14T19:09:24.259910] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 20.8s. Estimated remaining: 3h 23m 21s. Rate: 7.1 symbols/min [2025-10-14T19:09:24.433291] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:24.481822] [DEBUG] [LOCAL ] GGB: Loaded 51339 existing records from primary storage. [2025-10-14T19:09:24.482211] [INFO ] [MAIN ] GGB: Loaded 51339 existing records. [2025-10-14T19:09:24.668518] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:24.668787] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-14T19:09:24.668842] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-14T19:09:24.669259] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-14T19:09:24.669316] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-14T19:09:24.767208] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-14T19:09:25.033132] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:25.558050] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-14T19:09:26.032344] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T19:09:26.361576] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-14T19:09:26.382502] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T19:09:26.433357] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T19:09:27.158068] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-14T19:09:27.958071] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-14T19:09:28.246527] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T19:09:28.367819] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T19:09:28.758047] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-14T19:09:29.558094] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-14T19:09:29.616145] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T19:09:30.104338] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T19:09:30.358080] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-14T19:09:31.158091] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-14T19:09:31.587559] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T19:09:31.939088] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T19:09:31.958027] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-14T19:09:32.758044] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-14T19:09:32.785154] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:09:33.528686] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T19:09:33.558031] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-14T19:09:34.358059] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-14T19:09:34.848638] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-14T19:09:34.854871] [INFO ] [REMOTE ] GFI: Full fetch complete (76687 records). [2025-10-14T19:09:34.854990] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-14T19:09:35.166585] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-14T19:09:35.291168] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-14T19:09:35.291266] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-14T19:09:35.292260] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-14T19:09:35.292339] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-14T19:09:35.319444] [DEBUG] [LOCAL ] GFI: Trimmed 76687 records to 53117 (keeping 200 days of data) [2025-10-14T19:09:35.320787] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T19:09:35.562321] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T19:09:35.677435] [DEBUG] [LOCAL ] GFI: Primary data saved (53117 records). [2025-10-14T19:09:35.677622] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-14T19:09:35.677761] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GFI took 32.2s. Estimated remaining: 3h 23m 17s. Rate: 7.1 symbols/min [2025-10-14T19:09:35.845259] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:35.883060] [DEBUG] [LOCAL ] GGG: Loaded 40761 existing records from primary storage. [2025-10-14T19:09:35.883336] [INFO ] [MAIN ] GGG: Loaded 40761 existing records. [2025-10-14T19:09:35.963210] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-14T19:09:36.061305] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:36.061502] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-14T19:09:36.061548] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-14T19:09:36.061874] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-14T19:09:36.061931] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-14T19:09:36.422163] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:36.758033] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-14T19:09:36.801638] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T19:09:37.558042] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-14T19:09:37.613010] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T19:09:37.752974] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T19:09:37.756379] [INFO ] [REMOTE ] GFF: Full fetch complete (44068 records). [2025-10-14T19:09:37.756485] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-14T19:09:38.148817] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-14T19:09:38.148896] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-14T19:09:38.149587] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-14T19:09:38.149625] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-14T19:09:38.150611] [DEBUG] [LOCAL ] GFF: Trimmed 44068 records to 30024 (keeping 200 days of data) [2025-10-14T19:09:38.332894] [DEBUG] [LOCAL ] GFF: Primary data saved (30024 records). [2025-10-14T19:09:38.333031] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-14T19:09:38.333109] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFF took 34.9s. Estimated remaining: 3h 23m 0s. Rate: 7.1 symbols/min [2025-10-14T19:09:38.363910] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-14T19:09:38.505712] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:38.520233] [DEBUG] [LOCAL ] GGT: Loaded 14336 existing records from primary storage. [2025-10-14T19:09:38.520456] [INFO ] [MAIN ] GGT: Loaded 14336 existing records. [2025-10-14T19:09:38.695296] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:38.695497] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-14T19:09:38.695542] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-14T19:09:38.695729] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-14T19:09:38.695899] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-14T19:09:39.119186] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:39.137812] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T19:09:39.144634] [INFO ] [REMOTE ] GFL: Full fetch complete (69389 records). [2025-10-14T19:09:39.144851] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-14T19:09:39.163259] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-14T19:09:39.768325] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-14T19:09:39.768442] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-14T19:09:39.770229] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-14T19:09:39.770320] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-14T19:09:39.772425] [DEBUG] [LOCAL ] GFL: Trimmed 69389 records to 47717 (keeping 200 days of data) [2025-10-14T19:09:39.915350] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T19:09:39.957976] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T19:09:39.958094] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-14T19:09:40.157879] [DEBUG] [LOCAL ] GFL: Primary data saved (47717 records). [2025-10-14T19:09:40.158011] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-14T19:09:40.158089] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GFL took 36.7s. Estimated remaining: 3h 22m 41s. Rate: 7.1 symbols/min [2025-10-14T19:09:40.323615] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:09:40.328325] [DEBUG] [LOCAL ] GGZ: Loaded 2409 existing records from primary storage. [2025-10-14T19:09:40.328487] [INFO ] [MAIN ] GGZ: Loaded 2409 existing records. [2025-10-14T19:09:40.510738] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:09:40.510952] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-14T19:09:40.511003] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-14T19:09:40.511133] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-14T19:09:40.511174] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-14T19:09:40.763181] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-14T19:09:40.866833] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:09:41.477593] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T19:09:41.496542] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T19:09:41.558073] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-14T19:09:42.358078] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-14T19:09:42.923595] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T19:09:43.158092] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-14T19:09:43.327806] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T19:09:43.883780] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T19:09:43.958049] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-14T19:09:44.752860] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T19:09:44.758017] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-14T19:09:45.558102] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-14T19:09:45.681686] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-14T19:09:46.358140] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-14T19:09:47.161123] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-14T19:09:47.179025] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T19:09:47.207066] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T19:09:47.958089] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-14T19:09:48.654549] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T19:09:48.758045] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-14T19:09:48.881284] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T19:09:49.558065] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-14T19:09:49.880805] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T19:09:50.358045] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-14T19:09:50.445537] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T19:09:50.678440] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T19:09:51.158070] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-14T19:09:51.622831] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T19:09:51.958102] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-14T19:09:52.758040] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-14T19:09:53.509422] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T19:09:53.558110] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-14T19:09:54.204324] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T19:09:54.358063] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-14T19:09:54.390618] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T19:09:54.795225] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T19:09:55.158069] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-14T19:09:55.760685] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T19:09:55.958064] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-14T19:09:56.758069] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-14T19:09:57.293348] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-14T19:09:57.392600] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T19:09:57.558061] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-14T19:09:58.358103] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-14T19:09:58.869019] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-14T19:09:59.010752] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T19:09:59.158065] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-14T19:09:59.958128] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-14T19:10:00.499425] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-14T19:10:00.523260] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T19:10:00.758101] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-14T19:10:01.558074] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-14T19:10:01.816933] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:10:01.825468] [INFO ] [REMOTE ] GGT: Full fetch complete (18904 records). [2025-10-14T19:10:01.825776] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-14T19:10:02.249874] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-14T19:10:02.249957] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-14T19:10:02.250440] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-14T19:10:02.250480] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-14T19:10:02.251261] [DEBUG] [LOCAL ] GGT: Trimmed 18904 records to 14418 (keeping 200 days of data) [2025-10-14T19:10:02.336963] [DEBUG] [LOCAL ] GGT: Primary data saved (14418 records). [2025-10-14T19:10:02.337104] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-14T19:10:02.337184] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGT took 24.0s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-14T19:10:02.367205] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-14T19:10:02.514849] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:02.520638] [DEBUG] [LOCAL ] GHC: Loaded 2904 existing records from primary storage. [2025-10-14T19:10:02.520871] [INFO ] [MAIN ] GHC: Loaded 2904 existing records. [2025-10-14T19:10:02.700410] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:02.700682] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-14T19:10:02.700773] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-14T19:10:02.700921] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-14T19:10:02.700960] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-14T19:10:03.083336] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:03.120313] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T19:10:03.158082] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-14T19:10:03.814820] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T19:10:03.958068] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-14T19:10:04.454595] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-14T19:10:04.763637] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-14T19:10:04.766727] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T19:10:04.773517] [INFO ] [REMOTE ] GGB: Full fetch complete (74314 records). [2025-10-14T19:10:04.773627] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-14T19:10:05.178228] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-14T19:10:05.178312] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-14T19:10:05.179283] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-14T19:10:05.179346] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-14T19:10:05.180747] [DEBUG] [LOCAL ] GGB: Trimmed 74314 records to 51393 (keeping 200 days of data) [2025-10-14T19:10:05.475447] [DEBUG] [LOCAL ] GGB: Primary data saved (51393 records). [2025-10-14T19:10:05.475579] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-14T19:10:05.475676] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGB took 41.2s. Estimated remaining: 3h 22m 38s. Rate: 7.1 symbols/min [2025-10-14T19:10:05.565455] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-14T19:10:05.646170] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:05.651744] [DEBUG] [LOCAL ] GHG: Loaded 3279 existing records from primary storage. [2025-10-14T19:10:05.651894] [INFO ] [MAIN ] GHG: Loaded 3279 existing records. [2025-10-14T19:10:05.832175] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:05.832540] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-14T19:10:05.832618] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-14T19:10:05.832998] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-14T19:10:05.833219] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-14T19:10:06.205851] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T19:10:06.223550] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T19:10:06.236703] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:06.358062] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-14T19:10:07.158099] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-14T19:10:07.594550] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T19:10:07.632748] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T19:10:07.958104] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-14T19:10:08.383772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-14T19:10:08.758102] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-14T19:10:09.372610] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T19:10:09.558112] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-14T19:10:10.358102] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-14T19:10:10.670071] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-14T19:10:11.158082] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-14T19:10:11.647664] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T19:10:11.958096] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-14T19:10:12.409481] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T19:10:12.758061] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-14T19:10:13.176951] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (3.62 seconds). [2025-10-14T19:10:13.181349] [INFO ] [REMOTE ] GGG: Full fetch complete (59436 records). [2025-10-14T19:10:13.181441] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-14T19:10:13.261206] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T19:10:13.278866] [INFO ] [REMOTE ] GGZ: Full fetch complete (3998 records). [2025-10-14T19:10:13.289686] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-14T19:10:13.562187] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-14T19:10:13.930354] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-14T19:10:13.940708] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-14T19:10:13.954988] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-14T19:10:13.960183] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-14T19:10:14.001687] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-14T19:10:14.001827] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-14T19:10:14.002011] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-14T19:10:14.002184] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-14T19:10:14.002396] [DEBUG] [LOCAL ] GGG: Trimmed 59436 records to 40713 (keeping 200 days of data) [2025-10-14T19:10:14.003040] [DEBUG] [LOCAL ] GGZ: Trimmed 3998 records to 2407 (keeping 200 days of data) [2025-10-14T19:10:14.115038] [DEBUG] [LOCAL ] GGZ: Primary data saved (2407 records). [2025-10-14T19:10:14.126349] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-14T19:10:14.126470] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GGZ took 34.0s. Estimated remaining: 3h 22m 30s. Rate: 7.1 symbols/min [2025-10-14T19:10:14.264925] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T19:10:14.380900] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-14T19:10:14.402075] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:14.450014] [DEBUG] [LOCAL ] GHI: Loaded 7235 existing records from primary storage. [2025-10-14T19:10:14.453854] [INFO ] [MAIN ] GHI: Loaded 7235 existing records. [2025-10-14T19:10:14.639921] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:14.642321] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-14T19:10:14.643572] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-14T19:10:14.644776] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-14T19:10:14.644874] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-14T19:10:14.909296] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T19:10:14.896965] [DEBUG] [LOCAL ] GGG: Primary data saved (40713 records). [2025-10-14T19:10:14.926533] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-14T19:10:14.933013] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GGG took 39.3s. Estimated remaining: 3h 22m 9s. Rate: 7.1 symbols/min [2025-10-14T19:10:15.163618] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:15.158247] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-14T19:10:15.223207] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:15.229903] [DEBUG] [LOCAL ] GHLD: Loaded 4242 existing records from primary storage. [2025-10-14T19:10:15.230049] [INFO ] [MAIN ] GHLD: Loaded 4242 existing records. [2025-10-14T19:10:15.402241] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:15.402420] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-14T19:10:15.402467] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-14T19:10:15.402589] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-14T19:10:15.402625] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-14T19:10:15.679629] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T19:10:15.756737] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:15.958059] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-14T19:10:16.534855] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-14T19:10:16.758107] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-14T19:10:17.541339] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T19:10:17.558026] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-14T19:10:18.358051] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-14T19:10:18.375179] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T19:10:18.883451] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-14T19:10:19.158062] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-14T19:10:19.592491] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-14T19:10:19.958038] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-14T19:10:20.516480] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T19:10:20.758232] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-14T19:10:21.187399] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T19:10:21.558084] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-14T19:10:22.192967] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-14T19:10:22.358033] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-14T19:10:23.158037] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-14T19:10:23.221115] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T19:10:23.484051] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-14T19:10:23.958058] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-14T19:10:24.290008] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-14T19:10:24.758068] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-14T19:10:25.455227] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T19:10:25.558055] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-14T19:10:26.197528] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T19:10:26.358062] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-14T19:10:26.928335] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T19:10:27.158119] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-14T19:10:27.648229] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-14T19:10:27.958068] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-14T19:10:28.512400] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T19:10:28.758046] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-14T19:10:29.397130] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-14T19:10:29.558114] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-14T19:10:30.282286] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T19:10:30.358083] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-14T19:10:31.102166] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T19:10:31.158049] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-14T19:10:31.958110] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-14T19:10:31.974440] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T19:10:32.435500] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-14T19:10:32.758079] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-14T19:10:33.237911] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T19:10:33.558073] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-14T19:10:34.243227] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T19:10:34.244822] [INFO ] [REMOTE ] GHI: Full fetch complete (11312 records). [2025-10-14T19:10:34.244889] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-14T19:10:34.363164] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-14T19:10:34.624941] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-14T19:10:34.625017] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-14T19:10:34.625291] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-14T19:10:34.625328] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-14T19:10:34.625785] [DEBUG] [LOCAL ] GHI: Trimmed 11312 records to 7296 (keeping 200 days of data) [2025-10-14T19:10:34.671304] [DEBUG] [LOCAL ] GHI: Primary data saved (7296 records). [2025-10-14T19:10:34.671434] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-14T19:10:34.671512] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHI took 20.5s. Estimated remaining: 3h 22m 18s. Rate: 7.1 symbols/min [2025-10-14T19:10:34.846770] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:34.865508] [DEBUG] [LOCAL ] GHM: Loaded 14248 existing records from primary storage. [2025-10-14T19:10:34.866071] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T19:10:34.866710] [INFO ] [MAIN ] GHM: Loaded 14248 existing records. [2025-10-14T19:10:35.052852] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:35.053044] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-14T19:10:35.053092] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-14T19:10:35.053329] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-14T19:10:35.053387] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-14T19:10:35.163247] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-14T19:10:35.416918] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:35.551350] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-14T19:10:35.958059] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-14T19:10:36.758050] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-14T19:10:36.926760] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T19:10:37.223717] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-14T19:10:37.558073] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-14T19:10:38.143947] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T19:10:38.358075] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-14T19:10:39.158081] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-14T19:10:39.185745] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T19:10:39.639662] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-14T19:10:39.958063] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-14T19:10:40.599934] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T19:10:40.758090] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-14T19:10:41.198062] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T19:10:41.558078] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-14T19:10:41.995658] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T19:10:42.358082] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-14T19:10:42.909012] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T19:10:42.910299] [INFO ] [REMOTE ] GHG: Full fetch complete (4156 records). [2025-10-14T19:10:42.910409] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-14T19:10:43.163326] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-14T19:10:43.300774] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-14T19:10:43.300856] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-14T19:10:43.301026] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-14T19:10:43.301065] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-14T19:10:43.301399] [DEBUG] [LOCAL ] GHG: Trimmed 4156 records to 3280 (keeping 200 days of data) [2025-10-14T19:10:43.319679] [DEBUG] [LOCAL ] GHG: Primary data saved (3280 records). [2025-10-14T19:10:43.319756] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-14T19:10:43.319841] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHG took 37.8s. Estimated remaining: 3h 22m 10s. Rate: 7.1 symbols/min [2025-10-14T19:10:43.487240] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:43.509175] [DEBUG] [LOCAL ] GHY: Loaded 20868 existing records from primary storage. [2025-10-14T19:10:43.509449] [INFO ] [MAIN ] GHY: Loaded 20868 existing records. [2025-10-14T19:10:43.690995] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:43.691205] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-14T19:10:43.691254] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-14T19:10:43.691423] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-14T19:10:43.691462] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-14T19:10:43.967416] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-14T19:10:43.995836] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T19:10:44.079156] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:44.758095] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-14T19:10:44.917329] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T19:10:45.513853] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T19:10:45.514993] [INFO ] [REMOTE ] GHC: Full fetch complete (3597 records). [2025-10-14T19:10:45.515070] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-14T19:10:45.563153] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-14T19:10:45.882958] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-14T19:10:45.883022] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-14T19:10:45.883137] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-14T19:10:45.883173] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-14T19:10:45.883506] [DEBUG] [LOCAL ] GHC: Trimmed 3597 records to 2917 (keeping 200 days of data) [2025-10-14T19:10:45.902095] [DEBUG] [LOCAL ] GHC: Primary data saved (2917 records). [2025-10-14T19:10:45.902191] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-14T19:10:45.902262] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHC took 43.6s. Estimated remaining: 3h 21m 53s. Rate: 7.1 symbols/min [2025-10-14T19:10:46.073449] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:46.104942] [DEBUG] [LOCAL ] GIB: Loaded 31605 existing records from primary storage. [2025-10-14T19:10:46.105217] [INFO ] [MAIN ] GIB: Loaded 31605 existing records. [2025-10-14T19:10:46.285363] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:46.285592] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-14T19:10:46.285639] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-14T19:10:46.285928] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-14T19:10:46.285985] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-14T19:10:46.363182] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-14T19:10:46.646701] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:46.706797] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T19:10:47.158031] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-14T19:10:47.196557] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T19:10:47.958092] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-14T19:10:48.155048] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:10:48.758042] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-14T19:10:48.821603] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T19:10:49.558054] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-14T19:10:50.031139] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T19:10:50.358101] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-14T19:10:50.372848] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T19:10:51.158112] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-14T19:10:51.585332] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:10:51.947310] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T19:10:51.958014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-14T19:10:52.758040] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-14T19:10:52.970829] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T19:10:53.558065] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-14T19:10:53.728887] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T19:10:53.900980] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T19:10:54.358071] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-14T19:10:55.158102] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-14T19:10:55.366823] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T19:10:55.581629] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T19:10:55.582734] [INFO ] [REMOTE ] GHLD: Full fetch complete (4949 records). [2025-10-14T19:10:55.582803] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-14T19:10:55.941999] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-14T19:10:55.942083] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-14T19:10:55.942317] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-14T19:10:55.942392] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-14T19:10:55.943110] [DEBUG] [LOCAL ] GHLD: Trimmed 4949 records to 4238 (keeping 200 days of data) [2025-10-14T19:10:55.959491] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-14T19:10:55.974002] [DEBUG] [LOCAL ] GHLD: Primary data saved (4238 records). [2025-10-14T19:10:55.974082] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-14T19:10:55.974156] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHLD took 41.0s. Estimated remaining: 3h 21m 47s. Rate: 7.1 symbols/min [2025-10-14T19:10:56.146627] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:10:56.161672] [DEBUG] [LOCAL ] GIC: Loaded 13429 existing records from primary storage. [2025-10-14T19:10:56.161893] [INFO ] [MAIN ] GIC: Loaded 13429 existing records. [2025-10-14T19:10:56.340100] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:10:56.340303] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-14T19:10:56.340350] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-14T19:10:56.340508] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-14T19:10:56.340545] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-14T19:10:56.692309] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:10:56.758036] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-14T19:10:57.339678] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:10:57.558049] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-14T19:10:57.756238] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:10:58.358141] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-14T19:10:58.531098] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T19:10:59.158066] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-14T19:10:59.258779] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T19:10:59.904377] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T19:10:59.906734] [INFO ] [REMOTE ] GHM: Full fetch complete (22082 records). [2025-10-14T19:10:59.906811] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-14T19:10:59.967809] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-14T19:11:00.277332] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-14T19:11:00.277404] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-14T19:11:00.277898] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-14T19:11:00.277959] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-14T19:11:00.278528] [DEBUG] [LOCAL ] GHM: Trimmed 22082 records to 14325 (keeping 200 days of data) [2025-10-14T19:11:00.369422] [DEBUG] [LOCAL ] GHM: Primary data saved (14325 records). [2025-10-14T19:11:00.369553] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-14T19:11:00.369629] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GHM took 25.7s. Estimated remaining: 3h 21m 32s. Rate: 7.1 symbols/min [2025-10-14T19:11:00.543368] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:11:00.582212] [DEBUG] [LOCAL ] GIL: Loaded 43786 existing records from primary storage. [2025-10-14T19:11:00.582491] [INFO ] [MAIN ] GIL: Loaded 43786 existing records. [2025-10-14T19:11:00.752071] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T19:11:00.766756] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-14T19:11:00.771201] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:11:00.775149] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-14T19:11:00.775817] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-14T19:11:00.776163] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-14T19:11:00.776222] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-14T19:11:01.132053] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:11:01.558060] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-14T19:11:02.313686] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:11:02.364928] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-14T19:11:02.368870] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T19:11:03.158052] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-14T19:11:03.303577] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T19:11:03.958091] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-14T19:11:04.253885] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T19:11:04.758127] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-14T19:11:05.459776] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T19:11:05.558024] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-14T19:11:05.988207] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:11:06.358036] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-14T19:11:06.410415] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T19:11:07.158062] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-14T19:11:07.764991] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T19:11:07.958062] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-14T19:11:08.184898] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T19:11:08.758048] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-14T19:11:09.357394] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:11:09.558113] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-14T19:11:10.082326] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T19:11:10.358043] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-14T19:11:10.840874] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T19:11:11.158062] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-14T19:11:11.724261] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T19:11:11.941593] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T19:11:11.958033] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-14T19:11:12.528796] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T19:11:12.758224] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-14T19:11:13.558092] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-14T19:11:13.845722] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T19:11:14.358060] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-14T19:11:14.618670] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:11:14.859307] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-14T19:11:15.158037] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-14T19:11:15.958109] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-14T19:11:16.215283] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:11:16.758078] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-14T19:11:17.214243] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T19:11:17.558056] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-14T19:11:17.774169] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T19:11:18.358114] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-14T19:11:18.905516] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T19:11:18.909048] [INFO ] [REMOTE ] GIB: Full fetch complete (45856 records). [2025-10-14T19:11:18.909133] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-14T19:11:19.163855] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-14T19:11:19.282096] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-14T19:11:19.282423] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-14T19:11:19.283139] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-14T19:11:19.283200] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-14T19:11:19.284186] [DEBUG] [LOCAL ] GIB: Trimmed 45856 records to 31638 (keeping 200 days of data) [2025-10-14T19:11:19.479409] [DEBUG] [LOCAL ] GIB: Primary data saved (31638 records). [2025-10-14T19:11:19.479530] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-14T19:11:19.479605] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIB took 33.6s. Estimated remaining: 3h 21m 40s. Rate: 7.1 symbols/min [2025-10-14T19:11:19.676731] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:11:19.695342] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T19:11:19.752922] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-14T19:11:19.753233] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-14T19:11:19.930499] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:11:19.930848] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-14T19:11:19.930903] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-14T19:11:19.931418] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-14T19:11:19.931477] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-14T19:11:19.963172] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-14T19:11:20.233949] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T19:11:20.303775] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:11:20.758068] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-14T19:11:21.237106] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T19:11:21.558054] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-14T19:11:22.358044] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-14T19:11:22.603523] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T19:11:22.867245] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-14T19:11:23.046066] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T19:11:23.158050] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-14T19:11:23.958072] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-14T19:11:24.065922] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T19:11:24.758150] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-14T19:11:25.300248] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T19:11:25.558095] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-14T19:11:25.733484] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T19:11:26.358113] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-14T19:11:27.139333] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T19:11:27.158036] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-14T19:11:27.962785] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-14T19:11:27.965538] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T19:11:28.506131] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T19:11:28.758072] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-14T19:11:28.989317] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T19:11:29.552766] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T19:11:29.554389] [INFO ] [REMOTE ] GIC: Full fetch complete (19979 records). [2025-10-14T19:11:29.554472] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-14T19:11:29.565758] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-14T19:11:29.923314] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-14T19:11:29.923389] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-14T19:11:29.923818] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-14T19:11:29.923878] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-14T19:11:29.924423] [DEBUG] [LOCAL ] GIC: Trimmed 19979 records to 13431 (keeping 200 days of data) [2025-10-14T19:11:30.004946] [DEBUG] [LOCAL ] GIC: Primary data saved (13431 records). [2025-10-14T19:11:30.005086] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-14T19:11:30.005166] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GIC took 34.0s. Estimated remaining: 3h 21m 35s. Rate: 7.1 symbols/min [2025-10-14T19:11:30.171163] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:11:30.209014] [DEBUG] [LOCAL ] GKOS: Loaded 42521 existing records from primary storage. [2025-10-14T19:11:30.209326] [INFO ] [MAIN ] GKOS: Loaded 42521 existing records. [2025-10-14T19:11:30.388826] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:11:30.381130] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-14T19:11:30.389738] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-14T19:11:30.389798] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-14T19:11:30.389983] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-14T19:11:30.390039] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-14T19:11:30.740951] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:11:31.113911] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:11:31.158037] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-14T19:11:31.958038] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-14T19:11:32.036074] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T19:11:32.041508] [INFO ] [REMOTE ] GIL: Full fetch complete (62113 records). [2025-10-14T19:11:32.041633] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-14T19:11:32.437526] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-14T19:11:32.437616] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-14T19:11:32.438556] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-14T19:11:32.438633] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-14T19:11:32.440114] [DEBUG] [LOCAL ] GIL: Trimmed 62113 records to 43802 (keeping 200 days of data) [2025-10-14T19:11:32.715285] [DEBUG] [LOCAL ] GIL: Primary data saved (43802 records). [2025-10-14T19:11:32.715422] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-14T19:11:32.715502] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 32.3s. Estimated remaining: 3h 21m 18s. Rate: 7.1 symbols/min [2025-10-14T19:11:32.760406] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-14T19:11:32.904720] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:11:32.943662] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T19:11:32.944367] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T19:11:32.959838] [INFO ] [REMOTE ] GHY: Full fetch complete (32480 records). [2025-10-14T19:11:32.959961] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-14T19:11:33.239783] [DEBUG] [LOCAL ] GL: Loaded 37661 existing records from primary storage. [2025-10-14T19:11:33.269495] [INFO ] [MAIN ] GL: Loaded 37661 existing records. [2025-10-14T19:11:33.541330] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:11:33.543332] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-14T19:11:33.543452] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-14T19:11:33.543561] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-14T19:11:33.543614] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-14T19:11:33.544327] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-14T19:11:33.544402] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-14T19:11:33.544548] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-14T19:11:33.544475] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-14T19:11:33.565959] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-14T19:11:33.649599] [DEBUG] [LOCAL ] GHY: Trimmed 32480 records to 20943 (keeping 200 days of data) [2025-10-14T19:11:34.012925] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:11:34.048541] [DEBUG] [LOCAL ] GHY: Primary data saved (20943 records). [2025-10-14T19:11:34.048703] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-14T19:11:34.048792] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GHY took 50.7s. Estimated remaining: 3h 20m 59s. Rate: 7.1 symbols/min [2025-10-14T19:11:34.224418] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:11:34.267617] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T19:11:34.289291] [DEBUG] [LOCAL ] GLOB: Loaded 47959 existing records from primary storage. [2025-10-14T19:11:34.289563] [INFO ] [MAIN ] GLOB: Loaded 47959 existing records. [2025-10-14T19:11:34.365297] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-14T19:11:34.478402] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:11:34.478618] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-14T19:11:34.478720] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-14T19:11:34.478952] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-14T19:11:34.479011] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-14T19:11:34.837510] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:11:35.158072] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-14T19:11:35.503762] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T19:11:35.592424] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T19:11:35.958118] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-14T19:11:36.717034] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T19:11:36.758034] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-14T19:11:36.872570] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T19:11:37.558081] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-14T19:11:38.197759] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T19:11:38.358060] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-14T19:11:39.032285] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T19:11:39.158129] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-14T19:11:39.444981] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T19:11:39.958090] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-14T19:11:40.554116] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T19:11:40.758074] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-14T19:11:41.555029] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T19:11:41.565947] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-14T19:11:42.037666] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T19:11:42.358118] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-14T19:11:43.158102] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-14T19:11:43.408417] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T19:11:43.563558] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T19:11:43.958120] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-14T19:11:44.333953] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T19:11:44.758077] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-14T19:11:45.380980] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T19:11:45.558053] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-14T19:11:46.222369] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T19:11:46.358099] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-14T19:11:47.158065] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-14T19:11:47.375117] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-14T19:11:47.958108] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-14T19:11:48.285867] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T19:11:48.322400] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T19:11:48.758074] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-14T19:11:49.170917] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:11:49.558060] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-14T19:11:50.358047] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-14T19:11:50.409121] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T19:11:51.158069] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-14T19:11:51.222590] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T19:11:51.540203] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T19:11:51.958086] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-14T19:11:52.686609] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T19:11:52.758038] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-14T19:11:53.253282] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T19:11:53.558062] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-14T19:11:54.250115] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:11:54.358055] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-14T19:11:55.159266] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-14T19:11:55.165009] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T19:11:55.923092] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T19:11:55.958060] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-14T19:11:56.758072] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-14T19:11:56.964411] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T19:11:57.346140] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T19:11:57.558067] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-14T19:11:58.358126] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-14T19:11:58.579382] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T19:11:58.813178] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T19:11:59.158121] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-14T19:11:59.605513] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T19:11:59.958163] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-14T19:12:00.441288] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T19:12:00.758110] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-14T19:12:01.156777] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T19:12:01.308236] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T19:12:01.314231] [INFO ] [REMOTE ] GIS: Full fetch complete (77826 records). [2025-10-14T19:12:01.314378] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-14T19:12:01.568015] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-14T19:12:01.714771] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-14T19:12:01.714873] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-14T19:12:01.715844] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-14T19:12:01.715907] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-14T19:12:01.717472] [DEBUG] [LOCAL ] GIS: Trimmed 77826 records to 53673 (keeping 200 days of data) [2025-10-14T19:12:02.058928] [DEBUG] [LOCAL ] GIS: Primary data saved (53673 records). [2025-10-14T19:12:02.059079] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-14T19:12:02.059190] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GIS took 42.6s. Estimated remaining: 3h 21m 20s. Rate: 7.1 symbols/min [2025-10-14T19:12:02.235899] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:02.246666] [DEBUG] [LOCAL ] GLP: Loaded 9245 existing records from primary storage. [2025-10-14T19:12:02.246837] [INFO ] [MAIN ] GLP: Loaded 9245 existing records. [2025-10-14T19:12:02.363262] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-14T19:12:02.432528] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:02.432786] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-14T19:12:02.432839] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-14T19:12:02.432988] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-14T19:12:02.433025] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-14T19:12:02.803411] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:03.158092] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-14T19:12:03.191410] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:12:03.196908] [INFO ] [REMOTE ] GLOB: Full fetch complete (65268 records). [2025-10-14T19:12:03.197029] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-14T19:12:03.581728] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-14T19:12:03.581829] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-14T19:12:03.582734] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-14T19:12:03.582811] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-14T19:12:03.584251] [DEBUG] [LOCAL ] GLOB: Trimmed 65268 records to 47979 (keeping 200 days of data) [2025-10-14T19:12:03.686153] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T19:12:03.693369] [INFO ] [REMOTE ] GKOS: Full fetch complete (60336 records). [2025-10-14T19:12:03.694091] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-14T19:12:03.962756] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-14T19:12:04.113885] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-14T19:12:04.115280] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-14T19:12:04.116186] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-14T19:12:04.119271] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-14T19:12:04.183183] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T19:12:04.215325] [DEBUG] [LOCAL ] GKOS: Trimmed 60336 records to 42609 (keeping 200 days of data) [2025-10-14T19:12:04.456991] [DEBUG] [LOCAL ] GLOB: Primary data saved (47979 records). [2025-10-14T19:12:04.465579] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-14T19:12:04.465997] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GLOB took 30.4s. Estimated remaining: 3h 21m 3s. Rate: 7.1 symbols/min [2025-10-14T19:12:04.683704] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:04.714520] [DEBUG] [LOCAL ] GKOS: Primary data saved (42609 records). [2025-10-14T19:12:04.714728] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-14T19:12:04.714818] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GKOS took 34.7s. Estimated remaining: 3h 20m 42s. Rate: 7.1 symbols/min [2025-10-14T19:12:04.778559] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-14T19:12:04.918151] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:04.919449] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-14T19:12:04.919691] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-14T19:12:05.100972] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:05.101637] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-14T19:12:05.101725] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-14T19:12:05.101944] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-14T19:12:05.102001] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-14T19:12:05.323659] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-14T19:12:05.376799] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-14T19:12:05.596953] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T19:12:05.641856] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:05.672195] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-14T19:12:05.661273] [INFO ] [REMOTE ] GL: Full fetch complete (55284 records). [2025-10-14T19:12:05.689959] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-14T19:12:05.690277] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T19:12:05.718597] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:05.718879] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-14T19:12:05.718962] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-14T19:12:05.724722] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-14T19:12:05.756623] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-14T19:12:06.368702] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-14T19:12:06.477173] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-14T19:12:06.510566] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-14T19:12:06.510400] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:06.511631] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-14T19:12:06.511996] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-14T19:12:06.513436] [DEBUG] [LOCAL ] GL: Trimmed 55284 records to 37678 (keeping 200 days of data) [2025-10-14T19:12:06.750906] [DEBUG] [LOCAL ] GL: Primary data saved (37678 records). [2025-10-14T19:12:06.751056] [INFO ] [MAIN ] GL: Full history saved. [2025-10-14T19:12:06.751745] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GL took 34.0s. Estimated remaining: 3h 20m 24s. Rate: 7.1 symbols/min [2025-10-14T19:12:06.918275] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:06.972636] [DEBUG] [LOCAL ] GME: Loaded 53783 existing records from primary storage. [2025-10-14T19:12:06.973000] [INFO ] [MAIN ] GME: Loaded 53783 existing records. [2025-10-14T19:12:07.153419] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:07.153697] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-14T19:12:07.153755] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-14T19:12:07.154299] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-14T19:12:07.154354] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-14T19:12:07.175600] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-14T19:12:07.443758] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T19:12:07.551875] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:07.587554] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T19:12:07.958080] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-14T19:12:08.726440] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T19:12:08.758047] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-14T19:12:09.177231] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T19:12:09.558071] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-14T19:12:10.285136] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T19:12:10.358047] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-14T19:12:11.158196] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-14T19:12:11.242208] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-14T19:12:11.925017] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T19:12:11.958036] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-14T19:12:12.252915] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T19:12:12.419071] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T19:12:12.758112] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-14T19:12:13.558112] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-14T19:12:14.266198] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T19:12:14.358066] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-14T19:12:14.989242] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-14T19:12:15.158067] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-14T19:12:15.958047] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-14T19:12:16.118638] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T19:12:16.758164] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-14T19:12:17.364142] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T19:12:17.557016] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-14T19:12:17.561056] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-14T19:12:17.850481] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T19:12:18.358117] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-14T19:12:18.376458] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T19:12:19.158100] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-14T19:12:19.958070] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-14T19:12:20.278306] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T19:12:20.758047] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-14T19:12:21.143688] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T19:12:21.558050] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-14T19:12:22.123363] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-14T19:12:22.366009] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-14T19:12:22.373101] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T19:12:23.154792] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T19:12:23.157421] [INFO ] [REMOTE ] GLP: Full fetch complete (14282 records). [2025-10-14T19:12:23.157581] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-14T19:12:23.163391] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-14T19:12:23.551135] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-14T19:12:23.551350] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-14T19:12:23.551778] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-14T19:12:23.551857] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-14T19:12:23.552740] [DEBUG] [LOCAL ] GLP: Trimmed 14282 records to 9246 (keeping 200 days of data) [2025-10-14T19:12:23.613123] [DEBUG] [LOCAL ] GLP: Primary data saved (9246 records). [2025-10-14T19:12:23.613371] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-14T19:12:23.613516] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GLP took 21.6s. Estimated remaining: 3h 20m 28s. Rate: 7.1 symbols/min [2025-10-14T19:12:23.814589] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:23.853623] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-14T19:12:23.910844] [DEBUG] [LOCAL ] GMED: Loaded 48340 existing records from primary storage. [2025-10-14T19:12:23.911264] [INFO ] [MAIN ] GMED: Loaded 48340 existing records. [2025-10-14T19:12:23.963154] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-14T19:12:24.116442] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:24.116693] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-14T19:12:24.116753] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-14T19:12:24.116961] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-14T19:12:24.117020] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-14T19:12:24.474246] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:24.758059] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-14T19:12:25.127443] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T19:12:25.558062] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-14T19:12:26.358143] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-14T19:12:26.568923] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-14T19:12:26.722384] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T19:12:26.929609] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T19:12:27.158078] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-14T19:12:27.805927] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T19:12:27.958062] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-14T19:12:28.758080] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-14T19:12:29.553188] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T19:12:29.562837] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-14T19:12:29.614781] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-14T19:12:30.358051] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-14T19:12:30.444735] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T19:12:31.158053] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-14T19:12:31.635898] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-14T19:12:31.953619] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T19:12:31.963207] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-14T19:12:32.758048] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-14T19:12:33.208572] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-14T19:12:33.558097] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-14T19:12:33.925709] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-14T19:12:34.358083] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-14T19:12:34.999913] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-14T19:12:35.167574] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-14T19:12:35.186870] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T19:12:35.958049] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-14T19:12:36.460617] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-14T19:12:36.758054] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-14T19:12:37.354917] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T19:12:37.361274] [INFO ] [REMOTE ] GLW: Full fetch complete (77785 records). [2025-10-14T19:12:37.361420] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-14T19:12:37.580186] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-14T19:12:37.809835] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-14T19:12:37.809973] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-14T19:12:37.811872] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-14T19:12:37.811956] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-14T19:12:37.814200] [DEBUG] [LOCAL ] GLW: Trimmed 77785 records to 53636 (keeping 200 days of data) [2025-10-14T19:12:37.952131] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-14T19:12:38.136335] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T19:12:38.275039] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-14T19:12:38.275292] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-14T19:12:38.275405] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GLW took 33.8s. Estimated remaining: 3h 20m 29s. Rate: 7.1 symbols/min [2025-10-14T19:12:38.363229] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-14T19:12:38.465347] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:38.510046] [DEBUG] [LOCAL ] GMRE: Loaded 37093 existing records from primary storage. [2025-10-14T19:12:38.510489] [INFO ] [MAIN ] GMRE: Loaded 37093 existing records. [2025-10-14T19:12:38.725917] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:38.726225] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-14T19:12:38.726278] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-14T19:12:38.726807] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-14T19:12:38.726876] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-14T19:12:39.134287] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:39.159722] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-14T19:12:39.174661] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:12:39.958112] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-14T19:12:40.523627] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-14T19:12:40.619929] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T19:12:40.758039] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-14T19:12:41.558102] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-14T19:12:41.687463] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T19:12:42.197897] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T19:12:42.358078] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-14T19:12:43.158075] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-14T19:12:43.453879] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:12:43.958103] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-14T19:12:44.475884] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T19:12:44.588787] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-14T19:12:44.758158] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-14T19:12:45.520623] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T19:12:45.558047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-14T19:12:46.358102] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-14T19:12:46.414973] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T19:12:47.158078] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-14T19:12:47.593192] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T19:12:47.958172] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-14T19:12:48.504153] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T19:12:48.660208] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-14T19:12:48.666396] [INFO ] [REMOTE ] GME: Full fetch complete (77924 records). [2025-10-14T19:12:48.666565] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-14T19:12:48.763315] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-14T19:12:49.058932] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-14T19:12:49.059014] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-14T19:12:49.059995] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-14T19:12:49.060057] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-14T19:12:49.061466] [DEBUG] [LOCAL ] GME: Trimmed 77924 records to 53782 (keeping 200 days of data) [2025-10-14T19:12:49.390203] [DEBUG] [LOCAL ] GME: Primary data saved (53782 records). [2025-10-14T19:12:49.390334] [INFO ] [MAIN ] GME: Full history saved. [2025-10-14T19:12:49.390410] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GME took 42.6s. Estimated remaining: 3h 20m 25s. Rate: 7.1 symbols/min [2025-10-14T19:12:49.564305] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:49.561808] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-14T19:12:49.582806] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T19:12:49.589404] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-14T19:12:49.593975] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-14T19:12:49.678233] [DEBUG] [LOCAL ] GNE: Loaded 17941 existing records from primary storage. [2025-10-14T19:12:49.702327] [INFO ] [MAIN ] GNE: Loaded 17941 existing records. [2025-10-14T19:12:49.995610] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T19:12:50.114763] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:50.137044] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-14T19:12:50.139550] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-14T19:12:50.139905] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-14T19:12:50.150503] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-14T19:12:50.378192] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-14T19:12:50.372734] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-14T19:12:50.394793] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-14T19:12:50.422324] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-14T19:12:50.447911] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-14T19:12:50.554900] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-14T19:12:50.689702] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:50.975276] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-14T19:12:50.975430] [INFO ] [MAIN ] GM: Full history saved. [2025-10-14T19:12:50.975521] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GM took 46.3s. Estimated remaining: 3h 20m 6s. Rate: 7.1 symbols/min [2025-10-14T19:12:51.151078] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:12:51.183785] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-14T19:12:51.175977] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:51.224821] [DEBUG] [LOCAL ] GNK: Loaded 40257 existing records from primary storage. [2025-10-14T19:12:51.225135] [INFO ] [MAIN ] GNK: Loaded 40257 existing records. [2025-10-14T19:12:51.400924] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:51.401143] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-14T19:12:51.401189] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-14T19:12:51.401449] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-14T19:12:51.401489] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-14T19:12:51.756299] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:51.783064] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:12:51.854210] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T19:12:51.958049] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-14T19:12:52.758095] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-14T19:12:52.804863] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T19:12:53.558074] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-14T19:12:54.233764] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T19:12:54.358107] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-14T19:12:54.503476] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T19:12:55.158143] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-14T19:12:55.958103] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-14T19:12:56.020817] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T19:12:56.026775] [INFO ] [REMOTE ] GMED: Full fetch complete (69850 records). [2025-10-14T19:12:56.026927] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-14T19:12:56.418462] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-14T19:12:56.418808] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-14T19:12:56.420056] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-14T19:12:56.420134] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-14T19:12:56.427407] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T19:12:56.430591] [DEBUG] [LOCAL ] GMED: Trimmed 69850 records to 48308 (keeping 200 days of data) [2025-10-14T19:12:56.653990] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T19:12:56.740915] [DEBUG] [LOCAL ] GMED: Primary data saved (48308 records). [2025-10-14T19:12:56.741039] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-14T19:12:56.741117] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GMED took 33.1s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-14T19:12:56.763174] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-14T19:12:56.916074] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:12:56.956817] [DEBUG] [LOCAL ] GNL: Loaded 46678 existing records from primary storage. [2025-10-14T19:12:56.957110] [INFO ] [MAIN ] GNL: Loaded 46678 existing records. [2025-10-14T19:12:57.134590] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:12:57.134788] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-14T19:12:57.134834] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-14T19:12:57.135005] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-14T19:12:57.135041] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-14T19:12:57.493740] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:12:57.558046] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-14T19:12:58.306303] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T19:12:58.358053] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-14T19:12:59.158038] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-14T19:12:59.211470] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T19:12:59.859474] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T19:12:59.958096] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-14T19:13:00.315403] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T19:13:00.758136] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-14T19:13:01.529816] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:13:01.558056] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-14T19:13:02.223060] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T19:13:02.358035] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-14T19:13:03.107433] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T19:13:03.158035] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-14T19:13:03.525156] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T19:13:03.958094] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-14T19:13:04.585078] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T19:13:04.758054] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-14T19:13:05.242194] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T19:13:05.245459] [INFO ] [REMOTE ] GMRE: Full fetch complete (52742 records). [2025-10-14T19:13:05.245546] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-14T19:13:05.563150] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-14T19:13:05.639854] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-14T19:13:05.639930] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-14T19:13:05.640698] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-14T19:13:05.640757] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-14T19:13:05.641772] [DEBUG] [LOCAL ] GMRE: Trimmed 52742 records to 37032 (keeping 200 days of data) [2025-10-14T19:13:05.860544] [DEBUG] [LOCAL ] GMRE: Primary data saved (37032 records). [2025-10-14T19:13:05.860703] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-14T19:13:05.860792] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GMRE took 27.6s. Estimated remaining: 3h 19m 46s. Rate: 7.1 symbols/min [2025-10-14T19:13:06.028831] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:13:06.072843] [DEBUG] [LOCAL ] GNRC: Loaded 45346 existing records from primary storage. [2025-10-14T19:13:06.073136] [INFO ] [MAIN ] GNRC: Loaded 45346 existing records. [2025-10-14T19:13:06.255107] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:13:06.255345] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-14T19:13:06.255390] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-14T19:13:06.255711] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-14T19:13:06.255790] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-14T19:13:06.363155] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-14T19:13:06.499497] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T19:13:06.638547] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:13:06.657182] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T19:13:07.158123] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-14T19:13:07.963177] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-14T19:13:07.980498] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T19:13:08.758087] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-14T19:13:08.809226] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T19:13:08.836245] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T19:13:09.558106] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-14T19:13:10.177162] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T19:13:10.358070] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-14T19:13:10.828881] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T19:13:11.158043] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-14T19:13:11.295877] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T19:13:11.958056] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-14T19:13:12.732910] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:13:12.758039] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-14T19:13:13.388691] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T19:13:13.558112] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-14T19:13:14.275979] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T19:13:14.358051] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-14T19:13:15.046128] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:13:15.158114] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-14T19:13:15.659353] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T19:13:15.958088] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-14T19:13:16.314472] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T19:13:16.758112] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-14T19:13:17.287154] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T19:13:17.558064] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-14T19:13:18.358043] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-14T19:13:18.939013] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-14T19:13:19.067687] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T19:13:19.158078] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-14T19:13:19.958084] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-14T19:13:20.148729] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T19:13:20.436341] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T19:13:20.758069] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-14T19:13:21.502260] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T19:13:21.558037] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-14T19:13:22.336904] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T19:13:22.358026] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-14T19:13:22.821679] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T19:13:23.158060] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-14T19:13:23.955283] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T19:13:23.964219] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-14T19:13:24.105193] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T19:13:24.758065] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-14T19:13:25.558095] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-14T19:13:25.720462] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T19:13:25.777747] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T19:13:26.358154] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-14T19:13:26.652354] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T19:13:26.657201] [INFO ] [REMOTE ] GNK: Full fetch complete (57354 records). [2025-10-14T19:13:26.657369] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-14T19:13:27.120618] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-14T19:13:27.120749] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-14T19:13:27.121848] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-14T19:13:27.121924] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-14T19:13:27.123341] [DEBUG] [LOCAL ] GNK: Trimmed 57354 records to 40176 (keeping 200 days of data) [2025-10-14T19:13:27.180174] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-14T19:13:27.408967] [DEBUG] [LOCAL ] GNK: Primary data saved (40176 records). [2025-10-14T19:13:27.409149] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-14T19:13:27.409457] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNK took 36.4s. Estimated remaining: 3h 19m 57s. Rate: 7.1 symbols/min [2025-10-14T19:13:27.416459] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:13:27.610545] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:13:27.621122] [DEBUG] [LOCAL ] GNT: Loaded 8395 existing records from primary storage. [2025-10-14T19:13:27.621345] [INFO ] [MAIN ] GNT: Loaded 8395 existing records. [2025-10-14T19:13:27.795862] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:13:27.796108] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-14T19:13:27.796168] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-14T19:13:27.796384] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-14T19:13:27.796446] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-14T19:13:27.967777] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-14T19:13:28.153605] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:13:28.726193] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T19:13:28.758033] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-14T19:13:29.485431] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:13:29.491752] [INFO ] [REMOTE ] GNL: Full fetch complete (68165 records). [2025-10-14T19:13:29.491888] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-14T19:13:29.566894] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-14T19:13:29.922009] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-14T19:13:29.922103] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-14T19:13:29.923201] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-14T19:13:29.923265] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-14T19:13:29.924901] [DEBUG] [LOCAL ] GNL: Trimmed 68165 records to 46702 (keeping 200 days of data) [2025-10-14T19:13:30.166494] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T19:13:30.231944] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T19:13:30.250297] [DEBUG] [LOCAL ] GNL: Primary data saved (46702 records). [2025-10-14T19:13:30.250448] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-14T19:13:30.250536] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 33.5s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-14T19:13:30.363187] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-14T19:13:30.427988] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:13:30.474820] [DEBUG] [LOCAL ] GNW: Loaded 51406 existing records from primary storage. [2025-10-14T19:13:30.475144] [INFO ] [MAIN ] GNW: Loaded 51406 existing records. [2025-10-14T19:13:30.651487] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:13:30.651746] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-14T19:13:30.651803] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-14T19:13:30.652032] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-14T19:13:30.652087] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-14T19:13:31.009916] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:13:31.158018] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-14T19:13:31.958037] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-14T19:13:32.082812] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T19:13:32.087801] [INFO ] [REMOTE ] GNRC: Full fetch complete (65583 records). [2025-10-14T19:13:32.087929] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-14T19:13:32.465982] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-14T19:13:32.466130] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-14T19:13:32.467001] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-14T19:13:32.467061] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-14T19:13:32.468314] [DEBUG] [LOCAL ] GNRC: Trimmed 65583 records to 45433 (keeping 200 days of data) [2025-10-14T19:13:32.743557] [DEBUG] [LOCAL ] GNRC: Primary data saved (45433 records). [2025-10-14T19:13:32.743703] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-14T19:13:32.743801] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNRC took 26.9s. Estimated remaining: 3h 19m 23s. Rate: 7.1 symbols/min [2025-10-14T19:13:32.764908] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-14T19:13:32.817426] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T19:13:32.941413] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:13:32.959730] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T19:13:33.007229] [DEBUG] [LOCAL ] GOF: Loaded 42577 existing records from primary storage. [2025-10-14T19:13:33.007525] [INFO ] [MAIN ] GOF: Loaded 42577 existing records. [2025-10-14T19:13:33.182849] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:13:33.183121] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-14T19:13:33.183169] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-14T19:13:33.183412] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-14T19:13:33.183471] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-14T19:13:33.308414] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T19:13:33.542398] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:13:33.558022] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-14T19:13:34.358048] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-14T19:13:34.365619] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T19:13:34.368387] [INFO ] [REMOTE ] GNE: Full fetch complete (22500 records). [2025-10-14T19:13:34.368486] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-14T19:13:34.765051] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-14T19:13:34.765134] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-14T19:13:34.765636] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-14T19:13:34.765727] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-14T19:13:34.766511] [DEBUG] [LOCAL ] GNE: Trimmed 22500 records to 17991 (keeping 200 days of data) [2025-10-14T19:13:34.882489] [DEBUG] [LOCAL ] GNE: Primary data saved (17991 records). [2025-10-14T19:13:34.882639] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-14T19:13:34.882764] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNE took 45.5s. Estimated remaining: 3h 19m 5s. Rate: 7.1 symbols/min [2025-10-14T19:13:35.075836] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:13:35.107973] [DEBUG] [LOCAL ] GOLF: Loaded 31005 existing records from primary storage. [2025-10-14T19:13:35.108275] [INFO ] [MAIN ] GOLF: Loaded 31005 existing records. [2025-10-14T19:13:35.168500] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-14T19:13:35.298308] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:13:35.298579] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-14T19:13:35.298639] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-14T19:13:35.299446] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-14T19:13:35.299502] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-14T19:13:35.654435] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:13:35.787962] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T19:13:35.958077] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-14T19:13:36.002017] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T19:13:36.758104] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-14T19:13:37.039282] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T19:13:37.558070] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-14T19:13:38.348979] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T19:13:38.358596] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-14T19:13:38.482831] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T19:13:39.158118] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-14T19:13:39.619913] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T19:13:39.965381] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-14T19:13:39.969859] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T19:13:40.758125] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-14T19:13:41.185187] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T19:13:41.558062] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-14T19:13:42.309669] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T19:13:42.363275] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-14T19:13:42.366834] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T19:13:43.158066] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-14T19:13:43.958139] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-14T19:13:44.000418] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T19:13:44.723089] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T19:13:44.751849] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T19:13:44.760866] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-14T19:13:45.558044] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-14T19:13:46.180375] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T19:13:46.358118] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-14T19:13:46.819530] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T19:13:47.158104] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-14T19:13:47.674091] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-14T19:13:47.783487] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T19:13:47.958109] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-14T19:13:48.758107] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-14T19:13:49.456239] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T19:13:49.558057] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-14T19:13:49.587336] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T19:13:50.358078] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-14T19:13:51.158092] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-14T19:13:51.256619] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:13:51.824555] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:13:51.845201] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T19:13:51.958042] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-14T19:13:52.758129] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-14T19:13:53.284826] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T19:13:53.558082] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-14T19:13:54.324113] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T19:13:54.358044] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-14T19:13:54.782837] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T19:13:55.158136] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-14T19:13:55.891140] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T19:13:55.958077] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-14T19:13:56.549375] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:13:56.758095] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-14T19:13:57.157435] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T19:13:57.558098] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-14T19:13:58.358128] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-14T19:13:58.398126] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T19:13:58.797611] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T19:13:59.163171] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-14T19:13:59.175268] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T19:13:59.941207] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T19:13:59.958023] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-14T19:14:00.758040] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-14T19:14:00.793513] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T19:14:00.795295] [INFO ] [REMOTE ] GNT: Full fetch complete (11131 records). [2025-10-14T19:14:00.795363] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-14T19:14:01.232536] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-14T19:14:01.232638] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-14T19:14:01.233165] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-14T19:14:01.233228] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-14T19:14:01.233835] [DEBUG] [LOCAL ] GNT: Trimmed 11131 records to 8422 (keeping 200 days of data) [2025-10-14T19:14:01.286684] [DEBUG] [LOCAL ] GNT: Primary data saved (8422 records). [2025-10-14T19:14:01.286818] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-14T19:14:01.286897] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GNT took 33.9s. Estimated remaining: 3h 19m 24s. Rate: 7.1 symbols/min [2025-10-14T19:14:01.490714] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:01.537734] [DEBUG] [LOCAL ] GOOS: Loaded 44767 existing records from primary storage. [2025-10-14T19:14:01.538097] [INFO ] [MAIN ] GOOS: Loaded 44767 existing records. [2025-10-14T19:14:01.565469] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-14T19:14:01.727747] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:01.727989] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-14T19:14:01.728040] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-14T19:14:01.728304] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-14T19:14:01.728367] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-14T19:14:02.089902] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:02.109160] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T19:14:02.358146] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-14T19:14:03.158068] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-14T19:14:03.371528] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T19:14:03.530731] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T19:14:03.535563] [INFO ] [REMOTE ] GOF: Full fetch complete (62265 records). [2025-10-14T19:14:03.535693] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-14T19:14:03.927916] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-14T19:14:03.927997] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-14T19:14:03.928850] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-14T19:14:03.928911] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-14T19:14:03.930079] [DEBUG] [LOCAL ] GOF: Trimmed 62265 records to 42601 (keeping 200 days of data) [2025-10-14T19:14:03.983072] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-14T19:14:04.187053] [DEBUG] [LOCAL ] GOF: Primary data saved (42601 records). [2025-10-14T19:14:04.187172] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-14T19:14:04.187243] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GOF took 31.4s. Estimated remaining: 3h 19m 7s. Rate: 7.1 symbols/min [2025-10-14T19:14:04.363486] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:04.398605] [DEBUG] [LOCAL ] GOTU: Loaded 37454 existing records from primary storage. [2025-10-14T19:14:04.398921] [INFO ] [MAIN ] GOTU: Loaded 37454 existing records. [2025-10-14T19:14:04.577260] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:04.577630] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-14T19:14:04.577716] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-14T19:14:04.578014] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-14T19:14:04.578070] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-14T19:14:04.766008] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-14T19:14:04.890248] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T19:14:04.978035] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:04.992973] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T19:14:05.558072] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-14T19:14:06.358074] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-14T19:14:06.589379] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T19:14:06.772890] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T19:14:07.158099] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-14T19:14:07.441728] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T19:14:07.445161] [INFO ] [REMOTE ] GOLF: Full fetch complete (45209 records). [2025-10-14T19:14:07.445269] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-14T19:14:07.820798] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-14T19:14:07.820873] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-14T19:14:07.821672] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-14T19:14:07.821770] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-14T19:14:07.822871] [DEBUG] [LOCAL ] GOLF: Trimmed 45209 records to 30957 (keeping 200 days of data) [2025-10-14T19:14:07.977160] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-14T19:14:08.020328] [DEBUG] [LOCAL ] GOLF: Primary data saved (30957 records). [2025-10-14T19:14:08.020424] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-14T19:14:08.020497] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOLF took 33.1s. Estimated remaining: 3h 18m 52s. Rate: 7.1 symbols/min [2025-10-14T19:14:08.191227] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:08.234727] [DEBUG] [LOCAL ] GPC: Loaded 46150 existing records from primary storage. [2025-10-14T19:14:08.235007] [INFO ] [MAIN ] GPC: Loaded 46150 existing records. [2025-10-14T19:14:08.409734] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:08.409929] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-14T19:14:08.409984] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-14T19:14:08.410199] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-14T19:14:08.410254] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-14T19:14:08.775434] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:08.771556] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-14T19:14:08.851011] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T19:14:09.493124] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T19:14:09.558068] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-14T19:14:09.664170] [DEBUG] [REMOTE ] GPC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-14T19:14:09.664405] [WARN ] [REMOTE ] GPC: No data returned for month 2024-12 [2025-10-14T19:14:09.664491] [FATAL] [REMOTE ] GPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:14:09.664560] [FATAL] [MAIN ] GPC: Failed to fetch primary data. [2025-10-14T19:14:09.664624] [WARN ] [MAIN ] GPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:14:09.664736] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-14T19:14:09.664796] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-14T19:14:09.664832] [INFO ] [LOCAL ] GPC: Starting deletion of derivative data. [2025-10-14T19:14:09.665014] [DEBUG] [LOCAL ] GPC: Deleted derivative data file. [2025-10-14T19:14:09.665583] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GPC took 1.6s. Estimated remaining: 3h 18m 33s. Rate: 7.1 symbols/min [2025-10-14T19:14:09.832830] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:09.849831] [DEBUG] [LOCAL ] GPI: Loaded 14798 existing records from primary storage. [2025-10-14T19:14:09.850078] [INFO ] [MAIN ] GPI: Loaded 14798 existing records. [2025-10-14T19:14:10.030068] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:10.030408] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-14T19:14:10.030482] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-14T19:14:10.030786] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-14T19:14:10.030908] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-14T19:14:10.213849] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T19:14:10.363200] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-14T19:14:10.419036] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:11.158064] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-14T19:14:11.900578] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T19:14:11.958021] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-14T19:14:11.978573] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T19:14:12.758072] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-14T19:14:13.563247] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-14T19:14:13.575785] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T19:14:13.629197] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T19:14:14.358096] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-14T19:14:15.020227] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:14:15.025981] [INFO ] [REMOTE ] GNW: Full fetch complete (73838 records). [2025-10-14T19:14:15.026092] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-14T19:14:15.173348] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-14T19:14:15.352811] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T19:14:15.448693] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-14T19:14:15.448776] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-14T19:14:15.449736] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-14T19:14:15.449796] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-14T19:14:15.451170] [DEBUG] [LOCAL ] GNW: Trimmed 73838 records to 51401 (keeping 200 days of data) [2025-10-14T19:14:15.740846] [DEBUG] [LOCAL ] GNW: Primary data saved (51401 records). [2025-10-14T19:14:15.740936] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-14T19:14:15.741009] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GNW took 45.5s. Estimated remaining: 3h 18m 21s. Rate: 7.1 symbols/min [2025-10-14T19:14:15.905287] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:15.911330] [DEBUG] [LOCAL ] GPJA: Loaded 4251 existing records from primary storage. [2025-10-14T19:14:15.911468] [INFO ] [MAIN ] GPJA: Loaded 4251 existing records. [2025-10-14T19:14:15.965082] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-14T19:14:16.090543] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:16.090785] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-14T19:14:16.090839] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-14T19:14:16.090975] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-14T19:14:16.091030] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-14T19:14:16.450849] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:16.706454] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T19:14:16.758032] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-14T19:14:17.533040] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:14:17.558020] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-14T19:14:17.956116] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T19:14:18.358081] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-14T19:14:18.877885] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-14T19:14:19.163298] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-14T19:14:19.193061] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T19:14:19.958137] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-14T19:14:20.256279] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T19:14:20.758077] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-14T19:14:21.388150] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T19:14:21.558066] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-14T19:14:22.364185] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-14T19:14:22.371928] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T19:14:22.666439] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T19:14:23.158105] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-14T19:14:23.199032] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T19:14:23.958082] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-14T19:14:24.551558] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T19:14:24.758030] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-14T19:14:25.154882] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T19:14:25.558096] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-14T19:14:26.072328] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T19:14:26.358092] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-14T19:14:26.393587] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T19:14:27.158076] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-14T19:14:27.226458] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T19:14:27.748981] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T19:14:27.958070] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-14T19:14:28.758077] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-14T19:14:29.333733] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T19:14:29.558039] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-14T19:14:30.182668] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T19:14:30.182810] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T19:14:30.358067] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-14T19:14:31.158063] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-14T19:14:31.785883] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T19:14:31.788699] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T19:14:31.794762] [INFO ] [REMOTE ] GOOS: Full fetch complete (64893 records). [2025-10-14T19:14:31.794852] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-14T19:14:31.963162] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-14T19:14:32.240242] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-14T19:14:32.240328] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-14T19:14:32.241383] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-14T19:14:32.241449] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-14T19:14:32.242939] [DEBUG] [LOCAL ] GOOS: Trimmed 64893 records to 44689 (keeping 200 days of data) [2025-10-14T19:14:32.496455] [DEBUG] [LOCAL ] GOOS: Primary data saved (44689 records). [2025-10-14T19:14:32.496576] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-14T19:14:32.496669] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GOOS took 31.2s. Estimated remaining: 3h 18m 25s. Rate: 7.1 symbols/min [2025-10-14T19:14:32.758039] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-14T19:14:32.813540] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T19:14:33.558092] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-14T19:14:34.109509] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T19:14:34.358027] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-14T19:14:34.601370] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T19:14:35.158087] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-14T19:14:35.552019] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T19:14:35.691142] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-14T19:14:35.958043] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-14T19:14:36.580823] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T19:14:36.758043] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-14T19:14:37.558073] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-14T19:14:37.839491] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T19:14:38.358100] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-14T19:14:38.901189] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T19:14:38.929229] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T19:14:39.158113] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-14T19:14:39.958054] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-14T19:14:40.474454] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T19:14:40.482102] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-14T19:14:40.483800] [INFO ] [REMOTE ] GOTU: Full fetch complete (58816 records). [2025-10-14T19:14:40.484114] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-14T19:14:40.768167] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-14T19:14:40.870305] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-14T19:14:40.870397] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-14T19:14:40.871238] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-14T19:14:40.871297] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-14T19:14:40.872349] [DEBUG] [LOCAL ] GOTU: Trimmed 58816 records to 37406 (keeping 200 days of data) [2025-10-14T19:14:41.075592] [DEBUG] [LOCAL ] GOTU: Primary data saved (37406 records). [2025-10-14T19:14:41.075743] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-14T19:14:41.075827] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GOTU took 36.9s. Estimated remaining: 3h 18m 17s. Rate: 7.1 symbols/min [2025-10-14T19:14:41.473224] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T19:14:41.558100] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-14T19:14:42.105525] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T19:14:42.106411] [INFO ] [REMOTE ] GPJA: Full fetch complete (7102 records). [2025-10-14T19:14:42.106516] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-14T19:14:42.363152] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-14T19:14:42.472694] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-14T19:14:42.472776] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-14T19:14:42.472958] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-14T19:14:42.473001] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-14T19:14:42.473388] [DEBUG] [LOCAL ] GPJA: Trimmed 7102 records to 4241 (keeping 200 days of data) [2025-10-14T19:14:42.498744] [DEBUG] [LOCAL ] GPJA: Primary data saved (4241 records). [2025-10-14T19:14:42.498814] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-14T19:14:42.498885] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPJA took 26.8s. Estimated remaining: 3h 17m 58s. Rate: 7.1 symbols/min [2025-10-14T19:14:43.348225] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T19:14:43.350538] [INFO ] [REMOTE ] GPI: Full fetch complete (21416 records). [2025-10-14T19:14:43.350616] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-14T19:14:43.720230] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-14T19:14:43.720306] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-14T19:14:43.720797] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-14T19:14:43.720857] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-14T19:14:43.721497] [DEBUG] [LOCAL ] GPI: Trimmed 21416 records to 14831 (keeping 200 days of data) [2025-10-14T19:14:43.813046] [DEBUG] [LOCAL ] GPI: Primary data saved (14831 records). [2025-10-14T19:14:43.813173] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-14T19:14:43.813249] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPI took 34.1s. Estimated remaining: 3h 17m 39s. Rate: 7.1 symbols/min [2025-10-14T19:14:44.373465] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:44.416148] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:44.483275] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:44.516734] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:14:44.560335] [DEBUG] [LOCAL ] GPMT: Loaded 25859 existing records from primary storage. [2025-10-14T19:14:44.560906] [INFO ] [MAIN ] GPMT: Loaded 25859 existing records. [2025-10-14T19:14:44.657812] [DEBUG] [LOCAL ] GPOR: Loaded 23188 existing records from primary storage. [2025-10-14T19:14:44.659038] [DEBUG] [LOCAL ] GPN: Loaded 52044 existing records from primary storage. [2025-10-14T19:14:44.669724] [INFO ] [MAIN ] GPOR: Loaded 23188 existing records. [2025-10-14T19:14:44.716090] [INFO ] [MAIN ] GPN: Loaded 52044 existing records. [2025-10-14T19:14:44.894755] [DEBUG] [LOCAL ] GPK: Loaded 52741 existing records from primary storage. [2025-10-14T19:14:44.962819] [INFO ] [MAIN ] GPK: Loaded 52741 existing records. [2025-10-14T19:14:45.005206] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:45.041793] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-14T19:14:45.110267] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-14T19:14:45.218679] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:45.244474] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-14T19:14:45.229030] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-14T19:14:45.275280] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-14T19:14:45.280146] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:45.280691] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-14T19:14:45.275456] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-14T19:14:45.321755] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-14T19:14:45.356301] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-14T19:14:45.383128] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-14T19:14:45.399841] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-14T19:14:45.413439] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-14T19:14:45.560498] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:14:45.632040] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-14T19:14:45.685344] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-14T19:14:45.715147] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-14T19:14:45.791723] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-14T19:14:46.429602] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:46.574902] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-14T19:14:46.621763] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:46.678527] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-14T19:14:46.823825] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:46.836839] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-14T19:14:46.861010] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:14:46.861259] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-14T19:14:47.834688] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:14:47.840534] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-14T19:14:47.938234] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T19:14:47.944330] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-14T19:14:48.098314] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T19:14:48.111926] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-14T19:14:48.152581] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T19:14:48.758030] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-14T19:14:48.998379] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T19:14:49.199279] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T19:14:49.407232] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T19:14:49.558067] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-14T19:14:49.991399] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:14:50.226343] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T19:14:50.358109] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-14T19:14:51.158082] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-14T19:14:51.429291] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T19:14:51.958034] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-14T19:14:52.645158] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T19:14:52.758050] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-14T19:14:53.212105] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T19:14:53.558087] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-14T19:14:54.182639] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T19:14:54.358061] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-14T19:14:55.107990] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T19:14:55.158028] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-14T19:14:55.727946] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T19:14:55.958072] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-14T19:14:56.540484] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T19:14:56.758065] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-14T19:14:57.272903] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T19:14:57.558080] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-14T19:14:58.288889] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T19:14:58.358035] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-14T19:14:59.158086] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-14T19:14:59.216031] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T19:14:59.731553] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T19:14:59.958099] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-14T19:15:00.758078] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-14T19:15:00.831797] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T19:15:00.856377] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-14T19:15:01.558071] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-14T19:15:02.358090] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-14T19:15:02.473923] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:15:03.158050] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-14T19:15:03.296140] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T19:15:03.327541] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T19:15:03.958128] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-14T19:15:04.758073] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-14T19:15:04.984028] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T19:15:05.558124] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-14T19:15:05.818351] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T19:15:05.839848] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T19:15:06.358159] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-14T19:15:07.145107] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T19:15:07.158035] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-14T19:15:07.299226] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T19:15:07.958043] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-14T19:15:08.282897] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T19:15:08.758085] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-14T19:15:09.281296] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T19:15:09.558089] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-14T19:15:09.625879] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T19:15:10.358098] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-14T19:15:11.158040] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-14T19:15:11.261588] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T19:15:11.382533] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T19:15:11.385237] [INFO ] [REMOTE ] GPMT: Full fetch complete (36847 records). [2025-10-14T19:15:11.385334] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-14T19:15:11.808161] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-14T19:15:11.808291] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-14T19:15:11.809420] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-14T19:15:11.809516] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-14T19:15:11.810949] [DEBUG] [LOCAL ] GPMT: Trimmed 36847 records to 25901 (keeping 200 days of data) [2025-10-14T19:15:11.960369] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-14T19:15:12.019992] [DEBUG] [LOCAL ] GPMT: Primary data saved (25901 records). [2025-10-14T19:15:12.020156] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-14T19:15:12.020245] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPMT took 28.2s. Estimated remaining: 3h 17m 60s. Rate: 7.1 symbols/min [2025-10-14T19:15:12.217272] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T19:15:12.295416] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:12.349465] [DEBUG] [LOCAL ] GPRK: Loaded 39556 existing records from primary storage. [2025-10-14T19:15:12.349939] [INFO ] [MAIN ] GPRK: Loaded 39556 existing records. [2025-10-14T19:15:12.547821] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:12.548092] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-14T19:15:12.548142] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-14T19:15:12.548401] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-14T19:15:12.548443] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-14T19:15:12.769879] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-14T19:15:12.976966] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:13.558086] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-14T19:15:13.874152] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T19:15:14.358083] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-14T19:15:14.456347] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T19:15:14.462119] [INFO ] [REMOTE ] GPN: Full fetch complete (75107 records). [2025-10-14T19:15:14.462269] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-14T19:15:14.829519] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T19:15:14.875357] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-14T19:15:14.875548] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-14T19:15:14.876540] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-14T19:15:14.876622] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-14T19:15:14.878341] [DEBUG] [LOCAL ] GPN: Trimmed 75107 records to 52040 (keeping 200 days of data) [2025-10-14T19:15:15.161986] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-14T19:15:15.201858] [DEBUG] [LOCAL ] GPN: Primary data saved (52040 records). [2025-10-14T19:15:15.202002] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-14T19:15:15.202080] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPN took 31.4s. Estimated remaining: 3h 17m 44s. Rate: 7.1 symbols/min [2025-10-14T19:15:15.368784] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:15.393468] [DEBUG] [LOCAL ] GRBK: Loaded 27134 existing records from primary storage. [2025-10-14T19:15:15.393744] [INFO ] [MAIN ] GRBK: Loaded 27134 existing records. [2025-10-14T19:15:15.568227] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:15.568474] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-14T19:15:15.568537] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-14T19:15:15.568830] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-14T19:15:15.568879] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-14T19:15:15.923600] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:15.966168] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-14T19:15:15.968322] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T19:15:15.975633] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T19:15:16.758096] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-14T19:15:17.054569] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:15:17.558061] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-14T19:15:18.358077] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-14T19:15:18.448956] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T19:15:18.455011] [INFO ] [REMOTE ] GPK: Full fetch complete (75849 records). [2025-10-14T19:15:18.455148] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-14T19:15:18.836538] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T19:15:18.892092] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-14T19:15:18.892179] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-14T19:15:18.893142] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-14T19:15:18.893206] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-14T19:15:18.894542] [DEBUG] [LOCAL ] GPK: Trimmed 75849 records to 52763 (keeping 200 days of data) [2025-10-14T19:15:19.158112] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-14T19:15:19.242206] [DEBUG] [LOCAL ] GPK: Primary data saved (52763 records). [2025-10-14T19:15:19.242326] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-14T19:15:19.242396] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPK took 35.4s. Estimated remaining: 3h 17m 29s. Rate: 7.1 symbols/min [2025-10-14T19:15:19.440760] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:19.451635] [DEBUG] [LOCAL ] GRC: Loaded 9233 existing records from primary storage. [2025-10-14T19:15:19.451895] [INFO ] [MAIN ] GRC: Loaded 9233 existing records. [2025-10-14T19:15:19.632474] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:19.632742] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-14T19:15:19.632818] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-14T19:15:19.633157] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-14T19:15:19.633286] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-14T19:15:19.755107] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:15:19.967013] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-14T19:15:20.022550] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:20.031466] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T19:15:20.034420] [INFO ] [REMOTE ] GPOR: Full fetch complete (35121 records). [2025-10-14T19:15:20.034497] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-14T19:15:20.402465] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-14T19:15:20.402559] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-14T19:15:20.403243] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-14T19:15:20.403307] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-14T19:15:20.404332] [DEBUG] [LOCAL ] GPOR: Trimmed 35121 records to 23269 (keeping 200 days of data) [2025-10-14T19:15:20.542796] [DEBUG] [LOCAL ] GPOR: Primary data saved (23269 records). [2025-10-14T19:15:20.542929] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-14T19:15:20.543007] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPOR took 36.7s. Estimated remaining: 3h 17m 10s. Rate: 7.1 symbols/min [2025-10-14T19:15:20.710085] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:20.730033] [DEBUG] [LOCAL ] GRDN: Loaded 20887 existing records from primary storage. [2025-10-14T19:15:20.730253] [INFO ] [MAIN ] GRDN: Loaded 20887 existing records. [2025-10-14T19:15:20.763169] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-14T19:15:20.909113] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:20.909341] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-14T19:15:20.909387] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-14T19:15:20.909562] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-14T19:15:20.909616] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-14T19:15:21.264165] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:21.317044] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T19:15:21.463197] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T19:15:21.558053] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-14T19:15:22.358048] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-14T19:15:22.583679] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T19:15:22.821554] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T19:15:23.158101] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-14T19:15:23.958074] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-14T19:15:24.721571] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T19:15:24.747949] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T19:15:24.758033] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-14T19:15:25.558083] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-14T19:15:25.873333] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T19:15:26.358047] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-14T19:15:26.809539] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T19:15:27.158073] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-14T19:15:27.581556] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T19:15:27.958057] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-14T19:15:28.392890] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T19:15:28.758080] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-14T19:15:29.434580] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T19:15:29.451465] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T19:15:29.558018] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-14T19:15:30.358108] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-14T19:15:31.054824] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T19:15:31.103520] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T19:15:31.158037] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-14T19:15:31.958100] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-14T19:15:32.486778] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T19:15:32.705756] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T19:15:32.758033] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-14T19:15:33.558080] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-14T19:15:33.659501] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T19:15:34.358060] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-14T19:15:34.456688] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T19:15:35.158077] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-14T19:15:35.278115] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-14T19:15:35.958061] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-14T19:15:36.663072] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T19:15:36.758107] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-14T19:15:36.786709] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T19:15:37.558047] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-14T19:15:37.586034] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T19:15:38.358059] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-14T19:15:39.018497] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T19:15:39.158154] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-14T19:15:39.356079] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T19:15:39.958063] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-14T19:15:40.758079] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-14T19:15:40.943731] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T19:15:41.167138] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:15:41.234233] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-14T19:15:41.558066] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-14T19:15:42.108119] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T19:15:42.358107] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-14T19:15:43.158064] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-14T19:15:43.912866] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T19:15:43.958071] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-14T19:15:44.305947] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T19:15:44.758069] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-14T19:15:44.963672] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T19:15:45.558073] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-14T19:15:45.847095] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T19:15:46.018717] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T19:15:46.358059] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-14T19:15:47.158050] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-14T19:15:47.556252] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T19:15:47.958056] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-14T19:15:48.326982] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T19:15:48.331639] [INFO ] [REMOTE ] GPRK: Full fetch complete (57971 records). [2025-10-14T19:15:48.331791] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-14T19:15:48.722245] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-14T19:15:48.722349] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-14T19:15:48.723253] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-14T19:15:48.723314] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-14T19:15:48.724480] [DEBUG] [LOCAL ] GPRK: Trimmed 57971 records to 39628 (keeping 200 days of data) [2025-10-14T19:15:48.772061] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-14T19:15:48.953809] [DEBUG] [LOCAL ] GPRK: Primary data saved (39628 records). [2025-10-14T19:15:48.953938] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-14T19:15:48.954014] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GPRK took 36.9s. Estimated remaining: 3h 17m 31s. Rate: 7.1 symbols/min [2025-10-14T19:15:49.128476] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:49.170426] [DEBUG] [LOCAL ] GRMN: Loaded 40513 existing records from primary storage. [2025-10-14T19:15:49.170746] [INFO ] [MAIN ] GRMN: Loaded 40513 existing records. [2025-10-14T19:15:49.370626] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:15:49.369375] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:49.371040] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-14T19:15:49.376465] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-14T19:15:49.377437] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-14T19:15:49.377523] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-14T19:15:49.566044] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-14T19:15:49.736612] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:49.833959] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:15:50.127194] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T19:15:50.358067] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-14T19:15:51.158119] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-14T19:15:51.958086] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-14T19:15:52.073964] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T19:15:52.297916] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T19:15:52.303199] [INFO ] [REMOTE ] GRBK: Full fetch complete (40580 records). [2025-10-14T19:15:52.303298] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-14T19:15:52.667254] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T19:15:52.700875] [INFO ] [REMOTE ] GRC: Full fetch complete (13316 records). [2025-10-14T19:15:52.701019] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-14T19:15:52.701093] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-14T19:15:52.701149] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-14T19:15:52.702271] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-14T19:15:52.702358] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-14T19:15:52.766026] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-14T19:15:52.812529] [DEBUG] [LOCAL ] GRBK: Trimmed 40580 records to 27177 (keeping 200 days of data) [2025-10-14T19:15:53.225112] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-14T19:15:53.225547] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-14T19:15:53.226687] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-14T19:15:53.226779] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-14T19:15:53.253465] [DEBUG] [LOCAL ] GRC: Trimmed 13316 records to 9280 (keeping 200 days of data) [2025-10-14T19:15:53.322704] [DEBUG] [LOCAL ] GRBK: Primary data saved (27177 records). [2025-10-14T19:15:53.324686] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-14T19:15:53.325335] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 38.1s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-14T19:15:53.506111] [DEBUG] [LOCAL ] GRC: Primary data saved (9280 records). [2025-10-14T19:15:53.509686] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-14T19:15:53.509855] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRC took 34.3s. Estimated remaining: 3h 16m 56s. Rate: 7.1 symbols/min [2025-10-14T19:15:53.509417] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:53.568045] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-14T19:15:53.692528] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:15:53.725706] [DEBUG] [LOCAL ] GRND: Loaded 50041 existing records from primary storage. [2025-10-14T19:15:53.734995] [INFO ] [MAIN ] GRND: Loaded 50041 existing records. [2025-10-14T19:15:53.918984] [DEBUG] [LOCAL ] GRNT: Loaded 33945 existing records from primary storage. [2025-10-14T19:15:53.950404] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:53.951040] [INFO ] [MAIN ] GRNT: Loaded 33945 existing records. [2025-10-14T19:15:53.963942] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-14T19:15:53.964175] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-14T19:15:54.055872] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-14T19:15:54.068616] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-14T19:15:54.230890] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:15:54.260192] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-14T19:15:54.260408] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-14T19:15:54.271263] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-14T19:15:54.276531] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-14T19:15:54.581171] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T19:15:54.734556] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:54.734932] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-14T19:15:54.901626] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T19:15:54.967936] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:15:55.158074] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-14T19:15:55.958037] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-14T19:15:56.450292] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T19:15:56.638294] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T19:15:56.758038] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-14T19:15:57.209382] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T19:15:57.558104] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-14T19:15:58.015950] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T19:15:58.358045] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-14T19:15:59.158065] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-14T19:15:59.304832] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:15:59.568672] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T19:15:59.958066] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-14T19:16:00.285481] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T19:16:00.289543] [INFO ] [REMOTE ] GRDN: Full fetch complete (26286 records). [2025-10-14T19:16:00.289702] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-14T19:16:00.692521] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-14T19:16:00.692595] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-14T19:16:00.693135] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-14T19:16:00.693195] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-14T19:16:00.693965] [DEBUG] [LOCAL ] GRDN: Trimmed 26286 records to 20872 (keeping 200 days of data) [2025-10-14T19:16:00.773480] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-14T19:16:00.813394] [DEBUG] [LOCAL ] GRDN: Primary data saved (20872 records). [2025-10-14T19:16:00.813534] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-14T19:16:00.813613] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRDN took 40.3s. Estimated remaining: 3h 16m 46s. Rate: 7.1 symbols/min [2025-10-14T19:16:00.984682] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:00.995231] [DEBUG] [LOCAL ] GROV: Loaded 8755 existing records from primary storage. [2025-10-14T19:16:00.996119] [INFO ] [MAIN ] GROV: Loaded 8755 existing records. [2025-10-14T19:16:01.176394] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:01.176593] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-14T19:16:01.176660] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-14T19:16:01.176834] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-14T19:16:01.176874] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-14T19:16:01.554885] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T19:16:01.563035] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-14T19:16:01.599062] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:02.358120] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-14T19:16:02.511455] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T19:16:03.158081] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-14T19:16:03.346471] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T19:16:03.365768] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T19:16:03.958055] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-14T19:16:04.759743] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-14T19:16:04.769391] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T19:16:05.558056] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-14T19:16:05.721925] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T19:16:05.939453] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T19:16:06.126404] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T19:16:06.358101] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-14T19:16:07.158102] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-14T19:16:07.721394] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T19:16:07.927794] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T19:16:07.958046] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-14T19:16:08.710431] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T19:16:08.758090] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-14T19:16:09.558055] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-14T19:16:09.637096] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T19:16:10.358117] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-14T19:16:11.154075] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T19:16:11.163772] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-14T19:16:11.793862] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T19:16:11.958054] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-14T19:16:12.638461] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:16:12.758046] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-14T19:16:13.232225] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T19:16:13.558028] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-14T19:16:14.005626] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T19:16:14.186590] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T19:16:14.358078] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-14T19:16:15.158078] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-14T19:16:15.654040] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-14T19:16:15.924566] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T19:16:15.958086] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-14T19:16:16.758070] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-14T19:16:17.558120] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-14T19:16:17.701882] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T19:16:17.846563] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T19:16:18.358126] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-14T19:16:19.163509] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-14T19:16:19.169909] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T19:16:19.224511] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T19:16:19.958062] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-14T19:16:20.545894] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T19:16:20.758106] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-14T19:16:21.523770] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T19:16:21.558035] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-14T19:16:21.727336] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T19:16:22.358062] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-14T19:16:23.027674] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T19:16:23.158069] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-14T19:16:23.619286] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T19:16:23.825823] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T19:16:23.958067] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-14T19:16:24.721678] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T19:16:24.723886] [INFO ] [REMOTE ] GROV: Full fetch complete (14098 records). [2025-10-14T19:16:24.724023] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-14T19:16:24.763575] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-14T19:16:25.085693] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-14T19:16:25.085791] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-14T19:16:25.086120] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-14T19:16:25.086161] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-14T19:16:25.086621] [DEBUG] [LOCAL ] GROV: Trimmed 14098 records to 8717 (keeping 200 days of data) [2025-10-14T19:16:25.134868] [DEBUG] [LOCAL ] GROV: Primary data saved (8717 records). [2025-10-14T19:16:25.135005] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-14T19:16:25.135091] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GROV took 24.3s. Estimated remaining: 3h 17m 0s. Rate: 7.1 symbols/min [2025-10-14T19:16:25.331465] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:25.338494] [DEBUG] [LOCAL ] GRX: Loaded 4762 existing records from primary storage. [2025-10-14T19:16:25.338675] [INFO ] [MAIN ] GRX: Loaded 4762 existing records. [2025-10-14T19:16:25.513420] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:25.513676] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-14T19:16:25.513747] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-14T19:16:25.513900] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-14T19:16:25.513946] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-14T19:16:25.569852] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-14T19:16:25.916209] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:26.318107] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T19:16:26.358034] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-14T19:16:27.158092] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-14T19:16:27.185819] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:16:27.191719] [INFO ] [REMOTE ] GRND: Full fetch complete (71452 records). [2025-10-14T19:16:27.191828] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-14T19:16:27.586665] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-14T19:16:27.586814] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-14T19:16:27.587861] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-14T19:16:27.587927] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-14T19:16:27.589446] [DEBUG] [LOCAL ] GRND: Trimmed 71452 records to 50090 (keeping 200 days of data) [2025-10-14T19:16:27.687955] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T19:16:27.696127] [INFO ] [REMOTE ] GRMN: Full fetch complete (59699 records). [2025-10-14T19:16:27.697115] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-14T19:16:27.703299] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T19:16:27.961633] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-14T19:16:28.204351] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-14T19:16:28.204725] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-14T19:16:28.205896] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-14T19:16:28.206237] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-14T19:16:28.212917] [DEBUG] [LOCAL ] GRMN: Trimmed 59699 records to 40470 (keeping 200 days of data) [2025-10-14T19:16:28.500510] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T19:16:28.520615] [DEBUG] [LOCAL ] GRND: Primary data saved (50090 records). [2025-10-14T19:16:28.527180] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-14T19:16:28.530777] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GRND took 35.2s. Estimated remaining: 3h 16m 45s. Rate: 7.1 symbols/min [2025-10-14T19:16:28.725041] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:28.734175] [DEBUG] [LOCAL ] GRMN: Primary data saved (40470 records). [2025-10-14T19:16:28.734317] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-14T19:16:28.734405] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRMN took 39.8s. Estimated remaining: 3h 16m 24s. Rate: 7.1 symbols/min [2025-10-14T19:16:28.763966] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-14T19:16:28.913030] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:28.948858] [DEBUG] [LOCAL ] GS: Loaded 51775 existing records from primary storage. [2025-10-14T19:16:28.949338] [INFO ] [MAIN ] GS: Loaded 51775 existing records. [2025-10-14T19:16:29.143290] [DEBUG] [LOCAL ] GSBD: Loaded 39619 existing records from primary storage. [2025-10-14T19:16:29.153783] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:29.154402] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-14T19:16:29.154477] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-14T19:16:29.154218] [INFO ] [MAIN ] GSBD: Loaded 39619 existing records. [2025-10-14T19:16:29.187141] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-14T19:16:29.219923] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-14T19:16:29.291241] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T19:16:29.571110] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-14T19:16:29.585904] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:29.638067] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-14T19:16:29.660562] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-14T19:16:29.666454] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-14T19:16:29.671688] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-14T19:16:29.851113] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:30.101420] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:30.185457] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:16:30.358069] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-14T19:16:31.158061] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-14T19:16:31.748281] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T19:16:31.901864] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T19:16:31.958021] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-14T19:16:32.758109] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-14T19:16:33.379522] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T19:16:33.486672] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T19:16:33.558054] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-14T19:16:33.943480] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-14T19:16:34.358062] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-14T19:16:35.158069] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-14T19:16:35.724682] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T19:16:35.795155] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T19:16:35.958033] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-14T19:16:36.540816] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T19:16:36.758070] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-14T19:16:37.558044] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-14T19:16:38.107685] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T19:16:38.274570] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T19:16:38.358027] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-14T19:16:39.006981] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T19:16:39.008342] [INFO ] [REMOTE ] GRX: Full fetch complete (6535 records). [2025-10-14T19:16:39.008408] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-14T19:16:39.163202] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-14T19:16:39.370729] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-14T19:16:39.370808] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-14T19:16:39.370962] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-14T19:16:39.370998] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-14T19:16:39.371354] [DEBUG] [LOCAL ] GRX: Trimmed 6535 records to 4788 (keeping 200 days of data) [2025-10-14T19:16:39.399297] [DEBUG] [LOCAL ] GRX: Primary data saved (4788 records). [2025-10-14T19:16:39.399374] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-14T19:16:39.399444] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 14.3s. Estimated remaining: 3h 16m 19s. Rate: 7.1 symbols/min [2025-10-14T19:16:39.564435] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:39.615737] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-14T19:16:39.616056] [INFO ] [MAIN ] GSK: Loaded 53502 existing records. [2025-10-14T19:16:39.791433] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:39.791637] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-14T19:16:39.791723] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-14T19:16:39.792159] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-14T19:16:39.792214] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-14T19:16:39.965781] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-14T19:16:40.163624] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:40.758140] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-14T19:16:41.346046] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-14T19:16:41.558067] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-14T19:16:41.686518] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T19:16:42.051338] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T19:16:42.055120] [INFO ] [REMOTE ] GRNT: Full fetch complete (48296 records). [2025-10-14T19:16:42.055206] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-14T19:16:42.363135] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-14T19:16:42.428530] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-14T19:16:42.428600] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-14T19:16:42.429355] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-14T19:16:42.429414] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-14T19:16:42.430351] [DEBUG] [LOCAL ] GRNT: Trimmed 48296 records to 33969 (keeping 200 days of data) [2025-10-14T19:16:42.619895] [DEBUG] [LOCAL ] GRNT: Primary data saved (33969 records). [2025-10-14T19:16:42.620020] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-14T19:16:42.620097] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GRNT took 49.1s. Estimated remaining: 3h 16m 3s. Rate: 7.1 symbols/min [2025-10-14T19:16:42.785466] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:42.816843] [DEBUG] [LOCAL ] GSL: Loaded 33280 existing records from primary storage. [2025-10-14T19:16:42.817102] [INFO ] [MAIN ] GSL: Loaded 33280 existing records. [2025-10-14T19:16:42.993889] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:42.994102] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-14T19:16:42.994148] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-14T19:16:42.994457] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-14T19:16:42.994513] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-14T19:16:43.163544] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-14T19:16:43.346512] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:43.807557] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-14T19:16:43.964927] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-14T19:16:43.969728] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T19:16:44.758072] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-14T19:16:45.138859] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T19:16:45.252221] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T19:16:45.558037] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-14T19:16:46.358035] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-14T19:16:46.637302] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T19:16:47.113738] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T19:16:47.158027] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-14T19:16:47.345959] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T19:16:47.958116] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-14T19:16:48.356461] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T19:16:48.758061] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-14T19:16:49.558066] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-14T19:16:49.602334] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T19:16:49.861272] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T19:16:50.358095] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-14T19:16:50.500603] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T19:16:51.158069] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-14T19:16:51.800754] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T19:16:51.958046] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-14T19:16:52.758120] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-14T19:16:53.083237] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T19:16:53.558042] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-14T19:16:53.740552] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T19:16:54.229928] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T19:16:54.358094] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-14T19:16:54.936825] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T19:16:55.158106] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-14T19:16:55.515021] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T19:16:55.958117] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-14T19:16:56.758073] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-14T19:16:56.990374] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T19:16:57.334867] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T19:16:57.339931] [INFO ] [REMOTE ] GSBD: Full fetch complete (58707 records). [2025-10-14T19:16:57.340024] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-14T19:16:57.564949] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-14T19:16:57.741234] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-14T19:16:57.741306] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-14T19:16:57.742156] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-14T19:16:57.742216] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-14T19:16:57.743285] [DEBUG] [LOCAL ] GSBD: Trimmed 58707 records to 39648 (keeping 200 days of data) [2025-10-14T19:16:57.977289] [DEBUG] [LOCAL ] GSBD: Primary data saved (39648 records). [2025-10-14T19:16:57.977415] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-14T19:16:57.977489] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSBD took 29.2s. Estimated remaining: 3h 16m 5s. Rate: 7.1 symbols/min [2025-10-14T19:16:58.145184] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:16:58.190400] [DEBUG] [LOCAL ] GTES: Loaded 50407 existing records from primary storage. [2025-10-14T19:16:58.190720] [INFO ] [MAIN ] GTES: Loaded 50407 existing records. [2025-10-14T19:16:58.367032] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:16:58.363004] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-14T19:16:58.368130] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-14T19:16:58.368199] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-14T19:16:58.368573] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-14T19:16:58.368625] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-14T19:16:58.750343] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:16:58.916042] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T19:16:59.158045] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-14T19:16:59.543209] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T19:16:59.580818] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T19:16:59.958112] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-14T19:17:00.758076] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-14T19:17:01.084567] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T19:17:01.304482] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T19:17:01.558056] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-14T19:17:02.089304] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T19:17:02.358094] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-14T19:17:03.158048] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-14T19:17:03.571680] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T19:17:03.942527] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T19:17:03.958025] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-14T19:17:04.407486] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T19:17:04.758052] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-14T19:17:05.558051] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-14T19:17:05.874671] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T19:17:06.358082] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-14T19:17:06.920364] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T19:17:06.975265] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-14T19:17:07.158115] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-14T19:17:07.958059] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-14T19:17:08.282330] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T19:17:08.338707] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T19:17:08.758091] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-14T19:17:09.558086] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-14T19:17:09.610023] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T19:17:09.947988] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T19:17:10.358078] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-14T19:17:11.139146] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T19:17:11.158082] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-14T19:17:11.958063] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-14T19:17:12.122066] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T19:17:12.585436] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T19:17:12.758111] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-14T19:17:13.259416] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T19:17:13.263832] [INFO ] [REMOTE ] GSL: Full fetch complete (48172 records). [2025-10-14T19:17:13.264029] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-14T19:17:13.566163] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-14T19:17:13.858990] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-14T19:17:13.859115] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-14T19:17:13.860291] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-14T19:17:13.860372] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-14T19:17:13.861905] [DEBUG] [LOCAL ] GSL: Trimmed 48172 records to 33267 (keeping 200 days of data) [2025-10-14T19:17:14.098533] [DEBUG] [LOCAL ] GSL: Primary data saved (33267 records). [2025-10-14T19:17:14.098726] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-14T19:17:14.098839] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSL took 31.5s. Estimated remaining: 3h 16m 7s. Rate: 7.1 symbols/min [2025-10-14T19:17:14.298711] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:17:14.350081] [DEBUG] [LOCAL ] GTLS: Loaded 43230 existing records from primary storage. [2025-10-14T19:17:14.350531] [INFO ] [MAIN ] GTLS: Loaded 43230 existing records. [2025-10-14T19:17:14.364486] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-14T19:17:14.548065] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:17:14.548307] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-14T19:17:14.548396] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-14T19:17:14.548929] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-14T19:17:14.548987] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-14T19:17:14.815662] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T19:17:14.944246] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:17:15.082192] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:17:15.088008] [INFO ] [REMOTE ] GS: Full fetch complete (75775 records). [2025-10-14T19:17:15.088122] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-14T19:17:15.163585] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-14T19:17:15.480436] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-14T19:17:15.480517] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-14T19:17:15.481513] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-14T19:17:15.481586] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-14T19:17:15.483146] [DEBUG] [LOCAL ] GS: Trimmed 75775 records to 51784 (keeping 200 days of data) [2025-10-14T19:17:15.812451] [DEBUG] [LOCAL ] GS: Primary data saved (51784 records). [2025-10-14T19:17:15.812587] [INFO ] [MAIN ] GS: Full history saved. [2025-10-14T19:17:15.812683] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GS took 47.3s. Estimated remaining: 3h 15m 49s. Rate: 7.1 symbols/min [2025-10-14T19:17:15.963142] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-14T19:17:15.987029] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:17:16.028732] [DEBUG] [LOCAL ] GTN: Loaded 45242 existing records from primary storage. [2025-10-14T19:17:16.029026] [INFO ] [MAIN ] GTN: Loaded 45242 existing records. [2025-10-14T19:17:16.220721] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:17:16.220973] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-14T19:17:16.221052] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-14T19:17:16.221328] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-14T19:17:16.221459] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-14T19:17:16.366136] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T19:17:16.653701] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:17:16.683373] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T19:17:16.758031] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-14T19:17:17.565184] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-14T19:17:17.581786] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T19:17:18.356774] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T19:17:18.366717] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-14T19:17:19.003717] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T19:17:19.158073] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-14T19:17:19.958031] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-14T19:17:20.322135] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-14T19:17:20.328620] [INFO ] [REMOTE ] GSK: Full fetch complete (77630 records). [2025-10-14T19:17:20.343232] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-14T19:17:20.354382] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T19:17:20.764839] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-14T19:17:20.789954] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-14T19:17:20.790055] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-14T19:17:20.791115] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-14T19:17:20.791315] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-14T19:17:20.792910] [DEBUG] [LOCAL ] GSK: Trimmed 77630 records to 53502 (keeping 200 days of data) [2025-10-14T19:17:21.118857] [DEBUG] [LOCAL ] GSK: Primary data saved (53502 records). [2025-10-14T19:17:21.119008] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-14T19:17:21.119089] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GSK took 41.7s. Estimated remaining: 3h 15m 36s. Rate: 7.1 symbols/min [2025-10-14T19:17:21.295022] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:17:21.322281] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T19:17:21.351283] [DEBUG] [LOCAL ] GTY: Loaded 30265 existing records from primary storage. [2025-10-14T19:17:21.351539] [INFO ] [MAIN ] GTY: Loaded 30265 existing records. [2025-10-14T19:17:21.524954] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:17:21.525156] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-14T19:17:21.525203] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-14T19:17:21.525784] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-14T19:17:21.525841] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-14T19:17:21.568122] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-14T19:17:21.884751] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:17:22.358070] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-14T19:17:22.415002] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T19:17:23.008288] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T19:17:23.158058] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-14T19:17:23.178241] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T19:17:23.958149] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-14T19:17:24.758087] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-14T19:17:24.942627] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T19:17:25.558104] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-14T19:17:25.648447] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T19:17:25.727585] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T19:17:26.358107] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-14T19:17:27.106450] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T19:17:27.158063] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-14T19:17:27.243045] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T19:17:27.958069] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-14T19:17:28.758095] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-14T19:17:28.797842] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T19:17:29.323674] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T19:17:29.558034] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-14T19:17:30.012715] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T19:17:30.358109] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-14T19:17:30.956930] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T19:17:31.158059] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-14T19:17:31.519491] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T19:17:31.958060] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-14T19:17:32.765254] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-14T19:17:32.767304] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T19:17:32.773359] [INFO ] [REMOTE ] GTES: Full fetch complete (73901 records). [2025-10-14T19:17:32.773478] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-14T19:17:33.183907] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-14T19:17:33.184013] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-14T19:17:33.185317] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-14T19:17:33.185416] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-14T19:17:33.186962] [DEBUG] [LOCAL ] GTES: Trimmed 73901 records to 50384 (keeping 200 days of data) [2025-10-14T19:17:33.493088] [DEBUG] [LOCAL ] GTES: Primary data saved (50384 records). [2025-10-14T19:17:33.493489] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-14T19:17:33.493585] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTES took 35.5s. Estimated remaining: 3h 15m 34s. Rate: 7.1 symbols/min [2025-10-14T19:17:33.559327] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-14T19:17:33.604603] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T19:17:33.704933] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:17:33.717588] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-10-14T19:17:33.717855] [INFO ] [MAIN ] GUG: Loaded 12212 existing records. [2025-10-14T19:17:33.893196] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:17:33.893417] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-14T19:17:33.893464] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-14T19:17:33.893848] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-14T19:17:33.893905] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-14T19:17:34.251149] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:17:34.283059] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T19:17:34.358063] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-14T19:17:34.520353] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T19:17:35.158052] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-14T19:17:35.682190] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T19:17:35.958045] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-14T19:17:36.723680] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T19:17:36.758034] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-14T19:17:37.219802] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T19:17:37.558065] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-14T19:17:38.253024] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T19:17:38.358068] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-14T19:17:38.732253] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T19:17:39.158134] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-14T19:17:39.813238] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:17:39.818207] [INFO ] [REMOTE ] GTN: Full fetch complete (66206 records). [2025-10-14T19:17:39.818339] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-14T19:17:39.962277] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-14T19:17:40.221133] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-14T19:17:40.217886] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T19:17:40.225590] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-14T19:17:40.226534] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-14T19:17:40.226593] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-14T19:17:40.227931] [DEBUG] [LOCAL ] GTN: Trimmed 66206 records to 45235 (keeping 200 days of data) [2025-10-14T19:17:40.481977] [DEBUG] [LOCAL ] GTN: Primary data saved (45235 records). [2025-10-14T19:17:40.482106] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-14T19:17:40.482189] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 24.7s. Estimated remaining: 3h 15m 23s. Rate: 7.1 symbols/min [2025-10-14T19:17:40.652768] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:17:40.669184] [DEBUG] [LOCAL ] GUT: Loaded 15567 existing records from primary storage. [2025-10-14T19:17:40.669413] [INFO ] [MAIN ] GUT: Loaded 15567 existing records. [2025-10-14T19:17:40.766978] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-14T19:17:40.847013] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:17:40.847258] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-14T19:17:40.847306] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-14T19:17:40.847510] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-14T19:17:40.847566] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-14T19:17:41.209232] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:17:41.485512] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T19:17:41.558072] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-14T19:17:42.351274] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T19:17:42.359535] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-14T19:17:42.478505] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T19:17:43.158072] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-14T19:17:43.404733] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T19:17:43.958053] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-14T19:17:44.758045] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-14T19:17:44.793368] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T19:17:44.828002] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T19:17:45.308441] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T19:17:45.558045] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-14T19:17:46.358077] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-14T19:17:46.584385] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T19:17:47.158038] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-14T19:17:47.181348] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T19:17:47.958087] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-14T19:17:48.014190] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T19:17:48.758059] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-14T19:17:49.522736] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T19:17:49.558033] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-14T19:17:49.725846] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T19:17:50.358089] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-14T19:17:51.048842] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T19:17:51.053709] [INFO ] [REMOTE ] GTLS: Full fetch complete (61551 records). [2025-10-14T19:17:51.053804] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-14T19:17:51.163274] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-14T19:17:51.439734] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-14T19:17:51.439813] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-14T19:17:51.440714] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-14T19:17:51.440774] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-14T19:17:51.441931] [DEBUG] [LOCAL ] GTLS: Trimmed 61551 records to 43298 (keeping 200 days of data) [2025-10-14T19:17:51.554200] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T19:17:51.721410] [DEBUG] [LOCAL ] GTLS: Primary data saved (43298 records). [2025-10-14T19:17:51.721562] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-14T19:17:51.721688] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTLS took 37.6s. Estimated remaining: 3h 15m 19s. Rate: 7.1 symbols/min [2025-10-14T19:17:51.890105] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:17:51.890306] [DEBUG] [LOCAL ] GVA: No existing data file found in primary storage. [2025-10-14T19:17:51.890343] [WARN ] [MAIN ] GVA: No existing data found, performing full refresh instead. [2025-10-14T19:17:51.890451] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-14T19:17:51.890492] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-14T19:17:51.890531] [DEBUG] [LOCAL ] GVA: No primary data file found to delete. [2025-10-14T19:17:51.890560] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-14T19:17:51.963276] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-14T19:17:52.246731] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T19:17:52.259854] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:17:52.758074] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-14T19:17:53.169253] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T19:17:53.558099] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-14T19:17:53.828839] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T19:17:54.320532] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T19:17:54.358112] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-14T19:17:55.158074] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-14T19:17:55.756599] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:17:55.932026] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T19:17:55.958030] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-14T19:17:56.758026] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-14T19:17:57.162399] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T19:17:57.478370] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T19:17:57.558063] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-14T19:17:58.358127] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-14T19:17:58.372503] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T19:17:59.158053] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-14T19:17:59.291808] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T19:17:59.958063] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-14T19:18:00.424157] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T19:18:00.427847] [INFO ] [REMOTE ] GTY: Full fetch complete (43852 records). [2025-10-14T19:18:00.427938] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-14T19:18:00.763353] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-14T19:18:00.811265] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-14T19:18:00.811352] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-14T19:18:00.812157] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-14T19:18:00.812220] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-14T19:18:00.813127] [DEBUG] [LOCAL ] GTY: Trimmed 43852 records to 30186 (keeping 200 days of data) [2025-10-14T19:18:00.998720] [DEBUG] [LOCAL ] GTY: Primary data saved (30186 records). [2025-10-14T19:18:00.998920] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-14T19:18:00.999152] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GTY took 39.9s. Estimated remaining: 3h 15m 11s. Rate: 7.1 symbols/min [2025-10-14T19:18:01.191058] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:01.193212] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T19:18:01.222289] [DEBUG] [LOCAL ] GWH: Loaded 17922 existing records from primary storage. [2025-10-14T19:18:01.222698] [INFO ] [MAIN ] GWH: Loaded 17922 existing records. [2025-10-14T19:18:01.417790] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:01.418575] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-14T19:18:01.418627] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-14T19:18:01.419145] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-14T19:18:01.419419] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-14T19:18:01.563247] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-14T19:18:01.779317] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T19:18:01.853959] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:02.358056] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-14T19:18:02.709043] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T19:18:03.158130] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-14T19:18:03.581038] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T19:18:03.958425] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-14T19:18:03.959349] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T19:18:04.758131] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-14T19:18:05.435111] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T19:18:05.558070] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-14T19:18:05.584904] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T19:18:06.358126] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-14T19:18:07.072897] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T19:18:07.145346] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:18:07.158034] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-14T19:18:07.958124] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-14T19:18:08.524407] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T19:18:08.591693] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T19:18:08.758039] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-14T19:18:09.390943] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T19:18:09.558065] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-14T19:18:10.358086] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-14T19:18:10.456122] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T19:18:11.158045] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-14T19:18:11.395239] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T19:18:11.870878] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T19:18:11.958106] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-14T19:18:12.733719] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T19:18:12.735464] [INFO ] [REMOTE ] GUG: Full fetch complete (19254 records). [2025-10-14T19:18:12.735535] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-14T19:18:12.765488] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-14T19:18:13.101203] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-14T19:18:13.101279] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-14T19:18:13.101707] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-14T19:18:13.101766] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-14T19:18:13.102279] [DEBUG] [LOCAL ] GUG: Trimmed 19254 records to 12212 (keeping 200 days of data) [2025-10-14T19:18:13.176296] [DEBUG] [LOCAL ] GUG: Primary data saved (12212 records). [2025-10-14T19:18:13.176427] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-14T19:18:13.176500] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUG took 39.7s. Estimated remaining: 3h 15m 8s. Rate: 7.1 symbols/min [2025-10-14T19:18:13.341726] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:13.380572] [DEBUG] [LOCAL ] GWRE: Loaded 40055 existing records from primary storage. [2025-10-14T19:18:13.380871] [INFO ] [MAIN ] GWRE: Loaded 40055 existing records. [2025-10-14T19:18:13.553368] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:13.553600] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-14T19:18:13.553688] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-14T19:18:13.554003] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-14T19:18:13.554062] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-14T19:18:13.565413] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-14T19:18:13.935572] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:14.304420] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T19:18:14.320361] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T19:18:14.358025] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-14T19:18:15.158091] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-14T19:18:15.409462] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T19:18:15.958089] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-14T19:18:16.758060] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-14T19:18:16.819749] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T19:18:16.924050] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T19:18:16.927102] [INFO ] [REMOTE ] GUT: Full fetch complete (22608 records). [2025-10-14T19:18:16.927191] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-14T19:18:17.298898] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-14T19:18:17.298970] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-14T19:18:17.299432] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-14T19:18:17.299469] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-14T19:18:17.300104] [DEBUG] [LOCAL ] GUT: Trimmed 22608 records to 15591 (keeping 200 days of data) [2025-10-14T19:18:17.391605] [DEBUG] [LOCAL ] GUT: Primary data saved (15591 records). [2025-10-14T19:18:17.391732] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-14T19:18:17.391822] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GUT took 36.9s. Estimated remaining: 3h 14m 54s. Rate: 7.1 symbols/min [2025-10-14T19:18:17.504895] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T19:18:17.565788] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-14T19:18:17.568292] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:17.590001] [DEBUG] [LOCAL ] GWW: Loaded 19568 existing records from primary storage. [2025-10-14T19:18:17.590225] [INFO ] [MAIN ] GWW: Loaded 19568 existing records. [2025-10-14T19:18:17.763739] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:17.763917] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-14T19:18:17.763963] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-14T19:18:17.764230] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-14T19:18:17.764285] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-14T19:18:18.112883] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:18.358027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-14T19:18:18.609843] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T19:18:19.158108] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-14T19:18:19.226422] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T19:18:19.958059] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-14T19:18:20.476248] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-14T19:18:20.758111] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-14T19:18:21.095795] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T19:18:21.558081] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-14T19:18:22.300634] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T19:18:22.356597] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T19:18:22.360908] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-14T19:18:23.158074] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-14T19:18:23.665005] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T19:18:23.958039] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-14T19:18:23.988779] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T19:18:24.758068] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-14T19:18:25.000081] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T19:18:25.558066] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-14T19:18:25.731524] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T19:18:26.358066] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-14T19:18:27.118920] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T19:18:27.158028] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-14T19:18:27.673248] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T19:18:27.676891] [INFO ] [REMOTE ] GVA: Full fetch complete (48429 records). [2025-10-14T19:18:27.676967] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-14T19:18:27.963616] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-14T19:18:28.054831] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-14T19:18:28.054905] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-14T19:18:28.055620] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-14T19:18:28.055689] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-14T19:18:28.056599] [DEBUG] [LOCAL ] GVA: Trimmed 48429 records to 32725 (keeping 200 days of data) [2025-10-14T19:18:28.257149] [DEBUG] [LOCAL ] GVA: Primary data saved (32725 records). [2025-10-14T19:18:28.257276] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-14T19:18:28.257344] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GVA took 36.5s. Estimated remaining: 3h 14m 49s. Rate: 7.1 symbols/min [2025-10-14T19:18:28.427924] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:28.469448] [DEBUG] [LOCAL ] GXO: Loaded 46910 existing records from primary storage. [2025-10-14T19:18:28.469757] [INFO ] [MAIN ] GXO: Loaded 46910 existing records. [2025-10-14T19:18:28.659556] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:28.660517] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-14T19:18:28.660593] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-14T19:18:28.661036] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-14T19:18:28.661162] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-14T19:18:28.763842] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-14T19:18:28.864048] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T19:18:29.001441] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T19:18:29.082962] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:29.558050] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-14T19:18:29.855437] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T19:18:30.358066] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-14T19:18:30.819819] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T19:18:31.158078] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-14T19:18:31.188861] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T19:18:31.958114] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-14T19:18:32.577177] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T19:18:32.758048] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-14T19:18:32.933171] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T19:18:33.558051] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-14T19:18:33.852561] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T19:18:34.358070] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-14T19:18:34.953872] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T19:18:35.158081] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-14T19:18:35.815893] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T19:18:35.958095] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-14T19:18:36.723387] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T19:18:36.758029] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-14T19:18:36.895586] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T19:18:37.558067] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-14T19:18:37.860368] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T19:18:38.358108] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-14T19:18:38.732194] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T19:18:39.158120] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-14T19:18:39.689364] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T19:18:39.958135] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-14T19:18:40.221755] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:18:40.758127] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-14T19:18:41.416538] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T19:18:41.558037] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-14T19:18:41.896638] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T19:18:42.358067] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-14T19:18:42.802822] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T19:18:42.806999] [INFO ] [REMOTE ] GWRE: Full fetch complete (60457 records). [2025-10-14T19:18:42.807109] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-14T19:18:43.162736] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-14T19:18:43.180775] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-14T19:18:43.181879] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-14T19:18:43.182783] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-14T19:18:43.182963] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-14T19:18:43.184220] [DEBUG] [LOCAL ] GWRE: Trimmed 60457 records to 39976 (keeping 200 days of data) [2025-10-14T19:18:43.428453] [DEBUG] [LOCAL ] GWRE: Primary data saved (39976 records). [2025-10-14T19:18:43.428594] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-14T19:18:43.428702] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 30.3s. Estimated remaining: 3h 14m 50s. Rate: 7.1 symbols/min [2025-10-14T19:18:43.593781] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:43.597445] [DEBUG] [LOCAL ] GYLD: Loaded 1541 existing records from primary storage. [2025-10-14T19:18:43.597579] [INFO ] [MAIN ] GYLD: Loaded 1541 existing records. [2025-10-14T19:18:43.774099] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:43.774401] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-14T19:18:43.774460] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-14T19:18:43.774587] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-14T19:18:43.774625] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-14T19:18:43.959035] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-14T19:18:44.014971] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T19:18:44.062344] [INFO ] [REMOTE ] GWH: Full fetch complete (23012 records). [2025-10-14T19:18:44.079105] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-14T19:18:44.304669] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:44.586594] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-14T19:18:44.586713] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-14T19:18:44.587291] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-14T19:18:44.587336] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-14T19:18:44.588038] [DEBUG] [LOCAL ] GWH: Trimmed 23012 records to 18271 (keeping 200 days of data) [2025-10-14T19:18:44.695250] [DEBUG] [LOCAL ] GWH: Primary data saved (18271 records). [2025-10-14T19:18:44.695413] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-14T19:18:44.695500] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GWH took 43.7s. Estimated remaining: 3h 14m 31s. Rate: 7.1 symbols/min [2025-10-14T19:18:44.765379] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-14T19:18:44.880919] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:44.913182] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T19:18:44.964196] [DEBUG] [LOCAL ] H: Loaded 44516 existing records from primary storage. [2025-10-14T19:18:44.964510] [INFO ] [MAIN ] H: Loaded 44516 existing records. [2025-10-14T19:18:45.160937] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:45.163835] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-14T19:18:45.165099] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T19:18:45.164148] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-14T19:18:45.168797] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-14T19:18:45.168915] [INFO ] [REMOTE ] GWW: Full fetch complete (29126 records). [2025-10-14T19:18:45.168985] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-14T19:18:45.169095] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-14T19:18:45.169200] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-14T19:18:45.575805] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-14T19:18:45.900136] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-14T19:18:45.912492] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-14T19:18:45.912427] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:45.913243] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-14T19:18:45.913329] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-14T19:18:45.914590] [DEBUG] [LOCAL ] GWW: Trimmed 29126 records to 19603 (keeping 200 days of data) [2025-10-14T19:18:46.049179] [DEBUG] [LOCAL ] GWW: Primary data saved (19603 records). [2025-10-14T19:18:46.049324] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-14T19:18:46.049413] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GWW took 28.7s. Estimated remaining: 3h 14m 13s. Rate: 7.1 symbols/min [2025-10-14T19:18:46.232945] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:18:46.267984] [DEBUG] [LOCAL ] HAE: Loaded 39430 existing records from primary storage. [2025-10-14T19:18:46.268271] [INFO ] [MAIN ] HAE: Loaded 39430 existing records. [2025-10-14T19:18:46.363184] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-14T19:18:46.458185] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:18:46.458393] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-14T19:18:46.458441] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-14T19:18:46.459099] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-14T19:18:46.459172] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-14T19:18:46.820613] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:18:47.158078] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-14T19:18:47.251930] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T19:18:47.384332] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T19:18:47.958091] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-14T19:18:48.101488] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T19:18:48.758232] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-14T19:18:49.476377] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T19:18:49.558041] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-14T19:18:49.902025] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T19:18:50.358137] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-14T19:18:50.695327] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-14T19:18:51.021032] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T19:18:51.158092] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-14T19:18:51.498178] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T19:18:51.958042] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-14T19:18:52.758074] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-14T19:18:53.057733] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-14T19:18:53.475127] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T19:18:53.558040] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-14T19:18:54.358068] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-14T19:18:54.939526] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:18:55.158079] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-14T19:18:55.689398] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T19:18:55.958051] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-14T19:18:56.766313] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-14T19:18:56.786771] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T19:18:57.226375] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T19:18:57.479579] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T19:18:57.558056] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-14T19:18:58.358133] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-14T19:18:59.158131] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-14T19:18:59.310739] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T19:18:59.913833] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T19:18:59.958128] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-14T19:19:00.239898] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-14T19:19:00.664508] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T19:19:00.758072] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-14T19:19:01.225738] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T19:19:01.558070] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-14T19:19:02.358161] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-14T19:19:02.789687] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T19:19:03.033237] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T19:19:03.038264] [INFO ] [REMOTE ] GXO: Full fetch complete (69713 records). [2025-10-14T19:19:03.038386] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-14T19:19:03.163155] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-14T19:19:03.435563] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-14T19:19:03.435680] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-14T19:19:03.436662] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-14T19:19:03.436725] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-14T19:19:03.438087] [DEBUG] [LOCAL ] GXO: Trimmed 69713 records to 46833 (keeping 200 days of data) [2025-10-14T19:19:03.671998] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T19:19:03.732412] [DEBUG] [LOCAL ] GXO: Primary data saved (46833 records). [2025-10-14T19:19:03.732562] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-14T19:19:03.732669] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GXO took 35.5s. Estimated remaining: 3h 14m 17s. Rate: 7.1 symbols/min [2025-10-14T19:19:03.902212] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:03.940716] [DEBUG] [LOCAL ] HAFN: Loaded 43057 existing records from primary storage. [2025-10-14T19:19:03.941007] [INFO ] [MAIN ] HAFN: Loaded 43057 existing records. [2025-10-14T19:19:03.963190] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-14T19:19:04.123844] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:04.124099] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-14T19:19:04.124153] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-14T19:19:04.124772] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-14T19:19:04.124829] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-14T19:19:04.485950] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:04.758078] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-14T19:19:05.558045] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-14T19:19:05.656514] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T19:19:06.263432] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T19:19:06.358064] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-14T19:19:07.158082] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-14T19:19:07.222359] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T19:19:07.529037] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T19:19:07.958086] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-14T19:19:08.481495] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T19:19:08.689761] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T19:19:08.758037] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-14T19:19:09.231347] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T19:19:09.232110] [INFO ] [REMOTE ] GYLD: Full fetch complete (2103 records). [2025-10-14T19:19:09.232188] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-14T19:19:09.578120] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-14T19:19:09.584970] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-14T19:19:09.585049] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-14T19:19:09.585179] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-14T19:19:09.585235] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-14T19:19:09.585681] [DEBUG] [LOCAL ] GYLD: Trimmed 2103 records to 1542 (keeping 200 days of data) [2025-10-14T19:19:09.600401] [DEBUG] [LOCAL ] GYLD: Primary data saved (1542 records). [2025-10-14T19:19:09.600528] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-14T19:19:09.600608] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. GYLD took 26.2s. Estimated remaining: 3h 14m 5s. Rate: 7.1 symbols/min [2025-10-14T19:19:09.769764] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:09.818636] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-14T19:19:09.818999] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-14T19:19:09.994170] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:09.994427] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-14T19:19:09.994488] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-14T19:19:09.995731] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-14T19:19:09.995796] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-14T19:19:10.343379] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:10.358034] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-14T19:19:10.981263] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T19:19:11.158075] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-14T19:19:11.955573] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T19:19:11.965751] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-14T19:19:12.758038] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-14T19:19:13.002609] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T19:19:13.193086] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T19:19:13.558099] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-14T19:19:14.358066] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-14T19:19:14.511618] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T19:19:14.971856] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T19:19:15.158062] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-14T19:19:15.953518] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T19:19:15.962627] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-14T19:19:16.331739] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T19:19:16.758066] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-14T19:19:17.458258] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T19:19:17.558042] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-14T19:19:18.358127] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-14T19:19:18.488626] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T19:19:19.158128] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-14T19:19:19.424985] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T19:19:19.696343] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T19:19:19.958061] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-14T19:19:20.323704] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T19:19:20.758077] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-14T19:19:21.534638] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T19:19:21.539800] [INFO ] [REMOTE ] H: Full fetch complete (62795 records). [2025-10-14T19:19:21.539939] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-14T19:19:21.563308] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-14T19:19:21.939408] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-14T19:19:21.939504] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-14T19:19:21.940505] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-14T19:19:21.940583] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-14T19:19:21.942103] [DEBUG] [LOCAL ] H: Trimmed 62795 records to 44431 (keeping 200 days of data) [2025-10-14T19:19:22.196850] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T19:19:22.264203] [DEBUG] [LOCAL ] H: Primary data saved (44431 records). [2025-10-14T19:19:22.264335] [INFO ] [MAIN ] H: Full history saved. [2025-10-14T19:19:22.264423] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. H took 37.6s. Estimated remaining: 3h 14m 3s. Rate: 7.1 symbols/min [2025-10-14T19:19:22.366343] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-14T19:19:22.439786] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:22.480818] [DEBUG] [LOCAL ] HASI: Loaded 47474 existing records from primary storage. [2025-10-14T19:19:22.481137] [INFO ] [MAIN ] HASI: Loaded 47474 existing records. [2025-10-14T19:19:22.688135] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:22.688333] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-14T19:19:22.688379] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-14T19:19:22.689200] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-14T19:19:22.689258] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-14T19:19:23.042716] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:23.158036] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-14T19:19:23.694179] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-14T19:19:23.832743] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:19:23.958090] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-14T19:19:24.335151] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T19:19:24.758074] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-14T19:19:25.491942] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T19:19:25.558076] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-14T19:19:26.354396] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T19:19:26.363203] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-14T19:19:27.099364] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T19:19:27.158070] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-14T19:19:27.958111] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-14T19:19:28.167164] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T19:19:28.752602] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T19:19:28.757321] [INFO ] [REMOTE ] HAE: Full fetch complete (58746 records). [2025-10-14T19:19:28.757432] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-14T19:19:28.769567] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-14T19:19:29.150455] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-14T19:19:29.150539] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-14T19:19:29.151452] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-14T19:19:29.151513] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-14T19:19:29.152714] [DEBUG] [LOCAL ] HAE: Trimmed 58746 records to 39414 (keeping 200 days of data) [2025-10-14T19:19:29.397895] [DEBUG] [LOCAL ] HAE: Primary data saved (39414 records). [2025-10-14T19:19:29.398070] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-14T19:19:29.398158] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAE took 43.3s. Estimated remaining: 3h 13m 53s. Rate: 7.1 symbols/min [2025-10-14T19:19:29.570077] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-14T19:19:29.596461] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:29.601530] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T19:19:29.652047] [DEBUG] [LOCAL ] HAYW: Loaded 48879 existing records from primary storage. [2025-10-14T19:19:29.652333] [INFO ] [MAIN ] HAYW: Loaded 48879 existing records. [2025-10-14T19:19:29.825490] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:29.825735] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-14T19:19:29.825806] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-14T19:19:29.826637] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-14T19:19:29.826736] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-14T19:19:30.186230] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:30.358036] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-14T19:19:30.482196] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T19:19:31.158103] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-14T19:19:31.492026] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T19:19:31.540513] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T19:19:31.958063] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-14T19:19:32.758039] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-14T19:19:32.845097] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T19:19:33.558091] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-14T19:19:33.748820] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T19:19:34.349156] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:19:34.358889] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-14T19:19:34.777450] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T19:19:35.158132] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-14T19:19:35.892025] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T19:19:35.958050] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-14T19:19:36.492900] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T19:19:36.758117] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-14T19:19:37.558039] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-14T19:19:37.877380] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T19:19:38.358062] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-14T19:19:38.435763] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T19:19:39.158041] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-14T19:19:39.187777] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T19:19:39.855072] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T19:19:39.958091] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-14T19:19:40.758090] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-14T19:19:40.826897] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T19:19:41.558098] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-14T19:19:41.660011] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T19:19:41.998556] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T19:19:42.004518] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-14T19:19:42.004682] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-14T19:19:42.365101] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-14T19:19:42.417459] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-14T19:19:42.417751] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-14T19:19:42.418929] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-14T19:19:42.419023] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-14T19:19:42.449153] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-14T19:19:42.450707] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T19:19:42.785403] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-14T19:19:42.785536] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-14T19:19:42.785626] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 33.2s. Estimated remaining: 3h 13m 51s. Rate: 7.1 symbols/min [2025-10-14T19:19:42.960487] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:42.968728] [DEBUG] [LOCAL ] HBB: Loaded 6478 existing records from primary storage. [2025-10-14T19:19:42.968939] [INFO ] [MAIN ] HBB: Loaded 6478 existing records. [2025-10-14T19:19:43.147721] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:43.148044] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-14T19:19:43.148093] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-14T19:19:43.148550] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-14T19:19:43.148609] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-14T19:19:43.163299] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-14T19:19:43.508789] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:43.958043] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-14T19:19:44.119018] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T19:19:44.758051] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-14T19:19:44.765895] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T19:19:44.845959] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T19:19:45.558061] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-14T19:19:46.279475] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T19:19:46.358101] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-14T19:19:46.816605] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T19:19:47.158074] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-14T19:19:47.801367] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T19:19:47.835408] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T19:19:47.958036] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-14T19:19:48.550487] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T19:19:48.758076] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-14T19:19:49.474486] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T19:19:49.558086] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-14T19:19:50.194263] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T19:19:50.358048] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-14T19:19:51.080152] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T19:19:51.158067] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-14T19:19:51.716625] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T19:19:51.958122] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-14T19:19:52.758113] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-14T19:19:53.558084] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-14T19:19:53.606459] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T19:19:53.933405] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-14T19:19:54.323274] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T19:19:54.328827] [INFO ] [REMOTE ] HASI: Full fetch complete (68224 records). [2025-10-14T19:19:54.328940] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-14T19:19:54.363174] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-14T19:19:54.752458] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-14T19:19:54.752537] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-14T19:19:54.753467] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-14T19:19:54.753528] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-14T19:19:54.754903] [DEBUG] [LOCAL ] HASI: Trimmed 68224 records to 47577 (keeping 200 days of data) [2025-10-14T19:19:55.048525] [DEBUG] [LOCAL ] HASI: Primary data saved (47577 records). [2025-10-14T19:19:55.048690] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-14T19:19:55.048786] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 32.8s. Estimated remaining: 3h 13m 48s. Rate: 7.1 symbols/min [2025-10-14T19:19:55.160708] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-14T19:19:55.160602] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T19:19:55.237463] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:55.283946] [DEBUG] [LOCAL ] HBI: Loaded 52982 existing records from primary storage. [2025-10-14T19:19:55.284263] [INFO ] [MAIN ] HBI: Loaded 52982 existing records. [2025-10-14T19:19:55.473017] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:55.473227] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-14T19:19:55.473276] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-14T19:19:55.474201] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-14T19:19:55.474258] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-14T19:19:55.832009] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:55.958069] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-14T19:19:56.379100] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T19:19:56.383816] [INFO ] [REMOTE ] HAFN: Full fetch complete (65110 records). [2025-10-14T19:19:56.383905] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-14T19:19:56.764024] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-14T19:19:56.764135] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-14T19:19:56.763321] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-14T19:19:56.765263] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-14T19:19:56.765931] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-14T19:19:56.767142] [DEBUG] [LOCAL ] HAFN: Trimmed 65110 records to 43050 (keeping 200 days of data) [2025-10-14T19:19:57.009575] [DEBUG] [LOCAL ] HAFN: Primary data saved (43050 records). [2025-10-14T19:19:57.009694] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-14T19:19:57.009783] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HAFN took 53.3s. Estimated remaining: 3h 13m 30s. Rate: 7.1 symbols/min [2025-10-14T19:19:57.177170] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:57.225125] [DEBUG] [LOCAL ] HBM: Loaded 52941 existing records from primary storage. [2025-10-14T19:19:57.225437] [INFO ] [MAIN ] HBM: Loaded 52941 existing records. [2025-10-14T19:19:57.407620] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:57.408275] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-14T19:19:57.408331] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-14T19:19:57.408921] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-14T19:19:57.408977] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-14T19:19:57.558685] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-14T19:19:57.769575] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:19:57.797386] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T19:19:58.141221] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T19:19:58.358046] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-14T19:19:58.505933] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:19:59.088079] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T19:19:59.089333] [INFO ] [REMOTE ] HBB: Full fetch complete (9387 records). [2025-10-14T19:19:59.089410] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-14T19:19:59.163349] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-14T19:19:59.470501] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-14T19:19:59.470599] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-14T19:19:59.471020] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-14T19:19:59.471083] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-14T19:19:59.471597] [DEBUG] [LOCAL ] HBB: Trimmed 9387 records to 6478 (keeping 200 days of data) [2025-10-14T19:19:59.514519] [DEBUG] [LOCAL ] HBB: Primary data saved (6478 records). [2025-10-14T19:19:59.514722] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-14T19:19:59.514832] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HBB took 16.7s. Estimated remaining: 3h 13m 14s. Rate: 7.1 symbols/min [2025-10-14T19:19:59.694348] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:19:59.747440] [DEBUG] [LOCAL ] HCA: Loaded 46919 existing records from primary storage. [2025-10-14T19:19:59.747942] [INFO ] [MAIN ] HCA: Loaded 46919 existing records. [2025-10-14T19:19:59.931580] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:19:59.931915] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-14T19:19:59.931967] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-14T19:19:59.932544] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-14T19:19:59.932603] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-14T19:19:59.963755] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-14T19:20:00.349514] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:00.758135] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-14T19:20:00.906053] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T19:20:01.559753] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-14T19:20:01.559629] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T19:20:02.358117] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-14T19:20:02.618465] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T19:20:03.158065] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-14T19:20:03.404150] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T19:20:03.795716] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T19:20:03.958055] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-14T19:20:04.758130] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-14T19:20:05.002946] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T19:20:05.496268] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T19:20:05.558064] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-14T19:20:06.219954] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T19:20:06.358059] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-14T19:20:07.158084] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-14T19:20:07.271096] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T19:20:07.958079] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-14T19:20:08.111732] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T19:20:08.758057] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-14T19:20:08.840880] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T19:20:09.558045] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-14T19:20:09.759900] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T19:20:10.272964] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T19:20:10.358048] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-14T19:20:11.158053] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-14T19:20:11.357226] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T19:20:11.958089] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-14T19:20:12.022610] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T19:20:12.434611] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T19:20:12.440195] [INFO ] [REMOTE ] HAYW: Full fetch complete (70871 records). [2025-10-14T19:20:12.440308] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-14T19:20:12.763160] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-14T19:20:12.833729] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-14T19:20:12.833816] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-14T19:20:12.834779] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-14T19:20:12.834840] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-14T19:20:12.836169] [DEBUG] [LOCAL ] HAYW: Trimmed 70871 records to 48878 (keeping 200 days of data) [2025-10-14T19:20:13.122929] [DEBUG] [LOCAL ] HAYW: Primary data saved (48878 records). [2025-10-14T19:20:13.123062] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-14T19:20:13.123138] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HAYW took 43.7s. Estimated remaining: 3h 13m 13s. Rate: 7.1 symbols/min [2025-10-14T19:20:13.294329] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:20:13.333179] [DEBUG] [LOCAL ] HCC: Loaded 45223 existing records from primary storage. [2025-10-14T19:20:13.333516] [INFO ] [MAIN ] HCC: Loaded 45223 existing records. [2025-10-14T19:20:13.517237] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:20:13.517545] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-14T19:20:13.517715] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-14T19:20:13.518680] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-14T19:20:13.518739] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-14T19:20:13.574981] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-14T19:20:13.907436] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:13.942586] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T19:20:14.358110] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-14T19:20:14.421325] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T19:20:15.158051] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-14T19:20:15.341249] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T19:20:15.644442] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T19:20:15.958101] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-14T19:20:16.758039] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-14T19:20:16.955456] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T19:20:17.558094] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-14T19:20:17.709486] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T19:20:18.088151] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T19:20:18.358061] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-14T19:20:19.158074] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-14T19:20:19.225425] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T19:20:19.894398] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T19:20:19.958091] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-14T19:20:20.758151] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-14T19:20:20.809462] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T19:20:21.528308] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T19:20:21.558025] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-14T19:20:22.358052] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-14T19:20:22.380877] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:20:22.386712] [INFO ] [REMOTE ] HBI: Full fetch complete (77032 records). [2025-10-14T19:20:22.386831] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-14T19:20:22.780664] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-14T19:20:22.780846] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-14T19:20:22.781849] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-14T19:20:22.781972] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-14T19:20:22.783384] [DEBUG] [LOCAL ] HBI: Trimmed 77032 records to 52982 (keeping 200 days of data) [2025-10-14T19:20:22.998915] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T19:20:23.107503] [DEBUG] [LOCAL ] HBI: Primary data saved (52982 records). [2025-10-14T19:20:23.107629] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-14T19:20:23.107767] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HBI took 28.1s. Estimated remaining: 3h 13m 6s. Rate: 7.1 symbols/min [2025-10-14T19:20:23.158026] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-14T19:20:23.958065] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-14T19:20:24.202998] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T19:20:24.758118] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-14T19:20:24.831375] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T19:20:25.558069] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-14T19:20:25.805722] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T19:20:26.358071] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-14T19:20:26.888435] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T19:20:26.944845] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-14T19:20:27.158078] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-14T19:20:27.540401] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T19:20:27.958091] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-14T19:20:28.758084] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-14T19:20:28.863079] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T19:20:29.558087] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-14T19:20:29.635253] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:20:30.140741] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T19:20:30.358053] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-14T19:20:31.080015] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T19:20:31.158057] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-14T19:20:31.958097] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-14T19:20:32.188384] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-14T19:20:32.194411] [INFO ] [REMOTE ] HBM: Full fetch complete (76582 records). [2025-10-14T19:20:32.194565] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-14T19:20:32.599890] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-14T19:20:32.599990] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-14T19:20:32.601129] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-14T19:20:32.601222] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-14T19:20:32.602822] [DEBUG] [LOCAL ] HBM: Trimmed 76582 records to 52944 (keeping 200 days of data) [2025-10-14T19:20:32.713110] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:20:32.807247] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-14T19:20:32.966350] [DEBUG] [LOCAL ] HBM: Primary data saved (52944 records). [2025-10-14T19:20:32.966487] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-14T19:20:32.966566] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HBM took 36.0s. Estimated remaining: 3h 12m 60s. Rate: 7.1 symbols/min [2025-10-14T19:20:33.493215] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T19:20:33.498461] [INFO ] [REMOTE ] HCA: Full fetch complete (68861 records). [2025-10-14T19:20:33.498607] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-14T19:20:33.903103] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-14T19:20:33.903201] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-14T19:20:33.904269] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-14T19:20:33.904330] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-14T19:20:33.905603] [DEBUG] [LOCAL ] HCA: Trimmed 68861 records to 46950 (keeping 200 days of data) [2025-10-14T19:20:34.203167] [DEBUG] [LOCAL ] HCA: Primary data saved (46950 records). [2025-10-14T19:20:34.203300] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-14T19:20:34.203375] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HCA took 34.7s. Estimated remaining: 3h 12m 41s. Rate: 7.1 symbols/min [2025-10-14T19:20:34.410090] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T19:20:34.419351] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-14T19:20:36.009114] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T19:20:36.018705] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-14T19:20:37.495981] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T19:20:37.500959] [INFO ] [REMOTE ] HCC: Full fetch complete (64756 records). [2025-10-14T19:20:37.501049] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-14T19:20:37.879914] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-14T19:20:37.879988] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-14T19:20:37.880813] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-14T19:20:37.880875] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-14T19:20:37.882109] [DEBUG] [LOCAL ] HCC: Trimmed 64756 records to 45223 (keeping 200 days of data) [2025-10-14T19:20:38.151858] [DEBUG] [LOCAL ] HCC: Primary data saved (45223 records). [2025-10-14T19:20:38.152036] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-14T19:20:38.152125] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCC took 25.0s. Estimated remaining: 3h 12m 27s. Rate: 7.1 symbols/min [2025-10-14T19:20:38.676720] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:20:38.754737] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:20:38.779297] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-14T19:20:38.818179] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:20:38.802043] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-14T19:20:38.871889] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-14T19:20:38.874173] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-14T19:20:38.876118] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:20:38.876310] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-14T19:20:38.876848] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-14T19:20:38.926181] [DEBUG] [LOCAL ] HCI: Loaded 14057 existing records from primary storage. [2025-10-14T19:20:38.957481] [INFO ] [MAIN ] HCI: Loaded 14057 existing records. [2025-10-14T19:20:39.362823] [DEBUG] [LOCAL ] HDB: Loaded 51946 existing records from primary storage. [2025-10-14T19:20:39.430809] [INFO ] [MAIN ] HDB: Loaded 51946 existing records. [2025-10-14T19:20:39.424298] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:20:39.510313] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-14T19:20:39.542729] [INFO ] [MAIN ] HD: Loaded 53493 existing records. [2025-10-14T19:20:39.509443] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-14T19:20:39.569033] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-14T19:20:39.733496] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-14T19:20:39.806882] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-14T19:20:39.797883] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:39.812594] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-14T19:20:39.884858] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:20:39.916578] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-14T19:20:40.014027] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:20:40.024548] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-14T19:20:39.950468] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-14T19:20:40.038198] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-14T19:20:40.038148] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-14T19:20:40.041485] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-14T19:20:40.046956] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-14T19:20:40.092978] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-14T19:20:40.286704] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-14T19:20:40.313311] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-14T19:20:40.817533] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:40.850001] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T19:20:40.865907] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-14T19:20:40.867842] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-14T19:20:41.010944] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:41.014467] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-14T19:20:41.094049] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:41.094385] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-14T19:20:41.337505] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T19:20:41.338395] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-14T19:20:41.644623] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-14T19:20:41.645449] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-14T19:20:41.733515] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T19:20:41.738478] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-14T19:20:41.842407] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-10-14T19:20:42.358072] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-14T19:20:42.556318] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T19:20:42.606030] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-14T19:20:42.689065] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T19:20:43.159170] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-14T19:20:43.164686] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T19:20:43.958119] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-14T19:20:44.740449] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T19:20:44.758031] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-14T19:20:44.858964] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T19:20:45.558075] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-14T19:20:45.769577] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T19:20:45.785758] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-14T19:20:46.358128] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-14T19:20:47.158051] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-14T19:20:47.318145] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T19:20:47.958093] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-14T19:20:48.686212] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-14T19:20:48.758089] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-14T19:20:49.054212] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-14T19:20:49.558058] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-14T19:20:49.964480] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:20:50.358063] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-14T19:20:51.158071] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-14T19:20:51.292309] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T19:20:51.312802] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-14T19:20:51.397824] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-14T19:20:51.958097] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-14T19:20:52.758148] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-14T19:20:53.558044] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-14T19:20:53.766422] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T19:20:54.041396] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-14T19:20:54.358133] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-14T19:20:54.801285] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T19:20:55.158132] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-14T19:20:55.958045] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-14T19:20:56.122970] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T19:20:56.516671] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T19:20:56.758043] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-14T19:20:56.875327] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T19:20:57.558053] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-14T19:20:58.358037] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-14T19:20:58.492461] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T19:20:58.494489] [INFO ] [REMOTE ] HCI: Full fetch complete (19556 records). [2025-10-14T19:20:58.494557] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-14T19:20:58.597724] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-14T19:20:58.866074] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-14T19:20:58.866197] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-14T19:20:58.866699] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-14T19:20:58.866758] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-14T19:20:58.867295] [DEBUG] [LOCAL ] HCI: Trimmed 19556 records to 14096 (keeping 200 days of data) [2025-10-14T19:20:58.976811] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-14T19:20:58.998054] [DEBUG] [LOCAL ] HCI: Primary data saved (14096 records). [2025-10-14T19:20:58.998497] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-14T19:20:58.998577] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCI took 20.8s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-14T19:20:59.163862] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:20:59.162398] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-14T19:20:59.208563] [DEBUG] [LOCAL ] HE: Loaded 48960 existing records from primary storage. [2025-10-14T19:20:59.208913] [INFO ] [MAIN ] HE: Loaded 48960 existing records. [2025-10-14T19:20:59.381281] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:20:59.381468] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-14T19:20:59.381514] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-14T19:20:59.382296] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-14T19:20:59.382353] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-14T19:20:59.740882] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:20:59.958055] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-14T19:21:00.758113] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-14T19:21:01.115832] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-14T19:21:01.202873] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-14T19:21:01.558098] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-14T19:21:01.705883] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T19:21:02.358069] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-14T19:21:03.167573] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-14T19:21:03.173017] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T19:21:03.958137] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-14T19:21:04.301110] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T19:21:04.301746] [INFO ] [REMOTE ] HCXY: Full fetch complete (519 records). [2025-10-14T19:21:04.301812] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-14T19:21:04.484316] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-10-14T19:21:04.484691] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:21:04.484792] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:21:04.484927] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-14T19:21:04.485107] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-14T19:21:04.485193] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-14T19:21:04.485331] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-14T19:21:04.485461] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HCXY took 26.3s. Estimated remaining: 3h 12m 23s. Rate: 7.1 symbols/min [2025-10-14T19:21:04.657039] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:21:04.696711] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-14T19:21:04.733828] [DEBUG] [LOCAL ] HEI: Loaded 31410 existing records from primary storage. [2025-10-14T19:21:04.734076] [INFO ] [MAIN ] HEI: Loaded 31410 existing records. [2025-10-14T19:21:04.764602] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-14T19:21:04.922617] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:21:04.922989] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-14T19:21:04.923092] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-14T19:21:04.923682] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-14T19:21:04.923744] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-14T19:21:05.218878] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-14T19:21:05.335076] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:21:05.558062] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-14T19:21:06.358054] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-14T19:21:06.519285] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T19:21:06.947017] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T19:21:07.158119] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-14T19:21:07.958137] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-14T19:21:08.287321] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T19:21:08.466846] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T19:21:08.758070] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-14T19:21:09.558045] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-14T19:21:09.724159] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T19:21:10.358051] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-14T19:21:10.905054] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-14T19:21:10.946520] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T19:21:11.158112] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-14T19:21:11.899911] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T19:21:11.905809] [INFO ] [REMOTE ] HD: Full fetch complete (77551 records). [2025-10-14T19:21:11.905922] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-14T19:21:11.963173] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-14T19:21:12.331781] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-14T19:21:12.332216] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-14T19:21:12.334921] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T19:21:12.333236] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-14T19:21:12.335043] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-14T19:21:12.346693] [DEBUG] [LOCAL ] HD: Trimmed 77551 records to 53493 (keeping 200 days of data) [2025-10-14T19:21:12.679449] [DEBUG] [LOCAL ] HD: Primary data saved (53493 records). [2025-10-14T19:21:12.679585] [INFO ] [MAIN ] HD: Full history saved. [2025-10-14T19:21:12.679686] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HD took 34.5s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-14T19:21:12.763181] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-14T19:21:12.847407] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:21:12.856827] [DEBUG] [LOCAL ] HEQ: Loaded 6723 existing records from primary storage. [2025-10-14T19:21:12.857066] [INFO ] [MAIN ] HEQ: Loaded 6723 existing records. [2025-10-14T19:21:13.034929] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:21:13.035219] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-14T19:21:13.035323] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-14T19:21:13.035540] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-14T19:21:13.035587] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-14T19:21:13.393479] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:21:13.442911] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T19:21:13.558033] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-14T19:21:14.293706] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T19:21:14.358043] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-14T19:21:15.042929] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T19:21:15.158054] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-14T19:21:15.721294] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T19:21:15.958100] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-14T19:21:16.712768] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T19:21:16.758036] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-14T19:21:17.208316] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T19:21:17.558102] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-14T19:21:18.262860] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T19:21:18.287505] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T19:21:18.358098] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-14T19:21:19.158048] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-14T19:21:19.760745] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T19:21:19.958105] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-14T19:21:20.128010] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T19:21:20.661671] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T19:21:20.758064] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-14T19:21:21.558051] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-14T19:21:22.358071] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-14T19:21:22.652236] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T19:21:22.727793] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-14T19:21:23.158049] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-14T19:21:23.356279] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T19:21:23.958074] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-14T19:21:24.492477] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T19:21:24.758114] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-14T19:21:25.558090] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-14T19:21:25.766524] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T19:21:26.038283] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T19:21:26.358071] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-14T19:21:27.061573] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T19:21:27.158055] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-14T19:21:27.313876] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T19:21:27.958052] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-14T19:21:28.606796] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T19:21:28.730614] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T19:21:28.736177] [INFO ] [REMOTE ] HE: Full fetch complete (72282 records). [2025-10-14T19:21:28.736294] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-14T19:21:28.766586] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-14T19:21:29.128450] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-14T19:21:29.128541] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-14T19:21:29.129509] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-14T19:21:29.129678] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-14T19:21:29.131141] [DEBUG] [LOCAL ] HE: Trimmed 72282 records to 48972 (keeping 200 days of data) [2025-10-14T19:21:29.420728] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T19:21:29.433577] [DEBUG] [LOCAL ] HE: Primary data saved (48972 records). [2025-10-14T19:21:29.433769] [INFO ] [MAIN ] HE: Full history saved. [2025-10-14T19:21:29.433870] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HE took 30.4s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-14T19:21:29.572483] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-14T19:21:29.605401] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:21:29.648268] [DEBUG] [LOCAL ] HESM: Loaded 48421 existing records from primary storage. [2025-10-14T19:21:29.648558] [INFO ] [MAIN ] HESM: Loaded 48421 existing records. [2025-10-14T19:21:29.823065] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:21:29.823342] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-14T19:21:29.823394] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-14T19:21:29.823786] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-14T19:21:29.823844] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-14T19:21:30.181903] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:21:30.358064] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-14T19:21:30.983222] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T19:21:31.158066] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-14T19:21:31.560376] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T19:21:31.607196] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T19:21:31.958054] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-14T19:21:32.758102] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-14T19:21:33.335593] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T19:21:33.478343] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T19:21:33.558065] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-14T19:21:34.358093] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-14T19:21:34.960451] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T19:21:35.158054] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-14T19:21:35.248665] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T19:21:35.958113] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-14T19:21:36.110355] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T19:21:36.758050] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-14T19:21:37.304588] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T19:21:37.558096] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-14T19:21:37.891546] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T19:21:37.894671] [INFO ] [REMOTE ] HEI: Full fetch complete (47711 records). [2025-10-14T19:21:37.894765] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-14T19:21:38.228588] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T19:21:38.264946] [INFO ] [REMOTE ] HEQ: Full fetch complete (9607 records). [2025-10-14T19:21:38.273174] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-14T19:21:38.311781] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-14T19:21:38.333405] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-14T19:21:38.344023] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-14T19:21:38.357284] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-14T19:21:38.369355] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-14T19:21:38.433290] [DEBUG] [LOCAL ] HEI: Trimmed 47711 records to 31298 (keeping 200 days of data) [2025-10-14T19:21:38.855718] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-14T19:21:38.855831] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-14T19:21:38.856116] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-14T19:21:38.856185] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-14T19:21:38.889217] [DEBUG] [LOCAL ] HEQ: Trimmed 9607 records to 6781 (keeping 200 days of data) [2025-10-14T19:21:38.955378] [DEBUG] [LOCAL ] HEI: Primary data saved (31298 records). [2025-10-14T19:21:38.956507] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-14T19:21:38.956885] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEI took 34.5s. Estimated remaining: 3h 12m 10s. Rate: 7.1 symbols/min [2025-10-14T19:21:39.115329] [DEBUG] [LOCAL ] HEQ: Primary data saved (6781 records). [2025-10-14T19:21:39.137422] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-14T19:21:39.137558] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 26.5s. Estimated remaining: 3h 11m 50s. Rate: 7.1 symbols/min [2025-10-14T19:21:39.172501] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:21:39.172585] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-14T19:21:39.205758] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-14T19:21:39.205864] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-14T19:21:39.207022] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-14T19:21:39.207116] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-14T19:21:39.224743] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-14T19:21:39.246516] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-14T19:21:39.433580] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:21:39.449293] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-14T19:21:39.454495] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-14T19:21:39.489941] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-14T19:21:39.506837] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-14T19:21:39.532180] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-14T19:21:39.543386] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-14T19:21:39.840238] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:21:39.988985] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-14T19:21:40.099834] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:21:40.125234] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T19:21:40.269927] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-14T19:21:40.569333] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T19:21:40.758063] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-14T19:21:41.558138] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-14T19:21:42.028829] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-14T19:21:42.322218] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T19:21:42.358097] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-14T19:21:43.158108] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-14T19:21:43.478426] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T19:21:43.958049] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-14T19:21:44.071303] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T19:21:44.077109] [INFO ] [REMOTE ] HDB: Full fetch complete (75509 records). [2025-10-14T19:21:44.077221] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-14T19:21:44.340441] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T19:21:44.500422] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-14T19:21:44.500496] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-14T19:21:44.501488] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-14T19:21:44.501549] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-14T19:21:44.502925] [DEBUG] [LOCAL ] HDB: Trimmed 75509 records to 51927 (keeping 200 days of data) [2025-10-14T19:21:44.779104] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-14T19:21:44.822225] [DEBUG] [LOCAL ] HDB: Primary data saved (51927 records). [2025-10-14T19:21:44.822331] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-14T19:21:44.822420] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HDB took 1m 7s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-14T19:21:44.992425] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:21:45.009716] [DEBUG] [LOCAL ] HFRO: Loaded 17162 existing records from primary storage. [2025-10-14T19:21:45.009962] [INFO ] [MAIN ] HFRO: Loaded 17162 existing records. [2025-10-14T19:21:45.183439] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:21:45.183690] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-14T19:21:45.183793] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-14T19:21:45.183977] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-14T19:21:45.184017] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-14T19:21:45.558583] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-14T19:21:45.558467] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:21:45.790979] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-14T19:21:46.321704] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T19:21:46.358060] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-14T19:21:47.158064] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-14T19:21:47.481734] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T19:21:47.958102] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-14T19:21:48.036698] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T19:21:48.186301] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-14T19:21:48.758057] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-14T19:21:49.186510] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T19:21:49.558074] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-14T19:21:49.788409] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-14T19:21:50.358064] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-14T19:21:50.584591] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-14T19:21:51.158131] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-14T19:21:51.575616] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-14T19:21:51.958050] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-14T19:21:52.758080] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-14T19:21:53.070733] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T19:21:53.558128] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-14T19:21:54.232711] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T19:21:54.358075] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-14T19:21:54.611701] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-14T19:21:54.655805] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T19:21:55.158092] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-14T19:21:55.958125] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-14T19:21:56.274930] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-14T19:21:56.766069] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-14T19:21:56.788333] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T19:21:57.038695] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-14T19:21:57.558108] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-14T19:21:58.358136] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-14T19:21:59.158065] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-14T19:21:59.210337] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T19:21:59.238198] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T19:21:59.244287] [INFO ] [REMOTE ] HESM: Full fetch complete (69645 records). [2025-10-14T19:21:59.244497] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-14T19:21:59.439845] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-14T19:21:59.680300] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-14T19:21:59.680419] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-14T19:21:59.681922] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-14T19:21:59.681987] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-14T19:21:59.683968] [DEBUG] [LOCAL ] HESM: Trimmed 69645 records to 48462 (keeping 200 days of data) [2025-10-14T19:21:59.971856] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-14T19:22:00.003331] [DEBUG] [LOCAL ] HESM: Primary data saved (48462 records). [2025-10-14T19:22:00.003518] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-14T19:22:00.003612] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HESM took 30.6s. Estimated remaining: 3h 11m 39s. Rate: 7.1 symbols/min [2025-10-14T19:22:00.175949] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:00.192522] [DEBUG] [LOCAL ] HGER: Loaded 14728 existing records from primary storage. [2025-10-14T19:22:00.192785] [INFO ] [MAIN ] HGER: Loaded 14728 existing records. [2025-10-14T19:22:00.371198] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:00.371439] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-14T19:22:00.371486] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-14T19:22:00.371736] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-14T19:22:00.371793] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-14T19:22:00.444789] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-14T19:22:00.725808] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:00.758028] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-14T19:22:01.316118] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T19:22:01.558063] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-14T19:22:02.300572] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-14T19:22:02.358058] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-14T19:22:02.584548] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-14T19:22:03.158069] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-14T19:22:03.601356] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-14T19:22:03.958063] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-14T19:22:04.601460] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T19:22:04.758066] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-14T19:22:05.181752] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T19:22:05.558066] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-14T19:22:06.048780] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-14T19:22:06.358069] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-14T19:22:06.812987] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T19:22:06.813858] [INFO ] [REMOTE ] HFND: Full fetch complete (1791 records). [2025-10-14T19:22:06.813928] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-14T19:22:07.022145] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-14T19:22:07.022380] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:22:07.022453] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:22:07.022526] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-14T19:22:07.022833] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-14T19:22:07.022889] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-14T19:22:07.022933] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-14T19:22:07.022992] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HFND took 27.9s. Estimated remaining: 3h 11m 28s. Rate: 7.1 symbols/min [2025-10-14T19:22:07.173340] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-14T19:22:07.205253] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:07.215504] [DEBUG] [LOCAL ] HGLB: Loaded 9724 existing records from primary storage. [2025-10-14T19:22:07.215737] [INFO ] [MAIN ] HGLB: Loaded 9724 existing records. [2025-10-14T19:22:07.391567] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:07.391795] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-14T19:22:07.391842] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-14T19:22:07.392185] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-14T19:22:07.392240] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-14T19:22:07.739458] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:07.931250] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T19:22:07.958078] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-14T19:22:08.727664] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T19:22:08.758043] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-14T19:22:09.558049] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-14T19:22:09.569386] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T19:22:10.358045] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-14T19:22:10.656542] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T19:22:11.017140] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T19:22:11.158066] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-14T19:22:11.958058] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-14T19:22:12.190732] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T19:22:12.626505] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-14T19:22:12.758112] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-14T19:22:12.992608] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-14T19:22:13.558096] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-14T19:22:14.358095] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-14T19:22:14.467505] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T19:22:14.992806] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T19:22:15.158116] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-14T19:22:15.503857] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-14T19:22:15.504585] [INFO ] [REMOTE ] HF: Full fetch complete (435 records). [2025-10-14T19:22:15.504677] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-14T19:22:15.699447] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-14T19:22:15.700556] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:22:15.700639] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:22:15.700747] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-14T19:22:15.700824] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-14T19:22:15.700878] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-14T19:22:15.700921] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-14T19:22:15.700975] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HF took 36.7s. Estimated remaining: 3h 11m 20s. Rate: 7.1 symbols/min [2025-10-14T19:22:15.873688] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:15.887218] [DEBUG] [LOCAL ] HGTY: Loaded 13154 existing records from primary storage. [2025-10-14T19:22:15.887479] [INFO ] [MAIN ] HGTY: Loaded 13154 existing records. [2025-10-14T19:22:15.963201] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-14T19:22:16.072852] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:16.073075] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-14T19:22:16.073137] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-14T19:22:16.073757] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-14T19:22:16.073816] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-14T19:22:16.422002] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:16.730452] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T19:22:16.758067] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-14T19:22:17.447116] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T19:22:17.558071] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-14T19:22:18.358092] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-14T19:22:18.544081] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T19:22:19.096703] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T19:22:19.158097] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-14T19:22:19.898187] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-14T19:22:19.958093] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-14T19:22:20.758104] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-14T19:22:21.046425] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T19:22:21.049560] [INFO ] [REMOTE ] HGER: Full fetch complete (18062 records). [2025-10-14T19:22:21.049659] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-14T19:22:21.411325] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-14T19:22:21.411423] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-14T19:22:21.411831] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-14T19:22:21.411892] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-14T19:22:21.412433] [DEBUG] [LOCAL ] HGER: Trimmed 18062 records to 14809 (keeping 200 days of data) [2025-10-14T19:22:21.480166] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T19:22:21.509363] [DEBUG] [LOCAL ] HGER: Primary data saved (14809 records). [2025-10-14T19:22:21.509491] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-14T19:22:21.509569] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGER took 21.5s. Estimated remaining: 3h 11m 8s. Rate: 7.1 symbols/min [2025-10-14T19:22:21.563333] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-14T19:22:21.680762] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:21.722497] [DEBUG] [LOCAL ] HGV: Loaded 46369 existing records from primary storage. [2025-10-14T19:22:21.722833] [INFO ] [MAIN ] HGV: Loaded 46369 existing records. [2025-10-14T19:22:21.900693] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:21.900921] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-14T19:22:21.900968] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-14T19:22:21.901845] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-14T19:22:21.901902] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-14T19:22:22.258284] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:22.358036] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-14T19:22:22.433867] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T19:22:23.158073] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-14T19:22:23.872861] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T19:22:23.958235] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-14T19:22:24.110536] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-14T19:22:24.753952] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T19:22:24.758022] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-14T19:22:25.544088] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T19:22:25.558229] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-14T19:22:26.358185] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-14T19:22:26.998724] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T19:22:27.158073] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-14T19:22:27.188566] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T19:22:27.958081] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-14T19:22:28.559907] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T19:22:28.702605] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T19:22:28.758069] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-14T19:22:29.248055] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T19:22:29.558064] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-14T19:22:30.304018] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T19:22:30.358095] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-14T19:22:31.086806] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T19:22:31.158070] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-14T19:22:31.958069] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-14T19:22:32.243620] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T19:22:32.758113] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-14T19:22:32.944786] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T19:22:33.558044] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-14T19:22:33.588792] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T19:22:34.358080] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-14T19:22:34.536135] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T19:22:34.921378] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T19:22:35.158114] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-14T19:22:35.958144] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-14T19:22:36.748078] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T19:22:36.758021] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-14T19:22:37.020103] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:22:37.022137] [INFO ] [REMOTE ] HFRO: Full fetch complete (28160 records). [2025-10-14T19:22:37.022407] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-14T19:22:37.410239] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-14T19:22:37.410328] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-14T19:22:37.410967] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-14T19:22:37.411030] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-14T19:22:37.411901] [DEBUG] [LOCAL ] HFRO: Trimmed 28160 records to 17027 (keeping 200 days of data) [2025-10-14T19:22:37.509728] [DEBUG] [LOCAL ] HFRO: Primary data saved (17027 records). [2025-10-14T19:22:37.509871] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-14T19:22:37.509949] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HFRO took 52.7s. Estimated remaining: 3h 11m 10s. Rate: 7.1 symbols/min [2025-10-14T19:22:37.565227] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-14T19:22:37.683485] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:37.713303] [DEBUG] [LOCAL ] HHH: Loaded 33136 existing records from primary storage. [2025-10-14T19:22:37.713561] [INFO ] [MAIN ] HHH: Loaded 33136 existing records. [2025-10-14T19:22:37.890039] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:37.890249] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-14T19:22:37.890295] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-14T19:22:37.890812] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-14T19:22:37.890868] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-14T19:22:38.261949] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:38.358030] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-14T19:22:38.393545] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T19:22:38.428716] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T19:22:39.158114] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-14T19:22:39.447011] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:22:39.902195] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T19:22:39.958116] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-14T19:22:40.758094] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-14T19:22:40.769834] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T19:22:40.771793] [INFO ] [REMOTE ] HGTY: Full fetch complete (17408 records). [2025-10-14T19:22:40.771865] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-14T19:22:41.125495] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-14T19:22:41.125566] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-14T19:22:41.125942] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-14T19:22:41.126000] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-14T19:22:41.126503] [DEBUG] [LOCAL ] HGTY: Trimmed 17408 records to 13282 (keeping 200 days of data) [2025-10-14T19:22:41.201639] [DEBUG] [LOCAL ] HGTY: Primary data saved (13282 records). [2025-10-14T19:22:41.201784] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-14T19:22:41.201859] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGTY took 25.5s. Estimated remaining: 3h 10m 55s. Rate: 7.1 symbols/min [2025-10-14T19:22:41.367600] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:41.400212] [DEBUG] [LOCAL ] HI: Loaded 35572 existing records from primary storage. [2025-10-14T19:22:41.400469] [INFO ] [MAIN ] HI: Loaded 35572 existing records. [2025-10-14T19:22:41.559809] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-14T19:22:41.581667] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:41.581896] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-14T19:22:41.581966] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-14T19:22:41.582786] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-14T19:22:41.582842] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-14T19:22:41.937255] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:42.355115] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T19:22:42.363744] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-14T19:22:42.540288] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:22:42.768502] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-14T19:22:43.158042] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-14T19:22:43.958062] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-14T19:22:44.546702] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T19:22:44.758070] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-14T19:22:45.240988] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T19:22:45.558058] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-14T19:22:45.582818] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T19:22:46.358141] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-14T19:22:46.829880] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T19:22:47.158069] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-14T19:22:47.338505] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:22:47.958092] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-14T19:22:48.646362] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:22:48.758068] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-14T19:22:48.834821] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T19:22:48.836579] [INFO ] [REMOTE ] HGLB: Full fetch complete (14752 records). [2025-10-14T19:22:48.836673] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-14T19:22:49.195755] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-14T19:22:49.195827] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-14T19:22:49.196190] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-14T19:22:49.196229] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-14T19:22:49.196896] [DEBUG] [LOCAL ] HGLB: Trimmed 14752 records to 9621 (keeping 200 days of data) [2025-10-14T19:22:49.255814] [DEBUG] [LOCAL ] HGLB: Primary data saved (9621 records). [2025-10-14T19:22:49.255949] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-14T19:22:49.256031] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGLB took 42.2s. Estimated remaining: 3h 10m 46s. Rate: 7.1 symbols/min [2025-10-14T19:22:49.429987] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:22:49.483217] [DEBUG] [LOCAL ] HIG: Loaded 51154 existing records from primary storage. [2025-10-14T19:22:49.483543] [INFO ] [MAIN ] HIG: Loaded 51154 existing records. [2025-10-14T19:22:49.563315] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-14T19:22:49.663562] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:22:49.663829] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-14T19:22:49.663880] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-14T19:22:49.664842] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-14T19:22:49.664901] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-14T19:22:50.090953] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:22:50.363244] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-14T19:22:50.379848] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T19:22:50.840990] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T19:22:51.158148] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-14T19:22:51.958031] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-14T19:22:52.004893] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T19:22:52.758125] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-14T19:22:53.558123] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-14T19:23:04.954989] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (13.00 seconds). [2025-10-14T19:23:04.962502] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-14T19:23:05.529615] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (14.37 seconds). [2025-10-14T19:23:05.542356] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-14T19:23:05.661080] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (12.90 seconds). [2025-10-14T19:23:05.669785] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-14T19:23:06.039498] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (12.48 seconds). [2025-10-14T19:23:06.049540] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-14T19:23:06.615752] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T19:23:06.622996] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-14T19:23:06.950767] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:23:06.960192] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-14T19:23:07.205400] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T19:23:07.212822] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-14T19:23:07.395452] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T19:23:07.405556] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-14T19:23:07.921105] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T19:23:07.929873] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-14T19:23:08.273694] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T19:23:08.282128] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-14T19:23:08.528061] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T19:23:08.533847] [INFO ] [REMOTE ] HGV: Full fetch complete (65967 records). [2025-10-14T19:23:08.534089] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-14T19:23:08.963801] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-14T19:23:08.964181] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-14T19:23:08.965474] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-14T19:23:08.965544] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-14T19:23:08.967569] [DEBUG] [LOCAL ] HGV: Trimmed 65967 records to 46382 (keeping 200 days of data) [2025-10-14T19:23:09.235161] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T19:23:09.274075] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-14T19:23:09.287564] [DEBUG] [LOCAL ] HGV: Primary data saved (46382 records). [2025-10-14T19:23:09.287799] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-14T19:23:09.287935] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HGV took 47.8s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-14T19:23:09.477169] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T19:23:09.499493] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:09.509402] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-14T19:23:09.532524] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T19:23:09.541174] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-14T19:23:09.568444] [DEBUG] [LOCAL ] HII: Loaded 33833 existing records from primary storage. [2025-10-14T19:23:09.568768] [INFO ] [MAIN ] HII: Loaded 33833 existing records. [2025-10-14T19:23:09.751321] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:09.751522] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-14T19:23:09.751570] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-14T19:23:09.752267] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-14T19:23:09.752325] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-14T19:23:10.101252] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:10.101550] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-14T19:23:10.933790] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T19:23:10.960558] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T19:23:10.968073] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-14T19:23:10.970186] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-14T19:23:11.065765] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T19:23:11.077026] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-14T19:23:11.342602] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T19:23:11.351044] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-14T19:23:11.971554] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T19:23:11.975316] [INFO ] [REMOTE ] HHH: Full fetch complete (45856 records). [2025-10-14T19:23:11.975482] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-14T19:23:12.389020] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-14T19:23:12.389190] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-14T19:23:12.390208] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-14T19:23:12.390536] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-14T19:23:12.413500] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T19:23:12.413734] [DEBUG] [LOCAL ] HHH: Trimmed 45856 records to 33198 (keeping 200 days of data) [2025-10-14T19:23:12.423765] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-14T19:23:12.536296] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T19:23:12.546853] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-14T19:23:12.586965] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T19:23:12.600580] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-14T19:23:12.698466] [DEBUG] [LOCAL ] HHH: Primary data saved (33198 records). [2025-10-14T19:23:12.698617] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-14T19:23:12.698730] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HHH took 35.2s. Estimated remaining: 3h 10m 38s. Rate: 7.1 symbols/min [2025-10-14T19:23:12.865597] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:12.924497] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-14T19:23:12.924827] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-14T19:23:13.112184] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:13.112440] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-14T19:23:13.112498] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-14T19:23:13.113345] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-14T19:23:13.113403] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-14T19:23:13.460507] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:13.460850] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-14T19:23:13.966052] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T19:23:13.974286] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-14T19:23:14.175337] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T19:23:14.184156] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-14T19:23:14.274588] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T19:23:14.285801] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-14T19:23:15.392010] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T19:23:15.400060] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-14T19:23:15.680385] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T19:23:15.690250] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-14T19:23:15.770685] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T19:23:15.958242] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-14T19:23:16.139380] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-14T19:23:16.758105] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-14T19:23:16.884555] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T19:23:16.889496] [INFO ] [REMOTE ] HI: Full fetch complete (50263 records). [2025-10-14T19:23:16.889591] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-14T19:23:17.334051] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-14T19:23:17.334169] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-14T19:23:17.335090] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-14T19:23:17.335249] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-14T19:23:17.360516] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T19:23:17.360697] [DEBUG] [LOCAL ] HI: Trimmed 50263 records to 35603 (keeping 200 days of data) [2025-10-14T19:23:17.563407] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-14T19:23:17.612851] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T19:23:17.630943] [DEBUG] [LOCAL ] HI: Primary data saved (35603 records). [2025-10-14T19:23:17.631079] [INFO ] [MAIN ] HI: Full history saved. [2025-10-14T19:23:17.631158] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HI took 36.4s. Estimated remaining: 3h 10m 25s. Rate: 7.1 symbols/min [2025-10-14T19:23:17.796888] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:17.821471] [DEBUG] [LOCAL ] HIO: Loaded 24076 existing records from primary storage. [2025-10-14T19:23:17.821846] [INFO ] [MAIN ] HIO: Loaded 24076 existing records. [2025-10-14T19:23:17.996612] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:17.996836] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-14T19:23:17.996880] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-14T19:23:17.997497] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-14T19:23:17.997554] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-14T19:23:18.344731] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:18.358049] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-14T19:23:18.898931] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T19:23:19.158105] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-14T19:23:19.239994] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-14T19:23:19.266513] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T19:23:19.958057] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-14T19:23:20.758057] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-14T19:23:20.814629] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T19:23:21.255297] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T19:23:21.558080] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-14T19:23:22.128115] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T19:23:22.358074] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-14T19:23:23.158093] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-14T19:23:23.768057] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-14T19:23:23.798866] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T19:23:23.958089] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-14T19:23:24.328913] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T19:23:24.758061] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-14T19:23:25.083380] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T19:23:25.442994] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T19:23:25.448846] [INFO ] [REMOTE ] HIG: Full fetch complete (73358 records). [2025-10-14T19:23:25.448970] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-14T19:23:25.563163] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-14T19:23:25.886834] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-14T19:23:25.886911] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-14T19:23:25.887862] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-14T19:23:25.887922] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-14T19:23:25.889236] [DEBUG] [LOCAL ] HIG: Trimmed 73358 records to 51171 (keeping 200 days of data) [2025-10-14T19:23:26.206245] [DEBUG] [LOCAL ] HIG: Primary data saved (51171 records). [2025-10-14T19:23:26.206398] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-14T19:23:26.206486] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HIG took 37.0s. Estimated remaining: 3h 10m 17s. Rate: 7.1 symbols/min [2025-10-14T19:23:26.365134] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-14T19:23:26.373462] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:26.394518] [DEBUG] [LOCAL ] HIPO: Loaded 21977 existing records from primary storage. [2025-10-14T19:23:26.394789] [INFO ] [MAIN ] HIPO: Loaded 21977 existing records. [2025-10-14T19:23:26.582971] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:26.583163] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-14T19:23:26.583210] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-14T19:23:26.583595] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-14T19:23:26.583682] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-14T19:23:26.952848] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:26.972397] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:23:27.158071] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-14T19:23:27.782735] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T19:23:27.958087] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-14T19:23:28.758103] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-14T19:23:28.997531] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T19:23:29.558027] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-14T19:23:29.608567] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T19:23:29.914422] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-14T19:23:30.358063] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-14T19:23:30.554925] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T19:23:31.158111] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-14T19:23:31.958159] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-14T19:23:32.212005] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T19:23:32.758077] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-14T19:23:33.063706] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-14T19:23:33.450820] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T19:23:33.455085] [INFO ] [REMOTE ] HII: Full fetch complete (52452 records). [2025-10-14T19:23:33.455318] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-14T19:23:33.563961] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-14T19:23:33.851752] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-14T19:23:33.851861] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-14T19:23:33.852869] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-14T19:23:33.852950] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-14T19:23:33.868080] [DEBUG] [LOCAL ] HII: Trimmed 52452 records to 33836 (keeping 200 days of data) [2025-10-14T19:23:33.869764] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T19:23:34.090764] [DEBUG] [LOCAL ] HII: Primary data saved (33836 records). [2025-10-14T19:23:34.090915] [INFO ] [MAIN ] HII: Full history saved. [2025-10-14T19:23:34.091000] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HII took 24.8s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-14T19:23:34.262923] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:34.307357] [DEBUG] [LOCAL ] HIW: Loaded 44556 existing records from primary storage. [2025-10-14T19:23:34.307697] [INFO ] [MAIN ] HIW: Loaded 44556 existing records. [2025-10-14T19:23:34.370513] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-14T19:23:34.486206] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:34.486453] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-14T19:23:34.486500] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-14T19:23:34.487266] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-14T19:23:34.487325] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-14T19:23:34.842420] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:35.158064] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-14T19:23:35.472220] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T19:23:35.963135] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-14T19:23:35.982881] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-14T19:23:36.675290] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T19:23:36.758040] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-14T19:23:36.965864] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T19:23:37.558062] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-14T19:23:38.187504] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T19:23:38.358045] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-14T19:23:38.589230] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T19:23:39.158081] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-14T19:23:39.947091] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T19:23:39.970138] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-14T19:23:40.008144] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T19:23:40.758137] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-14T19:23:40.805320] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T19:23:41.558081] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-14T19:23:42.362719] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-14T19:23:42.376047] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T19:23:42.733415] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T19:23:43.158084] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-14T19:23:43.958115] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-14T19:23:44.438001] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T19:23:44.585042] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-14T19:23:44.758047] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-14T19:23:45.180538] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T19:23:45.558099] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-14T19:23:46.358074] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-14T19:23:46.905200] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T19:23:47.158050] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-14T19:23:47.509198] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-14T19:23:47.533880] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T19:23:47.958058] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-14T19:23:48.219997] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:23:48.223985] [INFO ] [REMOTE ] HIO: Full fetch complete (37897 records). [2025-10-14T19:23:48.224069] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-14T19:23:48.595854] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-14T19:23:48.595961] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-14T19:23:48.596705] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-14T19:23:48.596769] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-14T19:23:48.597700] [DEBUG] [LOCAL ] HIO: Trimmed 37897 records to 24147 (keeping 200 days of data) [2025-10-14T19:23:48.733005] [DEBUG] [LOCAL ] HIO: Primary data saved (24147 records). [2025-10-14T19:23:48.733127] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-14T19:23:48.733205] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIO took 31.1s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-14T19:23:48.763234] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-14T19:23:48.904977] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:48.923533] [DEBUG] [LOCAL ] HIX: Loaded 20501 existing records from primary storage. [2025-10-14T19:23:48.923818] [INFO ] [MAIN ] HIX: Loaded 20501 existing records. [2025-10-14T19:23:49.106020] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:49.111444] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-14T19:23:49.117686] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-14T19:23:49.118739] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T19:23:49.118278] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-14T19:23:49.123083] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-14T19:23:49.510109] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:49.558075] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-14T19:23:50.358069] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-14T19:23:50.647083] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:23:51.041537] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-14T19:23:51.158044] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-14T19:23:51.628775] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T19:23:51.958088] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-14T19:23:52.758046] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-14T19:23:52.986409] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T19:23:53.485034] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-14T19:23:53.558047] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-14T19:23:54.189225] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:23:54.358061] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-14T19:23:55.158085] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-14T19:23:55.513271] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T19:23:55.890440] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-14T19:23:55.896409] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-14T19:23:55.896535] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-14T19:23:55.963418] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-14T19:23:56.296829] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-14T19:23:56.297046] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-14T19:23:56.298234] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-14T19:23:56.298299] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-14T19:23:56.299798] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-14T19:23:56.536619] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T19:23:56.669618] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-14T19:23:56.669807] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-14T19:23:56.669899] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 44.0s. Estimated remaining: 3h 9m 58s. Rate: 7.1 symbols/min [2025-10-14T19:23:56.764182] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-14T19:23:56.851783] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:56.872416] [DEBUG] [LOCAL ] HKD: Loaded 18625 existing records from primary storage. [2025-10-14T19:23:56.872701] [INFO ] [MAIN ] HKD: Loaded 18625 existing records. [2025-10-14T19:23:57.056127] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:57.067954] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-14T19:23:57.067847] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T19:23:57.071855] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-14T19:23:57.072852] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-14T19:23:57.072913] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-14T19:23:57.428306] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:57.551538] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T19:23:57.553918] [INFO ] [REMOTE ] HIPO: Full fetch complete (31360 records). [2025-10-14T19:23:57.554033] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-14T19:23:57.566564] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-14T19:23:57.992470] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-14T19:23:57.992548] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-14T19:23:57.993282] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-14T19:23:57.993345] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-14T19:23:57.994126] [DEBUG] [LOCAL ] HIPO: Trimmed 31360 records to 21934 (keeping 200 days of data) [2025-10-14T19:23:58.123609] [DEBUG] [LOCAL ] HIPO: Primary data saved (21934 records). [2025-10-14T19:23:58.123759] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-14T19:23:58.123842] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIPO took 31.9s. Estimated remaining: 3h 9m 40s. Rate: 7.1 symbols/min [2025-10-14T19:23:58.301745] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:23:58.352557] [DEBUG] [LOCAL ] HL: Loaded 53672 existing records from primary storage. [2025-10-14T19:23:58.352899] [INFO ] [MAIN ] HL: Loaded 53672 existing records. [2025-10-14T19:23:58.364376] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-14T19:23:58.538422] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:23:58.538742] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-14T19:23:58.538882] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-14T19:23:58.539555] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-14T19:23:58.539613] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-14T19:23:58.745814] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T19:23:58.930820] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:23:59.125006] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T19:23:59.158054] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-14T19:23:59.958061] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-14T19:24:00.758079] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-14T19:24:01.011094] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T19:24:01.136718] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T19:24:01.558077] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-14T19:24:02.041961] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T19:24:02.358092] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-14T19:24:02.748727] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-14T19:24:03.158077] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-14T19:24:03.342552] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T19:24:03.958162] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-14T19:24:04.758043] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-14T19:24:04.948668] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T19:24:05.299116] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T19:24:05.558101] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-14T19:24:05.843149] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T19:24:06.358131] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-14T19:24:06.782477] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T19:24:06.787532] [INFO ] [REMOTE ] HIW: Full fetch complete (64847 records). [2025-10-14T19:24:06.787631] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-14T19:24:07.166949] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-14T19:24:07.171164] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-14T19:24:07.171249] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-14T19:24:07.172161] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-14T19:24:07.172319] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-14T19:24:07.173581] [DEBUG] [LOCAL ] HIW: Trimmed 64847 records to 44584 (keeping 200 days of data) [2025-10-14T19:24:07.422962] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T19:24:07.458433] [DEBUG] [LOCAL ] HIW: Primary data saved (44584 records). [2025-10-14T19:24:07.458569] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-14T19:24:07.458668] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIW took 33.4s. Estimated remaining: 3h 9m 33s. Rate: 7.1 symbols/min [2025-10-14T19:24:07.625408] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:24:07.667877] [DEBUG] [LOCAL ] HLF: Loaded 48470 existing records from primary storage. [2025-10-14T19:24:07.668187] [INFO ] [MAIN ] HLF: Loaded 48470 existing records. [2025-10-14T19:24:07.844087] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:24:07.844312] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-14T19:24:07.844364] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-14T19:24:07.844692] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-14T19:24:07.844749] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-14T19:24:07.963285] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-14T19:24:08.208955] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:24:08.758043] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-14T19:24:08.834064] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T19:24:09.021588] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-14T19:24:09.558043] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-14T19:24:09.767940] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T19:24:10.358050] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-14T19:24:10.609000] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T19:24:11.158041] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-14T19:24:11.409260] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T19:24:11.958065] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-14T19:24:12.266345] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T19:24:12.758091] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-14T19:24:13.558078] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-14T19:24:13.933104] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T19:24:14.131140] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T19:24:14.358067] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-14T19:24:15.158040] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-14T19:24:15.231507] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T19:24:15.457005] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T19:24:15.958055] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-14T19:24:16.758057] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-14T19:24:16.955210] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T19:24:16.957714] [INFO ] [REMOTE ] HIX: Full fetch complete (30172 records). [2025-10-14T19:24:16.957786] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-14T19:24:17.250279] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-14T19:24:17.391274] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-14T19:24:17.391354] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-14T19:24:17.392051] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-14T19:24:17.392118] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-14T19:24:17.393023] [DEBUG] [LOCAL ] HIX: Trimmed 30172 records to 20500 (keeping 200 days of data) [2025-10-14T19:24:17.512437] [DEBUG] [LOCAL ] HIX: Primary data saved (20500 records). [2025-10-14T19:24:17.512561] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-14T19:24:17.512635] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HIX took 28.8s. Estimated remaining: 3h 9m 27s. Rate: 7.1 symbols/min [2025-10-14T19:24:17.568526] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-14T19:24:17.687828] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:24:17.721171] [DEBUG] [LOCAL ] HLI: Loaded 30937 existing records from primary storage. [2025-10-14T19:24:17.721470] [INFO ] [MAIN ] HLI: Loaded 30937 existing records. [2025-10-14T19:24:17.903179] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:24:17.903376] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-14T19:24:17.903422] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-14T19:24:17.903774] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-14T19:24:17.903832] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-14T19:24:18.284439] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:24:18.299934] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T19:24:18.358073] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-14T19:24:19.158122] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-14T19:24:19.517178] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-14T19:24:19.958047] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-14T19:24:19.987990] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T19:24:20.506303] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T19:24:20.758060] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-14T19:24:21.558106] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-14T19:24:21.874400] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T19:24:22.358413] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-14T19:24:22.359353] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T19:24:22.408102] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T19:24:23.158061] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-14T19:24:23.958093] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-14T19:24:23.987241] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T19:24:24.424139] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T19:24:24.758063] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-14T19:24:25.491627] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T19:24:25.558086] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-14T19:24:25.928970] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T19:24:26.358058] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-14T19:24:26.987438] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T19:24:27.158059] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-14T19:24:27.958036] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-14T19:24:28.113924] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T19:24:28.267516] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T19:24:28.270237] [INFO ] [REMOTE ] HKD: Full fetch complete (28343 records). [2025-10-14T19:24:28.270316] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-14T19:24:28.631984] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-14T19:24:28.632057] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-14T19:24:28.632631] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-14T19:24:28.632713] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-14T19:24:28.633366] [DEBUG] [LOCAL ] HKD: Trimmed 28343 records to 18591 (keeping 200 days of data) [2025-10-14T19:24:28.743112] [DEBUG] [LOCAL ] HKD: Primary data saved (18591 records). [2025-10-14T19:24:28.743261] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-14T19:24:28.743344] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HKD took 32.1s. Estimated remaining: 3h 9m 22s. Rate: 7.1 symbols/min [2025-10-14T19:24:28.767544] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-14T19:24:28.939299] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:24:28.969511] [DEBUG] [LOCAL ] HLIO: Loaded 28073 existing records from primary storage. [2025-10-14T19:24:28.969861] [INFO ] [MAIN ] HLIO: Loaded 28073 existing records. [2025-10-14T19:24:29.171394] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:24:29.171622] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-14T19:24:29.171704] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-14T19:24:29.171917] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-14T19:24:29.171973] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-14T19:24:29.529601] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:24:29.554883] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T19:24:29.563404] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-14T19:24:30.210594] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T19:24:30.358105] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-14T19:24:31.158114] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-14T19:24:31.336788] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T19:24:31.783754] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-14T19:24:31.958033] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-14T19:24:32.394688] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T19:24:32.758063] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-14T19:24:32.939775] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:24:33.558086] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-14T19:24:34.358041] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-14T19:24:34.516843] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T19:24:35.118857] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-14T19:24:35.124807] [INFO ] [REMOTE ] HL: Full fetch complete (77822 records). [2025-10-14T19:24:35.124934] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-14T19:24:35.163186] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-14T19:24:35.545794] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-14T19:24:35.545880] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-14T19:24:35.547005] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-14T19:24:35.547068] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-14T19:24:35.548563] [DEBUG] [LOCAL ] HL: Trimmed 77822 records to 53673 (keeping 200 days of data) [2025-10-14T19:24:35.886840] [DEBUG] [LOCAL ] HL: Primary data saved (53673 records). [2025-10-14T19:24:35.886984] [INFO ] [MAIN ] HL: Full history saved. [2025-10-14T19:24:35.887064] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HL took 37.8s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-14T19:24:35.963548] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-14T19:24:36.069019] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:24:36.100318] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T19:24:36.137526] [DEBUG] [LOCAL ] HLLY: Loaded 33620 existing records from primary storage. [2025-10-14T19:24:36.137877] [INFO ] [MAIN ] HLLY: Loaded 33620 existing records. [2025-10-14T19:24:36.324923] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:24:36.325149] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-14T19:24:36.325230] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-14T19:24:36.325619] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-14T19:24:36.325705] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-14T19:24:36.628705] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T19:24:36.712212] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:24:36.758024] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-14T19:24:37.109131] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T19:24:37.558116] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-14T19:24:37.795408] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T19:24:38.358103] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-14T19:24:39.164960] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-14T19:24:39.183577] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:24:39.401211] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T19:24:39.958047] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-14T19:24:40.428314] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T19:24:40.758048] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-14T19:24:41.003316] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T19:24:41.558101] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-14T19:24:41.837519] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T19:24:42.358074] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-14T19:24:42.382274] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T19:24:43.158080] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-14T19:24:43.700445] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T19:24:43.940347] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T19:24:43.958025] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-14T19:24:44.758076] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-14T19:24:45.348146] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T19:24:45.558090] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-14T19:24:46.029349] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T19:24:46.358090] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-14T19:24:46.992851] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:24:47.158058] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-14T19:24:47.439176] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T19:24:47.958131] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-14T19:24:48.369161] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T19:24:48.758058] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-14T19:24:49.245760] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T19:24:49.558070] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-14T19:24:49.634196] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T19:24:50.317356] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T19:24:50.358034] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-14T19:24:51.158073] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-14T19:24:51.599615] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T19:24:51.958057] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-14T19:24:52.305134] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T19:24:52.758103] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-14T19:24:53.383593] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T19:24:53.558122] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-14T19:24:54.358047] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-14T19:24:54.409464] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T19:24:54.496873] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T19:24:55.158069] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-14T19:24:55.429168] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T19:24:55.958055] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-14T19:24:56.289243] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T19:24:56.292849] [INFO ] [REMOTE ] HLI: Full fetch complete (45232 records). [2025-10-14T19:24:56.292945] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-14T19:24:56.671415] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-14T19:24:56.671495] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-14T19:24:56.672237] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-14T19:24:56.672300] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-14T19:24:56.673249] [DEBUG] [LOCAL ] HLI: Trimmed 45232 records to 30898 (keeping 200 days of data) [2025-10-14T19:24:56.765086] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-14T19:24:56.873120] [DEBUG] [LOCAL ] HLI: Primary data saved (30898 records). [2025-10-14T19:24:56.873254] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-14T19:24:56.873333] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLI took 39.4s. Estimated remaining: 3h 9m 20s. Rate: 7.1 symbols/min [2025-10-14T19:24:57.041495] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:24:57.090578] [DEBUG] [LOCAL ] HLN: Loaded 53113 existing records from primary storage. [2025-10-14T19:24:57.091498] [INFO ] [MAIN ] HLN: Loaded 53113 existing records. [2025-10-14T19:24:57.277109] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:24:57.285339] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-14T19:24:57.285831] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T19:24:57.290492] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-14T19:24:57.291396] [INFO ] [REMOTE ] HLF: Full fetch complete (70999 records). [2025-10-14T19:24:57.291506] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-14T19:24:57.325693] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-14T19:24:57.350839] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-14T19:24:57.563556] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-14T19:24:57.995963] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-14T19:24:58.022571] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-14T19:24:58.039193] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-14T19:24:58.039291] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-14T19:24:58.112512] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:24:58.113340] [DEBUG] [LOCAL ] HLF: Trimmed 70999 records to 48505 (keeping 200 days of data) [2025-10-14T19:24:58.116383] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T19:24:58.362811] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-14T19:24:58.391665] [DEBUG] [LOCAL ] HLF: Primary data saved (48505 records). [2025-10-14T19:24:58.391803] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-14T19:24:58.391882] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLF took 50.9s. Estimated remaining: 3h 9m 2s. Rate: 7.1 symbols/min [2025-10-14T19:24:58.557682] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:24:58.605132] [DEBUG] [LOCAL ] HLT: Loaded 50609 existing records from primary storage. [2025-10-14T19:24:58.605430] [INFO ] [MAIN ] HLT: Loaded 50609 existing records. [2025-10-14T19:24:58.799492] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T19:24:58.798973] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:24:58.804006] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-14T19:24:58.804091] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-14T19:24:58.804224] [INFO ] [REMOTE ] HLLY: Full fetch complete (46204 records). [2025-10-14T19:24:58.804305] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-14T19:24:58.804565] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-14T19:24:58.804663] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-14T19:24:59.164042] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-14T19:24:59.512436] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:24:59.598080] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T19:24:59.598296] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-14T19:24:59.601284] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-14T19:24:59.602254] [INFO ] [REMOTE ] HLIO: Full fetch complete (36623 records). [2025-10-14T19:24:59.602353] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-14T19:24:59.602158] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-14T19:24:59.602564] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-14T19:24:59.703958] [DEBUG] [LOCAL ] HLLY: Trimmed 46204 records to 33534 (keeping 200 days of data) [2025-10-14T19:24:59.960888] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-14T19:25:00.120820] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-14T19:25:00.121561] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-14T19:25:00.122590] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-14T19:25:00.123359] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-14T19:25:00.127314] [DEBUG] [LOCAL ] HLIO: Trimmed 36623 records to 28076 (keeping 200 days of data) [2025-10-14T19:25:00.337910] [DEBUG] [LOCAL ] HLLY: Primary data saved (33534 records). [2025-10-14T19:25:00.341552] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-14T19:25:00.341730] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 24.5s. Estimated remaining: 3h 8m 45s. Rate: 7.1 symbols/min [2025-10-14T19:25:00.574122] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:00.574839] [DEBUG] [LOCAL ] HLX: No existing data file found in primary storage. [2025-10-14T19:25:00.575208] [WARN ] [MAIN ] HLX: No existing data found, performing full refresh instead. [2025-10-14T19:25:00.575599] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-14T19:25:00.577591] [DEBUG] [LOCAL ] HLIO: Primary data saved (28076 records). [2025-10-14T19:25:00.577710] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-14T19:25:00.577821] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-14T19:25:00.577925] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-14T19:25:00.577882] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-14T19:25:00.601712] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLIO took 31.9s. Estimated remaining: 3h 8m 26s. Rate: 7.1 symbols/min [2025-10-14T19:25:01.028463] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:01.151925] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:01.152487] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-14T19:25:01.182905] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T19:25:01.226508] [DEBUG] [LOCAL ] HMC: Loaded 46553 existing records from primary storage. [2025-10-14T19:25:01.226993] [INFO ] [MAIN ] HMC: Loaded 46553 existing records. [2025-10-14T19:25:01.418169] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:25:01.418425] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-14T19:25:01.418474] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-14T19:25:01.418874] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-14T19:25:01.418931] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-14T19:25:01.567085] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-14T19:25:01.815754] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:01.853500] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T19:25:02.358103] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-14T19:25:02.985217] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T19:25:03.158050] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-14T19:25:03.391686] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T19:25:03.900495] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T19:25:03.958124] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-14T19:25:04.758074] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-14T19:25:04.948575] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T19:25:05.211880] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T19:25:05.558068] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-14T19:25:06.358059] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-14T19:25:06.530456] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T19:25:07.086988] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T19:25:07.158032] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-14T19:25:07.710755] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T19:25:07.958071] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-14T19:25:08.768609] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-14T19:25:08.801987] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T19:25:09.558043] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-14T19:25:09.849294] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T19:25:10.358079] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-14T19:25:10.665420] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T19:25:10.781442] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T19:25:11.158083] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-14T19:25:11.958039] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-14T19:25:12.136905] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T19:25:12.564103] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T19:25:12.758120] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-14T19:25:13.558073] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-14T19:25:13.768292] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T19:25:14.358097] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-14T19:25:14.621054] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T19:25:15.085066] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T19:25:15.158030] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-14T19:25:15.863833] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T19:25:15.958038] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-14T19:25:16.758085] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-14T19:25:16.967710] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T19:25:17.558040] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-14T19:25:17.929935] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-14T19:25:18.358040] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-14T19:25:18.420504] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T19:25:19.158068] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-14T19:25:19.260020] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T19:25:19.958037] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-14T19:25:20.140672] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T19:25:20.747755] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T19:25:20.758031] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-14T19:25:21.392067] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T19:25:21.558052] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-14T19:25:21.962276] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T19:25:22.358103] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-14T19:25:23.158097] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-14T19:25:23.234243] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T19:25:23.958053] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-14T19:25:24.221548] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T19:25:24.341064] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T19:25:24.345915] [INFO ] [REMOTE ] HLX: Full fetch complete (68993 records). [2025-10-14T19:25:24.346020] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-14T19:25:24.726768] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-14T19:25:24.726854] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-14T19:25:24.727789] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-14T19:25:24.727871] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-14T19:25:24.729190] [DEBUG] [LOCAL ] HLX: Trimmed 68993 records to 47440 (keeping 200 days of data) [2025-10-14T19:25:24.773370] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-14T19:25:24.993340] [DEBUG] [LOCAL ] HLX: Primary data saved (47440 records). [2025-10-14T19:25:24.993473] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-14T19:25:24.993543] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLX took 24.7s. Estimated remaining: 3h 8m 38s. Rate: 7.1 symbols/min [2025-10-14T19:25:25.215860] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:25.239139] [DEBUG] [LOCAL ] HMN: Loaded 23424 existing records from primary storage. [2025-10-14T19:25:25.239381] [INFO ] [MAIN ] HMN: Loaded 23424 existing records. [2025-10-14T19:25:25.445637] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:25:25.446020] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-14T19:25:25.446198] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-14T19:25:25.446589] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-14T19:25:25.446753] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-14T19:25:25.558892] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-14T19:25:25.862124] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T19:25:25.866590] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:26.358069] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-14T19:25:26.522100] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T19:25:27.058196] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T19:25:27.158062] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-14T19:25:27.409032] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T19:25:27.958088] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-14T19:25:28.637776] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T19:25:28.758048] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-14T19:25:28.884400] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T19:25:29.558060] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-14T19:25:30.160262] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T19:25:30.358060] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-14T19:25:31.158085] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-14T19:25:31.207745] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T19:25:31.213714] [INFO ] [REMOTE ] HLN: Full fetch complete (77010 records). [2025-10-14T19:25:31.213816] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-14T19:25:31.612143] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-14T19:25:31.612314] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-14T19:25:31.613406] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-14T19:25:31.613517] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-14T19:25:31.615047] [DEBUG] [LOCAL ] HLN: Trimmed 77010 records to 53117 (keeping 200 days of data) [2025-10-14T19:25:31.852972] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T19:25:31.958074] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-14T19:25:31.970177] [DEBUG] [LOCAL ] HLN: Primary data saved (53117 records). [2025-10-14T19:25:31.970254] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-14T19:25:31.970326] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLN took 35.1s. Estimated remaining: 3h 8m 28s. Rate: 7.1 symbols/min [2025-10-14T19:25:32.137471] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:32.186757] [DEBUG] [LOCAL ] HMY: Loaded 53167 existing records from primary storage. [2025-10-14T19:25:32.187113] [INFO ] [MAIN ] HMY: Loaded 53167 existing records. [2025-10-14T19:25:32.362175] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:25:32.362866] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-14T19:25:32.363008] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-14T19:25:32.363380] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-14T19:25:32.363446] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-14T19:25:32.744950] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:32.749097] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T19:25:32.758403] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-14T19:25:33.247473] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-14T19:25:33.558091] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-14T19:25:34.358084] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-14T19:25:34.570932] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T19:25:35.158043] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-14T19:25:35.219080] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T19:25:35.694633] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T19:25:35.958073] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-14T19:25:36.700135] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T19:25:36.705880] [INFO ] [REMOTE ] HLT: Full fetch complete (73629 records). [2025-10-14T19:25:36.706060] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-14T19:25:36.767591] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-14T19:25:37.119622] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-14T19:25:37.119828] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-14T19:25:37.121044] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-14T19:25:37.121146] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-14T19:25:37.123294] [DEBUG] [LOCAL ] HLT: Trimmed 73629 records to 50550 (keeping 200 days of data) [2025-10-14T19:25:37.253977] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-14T19:25:37.483528] [DEBUG] [LOCAL ] HLT: Primary data saved (50550 records). [2025-10-14T19:25:37.483695] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-14T19:25:37.483789] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HLT took 39.1s. Estimated remaining: 3h 8m 16s. Rate: 7.1 symbols/min [2025-10-14T19:25:37.561616] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-14T19:25:37.656227] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:37.656478] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-14T19:25:37.656577] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-14T19:25:37.656718] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-14T19:25:37.656767] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-14T19:25:37.656809] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-14T19:25:37.656840] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-14T19:25:37.948093] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T19:25:38.028620] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:38.358083] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-14T19:25:38.731141] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:25:38.731464] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-14T19:25:38.731551] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:25:38.731620] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-14T19:25:38.731702] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:25:38.731773] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-14T19:25:38.731832] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-14T19:25:38.731870] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-14T19:25:38.731909] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-14T19:25:38.731953] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HNGE took 1.2s. Estimated remaining: 3h 7m 58s. Rate: 7.1 symbols/min [2025-10-14T19:25:38.898155] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:38.926314] [DEBUG] [LOCAL ] HNI: Loaded 29427 existing records from primary storage. [2025-10-14T19:25:38.926559] [INFO ] [MAIN ] HNI: Loaded 29427 existing records. [2025-10-14T19:25:39.104063] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:25:39.104325] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-14T19:25:39.104442] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-14T19:25:39.104878] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-14T19:25:39.104986] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-14T19:25:39.170795] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-14T19:25:39.292357] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T19:25:39.501069] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:39.958051] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-14T19:25:40.587492] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T19:25:40.592715] [INFO ] [REMOTE ] HMC: Full fetch complete (69032 records). [2025-10-14T19:25:40.592824] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-14T19:25:40.765005] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-14T19:25:41.077202] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-14T19:25:41.077307] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-14T19:25:41.078726] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-14T19:25:41.078818] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-14T19:25:41.080636] [DEBUG] [LOCAL ] HMC: Trimmed 69032 records to 46526 (keeping 200 days of data) [2025-10-14T19:25:41.500826] [DEBUG] [LOCAL ] HMC: Primary data saved (46526 records). [2025-10-14T19:25:41.500999] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-14T19:25:41.501096] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HMC took 40.9s. Estimated remaining: 3h 7m 42s. Rate: 7.1 symbols/min [2025-10-14T19:25:41.562018] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-14T19:25:41.748557] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:25:41.803510] [DEBUG] [LOCAL ] HOG: Loaded 50870 existing records from primary storage. [2025-10-14T19:25:41.803959] [INFO ] [MAIN ] HOG: Loaded 50870 existing records. [2025-10-14T19:25:42.065028] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:25:42.085445] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-14T19:25:42.101396] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-14T19:25:42.103944] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T19:25:42.115384] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-14T19:25:42.125172] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-14T19:25:42.133110] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-14T19:25:42.363150] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-14T19:25:42.478376] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T19:25:42.559201] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:25:43.158063] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-14T19:25:43.588582] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:25:43.958065] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-14T19:25:44.513231] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T19:25:44.758036] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-14T19:25:44.939398] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T19:25:45.558064] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-14T19:25:46.358042] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-14T19:25:46.534749] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T19:25:47.158040] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-14T19:25:47.324798] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-14T19:25:47.965137] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-14T19:25:47.970542] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T19:25:48.414924] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T19:25:48.758078] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-14T19:25:49.558044] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-14T19:25:49.946804] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-14T19:25:50.358098] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-14T19:25:50.502009] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T19:25:50.558068] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T19:25:51.158055] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-14T19:25:51.958054] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-14T19:25:52.274635] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T19:25:52.524095] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T19:25:52.758056] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-14T19:25:52.778551] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T19:25:53.558087] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-14T19:25:53.981825] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T19:25:54.358039] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-14T19:25:54.439376] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T19:25:55.158096] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-14T19:25:55.958045] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-14T19:25:56.012957] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T19:25:56.108993] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T19:25:56.759057] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-14T19:25:56.761862] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T19:25:57.558071] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-14T19:25:57.672476] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T19:25:58.358074] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-14T19:25:59.158101] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-14T19:25:59.476757] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T19:25:59.501127] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T19:25:59.958054] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-14T19:26:00.641123] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T19:26:00.758067] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-14T19:26:01.558038] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-14T19:26:01.735519] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T19:26:01.875270] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T19:26:02.358044] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-14T19:26:02.586105] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T19:26:02.588898] [INFO ] [REMOTE ] HMN: Full fetch complete (31512 records). [2025-10-14T19:26:02.589164] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-14T19:26:02.966059] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-14T19:26:02.966143] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-14T19:26:02.966789] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-14T19:26:02.966849] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-14T19:26:02.967753] [DEBUG] [LOCAL ] HMN: Trimmed 31512 records to 23474 (keeping 200 days of data) [2025-10-14T19:26:03.104912] [DEBUG] [LOCAL ] HMN: Primary data saved (23474 records). [2025-10-14T19:26:03.105031] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-14T19:26:03.105101] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMN took 38.1s. Estimated remaining: 3h 7m 51s. Rate: 7.1 symbols/min [2025-10-14T19:26:03.171113] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-14T19:26:03.278574] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:03.317082] [DEBUG] [LOCAL ] HOMB: Loaded 43542 existing records from primary storage. [2025-10-14T19:26:03.317361] [INFO ] [MAIN ] HOMB: Loaded 43542 existing records. [2025-10-14T19:26:03.492028] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:03.492235] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-14T19:26:03.492281] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-14T19:26:03.492614] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-14T19:26:03.492707] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-14T19:26:03.839201] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:03.958023] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-14T19:26:04.432295] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-14T19:26:04.667891] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T19:26:04.758045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-14T19:26:05.404167] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T19:26:05.558063] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-14T19:26:05.954609] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T19:26:06.358111] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-14T19:26:06.775876] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T19:26:07.158070] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-14T19:26:07.718390] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T19:26:07.722370] [INFO ] [REMOTE ] HNI: Full fetch complete (41938 records). [2025-10-14T19:26:07.722480] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-14T19:26:07.963198] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-14T19:26:08.096531] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-14T19:26:08.096603] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-14T19:26:08.097312] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-14T19:26:08.097373] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-14T19:26:08.098225] [DEBUG] [LOCAL ] HNI: Trimmed 41938 records to 29528 (keeping 200 days of data) [2025-10-14T19:26:08.270391] [DEBUG] [LOCAL ] HNI: Primary data saved (29528 records). [2025-10-14T19:26:08.270518] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-14T19:26:08.270591] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 29.5s. Estimated remaining: 3h 7m 38s. Rate: 7.1 symbols/min [2025-10-14T19:26:08.758118] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-14T19:26:08.908051] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T19:26:09.558115] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-14T19:26:10.008846] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T19:26:10.034241] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-14T19:26:10.040054] [INFO ] [REMOTE ] HMY: Full fetch complete (76968 records). [2025-10-14T19:26:10.040162] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-14T19:26:10.363217] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-14T19:26:10.435709] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-14T19:26:10.435786] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-14T19:26:10.436764] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-14T19:26:10.436825] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-14T19:26:10.438438] [DEBUG] [LOCAL ] HMY: Trimmed 76968 records to 53167 (keeping 200 days of data) [2025-10-14T19:26:10.758530] [DEBUG] [LOCAL ] HMY: Primary data saved (53167 records). [2025-10-14T19:26:10.758668] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-14T19:26:10.758770] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HMY took 38.8s. Estimated remaining: 3h 7m 22s. Rate: 7.1 symbols/min [2025-10-14T19:26:11.225295] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T19:26:11.236282] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-14T19:26:11.817343] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T19:26:11.958068] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-14T19:26:12.569294] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T19:26:12.758089] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-14T19:26:13.234171] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T19:26:13.558109] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-14T19:26:14.376564] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:26:14.382082] [INFO ] [REMOTE ] HOG: Full fetch complete (74240 records). [2025-10-14T19:26:14.382199] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-14T19:26:14.789408] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-14T19:26:14.789485] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-14T19:26:14.790545] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-14T19:26:14.790606] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-14T19:26:14.791967] [DEBUG] [LOCAL ] HOG: Trimmed 74240 records to 50858 (keeping 200 days of data) [2025-10-14T19:26:15.133332] [DEBUG] [LOCAL ] HOG: Primary data saved (50858 records). [2025-10-14T19:26:15.143378] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-14T19:26:15.143511] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOG took 33.6s. Estimated remaining: 3h 7m 8s. Rate: 7.1 symbols/min [2025-10-14T19:26:15.144854] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:26:15.156044] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-14T19:26:16.591910] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T19:26:16.600200] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-14T19:26:18.025256] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:26:18.033484] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-14T19:26:19.435970] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T19:26:19.446365] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-14T19:26:20.961087] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T19:26:20.971155] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-14T19:26:22.639437] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T19:26:22.649121] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-14T19:26:24.186856] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T19:26:24.191914] [INFO ] [REMOTE ] HOMB: Full fetch complete (64049 records). [2025-10-14T19:26:24.192037] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-14T19:26:24.572788] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-14T19:26:24.572865] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-14T19:26:24.573753] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-14T19:26:24.573816] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-14T19:26:24.574989] [DEBUG] [LOCAL ] HOMB: Trimmed 64049 records to 43570 (keeping 200 days of data) [2025-10-14T19:26:24.833693] [DEBUG] [LOCAL ] HOMB: Primary data saved (43570 records). [2025-10-14T19:26:24.833833] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-14T19:26:24.833924] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOMB took 21.7s. Estimated remaining: 3h 7m 1s. Rate: 7.1 symbols/min [2025-10-14T19:26:25.384508] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:25.492197] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:25.534161] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:25.514440] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:25.548002] [DEBUG] [LOCAL ] HOV: Loaded 13969 existing records from primary storage. [2025-10-14T19:26:25.548228] [INFO ] [MAIN ] HOV: Loaded 13969 existing records. [2025-10-14T19:26:25.765708] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:25.791261] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-14T19:26:25.792311] [DEBUG] [LOCAL ] HOUS: Loaded 45081 existing records from primary storage. [2025-10-14T19:26:25.792730] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-14T19:26:25.793025] [INFO ] [MAIN ] HOUS: Loaded 45081 existing records. [2025-10-14T19:26:25.799229] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-14T19:26:25.863305] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-14T19:26:25.959938] [DEBUG] [LOCAL ] HP: Loaded 51538 existing records from primary storage. [2025-10-14T19:26:25.983069] [INFO ] [MAIN ] HP: Loaded 51538 existing records. [2025-10-14T19:26:26.004247] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-14T19:26:26.109109] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-14T19:26:26.318947] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:26.499549] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-14T19:26:26.584985] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-14T19:26:26.685251] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:26.648692] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-14T19:26:26.704737] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-14T19:26:26.708137] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:26.753915] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-14T19:26:26.797675] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-14T19:26:26.778240] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-14T19:26:26.817327] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-14T19:26:26.821436] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:26.837573] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-14T19:26:26.852727] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-14T19:26:26.837487] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-14T19:26:26.838016] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-14T19:26:26.857981] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-14T19:26:27.756692] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:27.786095] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-14T19:26:27.836317] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:27.837221] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-14T19:26:27.917615] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:27.918117] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-14T19:26:27.928773] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:26:27.932357] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-14T19:26:28.724423] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T19:26:28.727260] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-14T19:26:28.923580] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T19:26:28.931958] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-14T19:26:29.318673] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:26:29.328393] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-14T19:26:29.522890] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T19:26:29.525841] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-14T19:26:29.854743] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T19:26:29.865707] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-14T19:26:30.186028] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T19:26:30.188897] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-14T19:26:30.536048] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T19:26:30.545159] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-14T19:26:30.718148] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T19:26:30.727542] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-14T19:26:30.822764] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T19:26:30.826096] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-14T19:26:31.522044] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T19:26:31.532858] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-14T19:26:31.612204] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T19:26:31.615329] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-14T19:26:31.981249] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T19:26:31.989265] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-14T19:26:32.429864] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:26:32.636124] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T19:26:32.758078] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-14T19:26:33.305163] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T19:26:33.406574] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T19:26:33.462944] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T19:26:33.558078] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-14T19:26:34.358144] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-14T19:26:35.158053] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-14T19:26:35.277728] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T19:26:35.581418] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-14T19:26:35.958057] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-14T19:26:36.511986] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T19:26:36.532695] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T19:26:36.758076] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-14T19:26:37.558083] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-14T19:26:38.358085] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-14T19:26:38.442155] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T19:26:39.158148] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-14T19:26:39.295919] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T19:26:39.957765] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T19:26:39.966412] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-14T19:26:40.758039] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-14T19:26:40.801602] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T19:26:40.803460] [INFO ] [REMOTE ] HOV: Full fetch complete (19050 records). [2025-10-14T19:26:40.803528] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-14T19:26:41.197158] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T19:26:41.255886] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-14T19:26:41.256333] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-14T19:26:41.256824] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-14T19:26:41.256886] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-14T19:26:41.257508] [DEBUG] [LOCAL ] HOV: Trimmed 19050 records to 14015 (keeping 200 days of data) [2025-10-14T19:26:41.338614] [DEBUG] [LOCAL ] HOV: Primary data saved (14015 records). [2025-10-14T19:26:41.338771] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-14T19:26:41.338867] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HOV took 16.5s. Estimated remaining: 3h 7m 3s. Rate: 7.1 symbols/min [2025-10-14T19:26:41.515615] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:41.525420] [DEBUG] [LOCAL ] HPF: Loaded 7500 existing records from primary storage. [2025-10-14T19:26:41.525662] [INFO ] [MAIN ] HPF: Loaded 7500 existing records. [2025-10-14T19:26:41.563244] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-14T19:26:41.719842] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:41.720037] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-14T19:26:41.720085] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-14T19:26:41.720233] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-14T19:26:41.720272] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-14T19:26:42.104767] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:42.147463] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:26:42.358041] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-14T19:26:43.099598] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T19:26:43.158041] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-14T19:26:43.538984] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-14T19:26:43.666823] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-14T19:26:43.958103] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-14T19:26:44.758120] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-14T19:26:45.558070] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-14T19:26:45.694608] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T19:26:45.947732] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T19:26:45.962565] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-14T19:26:46.358110] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-14T19:26:47.158075] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-14T19:26:47.868664] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T19:26:47.958070] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-14T19:26:48.463551] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T19:26:48.758077] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-14T19:26:49.123007] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T19:26:49.186528] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T19:26:49.558076] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-14T19:26:50.257879] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T19:26:50.358080] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-14T19:26:51.158039] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-14T19:26:51.958041] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-14T19:26:52.099764] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:26:52.758122] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-14T19:26:52.883486] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T19:26:53.445612] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T19:26:53.558034] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-14T19:26:53.759942] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T19:26:54.358116] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-14T19:26:55.134201] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T19:26:55.139816] [INFO ] [REMOTE ] HOUS: Full fetch complete (64289 records). [2025-10-14T19:26:55.139919] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-14T19:26:55.163174] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-14T19:26:55.523761] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-14T19:26:55.523842] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-14T19:26:55.524790] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-14T19:26:55.524853] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-14T19:26:55.526093] [DEBUG] [LOCAL ] HOUS: Trimmed 64289 records to 45217 (keeping 200 days of data) [2025-10-14T19:26:55.793884] [DEBUG] [LOCAL ] HOUS: Primary data saved (45217 records). [2025-10-14T19:26:55.794028] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-14T19:26:55.794113] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOUS took 31.0s. Estimated remaining: 3h 7m 2s. Rate: 7.1 symbols/min [2025-10-14T19:26:55.974595] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:26:55.971039] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-14T19:26:55.987040] [DEBUG] [LOCAL ] HPI: Loaded 10635 existing records from primary storage. [2025-10-14T19:26:55.987251] [INFO ] [MAIN ] HPI: Loaded 10635 existing records. [2025-10-14T19:26:56.173776] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:26:56.174012] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-14T19:26:56.174061] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-14T19:26:56.174275] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-14T19:26:56.174332] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-14T19:26:56.537700] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:26:56.574347] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-14T19:26:56.630529] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T19:26:56.734634] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T19:26:56.758032] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-14T19:26:57.558043] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-14T19:26:57.611662] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T19:26:58.358104] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-14T19:26:59.091814] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T19:26:59.154568] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T19:26:59.164742] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-14T19:26:59.958047] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-14T19:26:59.967865] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T19:27:00.758070] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-14T19:27:01.558080] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-14T19:27:01.591935] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T19:27:01.593262] [INFO ] [REMOTE ] HPF: Full fetch complete (10678 records). [2025-10-14T19:27:01.593329] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-14T19:27:01.958260] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-14T19:27:01.958332] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-14T19:27:01.958567] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-14T19:27:01.958604] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-14T19:27:01.959045] [DEBUG] [LOCAL ] HPF: Trimmed 10678 records to 7523 (keeping 200 days of data) [2025-10-14T19:27:02.008818] [DEBUG] [LOCAL ] HPF: Primary data saved (7523 records). [2025-10-14T19:27:02.008991] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-14T19:27:02.009169] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HPF took 20.7s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-14T19:27:02.186446] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-14T19:27:02.222178] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:02.269700] [DEBUG] [LOCAL ] HPP: Loaded 51145 existing records from primary storage. [2025-10-14T19:27:02.270031] [INFO ] [MAIN ] HPP: Loaded 51145 existing records. [2025-10-14T19:27:02.366747] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-14T19:27:02.452842] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:02.453064] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-14T19:27:02.453111] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-14T19:27:02.453565] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-14T19:27:02.453683] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-14T19:27:02.802185] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:03.158107] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-14T19:27:03.294378] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T19:27:03.300559] [INFO ] [REMOTE ] HP: Full fetch complete (74044 records). [2025-10-14T19:27:03.300806] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-14T19:27:03.712590] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-14T19:27:03.712736] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-14T19:27:03.714190] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-14T19:27:03.714256] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-14T19:27:03.716442] [DEBUG] [LOCAL ] HP: Trimmed 74044 records to 51534 (keeping 200 days of data) [2025-10-14T19:27:03.960397] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-14T19:27:04.054207] [DEBUG] [LOCAL ] HP: Primary data saved (51534 records). [2025-10-14T19:27:04.054487] [INFO ] [MAIN ] HP: Full history saved. [2025-10-14T19:27:04.054702] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HP took 39.2s. Estimated remaining: 3h 6m 34s. Rate: 7.1 symbols/min [2025-10-14T19:27:04.239358] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:04.292378] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-14T19:27:04.292828] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-14T19:27:04.424978] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-14T19:27:04.519631] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:04.520433] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-14T19:27:04.520676] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-14T19:27:04.511861] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-14T19:27:04.526328] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-14T19:27:04.526962] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-14T19:27:04.535481] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T19:27:04.556854] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-14T19:27:04.768060] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-14T19:27:04.948837] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T19:27:05.413153] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-14T19:27:05.412984] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:05.413464] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-14T19:27:05.415059] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-14T19:27:05.415445] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-14T19:27:05.417746] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 53697 (keeping 200 days of data) [2025-10-14T19:27:05.558042] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-14T19:27:05.629822] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T19:27:05.784862] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-14T19:27:05.785014] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-14T19:27:05.785110] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 40.9s. Estimated remaining: 3h 6m 17s. Rate: 7.1 symbols/min [2025-10-14T19:27:05.959636] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:05.972190] [DEBUG] [LOCAL ] HPS: Loaded 10321 existing records from primary storage. [2025-10-14T19:27:05.972431] [INFO ] [MAIN ] HPS: Loaded 10321 existing records. [2025-10-14T19:27:06.156031] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:06.156238] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-14T19:27:06.156286] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-14T19:27:06.156515] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-14T19:27:06.156575] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-14T19:27:06.367777] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-14T19:27:06.525180] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:07.030467] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T19:27:07.158068] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-14T19:27:07.296009] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T19:27:07.958112] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-14T19:27:08.758086] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-14T19:27:08.799434] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T19:27:09.306026] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T19:27:09.478832] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T19:27:09.558043] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-14T19:27:10.288921] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T19:27:10.358039] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-14T19:27:11.117768] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T19:27:11.158027] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-14T19:27:11.887479] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T19:27:11.958038] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-14T19:27:12.758094] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-14T19:27:13.558045] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-14T19:27:13.571230] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T19:27:13.600478] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T19:27:14.358049] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-14T19:27:14.466157] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T19:27:15.158088] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-14T19:27:15.958178] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-14T19:27:15.952216] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:27:15.960503] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T19:27:16.758081] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-14T19:27:17.558038] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-14T19:27:17.752093] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T19:27:17.797346] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T19:27:18.358043] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-14T19:27:19.141779] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T19:27:19.158070] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-14T19:27:19.892121] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T19:27:19.958082] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-14T19:27:20.188421] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T19:27:20.758048] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-14T19:27:21.564909] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-14T19:27:21.584290] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T19:27:22.336629] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T19:27:22.366792] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-14T19:27:22.372285] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T19:27:23.158085] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-14T19:27:23.269587] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T19:27:23.271991] [INFO ] [REMOTE ] HPI: Full fetch complete (13923 records). [2025-10-14T19:27:23.272072] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-14T19:27:23.636856] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-14T19:27:23.636931] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-14T19:27:23.637217] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-14T19:27:23.637254] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-14T19:27:23.637731] [DEBUG] [LOCAL ] HPI: Trimmed 13923 records to 10657 (keeping 200 days of data) [2025-10-14T19:27:23.704464] [DEBUG] [LOCAL ] HPI: Primary data saved (10657 records). [2025-10-14T19:27:23.704677] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-14T19:27:23.704773] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPI took 27.9s. Estimated remaining: 3h 6m 21s. Rate: 7.1 symbols/min [2025-10-14T19:27:23.871627] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:23.897416] [DEBUG] [LOCAL ] HQH: Loaded 25666 existing records from primary storage. [2025-10-14T19:27:23.897707] [INFO ] [MAIN ] HQH: Loaded 25666 existing records. [2025-10-14T19:27:23.963213] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-14T19:27:24.074121] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:24.074311] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-14T19:27:24.074359] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-14T19:27:24.074617] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-14T19:27:24.074716] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-14T19:27:24.421196] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:24.752826] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T19:27:24.758014] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-14T19:27:25.010308] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T19:27:25.213217] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T19:27:25.558063] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-14T19:27:26.358104] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-14T19:27:26.714074] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T19:27:27.158088] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-14T19:27:27.966269] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-14T19:27:27.985750] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T19:27:28.271855] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T19:27:28.758061] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-14T19:27:28.791941] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T19:27:29.558114] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-14T19:27:29.846728] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T19:27:30.358047] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-14T19:27:31.164586] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-14T19:27:31.192738] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:27:31.205145] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T19:27:31.960683] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-14T19:27:31.963490] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T19:27:32.758109] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-14T19:27:32.891610] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T19:27:33.558038] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-14T19:27:33.921474] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T19:27:34.358108] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-14T19:27:35.158077] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-14T19:27:35.240261] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:27:35.295363] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T19:27:35.914544] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T19:27:35.958021] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-14T19:27:36.713499] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T19:27:36.758049] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-14T19:27:37.558036] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-14T19:27:37.634267] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T19:27:37.636709] [INFO ] [REMOTE ] HPS: Full fetch complete (15185 records). [2025-10-14T19:27:37.636791] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-14T19:27:38.004741] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-14T19:27:38.004818] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-14T19:27:38.005137] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-14T19:27:38.005175] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-14T19:27:38.005626] [DEBUG] [LOCAL ] HPS: Trimmed 15185 records to 10340 (keeping 200 days of data) [2025-10-14T19:27:38.067530] [DEBUG] [LOCAL ] HPS: Primary data saved (10340 records). [2025-10-14T19:27:38.067666] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-14T19:27:38.067760] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPS took 32.3s. Estimated remaining: 3h 6m 20s. Rate: 7.1 symbols/min [2025-10-14T19:27:38.233837] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:38.251320] [DEBUG] [LOCAL ] HQL: Loaded 16787 existing records from primary storage. [2025-10-14T19:27:38.251538] [INFO ] [MAIN ] HQL: Loaded 16787 existing records. [2025-10-14T19:27:38.363239] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-14T19:27:38.430560] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:38.431041] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-14T19:27:38.431097] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-14T19:27:38.431277] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-14T19:27:38.431333] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-14T19:27:38.789316] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:39.158124] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-14T19:27:39.958079] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-14T19:27:40.913048] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T19:27:40.916846] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-14T19:27:41.185436] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T19:27:41.553312] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (4.00 seconds). [2025-10-14T19:27:41.558880] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-14T19:27:41.559790] [INFO ] [REMOTE ] HPP: Full fetch complete (73423 records). [2025-10-14T19:27:41.559865] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-14T19:27:41.975820] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-14T19:27:41.972255] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T19:27:41.979631] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-14T19:27:41.981343] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-14T19:27:41.981403] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-14T19:27:41.982627] [DEBUG] [LOCAL ] HPP: Trimmed 73423 records to 51172 (keeping 200 days of data) [2025-10-14T19:27:42.263339] [DEBUG] [LOCAL ] HPP: Primary data saved (51172 records). [2025-10-14T19:27:42.263464] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-14T19:27:42.263537] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPP took 40.3s. Estimated remaining: 3h 6m 6s. Rate: 7.1 symbols/min [2025-10-14T19:27:42.363806] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-14T19:27:42.438236] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:42.486512] [DEBUG] [LOCAL ] HR: Loaded 52098 existing records from primary storage. [2025-10-14T19:27:42.486829] [INFO ] [MAIN ] HR: Loaded 52098 existing records. [2025-10-14T19:27:42.668479] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:42.668804] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-14T19:27:42.668858] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-14T19:27:42.669565] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-14T19:27:42.669623] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-14T19:27:42.961070] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (4.60 seconds). [2025-10-14T19:27:43.043716] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:43.158030] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-14T19:27:43.387079] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T19:27:43.452534] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T19:27:43.958068] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-14T19:27:44.758046] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-14T19:27:44.811897] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T19:27:45.229134] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T19:27:45.558050] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-14T19:27:46.358046] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-14T19:27:46.556374] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T19:27:46.773274] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T19:27:47.158068] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-14T19:27:47.958123] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-14T19:27:47.995291] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T19:27:48.620708] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T19:27:48.758032] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-14T19:27:48.922903] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T19:27:49.558124] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-14T19:27:50.358101] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-14T19:27:50.654022] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T19:27:50.872141] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T19:27:51.158084] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-14T19:27:51.575987] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-14T19:27:51.958122] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-14T19:27:52.758051] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-14T19:27:52.846393] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T19:27:52.943388] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T19:27:53.137002] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T19:27:53.142957] [INFO ] [REMOTE ] HPQ: Full fetch complete (77835 records). [2025-10-14T19:27:53.143083] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-14T19:27:53.553796] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-14T19:27:53.553882] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-14T19:27:53.554896] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-14T19:27:53.554962] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-14T19:27:53.556438] [DEBUG] [LOCAL ] HPQ: Trimmed 77835 records to 53668 (keeping 200 days of data) [2025-10-14T19:27:53.558084] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-14T19:27:53.885329] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-14T19:27:53.885464] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-14T19:27:53.885544] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HPQ took 49.8s. Estimated remaining: 3h 6m 2s. Rate: 7.1 symbols/min [2025-10-14T19:27:54.084350] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:54.126317] [DEBUG] [LOCAL ] HRB: Loaded 48339 existing records from primary storage. [2025-10-14T19:27:54.126610] [INFO ] [MAIN ] HRB: Loaded 48339 existing records. [2025-10-14T19:27:54.302336] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:54.302561] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-14T19:27:54.302607] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-14T19:27:54.302835] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-14T19:27:54.302891] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-14T19:27:54.366985] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-14T19:27:54.661635] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:54.733745] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T19:27:54.737212] [INFO ] [REMOTE ] HQH: Full fetch complete (37281 records). [2025-10-14T19:27:54.737282] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-14T19:27:55.146126] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-14T19:27:55.146199] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-14T19:27:55.146862] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-14T19:27:55.146922] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-14T19:27:55.147882] [DEBUG] [LOCAL ] HQH: Trimmed 37281 records to 25740 (keeping 200 days of data) [2025-10-14T19:27:55.202099] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-14T19:27:55.308742] [DEBUG] [LOCAL ] HQH: Primary data saved (25740 records). [2025-10-14T19:27:55.308870] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-14T19:27:55.308947] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQH took 31.6s. Estimated remaining: 3h 5m 44s. Rate: 7.1 symbols/min [2025-10-14T19:27:55.400876] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T19:27:55.500842] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:27:55.532331] [DEBUG] [LOCAL ] HRI: Loaded 32515 existing records from primary storage. [2025-10-14T19:27:55.532592] [INFO ] [MAIN ] HRI: Loaded 32515 existing records. [2025-10-14T19:27:55.715338] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:27:55.715531] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-14T19:27:55.715587] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-14T19:27:55.716219] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-14T19:27:55.716277] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-14T19:27:55.963213] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-14T19:27:56.074919] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:27:56.758091] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-14T19:27:56.984322] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T19:27:57.306625] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T19:27:57.383772] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T19:27:57.558047] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-14T19:27:58.358064] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-14T19:27:59.158122] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-14T19:27:59.324732] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T19:27:59.537690] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T19:27:59.958121] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-14T19:28:00.735799] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T19:28:00.758034] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-14T19:28:00.873950] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T19:28:01.558060] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-14T19:28:01.984733] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T19:28:02.358127] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-14T19:28:02.918097] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T19:28:03.158167] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-14T19:28:03.737599] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:28:03.958166] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-14T19:28:04.758058] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-14T19:28:04.874230] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T19:28:05.091284] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T19:28:05.558086] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-14T19:28:05.808918] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T19:28:06.358100] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-14T19:28:07.144492] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T19:28:07.158030] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-14T19:28:07.871217] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T19:28:07.958147] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-14T19:28:08.758133] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-14T19:28:08.859823] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T19:28:09.001311] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T19:28:09.558091] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-14T19:28:10.201260] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T19:28:10.358073] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-14T19:28:10.732086] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T19:28:11.158074] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-14T19:28:11.958117] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-14T19:28:12.077624] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:28:12.758033] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-14T19:28:12.973050] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T19:28:13.558098] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-14T19:28:13.602929] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-14T19:28:14.283758] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T19:28:14.358104] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-14T19:28:15.158048] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-14T19:28:15.192049] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T19:28:15.197922] [INFO ] [REMOTE ] HR: Full fetch complete (74987 records). [2025-10-14T19:28:15.198046] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-14T19:28:15.530790] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T19:28:15.563419] [INFO ] [REMOTE ] HQL: Full fetch complete (25198 records). [2025-10-14T19:28:15.584028] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-14T19:28:15.689089] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-14T19:28:15.703966] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-14T19:28:15.705214] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-14T19:28:15.705299] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-14T19:28:15.750752] [DEBUG] [LOCAL ] HR: Trimmed 74987 records to 52103 (keeping 200 days of data) [2025-10-14T19:28:15.960257] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-14T19:28:16.153677] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-14T19:28:16.154897] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-14T19:28:16.157482] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-14T19:28:16.159569] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-14T19:28:16.177462] [DEBUG] [LOCAL ] HQL: Trimmed 25198 records to 16824 (keeping 200 days of data) [2025-10-14T19:28:16.371958] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:28:16.416190] [DEBUG] [LOCAL ] HQL: Primary data saved (16824 records). [2025-10-14T19:28:16.419173] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-14T19:28:16.419290] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HQL took 38.4s. Estimated remaining: 3h 5m 52s. Rate: 7.1 symbols/min [2025-10-14T19:28:16.600103] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:16.700203] [DEBUG] [LOCAL ] HR: Primary data saved (52103 records). [2025-10-14T19:28:16.700420] [INFO ] [MAIN ] HR: Full history saved. [2025-10-14T19:28:16.700510] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HR took 34.4s. Estimated remaining: 3h 5m 33s. Rate: 7.1 symbols/min [2025-10-14T19:28:16.764284] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-14T19:28:16.841870] [DEBUG] [LOCAL ] HRL: Loaded 53111 existing records from primary storage. [2025-10-14T19:28:16.867367] [INFO ] [MAIN ] HRL: Loaded 53111 existing records. [2025-10-14T19:28:16.967180] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:17.078823] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:28:17.079085] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-14T19:28:17.079250] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-14T19:28:17.079600] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-14T19:28:17.079695] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-14T19:28:17.224128] [DEBUG] [LOCAL ] HRTG: Loaded 34109 existing records from primary storage. [2025-10-14T19:28:17.263605] [INFO ] [MAIN ] HRTG: Loaded 34109 existing records. [2025-10-14T19:28:17.588935] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:28:17.615020] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-14T19:28:17.615189] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-14T19:28:17.640163] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-14T19:28:17.643293] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-14T19:28:17.684074] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:17.716875] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-14T19:28:17.868395] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T19:28:18.110766] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:18.254334] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T19:28:18.358066] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-14T19:28:19.158050] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-14T19:28:19.407876] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T19:28:19.441126] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T19:28:19.958093] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-14T19:28:20.758087] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-14T19:28:20.856569] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T19:28:20.890670] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T19:28:21.558081] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-14T19:28:22.033250] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T19:28:22.358067] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-14T19:28:22.909887] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T19:28:23.158061] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-14T19:28:23.769917] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T19:28:23.958110] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-14T19:28:24.149543] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T19:28:24.758070] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-14T19:28:25.558063] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-14T19:28:25.660098] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T19:28:25.763912] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T19:28:26.358058] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-14T19:28:27.158064] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-14T19:28:27.298183] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T19:28:27.958094] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-14T19:28:27.987181] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T19:28:27.992933] [INFO ] [REMOTE ] HRB: Full fetch complete (70051 records). [2025-10-14T19:28:27.993107] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-14T19:28:28.396782] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-14T19:28:28.396909] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-14T19:28:28.397904] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-14T19:28:28.397966] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-14T19:28:28.399286] [DEBUG] [LOCAL ] HRB: Trimmed 70051 records to 48355 (keeping 200 days of data) [2025-10-14T19:28:28.500815] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T19:28:28.505629] [INFO ] [REMOTE ] HRI: Full fetch complete (46348 records). [2025-10-14T19:28:28.506463] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-14T19:28:28.760733] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-14T19:28:28.997596] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-14T19:28:29.025406] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-14T19:28:29.029670] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-14T19:28:29.052945] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-14T19:28:29.055845] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T19:28:29.070086] [DEBUG] [LOCAL ] HRI: Trimmed 46348 records to 32458 (keeping 200 days of data) [2025-10-14T19:28:29.241350] [DEBUG] [LOCAL ] HRB: Primary data saved (48355 records). [2025-10-14T19:28:29.242180] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-14T19:28:29.242552] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRB took 35.4s. Estimated remaining: 3h 5m 30s. Rate: 7.1 symbols/min [2025-10-14T19:28:29.437084] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:29.516393] [DEBUG] [LOCAL ] HRI: Primary data saved (32458 records). [2025-10-14T19:28:29.528805] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-14T19:28:29.528975] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRI took 34.2s. Estimated remaining: 3h 5m 11s. Rate: 7.1 symbols/min [2025-10-14T19:28:29.564509] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-14T19:28:29.674438] [DEBUG] [LOCAL ] HSBC: Loaded 50994 existing records from primary storage. [2025-10-14T19:28:29.685627] [INFO ] [MAIN ] HSBC: Loaded 50994 existing records. [2025-10-14T19:28:29.856731] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:29.928088] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:28:29.928362] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-14T19:28:29.928446] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-14T19:28:29.934004] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-14T19:28:29.934357] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-14T19:28:29.934301] [DEBUG] [LOCAL ] HSHP: Loaded 14975 existing records from primary storage. [2025-10-14T19:28:29.977638] [INFO ] [MAIN ] HSHP: Loaded 14975 existing records. [2025-10-14T19:28:30.360005] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:28:30.372975] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-14T19:28:30.401195] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-14T19:28:30.401794] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-14T19:28:30.401861] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-14T19:28:30.586978] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:30.598125] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-14T19:28:30.852807] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:30.884004] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-14T19:28:31.059238] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:28:31.158073] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-14T19:28:31.958042] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-14T19:28:32.054937] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T19:28:32.712010] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T19:28:32.758043] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-14T19:28:33.305879] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T19:28:33.558073] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-14T19:28:34.229337] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T19:28:34.358042] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-14T19:28:34.613460] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T19:28:35.158088] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-14T19:28:35.797733] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T19:28:35.958053] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-14T19:28:36.758037] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-14T19:28:36.809388] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T19:28:37.558123] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-14T19:28:37.677746] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T19:28:37.707896] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T19:28:38.358082] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-14T19:28:38.912239] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T19:28:39.158173] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-14T19:28:39.358955] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T19:28:39.958112] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-14T19:28:40.620706] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T19:28:40.758081] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-14T19:28:41.386582] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T19:28:41.558078] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-14T19:28:42.202996] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T19:28:42.207392] [INFO ] [REMOTE ] HRTG: Full fetch complete (43891 records). [2025-10-14T19:28:42.207488] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-14T19:28:42.363325] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-14T19:28:42.641260] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-14T19:28:42.641340] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-14T19:28:42.642170] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-14T19:28:42.642235] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-14T19:28:42.643279] [DEBUG] [LOCAL ] HRTG: Trimmed 43891 records to 34286 (keeping 200 days of data) [2025-10-14T19:28:42.861637] [DEBUG] [LOCAL ] HRTG: Primary data saved (34286 records). [2025-10-14T19:28:42.861882] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-14T19:28:42.862067] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRTG took 26.2s. Estimated remaining: 3h 5m 9s. Rate: 7.1 symbols/min [2025-10-14T19:28:43.056077] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:43.102067] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T19:28:43.158305] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-14T19:28:43.158192] [DEBUG] [LOCAL ] HSY: Loaded 50382 existing records from primary storage. [2025-10-14T19:28:43.159805] [INFO ] [MAIN ] HSY: Loaded 50382 existing records. [2025-10-14T19:28:43.344318] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:28:43.344601] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-14T19:28:43.344684] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-14T19:28:43.345432] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-14T19:28:43.345494] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-14T19:28:43.720240] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:43.958092] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-14T19:28:44.200473] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T19:28:44.226513] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T19:28:44.758138] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-14T19:28:45.558091] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-14T19:28:45.838935] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T19:28:46.358091] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-14T19:28:46.805496] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-14T19:28:47.158043] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-14T19:28:47.453957] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:28:47.479921] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T19:28:47.958085] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-14T19:28:48.758117] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-14T19:28:48.951799] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T19:28:49.558052] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-14T19:28:49.803843] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T19:28:50.358052] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-14T19:28:51.065106] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T19:28:51.158059] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-14T19:28:51.932906] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T19:28:51.958049] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-14T19:28:52.062378] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-14T19:28:52.171563] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T19:28:52.758133] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-14T19:28:53.558081] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-14T19:28:53.870230] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T19:28:54.251279] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T19:28:54.358042] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-14T19:28:55.158053] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-14T19:28:55.326223] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T19:28:55.381939] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T19:28:55.387873] [INFO ] [REMOTE ] HRL: Full fetch complete (76882 records). [2025-10-14T19:28:55.388000] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-14T19:28:55.782193] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-14T19:28:55.782272] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-14T19:28:55.783291] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-14T19:28:55.783353] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-14T19:28:55.784752] [DEBUG] [LOCAL ] HRL: Trimmed 76882 records to 53119 (keeping 200 days of data) [2025-10-14T19:28:55.960289] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-14T19:28:56.108835] [DEBUG] [LOCAL ] HRL: Primary data saved (53119 records). [2025-10-14T19:28:56.108981] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-14T19:28:56.109060] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HRL took 39.7s. Estimated remaining: 3h 5m 6s. Rate: 7.1 symbols/min [2025-10-14T19:28:56.277043] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:56.277159] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-14T19:28:56.277198] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-14T19:28:56.277306] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-14T19:28:56.277347] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-14T19:28:56.277388] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-14T19:28:56.277419] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-14T19:28:56.633478] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:56.758044] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-14T19:28:56.791904] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:28:57.558052] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-14T19:28:57.742821] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T19:28:57.753542] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:28:57.754926] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-14T19:28:57.755033] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:28:57.755083] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-14T19:28:57.755117] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:28:57.755157] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-14T19:28:57.755221] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-14T19:28:57.755259] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-14T19:28:57.755299] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-14T19:28:57.755350] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HTB took 1.6s. Estimated remaining: 3h 4m 49s. Rate: 7.1 symbols/min [2025-10-14T19:28:57.879054] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T19:28:57.967384] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:28:57.983818] [DEBUG] [LOCAL ] HTD: Loaded 14053 existing records from primary storage. [2025-10-14T19:28:57.984085] [INFO ] [MAIN ] HTD: Loaded 14053 existing records. [2025-10-14T19:28:58.192885] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:28:58.193124] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-14T19:28:58.193205] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-14T19:28:58.193526] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-14T19:28:58.193602] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-14T19:28:58.366957] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-14T19:28:58.610134] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:28:59.158087] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-14T19:28:59.958052] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-14T19:28:59.995754] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T19:29:00.264377] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T19:29:00.758064] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-14T19:29:01.558085] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-14T19:29:02.124431] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-14T19:29:02.145033] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T19:29:02.358073] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-14T19:29:02.574581] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T19:29:02.581064] [INFO ] [REMOTE ] HSBC: Full fetch complete (74030 records). [2025-10-14T19:29:02.581260] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-14T19:29:03.001415] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-14T19:29:03.001526] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-14T19:29:03.002830] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-14T19:29:03.002899] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-14T19:29:03.004867] [DEBUG] [LOCAL ] HSBC: Trimmed 74030 records to 50997 (keeping 200 days of data) [2025-10-14T19:29:03.194609] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-14T19:29:03.342926] [DEBUG] [LOCAL ] HSBC: Primary data saved (50997 records). [2025-10-14T19:29:03.343117] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-14T19:29:03.343222] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSBC took 34.1s. Estimated remaining: 3h 4m 37s. Rate: 7.1 symbols/min [2025-10-14T19:29:03.519370] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:03.519638] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-14T19:29:03.519719] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-14T19:29:03.519844] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-14T19:29:03.519886] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-14T19:29:03.519927] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-14T19:29:03.519959] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-14T19:29:03.876904] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:03.958059] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-14T19:29:04.376961] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T19:29:04.589986] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-14T19:29:04.758070] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-14T19:29:04.829839] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T19:29:05.558113] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-14T19:29:05.752611] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T19:29:05.754850] [INFO ] [REMOTE ] HSHP: Full fetch complete (23292 records). [2025-10-14T19:29:05.754927] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-14T19:29:06.166536] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-14T19:29:06.166683] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-14T19:29:06.167559] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-14T19:29:06.167605] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-14T19:29:06.168594] [DEBUG] [LOCAL ] HSHP: Trimmed 23292 records to 14927 (keeping 200 days of data) [2025-10-14T19:29:06.266436] [DEBUG] [LOCAL ] HSHP: Primary data saved (14927 records). [2025-10-14T19:29:06.266664] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-14T19:29:06.266786] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSHP took 36.7s. Estimated remaining: 3h 4m 22s. Rate: 7.1 symbols/min [2025-10-14T19:29:06.366904] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-14T19:29:06.457373] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:06.513270] [DEBUG] [LOCAL ] HTGC: Loaded 47669 existing records from primary storage. [2025-10-14T19:29:06.513779] [INFO ] [MAIN ] HTGC: Loaded 47669 existing records. [2025-10-14T19:29:06.712426] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:29:06.712762] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-14T19:29:06.712824] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-14T19:29:06.713542] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-14T19:29:06.713601] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-14T19:29:07.126806] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:07.141100] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T19:29:07.158016] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-14T19:29:07.443696] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T19:29:07.958043] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-14T19:29:08.013270] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T19:29:08.203149] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-10-14T19:29:08.758066] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-14T19:29:09.558086] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-14T19:29:09.636259] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T19:29:09.885844] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-14T19:29:10.358055] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-14T19:29:11.158112] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-14T19:29:11.897427] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T19:29:11.958053] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-14T19:29:12.758045] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-14T19:29:12.788006] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:29:13.550246] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T19:29:13.559990] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-14T19:29:13.650121] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T19:29:14.358094] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-14T19:29:14.675807] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-14T19:29:15.128374] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T19:29:15.158029] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-14T19:29:15.958132] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-14T19:29:16.277988] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-14T19:29:16.722050] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T19:29:16.758026] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-14T19:29:17.558118] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-14T19:29:17.970283] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-14T19:29:18.358039] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-14T19:29:18.471375] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T19:29:19.158036] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-14T19:29:19.236477] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T19:29:19.482368] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-14T19:29:19.958061] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-14T19:29:20.758081] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-14T19:29:21.544994] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T19:29:21.558056] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-14T19:29:21.712621] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T19:29:22.358054] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-14T19:29:22.678835] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-14T19:29:22.948236] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:29:23.158057] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-14T19:29:23.385944] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-14T19:29:23.958074] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-14T19:29:24.758064] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-14T19:29:25.558104] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-14T19:29:25.605738] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T19:29:25.669259] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T19:29:25.677195] [INFO ] [REMOTE ] HSY: Full fetch complete (73626 records). [2025-10-14T19:29:25.677352] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-14T19:29:25.799033] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-14T19:29:26.097279] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-14T19:29:26.097379] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-14T19:29:26.098394] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-14T19:29:26.098457] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-14T19:29:26.099839] [DEBUG] [LOCAL ] HSY: Trimmed 73626 records to 50417 (keeping 200 days of data) [2025-10-14T19:29:26.377723] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-14T19:29:26.419154] [DEBUG] [LOCAL ] HSY: Primary data saved (50417 records). [2025-10-14T19:29:26.419298] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-14T19:29:26.420247] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HSY took 43.6s. Estimated remaining: 3h 4m 28s. Rate: 7.1 symbols/min [2025-10-14T19:29:26.588090] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:26.619394] [DEBUG] [LOCAL ] HTH: Loaded 32523 existing records from primary storage. [2025-10-14T19:29:26.619715] [INFO ] [MAIN ] HTH: Loaded 32523 existing records. [2025-10-14T19:29:26.795635] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:29:26.795900] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-14T19:29:26.795948] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-14T19:29:26.796589] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-14T19:29:26.796675] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-14T19:29:27.149590] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:27.158027] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-14T19:29:27.370811] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T19:29:27.958090] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-14T19:29:28.270790] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-14T19:29:28.351565] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T19:29:28.758119] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-14T19:29:29.558094] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-14T19:29:29.692732] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T19:29:29.696698] [INFO ] [REMOTE ] HTD: Full fetch complete (19412 records). [2025-10-14T19:29:29.696876] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-14T19:29:29.949148] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T19:29:29.965083] [INFO ] [REMOTE ] HTFC: Full fetch complete (848 records). [2025-10-14T19:29:29.985939] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-14T19:29:30.371746] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-14T19:29:30.370075] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-14T19:29:30.371904] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-14T19:29:30.396767] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-14T19:29:30.398502] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-14T19:29:30.398784] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-14T19:29:30.398857] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:29:30.399390] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:29:30.399486] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-14T19:29:30.400022] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-14T19:29:30.400387] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-14T19:29:30.400484] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-14T19:29:30.400697] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTFC took 27.1s. Estimated remaining: 3h 4m 14s. Rate: 7.1 symbols/min [2025-10-14T19:29:30.401102] [DEBUG] [LOCAL ] HTD: Trimmed 19412 records to 14145 (keeping 200 days of data) [2025-10-14T19:29:30.674707] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:30.690368] [DEBUG] [LOCAL ] HTD: Primary data saved (14145 records). [2025-10-14T19:29:30.690511] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-14T19:29:30.690693] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTD took 32.9s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-10-14T19:29:30.896880] [DEBUG] [LOCAL ] HUBB: Loaded 36459 existing records from primary storage. [2025-10-14T19:29:30.898414] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:30.899203] [INFO ] [MAIN ] HUBB: Loaded 36459 existing records. [2025-10-14T19:29:31.083034] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:29:31.092447] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-14T19:29:31.092505] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-14T19:29:31.093218] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-14T19:29:31.093288] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-14T19:29:31.158899] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-14T19:29:31.246372] [DEBUG] [LOCAL ] HUBS: Loaded 39971 existing records from primary storage. [2025-10-14T19:29:31.262294] [INFO ] [MAIN ] HUBS: Loaded 39971 existing records. [2025-10-14T19:29:31.656826] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:29:31.667557] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-14T19:29:31.672854] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-14T19:29:31.696932] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-14T19:29:31.709271] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-14T19:29:31.751225] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:31.967143] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-14T19:29:32.148088] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:32.150217] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T19:29:32.393150] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:29:32.758070] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-14T19:29:32.921629] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T19:29:33.558062] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-14T19:29:34.143399] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T19:29:34.358050] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-14T19:29:34.805582] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T19:29:35.158079] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-14T19:29:35.593041] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T19:29:35.958095] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-14T19:29:36.499796] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T19:29:36.758112] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-14T19:29:37.319503] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T19:29:37.558054] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-14T19:29:38.268962] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T19:29:38.358069] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-14T19:29:38.940237] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T19:29:39.158118] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-14T19:29:39.958058] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-14T19:29:40.064613] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T19:29:40.136560] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T19:29:40.758068] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-14T19:29:41.558141] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-14T19:29:41.972361] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-14T19:29:42.358064] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-14T19:29:42.439253] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T19:29:42.445549] [INFO ] [REMOTE ] HTGC: Full fetch complete (68794 records). [2025-10-14T19:29:42.445749] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-14T19:29:42.838142] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T19:29:42.864345] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-14T19:29:42.864908] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-14T19:29:42.866180] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-14T19:29:42.866600] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-14T19:29:42.867928] [DEBUG] [LOCAL ] HTGC: Trimmed 68794 records to 47691 (keeping 200 days of data) [2025-10-14T19:29:43.156197] [DEBUG] [LOCAL ] HTGC: Primary data saved (47691 records). [2025-10-14T19:29:43.156473] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-14T19:29:43.156567] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HTGC took 36.9s. Estimated remaining: 3h 3m 52s. Rate: 7.1 symbols/min [2025-10-14T19:29:43.168033] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-14T19:29:43.328154] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:43.328340] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-14T19:29:43.328386] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-14T19:29:43.328511] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-14T19:29:43.328553] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-14T19:29:43.328593] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-14T19:29:43.328625] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-14T19:29:43.676531] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:43.935781] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:29:43.958035] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-14T19:29:44.758102] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-14T19:29:44.796345] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T19:29:45.230529] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T19:29:45.558094] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-14T19:29:46.358058] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-14T19:29:46.561398] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T19:29:47.002533] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T19:29:47.158100] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-14T19:29:47.557715] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T19:29:47.958072] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-14T19:29:48.708492] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:29:48.758053] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-14T19:29:48.881433] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T19:29:49.558151] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-14T19:29:50.358049] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-14T19:29:50.419017] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T19:29:50.778612] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T19:29:51.158113] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-14T19:29:51.958064] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-14T19:29:52.152042] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T19:29:52.686033] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T19:29:52.758033] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-14T19:29:53.429388] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T19:29:53.558076] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-14T19:29:54.230638] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T19:29:54.358078] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-14T19:29:54.783821] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T19:29:55.158138] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-14T19:29:55.958096] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-14T19:29:56.036333] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T19:29:56.385359] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T19:29:56.389419] [INFO ] [REMOTE ] HTH: Full fetch complete (46716 records). [2025-10-14T19:29:56.389530] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-14T19:29:56.786085] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-14T19:29:56.804005] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-14T19:29:56.804101] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-14T19:29:56.804993] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-14T19:29:56.805057] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-14T19:29:56.806088] [DEBUG] [LOCAL ] HTH: Trimmed 46716 records to 32540 (keeping 200 days of data) [2025-10-14T19:29:57.018256] [DEBUG] [LOCAL ] HTH: Primary data saved (32540 records). [2025-10-14T19:29:57.018423] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-14T19:29:57.018539] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HTH took 30.6s. Estimated remaining: 3h 3m 50s. Rate: 7.1 symbols/min [2025-10-14T19:29:57.190745] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:29:57.240010] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T19:29:57.265701] [DEBUG] [LOCAL ] HUN: Loaded 53215 existing records from primary storage. [2025-10-14T19:29:57.266068] [INFO ] [MAIN ] HUN: Loaded 53215 existing records. [2025-10-14T19:29:57.443468] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:29:57.443708] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-14T19:29:57.443766] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-14T19:29:57.444617] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-14T19:29:57.444719] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-14T19:29:57.563236] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-14T19:29:57.818955] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:29:58.287386] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T19:29:58.358095] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-14T19:29:58.923540] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T19:29:59.158065] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-14T19:29:59.754450] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:29:59.958066] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-14T19:30:00.624880] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T19:30:00.758061] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-14T19:30:01.535528] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T19:30:01.558077] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-14T19:30:02.358112] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-14T19:30:03.158120] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-14T19:30:03.474935] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T19:30:03.817624] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-14T19:30:03.823530] [INFO ] [REMOTE ] HUBS: Full fetch complete (56412 records). [2025-10-14T19:30:03.823821] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-14T19:30:03.968222] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-14T19:30:04.282529] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T19:30:04.282915] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-14T19:30:04.291400] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-14T19:30:04.293330] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-14T19:30:04.293467] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-14T19:30:04.295677] [DEBUG] [LOCAL ] HUBS: Trimmed 56412 records to 40047 (keeping 200 days of data) [2025-10-14T19:30:04.542266] [DEBUG] [LOCAL ] HUBS: Primary data saved (40047 records). [2025-10-14T19:30:04.542401] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-14T19:30:04.542482] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBS took 33.9s. Estimated remaining: 3h 3m 41s. Rate: 7.1 symbols/min [2025-10-14T19:30:04.720379] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:30:04.760345] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-14T19:30:04.762461] [DEBUG] [LOCAL ] HUYA: Loaded 43863 existing records from primary storage. [2025-10-14T19:30:04.762834] [INFO ] [MAIN ] HUYA: Loaded 43863 existing records. [2025-10-14T19:30:04.948789] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:30:04.949068] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-14T19:30:04.949475] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-14T19:30:04.960892] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-14T19:30:04.966103] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-14T19:30:05.059880] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T19:30:05.382507] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:30:05.522182] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:30:05.558062] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-14T19:30:06.191917] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T19:30:06.358117] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-14T19:30:07.158087] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-14T19:30:07.576826] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T19:30:07.958106] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-14T19:30:08.177297] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T19:30:08.335523] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T19:30:08.758079] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-14T19:30:09.433578] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T19:30:09.558072] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-14T19:30:10.217288] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T19:30:10.358045] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-14T19:30:11.158081] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-14T19:30:11.495854] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T19:30:11.869313] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T19:30:11.958062] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-14T19:30:12.758126] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-14T19:30:12.987942] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T19:30:13.228160] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T19:30:13.558067] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-14T19:30:14.262798] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T19:30:14.358067] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-14T19:30:14.599776] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T19:30:15.158077] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-14T19:30:15.811612] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T19:30:15.958078] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-14T19:30:16.405540] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T19:30:16.409535] [INFO ] [REMOTE ] HUBB: Full fetch complete (54107 records). [2025-10-14T19:30:16.409619] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-14T19:30:16.759066] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-14T19:30:16.794418] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-14T19:30:16.794512] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-14T19:30:16.795358] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-14T19:30:16.795521] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-14T19:30:16.796685] [DEBUG] [LOCAL ] HUBB: Trimmed 54107 records to 36488 (keeping 200 days of data) [2025-10-14T19:30:17.023149] [DEBUG] [LOCAL ] HUBB: Primary data saved (36488 records). [2025-10-14T19:30:17.023280] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-14T19:30:17.023356] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUBB took 46.6s. Estimated remaining: 3h 3m 37s. Rate: 7.1 symbols/min [2025-10-14T19:30:17.192594] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:30:17.211406] [DEBUG] [LOCAL ] HVT: Loaded 15205 existing records from primary storage. [2025-10-14T19:30:17.211679] [INFO ] [MAIN ] HVT: Loaded 15205 existing records. [2025-10-14T19:30:17.389772] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:30:17.390115] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-14T19:30:17.390255] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-14T19:30:17.390514] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-14T19:30:17.390566] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-14T19:30:17.563873] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-14T19:30:17.662349] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:30:17.784947] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:30:18.358045] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-14T19:30:18.510146] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T19:30:19.158026] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-14T19:30:19.193975] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T19:30:19.199471] [INFO ] [REMOTE ] HUM: Full fetch complete (71037 records). [2025-10-14T19:30:19.199585] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-14T19:30:19.585803] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-14T19:30:19.585880] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-14T19:30:19.586885] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-14T19:30:19.586947] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-14T19:30:19.588307] [DEBUG] [LOCAL ] HUM: Trimmed 71037 records to 49228 (keeping 200 days of data) [2025-10-14T19:30:19.911189] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T19:30:19.937083] [DEBUG] [LOCAL ] HUM: Primary data saved (49228 records). [2025-10-14T19:30:19.937228] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-14T19:30:19.937300] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUM took 36.8s. Estimated remaining: 3h 3m 22s. Rate: 7.1 symbols/min [2025-10-14T19:30:19.968496] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-14T19:30:20.118197] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:30:20.169240] [DEBUG] [LOCAL ] HWM: Loaded 52832 existing records from primary storage. [2025-10-14T19:30:20.169628] [INFO ] [MAIN ] HWM: Loaded 52832 existing records. [2025-10-14T19:30:20.358559] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:30:20.358812] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-14T19:30:20.358876] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-14T19:30:20.360099] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-14T19:30:20.360159] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-14T19:30:20.736208] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:30:20.764154] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-14T19:30:20.770240] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T19:30:21.181214] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:30:21.558071] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-14T19:30:22.358120] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-14T19:30:22.432332] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T19:30:23.158297] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-14T19:30:23.299738] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T19:30:23.669365] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T19:30:23.958065] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-14T19:30:24.766909] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-14T19:30:24.772274] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T19:30:25.504345] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T19:30:25.558030] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-14T19:30:26.177670] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:30:26.358063] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-14T19:30:26.684592] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T19:30:27.158115] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-14T19:30:27.958108] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-14T19:30:28.013818] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T19:30:28.019729] [INFO ] [REMOTE ] HUN: Full fetch complete (76919 records). [2025-10-14T19:30:28.019838] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-14T19:30:28.348050] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T19:30:28.429966] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-14T19:30:28.430048] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-14T19:30:28.431039] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-14T19:30:28.431102] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-14T19:30:28.432504] [DEBUG] [LOCAL ] HUN: Trimmed 76919 records to 53215 (keeping 200 days of data) [2025-10-14T19:30:28.747589] [DEBUG] [LOCAL ] HUN: Primary data saved (53215 records). [2025-10-14T19:30:28.747739] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-14T19:30:28.750833] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUN took 31.7s. Estimated remaining: 3h 3m 14s. Rate: 7.1 symbols/min [2025-10-14T19:30:28.763168] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-14T19:30:28.931333] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:30:28.971328] [DEBUG] [LOCAL ] HXL: Loaded 45906 existing records from primary storage. [2025-10-14T19:30:28.971740] [INFO ] [MAIN ] HXL: Loaded 45906 existing records. [2025-10-14T19:30:29.151093] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:30:29.151310] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-14T19:30:29.151357] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-14T19:30:29.152229] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-14T19:30:29.152286] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-14T19:30:29.535582] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:30:29.559917] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-14T19:30:29.565011] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T19:30:30.359814] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-14T19:30:30.361817] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T19:30:30.373211] [INFO ] [REMOTE ] HUYA: Full fetch complete (64088 records). [2025-10-14T19:30:30.378273] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T19:30:30.377932] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-14T19:30:30.785738] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-14T19:30:30.785898] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-14T19:30:30.786838] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-14T19:30:30.786899] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-14T19:30:30.788170] [DEBUG] [LOCAL ] HUYA: Trimmed 64088 records to 43846 (keeping 200 days of data) [2025-10-14T19:30:31.035676] [DEBUG] [LOCAL ] HUYA: Primary data saved (43846 records). [2025-10-14T19:30:31.035812] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-14T19:30:31.035888] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HUYA took 26.5s. Estimated remaining: 3h 2m 58s. Rate: 7.1 symbols/min [2025-10-14T19:30:31.163256] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-14T19:30:31.206216] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:30:31.216451] [DEBUG] [LOCAL ] HY: Loaded 10021 existing records from primary storage. [2025-10-14T19:30:31.217057] [INFO ] [MAIN ] HY: Loaded 10021 existing records. [2025-10-14T19:30:31.397795] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:30:31.398177] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-14T19:30:31.398236] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-14T19:30:31.399022] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-14T19:30:31.399099] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-14T19:30:31.760719] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:30:31.958039] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-14T19:30:32.367703] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-14T19:30:32.758042] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-14T19:30:32.825108] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T19:30:32.918957] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T19:30:33.558064] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-14T19:30:34.358108] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-14T19:30:34.657969] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T19:30:34.725246] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T19:30:35.128896] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T19:30:35.158043] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-14T19:30:35.715734] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T19:30:35.958139] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-14T19:30:36.733444] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T19:30:36.758022] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-14T19:30:37.558046] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-14T19:30:37.570264] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T19:30:38.358067] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-14T19:30:38.664257] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T19:30:39.158102] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-14T19:30:39.958101] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-14T19:30:39.987697] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T19:30:40.229921] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T19:30:40.758072] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-14T19:30:40.978458] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T19:30:41.529202] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T19:30:41.558091] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-14T19:30:42.089513] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T19:30:42.358118] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-14T19:30:43.158084] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-14T19:30:43.271056] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T19:30:43.958055] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-14T19:30:44.692455] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T19:30:44.758083] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-14T19:30:44.937182] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T19:30:45.316576] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T19:30:45.558115] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-14T19:30:46.358078] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-14T19:30:47.158086] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-14T19:30:47.241115] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T19:30:47.262291] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-14T19:30:47.944169] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T19:30:47.958033] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-14T19:30:48.695027] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T19:30:48.696971] [INFO ] [REMOTE ] HY: Full fetch complete (15063 records). [2025-10-14T19:30:48.697166] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-14T19:30:48.765532] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-14T19:30:49.089119] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-14T19:30:49.089197] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-14T19:30:49.089513] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-14T19:30:49.089569] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-14T19:30:49.090163] [DEBUG] [LOCAL ] HY: Trimmed 15063 records to 10030 (keeping 200 days of data) [2025-10-14T19:30:49.155456] [DEBUG] [LOCAL ] HY: Primary data saved (10030 records). [2025-10-14T19:30:49.155597] [INFO ] [MAIN ] HY: Full history saved. [2025-10-14T19:30:49.155697] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HY took 18.1s. Estimated remaining: 3h 3m 1s. Rate: 7.1 symbols/min [2025-10-14T19:30:49.326038] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:30:49.326227] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-14T19:30:49.326265] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-14T19:30:49.326374] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-14T19:30:49.326414] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-14T19:30:49.326453] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-14T19:30:49.326484] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-14T19:30:49.563203] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-14T19:30:49.711863] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:30:49.720882] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T19:30:50.358077] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-14T19:30:50.733521] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-14T19:30:51.045778] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T19:30:51.158055] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-14T19:30:51.958129] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-14T19:30:52.319274] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T19:30:52.763244] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-14T19:30:52.781591] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T19:30:53.558109] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-14T19:30:53.872256] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-14T19:30:54.358135] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-14T19:30:54.673686] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-14T19:30:54.714070] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T19:30:55.158146] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-14T19:30:55.495023] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-14T19:30:55.958149] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-14T19:30:56.301872] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-14T19:30:56.758133] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-14T19:30:57.558090] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-14T19:30:58.361397] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-14T19:30:58.368759] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T19:30:58.697416] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-14T19:30:59.108085] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T19:30:59.158039] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-14T19:30:59.958158] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-14T19:31:00.758059] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-14T19:31:00.941584] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T19:31:01.535769] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-14T19:31:01.558043] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-14T19:31:02.358046] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-14T19:31:02.484219] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T19:31:02.521544] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T19:31:02.523547] [INFO ] [REMOTE ] HVT: Full fetch complete (23208 records). [2025-10-14T19:31:02.523622] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-14T19:31:02.909035] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-14T19:31:02.909115] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-14T19:31:02.909586] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-14T19:31:02.909627] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-14T19:31:02.910407] [DEBUG] [LOCAL ] HVT: Trimmed 23208 records to 15153 (keeping 200 days of data) [2025-10-14T19:31:03.001680] [DEBUG] [LOCAL ] HVT: Primary data saved (15153 records). [2025-10-14T19:31:03.001826] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-14T19:31:03.001904] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HVT took 46.0s. Estimated remaining: 3h 2m 59s. Rate: 7.1 symbols/min [2025-10-14T19:31:03.170347] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:31:03.167511] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-14T19:31:03.171252] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-14T19:31:03.171303] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-14T19:31:03.171410] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-14T19:31:03.171452] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-14T19:31:03.171492] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-14T19:31:03.171524] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-14T19:31:03.542876] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:31:03.958084] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-14T19:31:04.395568] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T19:31:04.516126] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-14T19:31:04.522192] [INFO ] [REMOTE ] HWM: Full fetch complete (76680 records). [2025-10-14T19:31:04.522313] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-14T19:31:04.763221] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-14T19:31:04.955197] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-14T19:31:04.955400] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-14T19:31:04.956805] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-14T19:31:04.971246] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-14T19:31:04.984896] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T19:31:04.996148] [DEBUG] [LOCAL ] HWM: Trimmed 76680 records to 52852 (keeping 200 days of data) [2025-10-14T19:31:05.105413] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-14T19:31:05.370556] [DEBUG] [LOCAL ] HWM: Primary data saved (52852 records). [2025-10-14T19:31:05.370734] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-14T19:31:05.370853] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HWM took 45.4s. Estimated remaining: 3h 2m 44s. Rate: 7.1 symbols/min [2025-10-14T19:31:05.560231] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-14T19:31:05.560144] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:31:05.571269] [DEBUG] [LOCAL ] HYI: Loaded 9920 existing records from primary storage. [2025-10-14T19:31:05.571458] [INFO ] [MAIN ] HYI: Loaded 9920 existing records. [2025-10-14T19:31:05.753269] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:31:05.753492] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-14T19:31:05.753542] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-14T19:31:05.753881] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-14T19:31:05.753941] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-14T19:31:05.847302] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-14T19:31:06.107039] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:31:06.358062] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-14T19:31:07.115185] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T19:31:07.158094] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-14T19:31:07.516330] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-14T19:31:07.958067] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-14T19:31:08.299613] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-14T19:31:08.758063] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-14T19:31:09.009132] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-14T19:31:09.558065] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-14T19:31:09.769353] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-14T19:31:10.358104] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-14T19:31:10.680488] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-14T19:31:11.158081] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-14T19:31:11.566600] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T19:31:11.567684] [INFO ] [REMOTE ] HYAC: Full fetch complete (918 records). [2025-10-14T19:31:11.567760] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-14T19:31:11.775187] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-14T19:31:11.775419] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:31:11.775490] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:31:11.775563] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-14T19:31:11.775627] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-14T19:31:11.775724] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-14T19:31:11.775781] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-14T19:31:11.775837] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYAC took 22.6s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-14T19:31:11.970357] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-14T19:31:11.974351] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:31:12.008225] [DEBUG] [LOCAL ] HYT: Loaded 33656 existing records from primary storage. [2025-10-14T19:31:12.008543] [INFO ] [MAIN ] HYT: Loaded 33656 existing records. [2025-10-14T19:31:12.202172] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:31:12.202375] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-14T19:31:12.202423] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-14T19:31:12.203057] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-14T19:31:12.203116] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-14T19:31:12.343472] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-14T19:31:12.568187] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:31:12.758082] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-14T19:31:13.558031] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-14T19:31:14.010175] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T19:31:14.358070] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-14T19:31:15.165182] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-14T19:31:15.173707] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T19:31:15.309410] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T19:31:15.424284] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-14T19:31:15.958062] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-14T19:31:16.310159] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-14T19:31:16.758059] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-14T19:31:17.488106] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T19:31:17.558045] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-14T19:31:18.358063] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-14T19:31:19.045046] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T19:31:19.158041] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-14T19:31:19.524905] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-14T19:31:19.644195] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T19:31:19.958045] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-14T19:31:20.220161] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-14T19:31:20.758064] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-14T19:31:21.558074] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-14T19:31:22.277009] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T19:31:22.308850] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T19:31:22.358053] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-14T19:31:23.158061] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-14T19:31:23.482200] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-14T19:31:23.482874] [INFO ] [REMOTE ] HYBX: Full fetch complete (709 records). [2025-10-14T19:31:23.482939] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-14T19:31:23.483258] [FATAL] [VALIDATOR ] HYBX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T19:31:23.483337] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:31:23.483378] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:31:23.483415] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-14T19:31:23.483468] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-14T19:31:23.483501] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-14T19:31:23.483540] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-14T19:31:23.483590] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HYBX took 20.5s. Estimated remaining: 3h 2m 28s. Rate: 7.1 symbols/min [2025-10-14T19:31:23.659010] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:31:23.663870] [DEBUG] [LOCAL ] HYTR: Loaded 3131 existing records from primary storage. [2025-10-14T19:31:23.664071] [INFO ] [MAIN ] HYTR: Loaded 3131 existing records. [2025-10-14T19:31:23.863167] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:31:23.863498] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-14T19:31:23.863593] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-14T19:31:23.870174] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-14T19:31:23.881092] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-14T19:31:23.919132] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T19:31:23.959491] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-14T19:31:23.997301] [INFO ] [REMOTE ] HXL: Full fetch complete (66353 records). [2025-10-14T19:31:24.018465] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-14T19:31:24.528571] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:31:24.743620] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-14T19:31:24.743834] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-14T19:31:24.744794] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-14T19:31:24.744892] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-14T19:31:24.746226] [DEBUG] [LOCAL ] HXL: Trimmed 66353 records to 45870 (keeping 200 days of data) [2025-10-14T19:31:24.800251] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-14T19:31:24.848196] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-14T19:31:25.037870] [DEBUG] [LOCAL ] HXL: Primary data saved (45870 records). [2025-10-14T19:31:25.037997] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-14T19:31:25.038075] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HXL took 56.3s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-14T19:31:25.204406] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:31:25.230978] [DEBUG] [LOCAL ] HZO: Loaded 29044 existing records from primary storage. [2025-10-14T19:31:25.231227] [INFO ] [MAIN ] HZO: Loaded 29044 existing records. [2025-10-14T19:31:25.410591] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T19:31:25.415780] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:31:25.417022] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-14T19:31:25.417070] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-14T19:31:25.417731] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-14T19:31:25.417819] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-14T19:31:25.564624] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-14T19:31:25.770153] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:31:26.162022] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T19:31:26.358053] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-14T19:31:27.146634] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T19:31:27.158015] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-14T19:31:27.906402] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T19:31:27.958111] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-14T19:31:28.470725] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T19:31:28.758055] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-14T19:31:29.446405] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T19:31:29.558057] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-14T19:31:30.358104] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-14T19:31:30.643561] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:31:30.794671] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T19:31:31.158065] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-14T19:31:31.958078] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-14T19:31:32.252426] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T19:31:32.513755] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-14T19:31:32.758072] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-14T19:31:33.558065] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-14T19:31:33.574342] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T19:31:34.358061] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-14T19:31:35.016334] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T19:31:35.030312] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T19:31:35.158038] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-14T19:31:35.958094] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-14T19:31:36.247552] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T19:31:36.308098] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-14T19:31:36.758113] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-14T19:31:37.317124] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T19:31:37.558060] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-14T19:31:38.071970] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-14T19:31:38.358107] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-14T19:31:38.900330] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T19:31:39.158045] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-14T19:31:39.626060] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T19:31:39.958088] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-14T19:31:40.416067] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T19:31:40.758123] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-14T19:31:41.347247] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T19:31:41.348272] [INFO ] [REMOTE ] HYTR: Full fetch complete (4632 records). [2025-10-14T19:31:41.348340] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-14T19:31:41.563304] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-14T19:31:41.698954] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-14T19:31:41.699031] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-14T19:31:41.699163] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-14T19:31:41.699199] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-14T19:31:41.699536] [DEBUG] [LOCAL ] HYTR: Trimmed 4632 records to 3124 (keeping 200 days of data) [2025-10-14T19:31:41.718538] [DEBUG] [LOCAL ] HYTR: Primary data saved (3124 records). [2025-10-14T19:31:41.718605] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-14T19:31:41.718692] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 18.2s. Estimated remaining: 3h 2m 13s. Rate: 7.1 symbols/min [2025-10-14T19:31:41.884351] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:31:41.891639] [DEBUG] [LOCAL ] IAE: Loaded 6226 existing records from primary storage. [2025-10-14T19:31:41.891880] [INFO ] [MAIN ] IAE: Loaded 6226 existing records. [2025-10-14T19:31:42.064148] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:31:42.064347] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-14T19:31:42.064393] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-14T19:31:42.064636] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-14T19:31:42.064722] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-14T19:31:42.363212] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-14T19:31:42.414542] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:31:42.929285] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T19:31:42.992487] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T19:31:42.994535] [INFO ] [REMOTE ] HYI: Full fetch complete (13985 records). [2025-10-14T19:31:42.994719] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-14T19:31:43.167908] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-14T19:31:43.358230] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-14T19:31:43.358304] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-14T19:31:43.358626] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-14T19:31:43.358697] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-14T19:31:43.359157] [DEBUG] [LOCAL ] HYI: Trimmed 13985 records to 9904 (keeping 200 days of data) [2025-10-14T19:31:43.419034] [DEBUG] [LOCAL ] HYI: Primary data saved (9904 records). [2025-10-14T19:31:43.419175] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-14T19:31:43.419255] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYI took 38.0s. Estimated remaining: 3h 1m 56s. Rate: 7.1 symbols/min [2025-10-14T19:31:43.958075] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-14T19:31:44.519781] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T19:31:44.642114] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T19:31:44.758079] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-14T19:31:45.344276] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T19:31:45.558041] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-14T19:31:46.358037] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-14T19:31:46.610617] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T19:31:46.791358] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T19:31:47.158068] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-14T19:31:47.767190] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:31:47.958066] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-14T19:31:48.524480] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-14T19:31:48.758097] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-14T19:31:49.379485] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T19:31:49.558045] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-14T19:31:50.358079] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-14T19:31:50.822393] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T19:31:50.834292] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-14T19:31:51.158077] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-14T19:31:51.799832] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T19:31:51.958127] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-14T19:31:52.758076] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-14T19:31:53.373491] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T19:31:53.558062] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-14T19:31:54.246952] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:31:54.358036] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-14T19:31:54.935198] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T19:31:55.158026] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-14T19:31:55.479499] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T19:31:55.958092] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-14T19:31:56.472334] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T19:31:56.472493] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T19:31:56.758061] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-14T19:31:57.459547] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T19:31:57.558034] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-14T19:31:58.282373] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T19:31:58.283966] [INFO ] [REMOTE ] IAE: Full fetch complete (9001 records). [2025-10-14T19:31:58.284034] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-14T19:31:58.363162] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-14T19:31:58.661447] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-14T19:31:58.661519] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-14T19:31:58.661763] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-14T19:31:58.661823] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-14T19:31:58.662211] [DEBUG] [LOCAL ] IAE: Trimmed 9001 records to 6255 (keeping 200 days of data) [2025-10-14T19:31:58.697357] [DEBUG] [LOCAL ] IAE: Primary data saved (6255 records). [2025-10-14T19:31:58.697455] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-14T19:31:58.697525] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. IAE took 17.0s. Estimated remaining: 3h 1m 56s. Rate: 7.1 symbols/min [2025-10-14T19:31:59.158053] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-14T19:31:59.823845] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:31:59.827900] [INFO ] [REMOTE ] HYT: Full fetch complete (47875 records). [2025-10-14T19:31:59.827987] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-14T19:32:00.207075] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-14T19:32:00.207173] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-14T19:32:00.207999] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-14T19:32:00.208072] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-14T19:32:00.209324] [DEBUG] [LOCAL ] HYT: Trimmed 47875 records to 33676 (keeping 200 days of data) [2025-10-14T19:32:00.334600] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T19:32:00.344805] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-14T19:32:00.447106] [DEBUG] [LOCAL ] HYT: Primary data saved (33676 records). [2025-10-14T19:32:00.447247] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-14T19:32:00.447328] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. HYT took 48.7s. Estimated remaining: 3h 1m 40s. Rate: 7.1 symbols/min [2025-10-14T19:32:01.895808] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T19:32:01.902512] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-14T19:32:03.181009] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T19:32:03.187532] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-14T19:32:04.333108] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T19:32:04.340242] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-14T19:32:05.706016] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T19:32:05.709317] [INFO ] [REMOTE ] HZO: Full fetch complete (41239 records). [2025-10-14T19:32:05.709412] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-14T19:32:06.082111] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-14T19:32:06.082189] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-14T19:32:06.082870] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-14T19:32:06.082929] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-14T19:32:06.083774] [DEBUG] [LOCAL ] HZO: Trimmed 41239 records to 29123 (keeping 200 days of data) [2025-10-14T19:32:06.253593] [DEBUG] [LOCAL ] HZO: Primary data saved (29123 records). [2025-10-14T19:32:06.253780] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-14T19:32:06.253871] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. HZO took 41.2s. Estimated remaining: 3h 1m 28s. Rate: 7.1 symbols/min [2025-10-14T19:32:06.980454] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:07.043161] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:07.050344] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:07.049176] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:07.082183] [DEBUG] [LOCAL ] IBP: Loaded 28889 existing records from primary storage. [2025-10-14T19:32:07.082464] [INFO ] [MAIN ] IBP: Loaded 28889 existing records. [2025-10-14T19:32:07.278355] [DEBUG] [LOCAL ] IBN: Loaded 52832 existing records from primary storage. [2025-10-14T19:32:07.284597] [INFO ] [MAIN ] IBN: Loaded 52832 existing records. [2025-10-14T19:32:07.350196] [DEBUG] [LOCAL ] IAG: Loaded 53486 existing records from primary storage. [2025-10-14T19:32:07.359530] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:07.360380] [DEBUG] [LOCAL ] IBM: Loaded 53633 existing records from primary storage. [2025-10-14T19:32:07.372460] [INFO ] [MAIN ] IAG: Loaded 53486 existing records. [2025-10-14T19:32:07.378452] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-14T19:32:07.378813] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-14T19:32:07.416397] [INFO ] [MAIN ] IBM: Loaded 53633 existing records. [2025-10-14T19:32:07.529027] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-14T19:32:07.534307] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-14T19:32:07.982603] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:08.001514] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:08.053250] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-14T19:32:08.064384] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-14T19:32:08.064308] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:08.061327] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-14T19:32:08.097395] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-14T19:32:08.130164] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-14T19:32:08.140960] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-14T19:32:08.141248] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-14T19:32:08.141134] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-14T19:32:08.141186] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-14T19:32:08.161356] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-14T19:32:08.222054] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-14T19:32:08.273954] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-14T19:32:08.907378] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:08.940796] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-14T19:32:09.306492] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:09.345229] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-14T19:32:09.412754] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:09.437009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-14T19:32:09.440929] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:09.442218] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-14T19:32:10.271358] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T19:32:10.276661] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-14T19:32:10.730283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T19:32:10.740579] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-14T19:32:11.159709] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T19:32:11.164789] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-14T19:32:11.217460] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T19:32:11.228966] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-14T19:32:11.259667] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T19:32:11.270710] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-14T19:32:12.084636] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:32:12.095059] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-14T19:32:12.456622] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T19:32:12.462512] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-14T19:32:13.027425] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T19:32:13.037973] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-14T19:32:13.401576] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T19:32:13.412211] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-14T19:32:13.451365] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-14T19:32:13.558036] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-14T19:32:13.785345] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T19:32:14.358060] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-14T19:32:14.827018] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T19:32:15.158093] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-14T19:32:15.200969] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T19:32:15.319953] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T19:32:15.851571] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:32:15.958060] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-14T19:32:16.758105] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-14T19:32:16.882591] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T19:32:17.133626] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T19:32:17.558084] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-14T19:32:18.358035] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-14T19:32:18.668128] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T19:32:18.834636] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-14T19:32:19.158056] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-14T19:32:19.958048] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-14T19:32:20.142420] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T19:32:20.758091] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-14T19:32:21.261616] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T19:32:21.353360] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-14T19:32:21.558054] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-14T19:32:22.358055] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-14T19:32:22.633971] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T19:32:22.705970] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T19:32:23.158050] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-14T19:32:23.797290] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T19:32:23.958136] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-14T19:32:24.758116] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-14T19:32:25.062630] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T19:32:25.254373] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T19:32:25.558099] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-14T19:32:26.358035] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-14T19:32:26.694504] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T19:32:26.815872] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T19:32:27.158076] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-14T19:32:27.781302] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T19:32:27.958116] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-14T19:32:28.758055] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-14T19:32:28.964276] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T19:32:29.558038] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-14T19:32:30.046798] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T19:32:30.086015] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T19:32:30.358072] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-14T19:32:31.158064] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-14T19:32:31.418101] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T19:32:31.958088] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-14T19:32:32.215204] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:32:32.218591] [INFO ] [REMOTE ] IBP: Full fetch complete (41085 records). [2025-10-14T19:32:32.218735] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-14T19:32:32.617199] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-14T19:32:32.617326] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-14T19:32:32.618151] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-14T19:32:32.618285] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-14T19:32:32.619365] [DEBUG] [LOCAL ] IBP: Trimmed 41085 records to 28892 (keeping 200 days of data) [2025-10-14T19:32:32.757616] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-14T19:32:32.760703] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-14T19:32:32.847020] [DEBUG] [LOCAL ] IBP: Primary data saved (28892 records). [2025-10-14T19:32:32.847151] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-14T19:32:32.847228] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 26.6s. Estimated remaining: 3h 1m 41s. Rate: 7.1 symbols/min [2025-10-14T19:32:33.013422] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:33.045791] [DEBUG] [LOCAL ] IBTA: Loaded 36817 existing records from primary storage. [2025-10-14T19:32:33.046051] [INFO ] [MAIN ] IBTA: Loaded 36817 existing records. [2025-10-14T19:32:33.220602] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:33.220799] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-14T19:32:33.220852] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-14T19:32:33.221392] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-14T19:32:33.221448] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-14T19:32:33.558772] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-14T19:32:33.579708] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:33.705436] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T19:32:34.358133] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-14T19:32:34.587356] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T19:32:35.158102] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-14T19:32:35.481906] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T19:32:35.958043] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-14T19:32:35.998360] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-14T19:32:36.758045] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-14T19:32:37.080764] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T19:32:37.178273] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T19:32:37.558084] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-14T19:32:38.358063] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-14T19:32:38.378787] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:32:38.384623] [INFO ] [REMOTE ] IBN: Full fetch complete (76473 records). [2025-10-14T19:32:38.384799] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-14T19:32:38.786282] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-14T19:32:38.786368] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-14T19:32:38.787427] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-14T19:32:38.787491] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-14T19:32:38.789038] [DEBUG] [LOCAL ] IBN: Trimmed 76473 records to 52809 (keeping 200 days of data) [2025-10-14T19:32:39.129459] [DEBUG] [LOCAL ] IBN: Primary data saved (52809 records). [2025-10-14T19:32:39.129588] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-14T19:32:39.129686] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBN took 32.9s. Estimated remaining: 3h 1m 30s. Rate: 7.1 symbols/min [2025-10-14T19:32:39.161336] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-14T19:32:39.303570] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:39.321129] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T19:32:39.339324] [INFO ] [REMOTE ] IAG: Full fetch complete (77468 records). [2025-10-14T19:32:39.340521] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T19:32:39.345702] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-14T19:32:39.693192] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-14T19:32:39.696064] [INFO ] [MAIN ] ICE: Loaded 53011 existing records. [2025-10-14T19:32:39.974102] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-14T19:32:39.978855] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:39.979944] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-14T19:32:39.980014] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-14T19:32:39.980125] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-14T19:32:39.980240] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-14T19:32:39.981451] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-14T19:32:39.981570] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-14T19:32:39.981753] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-14T19:32:39.981867] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-14T19:32:40.085606] [DEBUG] [LOCAL ] IAG: Trimmed 77468 records to 53488 (keeping 200 days of data) [2025-10-14T19:32:40.566322] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:40.673115] [DEBUG] [LOCAL ] IAG: Primary data saved (53488 records). [2025-10-14T19:32:40.673248] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-14T19:32:40.673325] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IAG took 34.4s. Estimated remaining: 3h 1m 13s. Rate: 7.1 symbols/min [2025-10-14T19:32:40.764712] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-14T19:32:40.847145] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:40.880508] [DEBUG] [LOCAL ] ICL: Loaded 38494 existing records from primary storage. [2025-10-14T19:32:40.880825] [INFO ] [MAIN ] ICL: Loaded 38494 existing records. [2025-10-14T19:32:41.056987] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:41.057551] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-14T19:32:41.058304] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-14T19:32:41.059099] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-14T19:32:41.059174] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-14T19:32:41.493835] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:41.558056] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-14T19:32:41.563134] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-14T19:32:41.616360] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T19:32:42.358045] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-14T19:32:42.557097] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T19:32:42.636013] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T19:32:43.158057] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-14T19:32:43.624307] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T19:32:43.852415] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T19:32:43.858382] [INFO ] [REMOTE ] IBM: Full fetch complete (77737 records). [2025-10-14T19:32:43.858499] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-14T19:32:43.958075] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-14T19:32:44.253745] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-14T19:32:44.253820] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-14T19:32:44.254846] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-14T19:32:44.254905] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-14T19:32:44.256255] [DEBUG] [LOCAL ] IBM: Trimmed 77737 records to 53632 (keeping 200 days of data) [2025-10-14T19:32:44.593819] [DEBUG] [LOCAL ] IBM: Primary data saved (53632 records). [2025-10-14T19:32:44.593942] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-14T19:32:44.594016] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 38.3s. Estimated remaining: 3h 0m 60s. Rate: 7.1 symbols/min [2025-10-14T19:32:44.765468] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:32:44.763228] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-14T19:32:44.799287] [DEBUG] [LOCAL ] IDA: Loaded 32732 existing records from primary storage. [2025-10-14T19:32:44.799539] [INFO ] [MAIN ] IDA: Loaded 32732 existing records. [2025-10-14T19:32:44.979379] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:32:44.979795] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-14T19:32:44.979852] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-14T19:32:44.980726] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-14T19:32:44.980806] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-14T19:32:45.350767] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:32:45.370034] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T19:32:45.558056] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-14T19:32:46.168022] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T19:32:46.358031] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-14T19:32:46.604361] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T19:32:47.158074] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-14T19:32:47.958081] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-14T19:32:48.076634] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T19:32:48.208225] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T19:32:48.758069] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-14T19:32:48.935234] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T19:32:49.558053] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-14T19:32:49.642058] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T19:32:50.358086] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-14T19:32:51.116975] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T19:32:51.158069] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-14T19:32:51.477707] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T19:32:51.962539] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-14T19:32:51.966890] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T19:32:52.758087] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-14T19:32:53.558136] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-14T19:32:53.592853] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T19:32:53.842018] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T19:32:54.358068] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-14T19:32:55.158114] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-14T19:32:55.262428] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:32:55.968438] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-14T19:32:55.973265] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T19:32:56.554264] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T19:32:56.758050] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-14T19:32:57.558038] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-14T19:32:57.710895] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T19:32:58.133806] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T19:32:58.358052] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-14T19:32:59.026914] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T19:32:59.158036] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-14T19:32:59.558793] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T19:32:59.958092] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-14T19:33:00.070749] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T19:33:00.758118] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-14T19:33:01.518996] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:33:01.558034] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-14T19:33:02.358093] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-14T19:33:02.417678] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T19:33:02.893965] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T19:33:03.158049] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-14T19:33:03.958080] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-14T19:33:04.254989] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T19:33:04.286780] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T19:33:04.758061] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-14T19:33:05.298991] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T19:33:05.304477] [INFO ] [REMOTE ] IBTA: Full fetch complete (51075 records). [2025-10-14T19:33:05.304589] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-14T19:33:05.563807] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-14T19:33:05.698827] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-14T19:33:05.698904] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-14T19:33:05.699712] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-14T19:33:05.699773] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-14T19:33:05.700847] [DEBUG] [LOCAL ] IBTA: Trimmed 51075 records to 36746 (keeping 200 days of data) [2025-10-14T19:33:05.915350] [DEBUG] [LOCAL ] IBTA: Primary data saved (36746 records). [2025-10-14T19:33:05.921428] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-14T19:33:05.925639] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. IBTA took 33.1s. Estimated remaining: 3h 1m 6s. Rate: 7.1 symbols/min [2025-10-14T19:33:05.959677] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T19:33:06.009291] [INFO ] [REMOTE ] ICL: Full fetch complete (56088 records). [2025-10-14T19:33:06.029315] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-14T19:33:06.237748] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:06.366437] [DEBUG] [LOCAL ] IDE: Loaded 9063 existing records from primary storage. [2025-10-14T19:33:06.373332] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-14T19:33:06.378759] [INFO ] [MAIN ] IDE: Loaded 9063 existing records. [2025-10-14T19:33:06.630965] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-14T19:33:06.656837] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-14T19:33:06.709991] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:06.680078] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-14T19:33:06.710519] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-14T19:33:06.710627] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-14T19:33:06.711201] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-14T19:33:06.711927] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-14T19:33:06.712056] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-14T19:33:06.805303] [DEBUG] [LOCAL ] ICL: Trimmed 56088 records to 38549 (keeping 200 days of data) [2025-10-14T19:33:07.180192] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T19:33:07.294484] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-14T19:33:07.366205] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:07.375416] [DEBUG] [LOCAL ] ICL: Primary data saved (38549 records). [2025-10-14T19:33:07.375613] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-14T19:33:07.375738] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. ICL took 26.7s. Estimated remaining: 3h 0m 50s. Rate: 7.1 symbols/min [2025-10-14T19:33:07.541174] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:07.557945] [DEBUG] [LOCAL ] IDT: Loaded 18345 existing records from primary storage. [2025-10-14T19:33:07.558183] [INFO ] [MAIN ] IDT: Loaded 18345 existing records. [2025-10-14T19:33:07.733094] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:07.733344] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-14T19:33:07.733391] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-14T19:33:07.733812] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-14T19:33:07.733870] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-14T19:33:07.960478] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-14T19:33:08.102001] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:08.133800] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T19:33:08.592504] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-14T19:33:08.734016] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T19:33:08.758049] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-14T19:33:09.398991] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T19:33:09.558071] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-14T19:33:10.077297] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T19:33:10.358062] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-14T19:33:11.158068] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-14T19:33:11.667626] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T19:33:11.958047] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-14T19:33:12.004889] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T19:33:12.758067] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-14T19:33:13.563249] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-14T19:33:13.582344] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T19:33:13.608623] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T19:33:14.358069] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-14T19:33:14.875047] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T19:33:14.879073] [INFO ] [REMOTE ] IDA: Full fetch complete (45182 records). [2025-10-14T19:33:14.879198] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-14T19:33:15.158949] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-14T19:33:15.191065] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T19:33:15.296280] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-14T19:33:15.296362] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-14T19:33:15.297277] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-14T19:33:15.297363] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-14T19:33:15.298373] [DEBUG] [LOCAL ] IDA: Trimmed 45182 records to 32789 (keeping 200 days of data) [2025-10-14T19:33:15.501617] [DEBUG] [LOCAL ] IDA: Primary data saved (32789 records). [2025-10-14T19:33:15.501779] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-14T19:33:15.501859] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDA took 30.9s. Estimated remaining: 3h 0m 41s. Rate: 7.1 symbols/min [2025-10-14T19:33:15.673765] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:15.710350] [DEBUG] [LOCAL ] IEX: Loaded 38338 existing records from primary storage. [2025-10-14T19:33:15.710675] [INFO ] [MAIN ] IEX: Loaded 38338 existing records. [2025-10-14T19:33:15.902858] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:15.909740] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-14T19:33:15.910311] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-14T19:33:15.910128] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T19:33:15.912515] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-14T19:33:15.913266] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-14T19:33:15.963206] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-14T19:33:16.296718] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:16.738215] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T19:33:16.758072] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-14T19:33:17.501879] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T19:33:17.558097] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-14T19:33:18.358071] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-14T19:33:19.120475] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T19:33:19.158024] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-14T19:33:19.418992] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T19:33:19.820245] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T19:33:19.958073] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-14T19:33:20.758042] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-14T19:33:21.269485] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T19:33:21.558090] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-14T19:33:21.792377] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:33:22.358127] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-14T19:33:22.639983] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T19:33:22.984965] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T19:33:23.158069] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-14T19:33:23.958034] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-14T19:33:24.195599] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T19:33:24.758160] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-14T19:33:25.106168] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T19:33:25.341627] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T19:33:25.558075] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-14T19:33:26.358074] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-14T19:33:26.658003] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T19:33:27.158058] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-14T19:33:27.880686] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T19:33:27.958023] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-14T19:33:28.758037] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-14T19:33:28.804685] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T19:33:29.562295] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-14T19:33:29.564484] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T19:33:29.693074] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T19:33:30.358108] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-14T19:33:30.889879] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T19:33:31.158129] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-14T19:33:31.375348] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T19:33:31.812610] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T19:33:31.958076] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-14T19:33:32.758057] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-14T19:33:33.037590] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T19:33:33.558085] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-14T19:33:33.576639] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T19:33:34.358067] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-14T19:33:35.135505] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T19:33:35.141356] [INFO ] [REMOTE ] ICE: Full fetch complete (76938 records). [2025-10-14T19:33:35.141481] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-14T19:33:35.163323] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-14T19:33:35.530071] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-14T19:33:35.530199] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-14T19:33:35.531298] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-14T19:33:35.531359] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-14T19:33:35.532782] [DEBUG] [LOCAL ] ICE: Trimmed 76938 records to 53017 (keeping 200 days of data) [2025-10-14T19:33:35.775804] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T19:33:35.893421] [DEBUG] [LOCAL ] ICE: Primary data saved (53017 records). [2025-10-14T19:33:35.893532] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-14T19:33:35.893607] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. ICE took 56.8s. Estimated remaining: 3h 0m 46s. Rate: 7.1 symbols/min [2025-10-14T19:33:35.960402] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-14T19:33:36.074607] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:36.076635] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T19:33:36.079831] [INFO ] [REMOTE ] IDE: Full fetch complete (12726 records). [2025-10-14T19:33:36.080046] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-14T19:33:36.417402] [DEBUG] [LOCAL ] IFF: Loaded 51078 existing records from primary storage. [2025-10-14T19:33:36.445406] [INFO ] [MAIN ] IFF: Loaded 51078 existing records. [2025-10-14T19:33:36.580554] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-14T19:33:36.580984] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-14T19:33:36.586849] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-14T19:33:36.586968] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-14T19:33:36.608561] [DEBUG] [LOCAL ] IDE: Trimmed 12726 records to 9113 (keeping 200 days of data) [2025-10-14T19:33:36.682945] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:36.703114] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-14T19:33:36.704690] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-14T19:33:36.713418] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-14T19:33:36.718990] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-14T19:33:36.718907] [DEBUG] [LOCAL ] IDE: Primary data saved (9113 records). [2025-10-14T19:33:36.719284] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-14T19:33:36.719387] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDE took 30.8s. Estimated remaining: 3h 0m 29s. Rate: 7.1 symbols/min [2025-10-14T19:33:36.769634] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-14T19:33:37.111537] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:37.274626] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:37.288774] [DEBUG] [LOCAL ] IFN: Loaded 18400 existing records from primary storage. [2025-10-14T19:33:37.289030] [INFO ] [MAIN ] IFN: Loaded 18400 existing records. [2025-10-14T19:33:37.473594] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:37.474040] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-14T19:33:37.474178] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-14T19:33:37.482927] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-14T19:33:37.496602] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-14T19:33:37.563817] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-14T19:33:37.531265] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T19:33:37.865763] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:37.983311] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T19:33:37.986420] [INFO ] [REMOTE ] IDT: Full fetch complete (23720 records). [2025-10-14T19:33:37.986607] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-14T19:33:38.356370] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-14T19:33:38.356448] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-14T19:33:38.356994] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-14T19:33:38.357057] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-14T19:33:38.357784] [DEBUG] [LOCAL ] IDT: Trimmed 23720 records to 18405 (keeping 200 days of data) [2025-10-14T19:33:38.358144] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-14T19:33:38.476726] [DEBUG] [LOCAL ] IDT: Primary data saved (18405 records). [2025-10-14T19:33:38.476879] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-14T19:33:38.476978] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IDT took 31.1s. Estimated remaining: 3h 0m 13s. Rate: 7.1 symbols/min [2025-10-14T19:33:38.658498] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:38.679944] [DEBUG] [LOCAL ] IFS: Loaded 22767 existing records from primary storage. [2025-10-14T19:33:38.680208] [INFO ] [MAIN ] IFS: Loaded 22767 existing records. [2025-10-14T19:33:38.870033] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:38.870231] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-14T19:33:38.870298] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-14T19:33:38.870801] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-14T19:33:38.870866] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-14T19:33:39.160275] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-14T19:33:39.247613] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:39.274745] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T19:33:39.492076] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T19:33:39.958073] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-14T19:33:40.636708] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T19:33:40.758041] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-14T19:33:41.558133] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-14T19:33:41.630518] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T19:33:42.283766] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T19:33:42.358047] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-14T19:33:42.655127] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T19:33:43.158071] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-14T19:33:43.534028] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T19:33:43.538018] [INFO ] [REMOTE ] IEX: Full fetch complete (53490 records). [2025-10-14T19:33:43.538114] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-14T19:33:43.911021] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-14T19:33:43.911104] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-14T19:33:43.912024] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-14T19:33:43.912090] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-14T19:33:43.913190] [DEBUG] [LOCAL ] IEX: Trimmed 53490 records to 38366 (keeping 200 days of data) [2025-10-14T19:33:43.969118] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-14T19:33:44.176906] [DEBUG] [LOCAL ] IEX: Primary data saved (38366 records). [2025-10-14T19:33:44.177073] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-14T19:33:44.177177] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IEX took 28.7s. Estimated remaining: 3h 0m 1s. Rate: 7.1 symbols/min [2025-10-14T19:33:44.340192] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T19:33:44.369845] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:33:44.380868] [DEBUG] [LOCAL ] IGA: Loaded 10122 existing records from primary storage. [2025-10-14T19:33:44.381072] [INFO ] [MAIN ] IGA: Loaded 10122 existing records. [2025-10-14T19:33:44.565017] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:33:44.565215] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-14T19:33:44.565262] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-14T19:33:44.565546] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-14T19:33:44.565603] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-14T19:33:44.763297] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-14T19:33:44.945725] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:33:45.117983] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T19:33:45.558064] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-14T19:33:46.193512] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T19:33:46.358052] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-14T19:33:46.484488] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T19:33:47.158095] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-14T19:33:47.487856] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T19:33:47.958139] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-14T19:33:47.992614] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T19:33:48.758114] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-14T19:33:48.883400] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T19:33:49.558042] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-14T19:33:49.806334] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T19:33:50.015838] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T19:33:50.358135] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-14T19:33:51.158065] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-14T19:33:51.958088] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-14T19:33:52.170122] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T19:33:52.315880] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-14T19:33:52.758090] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-14T19:33:53.046114] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T19:33:53.469201] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T19:33:53.558062] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-14T19:33:54.358120] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-14T19:33:55.158055] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-14T19:33:55.248489] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T19:33:55.296411] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T19:33:55.958046] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-14T19:33:56.135052] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T19:33:56.758100] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-14T19:33:57.552177] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:33:57.562756] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-14T19:33:57.600054] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T19:33:58.305524] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T19:33:58.358087] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-14T19:33:59.158127] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-14T19:33:59.958039] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-14T19:34:00.042793] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T19:34:00.287259] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T19:34:00.758079] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-14T19:34:01.189777] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-14T19:34:01.558090] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-14T19:34:01.797114] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T19:34:02.358114] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-14T19:34:03.158055] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-14T19:34:03.307627] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-14T19:34:03.345542] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T19:34:03.958126] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-14T19:34:04.291719] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T19:34:04.758085] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-14T19:34:05.070889] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T19:34:05.558118] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-14T19:34:06.358081] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-14T19:34:06.681359] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T19:34:06.710949] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T19:34:07.016286] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T19:34:07.158099] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-14T19:34:07.958061] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-14T19:34:08.758072] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-14T19:34:08.913715] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T19:34:09.040537] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T19:34:09.044537] [INFO ] [REMOTE ] IFS: Full fetch complete (31942 records). [2025-10-14T19:34:09.044719] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-14T19:34:09.469370] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-14T19:34:09.469447] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-14T19:34:09.470125] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-14T19:34:09.470187] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-14T19:34:09.470950] [DEBUG] [LOCAL ] IFS: Trimmed 31942 records to 22683 (keeping 200 days of data) [2025-10-14T19:34:09.569618] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-14T19:34:09.606203] [DEBUG] [LOCAL ] IFS: Primary data saved (22683 records). [2025-10-14T19:34:09.606331] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-14T19:34:09.606406] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFS took 31.1s. Estimated remaining: 3h 0m 12s. Rate: 7.1 symbols/min [2025-10-14T19:34:09.781943] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:09.782852] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T19:34:09.786086] [INFO ] [REMOTE ] IFN: Full fetch complete (28676 records). [2025-10-14T19:34:09.786168] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-14T19:34:09.951239] [DEBUG] [LOCAL ] IGD: Loaded 19338 existing records from primary storage. [2025-10-14T19:34:09.958237] [INFO ] [MAIN ] IGD: Loaded 19338 existing records. [2025-10-14T19:34:10.365218] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-14T19:34:10.385083] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-14T19:34:10.394876] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:10.395174] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-14T19:34:10.395743] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-14T19:34:10.395843] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-14T19:34:10.397983] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-14T19:34:10.398247] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-14T19:34:10.397889] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-14T19:34:10.403765] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-14T19:34:10.514712] [DEBUG] [LOCAL ] IFN: Trimmed 28676 records to 18475 (keeping 200 days of data) [2025-10-14T19:34:11.133275] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:11.144855] [DEBUG] [LOCAL ] IFN: Primary data saved (18475 records). [2025-10-14T19:34:11.145115] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-14T19:34:11.145278] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFN took 34.4s. Estimated remaining: 2h 59m 56s. Rate: 7.1 symbols/min [2025-10-14T19:34:11.161983] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-14T19:34:11.227242] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T19:34:11.383061] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:11.385684] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T19:34:11.401950] [DEBUG] [LOCAL ] IGI: Loaded 3896 existing records from primary storage. [2025-10-14T19:34:11.402171] [INFO ] [MAIN ] IGI: Loaded 3896 existing records. [2025-10-14T19:34:11.587035] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:11.587267] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-14T19:34:11.587321] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-14T19:34:11.587673] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-14T19:34:11.587743] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-14T19:34:11.958183] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-14T19:34:11.958107] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:12.364584] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T19:34:12.736219] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T19:34:12.758032] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-14T19:34:13.503036] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T19:34:13.558050] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-14T19:34:14.358043] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-14T19:34:14.490094] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T19:34:15.158043] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-14T19:34:15.817613] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:34:15.823310] [INFO ] [REMOTE ] IFF: Full fetch complete (73435 records). [2025-10-14T19:34:15.823438] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-14T19:34:15.971440] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-14T19:34:16.224455] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-14T19:34:16.224530] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-14T19:34:16.225523] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-14T19:34:16.225584] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-14T19:34:16.226961] [DEBUG] [LOCAL ] IFF: Trimmed 73435 records to 51103 (keeping 200 days of data) [2025-10-14T19:34:16.545477] [DEBUG] [LOCAL ] IFF: Primary data saved (51103 records). [2025-10-14T19:34:16.545740] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-14T19:34:16.545843] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IFF took 40.7s. Estimated remaining: 2h 59m 44s. Rate: 7.1 symbols/min [2025-10-14T19:34:16.687120] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T19:34:16.739730] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:16.758062] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-14T19:34:16.768466] [DEBUG] [LOCAL ] IGR: Loaded 30339 existing records from primary storage. [2025-10-14T19:34:16.768695] [INFO ] [MAIN ] IGR: Loaded 30339 existing records. [2025-10-14T19:34:16.906126] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T19:34:16.956387] [INFO ] [REMOTE ] IGA: Full fetch complete (14118 records). [2025-10-14T19:34:16.961317] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:16.961540] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-14T19:34:16.961621] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-14T19:34:16.961727] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-14T19:34:16.993371] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-14T19:34:17.025546] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-14T19:34:17.592202] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-14T19:34:17.658215] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-14T19:34:17.669449] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-14T19:34:17.692821] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-14T19:34:17.698609] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-14T19:34:17.730460] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:17.745735] [DEBUG] [LOCAL ] IGA: Trimmed 14118 records to 10185 (keeping 200 days of data) [2025-10-14T19:34:17.747012] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T19:34:17.814516] [DEBUG] [LOCAL ] IGA: Primary data saved (10185 records). [2025-10-14T19:34:17.814700] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-14T19:34:17.814798] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGA took 33.6s. Estimated remaining: 2h 59m 27s. Rate: 7.1 symbols/min [2025-10-14T19:34:17.982959] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:17.987110] [DEBUG] [LOCAL ] IH: Loaded 2809 existing records from primary storage. [2025-10-14T19:34:17.987284] [INFO ] [MAIN ] IH: Loaded 2809 existing records. [2025-10-14T19:34:18.162297] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:18.162451] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-14T19:34:18.162497] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-14T19:34:18.162692] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-14T19:34:18.162765] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-14T19:34:18.368974] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-14T19:34:18.526936] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:18.540983] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T19:34:19.158066] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-14T19:34:19.298181] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T19:34:19.958062] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-14T19:34:20.509447] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T19:34:20.758049] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-14T19:34:20.840245] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T19:34:21.558020] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-14T19:34:21.730997] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T19:34:21.990938] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T19:34:22.358107] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-14T19:34:23.134225] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T19:34:23.158023] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-14T19:34:23.885604] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T19:34:23.958063] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-14T19:34:24.470471] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-14T19:34:24.758076] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-14T19:34:25.230863] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T19:34:25.558063] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-14T19:34:26.358052] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-14T19:34:26.597368] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T19:34:26.639946] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-14T19:34:27.158101] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-14T19:34:27.958100] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-14T19:34:28.185760] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T19:34:28.317297] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-14T19:34:28.758127] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-14T19:34:29.178754] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T19:34:29.558104] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-14T19:34:30.358074] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-14T19:34:30.617235] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T19:34:31.036322] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-14T19:34:31.158056] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-14T19:34:31.634728] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-14T19:34:31.958091] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-14T19:34:32.758155] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-14T19:34:33.328264] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T19:34:33.558116] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-14T19:34:33.774246] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T19:34:34.358032] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-14T19:34:34.446282] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T19:34:34.786871] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T19:34:35.158087] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-14T19:34:35.958045] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-14T19:34:36.148054] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T19:34:36.655996] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T19:34:36.758255] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-14T19:34:37.558086] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-14T19:34:37.813862] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:34:37.816934] [INFO ] [REMOTE ] IGD: Full fetch complete (30082 records). [2025-10-14T19:34:37.817011] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-14T19:34:38.144581] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T19:34:38.213150] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-14T19:34:38.213232] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-14T19:34:38.214023] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-14T19:34:38.214092] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-14T19:34:38.214865] [DEBUG] [LOCAL ] IGD: Trimmed 30082 records to 19411 (keeping 200 days of data) [2025-10-14T19:34:38.330025] [DEBUG] [LOCAL ] IGD: Primary data saved (19411 records). [2025-10-14T19:34:38.330182] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-14T19:34:38.330315] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 28.7s. Estimated remaining: 2h 59m 32s. Rate: 7.1 symbols/min [2025-10-14T19:34:38.363179] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-14T19:34:38.511828] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:38.519736] [DEBUG] [LOCAL ] IHD: Loaded 7224 existing records from primary storage. [2025-10-14T19:34:38.519909] [INFO ] [MAIN ] IHD: Loaded 7224 existing records. [2025-10-14T19:34:38.697394] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:38.697617] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-14T19:34:38.697697] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-14T19:34:38.698018] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-14T19:34:38.698077] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-14T19:34:38.951350] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T19:34:39.070561] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:39.158060] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-14T19:34:39.618023] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T19:34:39.958077] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-14T19:34:40.758073] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-14T19:34:41.215205] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T19:34:41.558043] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-14T19:34:41.713836] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T19:34:41.968544] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T19:34:41.969432] [INFO ] [REMOTE ] IH: Full fetch complete (5014 records). [2025-10-14T19:34:41.969500] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-14T19:34:42.346695] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-14T19:34:42.346834] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-14T19:34:42.347010] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-14T19:34:42.347054] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-14T19:34:42.347572] [DEBUG] [LOCAL ] IH: Trimmed 5014 records to 2794 (keeping 200 days of data) [2025-10-14T19:34:42.360109] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-14T19:34:42.366695] [DEBUG] [LOCAL ] IH: Primary data saved (2794 records). [2025-10-14T19:34:42.366994] [INFO ] [MAIN ] IH: Full history saved. [2025-10-14T19:34:42.367106] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IH took 24.6s. Estimated remaining: 2h 59m 19s. Rate: 7.1 symbols/min [2025-10-14T19:34:42.537723] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:42.560685] [DEBUG] [LOCAL ] IHG: Loaded 24225 existing records from primary storage. [2025-10-14T19:34:42.560999] [INFO ] [MAIN ] IHG: Loaded 24225 existing records. [2025-10-14T19:34:42.741244] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:42.741463] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-14T19:34:42.741511] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-14T19:34:42.742036] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-14T19:34:42.742095] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-14T19:34:43.045616] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T19:34:43.127419] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:43.158030] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-14T19:34:43.958191] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-14T19:34:44.378253] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T19:34:44.579353] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T19:34:44.758155] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-14T19:34:45.558061] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-14T19:34:45.590177] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T19:34:46.358082] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-14T19:34:46.497995] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T19:34:46.914811] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T19:34:47.158097] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-14T19:34:47.894840] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T19:34:47.896447] [INFO ] [REMOTE ] IGI: Full fetch complete (5433 records). [2025-10-14T19:34:47.896568] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-14T19:34:47.963242] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-14T19:34:48.282731] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-14T19:34:48.282862] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-14T19:34:48.283135] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-14T19:34:48.283179] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-14T19:34:48.283611] [DEBUG] [LOCAL ] IGI: Trimmed 5433 records to 3934 (keeping 200 days of data) [2025-10-14T19:34:48.307624] [DEBUG] [LOCAL ] IGI: Primary data saved (3934 records). [2025-10-14T19:34:48.307790] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-14T19:34:48.307895] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IGI took 37.2s. Estimated remaining: 2h 59m 8s. Rate: 7.1 symbols/min [2025-10-14T19:34:48.477261] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:34:48.510705] [DEBUG] [LOCAL ] IHS: Loaded 37878 existing records from primary storage. [2025-10-14T19:34:48.510975] [INFO ] [MAIN ] IHS: Loaded 37878 existing records. [2025-10-14T19:34:48.687744] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:34:48.687972] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-14T19:34:48.688019] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-14T19:34:48.688833] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-14T19:34:48.688891] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-14T19:34:48.766288] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-14T19:34:49.058795] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:34:49.315297] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T19:34:49.528593] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T19:34:49.558022] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-14T19:34:50.273846] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T19:34:50.358056] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-14T19:34:51.029446] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T19:34:51.158044] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-14T19:34:51.958066] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-14T19:34:52.557907] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:34:52.758065] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-14T19:34:53.252795] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T19:34:53.547118] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T19:34:53.558026] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-14T19:34:54.358122] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-14T19:34:54.781343] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T19:34:55.139733] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T19:34:55.158032] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-14T19:34:55.958110] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-14T19:34:56.633099] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T19:34:56.758075] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-14T19:34:57.148631] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T19:34:57.558118] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-14T19:34:58.079445] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T19:34:58.358086] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-14T19:34:58.991185] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T19:34:59.158088] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-14T19:34:59.818788] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T19:34:59.946113] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T19:34:59.958031] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-14T19:35:00.735285] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T19:35:00.758045] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-14T19:35:01.558098] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-14T19:35:01.571041] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T19:35:02.358090] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-14T19:35:03.035390] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T19:35:03.158101] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-14T19:35:03.508305] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T19:35:03.958130] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-14T19:35:04.381561] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T19:35:04.758068] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-14T19:35:05.176018] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T19:35:05.252251] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T19:35:05.558094] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-14T19:35:06.358080] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-14T19:35:06.856074] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T19:35:07.158058] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-14T19:35:07.349027] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T19:35:07.892791] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T19:35:07.958070] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-14T19:35:08.704673] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T19:35:08.706828] [INFO ] [REMOTE ] IHD: Full fetch complete (11948 records). [2025-10-14T19:35:08.706910] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-14T19:35:08.763257] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-14T19:35:09.109020] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-14T19:35:09.109106] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-14T19:35:09.109443] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-14T19:35:09.109484] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-14T19:35:09.109965] [DEBUG] [LOCAL ] IHD: Trimmed 11948 records to 7305 (keeping 200 days of data) [2025-10-14T19:35:09.153000] [DEBUG] [LOCAL ] IHD: Primary data saved (7305 records). [2025-10-14T19:35:09.153152] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-14T19:35:09.153235] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IHD took 30.8s. Estimated remaining: 2h 59m 13s. Rate: 7.1 symbols/min [2025-10-14T19:35:09.321465] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:09.327890] [DEBUG] [LOCAL ] IIF: Loaded 5598 existing records from primary storage. [2025-10-14T19:35:09.328055] [INFO ] [MAIN ] IIF: Loaded 5598 existing records. [2025-10-14T19:35:09.503129] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:09.503302] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-14T19:35:09.503350] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-14T19:35:09.503590] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-14T19:35:09.503674] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-14T19:35:09.566526] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-14T19:35:09.858143] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:09.954704] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T19:35:09.958011] [INFO ] [REMOTE ] IGR: Full fetch complete (45007 records). [2025-10-14T19:35:09.958088] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-14T19:35:10.327055] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-14T19:35:10.327128] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-14T19:35:10.327840] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-14T19:35:10.327899] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-14T19:35:10.328757] [DEBUG] [LOCAL ] IGR: Trimmed 45007 records to 30377 (keeping 200 days of data) [2025-10-14T19:35:10.375114] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-14T19:35:10.501620] [DEBUG] [LOCAL ] IGR: Primary data saved (30377 records). [2025-10-14T19:35:10.501770] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-14T19:35:10.501848] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IGR took 54.0s. Estimated remaining: 2h 58m 57s. Rate: 7.1 symbols/min [2025-10-14T19:35:10.674243] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:10.691884] [DEBUG] [LOCAL ] IIIN: Loaded 15957 existing records from primary storage. [2025-10-14T19:35:10.692197] [INFO ] [MAIN ] IIIN: Loaded 15957 existing records. [2025-10-14T19:35:10.872106] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:10.872372] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-14T19:35:10.872439] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-14T19:35:10.888894] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-14T19:35:10.889047] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-14T19:35:10.959908] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T19:35:11.163416] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-14T19:35:11.251990] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:11.841519] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:35:11.958075] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-14T19:35:12.433963] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T19:35:12.437473] [INFO ] [REMOTE ] IHS: Full fetch complete (51530 records). [2025-10-14T19:35:12.437551] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-14T19:35:12.763270] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-14T19:35:12.810000] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-14T19:35:12.810069] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-14T19:35:12.810914] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-14T19:35:12.810973] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-14T19:35:12.812000] [DEBUG] [LOCAL ] IHS: Trimmed 51530 records to 37773 (keeping 200 days of data) [2025-10-14T19:35:13.020695] [DEBUG] [LOCAL ] IHS: Primary data saved (37773 records). [2025-10-14T19:35:13.021050] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-14T19:35:13.021137] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHS took 24.7s. Estimated remaining: 2h 58m 41s. Rate: 7.1 symbols/min [2025-10-14T19:35:13.188795] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:13.206170] [DEBUG] [LOCAL ] IIM: Loaded 15729 existing records from primary storage. [2025-10-14T19:35:13.206412] [INFO ] [MAIN ] IIM: Loaded 15729 existing records. [2025-10-14T19:35:13.386076] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T19:35:13.405524] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:13.412287] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-14T19:35:13.412353] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-14T19:35:13.412910] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-14T19:35:13.412969] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-14T19:35:13.559829] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-14T19:35:13.767934] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:13.782562] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T19:35:14.280816] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T19:35:14.358081] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-14T19:35:15.158096] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-14T19:35:15.507200] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T19:35:15.958064] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-14T19:35:16.448578] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T19:35:16.718459] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T19:35:16.758065] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-14T19:35:17.558057] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-14T19:35:17.711401] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T19:35:18.358090] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-14T19:35:18.780033] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T19:35:19.077246] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T19:35:19.158071] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-14T19:35:19.958084] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-14T19:35:20.239277] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T19:35:20.758089] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-14T19:35:21.005627] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T19:35:21.558096] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-14T19:35:22.010971] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T19:35:22.358071] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-14T19:35:22.589421] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:35:23.084693] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T19:35:23.158069] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-14T19:35:23.958048] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-14T19:35:24.119592] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T19:35:24.758087] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-14T19:35:25.040565] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T19:35:25.043310] [INFO ] [REMOTE ] IHG: Full fetch complete (33876 records). [2025-10-14T19:35:25.043425] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-14T19:35:25.438940] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-14T19:35:25.439025] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-14T19:35:25.439888] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-14T19:35:25.439951] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-14T19:35:25.441018] [DEBUG] [LOCAL ] IHG: Trimmed 33876 records to 24262 (keeping 200 days of data) [2025-10-14T19:35:25.560743] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-14T19:35:25.594780] [DEBUG] [LOCAL ] IHG: Primary data saved (24262 records). [2025-10-14T19:35:25.594891] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-14T19:35:25.594967] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IHG took 43.2s. Estimated remaining: 2h 58m 38s. Rate: 7.1 symbols/min [2025-10-14T19:35:25.786991] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:25.801125] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T19:35:25.833774] [DEBUG] [LOCAL ] IIPR: Loaded 29422 existing records from primary storage. [2025-10-14T19:35:25.834065] [INFO ] [MAIN ] IIPR: Loaded 29422 existing records. [2025-10-14T19:35:26.016005] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:26.016212] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-14T19:35:26.016259] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-14T19:35:26.016472] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-14T19:35:26.016527] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-14T19:35:26.286436] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T19:35:26.367089] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-14T19:35:26.388065] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:27.158035] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-14T19:35:27.550578] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T19:35:27.930748] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T19:35:27.958073] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-14T19:35:28.558933] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T19:35:28.758092] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-14T19:35:29.558071] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-14T19:35:30.119866] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T19:35:30.228293] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T19:35:30.358117] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-14T19:35:31.158061] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-14T19:35:31.323633] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T19:35:31.958120] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-14T19:35:32.758068] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-14T19:35:32.782598] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T19:35:32.977889] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T19:35:33.399910] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T19:35:33.558070] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-14T19:35:34.182779] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T19:35:34.358083] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-14T19:35:34.954195] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T19:35:35.158059] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-14T19:35:35.958089] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-14T19:35:36.164543] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T19:35:36.503736] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T19:35:36.504601] [INFO ] [REMOTE ] IIF: Full fetch complete (9030 records). [2025-10-14T19:35:36.504690] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-14T19:35:36.763156] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-14T19:35:36.875398] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-14T19:35:36.875468] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-14T19:35:36.875712] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-14T19:35:36.875772] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-14T19:35:36.876154] [DEBUG] [LOCAL ] IIF: Trimmed 9030 records to 5596 (keeping 200 days of data) [2025-10-14T19:35:36.908216] [DEBUG] [LOCAL ] IIF: Primary data saved (5596 records). [2025-10-14T19:35:36.908294] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-14T19:35:36.908372] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IIF took 27.8s. Estimated remaining: 2h 58m 32s. Rate: 7.1 symbols/min [2025-10-14T19:35:37.075565] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:37.112137] [DEBUG] [LOCAL ] IMAX: Loaded 43065 existing records from primary storage. [2025-10-14T19:35:37.112411] [INFO ] [MAIN ] IMAX: Loaded 43065 existing records. [2025-10-14T19:35:37.288463] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:37.288666] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-14T19:35:37.288726] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-14T19:35:37.289403] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-14T19:35:37.289461] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-14T19:35:37.568107] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-14T19:35:37.649412] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:38.011296] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T19:35:38.358073] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-14T19:35:38.488888] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T19:35:39.158072] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-14T19:35:39.297585] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T19:35:39.958044] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-14T19:35:40.610598] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T19:35:40.646276] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T19:35:40.758083] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-14T19:35:41.558126] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-14T19:35:42.252305] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:35:42.358035] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-14T19:35:42.483911] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T19:35:43.158045] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-14T19:35:43.546916] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T19:35:43.958038] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-14T19:35:44.092511] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T19:35:44.758091] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-14T19:35:45.141623] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T19:35:45.548278] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T19:35:45.558016] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-14T19:35:46.358058] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-14T19:35:46.450711] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T19:35:46.452524] [INFO ] [REMOTE ] IIIN: Full fetch complete (24536 records). [2025-10-14T19:35:46.452591] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-14T19:35:46.821482] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-14T19:35:46.821556] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-14T19:35:46.822081] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-14T19:35:46.822141] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-14T19:35:46.822794] [DEBUG] [LOCAL ] IIIN: Trimmed 24536 records to 15969 (keeping 200 days of data) [2025-10-14T19:35:46.918119] [DEBUG] [LOCAL ] IIIN: Primary data saved (15969 records). [2025-10-14T19:35:46.918247] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-14T19:35:46.918377] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIIN took 36.4s. Estimated remaining: 2h 58m 26s. Rate: 7.1 symbols/min [2025-10-14T19:35:47.085987] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:47.130903] [DEBUG] [LOCAL ] INFA: Loaded 49157 existing records from primary storage. [2025-10-14T19:35:47.131220] [INFO ] [MAIN ] INFA: Loaded 49157 existing records. [2025-10-14T19:35:47.163194] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-14T19:35:47.325108] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:47.325326] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-14T19:35:47.325388] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-14T19:35:47.325854] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-14T19:35:47.325913] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-14T19:35:47.720041] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:47.763763] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T19:35:47.958093] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-14T19:35:48.629404] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T19:35:48.758037] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-14T19:35:48.977860] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T19:35:49.558061] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-14T19:35:50.335537] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T19:35:50.358029] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-14T19:35:51.158078] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-14T19:35:51.326416] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T19:35:51.793449] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T19:35:51.817805] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T19:35:51.958064] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-14T19:35:52.758075] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-14T19:35:53.431433] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T19:35:53.558064] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-14T19:35:54.080630] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T19:35:54.358079] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-14T19:35:55.119912] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T19:35:55.122787] [INFO ] [REMOTE ] IIM: Full fetch complete (25263 records). [2025-10-14T19:35:55.122899] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-14T19:35:55.163184] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-14T19:35:55.259741] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:35:55.557659] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-14T19:35:55.557771] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-14T19:35:55.558370] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-14T19:35:55.558432] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-14T19:35:55.559208] [DEBUG] [LOCAL ] IIM: Trimmed 25263 records to 15708 (keeping 200 days of data) [2025-10-14T19:35:55.655737] [DEBUG] [LOCAL ] IIM: Primary data saved (15708 records). [2025-10-14T19:35:55.655864] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-14T19:35:55.655940] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIM took 42.6s. Estimated remaining: 2h 58m 18s. Rate: 7.1 symbols/min [2025-10-14T19:35:55.836393] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:55.886376] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-14T19:35:55.886771] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-14T19:35:55.968039] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-14T19:35:56.075847] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:56.076032] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-14T19:35:56.076079] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-14T19:35:56.077008] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-14T19:35:56.077065] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-14T19:35:56.445746] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:56.677256] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T19:35:56.758027] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-14T19:35:57.364779] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T19:35:57.368518] [INFO ] [REMOTE ] IIPR: Full fetch complete (44362 records). [2025-10-14T19:35:57.368614] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-14T19:35:57.567725] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-14T19:35:57.769842] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-14T19:35:57.769926] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-14T19:35:57.770837] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-14T19:35:57.770899] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-14T19:35:57.771967] [DEBUG] [LOCAL ] IIPR: Trimmed 44362 records to 29452 (keeping 200 days of data) [2025-10-14T19:35:57.970209] [DEBUG] [LOCAL ] IIPR: Primary data saved (29452 records). [2025-10-14T19:35:57.970334] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-14T19:35:57.970411] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IIPR took 32.4s. Estimated remaining: 2h 58m 2s. Rate: 7.1 symbols/min [2025-10-14T19:35:58.144509] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:35:58.191602] [DEBUG] [LOCAL ] ING: Loaded 50726 existing records from primary storage. [2025-10-14T19:35:58.191963] [INFO ] [MAIN ] ING: Loaded 50726 existing records. [2025-10-14T19:35:58.396308] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:35:58.391750] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-14T19:35:58.396718] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-14T19:35:58.398246] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-14T19:35:58.403327] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-14T19:35:58.403193] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T19:35:58.403559] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-14T19:35:58.763936] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:35:59.158070] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-14T19:35:59.360691] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T19:35:59.958079] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-14T19:36:00.128821] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T19:36:00.697634] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T19:36:00.758130] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-14T19:36:01.558089] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-14T19:36:01.906351] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-14T19:36:02.267780] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T19:36:02.358092] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-14T19:36:02.866407] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T19:36:03.158103] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-14T19:36:03.958059] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-14T19:36:04.104731] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T19:36:04.652789] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:36:04.758061] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-14T19:36:05.558044] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-14T19:36:05.645393] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T19:36:06.358042] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-14T19:36:06.517233] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T19:36:06.862291] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T19:36:07.158051] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-14T19:36:07.932459] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T19:36:07.958026] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-14T19:36:08.758107] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-14T19:36:08.927398] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T19:36:09.564206] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-14T19:36:09.580078] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T19:36:10.358053] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-14T19:36:10.392069] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T19:36:11.158083] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-14T19:36:11.383962] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T19:36:11.720572] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T19:36:11.958079] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-14T19:36:12.267397] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T19:36:12.758134] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-14T19:36:13.446911] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T19:36:13.558031] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-14T19:36:14.331688] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T19:36:14.358079] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-14T19:36:15.118092] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T19:36:15.158078] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-14T19:36:15.947000] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T19:36:15.952145] [INFO ] [REMOTE ] IMAX: Full fetch complete (60500 records). [2025-10-14T19:36:15.952243] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-14T19:36:15.963991] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-14T19:36:16.354992] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-14T19:36:16.355111] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-14T19:36:16.356141] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-14T19:36:16.356253] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-14T19:36:16.357905] [DEBUG] [LOCAL ] IMAX: Trimmed 60500 records to 43182 (keeping 200 days of data) [2025-10-14T19:36:16.613394] [DEBUG] [LOCAL ] IMAX: Primary data saved (43182 records). [2025-10-14T19:36:16.613512] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-14T19:36:16.613587] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. IMAX took 39.7s. Estimated remaining: 2h 58m 5s. Rate: 7.1 symbols/min [2025-10-14T19:36:16.731525] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T19:36:16.763017] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-14T19:36:16.810468] [INFO ] [REMOTE ] INFA: Full fetch complete (70901 records). [2025-10-14T19:36:16.810360] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:16.811357] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-14T19:36:17.115958] [DEBUG] [LOCAL ] INGM: Loaded 28621 existing records from primary storage. [2025-10-14T19:36:17.126572] [INFO ] [MAIN ] INGM: Loaded 28621 existing records. [2025-10-14T19:36:17.428279] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-14T19:36:17.454881] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-14T19:36:17.460777] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:36:17.462101] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-14T19:36:17.462407] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-14T19:36:17.462355] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-14T19:36:17.462543] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-14T19:36:17.463433] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-14T19:36:17.463542] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-14T19:36:17.550923] [DEBUG] [LOCAL ] INFA: Trimmed 70901 records to 49048 (keeping 200 days of data) [2025-10-14T19:36:17.995599] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:17.996626] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-14T19:36:18.035595] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T19:36:18.243254] [DEBUG] [LOCAL ] INFA: Primary data saved (49048 records). [2025-10-14T19:36:18.243459] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-14T19:36:18.243742] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFA took 31.3s. Estimated remaining: 2h 57m 49s. Rate: 7.1 symbols/min [2025-10-14T19:36:18.374097] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-14T19:36:18.473473] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T19:36:18.476506] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:18.533373] [DEBUG] [LOCAL ] INGR: Loaded 33810 existing records from primary storage. [2025-10-14T19:36:18.533744] [INFO ] [MAIN ] INGR: Loaded 33810 existing records. [2025-10-14T19:36:18.727956] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:36:18.728169] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-14T19:36:18.728218] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-14T19:36:18.728572] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-14T19:36:18.728612] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-14T19:36:19.091222] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:19.158038] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-14T19:36:19.321223] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T19:36:19.958093] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-14T19:36:20.378265] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T19:36:20.758117] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-14T19:36:20.892923] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T19:36:20.896366] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T19:36:21.558074] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-14T19:36:21.751020] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T19:36:22.358118] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-14T19:36:23.158122] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-14T19:36:23.386221] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T19:36:23.753353] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T19:36:23.958131] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-14T19:36:24.758159] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-14T19:36:24.827416] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T19:36:25.046223] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T19:36:25.558115] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-14T19:36:26.274569] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T19:36:26.358073] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-14T19:36:27.065095] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T19:36:27.158065] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-14T19:36:27.893990] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T19:36:27.958079] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-14T19:36:28.497514] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T19:36:28.758089] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-14T19:36:29.431791] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T19:36:29.558068] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-14T19:36:29.741742] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T19:36:30.358077] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-14T19:36:30.599086] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T19:36:31.158101] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-14T19:36:31.490809] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T19:36:31.958088] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-14T19:36:32.460581] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T19:36:32.758114] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-14T19:36:33.271582] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T19:36:33.558073] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-14T19:36:34.358078] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-14T19:36:34.733520] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T19:36:34.762862] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T19:36:35.158102] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-14T19:36:35.958071] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-14T19:36:36.144063] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T19:36:36.445584] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T19:36:36.758075] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-14T19:36:37.501291] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T19:36:37.558034] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-14T19:36:37.728120] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T19:36:38.358075] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-14T19:36:39.158082] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-14T19:36:39.321214] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T19:36:39.677161] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T19:36:39.958114] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-14T19:36:40.258973] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T19:36:40.758106] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-14T19:36:41.558124] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-14T19:36:41.638141] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:36:41.894960] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T19:36:41.898798] [INFO ] [REMOTE ] INGM: Full fetch complete (42094 records). [2025-10-14T19:36:41.898946] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-14T19:36:42.289463] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-14T19:36:42.289559] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-14T19:36:42.290602] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-14T19:36:42.290689] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-14T19:36:42.291904] [DEBUG] [LOCAL ] INGM: Trimmed 42094 records to 28445 (keeping 200 days of data) [2025-10-14T19:36:42.383561] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-14T19:36:42.480291] [DEBUG] [LOCAL ] INGM: Primary data saved (28445 records). [2025-10-14T19:36:42.480498] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-14T19:36:42.480614] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INGM took 25.9s. Estimated remaining: 2h 57m 59s. Rate: 7.1 symbols/min [2025-10-14T19:36:42.682995] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:42.726360] [DEBUG] [LOCAL ] INN: Loaded 41803 existing records from primary storage. [2025-10-14T19:36:42.726838] [INFO ] [MAIN ] INN: Loaded 41803 existing records. [2025-10-14T19:36:42.913375] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:36:42.913707] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-14T19:36:42.913769] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-14T19:36:42.914107] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-14T19:36:42.914169] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-14T19:36:43.158559] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-14T19:36:43.327700] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:43.331400] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-14T19:36:43.338434] [INFO ] [REMOTE ] INFY: Full fetch complete (77725 records). [2025-10-14T19:36:43.338728] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-14T19:36:43.767610] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-14T19:36:43.767832] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-14T19:36:43.769719] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-14T19:36:43.769846] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-14T19:36:43.772134] [DEBUG] [LOCAL ] INFY: Trimmed 77725 records to 53596 (keeping 200 days of data) [2025-10-14T19:36:43.886232] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T19:36:43.896395] [INFO ] [REMOTE ] ING: Full fetch complete (73777 records). [2025-10-14T19:36:43.897229] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-14T19:36:43.958750] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-14T19:36:44.334739] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-14T19:36:44.336935] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-14T19:36:44.338153] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-14T19:36:44.338242] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-14T19:36:44.344473] [DEBUG] [LOCAL ] ING: Trimmed 73777 records to 50723 (keeping 200 days of data) [2025-10-14T19:36:44.777898] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-14T19:36:44.778520] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-14T19:36:44.792076] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INFY took 49.1s. Estimated remaining: 2h 57m 43s. Rate: 7.1 symbols/min [2025-10-14T19:36:44.815314] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T19:36:44.898313] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-14T19:36:45.016492] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:45.018225] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-14T19:36:45.018595] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-14T19:36:45.021030] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-14T19:36:45.021852] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-14T19:36:45.024421] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-14T19:36:45.024495] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-14T19:36:45.453561] [DEBUG] [LOCAL ] ING: Primary data saved (50723 records). [2025-10-14T19:36:45.450684] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:45.453928] [INFO ] [MAIN ] ING: Full history saved. [2025-10-14T19:36:45.454020] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. ING took 47.5s. Estimated remaining: 2h 57m 26s. Rate: 7.1 symbols/min [2025-10-14T19:36:45.566526] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-14T19:36:45.647103] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:45.683194] [DEBUG] [LOCAL ] INSP: Loaded 38084 existing records from primary storage. [2025-10-14T19:36:45.683491] [INFO ] [MAIN ] INSP: Loaded 38084 existing records. [2025-10-14T19:36:45.825203] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:36:45.844323] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-14T19:36:45.863279] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:36:45.863507] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-14T19:36:45.867504] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:36:45.867789] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-14T19:36:45.867881] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-14T19:36:45.868024] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:36:45.868352] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-14T19:36:45.868602] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-14T19:36:45.868268] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-14T19:36:45.933154] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-14T19:36:45.996562] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-14T19:36:46.001238] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-14T19:36:46.001445] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INR took 1.2s. Estimated remaining: 2h 57m 8s. Rate: 7.1 symbols/min [2025-10-14T19:36:46.001157] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T19:36:46.364921] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-14T19:36:46.378905] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:46.478406] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:46.492324] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T19:36:46.497324] [INFO ] [REMOTE ] INGR: Full fetch complete (50605 records). [2025-10-14T19:36:46.497409] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-14T19:36:46.690867] [DEBUG] [LOCAL ] INSW: Loaded 39735 existing records from primary storage. [2025-10-14T19:36:46.726108] [INFO ] [MAIN ] INSW: Loaded 39735 existing records. [2025-10-14T19:36:47.099180] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:36:47.118263] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-14T19:36:47.118401] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-14T19:36:47.118535] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-14T19:36:47.118628] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-14T19:36:47.119950] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-14T19:36:47.120124] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-14T19:36:47.120017] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-14T19:36:47.120271] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-14T19:36:47.170282] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-14T19:36:47.193285] [DEBUG] [LOCAL ] INGR: Trimmed 50605 records to 33861 (keeping 200 days of data) [2025-10-14T19:36:47.617406] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:47.667900] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T19:36:47.772256] [DEBUG] [LOCAL ] INGR: Primary data saved (33861 records). [2025-10-14T19:36:47.772425] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-14T19:36:47.772546] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INGR took 29.5s. Estimated remaining: 2h 56m 52s. Rate: 7.1 symbols/min [2025-10-14T19:36:47.968030] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-14T19:36:47.970609] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:36:48.018858] [DEBUG] [LOCAL ] INVH: Loaded 53181 existing records from primary storage. [2025-10-14T19:36:48.019154] [INFO ] [MAIN ] INVH: Loaded 53181 existing records. [2025-10-14T19:36:48.200092] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:36:48.200510] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-14T19:36:48.200708] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-14T19:36:48.201225] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-14T19:36:48.201416] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-14T19:36:48.350337] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T19:36:48.591949] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:36:48.758080] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-14T19:36:49.284018] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T19:36:49.558105] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-14T19:36:50.358058] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-14T19:36:50.518405] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T19:36:50.650352] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:36:51.158088] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-14T19:36:51.856219] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T19:36:51.958032] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-14T19:36:52.758056] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-14T19:36:52.835326] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T19:36:53.492427] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T19:36:53.558099] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-14T19:36:54.160194] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T19:36:54.358119] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-14T19:36:55.104754] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T19:36:55.158098] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-14T19:36:55.928429] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:36:55.958041] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-14T19:36:56.758091] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-14T19:36:56.959312] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T19:36:57.430362] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T19:36:57.558077] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-14T19:36:58.358058] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-14T19:36:58.455559] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:36:59.096093] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T19:36:59.158107] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-14T19:36:59.958050] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-14T19:37:00.119011] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T19:37:00.769358] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-14T19:37:00.773411] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T19:37:01.535424] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:37:01.558042] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-14T19:37:02.358052] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-14T19:37:02.457961] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T19:37:03.041157] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T19:37:03.158066] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-14T19:37:03.900589] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T19:37:03.958075] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-14T19:37:04.569759] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T19:37:04.758079] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-14T19:37:05.450894] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:37:05.558120] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-14T19:37:06.110810] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T19:37:06.358108] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-14T19:37:07.115046] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:37:07.158036] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-14T19:37:07.762960] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T19:37:07.958087] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-14T19:37:08.234166] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T19:37:08.758074] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-14T19:37:09.488705] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T19:37:09.558024] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-14T19:37:10.358077] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-14T19:37:10.514197] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T19:37:10.984027] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:37:11.158113] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-14T19:37:11.958067] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-14T19:37:12.037147] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T19:37:12.758085] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-14T19:37:12.955860] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T19:37:12.990294] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T19:37:13.558042] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-14T19:37:14.358040] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-14T19:37:14.426626] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T19:37:14.995192] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T19:37:15.158035] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-14T19:37:15.604495] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T19:37:15.609178] [INFO ] [REMOTE ] INN: Full fetch complete (57773 records). [2025-10-14T19:37:15.609304] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-14T19:37:15.964613] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-14T19:37:15.999267] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-14T19:37:15.999346] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-14T19:37:16.000257] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-14T19:37:16.000320] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-14T19:37:16.001869] [DEBUG] [LOCAL ] INN: Trimmed 57773 records to 41782 (keeping 200 days of data) [2025-10-14T19:37:16.238144] [DEBUG] [LOCAL ] INN: Primary data saved (41782 records). [2025-10-14T19:37:16.238268] [INFO ] [MAIN ] INN: Full history saved. [2025-10-14T19:37:16.238344] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INN took 33.8s. Estimated remaining: 2h 57m 6s. Rate: 7.1 symbols/min [2025-10-14T19:37:16.407181] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:16.435611] [DEBUG] [LOCAL ] INVX: Loaded 29284 existing records from primary storage. [2025-10-14T19:37:16.436053] [INFO ] [MAIN ] INVX: Loaded 29284 existing records. [2025-10-14T19:37:16.622689] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:16.622995] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-14T19:37:16.623098] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-14T19:37:16.631001] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-14T19:37:16.643240] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-14T19:37:16.676918] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T19:37:16.763142] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-14T19:37:17.007383] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:17.558072] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-14T19:37:17.610029] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T19:37:17.615083] [INFO ] [REMOTE ] INSP: Full fetch complete (53540 records). [2025-10-14T19:37:17.615171] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-14T19:37:18.013218] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-14T19:37:18.013302] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-14T19:37:18.014243] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-14T19:37:18.014306] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-14T19:37:18.015869] [DEBUG] [LOCAL ] INSP: Trimmed 53540 records to 38215 (keeping 200 days of data) [2025-10-14T19:37:18.243277] [DEBUG] [LOCAL ] INSP: Primary data saved (38215 records). [2025-10-14T19:37:18.243405] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-14T19:37:18.243479] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSP took 32.8s. Estimated remaining: 2h 56m 51s. Rate: 7.1 symbols/min [2025-10-14T19:37:18.369284] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-14T19:37:18.419009] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:18.441884] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:37:18.503341] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-14T19:37:18.503714] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-14T19:37:18.717906] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:18.718242] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-14T19:37:18.718323] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-14T19:37:18.718853] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-14T19:37:18.718917] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-14T19:37:18.869922] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T19:37:19.163431] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-14T19:37:19.171044] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:19.958080] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-14T19:37:20.110230] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:37:20.594976] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T19:37:20.599563] [INFO ] [REMOTE ] INSW: Full fetch complete (60153 records). [2025-10-14T19:37:20.599702] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-14T19:37:20.763300] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-14T19:37:21.055501] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-14T19:37:21.055582] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-14T19:37:21.056615] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-14T19:37:21.056706] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-14T19:37:21.057966] [DEBUG] [LOCAL ] INSW: Trimmed 60153 records to 39628 (keeping 200 days of data) [2025-10-14T19:37:21.332847] [DEBUG] [LOCAL ] INSW: Primary data saved (39628 records). [2025-10-14T19:37:21.333018] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-14T19:37:21.333144] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INSW took 35.3s. Estimated remaining: 2h 56m 36s. Rate: 7.1 symbols/min [2025-10-14T19:37:21.534472] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:21.565730] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-14T19:37:21.592867] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-14T19:37:21.593286] [INFO ] [MAIN ] IOT: Loaded 53475 existing records. [2025-10-14T19:37:21.771047] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:21.771254] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-14T19:37:21.771301] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-14T19:37:21.771591] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-14T19:37:21.771686] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-14T19:37:22.125591] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:22.358062] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-14T19:37:22.633595] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-14T19:37:22.711586] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T19:37:22.928752] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T19:37:23.158088] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-14T19:37:23.958098] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-14T19:37:24.350676] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T19:37:24.758071] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-14T19:37:25.260827] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T19:37:25.351252] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-14T19:37:25.558047] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-14T19:37:26.358066] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-14T19:37:26.567696] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T19:37:27.158068] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-14T19:37:27.958086] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-14T19:37:28.113983] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-14T19:37:28.160089] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T19:37:28.167495] [INFO ] [REMOTE ] INVH: Full fetch complete (76919 records). [2025-10-14T19:37:28.184449] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-14T19:37:28.187063] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:37:28.606843] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-14T19:37:28.606957] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-14T19:37:28.608548] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-14T19:37:28.608617] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-14T19:37:28.610633] [DEBUG] [LOCAL ] INVH: Trimmed 76919 records to 53185 (keeping 200 days of data) [2025-10-14T19:37:28.804459] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-14T19:37:28.972989] [DEBUG] [LOCAL ] INVH: Primary data saved (53185 records). [2025-10-14T19:37:28.973137] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-14T19:37:28.973248] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVH took 41.2s. Estimated remaining: 2h 56m 27s. Rate: 7.1 symbols/min [2025-10-14T19:37:29.558048] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-14T19:37:29.700599] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T19:37:29.970975] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T19:37:30.358072] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-14T19:37:31.158070] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-14T19:37:32.230385] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T19:37:32.241886] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-14T19:37:32.274835] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-14T19:37:32.308039] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T19:37:32.758107] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-14T19:37:33.558034] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-14T19:37:34.020331] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T19:37:34.022503] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T19:37:34.358140] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-14T19:37:35.158100] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-14T19:37:35.611865] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T19:37:35.958123] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-14T19:37:36.304802] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-14T19:37:36.544828] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:37:36.758092] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-14T19:37:37.083765] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T19:37:37.558078] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-14T19:37:38.358098] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-14T19:37:38.665917] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-14T19:37:39.158083] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-14T19:37:39.471065] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T19:37:39.958159] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-14T19:37:40.228097] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-14T19:37:40.758182] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-14T19:37:41.090638] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T19:37:41.094702] [INFO ] [REMOTE ] INVX: Full fetch complete (43444 records). [2025-10-14T19:37:41.094795] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-14T19:37:41.497517] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-14T19:37:41.588773] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-14T19:37:41.614237] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-14T19:37:41.614347] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-14T19:37:41.615431] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-14T19:37:41.615502] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-14T19:37:41.616910] [DEBUG] [LOCAL ] INVX: Trimmed 43444 records to 29342 (keeping 200 days of data) [2025-10-14T19:37:41.810386] [DEBUG] [LOCAL ] INVX: Primary data saved (29342 records). [2025-10-14T19:37:41.810522] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-14T19:37:41.810602] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. INVX took 25.6s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-14T19:37:43.363268] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-14T19:37:43.375621] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-14T19:37:43.487026] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:37:43.499525] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-14T19:37:45.291302] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T19:37:45.303401] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-14T19:37:45.616853] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-14T19:37:45.630003] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-14T19:37:47.123514] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T19:37:47.129883] [INFO ] [REMOTE ] IOT: Full fetch complete (77548 records). [2025-10-14T19:37:47.130038] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-14T19:37:47.524798] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-14T19:37:47.524906] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-14T19:37:47.526633] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-14T19:37:47.526720] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-14T19:37:47.532535] [DEBUG] [LOCAL ] IOT: Trimmed 77548 records to 53480 (keeping 200 days of data) [2025-10-14T19:37:47.879217] [DEBUG] [LOCAL ] IOT: Primary data saved (53480 records). [2025-10-14T19:37:47.879422] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-14T19:37:47.879524] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IOT took 26.5s. Estimated remaining: 2h 56m 12s. Rate: 7.1 symbols/min [2025-10-14T19:37:48.358026] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-14T19:37:48.371387] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-14T19:37:51.051213] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-14T19:37:51.066932] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-14T19:37:53.795210] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-14T19:37:53.802152] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-14T19:37:53.802300] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-14T19:37:54.226856] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-14T19:37:54.226933] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-14T19:37:54.227959] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-14T19:37:54.228020] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-14T19:37:54.229391] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-14T19:37:54.543776] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-14T19:37:54.543928] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-14T19:37:54.544018] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IONQ took 36.3s. Estimated remaining: 2h 56m 2s. Rate: 7.1 symbols/min [2025-10-14T19:37:55.161148] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:55.223407] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:55.225117] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:55.277950] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:37:55.299572] [DEBUG] [LOCAL ] IPI: Loaded 21272 existing records from primary storage. [2025-10-14T19:37:55.299941] [INFO ] [MAIN ] IPI: Loaded 21272 existing records. [2025-10-14T19:37:55.337850] [DEBUG] [LOCAL ] IQI: Loaded 17869 existing records from primary storage. [2025-10-14T19:37:55.384198] [INFO ] [MAIN ] IQI: Loaded 17869 existing records. [2025-10-14T19:37:55.703497] [DEBUG] [LOCAL ] IP: Loaded 53310 existing records from primary storage. [2025-10-14T19:37:55.706935] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:55.707297] [INFO ] [MAIN ] IP: Loaded 53310 existing records. [2025-10-14T19:37:55.713430] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-14T19:37:55.707985] [DEBUG] [LOCAL ] IPG: Loaded 53329 existing records from primary storage. [2025-10-14T19:37:55.732740] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-14T19:37:55.751571] [INFO ] [MAIN ] IPG: Loaded 53329 existing records. [2025-10-14T19:37:55.792525] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-14T19:37:55.798683] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:55.810303] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-14T19:37:55.935746] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-14T19:37:56.033334] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-14T19:37:56.148227] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-14T19:37:56.185830] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:56.191106] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-14T19:37:56.290280] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-14T19:37:56.296392] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-14T19:37:56.348394] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:37:56.363009] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-14T19:37:56.422472] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-14T19:37:56.463754] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-14T19:37:56.489752] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-14T19:37:56.524912] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-14T19:37:56.580280] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-14T19:37:56.877213] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:56.908219] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-14T19:37:57.480597] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:57.536814] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-14T19:37:57.621966] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:57.646227] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-14T19:37:57.690277] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:37:57.690636] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-14T19:37:57.957376] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T19:37:57.961667] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-14T19:37:58.701329] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T19:37:58.709138] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-14T19:37:58.767601] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T19:37:58.773081] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-14T19:37:59.210367] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T19:37:59.221250] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-14T19:37:59.458021] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T19:37:59.470048] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-14T19:37:59.716868] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T19:37:59.721985] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-14T19:37:59.795012] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T19:37:59.799802] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-14T19:38:00.961230] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T19:38:00.973334] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-14T19:38:00.994299] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T19:38:01.016463] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-14T19:38:01.017072] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T19:38:01.024065] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-14T19:38:01.179933] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T19:38:01.191869] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-14T19:38:01.659009] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T19:38:01.663244] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-14T19:38:02.292468] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T19:38:02.298322] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-14T19:38:02.711258] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T19:38:02.716930] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-14T19:38:02.781675] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T19:38:02.793496] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-14T19:38:02.890152] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T19:38:02.901364] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-14T19:38:03.134895] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T19:38:03.158054] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-14T19:38:03.707726] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T19:38:03.958121] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-14T19:38:04.166189] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T19:38:04.345057] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T19:38:04.613710] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T19:38:04.649132] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T19:38:04.758099] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-14T19:38:05.558096] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-14T19:38:06.358111] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-14T19:38:06.526396] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T19:38:06.628446] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T19:38:07.158102] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-14T19:38:07.958079] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-14T19:38:08.302571] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T19:38:08.549215] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:38:08.758054] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-14T19:38:09.004399] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T19:38:09.558071] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-14T19:38:10.207592] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T19:38:10.263441] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T19:38:10.358113] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-14T19:38:11.158072] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-14T19:38:11.958064] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-14T19:38:12.094280] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T19:38:12.563342] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T19:38:12.758052] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-14T19:38:12.899619] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T19:38:13.558068] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-14T19:38:13.874410] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T19:38:14.358080] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-14T19:38:15.158051] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-14T19:38:15.306292] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T19:38:15.389143] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T19:38:15.958084] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-14T19:38:16.758184] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-14T19:38:16.859003] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T19:38:16.995292] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T19:38:16.997493] [INFO ] [REMOTE ] IQI: Full fetch complete (26560 records). [2025-10-14T19:38:16.997564] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-14T19:38:17.393143] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-14T19:38:17.393232] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-14T19:38:17.393787] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-14T19:38:17.393859] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-14T19:38:17.394716] [DEBUG] [LOCAL ] IQI: Trimmed 26560 records to 17823 (keeping 200 days of data) [2025-10-14T19:38:17.501505] [DEBUG] [LOCAL ] IQI: Primary data saved (17823 records). [2025-10-14T19:38:17.501671] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-14T19:38:17.501778] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 22.9s. Estimated remaining: 2h 56m 9s. Rate: 7.1 symbols/min [2025-10-14T19:38:17.570010] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-14T19:38:17.684217] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:38:17.734242] [DEBUG] [LOCAL ] IQV: Loaded 50121 existing records from primary storage. [2025-10-14T19:38:17.734610] [INFO ] [MAIN ] IQV: Loaded 50121 existing records. [2025-10-14T19:38:17.928782] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:38:17.936883] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-14T19:38:17.936951] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-14T19:38:17.937309] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T19:38:17.940161] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-14T19:38:17.940610] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-14T19:38:17.946043] [INFO ] [REMOTE ] IPI: Full fetch complete (29826 records). [2025-10-14T19:38:17.985067] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-14T19:38:18.359733] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-14T19:38:18.654768] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:38:18.699401] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-14T19:38:18.699475] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-14T19:38:18.700164] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-14T19:38:18.700232] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-14T19:38:18.700924] [DEBUG] [LOCAL ] IPI: Trimmed 29826 records to 21301 (keeping 200 days of data) [2025-10-14T19:38:18.821462] [DEBUG] [LOCAL ] IPI: Primary data saved (21301 records). [2025-10-14T19:38:18.821579] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-14T19:38:18.821675] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPI took 24.3s. Estimated remaining: 2h 55m 53s. Rate: 7.1 symbols/min [2025-10-14T19:38:18.989238] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:38:19.038324] [DEBUG] [LOCAL ] IR: Loaded 52765 existing records from primary storage. [2025-10-14T19:38:19.038618] [INFO ] [MAIN ] IR: Loaded 52765 existing records. [2025-10-14T19:38:19.163281] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-14T19:38:19.226226] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:38:19.226449] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-14T19:38:19.226587] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-14T19:38:19.227134] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-14T19:38:19.227195] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-14T19:38:19.566906] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T19:38:19.628466] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:38:19.958049] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-14T19:38:20.200560] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T19:38:20.758073] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-14T19:38:20.953707] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T19:38:21.558072] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-14T19:38:21.788694] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T19:38:22.358050] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-14T19:38:22.553484] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-14T19:38:22.835465] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T19:38:23.158049] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-14T19:38:23.676231] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T19:38:23.682471] [INFO ] [REMOTE ] IPG: Full fetch complete (77424 records). [2025-10-14T19:38:23.682606] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-14T19:38:23.965698] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-14T19:38:24.073159] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-14T19:38:24.073243] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-14T19:38:24.074311] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-14T19:38:24.074375] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-14T19:38:24.075896] [DEBUG] [LOCAL ] IPG: Trimmed 77424 records to 53331 (keeping 200 days of data) [2025-10-14T19:38:24.407981] [DEBUG] [LOCAL ] IPG: Primary data saved (53331 records). [2025-10-14T19:38:24.408127] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-14T19:38:24.408209] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IPG took 29.9s. Estimated remaining: 2h 55m 41s. Rate: 7.1 symbols/min [2025-10-14T19:38:24.580223] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:38:24.610829] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T19:38:24.660135] [DEBUG] [LOCAL ] IRM: Loaded 49203 existing records from primary storage. [2025-10-14T19:38:24.660428] [INFO ] [MAIN ] IRM: Loaded 49203 existing records. [2025-10-14T19:38:24.759258] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-14T19:38:24.857829] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:38:24.858026] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-14T19:38:24.858072] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-14T19:38:24.858260] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-14T19:38:24.858297] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-14T19:38:25.203038] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:38:25.558040] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-14T19:38:25.785633] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T19:38:25.791521] [INFO ] [REMOTE ] IP: Full fetch complete (77347 records). [2025-10-14T19:38:25.791626] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-14T19:38:26.192072] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-14T19:38:26.192150] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-14T19:38:26.193312] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-14T19:38:26.193376] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-14T19:38:26.194760] [DEBUG] [LOCAL ] IP: Trimmed 77347 records to 53311 (keeping 200 days of data) [2025-10-14T19:38:26.375357] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-14T19:38:26.508346] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T19:38:26.562906] [DEBUG] [LOCAL ] IP: Primary data saved (53311 records). [2025-10-14T19:38:26.563022] [INFO ] [MAIN ] IP: Full history saved. [2025-10-14T19:38:26.563093] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IP took 32.0s. Estimated remaining: 2h 55m 26s. Rate: 7.1 symbols/min [2025-10-14T19:38:26.729776] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:38:26.751887] [DEBUG] [LOCAL ] IRS: Loaded 22924 existing records from primary storage. [2025-10-14T19:38:26.752114] [INFO ] [MAIN ] IRS: Loaded 22924 existing records. [2025-10-14T19:38:26.928006] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:38:26.928222] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-14T19:38:26.928271] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-14T19:38:26.928496] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-14T19:38:26.928560] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-14T19:38:27.168026] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-14T19:38:27.289086] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:38:27.318532] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T19:38:27.958085] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-14T19:38:28.184083] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T19:38:28.758064] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-14T19:38:28.936078] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T19:38:29.114977] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T19:38:29.558083] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-14T19:38:30.358065] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-14T19:38:30.577309] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T19:38:31.164858] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-14T19:38:31.184451] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T19:38:31.958044] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-14T19:38:32.159446] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T19:38:32.260080] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T19:38:32.758123] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-14T19:38:33.492631] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T19:38:33.558058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-14T19:38:34.358058] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-14T19:38:34.564013] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T19:38:35.158040] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-14T19:38:35.324847] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T19:38:35.403315] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T19:38:35.958112] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-14T19:38:36.758062] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-14T19:38:36.859686] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T19:38:37.375400] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T19:38:37.558072] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-14T19:38:37.740738] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T19:38:38.358078] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-14T19:38:39.158082] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-14T19:38:39.316877] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T19:38:39.377154] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T19:38:39.958107] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-14T19:38:40.674017] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T19:38:40.758102] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-14T19:38:40.953555] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T19:38:41.558062] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-14T19:38:42.358049] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-14T19:38:42.600270] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T19:38:42.853066] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T19:38:43.158038] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-14T19:38:43.352933] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T19:38:43.958126] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-14T19:38:44.758165] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-14T19:38:44.793273] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T19:38:45.558044] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-14T19:38:45.721053] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T19:38:45.876069] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T19:38:46.358113] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-14T19:38:47.158053] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-14T19:38:47.289861] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T19:38:47.337115] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T19:38:47.958081] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-14T19:38:48.566785] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:38:48.758069] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-14T19:38:49.077856] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-14T19:38:49.083573] [INFO ] [REMOTE ] IQV: Full fetch complete (72306 records). [2025-10-14T19:38:49.083748] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-14T19:38:49.502068] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-14T19:38:49.502177] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-14T19:38:49.503204] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-14T19:38:49.503284] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-14T19:38:49.534317] [DEBUG] [LOCAL ] IQV: Trimmed 72306 records to 50084 (keeping 200 days of data) [2025-10-14T19:38:49.535487] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T19:38:49.597404] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-14T19:38:49.851082] [DEBUG] [LOCAL ] IQV: Primary data saved (50084 records). [2025-10-14T19:38:49.851212] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-14T19:38:49.851289] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IQV took 32.3s. Estimated remaining: 2h 55m 34s. Rate: 7.1 symbols/min [2025-10-14T19:38:50.019825] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:38:50.067818] [DEBUG] [LOCAL ] IRT: Loaded 50560 existing records from primary storage. [2025-10-14T19:38:50.068122] [INFO ] [MAIN ] IRT: Loaded 50560 existing records. [2025-10-14T19:38:50.242050] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:38:50.242284] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-14T19:38:50.242332] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-14T19:38:50.242615] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-14T19:38:50.242693] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-14T19:38:50.363201] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-14T19:38:50.596376] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:38:51.022688] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T19:38:51.158066] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-14T19:38:51.958116] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-14T19:38:52.223054] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T19:38:52.671380] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T19:38:52.758042] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-14T19:38:53.323495] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T19:38:53.558092] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-14T19:38:54.358071] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-14T19:38:54.434056] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:38:55.129544] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:38:55.158059] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-14T19:38:55.958103] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-14T19:38:56.096824] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:38:56.657908] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T19:38:56.758106] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-14T19:38:57.558084] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-14T19:38:57.600531] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T19:38:57.606206] [INFO ] [REMOTE ] IRM: Full fetch complete (72322 records). [2025-10-14T19:38:57.606318] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-14T19:38:58.007902] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-14T19:38:58.008023] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-14T19:38:58.009696] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-14T19:38:58.009766] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-14T19:38:58.011793] [DEBUG] [LOCAL ] IRM: Trimmed 72322 records to 49163 (keeping 200 days of data) [2025-10-14T19:38:58.337486] [DEBUG] [LOCAL ] IRM: Primary data saved (49163 records). [2025-10-14T19:38:58.337986] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-14T19:38:58.338138] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IRM took 33.9s. Estimated remaining: 2h 55m 25s. Rate: 7.1 symbols/min [2025-10-14T19:38:58.372972] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-14T19:38:58.535499] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:38:58.567820] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T19:38:58.593547] [DEBUG] [LOCAL ] ISD: Loaded 15901 existing records from primary storage. [2025-10-14T19:38:58.593909] [INFO ] [MAIN ] ISD: Loaded 15901 existing records. [2025-10-14T19:38:58.776551] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:38:58.777322] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-14T19:38:58.777405] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-14T19:38:58.777610] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-14T19:38:58.777713] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-14T19:38:58.972962] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:38:59.158048] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-14T19:38:59.162128] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:38:59.958086] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-14T19:39:00.123020] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:39:00.163801] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T19:39:00.169660] [INFO ] [REMOTE ] IRS: Full fetch complete (32704 records). [2025-10-14T19:39:00.169905] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-14T19:39:00.570700] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-14T19:39:00.570809] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-14T19:39:00.572327] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-14T19:39:00.572395] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-14T19:39:00.573338] [DEBUG] [LOCAL ] IRS: Trimmed 32704 records to 22985 (keeping 200 days of data) [2025-10-14T19:39:00.714274] [DEBUG] [LOCAL ] IRS: Primary data saved (22985 records). [2025-10-14T19:39:00.714459] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-14T19:39:00.714560] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRS took 34.2s. Estimated remaining: 2h 55m 10s. Rate: 7.1 symbols/min [2025-10-14T19:39:00.763314] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-14T19:39:00.899468] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:00.944535] [DEBUG] [LOCAL ] IT: Loaded 42159 existing records from primary storage. [2025-10-14T19:39:00.944960] [INFO ] [MAIN ] IT: Loaded 42159 existing records. [2025-10-14T19:39:01.137595] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:01.147988] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-14T19:39:01.148138] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-14T19:39:01.149293] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-14T19:39:01.149209] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T19:39:01.149450] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-14T19:39:01.546716] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:01.558088] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-14T19:39:02.358100] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-14T19:39:02.559755] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T19:39:02.565960] [INFO ] [REMOTE ] IR: Full fetch complete (76422 records). [2025-10-14T19:39:02.566115] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-14T19:39:02.747958] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T19:39:02.987623] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-14T19:39:02.987753] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-14T19:39:02.988870] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-14T19:39:02.988931] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-14T19:39:02.990410] [DEBUG] [LOCAL ] IR: Trimmed 76422 records to 52781 (keeping 200 days of data) [2025-10-14T19:39:03.165190] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-14T19:39:03.318513] [DEBUG] [LOCAL ] IR: Primary data saved (52781 records). [2025-10-14T19:39:03.318722] [INFO ] [MAIN ] IR: Full history saved. [2025-10-14T19:39:03.318922] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IR took 44.5s. Estimated remaining: 2h 54m 55s. Rate: 7.1 symbols/min [2025-10-14T19:39:03.528207] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:03.548709] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T19:39:03.588692] [DEBUG] [LOCAL ] ITGR: Loaded 31229 existing records from primary storage. [2025-10-14T19:39:03.589010] [INFO ] [MAIN ] ITGR: Loaded 31229 existing records. [2025-10-14T19:39:03.776635] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:03.776887] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-14T19:39:03.776935] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-14T19:39:03.777232] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-14T19:39:03.777289] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-14T19:39:03.963023] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-14T19:39:04.013129] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T19:39:04.173035] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:04.758076] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-14T19:39:05.430329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T19:39:05.558036] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-14T19:39:06.358098] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-14T19:39:06.456038] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:39:07.035866] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T19:39:07.058202] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T19:39:07.158147] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-14T19:39:07.958092] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-14T19:39:08.710258] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:39:08.758073] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-14T19:39:09.530589] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T19:39:09.558041] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-14T19:39:10.340757] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T19:39:10.358054] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-14T19:39:11.161503] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-14T19:39:11.177603] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T19:39:11.813499] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T19:39:11.958078] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-14T19:39:12.186002] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T19:39:12.758082] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-14T19:39:12.988001] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T19:39:13.558054] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-14T19:39:13.807015] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T19:39:14.358043] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-14T19:39:14.674512] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T19:39:15.158087] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-14T19:39:15.272239] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T19:39:15.958089] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-14T19:39:16.561061] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:39:16.758069] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-14T19:39:17.388285] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:39:17.558062] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-14T19:39:18.358044] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-14T19:39:18.407848] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T19:39:19.158058] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-14T19:39:19.273410] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T19:39:19.320577] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T19:39:19.958105] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-14T19:39:20.538099] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T19:39:20.758072] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-14T19:39:21.210537] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T19:39:21.558087] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-14T19:39:21.985635] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T19:39:22.358078] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-14T19:39:23.158043] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-14T19:39:23.216042] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T19:39:23.547153] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T19:39:23.915484] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T19:39:23.958075] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-14T19:39:24.758115] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-14T19:39:25.334210] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T19:39:25.558069] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-14T19:39:26.358063] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-14T19:39:26.542248] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T19:39:26.674398] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T19:39:27.158119] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-14T19:39:27.958132] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-14T19:39:28.036915] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T19:39:28.042877] [INFO ] [REMOTE ] IRT: Full fetch complete (72919 records). [2025-10-14T19:39:28.043035] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-14T19:39:28.152551] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T19:39:28.455832] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-14T19:39:28.455912] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-14T19:39:28.456905] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-14T19:39:28.456967] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-14T19:39:28.458367] [DEBUG] [LOCAL ] IRT: Trimmed 72919 records to 50569 (keeping 200 days of data) [2025-10-14T19:39:28.760124] [DEBUG] [LOCAL ] IRT: Primary data saved (50569 records). [2025-10-14T19:39:28.760296] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-14T19:39:28.760410] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. IRT took 38.9s. Estimated remaining: 2h 55m 5s. Rate: 7.1 symbols/min [2025-10-14T19:39:28.760038] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-14T19:39:28.929057] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:28.962496] [DEBUG] [LOCAL ] ITT: Loaded 32826 existing records from primary storage. [2025-10-14T19:39:28.962786] [INFO ] [MAIN ] ITT: Loaded 32826 existing records. [2025-10-14T19:39:29.141535] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:29.141756] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-14T19:39:29.141807] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-14T19:39:29.142129] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-14T19:39:29.142187] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-14T19:39:29.495877] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:29.558026] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-14T19:39:29.639473] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:39:30.132588] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T19:39:30.358154] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-14T19:39:30.778006] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T19:39:31.158048] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-14T19:39:31.380111] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T19:39:31.958077] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-14T19:39:32.377031] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T19:39:32.380709] [INFO ] [REMOTE ] ITGR: Full fetch complete (42599 records). [2025-10-14T19:39:32.380806] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-14T19:39:32.748078] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-14T19:39:32.748152] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-14T19:39:32.748896] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-14T19:39:32.748956] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-14T19:39:32.749861] [DEBUG] [LOCAL ] ITGR: Trimmed 42599 records to 31233 (keeping 200 days of data) [2025-10-14T19:39:32.799408] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-14T19:39:32.939988] [DEBUG] [LOCAL ] ITGR: Primary data saved (31233 records). [2025-10-14T19:39:32.940129] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-14T19:39:32.940209] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. ITGR took 29.6s. Estimated remaining: 2h 54m 52s. Rate: 7.1 symbols/min [2025-10-14T19:39:33.022507] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T19:39:33.050926] [INFO ] [REMOTE ] ISD: Full fetch complete (24078 records). [2025-10-14T19:39:33.061501] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-14T19:39:33.203027] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:33.563620] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-10-14T19:39:33.561872] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-14T19:39:33.563835] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-14T19:39:33.564925] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-14T19:39:33.564084] [INFO ] [MAIN ] ITUB: Loaded 53318 existing records. [2025-10-14T19:39:33.565519] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-14T19:39:33.576716] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-14T19:39:33.662572] [DEBUG] [LOCAL ] ISD: Trimmed 24078 records to 15926 (keeping 200 days of data) [2025-10-14T19:39:33.827121] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:33.830399] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-14T19:39:33.830765] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-14T19:39:33.831395] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-14T19:39:33.833766] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-14T19:39:34.013503] [DEBUG] [LOCAL ] ISD: Primary data saved (15926 records). [2025-10-14T19:39:34.014572] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-14T19:39:34.029097] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ISD took 35.7s. Estimated remaining: 2h 54m 36s. Rate: 7.1 symbols/min [2025-10-14T19:39:34.354379] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:34.383997] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:34.384489] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-14T19:39:34.425335] [DEBUG] [LOCAL ] ITW: Loaded 45832 existing records from primary storage. [2025-10-14T19:39:34.425670] [INFO ] [MAIN ] ITW: Loaded 45832 existing records. [2025-10-14T19:39:34.614073] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:34.621514] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-14T19:39:34.622546] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T19:39:34.622679] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-14T19:39:34.628062] [INFO ] [REMOTE ] IT: Full fetch complete (57106 records). [2025-10-14T19:39:34.628136] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-14T19:39:34.628166] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-14T19:39:34.628318] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-14T19:39:35.303943] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:35.332541] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-14T19:39:35.384597] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T19:39:35.402917] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-14T19:39:35.402980] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-14T19:39:35.403919] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-14T19:39:35.410900] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-14T19:39:35.412853] [DEBUG] [LOCAL ] IT: Trimmed 57106 records to 42200 (keeping 200 days of data) [2025-10-14T19:39:35.667060] [DEBUG] [LOCAL ] IT: Primary data saved (42200 records). [2025-10-14T19:39:35.667173] [INFO ] [MAIN ] IT: Full history saved. [2025-10-14T19:39:35.667245] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. IT took 35.0s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-10-14T19:39:35.837349] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:35.878154] [DEBUG] [LOCAL ] IVR: Loaded 48122 existing records from primary storage. [2025-10-14T19:39:35.878447] [INFO ] [MAIN ] IVR: Loaded 48122 existing records. [2025-10-14T19:39:35.963278] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-14T19:39:36.028112] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T19:39:36.105158] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:36.105363] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-14T19:39:36.105411] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-14T19:39:36.105592] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-14T19:39:36.105632] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-14T19:39:36.460224] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:36.599339] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T19:39:36.758109] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-14T19:39:37.405055] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T19:39:37.558056] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-14T19:39:38.358109] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-14T19:39:38.496052] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T19:39:38.984863] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T19:39:39.158092] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-14T19:39:39.941562] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T19:39:39.958022] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-14T19:39:40.466982] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T19:39:40.758112] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-14T19:39:41.162686] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T19:39:41.558067] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-14T19:39:42.367794] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-14T19:39:42.372801] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T19:39:43.158042] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-14T19:39:43.301970] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T19:39:43.958094] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-14T19:39:44.048864] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T19:39:44.736569] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:39:44.758069] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-14T19:39:45.558097] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-14T19:39:45.689534] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T19:39:46.215850] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T19:39:46.358058] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-14T19:39:46.830746] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T19:39:47.158071] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-14T19:39:47.246891] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T19:39:47.958062] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-14T19:39:48.544195] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T19:39:48.758060] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-14T19:39:49.303129] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T19:39:49.558075] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-14T19:39:49.890532] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T19:39:50.358091] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-14T19:39:51.158114] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-14T19:39:51.263099] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T19:39:51.724962] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T19:39:51.958064] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-14T19:39:52.366223] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T19:39:52.758112] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-14T19:39:53.562279] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-14T19:39:53.567799] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T19:39:54.085582] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T19:39:54.358111] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-14T19:39:55.126100] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T19:39:55.158081] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-14T19:39:55.958080] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-14T19:39:56.073809] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:39:56.480589] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T19:39:56.484410] [INFO ] [REMOTE ] ITT: Full fetch complete (47168 records). [2025-10-14T19:39:56.484546] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-14T19:39:56.763242] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-14T19:39:56.893592] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-14T19:39:56.893700] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-14T19:39:56.894604] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-14T19:39:56.894666] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-14T19:39:56.895779] [DEBUG] [LOCAL ] ITT: Trimmed 47168 records to 32739 (keeping 200 days of data) [2025-10-14T19:39:57.100324] [DEBUG] [LOCAL ] ITT: Primary data saved (32739 records). [2025-10-14T19:39:57.100446] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-14T19:39:57.100519] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITT took 28.3s. Estimated remaining: 2h 54m 26s. Rate: 7.1 symbols/min [2025-10-14T19:39:57.272434] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:39:57.302684] [DEBUG] [LOCAL ] IVT: Loaded 31261 existing records from primary storage. [2025-10-14T19:39:57.302952] [INFO ] [MAIN ] IVT: Loaded 31261 existing records. [2025-10-14T19:39:57.499199] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:39:57.510806] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-14T19:39:57.512438] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T19:39:57.511500] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-14T19:39:57.523174] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-14T19:39:57.523293] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-14T19:39:57.565081] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-14T19:39:57.874525] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:39:58.358103] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-14T19:39:58.535287] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T19:39:59.158091] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-14T19:39:59.369399] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T19:39:59.964469] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-14T19:39:59.973229] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T19:40:00.470406] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T19:40:00.758176] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-14T19:40:01.558099] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-14T19:40:01.810628] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T19:40:02.273941] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T19:40:02.358088] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-14T19:40:02.465445] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T19:40:03.158069] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-14T19:40:03.958037] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-14T19:40:04.051702] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T19:40:04.431181] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T19:40:04.758058] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-14T19:40:05.555868] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T19:40:05.560795] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-14T19:40:05.563089] [INFO ] [REMOTE ] ITW: Full fetch complete (66608 records). [2025-10-14T19:40:05.563251] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-14T19:40:05.940105] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T19:40:06.018357] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-14T19:40:06.018455] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-14T19:40:06.019481] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-14T19:40:06.019546] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-14T19:40:06.021544] [DEBUG] [LOCAL ] ITW: Trimmed 66608 records to 45801 (keeping 200 days of data) [2025-10-14T19:40:06.317948] [DEBUG] [LOCAL ] ITW: Primary data saved (45801 records). [2025-10-14T19:40:06.318080] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-14T19:40:06.318158] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. ITW took 32.3s. Estimated remaining: 2h 54m 18s. Rate: 7.1 symbols/min [2025-10-14T19:40:06.363290] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-14T19:40:06.490283] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:06.539350] [DEBUG] [LOCAL ] IVZ: Loaded 53118 existing records from primary storage. [2025-10-14T19:40:06.539693] [INFO ] [MAIN ] IVZ: Loaded 53118 existing records. [2025-10-14T19:40:06.734003] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:06.734226] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-14T19:40:06.734275] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-14T19:40:06.734453] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-14T19:40:06.734494] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-14T19:40:07.137371] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:07.158050] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-14T19:40:07.285353] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T19:40:07.833892] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:40:07.958067] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-14T19:40:08.758042] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-14T19:40:08.945171] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T19:40:09.558088] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-14T19:40:09.748424] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T19:40:10.252453] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T19:40:10.358072] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-14T19:40:10.955800] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T19:40:11.158072] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-14T19:40:11.675067] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-14T19:40:11.958049] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-14T19:40:12.333412] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T19:40:12.758079] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-14T19:40:13.519854] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T19:40:13.558090] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-14T19:40:14.258741] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T19:40:14.358104] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-14T19:40:14.881896] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T19:40:15.158064] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-14T19:40:15.768676] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T19:40:15.958108] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-14T19:40:16.758148] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-14T19:40:16.898377] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T19:40:17.558094] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-14T19:40:17.761919] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T19:40:17.767997] [INFO ] [REMOTE ] ITUB: Full fetch complete (77320 records). [2025-10-14T19:40:17.768154] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-14T19:40:18.162419] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-14T19:40:18.162498] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-14T19:40:18.163519] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-14T19:40:18.163583] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-14T19:40:18.165019] [DEBUG] [LOCAL ] ITUB: Trimmed 77320 records to 53330 (keeping 200 days of data) [2025-10-14T19:40:18.364295] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-14T19:40:18.484743] [DEBUG] [LOCAL ] ITUB: Primary data saved (53330 records). [2025-10-14T19:40:18.484885] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-14T19:40:18.484964] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. ITUB took 45.5s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-14T19:40:18.661857] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:18.694150] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T19:40:18.721776] [DEBUG] [LOCAL ] IX: Loaded 22373 existing records from primary storage. [2025-10-14T19:40:18.722022] [INFO ] [MAIN ] IX: Loaded 22373 existing records. [2025-10-14T19:40:18.895592] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:18.895827] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-14T19:40:18.895915] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-14T19:40:18.896150] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-14T19:40:18.896227] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-14T19:40:19.173677] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-14T19:40:19.259084] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:19.268497] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T19:40:19.274097] [INFO ] [REMOTE ] IVR: Full fetch complete (69279 records). [2025-10-14T19:40:19.274187] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-14T19:40:19.667695] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-14T19:40:19.667838] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-14T19:40:19.668941] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-14T19:40:19.669077] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-14T19:40:19.691347] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T19:40:19.698550] [DEBUG] [LOCAL ] IVR: Trimmed 69279 records to 48130 (keeping 200 days of data) [2025-10-14T19:40:19.962792] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-14T19:40:19.994216] [DEBUG] [LOCAL ] IVR: Primary data saved (48130 records). [2025-10-14T19:40:19.994350] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-14T19:40:19.994437] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. IVR took 44.3s. Estimated remaining: 2h 53m 57s. Rate: 7.1 symbols/min [2025-10-14T19:40:20.184230] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:20.226805] [DEBUG] [LOCAL ] J: Loaded 40285 existing records from primary storage. [2025-10-14T19:40:20.227166] [INFO ] [MAIN ] J: Loaded 40285 existing records. [2025-10-14T19:40:20.422242] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:20.422572] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-14T19:40:20.422629] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-14T19:40:20.423085] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-14T19:40:20.423164] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-14T19:40:20.766418] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-14T19:40:20.800505] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:21.047819] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:40:21.049873] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T19:40:21.558072] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-14T19:40:22.051146] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T19:40:22.262454] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T19:40:22.358067] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-14T19:40:23.158079] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-14T19:40:23.760592] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T19:40:23.764971] [INFO ] [REMOTE ] IVT: Full fetch complete (45787 records). [2025-10-14T19:40:23.765070] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-14T19:40:23.959807] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-14T19:40:24.195736] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-14T19:40:24.195820] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-14T19:40:24.196583] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-14T19:40:24.196699] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-14T19:40:24.197795] [DEBUG] [LOCAL ] IVT: Trimmed 45787 records to 31274 (keeping 200 days of data) [2025-10-14T19:40:24.405469] [DEBUG] [LOCAL ] IVT: Primary data saved (31274 records). [2025-10-14T19:40:24.405666] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-14T19:40:24.405794] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IVT took 27.3s. Estimated remaining: 2h 53m 45s. Rate: 7.1 symbols/min [2025-10-14T19:40:24.579406] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:24.618623] [DEBUG] [LOCAL ] JBGS: Loaded 42181 existing records from primary storage. [2025-10-14T19:40:24.618928] [INFO ] [MAIN ] JBGS: Loaded 42181 existing records. [2025-10-14T19:40:24.762321] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-14T19:40:24.806501] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:24.806798] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-14T19:40:24.807002] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-14T19:40:24.807421] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-14T19:40:24.807480] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-14T19:40:25.022623] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T19:40:25.239308] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:25.422119] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T19:40:25.562481] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-14T19:40:25.563352] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T19:40:26.358070] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-14T19:40:27.158092] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-14T19:40:27.430059] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-14T19:40:27.449708] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T19:40:27.958077] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-14T19:40:28.624189] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T19:40:28.758130] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-14T19:40:29.313346] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T19:40:29.558082] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-14T19:40:30.358150] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-14T19:40:30.529692] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T19:40:30.591408] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T19:40:31.158154] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-14T19:40:31.888584] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T19:40:31.958035] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-14T19:40:32.758073] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-14T19:40:33.043957] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T19:40:33.082225] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T19:40:33.558061] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-14T19:40:34.052072] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T19:40:34.358081] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-14T19:40:35.163279] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-14T19:40:35.173543] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:40:35.179729] [INFO ] [REMOTE ] IVZ: Full fetch complete (76992 records). [2025-10-14T19:40:35.179828] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-14T19:40:35.576378] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-14T19:40:35.576477] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-14T19:40:35.577543] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-14T19:40:35.577764] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-14T19:40:35.579340] [DEBUG] [LOCAL ] IVZ: Trimmed 76992 records to 53118 (keeping 200 days of data) [2025-10-14T19:40:35.713964] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T19:40:35.931795] [DEBUG] [LOCAL ] IVZ: Primary data saved (53118 records). [2025-10-14T19:40:35.931925] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-14T19:40:35.932003] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IVZ took 29.6s. Estimated remaining: 2h 53m 39s. Rate: 7.1 symbols/min [2025-10-14T19:40:35.963172] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-14T19:40:36.106231] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:36.143749] [DEBUG] [LOCAL ] JBI: Loaded 43124 existing records from primary storage. [2025-10-14T19:40:36.144026] [INFO ] [MAIN ] JBI: Loaded 43124 existing records. [2025-10-14T19:40:36.317800] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T19:40:36.339947] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:36.344540] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-14T19:40:36.344837] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-14T19:40:36.345279] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-14T19:40:36.345343] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-14T19:40:36.696395] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:36.758035] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-14T19:40:37.558078] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-14T19:40:37.601746] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T19:40:38.287902] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T19:40:38.358084] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-14T19:40:38.954871] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:40:39.158066] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-14T19:40:39.480917] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T19:40:39.958106] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-14T19:40:40.288984] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T19:40:40.758066] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-14T19:40:41.423145] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T19:40:41.558058] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-14T19:40:41.953896] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T19:40:42.358084] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-14T19:40:43.156583] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T19:40:43.166308] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-14T19:40:43.204788] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T19:40:43.958095] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-14T19:40:44.604883] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T19:40:44.758072] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-14T19:40:44.946389] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T19:40:45.558075] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-14T19:40:46.048549] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T19:40:46.315493] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T19:40:46.318080] [INFO ] [REMOTE ] IX: Full fetch complete (28055 records). [2025-10-14T19:40:46.318170] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-14T19:40:46.363159] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-14T19:40:46.683103] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-14T19:40:46.683178] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-14T19:40:46.683716] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-14T19:40:46.683775] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-14T19:40:46.684415] [DEBUG] [LOCAL ] IX: Trimmed 28055 records to 22281 (keeping 200 days of data) [2025-10-14T19:40:46.808880] [DEBUG] [LOCAL ] IX: Primary data saved (22281 records). [2025-10-14T19:40:46.808997] [INFO ] [MAIN ] IX: Full history saved. [2025-10-14T19:40:46.809072] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. IX took 28.3s. Estimated remaining: 2h 53m 34s. Rate: 7.1 symbols/min [2025-10-14T19:40:46.978015] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:47.023876] [DEBUG] [LOCAL ] JBL: Loaded 48384 existing records from primary storage. [2025-10-14T19:40:47.024175] [INFO ] [MAIN ] JBL: Loaded 48384 existing records. [2025-10-14T19:40:47.163942] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-14T19:40:47.204226] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:47.204373] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-14T19:40:47.204418] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-14T19:40:47.204688] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-14T19:40:47.204743] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-14T19:40:47.553007] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:47.958085] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-14T19:40:48.104179] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T19:40:48.196426] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T19:40:48.758098] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-14T19:40:49.326829] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T19:40:49.558109] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-14T19:40:50.123087] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T19:40:50.358079] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-14T19:40:51.142810] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T19:40:51.158040] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-14T19:40:51.657087] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T19:40:51.958065] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-14T19:40:52.758049] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-14T19:40:52.965969] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T19:40:53.369880] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T19:40:53.558107] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-14T19:40:53.904788] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T19:40:54.358110] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-14T19:40:55.158107] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-14T19:40:55.240007] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T19:40:55.943711] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T19:40:55.958032] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-14T19:40:56.313534] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T19:40:56.317890] [INFO ] [REMOTE ] JBGS: Full fetch complete (59363 records). [2025-10-14T19:40:56.317977] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-14T19:40:56.690928] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-14T19:40:56.690999] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-14T19:40:56.691763] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-14T19:40:56.691825] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-14T19:40:56.692918] [DEBUG] [LOCAL ] JBGS: Trimmed 59363 records to 42182 (keeping 200 days of data) [2025-10-14T19:40:56.778365] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-14T19:40:56.940900] [DEBUG] [LOCAL ] JBGS: Primary data saved (42182 records). [2025-10-14T19:40:56.941045] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-14T19:40:56.941126] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. JBGS took 32.5s. Estimated remaining: 2h 53m 27s. Rate: 7.1 symbols/min [2025-10-14T19:40:57.150233] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:40:57.175099] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T19:40:57.206089] [DEBUG] [LOCAL ] JBND: Loaded 26674 existing records from primary storage. [2025-10-14T19:40:57.206354] [INFO ] [MAIN ] JBND: Loaded 26674 existing records. [2025-10-14T19:40:57.384777] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:40:57.385019] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-14T19:40:57.385065] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-14T19:40:57.385369] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-14T19:40:57.385409] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-14T19:40:57.563237] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-14T19:40:57.791950] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:40:58.165522] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T19:40:58.358123] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-14T19:40:59.158084] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-14T19:40:59.315990] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:40:59.806820] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T19:40:59.856280] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T19:40:59.958062] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-14T19:41:00.758075] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-14T19:41:01.558092] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-14T19:41:01.736835] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T19:41:02.209276] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T19:41:02.358089] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-14T19:41:03.158070] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-14T19:41:03.196369] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T19:41:03.299596] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T19:41:03.958064] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-14T19:41:04.527638] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T19:41:04.758049] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-14T19:41:04.892609] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-14T19:41:05.558061] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-14T19:41:06.247523] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T19:41:06.358070] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-14T19:41:06.828582] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T19:41:07.158073] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-14T19:41:07.470055] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T19:41:07.958064] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-14T19:41:08.758073] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-14T19:41:08.951133] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T19:41:09.116619] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T19:41:09.558085] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-14T19:41:09.839980] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T19:41:09.844574] [INFO ] [REMOTE ] JBI: Full fetch complete (64013 records). [2025-10-14T19:41:09.844711] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-14T19:41:10.279524] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-14T19:41:10.279624] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-14T19:41:10.280582] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-14T19:41:10.280630] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-14T19:41:10.281973] [DEBUG] [LOCAL ] JBI: Trimmed 64013 records to 43014 (keeping 200 days of data) [2025-10-14T19:41:10.361173] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-14T19:41:10.522821] [DEBUG] [LOCAL ] JBI: Primary data saved (43014 records). [2025-10-14T19:41:10.522941] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-14T19:41:10.523014] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBI took 34.6s. Estimated remaining: 2h 53m 24s. Rate: 7.1 symbols/min [2025-10-14T19:41:10.687420] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:10.687598] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-14T19:41:10.687635] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-14T19:41:10.687799] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-14T19:41:10.687843] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-14T19:41:10.687884] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-14T19:41:10.687916] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-14T19:41:11.045748] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:11.158041] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-14T19:41:11.275015] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T19:41:11.280115] [INFO ] [REMOTE ] J: Full fetch complete (59446 records). [2025-10-14T19:41:11.280244] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-14T19:41:11.382395] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:41:11.382998] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-14T19:41:11.393572] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:41:11.403920] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-14T19:41:11.431794] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:41:11.440200] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-14T19:41:11.457905] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-14T19:41:11.461434] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-14T19:41:11.478414] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-14T19:41:11.478520] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBS took 1.0s. Estimated remaining: 2h 53m 7s. Rate: 7.1 symbols/min [2025-10-14T19:41:11.837419] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:11.840392] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-14T19:41:11.840472] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-14T19:41:11.840562] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-14T19:41:11.841494] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-14T19:41:11.841571] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-14T19:41:11.841765] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-14T19:41:11.841895] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-14T19:41:11.841964] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-14T19:41:11.842026] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-14T19:41:11.842082] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-14T19:41:11.947002] [DEBUG] [LOCAL ] J: Trimmed 59446 records to 40309 (keeping 200 days of data) [2025-10-14T19:41:11.959275] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-14T19:41:12.322548] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:12.374523] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T19:41:12.512992] [DEBUG] [LOCAL ] J: Primary data saved (40309 records). [2025-10-14T19:41:12.513576] [INFO ] [MAIN ] J: Full history saved. [2025-10-14T19:41:12.513734] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. J took 52.5s. Estimated remaining: 2h 52m 51s. Rate: 7.1 symbols/min [2025-10-14T19:41:12.680594] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:12.690760] [DEBUG] [LOCAL ] JCE: Loaded 7371 existing records from primary storage. [2025-10-14T19:41:12.690949] [INFO ] [MAIN ] JCE: Loaded 7371 existing records. [2025-10-14T19:41:12.764101] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-14T19:41:12.871420] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:41:12.871793] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-14T19:41:12.871859] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-14T19:41:12.877422] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-14T19:41:12.885256] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-14T19:41:12.918381] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T19:41:13.034105] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:41:13.069822] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-14T19:41:13.118416] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:41:13.151089] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-14T19:41:13.156305] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:41:13.177906] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-14T19:41:13.188845] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-14T19:41:13.216577] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-14T19:41:13.235592] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-14T19:41:13.251557] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JBTM took 1.7s. Estimated remaining: 2h 52m 34s. Rate: 7.1 symbols/min [2025-10-14T19:41:13.255952] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:13.430585] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:13.486602] [DEBUG] [LOCAL ] JCI: Loaded 53533 existing records from primary storage. [2025-10-14T19:41:13.486955] [INFO ] [MAIN ] JCI: Loaded 53533 existing records. [2025-10-14T19:41:13.563314] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-14T19:41:13.673837] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:41:13.674017] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-14T19:41:13.674063] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-14T19:41:13.674463] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-14T19:41:13.674522] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-14T19:41:14.048569] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:14.358073] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-14T19:41:14.681713] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T19:41:15.158053] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-14T19:41:15.958087] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-14T19:41:16.110867] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T19:41:16.158049] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T19:41:16.579419] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T19:41:16.758074] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-14T19:41:17.558078] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-14T19:41:18.358139] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-14T19:41:18.505170] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T19:41:18.959734] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T19:41:19.158101] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-14T19:41:19.238163] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:41:19.958065] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-14T19:41:20.496304] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T19:41:20.511159] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T19:41:20.758108] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-14T19:41:21.558054] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-14T19:41:22.358053] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-14T19:41:22.546541] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T19:41:23.158096] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-14T19:41:23.270385] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T19:41:23.276969] [INFO ] [REMOTE ] JBL: Full fetch complete (70513 records). [2025-10-14T19:41:23.277306] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-14T19:41:23.401766] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T19:41:23.744915] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-14T19:41:23.745007] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-14T19:41:23.746233] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-14T19:41:23.746310] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-14T19:41:23.747793] [DEBUG] [LOCAL ] JBL: Trimmed 70513 records to 48360 (keeping 200 days of data) [2025-10-14T19:41:23.982048] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-14T19:41:24.070194] [DEBUG] [LOCAL ] JBL: Primary data saved (48360 records). [2025-10-14T19:41:24.070314] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-14T19:41:24.070393] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JBL took 37.3s. Estimated remaining: 2h 52m 28s. Rate: 7.1 symbols/min [2025-10-14T19:41:24.246917] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:24.292665] [DEBUG] [LOCAL ] JEF: Loaded 50183 existing records from primary storage. [2025-10-14T19:41:24.292974] [INFO ] [MAIN ] JEF: Loaded 50183 existing records. [2025-10-14T19:41:24.480157] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:41:24.480353] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-14T19:41:24.480404] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-14T19:41:24.480825] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-14T19:41:24.480882] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-14T19:41:24.605459] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T19:41:24.763438] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-14T19:41:24.874851] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:24.902257] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T19:41:25.558102] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-14T19:41:26.091935] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T19:41:26.096116] [INFO ] [REMOTE ] JBND: Full fetch complete (35268 records). [2025-10-14T19:41:26.096209] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-14T19:41:26.363293] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-14T19:41:26.486943] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-14T19:41:26.487022] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-14T19:41:26.487740] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-14T19:41:26.487802] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-14T19:41:26.488797] [DEBUG] [LOCAL ] JBND: Trimmed 35268 records to 26794 (keeping 200 days of data) [2025-10-14T19:41:26.651715] [DEBUG] [LOCAL ] JBND: Primary data saved (26794 records). [2025-10-14T19:41:26.651848] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-14T19:41:26.651928] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBND took 29.7s. Estimated remaining: 2h 52m 14s. Rate: 7.1 symbols/min [2025-10-14T19:41:26.826476] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:26.866723] [DEBUG] [LOCAL ] JELD: Loaded 46105 existing records from primary storage. [2025-10-14T19:41:26.867069] [INFO ] [MAIN ] JELD: Loaded 46105 existing records. [2025-10-14T19:41:27.056711] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:41:27.057281] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-14T19:41:27.057493] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-14T19:41:27.057891] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-14T19:41:27.057955] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-14T19:41:27.163607] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T19:41:27.172128] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-14T19:41:27.492066] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:27.496616] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T19:41:27.958136] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-14T19:41:28.758132] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-14T19:41:29.196961] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-14T19:41:29.322075] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T19:41:29.558063] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-14T19:41:29.755689] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T19:41:30.212136] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T19:41:30.358120] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-14T19:41:31.158132] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-14T19:41:31.863414] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T19:41:31.958047] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-14T19:41:32.356273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T19:41:32.387566] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T19:41:32.758083] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-14T19:41:33.558053] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-14T19:41:34.364005] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-14T19:41:34.376843] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T19:41:34.411450] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T19:41:35.158111] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-14T19:41:35.772150] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T19:41:35.958097] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-14T19:41:36.670444] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T19:41:36.758058] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-14T19:41:36.821868] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T19:41:36.823907] [INFO ] [REMOTE ] JCE: Full fetch complete (9797 records). [2025-10-14T19:41:36.823973] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-14T19:41:37.196915] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-14T19:41:37.196992] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-14T19:41:37.197240] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-14T19:41:37.197277] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-14T19:41:37.197791] [DEBUG] [LOCAL ] JCE: Trimmed 9797 records to 7424 (keeping 200 days of data) [2025-10-14T19:41:37.242692] [DEBUG] [LOCAL ] JCE: Primary data saved (7424 records). [2025-10-14T19:41:37.242824] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-14T19:41:37.242903] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCE took 24.7s. Estimated remaining: 2h 52m 7s. Rate: 7.1 symbols/min [2025-10-14T19:41:37.420924] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:37.450900] [DEBUG] [LOCAL ] JFR: Loaded 30972 existing records from primary storage. [2025-10-14T19:41:37.451172] [INFO ] [MAIN ] JFR: Loaded 30972 existing records. [2025-10-14T19:41:37.563301] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-14T19:41:37.641309] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:41:37.641595] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-14T19:41:37.641697] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-14T19:41:37.642060] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-14T19:41:37.642128] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-14T19:41:38.019359] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:38.358104] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-14T19:41:38.537370] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T19:41:38.619208] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T19:41:39.158049] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-14T19:41:39.848699] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:41:39.958071] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-14T19:41:40.540070] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:41:40.758082] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-14T19:41:41.328606] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T19:41:41.558065] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-14T19:41:42.269507] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T19:41:42.358116] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-14T19:41:42.498547] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T19:41:43.158060] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-14T19:41:43.945892] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:41:43.958029] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-14T19:41:44.758091] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-14T19:41:44.920628] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T19:41:45.508853] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T19:41:45.558024] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-14T19:41:46.264499] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T19:41:46.358313] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-14T19:41:47.158075] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-14T19:41:47.265847] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T19:41:47.514350] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T19:41:47.958075] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-14T19:41:48.758058] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-14T19:41:49.124388] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T19:41:49.163062] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T19:41:49.558115] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-14T19:41:50.094165] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T19:41:50.358081] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-14T19:41:51.158056] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-14T19:41:51.462919] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:41:51.777925] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T19:41:51.958060] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-14T19:41:52.540912] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T19:41:52.758156] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-14T19:41:53.452976] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T19:41:53.558092] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-14T19:41:54.363210] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-14T19:41:54.383980] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T19:41:54.719033] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T19:41:55.158126] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-14T19:41:55.958120] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-14T19:41:56.120950] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T19:41:56.174495] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T19:41:56.758068] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-14T19:41:57.547002] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T19:41:57.553072] [INFO ] [REMOTE ] JCI: Full fetch complete (77569 records). [2025-10-14T19:41:57.553217] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-14T19:41:57.565500] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-14T19:41:57.949608] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T19:41:58.016818] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-14T19:41:58.016910] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-14T19:41:58.018111] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-14T19:41:58.018177] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-14T19:41:58.020520] [DEBUG] [LOCAL ] JCI: Trimmed 77569 records to 53530 (keeping 200 days of data) [2025-10-14T19:41:58.350511] [DEBUG] [LOCAL ] JCI: Primary data saved (53530 records). [2025-10-14T19:41:58.350663] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-14T19:41:58.350759] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JCI took 45.1s. Estimated remaining: 2h 52m 12s. Rate: 7.1 symbols/min [2025-10-14T19:41:58.363936] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-14T19:41:58.524264] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:58.537936] [DEBUG] [LOCAL ] JGH: Loaded 12022 existing records from primary storage. [2025-10-14T19:41:58.538171] [INFO ] [MAIN ] JGH: Loaded 12022 existing records. [2025-10-14T19:41:58.712664] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:41:58.712877] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-14T19:41:58.712924] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-14T19:41:58.713151] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-14T19:41:58.713207] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-14T19:41:59.068872] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:41:59.081614] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:41:59.086837] [INFO ] [REMOTE ] JELD: Full fetch complete (64354 records). [2025-10-14T19:41:59.086991] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-14T19:41:59.163177] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-14T19:41:59.472363] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-14T19:41:59.472450] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-14T19:41:59.473571] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-14T19:41:59.473664] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-14T19:41:59.475168] [DEBUG] [LOCAL ] JELD: Trimmed 64354 records to 46081 (keeping 200 days of data) [2025-10-14T19:41:59.734477] [DEBUG] [LOCAL ] JELD: Primary data saved (46081 records). [2025-10-14T19:41:59.734620] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-14T19:41:59.734740] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JELD took 33.1s. Estimated remaining: 2h 51m 56s. Rate: 7.1 symbols/min [2025-10-14T19:41:59.909365] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:41:59.951319] [DEBUG] [LOCAL ] JHG: Loaded 47620 existing records from primary storage. [2025-10-14T19:41:59.951933] [INFO ] [MAIN ] JHG: Loaded 47620 existing records. [2025-10-14T19:41:59.963208] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-14T19:42:00.141629] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:00.147299] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-14T19:42:00.149100] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-14T19:42:00.175672] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-14T19:42:00.165740] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:42:00.180277] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-14T19:42:00.214228] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T19:42:00.543467] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:00.758052] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-14T19:42:01.462389] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T19:42:01.558076] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-14T19:42:01.972808] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T19:42:02.358086] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-14T19:42:03.143938] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T19:42:03.158021] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-14T19:42:03.390955] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T19:42:03.537396] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T19:42:03.958057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-14T19:42:04.724562] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T19:42:04.758028] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-14T19:42:05.545524] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T19:42:05.558014] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-14T19:42:06.310238] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T19:42:06.358071] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-14T19:42:07.158061] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-14T19:42:07.631407] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T19:42:07.958120] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-14T19:42:08.705264] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T19:42:08.717851] [INFO ] [REMOTE ] JEF: Full fetch complete (73231 records). [2025-10-14T19:42:08.718743] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T19:42:08.718832] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-14T19:42:08.763156] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-14T19:42:09.125353] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-14T19:42:09.125434] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-14T19:42:09.126421] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-14T19:42:09.126483] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-14T19:42:09.127900] [DEBUG] [LOCAL ] JEF: Trimmed 73231 records to 50173 (keeping 200 days of data) [2025-10-14T19:42:09.427194] [DEBUG] [LOCAL ] JEF: Primary data saved (50173 records). [2025-10-14T19:42:09.427315] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-14T19:42:09.427391] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JEF took 45.4s. Estimated remaining: 2h 51m 49s. Rate: 7.1 symbols/min [2025-10-14T19:42:09.567377] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-14T19:42:09.599880] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:09.606348] [DEBUG] [LOCAL ] JHI: Loaded 3933 existing records from primary storage. [2025-10-14T19:42:09.606530] [INFO ] [MAIN ] JHI: Loaded 3933 existing records. [2025-10-14T19:42:09.792987] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:09.793138] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-14T19:42:09.793184] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-14T19:42:09.793302] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-14T19:42:09.793338] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-14T19:42:10.156233] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:10.257631] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T19:42:10.358031] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-14T19:42:10.438663] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T19:42:11.158088] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-14T19:42:11.927541] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:42:11.943780] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T19:42:11.958022] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-14T19:42:12.758043] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-14T19:42:13.436574] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T19:42:13.558045] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-14T19:42:14.109727] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T19:42:14.114558] [INFO ] [REMOTE ] JFR: Full fetch complete (48326 records). [2025-10-14T19:42:14.114783] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-14T19:42:14.363402] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-14T19:42:14.515311] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-14T19:42:14.515417] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-14T19:42:14.516692] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-14T19:42:14.516757] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-14T19:42:14.518056] [DEBUG] [LOCAL ] JFR: Trimmed 48326 records to 30884 (keeping 200 days of data) [2025-10-14T19:42:14.707131] [DEBUG] [LOCAL ] JFR: Primary data saved (30884 records). [2025-10-14T19:42:14.707290] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-14T19:42:14.707385] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JFR took 37.5s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-10-14T19:42:14.913806] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:14.919450] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-14T19:42:14.919624] [INFO ] [MAIN ] JHS: Loaded 2944 existing records. [2025-10-14T19:42:15.131917] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:15.132177] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-14T19:42:15.132391] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-14T19:42:15.132690] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-14T19:42:15.132756] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-14T19:42:15.168202] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-14T19:42:15.474090] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T19:42:15.517536] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T19:42:15.592423] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:15.830807] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T19:42:15.958083] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-14T19:42:16.758097] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-14T19:42:17.558048] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-14T19:42:17.594404] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T19:42:17.622718] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T19:42:18.358058] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-14T19:42:18.489008] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T19:42:18.491986] [INFO ] [REMOTE ] JGH: Full fetch complete (15822 records). [2025-10-14T19:42:18.492055] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-14T19:42:18.767797] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-14T19:42:18.859330] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-14T19:42:18.859395] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-14T19:42:18.859739] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-14T19:42:18.859798] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-14T19:42:18.860286] [DEBUG] [LOCAL ] JGH: Trimmed 15822 records to 12243 (keeping 200 days of data) [2025-10-14T19:42:18.931564] [DEBUG] [LOCAL ] JGH: Primary data saved (12243 records). [2025-10-14T19:42:18.931712] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-14T19:42:18.931800] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JGH took 20.6s. Estimated remaining: 2h 51m 25s. Rate: 7.1 symbols/min [2025-10-14T19:42:19.098489] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:19.146365] [DEBUG] [LOCAL ] JHX: Loaded 53153 existing records from primary storage. [2025-10-14T19:42:19.146748] [INFO ] [MAIN ] JHX: Loaded 53153 existing records. [2025-10-14T19:42:19.167060] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-14T19:42:19.328845] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:19.329061] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-14T19:42:19.329123] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-14T19:42:19.329500] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-14T19:42:19.329568] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-14T19:42:19.688100] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:19.716321] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T19:42:19.958069] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-14T19:42:20.605513] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T19:42:20.758081] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-14T19:42:21.437190] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-14T19:42:21.558077] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-14T19:42:22.061225] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T19:42:22.358075] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-14T19:42:22.464381] [DEBUG] [REMOTE ] JHI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-14T19:42:22.464701] [WARN ] [REMOTE ] JHI: No data returned for month 2025-05 [2025-10-14T19:42:22.464788] [FATAL] [REMOTE ] JHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:42:22.464868] [FATAL] [MAIN ] JHI: Failed to fetch primary data. [2025-10-14T19:42:22.464933] [WARN ] [MAIN ] JHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:42:22.465012] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-14T19:42:22.465107] [DEBUG] [LOCAL ] JHI: No primary data file found to delete. [2025-10-14T19:42:22.465158] [INFO ] [LOCAL ] JHI: Starting deletion of derivative data. [2025-10-14T19:42:22.465353] [DEBUG] [LOCAL ] JHI: Deleted derivative data file. [2025-10-14T19:42:22.465437] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 13.0s. Estimated remaining: 2h 51m 11s. Rate: 7.1 symbols/min [2025-10-14T19:42:22.673874] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:22.690737] [DEBUG] [LOCAL ] JILL: Loaded 16095 existing records from primary storage. [2025-10-14T19:42:22.690964] [INFO ] [MAIN ] JILL: Loaded 16095 existing records. [2025-10-14T19:42:22.897065] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:22.897311] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-14T19:42:22.897380] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-14T19:42:22.897626] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-14T19:42:22.897757] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-14T19:42:23.163280] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-14T19:42:23.315174] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:23.796274] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-14T19:42:23.958129] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-14T19:42:24.758135] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-14T19:42:25.200994] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T19:42:25.558092] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-14T19:42:25.619730] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T19:42:26.358076] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-14T19:42:26.482193] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T19:42:27.158079] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-14T19:42:27.418924] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T19:42:27.958066] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-14T19:42:28.141796] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T19:42:28.529967] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T19:42:28.758102] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-14T19:42:29.558075] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-14T19:42:30.000116] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T19:42:30.328787] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T19:42:30.358083] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-14T19:42:31.158092] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-14T19:42:31.941208] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T19:42:31.958099] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-14T19:42:32.013542] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T19:42:32.730709] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T19:42:32.758034] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-14T19:42:33.558065] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-14T19:42:33.976496] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T19:42:34.358087] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-14T19:42:34.590586] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:42:35.158083] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-14T19:42:35.512025] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T19:42:35.842990] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T19:42:35.958065] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-14T19:42:36.758142] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-14T19:42:37.558045] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-14T19:42:37.677773] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T19:42:37.760687] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T19:42:38.358105] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-14T19:42:39.158076] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-14T19:42:39.244621] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T19:42:39.341412] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T19:42:39.958135] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-14T19:42:40.758055] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-14T19:42:40.781458] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:42:40.786979] [INFO ] [REMOTE ] JHG: Full fetch complete (68429 records). [2025-10-14T19:42:40.787083] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-14T19:42:41.180154] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-14T19:42:41.180306] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-14T19:42:41.181309] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-14T19:42:41.181369] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-14T19:42:41.182614] [DEBUG] [LOCAL ] JHG: Trimmed 68429 records to 47608 (keeping 200 days of data) [2025-10-14T19:42:41.365718] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-14T19:42:41.477935] [DEBUG] [LOCAL ] JHG: Primary data saved (47608 records). [2025-10-14T19:42:41.478096] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-14T19:42:41.478193] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 41.7s. Estimated remaining: 2h 51m 14s. Rate: 7.1 symbols/min [2025-10-14T19:42:41.558165] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-14T19:42:41.659944] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:41.692089] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T19:42:41.735319] [DEBUG] [LOCAL ] JKS: Loaded 39731 existing records from primary storage. [2025-10-14T19:42:41.735601] [INFO ] [MAIN ] JKS: Loaded 39731 existing records. [2025-10-14T19:42:41.919665] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:41.919905] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-14T19:42:41.919953] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-14T19:42:41.920253] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-14T19:42:41.920315] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-14T19:42:42.285608] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:42.358061] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-14T19:42:42.684231] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T19:42:43.158058] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-14T19:42:43.958075] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-14T19:42:44.092367] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T19:42:44.395024] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T19:42:44.507761] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T19:42:44.758140] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-14T19:42:45.404927] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T19:42:45.558109] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-14T19:42:46.358081] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-14T19:42:46.532400] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T19:42:47.158123] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-14T19:42:47.958037] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-14T19:42:48.083853] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T19:42:48.260023] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T19:42:48.312411] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-14T19:42:48.758058] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-14T19:42:49.558051] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-14T19:42:49.685353] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T19:42:50.358066] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-14T19:42:50.866006] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T19:42:51.158102] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-14T19:42:51.754878] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T19:42:51.958037] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-14T19:42:52.201964] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T19:42:52.758045] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-14T19:42:52.978563] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T19:42:52.981718] [INFO ] [REMOTE ] JILL: Full fetch complete (22643 records). [2025-10-14T19:42:52.981835] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-14T19:42:53.357126] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T19:42:53.357306] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-14T19:42:53.358263] [INFO ] [REMOTE ] JHS: Full fetch complete (4504 records). [2025-10-14T19:42:53.358391] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-14T19:42:53.358332] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-14T19:42:53.390856] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-14T19:42:53.402453] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-14T19:42:53.462438] [DEBUG] [LOCAL ] JILL: Trimmed 22643 records to 16017 (keeping 200 days of data) [2025-10-14T19:42:53.562834] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-14T19:42:53.813410] [DEBUG] [LOCAL ] JILL: Primary data saved (16017 records). [2025-10-14T19:42:53.835340] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-14T19:42:53.835431] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-14T19:42:53.835506] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-14T19:42:53.835767] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-14T19:42:53.835838] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-14T19:42:53.835614] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JILL took 31.4s. Estimated remaining: 2h 51m 9s. Rate: 7.1 symbols/min [2025-10-14T19:42:53.880276] [DEBUG] [LOCAL ] JHS: Trimmed 4504 records to 2944 (keeping 200 days of data) [2025-10-14T19:42:53.978534] [DEBUG] [LOCAL ] JHS: Primary data saved (2944 records). [2025-10-14T19:42:53.983758] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-14T19:42:53.983861] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHS took 39.3s. Estimated remaining: 2h 50m 52s. Rate: 7.1 symbols/min [2025-10-14T19:42:54.109811] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:54.207000] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:42:54.221541] [DEBUG] [LOCAL ] JLS: Loaded 4178 existing records from primary storage. [2025-10-14T19:42:54.221831] [INFO ] [MAIN ] JLS: Loaded 4178 existing records. [2025-10-14T19:42:54.337971] [DEBUG] [LOCAL ] JLL: Loaded 31667 existing records from primary storage. [2025-10-14T19:42:54.349131] [INFO ] [MAIN ] JLL: Loaded 31667 existing records. [2025-10-14T19:42:54.365872] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-14T19:42:54.519921] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:54.540406] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-14T19:42:54.540492] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-14T19:42:54.546460] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-14T19:42:54.551683] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-14T19:42:54.727314] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:42:54.727973] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-14T19:42:54.733486] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-14T19:42:54.754363] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-14T19:42:54.777530] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-14T19:42:55.244204] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:55.250167] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-14T19:42:55.420689] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:42:55.492515] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T19:42:55.639212] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T19:42:55.691498] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-14T19:42:55.958066] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-14T19:42:56.758048] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-14T19:42:57.072005] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T19:42:57.558091] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-14T19:42:58.169785] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T19:42:58.358068] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-14T19:42:58.499830] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T19:42:58.918624] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T19:42:59.158066] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-14T19:42:59.958075] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-14T19:43:00.758109] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-14T19:43:01.278024] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-14T19:43:01.283984] [INFO ] [REMOTE ] JHX: Full fetch complete (60946 records). [2025-10-14T19:43:01.284086] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-14T19:43:01.370574] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:43:01.559805] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-14T19:43:01.677638] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:43:01.734413] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-14T19:43:01.734498] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-14T19:43:01.735515] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-14T19:43:01.735579] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-14T19:43:01.736917] [DEBUG] [LOCAL ] JHX: Trimmed 60946 records to 53155 (keeping 200 days of data) [2025-10-14T19:43:02.044780] [DEBUG] [LOCAL ] JHX: Primary data saved (53155 records). [2025-10-14T19:43:02.044931] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-14T19:43:02.045011] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JHX took 43.1s. Estimated remaining: 2h 50m 43s. Rate: 7.1 symbols/min [2025-10-14T19:43:02.213011] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T19:43:02.358076] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-14T19:43:02.986869] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T19:43:03.158081] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-14T19:43:03.724289] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T19:43:03.958076] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-14T19:43:04.758136] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-14T19:43:05.241277] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T19:43:05.481147] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T19:43:05.558057] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-14T19:43:06.358136] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-14T19:43:06.978856] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T19:43:07.158037] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-14T19:43:07.402471] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T19:43:07.958089] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-14T19:43:08.525272] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T19:43:08.677676] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T19:43:08.758077] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-14T19:43:09.558060] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-14T19:43:10.339238] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T19:43:10.358023] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-14T19:43:10.960866] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:43:11.158095] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-14T19:43:11.418816] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:43:11.958087] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-14T19:43:12.651489] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:43:12.758141] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-14T19:43:13.155624] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T19:43:13.179052] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T19:43:13.180218] [INFO ] [REMOTE ] JLS: Full fetch complete (5855 records). [2025-10-14T19:43:13.180289] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-14T19:43:13.543015] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-14T19:43:13.543149] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-14T19:43:13.543321] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-14T19:43:13.543361] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-14T19:43:13.543737] [DEBUG] [LOCAL ] JLS: Trimmed 5855 records to 4203 (keeping 200 days of data) [2025-10-14T19:43:13.562482] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-14T19:43:13.569982] [DEBUG] [LOCAL ] JLS: Primary data saved (4203 records). [2025-10-14T19:43:13.570798] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-14T19:43:13.570892] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLS took 19.6s. Estimated remaining: 2h 50m 38s. Rate: 7.1 symbols/min [2025-10-14T19:43:14.358209] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-14T19:43:15.610714] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-14T19:43:15.616490] [INFO ] [REMOTE ] JKS: Full fetch complete (58861 records). [2025-10-14T19:43:15.616706] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-14T19:43:15.987089] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T19:43:16.038270] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-14T19:43:16.038405] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-14T19:43:16.038147] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-14T19:43:16.039503] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-14T19:43:16.039816] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-14T19:43:16.041827] [DEBUG] [LOCAL ] JKS: Trimmed 58861 records to 39715 (keeping 200 days of data) [2025-10-14T19:43:16.281959] [DEBUG] [LOCAL ] JKS: Primary data saved (39715 records). [2025-10-14T19:43:16.282106] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-14T19:43:16.282184] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JKS took 34.8s. Estimated remaining: 2h 50m 24s. Rate: 7.1 symbols/min [2025-10-14T19:43:17.436423] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T19:43:17.447259] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-14T19:43:19.076828] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T19:43:19.084913] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-14T19:43:21.058799] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T19:43:21.066705] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-14T19:43:22.382444] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T19:43:22.390583] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-14T19:43:23.655112] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T19:43:23.658672] [INFO ] [REMOTE ] JLL: Full fetch complete (44884 records). [2025-10-14T19:43:23.658820] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-14T19:43:24.052240] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-14T19:43:24.052323] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-14T19:43:24.053143] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-14T19:43:24.053206] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-14T19:43:24.054182] [DEBUG] [LOCAL ] JLL: Trimmed 44884 records to 31732 (keeping 200 days of data) [2025-10-14T19:43:24.251375] [DEBUG] [LOCAL ] JLL: Primary data saved (31732 records). [2025-10-14T19:43:24.251521] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-14T19:43:24.251607] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JLL took 30.4s. Estimated remaining: 2h 50m 15s. Rate: 7.1 symbols/min [2025-10-14T19:43:24.840275] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:43:24.936622] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-14T19:43:24.966518] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:43:24.967475] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:43:24.967981] [DEBUG] [LOCAL ] JMIA: No existing data file found in primary storage. [2025-10-14T19:43:24.967735] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-14T19:43:24.968077] [WARN ] [MAIN ] JMIA: No existing data found, performing full refresh instead. [2025-10-14T19:43:24.968614] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-14T19:43:24.968500] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-14T19:43:24.937573] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:43:24.968922] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-14T19:43:24.968850] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-14T19:43:24.969274] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-14T19:43:24.969366] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-14T19:43:24.969469] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-10-14T19:43:24.969570] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-14T19:43:25.553635] [DEBUG] [LOCAL ] JOBY: Loaded 53803 existing records from primary storage. [2025-10-14T19:43:25.597524] [INFO ] [MAIN ] JOBY: Loaded 53803 existing records. [2025-10-14T19:43:25.750336] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-14T19:43:25.755736] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:43:25.798934] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-14T19:43:25.798838] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-14T19:43:25.861335] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:43:25.891349] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-14T19:43:26.185883] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:43:26.190217] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:43:26.190456] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-14T19:43:26.190720] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-14T19:43:26.190807] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-14T19:43:26.190902] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-14T19:43:26.191411] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-14T19:43:26.191459] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-14T19:43:26.191589] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-14T19:43:26.191791] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-14T19:43:26.530249] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T19:43:26.551606] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-14T19:43:26.940522] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:43:26.946106] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:43:26.946807] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-14T19:43:26.947050] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-14T19:43:27.020301] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-14T19:43:27.021215] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-14T19:43:27.422199] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-14T19:43:27.423395] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-14T19:43:27.742182] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-14T19:43:27.743101] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-14T19:43:27.991134] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-14T19:43:28.001908] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-14T19:43:28.188985] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-14T19:43:28.190015] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-14T19:43:28.903097] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T19:43:28.904383] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-14T19:43:29.346185] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T19:43:29.347467] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-14T19:43:29.492463] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-14T19:43:29.504035] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-14T19:43:29.974727] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-10-14T19:43:29.986797] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-14T19:43:29.998392] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T19:43:30.068187] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-14T19:43:30.358104] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-14T19:43:31.158085] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-14T19:43:31.521491] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T19:43:31.609924] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T19:43:31.654241] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T19:43:31.958038] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-14T19:43:31.995527] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-14T19:43:32.758123] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-14T19:43:33.182557] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T19:43:33.558075] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-14T19:43:34.166234] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-14T19:43:34.358040] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-14T19:43:34.392923] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T19:43:34.393575] [INFO ] [REMOTE ] JMM: Full fetch complete (2304 records). [2025-10-14T19:43:34.393638] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-14T19:43:34.574397] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-14T19:43:34.574569] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:43:34.574635] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:43:34.574741] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-14T19:43:34.574801] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-14T19:43:34.574836] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-14T19:43:34.574874] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-14T19:43:34.574930] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 10.3s. Estimated remaining: 2h 50m 8s. Rate: 7.1 symbols/min [2025-10-14T19:43:34.740546] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:43:34.763423] [DEBUG] [LOCAL ] JOE: Loaded 23909 existing records from primary storage. [2025-10-14T19:43:34.763678] [INFO ] [MAIN ] JOE: Loaded 23909 existing records. [2025-10-14T19:43:34.937971] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:43:34.938139] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-14T19:43:34.938184] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-14T19:43:34.938399] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-14T19:43:34.938465] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-14T19:43:35.166279] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-14T19:43:35.291897] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:43:35.958102] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-14T19:43:36.758080] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-14T19:43:36.789181] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-14T19:43:36.871171] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T19:43:37.326435] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-14T19:43:37.558064] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-14T19:43:38.358152] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-14T19:43:38.833990] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-14T19:43:39.158082] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-14T19:43:39.864174] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-14T19:43:39.958057] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-14T19:43:40.459380] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T19:43:40.571594] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-14T19:43:40.758067] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-14T19:43:41.558051] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-14T19:43:41.855773] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T19:43:42.205444] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-14T19:43:42.358108] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-14T19:43:43.158157] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-14T19:43:43.958128] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-14T19:43:43.960570] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-14T19:43:44.323415] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T19:43:44.418010] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-14T19:43:44.758053] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-14T19:43:45.514310] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T19:43:45.558082] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-14T19:43:46.358165] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-14T19:43:47.158100] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-14T19:43:47.306157] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-14T19:43:47.390332] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T19:43:47.958049] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-14T19:43:48.211155] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T19:43:48.432754] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T19:43:48.758145] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-14T19:43:49.558043] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-14T19:43:49.913901] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T19:43:50.358080] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-14T19:43:50.568124] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-14T19:43:51.158084] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-14T19:43:51.733358] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-14T19:43:51.965562] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-14T19:43:51.986051] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T19:43:52.758106] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-14T19:43:53.558144] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-14T19:43:53.854282] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-14T19:43:53.929861] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-14T19:43:54.358046] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-14T19:43:54.564702] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T19:43:54.656913] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T19:43:55.158061] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-14T19:43:55.958082] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-14T19:43:56.758077] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-14T19:43:57.078735] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-14T19:43:57.112216] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-14T19:43:57.135116] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-14T19:43:57.135560] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-14T19:43:57.136711] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T19:43:57.538610] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-14T19:43:57.538740] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-14T19:43:57.539826] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-14T19:43:57.539888] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-14T19:43:57.541542] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-14T19:43:57.597411] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-14T19:43:57.875197] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-14T19:43:57.875331] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-14T19:43:57.875410] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JNJ took 33.6s. Estimated remaining: 2h 50m 15s. Rate: 7.1 symbols/min [2025-10-14T19:43:58.044473] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:43:58.053716] [DEBUG] [LOCAL ] JOF: Loaded 6875 existing records from primary storage. [2025-10-14T19:43:58.053921] [INFO ] [MAIN ] JOF: Loaded 6875 existing records. [2025-10-14T19:43:58.229629] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:43:58.229886] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-14T19:43:58.229936] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-14T19:43:58.230119] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-14T19:43:58.230184] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-14T19:43:58.368220] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-14T19:43:58.584997] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:43:58.676529] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T19:43:59.158086] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-14T19:43:59.575262] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T19:43:59.937296] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T19:43:59.958039] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-14T19:44:00.155405] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-14T19:44:00.526820] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T19:44:00.758072] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-14T19:44:01.558045] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-14T19:44:02.358142] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-14T19:44:03.158052] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-14T19:44:03.438603] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-14T19:44:03.455175] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-14T19:44:03.457000] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-14T19:44:03.458334] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T19:44:03.568287] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T19:44:03.879510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-14T19:44:03.933565] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-14T19:44:03.933775] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-14T19:44:03.934882] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-14T19:44:03.934993] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-14T19:44:03.937201] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53808 (keeping 200 days of data) [2025-10-14T19:44:03.986421] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-14T19:44:04.267141] [DEBUG] [LOCAL ] JOBY: Primary data saved (53808 records). [2025-10-14T19:44:04.267273] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-14T19:44:04.267349] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JOBY took 40.0s. Estimated remaining: 2h 50m 4s. Rate: 7.1 symbols/min [2025-10-14T19:44:04.434587] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:04.471304] [DEBUG] [LOCAL ] JPC: Loaded 37227 existing records from primary storage. [2025-10-14T19:44:04.471600] [INFO ] [MAIN ] JPC: Loaded 37227 existing records. [2025-10-14T19:44:04.649263] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:04.649481] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-14T19:44:04.649528] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-14T19:44:04.649854] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-14T19:44:04.649912] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-14T19:44:04.763833] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-14T19:44:05.020920] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:05.508293] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T19:44:05.558094] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-14T19:44:05.848092] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-14T19:44:05.854161] [INFO ] [REMOTE ] JMIA: Full fetch complete (73438 records). [2025-10-14T19:44:05.854310] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-14T19:44:06.245817] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-14T19:44:06.245905] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-14T19:44:06.246904] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-14T19:44:06.246967] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-14T19:44:06.248504] [DEBUG] [LOCAL ] JMIA: Trimmed 73438 records to 51026 (keeping 200 days of data) [2025-10-14T19:44:06.339312] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T19:44:06.348416] [INFO ] [REMOTE ] JOE: Full fetch complete (35702 records). [2025-10-14T19:44:06.350209] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-14T19:44:06.364626] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-14T19:44:06.860721] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-14T19:44:06.862739] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-14T19:44:06.866007] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-14T19:44:06.866679] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-14T19:44:06.879595] [DEBUG] [LOCAL ] JOE: Trimmed 35702 records to 23904 (keeping 200 days of data) [2025-10-14T19:44:07.071620] [DEBUG] [LOCAL ] JMIA: Primary data saved (51026 records). [2025-10-14T19:44:07.074668] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-14T19:44:07.074768] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JMIA took 42.8s. Estimated remaining: 2h 49m 50s. Rate: 7.1 symbols/min [2025-10-14T19:44:07.162756] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-14T19:44:07.211565] [DEBUG] [LOCAL ] JOE: Primary data saved (23904 records). [2025-10-14T19:44:07.215390] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-14T19:44:07.215864] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOE took 32.6s. Estimated remaining: 2h 49m 33s. Rate: 7.1 symbols/min [2025-10-14T19:44:07.376592] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:07.469173] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:07.521914] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-14T19:44:07.522320] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-14T19:44:07.633244] [DEBUG] [LOCAL ] JQC: Loaded 33961 existing records from primary storage. [2025-10-14T19:44:07.633931] [INFO ] [MAIN ] JQC: Loaded 33961 existing records. [2025-10-14T19:44:07.900585] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:07.894274] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:07.901590] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-14T19:44:07.901478] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-14T19:44:07.901976] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-14T19:44:07.902273] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-14T19:44:07.906345] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-14T19:44:07.909292] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-14T19:44:07.909491] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-14T19:44:07.910371] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T19:44:07.921352] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-14T19:44:07.974801] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-14T19:44:08.124785] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T19:44:08.652520] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:08.670105] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T19:44:08.705545] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:08.758048] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-14T19:44:09.558073] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-14T19:44:10.127504] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T19:44:10.358034] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-14T19:44:10.908401] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-14T19:44:11.158041] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-14T19:44:11.630906] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T19:44:11.958069] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-14T19:44:12.611951] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T19:44:12.664074] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T19:44:12.758054] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-14T19:44:13.558064] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-14T19:44:14.142138] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:44:14.143595] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T19:44:14.358103] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-14T19:44:15.062464] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T19:44:15.158098] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-14T19:44:15.905024] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T19:44:15.906546] [INFO ] [REMOTE ] JOF: Full fetch complete (9583 records). [2025-10-14T19:44:15.906618] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-14T19:44:15.966841] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-14T19:44:16.304997] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-14T19:44:16.305102] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-14T19:44:16.305603] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-14T19:44:16.305691] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-14T19:44:16.306297] [DEBUG] [LOCAL ] JOF: Trimmed 9583 records to 6886 (keeping 200 days of data) [2025-10-14T19:44:16.351341] [DEBUG] [LOCAL ] JOF: Primary data saved (6886 records). [2025-10-14T19:44:16.351522] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-14T19:44:16.351619] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JOF took 18.5s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-14T19:44:16.532455] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:16.551233] [DEBUG] [LOCAL ] JRI: Loaded 15394 existing records from primary storage. [2025-10-14T19:44:16.551548] [INFO ] [MAIN ] JRI: Loaded 15394 existing records. [2025-10-14T19:44:16.745714] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:16.746024] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-14T19:44:16.746077] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-14T19:44:16.746313] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-14T19:44:16.746405] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-14T19:44:16.768818] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-14T19:44:17.165750] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:17.499324] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T19:44:17.558045] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-14T19:44:18.358058] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-14T19:44:19.047365] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-14T19:44:19.129460] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T19:44:19.158044] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-14T19:44:19.659804] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T19:44:19.958113] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-14T19:44:20.521279] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T19:44:20.758109] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-14T19:44:21.263176] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T19:44:21.558061] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-14T19:44:22.358036] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-14T19:44:22.827982] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T19:44:22.826894] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-14T19:44:23.158048] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-14T19:44:23.722673] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T19:44:23.958078] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-14T19:44:24.147902] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T19:44:24.758086] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-14T19:44:24.933348] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T19:44:25.558101] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-14T19:44:26.131417] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T19:44:26.358089] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-14T19:44:27.050470] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T19:44:27.158044] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-14T19:44:27.782122] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T19:44:27.958094] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-14T19:44:28.452298] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T19:44:28.758073] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-14T19:44:29.297448] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T19:44:29.302022] [INFO ] [REMOTE ] JPC: Full fetch complete (55389 records). [2025-10-14T19:44:29.302126] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-14T19:44:29.566749] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-14T19:44:29.719499] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-14T19:44:29.721543] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T19:44:29.719972] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-14T19:44:29.724860] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-14T19:44:29.728551] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-14T19:44:29.730281] [DEBUG] [LOCAL ] JPC: Trimmed 55389 records to 37244 (keeping 200 days of data) [2025-10-14T19:44:29.948305] [DEBUG] [LOCAL ] JPC: Primary data saved (37244 records). [2025-10-14T19:44:29.948447] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-14T19:44:29.948526] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JPC took 25.7s. Estimated remaining: 2h 49m 22s. Rate: 7.1 symbols/min [2025-10-14T19:44:30.118460] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:30.131798] [DEBUG] [LOCAL ] JRS: Loaded 11663 existing records from primary storage. [2025-10-14T19:44:30.132019] [INFO ] [MAIN ] JRS: Loaded 11663 existing records. [2025-10-14T19:44:30.317293] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:30.317569] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-14T19:44:30.317673] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-14T19:44:30.317937] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-14T19:44:30.318011] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-14T19:44:30.363254] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-14T19:44:30.699330] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T19:44:30.703177] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:31.158069] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-14T19:44:31.958071] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-14T19:44:32.577544] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T19:44:32.764778] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-14T19:44:32.772703] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-14T19:44:32.795276] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T19:44:33.558082] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-14T19:44:34.215165] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T19:44:34.233279] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T19:44:34.358084] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-14T19:44:35.158053] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-14T19:44:35.337030] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T19:44:35.958050] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-14T19:44:35.971844] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T19:44:36.758036] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-14T19:44:37.218460] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T19:44:37.558073] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-14T19:44:38.358149] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-14T19:44:38.934156] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T19:44:38.939411] [INFO ] [REMOTE ] JQC: Full fetch complete (49689 records). [2025-10-14T19:44:38.939628] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-14T19:44:39.161618] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-14T19:44:39.328266] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T19:44:39.425397] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-14T19:44:39.425635] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-14T19:44:39.426575] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-14T19:44:39.437220] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-14T19:44:39.457780] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-14T19:44:39.468783] [DEBUG] [LOCAL ] JQC: Trimmed 49689 records to 33824 (keeping 200 days of data) [2025-10-14T19:44:39.680681] [DEBUG] [LOCAL ] JQC: Primary data saved (33824 records). [2025-10-14T19:44:39.681235] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-14T19:44:39.681336] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JQC took 32.5s. Estimated remaining: 2h 49m 15s. Rate: 7.1 symbols/min [2025-10-14T19:44:39.862106] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:39.905224] [DEBUG] [LOCAL ] JXN: Loaded 44862 existing records from primary storage. [2025-10-14T19:44:39.905586] [INFO ] [MAIN ] JXN: Loaded 44862 existing records. [2025-10-14T19:44:39.966047] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-14T19:44:40.106563] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:40.106879] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-14T19:44:40.106932] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-14T19:44:40.107241] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-14T19:44:40.107290] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-14T19:44:40.222665] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T19:44:40.544316] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:40.758081] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-14T19:44:40.932385] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T19:44:41.518690] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T19:44:41.558071] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-14T19:44:42.358061] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-14T19:44:42.942160] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T19:44:43.158085] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-14T19:44:43.216755] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T19:44:43.958114] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-14T19:44:44.026215] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T19:44:44.529342] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T19:44:44.758061] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-14T19:44:45.549005] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T19:44:45.558021] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-14T19:44:46.358117] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-14T19:44:46.491326] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T19:44:47.158060] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-14T19:44:47.942169] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T19:44:47.958017] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-14T19:44:48.623437] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-14T19:44:48.758065] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-14T19:44:48.876694] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T19:44:49.558061] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-14T19:44:49.732465] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T19:44:50.185300] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T19:44:50.187398] [INFO ] [REMOTE ] JRS: Full fetch complete (16373 records). [2025-10-14T19:44:50.187465] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-14T19:44:50.366207] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-14T19:44:50.555910] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-14T19:44:50.555981] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-14T19:44:50.556338] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-14T19:44:50.556374] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-14T19:44:50.556885] [DEBUG] [LOCAL ] JRS: Trimmed 16373 records to 11664 (keeping 200 days of data) [2025-10-14T19:44:50.626988] [DEBUG] [LOCAL ] JRS: Primary data saved (11664 records). [2025-10-14T19:44:50.627120] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-14T19:44:50.627249] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JRS took 20.7s. Estimated remaining: 2h 49m 9s. Rate: 7.1 symbols/min [2025-10-14T19:44:50.807571] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:50.854467] [DEBUG] [LOCAL ] K: Loaded 50349 existing records from primary storage. [2025-10-14T19:44:50.854813] [INFO ] [MAIN ] K: Loaded 50349 existing records. [2025-10-14T19:44:51.031156] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:51.031375] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-14T19:44:51.031422] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-14T19:44:51.031843] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-14T19:44:51.031901] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-14T19:44:51.172959] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-14T19:44:51.399124] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:51.407559] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T19:44:51.958101] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-14T19:44:52.680291] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T19:44:52.758062] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-14T19:44:53.558088] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-14T19:44:53.624611] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T19:44:53.831572] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T19:44:54.358059] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-14T19:44:54.630551] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T19:44:55.158047] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-14T19:44:55.958037] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-14T19:44:55.994827] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T19:44:56.194020] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T19:44:56.196610] [INFO ] [REMOTE ] JRI: Full fetch complete (23310 records). [2025-10-14T19:44:56.196863] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-14T19:44:56.590709] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-14T19:44:56.590793] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-14T19:44:56.591336] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-14T19:44:56.591397] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-14T19:44:56.592047] [DEBUG] [LOCAL ] JRI: Trimmed 23310 records to 15431 (keeping 200 days of data) [2025-10-14T19:44:56.692379] [DEBUG] [LOCAL ] JRI: Primary data saved (15431 records). [2025-10-14T19:44:56.692554] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-14T19:44:56.692707] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRI took 40.3s. Estimated remaining: 2h 48m 58s. Rate: 7.1 symbols/min [2025-10-14T19:44:56.763222] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-14T19:44:56.869626] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:44:56.884974] [DEBUG] [LOCAL ] KAI: Loaded 13493 existing records from primary storage. [2025-10-14T19:44:56.885234] [INFO ] [MAIN ] KAI: Loaded 13493 existing records. [2025-10-14T19:44:57.061983] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:44:57.062185] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-14T19:44:57.062231] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-14T19:44:57.062452] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-14T19:44:57.062492] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-14T19:44:57.406398] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:44:57.558026] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-14T19:44:58.170889] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-14T19:44:58.358038] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-14T19:44:58.392612] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T19:44:58.442478] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T19:44:59.158057] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-14T19:44:59.958060] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-14T19:45:00.731683] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T19:45:00.758023] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-14T19:45:00.891638] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-14T19:45:00.962456] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T19:45:01.558116] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-14T19:45:02.358109] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-14T19:45:02.519935] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T19:45:02.647124] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T19:45:03.158076] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-14T19:45:03.958070] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-14T19:45:04.758083] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-14T19:45:04.825746] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T19:45:04.857927] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T19:45:04.895447] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-14T19:45:05.558077] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-14T19:45:06.300575] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T19:45:06.358095] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-14T19:45:06.614445] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T19:45:07.158060] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-14T19:45:07.958071] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-14T19:45:08.068892] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T19:45:08.740488] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T19:45:08.758036] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-14T19:45:09.558076] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-14T19:45:10.358509] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-14T19:45:10.365003] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-14T19:45:10.445241] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T19:45:10.540747] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T19:45:11.158072] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-14T19:45:11.958066] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-14T19:45:12.099231] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T19:45:12.758047] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-14T19:45:12.881188] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T19:45:13.047389] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T19:45:13.558056] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-14T19:45:14.358067] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-14T19:45:14.389263] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T19:45:14.466674] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T19:45:15.158036] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-14T19:45:15.958087] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-14T19:45:16.135563] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T19:45:16.758074] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-14T19:45:16.777252] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T19:45:16.813821] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T19:45:17.558102] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-14T19:45:18.358096] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-14T19:45:19.164498] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-14T19:45:19.190482] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T19:45:19.228095] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-14T19:45:19.234367] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-14T19:45:19.234525] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-14T19:45:19.640694] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-14T19:45:19.640809] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-14T19:45:19.641868] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-14T19:45:19.641933] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-14T19:45:19.643461] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-14T19:45:19.958177] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-14T19:45:19.988913] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-14T19:45:19.989037] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-14T19:45:19.989131] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. JPM took 1m 13s. Estimated remaining: 2h 49m 5s. Rate: 7.1 symbols/min [2025-10-14T19:45:20.132607] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T19:45:20.217963] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:45:20.225472] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T19:45:20.271375] [DEBUG] [LOCAL ] KAR: Loaded 40157 existing records from primary storage. [2025-10-14T19:45:20.271695] [INFO ] [MAIN ] KAR: Loaded 40157 existing records. [2025-10-14T19:45:20.444207] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:45:20.444424] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-14T19:45:20.444470] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-14T19:45:20.444869] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-14T19:45:20.444929] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-14T19:45:20.784803] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-14T19:45:20.790158] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:45:21.394061] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T19:45:21.399414] [INFO ] [REMOTE ] JXN: Full fetch complete (65411 records). [2025-10-14T19:45:21.399532] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-14T19:45:21.579918] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-14T19:45:21.798847] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-14T19:45:21.798950] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-14T19:45:21.799969] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-14T19:45:21.800046] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-14T19:45:21.801443] [DEBUG] [LOCAL ] JXN: Trimmed 65411 records to 44808 (keeping 200 days of data) [2025-10-14T19:45:22.076017] [DEBUG] [LOCAL ] JXN: Primary data saved (44808 records). [2025-10-14T19:45:22.076144] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-14T19:45:22.076221] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JXN took 42.4s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-14T19:45:22.246849] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:45:22.270240] [DEBUG] [LOCAL ] KB: Loaded 23448 existing records from primary storage. [2025-10-14T19:45:22.270526] [INFO ] [MAIN ] KB: Loaded 23448 existing records. [2025-10-14T19:45:22.363198] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-14T19:45:22.456088] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:45:22.456402] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-14T19:45:22.456483] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-14T19:45:22.470910] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-14T19:45:22.471420] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T19:45:22.471492] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-14T19:45:22.552633] [INFO ] [REMOTE ] K: Full fetch complete (72262 records). [2025-10-14T19:45:22.569759] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-14T19:45:23.150744] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:45:23.178355] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-14T19:45:23.257131] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T19:45:23.324731] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-14T19:45:23.324945] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-14T19:45:23.326318] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-14T19:45:23.326386] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-14T19:45:23.327983] [DEBUG] [LOCAL ] K: Trimmed 72262 records to 50400 (keeping 200 days of data) [2025-10-14T19:45:23.429690] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T19:45:23.433594] [INFO ] [REMOTE ] KAI: Full fetch complete (19039 records). [2025-10-14T19:45:23.434597] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-14T19:45:23.842974] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-14T19:45:23.843294] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-14T19:45:23.844077] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-14T19:45:23.845111] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-14T19:45:23.848577] [DEBUG] [LOCAL ] KAI: Trimmed 19039 records to 13548 (keeping 200 days of data) [2025-10-14T19:45:23.984145] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-14T19:45:24.036563] [DEBUG] [LOCAL ] KAI: Primary data saved (13548 records). [2025-10-14T19:45:24.037684] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-14T19:45:24.037819] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. KAI took 27.3s. Estimated remaining: 2h 48m 35s. Rate: 7.1 symbols/min [2025-10-14T19:45:24.228619] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:45:24.259715] [DEBUG] [LOCAL ] KBDC: Loaded 22026 existing records from primary storage. [2025-10-14T19:45:24.260975] [INFO ] [MAIN ] KBDC: Loaded 22026 existing records. [2025-10-14T19:45:24.500292] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:45:24.502147] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-14T19:45:24.502579] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-14T19:45:24.504888] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-14T19:45:24.506006] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-14T19:45:24.563368] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T19:45:24.763049] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-14T19:45:24.825466] [DEBUG] [LOCAL ] K: Primary data saved (50400 records). [2025-10-14T19:45:24.833125] [INFO ] [MAIN ] K: Full history saved. [2025-10-14T19:45:24.833404] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 34.2s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-14T19:45:25.054264] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:45:25.110086] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:45:25.154199] [DEBUG] [LOCAL ] KBH: Loaded 48810 existing records from primary storage. [2025-10-14T19:45:25.154500] [INFO ] [MAIN ] KBH: Loaded 48810 existing records. [2025-10-14T19:45:25.364584] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:45:25.364859] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-14T19:45:25.364935] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-14T19:45:25.365559] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-14T19:45:25.365617] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-14T19:45:25.506137] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T19:45:25.559162] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-14T19:45:25.764668] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:45:25.760382] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T19:45:26.358057] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-14T19:45:26.507213] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T19:45:27.158049] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-14T19:45:27.313726] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T19:45:27.958082] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-14T19:45:28.572374] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T19:45:28.758124] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-14T19:45:29.456934] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T19:45:29.558075] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-14T19:45:30.358086] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-14T19:45:30.436532] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T19:45:30.847866] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T19:45:31.158088] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-14T19:45:31.824182] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T19:45:31.958060] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-14T19:45:32.086425] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T19:45:32.758064] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-14T19:45:33.290140] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T19:45:33.558097] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-14T19:45:34.005038] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-14T19:45:34.358133] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-14T19:45:34.466777] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-14T19:45:35.158073] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-14T19:45:35.958074] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-14T19:45:36.027577] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T19:45:36.558518] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T19:45:36.745028] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T19:45:36.758047] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-14T19:45:37.558089] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-14T19:45:37.973714] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T19:45:38.358045] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-14T19:45:38.394431] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T19:45:39.158117] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-14T19:45:39.958047] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-14T19:45:40.069471] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T19:45:40.445981] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T19:45:40.758074] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-14T19:45:40.995636] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T19:45:41.558046] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-14T19:45:41.893970] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T19:45:42.358112] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-14T19:45:43.158126] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-14T19:45:43.243231] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T19:45:43.828237] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T19:45:43.958136] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-14T19:45:44.157352] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T19:45:44.758117] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-14T19:45:45.415562] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T19:45:45.558059] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-14T19:45:45.828536] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T19:45:46.358060] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-14T19:45:47.024521] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T19:45:47.158040] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-14T19:45:47.958059] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-14T19:45:48.002803] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T19:45:48.105627] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T19:45:48.758103] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-14T19:45:49.403165] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T19:45:49.408006] [INFO ] [REMOTE ] KAR: Full fetch complete (57034 records). [2025-10-14T19:45:49.408125] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-14T19:45:49.564802] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-14T19:45:49.815884] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-14T19:45:49.815972] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-14T19:45:49.816896] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-14T19:45:49.816981] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-14T19:45:49.818100] [DEBUG] [LOCAL ] KAR: Trimmed 57034 records to 40095 (keeping 200 days of data) [2025-10-14T19:45:50.043700] [DEBUG] [LOCAL ] KAR: Primary data saved (40095 records). [2025-10-14T19:45:50.043817] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-14T19:45:50.043892] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KAR took 30.1s. Estimated remaining: 2h 48m 27s. Rate: 7.1 symbols/min [2025-10-14T19:45:50.217464] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:45:50.259437] [DEBUG] [LOCAL ] KBR: Loaded 48028 existing records from primary storage. [2025-10-14T19:45:50.259775] [INFO ] [MAIN ] KBR: Loaded 48028 existing records. [2025-10-14T19:45:50.374451] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-14T19:45:50.445558] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:45:50.446025] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-14T19:45:50.446214] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-14T19:45:50.455532] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-14T19:45:50.461314] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-14T19:45:50.572907] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T19:45:50.839167] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T19:45:50.858844] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:45:51.158133] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-14T19:45:51.451388] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T19:45:51.958117] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-14T19:45:52.758079] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-14T19:45:52.997977] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T19:45:53.530384] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T19:45:53.558041] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-14T19:45:53.785033] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T19:45:54.358115] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-14T19:45:55.158097] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-14T19:45:55.212715] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T19:45:55.958037] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-14T19:45:56.111173] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T19:45:56.191553] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T19:45:56.194183] [INFO ] [REMOTE ] KB: Full fetch complete (33710 records). [2025-10-14T19:45:56.194414] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-14T19:45:56.574799] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-14T19:45:56.574882] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-14T19:45:56.575538] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-14T19:45:56.575577] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-14T19:45:56.576345] [DEBUG] [LOCAL ] KB: Trimmed 33710 records to 23417 (keeping 200 days of data) [2025-10-14T19:45:56.726682] [DEBUG] [LOCAL ] KB: Primary data saved (23417 records). [2025-10-14T19:45:56.726839] [INFO ] [MAIN ] KB: Full history saved. [2025-10-14T19:45:56.726932] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KB took 34.7s. Estimated remaining: 2h 48m 17s. Rate: 7.1 symbols/min [2025-10-14T19:45:56.759873] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-14T19:45:56.897097] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:45:56.943805] [DEBUG] [LOCAL ] KD: Loaded 52360 existing records from primary storage. [2025-10-14T19:45:56.944118] [INFO ] [MAIN ] KD: Loaded 52360 existing records. [2025-10-14T19:45:57.119950] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:45:57.120145] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-14T19:45:57.120194] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-14T19:45:57.121140] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-14T19:45:57.121199] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-14T19:45:57.474573] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:45:57.508411] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T19:45:57.558052] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-14T19:45:58.167240] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:45:58.358070] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-14T19:45:59.004216] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T19:45:59.158070] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-14T19:45:59.958101] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-14T19:46:00.492550] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T19:46:00.758143] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-14T19:46:01.399050] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-14T19:46:01.514717] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T19:46:01.558026] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-14T19:46:01.765449] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T19:46:01.769553] [INFO ] [REMOTE ] KBDC: Full fetch complete (30045 records). [2025-10-14T19:46:01.769636] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-14T19:46:02.140568] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-14T19:46:02.140675] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-14T19:46:02.141476] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-14T19:46:02.141518] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-14T19:46:02.142310] [DEBUG] [LOCAL ] KBDC: Trimmed 30045 records to 22139 (keeping 200 days of data) [2025-10-14T19:46:02.275906] [DEBUG] [LOCAL ] KBDC: Primary data saved (22139 records). [2025-10-14T19:46:02.276030] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-14T19:46:02.276105] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KBDC took 38.2s. Estimated remaining: 2h 48m 6s. Rate: 7.1 symbols/min [2025-10-14T19:46:02.363267] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-14T19:46:02.459570] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:02.466130] [DEBUG] [LOCAL ] KEN: Loaded 4698 existing records from primary storage. [2025-10-14T19:46:02.466359] [INFO ] [MAIN ] KEN: Loaded 4698 existing records. [2025-10-14T19:46:02.643357] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:46:02.643621] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-14T19:46:02.643845] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-14T19:46:02.644061] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-14T19:46:02.644107] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-14T19:46:03.000588] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:03.026517] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:46:03.158025] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-14T19:46:03.958062] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-14T19:46:04.061202] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T19:46:04.066753] [INFO ] [REMOTE ] KBH: Full fetch complete (71011 records). [2025-10-14T19:46:04.066886] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-14T19:46:04.456900] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-14T19:46:04.457013] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-14T19:46:04.461681] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-14T19:46:04.461505] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-14T19:46:04.463183] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-14T19:46:04.464494] [DEBUG] [LOCAL ] KBH: Trimmed 71011 records to 48836 (keeping 200 days of data) [2025-10-14T19:46:04.756294] [DEBUG] [LOCAL ] KBH: Primary data saved (48836 records). [2025-10-14T19:46:04.756422] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-14T19:46:04.756498] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBH took 39.9s. Estimated remaining: 2h 47m 51s. Rate: 7.1 symbols/min [2025-10-14T19:46:04.767394] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-14T19:46:04.949026] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:04.979888] [DEBUG] [LOCAL ] KEP: Loaded 31657 existing records from primary storage. [2025-10-14T19:46:04.980152] [INFO ] [MAIN ] KEP: Loaded 31657 existing records. [2025-10-14T19:46:05.187270] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T19:46:05.192848] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:46:05.193094] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-14T19:46:05.202743] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-14T19:46:05.203558] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-14T19:46:05.203616] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-14T19:46:05.480294] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T19:46:05.566637] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-14T19:46:05.600926] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:06.040628] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T19:46:06.358098] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-14T19:46:07.158129] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-14T19:46:07.683925] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T19:46:07.958071] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-14T19:46:08.671486] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T19:46:08.758099] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-14T19:46:08.878080] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T19:46:09.327175] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T19:46:09.558067] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-14T19:46:10.358081] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-14T19:46:11.158112] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-14T19:46:11.381403] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T19:46:11.399623] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T19:46:11.958080] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-14T19:46:12.758121] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-14T19:46:12.940525] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T19:46:13.558109] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-14T19:46:13.870762] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-14T19:46:13.894178] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T19:46:14.358097] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-14T19:46:15.158044] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-14T19:46:15.211296] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T19:46:15.360817] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T19:46:15.958091] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-14T19:46:16.758057] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-14T19:46:16.850124] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T19:46:17.113683] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-14T19:46:17.327179] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T19:46:17.558049] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-14T19:46:18.358087] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-14T19:46:18.890025] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T19:46:19.158119] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-14T19:46:19.811965] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T19:46:19.958041] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-14T19:46:20.124540] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T19:46:20.758065] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-14T19:46:21.002937] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T19:46:21.392052] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-14T19:46:21.558063] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-14T19:46:22.358093] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-14T19:46:23.158069] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-14T19:46:23.207869] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T19:46:23.769543] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T19:46:23.958071] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-14T19:46:24.109533] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T19:46:24.505664] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T19:46:24.758090] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-14T19:46:25.300607] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T19:46:25.301464] [INFO ] [REMOTE ] KEN: Full fetch complete (5964 records). [2025-10-14T19:46:25.301528] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-14T19:46:25.563198] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-14T19:46:25.655422] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-14T19:46:25.655496] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-14T19:46:25.655680] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-14T19:46:25.655740] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-14T19:46:25.656101] [DEBUG] [LOCAL ] KEN: Trimmed 5964 records to 4689 (keeping 200 days of data) [2025-10-14T19:46:25.683249] [DEBUG] [LOCAL ] KEN: Primary data saved (4689 records). [2025-10-14T19:46:25.683328] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-14T19:46:25.683399] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KEN took 23.4s. Estimated remaining: 2h 47m 55s. Rate: 7.1 symbols/min [2025-10-14T19:46:25.851184] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:25.886019] [DEBUG] [LOCAL ] KEX: Loaded 38528 existing records from primary storage. [2025-10-14T19:46:25.886302] [INFO ] [MAIN ] KEX: Loaded 38528 existing records. [2025-10-14T19:46:26.066376] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:46:26.066612] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-14T19:46:26.066696] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-14T19:46:26.067546] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-14T19:46:26.067614] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-14T19:46:26.366760] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-14T19:46:26.553437] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:27.158085] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-14T19:46:27.411735] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T19:46:27.958146] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-14T19:46:28.209668] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T19:46:28.214982] [INFO ] [REMOTE ] KBR: Full fetch complete (69941 records). [2025-10-14T19:46:28.215091] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-14T19:46:28.604591] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T19:46:28.647965] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-14T19:46:28.648239] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-14T19:46:28.649353] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-14T19:46:28.649436] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-14T19:46:28.651060] [DEBUG] [LOCAL ] KBR: Trimmed 69941 records to 48037 (keeping 200 days of data) [2025-10-14T19:46:28.758115] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-14T19:46:28.946199] [DEBUG] [LOCAL ] KBR: Primary data saved (48037 records). [2025-10-14T19:46:28.946334] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-14T19:46:28.946414] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KBR took 38.9s. Estimated remaining: 2h 47m 41s. Rate: 7.1 symbols/min [2025-10-14T19:46:29.117581] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:29.117841] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-14T19:46:29.117912] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-14T19:46:29.118056] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-14T19:46:29.118131] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-14T19:46:29.118235] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-14T19:46:29.118377] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-14T19:46:29.503442] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T19:46:29.501532] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:29.558062] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-14T19:46:30.358092] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-14T19:46:30.613925] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T19:46:31.158083] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-14T19:46:31.340366] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T19:46:31.811284] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T19:46:31.958118] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-14T19:46:32.266410] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T19:46:32.758073] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-14T19:46:33.558058] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-14T19:46:33.719306] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T19:46:33.781860] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T19:46:34.358113] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-14T19:46:34.951373] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T19:46:35.158081] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-14T19:46:35.958035] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-14T19:46:36.155007] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T19:46:36.607904] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T19:46:36.758094] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-14T19:46:37.382639] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T19:46:37.386437] [INFO ] [REMOTE ] KEP: Full fetch complete (42026 records). [2025-10-14T19:46:37.386526] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-14T19:46:37.572184] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-14T19:46:37.761298] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-14T19:46:37.761374] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-14T19:46:37.762119] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-14T19:46:37.762178] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-14T19:46:37.763113] [DEBUG] [LOCAL ] KEP: Trimmed 42026 records to 31864 (keeping 200 days of data) [2025-10-14T19:46:37.945216] [DEBUG] [LOCAL ] KEP: Primary data saved (31864 records). [2025-10-14T19:46:37.945354] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-14T19:46:37.945433] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KEP took 33.2s. Estimated remaining: 2h 47m 34s. Rate: 7.1 symbols/min [2025-10-14T19:46:38.121379] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:38.168534] [DEBUG] [LOCAL ] KEYS: Loaded 43256 existing records from primary storage. [2025-10-14T19:46:38.168868] [INFO ] [MAIN ] KEYS: Loaded 43256 existing records. [2025-10-14T19:46:38.330812] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T19:46:38.358571] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-14T19:46:38.379350] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:46:38.380373] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-14T19:46:38.380421] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-14T19:46:38.381177] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-14T19:46:38.381236] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-14T19:46:38.738969] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:39.158144] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-14T19:46:39.436913] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-14T19:46:39.442953] [INFO ] [REMOTE ] KD: Full fetch complete (75969 records). [2025-10-14T19:46:39.443105] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-14T19:46:39.831117] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-14T19:46:39.831254] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-14T19:46:39.832294] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-14T19:46:39.832353] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-14T19:46:39.833721] [DEBUG] [LOCAL ] KD: Trimmed 75969 records to 52358 (keeping 200 days of data) [2025-10-14T19:46:39.997084] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-14T19:46:40.145546] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T19:46:40.176660] [DEBUG] [LOCAL ] KD: Primary data saved (52358 records). [2025-10-14T19:46:40.176769] [INFO ] [MAIN ] KD: Full history saved. [2025-10-14T19:46:40.176841] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KD took 43.4s. Estimated remaining: 2h 47m 19s. Rate: 7.1 symbols/min [2025-10-14T19:46:40.346448] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:40.350218] [DEBUG] [LOCAL ] KF: Loaded 2335 existing records from primary storage. [2025-10-14T19:46:40.350353] [INFO ] [MAIN ] KF: Loaded 2335 existing records. [2025-10-14T19:46:40.527774] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:46:40.528092] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-14T19:46:40.528206] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-14T19:46:40.528506] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-14T19:46:40.528565] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-14T19:46:40.769369] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-14T19:46:40.924186] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:40.928921] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T19:46:41.211025] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T19:46:41.558060] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-14T19:46:42.358144] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-14T19:46:42.662051] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T19:46:43.002182] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T19:46:43.158038] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-14T19:46:43.936201] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T19:46:43.958032] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-14T19:46:44.758051] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-14T19:46:44.843538] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T19:46:45.090196] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-14T19:46:45.329197] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T19:46:45.558077] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-14T19:46:46.033478] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T19:46:46.358060] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-14T19:46:47.158062] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-14T19:46:47.864941] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T19:46:47.887928] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T19:46:47.958035] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-14T19:46:48.758067] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-14T19:46:49.558077] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-14T19:46:49.869607] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T19:46:50.344568] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T19:46:50.358014] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-14T19:46:51.162062] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-14T19:46:51.173233] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T19:46:51.461951] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-14T19:46:51.466741] [INFO ] [REMOTE ] KEX: Full fetch complete (55928 records). [2025-10-14T19:46:51.466845] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-14T19:46:51.868635] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-14T19:46:51.868741] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-14T19:46:51.869621] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-14T19:46:51.869690] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-14T19:46:51.870765] [DEBUG] [LOCAL ] KEX: Trimmed 55928 records to 38548 (keeping 200 days of data) [2025-10-14T19:46:51.958049] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-14T19:46:52.107631] [DEBUG] [LOCAL ] KEX: Primary data saved (38548 records). [2025-10-14T19:46:52.107795] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-14T19:46:52.107876] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEX took 26.4s. Estimated remaining: 2h 47m 14s. Rate: 7.1 symbols/min [2025-10-14T19:46:52.274253] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:46:52.292292] [DEBUG] [LOCAL ] KFRC: Loaded 20312 existing records from primary storage. [2025-10-14T19:46:52.292508] [INFO ] [MAIN ] KFRC: Loaded 20312 existing records. [2025-10-14T19:46:52.465930] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:46:52.466121] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-14T19:46:52.466166] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-14T19:46:52.466698] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-14T19:46:52.466755] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-14T19:46:52.763199] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-14T19:46:52.824142] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:46:53.039030] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T19:46:53.290756] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-14T19:46:53.558049] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-14T19:46:53.653720] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:46:54.358154] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-14T19:46:54.903333] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T19:46:55.158088] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-14T19:46:55.251103] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T19:46:55.958090] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-14T19:46:56.124393] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T19:46:56.758076] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-14T19:46:57.428780] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T19:46:57.558062] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-14T19:46:58.153099] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T19:46:58.358088] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-14T19:46:58.705923] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T19:46:59.158090] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-14T19:46:59.232936] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T19:46:59.539185] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-14T19:46:59.958066] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-14T19:47:00.314923] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-14T19:47:00.758079] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-14T19:47:01.558079] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-14T19:47:01.759183] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T19:47:02.358076] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-14T19:47:03.101473] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T19:47:03.158043] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-14T19:47:03.927288] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T19:47:03.958032] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-14T19:47:04.761039] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-14T19:47:04.765783] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T19:47:05.221601] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T19:47:05.558083] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-14T19:47:05.629686] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T19:47:06.358093] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-14T19:47:06.549967] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T19:47:06.777202] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T19:47:07.158086] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-14T19:47:07.691429] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T19:47:07.692264] [INFO ] [REMOTE ] KF: Full fetch complete (3557 records). [2025-10-14T19:47:07.692331] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-14T19:47:07.963226] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-14T19:47:08.054429] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-14T19:47:08.054502] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-14T19:47:08.054625] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-14T19:47:08.054706] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-14T19:47:08.055058] [DEBUG] [LOCAL ] KF: Trimmed 3557 records to 2339 (keeping 200 days of data) [2025-10-14T19:47:08.068823] [DEBUG] [LOCAL ] KF: Primary data saved (2339 records). [2025-10-14T19:47:08.068886] [INFO ] [MAIN ] KF: Full history saved. [2025-10-14T19:47:08.068953] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KF took 27.9s. Estimated remaining: 2h 47m 13s. Rate: 7.1 symbols/min [2025-10-14T19:47:08.239730] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:08.249300] [DEBUG] [LOCAL ] KFS: Loaded 8662 existing records from primary storage. [2025-10-14T19:47:08.249513] [INFO ] [MAIN ] KFS: Loaded 8662 existing records. [2025-10-14T19:47:08.429879] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:08.430091] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-14T19:47:08.430142] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-14T19:47:08.430390] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-14T19:47:08.430447] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-14T19:47:08.760508] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-14T19:47:08.787744] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:09.558115] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-14T19:47:09.789022] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-14T19:47:09.796058] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-14T19:47:09.796245] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-14T19:47:10.027504] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T19:47:10.028472] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:47:10.028549] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:47:10.028600] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-14T19:47:10.028700] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-14T19:47:10.028775] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-14T19:47:10.028849] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-14T19:47:10.028918] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 41.1s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-14T19:47:10.168514] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T19:47:10.235741] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:10.267344] [DEBUG] [LOCAL ] KFY: Loaded 30001 existing records from primary storage. [2025-10-14T19:47:10.267629] [INFO ] [MAIN ] KFY: Loaded 30001 existing records. [2025-10-14T19:47:10.367664] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-14T19:47:10.471388] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:10.473227] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T19:47:10.473464] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-14T19:47:10.482369] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-14T19:47:10.483015] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-14T19:47:10.483371] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-14T19:47:10.848125] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:11.038900] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T19:47:11.158057] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-14T19:47:11.958152] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-14T19:47:12.545459] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T19:47:12.758084] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-14T19:47:13.323619] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T19:47:13.465897] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:47:13.558036] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-14T19:47:14.218855] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T19:47:14.358080] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-14T19:47:15.158060] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-14T19:47:15.575237] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T19:47:15.947404] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T19:47:15.958053] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-14T19:47:16.758163] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-14T19:47:17.476864] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:47:17.482147] [INFO ] [REMOTE ] KEYS: Full fetch complete (62829 records). [2025-10-14T19:47:17.482280] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-14T19:47:17.559487] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-14T19:47:17.595148] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T19:47:17.886041] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-14T19:47:17.886127] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-14T19:47:17.887062] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-14T19:47:17.887123] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-14T19:47:17.888456] [DEBUG] [LOCAL ] KEYS: Trimmed 62829 records to 43320 (keeping 200 days of data) [2025-10-14T19:47:18.159407] [DEBUG] [LOCAL ] KEYS: Primary data saved (43320 records). [2025-10-14T19:47:18.159532] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-14T19:47:18.159608] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KEYS took 40.2s. Estimated remaining: 2h 46m 49s. Rate: 7.1 symbols/min [2025-10-14T19:47:18.326205] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:18.358070] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-14T19:47:18.380009] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-14T19:47:18.380322] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-14T19:47:18.563150] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:18.563521] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-14T19:47:18.563577] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-14T19:47:18.564418] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-14T19:47:18.564475] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-14T19:47:18.940174] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:18.942073] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:47:19.130154] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T19:47:19.158023] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-14T19:47:19.927521] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T19:47:19.958046] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-14T19:47:20.700877] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T19:47:20.758053] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-14T19:47:21.532504] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T19:47:21.558066] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-14T19:47:22.358066] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-14T19:47:23.083042] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T19:47:23.158076] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-14T19:47:23.320814] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T19:47:23.322281] [INFO ] [REMOTE ] KFS: Full fetch complete (10932 records). [2025-10-14T19:47:23.322358] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-14T19:47:23.703353] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-14T19:47:23.703428] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-14T19:47:23.703700] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-14T19:47:23.703769] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-14T19:47:23.704229] [DEBUG] [LOCAL ] KFS: Trimmed 10932 records to 8695 (keeping 200 days of data) [2025-10-14T19:47:23.760807] [DEBUG] [LOCAL ] KFS: Primary data saved (8695 records). [2025-10-14T19:47:23.760962] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-14T19:47:23.761052] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KFS took 15.7s. Estimated remaining: 2h 46m 38s. Rate: 7.1 symbols/min [2025-10-14T19:47:23.947214] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:23.958040] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-14T19:47:23.990455] [DEBUG] [LOCAL ] KGS: Loaded 46095 existing records from primary storage. [2025-10-14T19:47:23.990849] [INFO ] [MAIN ] KGS: Loaded 46095 existing records. [2025-10-14T19:47:24.192626] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:24.198123] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-14T19:47:24.203356] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-14T19:47:24.204465] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-14T19:47:24.204401] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T19:47:24.204569] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-14T19:47:24.596852] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:24.758049] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-14T19:47:25.503971] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:47:25.558077] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-14T19:47:26.235965] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T19:47:26.358052] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-14T19:47:27.158045] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-14T19:47:27.431366] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T19:47:27.855101] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T19:47:27.958068] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-14T19:47:28.148289] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T19:47:28.758085] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-14T19:47:28.928917] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T19:47:29.558108] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-14T19:47:29.683996] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T19:47:30.358101] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-14T19:47:30.570934] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T19:47:31.158043] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-14T19:47:31.958081] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-14T19:47:32.192841] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T19:47:32.337322] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T19:47:32.758088] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-14T19:47:33.263671] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T19:47:33.558132] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-14T19:47:33.838788] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T19:47:34.358117] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-14T19:47:34.842776] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T19:47:35.158097] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-14T19:47:35.835365] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T19:47:35.958028] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-14T19:47:36.001136] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T19:47:36.004193] [INFO ] [REMOTE ] KFRC: Full fetch complete (26402 records). [2025-10-14T19:47:36.004263] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-14T19:47:36.370603] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-14T19:47:36.370702] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-14T19:47:36.371236] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-14T19:47:36.371275] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-14T19:47:36.371951] [DEBUG] [LOCAL ] KFRC: Trimmed 26402 records to 20396 (keeping 200 days of data) [2025-10-14T19:47:36.498319] [DEBUG] [LOCAL ] KFRC: Primary data saved (20396 records). [2025-10-14T19:47:36.498450] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-14T19:47:36.498528] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFRC took 44.4s. Estimated remaining: 2h 46m 34s. Rate: 7.1 symbols/min [2025-10-14T19:47:36.672574] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:36.718924] [DEBUG] [LOCAL ] KIM: Loaded 52996 existing records from primary storage. [2025-10-14T19:47:36.719220] [INFO ] [MAIN ] KIM: Loaded 52996 existing records. [2025-10-14T19:47:36.763289] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-14T19:47:36.902404] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:36.902665] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-14T19:47:36.902728] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-14T19:47:36.903819] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-14T19:47:36.903878] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-14T19:47:37.357527] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:37.534401] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:47:37.558129] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-14T19:47:38.358088] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-14T19:47:38.654995] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-14T19:47:38.759132] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T19:47:39.158062] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-14T19:47:39.958054] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-14T19:47:40.039027] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T19:47:40.758080] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-14T19:47:41.037323] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T19:47:41.154776] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T19:47:41.558067] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-14T19:47:42.305304] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T19:47:42.358051] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-14T19:47:42.805313] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T19:47:43.158128] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-14T19:47:43.446849] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T19:47:43.958065] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-14T19:47:44.170698] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T19:47:44.758068] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-14T19:47:45.535813] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T19:47:45.558035] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-14T19:47:46.335063] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T19:47:46.358026] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-14T19:47:46.754955] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T19:47:46.758588] [INFO ] [REMOTE ] KFY: Full fetch complete (43289 records). [2025-10-14T19:47:46.758708] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-14T19:47:47.130723] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-14T19:47:47.130804] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-14T19:47:47.131560] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-14T19:47:47.131598] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-14T19:47:47.132596] [DEBUG] [LOCAL ] KFY: Trimmed 43289 records to 29975 (keeping 200 days of data) [2025-10-14T19:47:47.185310] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-14T19:47:47.319500] [DEBUG] [LOCAL ] KFY: Primary data saved (29975 records). [2025-10-14T19:47:47.319629] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-14T19:47:47.319743] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KFY took 37.3s. Estimated remaining: 2h 46m 27s. Rate: 7.1 symbols/min [2025-10-14T19:47:47.492303] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:47.512865] [DEBUG] [LOCAL ] KIO: Loaded 21587 existing records from primary storage. [2025-10-14T19:47:47.513216] [INFO ] [MAIN ] KIO: Loaded 21587 existing records. [2025-10-14T19:47:47.692526] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:47.692787] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-14T19:47:47.692835] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-14T19:47:47.693444] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-14T19:47:47.693501] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-14T19:47:47.960096] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-14T19:47:48.074074] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:48.100522] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T19:47:48.758065] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-14T19:47:49.370857] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T19:47:49.558042] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-14T19:47:49.741026] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T19:47:50.182431] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T19:47:50.358068] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-14T19:47:51.158040] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-14T19:47:51.556965] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T19:47:51.958122] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-14T19:47:52.087465] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T19:47:52.210258] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T19:47:52.758058] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-14T19:47:53.558089] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-14T19:47:53.701457] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T19:47:53.860275] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T19:47:54.358067] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-14T19:47:55.026903] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T19:47:55.032145] [INFO ] [REMOTE ] KGS: Full fetch complete (66591 records). [2025-10-14T19:47:55.032254] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-14T19:47:55.171701] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-14T19:47:55.429484] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-14T19:47:55.429564] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-14T19:47:55.430524] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-14T19:47:55.430583] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-14T19:47:55.431846] [DEBUG] [LOCAL ] KGS: Trimmed 66591 records to 46153 (keeping 200 days of data) [2025-10-14T19:47:55.712065] [DEBUG] [LOCAL ] KGS: Primary data saved (46153 records). [2025-10-14T19:47:55.712191] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-14T19:47:55.712269] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KGS took 32.0s. Estimated remaining: 2h 46m 19s. Rate: 7.1 symbols/min [2025-10-14T19:47:55.889496] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:47:55.939116] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-14T19:47:55.939409] [INFO ] [MAIN ] KKR: Loaded 53503 existing records. [2025-10-14T19:47:55.970772] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-14T19:47:56.123143] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:47:56.123470] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-14T19:47:56.123635] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-14T19:47:56.135577] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-14T19:47:56.154458] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-14T19:47:56.237838] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T19:47:56.587002] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:47:56.758045] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-14T19:47:57.080561] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T19:47:57.281146] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-14T19:47:57.558075] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-14T19:47:58.108821] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T19:47:58.358078] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-14T19:47:59.158110] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-14T19:47:59.577062] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-14T19:47:59.958081] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-14T19:48:00.206596] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T19:48:00.758054] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-14T19:48:00.981209] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T19:48:01.558097] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-14T19:48:01.932770] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T19:48:02.112195] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-14T19:48:02.358092] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-14T19:48:03.158082] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-14T19:48:03.396267] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T19:48:03.617506] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T19:48:03.958108] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-14T19:48:04.714931] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T19:48:04.758045] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-14T19:48:05.097247] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T19:48:05.558097] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-14T19:48:06.358061] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-14T19:48:06.590452] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T19:48:06.958270] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T19:48:07.158071] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-14T19:48:07.293339] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T19:48:07.958103] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-14T19:48:08.758124] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-14T19:48:09.294009] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-14T19:48:09.300243] [INFO ] [REMOTE ] KGC: Full fetch complete (77862 records). [2025-10-14T19:48:09.300400] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-14T19:48:09.574685] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-14T19:48:09.725713] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-14T19:48:09.725827] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-14T19:48:09.727117] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-14T19:48:09.727183] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-14T19:48:09.728829] [DEBUG] [LOCAL ] KGC: Trimmed 77862 records to 53700 (keeping 200 days of data) [2025-10-14T19:48:09.855426] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T19:48:10.018294] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T19:48:10.137151] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-14T19:48:10.137294] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-14T19:48:10.137374] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGC took 52.0s. Estimated remaining: 2h 46m 16s. Rate: 7.1 symbols/min [2025-10-14T19:48:10.311557] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:10.322106] [DEBUG] [LOCAL ] KKRS: Loaded 5732 existing records from primary storage. [2025-10-14T19:48:10.322344] [INFO ] [MAIN ] KKRS: Loaded 5732 existing records. [2025-10-14T19:48:10.364038] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-14T19:48:10.498283] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:10.498479] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-14T19:48:10.498525] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-14T19:48:10.498773] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-14T19:48:10.498829] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-14T19:48:10.843737] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:11.158054] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-14T19:48:11.309144] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T19:48:11.318143] [INFO ] [REMOTE ] KIM: Full fetch complete (76963 records). [2025-10-14T19:48:11.318368] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-14T19:48:11.724578] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T19:48:11.717730] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T19:48:11.812126] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-14T19:48:11.812214] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-14T19:48:11.813632] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-14T19:48:11.813716] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-14T19:48:11.815190] [DEBUG] [LOCAL ] KIM: Trimmed 76963 records to 52997 (keeping 200 days of data) [2025-10-14T19:48:11.990590] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-14T19:48:12.152144] [DEBUG] [LOCAL ] KIM: Primary data saved (52997 records). [2025-10-14T19:48:12.152278] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-14T19:48:12.152353] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KIM took 35.7s. Estimated remaining: 2h 46m 2s. Rate: 7.1 symbols/min [2025-10-14T19:48:12.328177] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:12.328307] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-14T19:48:12.328343] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-14T19:48:12.328450] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-14T19:48:12.328490] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-14T19:48:12.328529] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-14T19:48:12.328563] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-14T19:48:12.605190] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T19:48:12.683875] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:12.758034] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-14T19:48:12.954917] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:48:12.955386] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-14T19:48:12.955495] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:48:12.955571] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-14T19:48:12.955616] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:48:12.955711] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-14T19:48:12.955785] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-14T19:48:12.955823] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-14T19:48:12.955862] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-14T19:48:12.955916] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KKRT took 0.8s. Estimated remaining: 2h 45m 46s. Rate: 7.1 symbols/min [2025-10-14T19:48:13.126269] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:13.126457] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-14T19:48:13.126495] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-14T19:48:13.126603] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-14T19:48:13.126665] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-14T19:48:13.126731] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-14T19:48:13.126765] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-14T19:48:13.469499] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:13.558041] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-14T19:48:14.358082] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-14T19:48:15.158056] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-14T19:48:15.361692] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T19:48:15.595415] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T19:48:15.806987] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T19:48:15.958094] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-14T19:48:16.758116] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-14T19:48:17.140450] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T19:48:17.143502] [INFO ] [REMOTE ] KIO: Full fetch complete (31766 records). [2025-10-14T19:48:17.143765] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-14T19:48:17.542053] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-14T19:48:17.542155] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-14T19:48:17.542975] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-14T19:48:17.543052] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-14T19:48:17.544232] [DEBUG] [LOCAL ] KIO: Trimmed 31766 records to 21606 (keeping 200 days of data) [2025-10-14T19:48:17.605150] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-14T19:48:17.684899] [DEBUG] [LOCAL ] KIO: Primary data saved (21606 records). [2025-10-14T19:48:17.685019] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-14T19:48:17.685152] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KIO took 30.4s. Estimated remaining: 2h 45m 33s. Rate: 7.1 symbols/min [2025-10-14T19:48:17.857368] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:48:17.857194] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:17.858043] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-14T19:48:17.858238] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:48:17.858326] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-14T19:48:17.858407] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:48:17.858495] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-14T19:48:17.858589] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-14T19:48:17.858692] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-14T19:48:17.858783] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-14T19:48:17.858882] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KLAR took 4.9s. Estimated remaining: 2h 45m 17s. Rate: 7.1 symbols/min [2025-10-14T19:48:18.063265] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:18.064889] [DEBUG] [LOCAL ] KLC: Loaded 36593 existing records from primary storage. [2025-10-14T19:48:18.065182] [INFO ] [MAIN ] KLC: Loaded 36593 existing records. [2025-10-14T19:48:18.267005] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:18.267307] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-14T19:48:18.267372] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-14T19:48:18.268197] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-14T19:48:18.268257] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-14T19:48:18.359491] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-14T19:48:18.429033] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-14T19:48:18.453798] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-14T19:48:18.832986] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:18.869420] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:18.869747] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-14T19:48:18.870367] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-14T19:48:18.871471] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-14T19:48:18.871533] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-14T19:48:18.970457] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:48:19.184302] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-14T19:48:19.230460] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-14T19:48:19.300072] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:19.958105] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-14T19:48:20.483767] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T19:48:20.695447] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-14T19:48:20.758066] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-14T19:48:21.517709] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T19:48:21.558047] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-14T19:48:22.358034] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-14T19:48:22.806283] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T19:48:23.158106] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-14T19:48:23.749259] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T19:48:23.958086] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-14T19:48:24.103990] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T19:48:24.758076] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-14T19:48:25.330268] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T19:48:25.558042] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-14T19:48:25.626876] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T19:48:26.118390] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T19:48:26.358129] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-14T19:48:27.158098] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-14T19:48:27.264717] [DEBUG] [REMOTE ] KKR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-14T19:48:27.265071] [WARN ] [REMOTE ] KKR: No data returned for month 2025-07 [2025-10-14T19:48:27.265183] [FATAL] [REMOTE ] KKR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:48:27.265314] [FATAL] [MAIN ] KKR: Failed to fetch primary data. [2025-10-14T19:48:27.265403] [WARN ] [MAIN ] KKR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:48:27.265498] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-14T19:48:27.265599] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-10-14T19:48:27.265706] [INFO ] [LOCAL ] KKR: Starting deletion of derivative data. [2025-10-14T19:48:27.266000] [DEBUG] [LOCAL ] KKR: Deleted derivative data file. [2025-10-14T19:48:27.266112] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKR took 31.6s. Estimated remaining: 2h 45m 9s. Rate: 7.1 symbols/min [2025-10-14T19:48:27.462615] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:27.467607] [DEBUG] [LOCAL ] KMPB: Loaded 3733 existing records from primary storage. [2025-10-14T19:48:27.467813] [INFO ] [MAIN ] KMPB: Loaded 3733 existing records. [2025-10-14T19:48:27.644569] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:27.644830] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-14T19:48:27.644890] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-14T19:48:27.645080] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-14T19:48:27.645137] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-14T19:48:27.961959] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-14T19:48:27.997476] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:28.483093] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-14T19:48:28.513914] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T19:48:28.758118] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-14T19:48:29.558065] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-14T19:48:30.358139] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-14T19:48:30.660172] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T19:48:30.707243] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T19:48:30.886762] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T19:48:30.888330] [INFO ] [REMOTE ] KKRS: Full fetch complete (7700 records). [2025-10-14T19:48:30.888435] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-14T19:48:31.163252] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-14T19:48:31.360485] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-14T19:48:31.360566] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-14T19:48:31.361069] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-14T19:48:31.361130] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-14T19:48:31.361772] [DEBUG] [LOCAL ] KKRS: Trimmed 7700 records to 5647 (keeping 200 days of data) [2025-10-14T19:48:31.400043] [DEBUG] [LOCAL ] KKRS: Primary data saved (5647 records). [2025-10-14T19:48:31.400163] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-14T19:48:31.400243] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKRS took 21.3s. Estimated remaining: 2h 44m 57s. Rate: 7.1 symbols/min [2025-10-14T19:48:31.958079] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-14T19:48:32.067439] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T19:48:32.758154] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-14T19:48:33.558094] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-14T19:48:33.826551] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T19:48:33.991681] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T19:48:34.092157] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T19:48:34.358108] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-14T19:48:35.158098] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-14T19:48:35.824775] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T19:48:35.958051] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-14T19:48:36.758040] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-14T19:48:37.120202] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T19:48:37.296118] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T19:48:37.412273] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T19:48:37.558063] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-14T19:48:38.358075] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-14T19:48:38.941710] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T19:48:39.158105] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-14T19:48:39.496424] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T19:48:39.958109] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-14T19:48:40.584701] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:48:40.758057] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-14T19:48:41.558097] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-14T19:48:41.741936] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T19:48:41.793692] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T19:48:42.092104] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-14T19:48:42.358054] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-14T19:48:42.798797] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T19:48:43.158061] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-14T19:48:43.723462] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T19:48:43.958091] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-14T19:48:44.464539] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-14T19:48:44.758085] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-14T19:48:45.558069] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-14T19:48:46.358099] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-14T19:48:46.915959] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T19:48:47.030259] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T19:48:47.060706] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-14T19:48:47.158082] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-14T19:48:47.708234] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T19:48:47.958069] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-14T19:48:48.524442] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T19:48:48.525388] [INFO ] [REMOTE ] KMPB: Full fetch complete (5037 records). [2025-10-14T19:48:48.525453] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-14T19:48:48.766357] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-14T19:48:48.884298] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-14T19:48:48.884372] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-14T19:48:48.884530] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-14T19:48:48.884568] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-14T19:48:48.884944] [DEBUG] [LOCAL ] KMPB: Trimmed 5037 records to 3693 (keeping 200 days of data) [2025-10-14T19:48:48.906900] [DEBUG] [LOCAL ] KMPB: Primary data saved (3693 records). [2025-10-14T19:48:48.906962] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-14T19:48:48.907027] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KMPB took 21.6s. Estimated remaining: 2h 44m 57s. Rate: 7.1 symbols/min [2025-10-14T19:48:49.558083] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-14T19:48:50.863026] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-14T19:48:50.876100] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-14T19:48:51.036444] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T19:48:51.158074] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-14T19:48:52.712108] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T19:48:52.717085] [INFO ] [REMOTE ] KLC: Full fetch complete (50525 records). [2025-10-14T19:48:52.717200] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-14T19:48:52.878089] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T19:48:52.928860] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-14T19:48:53.160961] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-14T19:48:53.161035] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-14T19:48:53.161895] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-14T19:48:53.161956] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-14T19:48:53.163023] [DEBUG] [LOCAL ] KLC: Trimmed 50525 records to 36536 (keeping 200 days of data) [2025-10-14T19:48:53.370662] [DEBUG] [LOCAL ] KLC: Primary data saved (36536 records). [2025-10-14T19:48:53.370811] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-14T19:48:53.370892] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KLC took 35.7s. Estimated remaining: 2h 44m 45s. Rate: 7.1 symbols/min [2025-10-14T19:48:54.868606] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-14T19:48:54.874568] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-14T19:48:54.874717] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-14T19:48:55.280940] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-14T19:48:55.281020] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-14T19:48:55.282048] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-14T19:48:55.282111] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-14T19:48:55.283537] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-14T19:48:55.608052] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-14T19:48:55.608184] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-14T19:48:55.608279] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KMI took 37.7s. Estimated remaining: 2h 44m 30s. Rate: 7.1 symbols/min [2025-10-14T19:48:56.245879] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:56.228622] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:56.286586] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:56.320294] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:48:56.391429] [DEBUG] [LOCAL ] KMT: Loaded 42905 existing records from primary storage. [2025-10-14T19:48:56.417021] [INFO ] [MAIN ] KMT: Loaded 42905 existing records. [2025-10-14T19:48:56.475312] [DEBUG] [LOCAL ] KMX: Loaded 53264 existing records from primary storage. [2025-10-14T19:48:56.485088] [DEBUG] [LOCAL ] KMPR: Loaded 39744 existing records from primary storage. [2025-10-14T19:48:56.494229] [INFO ] [MAIN ] KMX: Loaded 53264 existing records. [2025-10-14T19:48:56.516187] [INFO ] [MAIN ] KMPR: Loaded 39744 existing records. [2025-10-14T19:48:56.516018] [DEBUG] [LOCAL ] KN: Loaded 38584 existing records from primary storage. [2025-10-14T19:48:56.572526] [INFO ] [MAIN ] KN: Loaded 38584 existing records. [2025-10-14T19:48:56.969840] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:57.101525] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-14T19:48:57.172056] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:57.172162] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-14T19:48:57.200480] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-14T19:48:57.207157] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:57.203723] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-14T19:48:57.214677] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-14T19:48:57.214480] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-14T19:48:57.235843] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-14T19:48:57.235770] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-14T19:48:57.242409] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-14T19:48:57.236007] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-14T19:48:57.235599] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:48:57.278804] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-14T19:48:57.264024] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-14T19:48:57.302567] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-14T19:48:57.342747] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-14T19:48:57.348109] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-14T19:48:57.400286] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-14T19:48:58.616868] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:58.637209] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-14T19:48:58.681950] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:58.734027] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-14T19:48:58.745338] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:58.754561] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-14T19:48:58.793992] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:48:58.794824] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-14T19:48:59.973263] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T19:48:59.979073] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-14T19:49:00.129960] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T19:49:00.138602] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-14T19:49:00.178335] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T19:49:00.186174] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-14T19:49:00.475712] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T19:49:00.486314] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-14T19:49:00.991718] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T19:49:00.997537] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-14T19:49:01.445743] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T19:49:01.454697] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-14T19:49:01.800056] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T19:49:01.807707] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-14T19:49:01.933938] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T19:49:01.939843] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-14T19:49:02.350971] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T19:49:02.361319] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-14T19:49:02.662310] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T19:49:02.818853] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T19:49:03.158114] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-14T19:49:03.221468] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T19:49:03.934133] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T19:49:03.958028] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-14T19:49:04.651620] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T19:49:04.758036] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-14T19:49:05.558068] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-14T19:49:05.773894] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T19:49:06.358136] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-14T19:49:06.394371] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T19:49:07.072112] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T19:49:07.158085] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-14T19:49:07.816580] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T19:49:07.958046] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-14T19:49:08.225733] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T19:49:08.758090] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-14T19:49:09.558058] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-14T19:49:09.914618] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T19:49:10.013227] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T19:49:10.358099] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-14T19:49:11.169962] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-14T19:49:11.176740] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T19:49:11.826826] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T19:49:11.958046] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-14T19:49:12.549177] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T19:49:12.758043] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-14T19:49:13.558040] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-14T19:49:13.818529] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T19:49:14.079607] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T19:49:14.358096] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-14T19:49:14.554610] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T19:49:15.158081] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-14T19:49:15.958063] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-14T19:49:16.277308] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T19:49:16.723135] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T19:49:16.758028] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-14T19:49:17.466595] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T19:49:17.558031] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-14T19:49:18.324533] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T19:49:18.358046] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-14T19:49:19.021087] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T19:49:19.158030] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-14T19:49:19.866581] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:49:19.958044] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-14T19:49:20.658486] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T19:49:20.758128] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-14T19:49:21.454901] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T19:49:21.460339] [INFO ] [REMOTE ] KMPR: Full fetch complete (52609 records). [2025-10-14T19:49:21.460463] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-14T19:49:21.567292] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-14T19:49:21.889516] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-14T19:49:21.889615] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-14T19:49:21.890731] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-14T19:49:21.890797] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-14T19:49:21.892051] [DEBUG] [LOCAL ] KMPR: Trimmed 52609 records to 39849 (keeping 200 days of data) [2025-10-14T19:49:22.135413] [DEBUG] [LOCAL ] KMPR: Primary data saved (39849 records). [2025-10-14T19:49:22.135580] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-14T19:49:22.135719] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KMPR took 26.5s. Estimated remaining: 2h 44m 39s. Rate: 7.1 symbols/min [2025-10-14T19:49:22.305691] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:49:22.339438] [DEBUG] [LOCAL ] KNF: Loaded 36521 existing records from primary storage. [2025-10-14T19:49:22.339749] [INFO ] [MAIN ] KNF: Loaded 36521 existing records. [2025-10-14T19:49:22.369796] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-14T19:49:22.527883] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:49:22.528230] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-14T19:49:22.528344] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-14T19:49:22.529229] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-14T19:49:22.529292] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-14T19:49:22.956457] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-14T19:49:22.963618] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:49:23.003357] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T19:49:23.158133] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-14T19:49:23.642833] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T19:49:23.650608] [INFO ] [REMOTE ] KMT: Full fetch complete (61929 records). [2025-10-14T19:49:23.650842] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-14T19:49:23.963274] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-14T19:49:24.149020] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-14T19:49:24.149130] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-14T19:49:24.150302] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-14T19:49:24.150370] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-14T19:49:24.151824] [DEBUG] [LOCAL ] KMT: Trimmed 61929 records to 42914 (keeping 200 days of data) [2025-10-14T19:49:24.436417] [DEBUG] [LOCAL ] KMT: Primary data saved (42914 records). [2025-10-14T19:49:24.436632] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-14T19:49:24.436748] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KMT took 28.8s. Estimated remaining: 2h 44m 25s. Rate: 7.1 symbols/min [2025-10-14T19:49:24.559827] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T19:49:24.636185] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:49:24.646937] [DEBUG] [LOCAL ] KNOP: Loaded 10368 existing records from primary storage. [2025-10-14T19:49:24.647151] [INFO ] [MAIN ] KNOP: Loaded 10368 existing records. [2025-10-14T19:49:24.763291] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-14T19:49:24.826580] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:49:24.826751] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-14T19:49:24.826802] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-14T19:49:24.827236] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-14T19:49:24.827292] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-14T19:49:25.177229] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:49:25.435203] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T19:49:25.558069] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-14T19:49:26.358046] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-14T19:49:26.783284] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T19:49:26.885431] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T19:49:27.158087] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-14T19:49:27.360514] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:49:27.885730] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T19:49:27.891609] [INFO ] [REMOTE ] KMX: Full fetch complete (76278 records). [2025-10-14T19:49:27.891743] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-14T19:49:27.963149] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-14T19:49:28.295600] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-14T19:49:28.295703] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-14T19:49:28.296856] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-14T19:49:28.296919] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-14T19:49:28.298353] [DEBUG] [LOCAL ] KMX: Trimmed 76278 records to 53268 (keeping 200 days of data) [2025-10-14T19:49:28.602110] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T19:49:28.625596] [DEBUG] [LOCAL ] KMX: Primary data saved (53268 records). [2025-10-14T19:49:28.625758] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-14T19:49:28.626509] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMX took 33.0s. Estimated remaining: 2h 44m 12s. Rate: 7.1 symbols/min [2025-10-14T19:49:28.763323] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-14T19:49:28.794007] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:49:28.812157] [DEBUG] [LOCAL ] KNSL: Loaded 18409 existing records from primary storage. [2025-10-14T19:49:28.812387] [INFO ] [MAIN ] KNSL: Loaded 18409 existing records. [2025-10-14T19:49:28.986855] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:49:28.987096] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-14T19:49:28.987143] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-14T19:49:28.987596] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-14T19:49:28.987693] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-14T19:49:29.340196] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:49:29.558069] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-14T19:49:30.107447] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:49:30.358088] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-14T19:49:30.563356] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T19:49:31.158125] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-14T19:49:31.736575] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T19:49:31.958069] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-14T19:49:32.405001] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T19:49:32.658209] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T19:49:32.758112] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-14T19:49:33.558072] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-14T19:49:34.224693] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T19:49:34.358078] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-14T19:49:34.662278] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T19:49:35.158069] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-14T19:49:35.454287] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T19:49:35.958043] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-14T19:49:36.234368] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T19:49:36.758054] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-14T19:49:36.956396] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T19:49:37.558057] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-14T19:49:37.794715] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T19:49:38.150899] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T19:49:38.358080] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-14T19:49:39.158107] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-14T19:49:39.698784] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T19:49:39.958067] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-14T19:49:39.970255] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T19:49:40.758073] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-14T19:49:41.354123] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T19:49:41.558067] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-14T19:49:42.096633] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T19:49:42.101204] [INFO ] [REMOTE ] KN: Full fetch complete (56548 records). [2025-10-14T19:49:42.101314] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-14T19:49:42.363298] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-14T19:49:42.488870] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-14T19:49:42.488971] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-14T19:49:42.489918] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-14T19:49:42.489980] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-14T19:49:42.491150] [DEBUG] [LOCAL ] KN: Trimmed 56548 records to 38607 (keeping 200 days of data) [2025-10-14T19:49:42.722218] [DEBUG] [LOCAL ] KN: Primary data saved (38607 records). [2025-10-14T19:49:42.722335] [INFO ] [MAIN ] KN: Full history saved. [2025-10-14T19:49:42.722413] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KN took 47.1s. Estimated remaining: 2h 44m 9s. Rate: 7.1 symbols/min [2025-10-14T19:49:42.936398] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:49:42.979900] [DEBUG] [LOCAL ] KNTK: Loaded 46863 existing records from primary storage. [2025-10-14T19:49:42.987783] [INFO ] [MAIN ] KNTK: Loaded 46863 existing records. [2025-10-14T19:49:43.035152] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T19:49:43.163184] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-14T19:49:43.225295] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:49:43.225717] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-14T19:49:43.225774] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-14T19:49:43.226609] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-14T19:49:43.226692] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-14T19:49:43.603093] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:49:43.623733] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T19:49:43.958145] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-14T19:49:44.667465] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T19:49:44.693988] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T19:49:44.758046] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-14T19:49:45.558109] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-14T19:49:46.275133] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:49:46.280055] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T19:49:46.282695] [INFO ] [REMOTE ] KNF: Full fetch complete (51188 records). [2025-10-14T19:49:46.283026] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-14T19:49:46.363276] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-14T19:49:46.678100] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-14T19:49:46.678180] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-14T19:49:46.679063] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-14T19:49:46.679126] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-14T19:49:46.680134] [DEBUG] [LOCAL ] KNF: Trimmed 51188 records to 36549 (keeping 200 days of data) [2025-10-14T19:49:46.892469] [DEBUG] [LOCAL ] KNF: Primary data saved (36549 records). [2025-10-14T19:49:46.892616] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-14T19:49:46.892737] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KNF took 24.8s. Estimated remaining: 2h 43m 57s. Rate: 7.1 symbols/min [2025-10-14T19:49:47.063803] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:49:47.111600] [DEBUG] [LOCAL ] KNX: Loaded 52602 existing records from primary storage. [2025-10-14T19:49:47.111987] [INFO ] [MAIN ] KNX: Loaded 52602 existing records. [2025-10-14T19:49:47.163917] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-14T19:49:47.291013] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:49:47.291305] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-14T19:49:47.291355] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-14T19:49:47.292242] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-14T19:49:47.292300] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-14T19:49:47.468581] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T19:49:47.659416] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:49:47.958099] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-14T19:49:48.703983] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T19:49:48.758051] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-14T19:49:48.967897] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T19:49:49.558081] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-14T19:49:50.186989] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T19:49:50.358092] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-14T19:49:50.725417] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T19:49:51.158080] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-14T19:49:51.933189] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T19:49:51.958034] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-14T19:49:52.216900] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:49:52.758083] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-14T19:49:53.558071] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-14T19:49:53.686220] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T19:49:54.289228] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T19:49:54.358058] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-14T19:49:54.539463] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T19:49:55.158074] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-14T19:49:55.880586] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T19:49:55.919739] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T19:49:55.958065] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-14T19:49:56.656380] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T19:49:56.758057] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-14T19:49:57.558066] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-14T19:49:57.593144] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T19:49:58.358067] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-14T19:49:59.151669] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T19:49:59.161140] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-14T19:49:59.216263] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T19:49:59.218160] [INFO ] [REMOTE ] KNOP: Full fetch complete (14708 records). [2025-10-14T19:49:59.218245] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-14T19:49:59.579320] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-14T19:49:59.579394] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-14T19:49:59.579787] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-14T19:49:59.579848] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-14T19:49:59.580309] [DEBUG] [LOCAL ] KNOP: Trimmed 14708 records to 10475 (keeping 200 days of data) [2025-10-14T19:49:59.640333] [DEBUG] [LOCAL ] KNOP: Primary data saved (10475 records). [2025-10-14T19:49:59.640459] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-14T19:49:59.640533] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNOP took 35.2s. Estimated remaining: 2h 43m 52s. Rate: 7.1 symbols/min [2025-10-14T19:49:59.808904] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:49:59.809093] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-14T19:49:59.809133] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-14T19:49:59.809242] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-14T19:49:59.809287] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-14T19:49:59.809331] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-14T19:49:59.809364] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-14T19:49:59.963244] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-14T19:50:00.170038] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:00.717639] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T19:50:00.720897] [INFO ] [REMOTE ] KNSL: Full fetch complete (26875 records). [2025-10-14T19:50:00.721115] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-14T19:50:00.767445] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-14T19:50:01.129452] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-14T19:50:01.129541] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-14T19:50:01.130306] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-14T19:50:01.130369] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-14T19:50:01.131212] [DEBUG] [LOCAL ] KNSL: Trimmed 26875 records to 18386 (keeping 200 days of data) [2025-10-14T19:50:01.247922] [DEBUG] [LOCAL ] KNSL: Primary data saved (18386 records). [2025-10-14T19:50:01.248073] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-14T19:50:01.248155] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KNSL took 32.6s. Estimated remaining: 2h 43m 37s. Rate: 7.1 symbols/min [2025-10-14T19:50:01.426424] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:01.466237] [DEBUG] [LOCAL ] KODK: Loaded 43626 existing records from primary storage. [2025-10-14T19:50:01.466529] [INFO ] [MAIN ] KODK: Loaded 43626 existing records. [2025-10-14T19:50:01.559106] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-14T19:50:01.665293] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:01.665763] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-14T19:50:01.665936] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-14T19:50:01.666986] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-14T19:50:01.667047] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-14T19:50:02.000464] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-14T19:50:02.143286] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:02.358133] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-14T19:50:03.158105] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-14T19:50:03.410865] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T19:50:03.461961] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-10-14T19:50:03.958034] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-14T19:50:04.162017] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T19:50:04.538451] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T19:50:04.758088] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-14T19:50:05.558055] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-14T19:50:05.758961] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T19:50:06.358068] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-14T19:50:06.446119] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T19:50:07.030454] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T19:50:07.158097] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-14T19:50:07.935425] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T19:50:07.958057] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-14T19:50:08.758127] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-14T19:50:09.558083] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-14T19:50:09.752947] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-14T19:50:09.800043] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T19:50:10.363600] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-14T19:50:10.366497] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T19:50:10.960868] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T19:50:11.158150] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-14T19:50:11.958128] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-14T19:50:12.758064] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-14T19:50:12.797020] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-14T19:50:12.964294] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T19:50:13.559050] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-14T19:50:13.558970] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T19:50:14.332371] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T19:50:14.358126] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-14T19:50:15.158209] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-14T19:50:15.958149] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-14T19:50:16.027213] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T19:50:16.284091] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-14T19:50:16.758160] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-14T19:50:16.854372] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:50:17.214006] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T19:50:17.558108] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-14T19:50:18.311881] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T19:50:18.358032] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-14T19:50:19.072989] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T19:50:19.082233] [INFO ] [REMOTE ] KNX: Full fetch complete (76116 records). [2025-10-14T19:50:19.082408] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-14T19:50:19.162273] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-14T19:50:19.517554] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T19:50:19.553835] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-14T19:50:19.554135] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-14T19:50:19.556206] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-14T19:50:19.556304] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-14T19:50:19.558674] [DEBUG] [LOCAL ] KNX: Trimmed 76116 records to 52607 (keeping 200 days of data) [2025-10-14T19:50:19.929511] [DEBUG] [LOCAL ] KNX: Primary data saved (52607 records). [2025-10-14T19:50:19.929761] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-14T19:50:19.929878] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNX took 33.0s. Estimated remaining: 2h 43m 39s. Rate: 7.1 symbols/min [2025-10-14T19:50:19.963443] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-14T19:50:20.116382] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:20.143977] [DEBUG] [LOCAL ] KOF: Loaded 26539 existing records from primary storage. [2025-10-14T19:50:20.144324] [INFO ] [MAIN ] KOF: Loaded 26539 existing records. [2025-10-14T19:50:20.330708] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:20.331016] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-14T19:50:20.331069] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-14T19:50:20.331968] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-14T19:50:20.332030] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-14T19:50:20.762614] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:20.762761] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-14T19:50:20.781076] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T19:50:20.787310] [INFO ] [REMOTE ] KNTK: Full fetch complete (65341 records). [2025-10-14T19:50:20.787467] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-14T19:50:21.173122] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-14T19:50:21.173202] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-14T19:50:21.174256] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-14T19:50:21.174320] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-14T19:50:21.175735] [DEBUG] [LOCAL ] KNTK: Trimmed 65341 records to 46985 (keeping 200 days of data) [2025-10-14T19:50:21.461743] [DEBUG] [LOCAL ] KNTK: Primary data saved (46985 records). [2025-10-14T19:50:21.461872] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-14T19:50:21.461953] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KNTK took 38.7s. Estimated remaining: 2h 43m 24s. Rate: 7.1 symbols/min [2025-10-14T19:50:21.563981] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-14T19:50:21.664188] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T19:50:21.662873] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:21.688864] [DEBUG] [LOCAL ] KOP: Loaded 17485 existing records from primary storage. [2025-10-14T19:50:21.689152] [INFO ] [MAIN ] KOP: Loaded 17485 existing records. [2025-10-14T19:50:21.869547] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:21.869817] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-14T19:50:21.869866] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-14T19:50:21.870364] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-14T19:50:21.870420] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-14T19:50:22.220284] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:22.358039] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-14T19:50:22.706405] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T19:50:23.069983] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-14T19:50:23.158030] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-14T19:50:23.963722] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-14T19:50:23.994745] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T19:50:24.679784] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T19:50:24.758099] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-14T19:50:25.558087] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-14T19:50:25.705822] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T19:50:25.841431] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-14T19:50:26.358091] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-14T19:50:27.158062] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-14T19:50:27.312989] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T19:50:27.313107] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T19:50:27.958069] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-14T19:50:28.417431] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T19:50:28.758090] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-14T19:50:29.023374] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T19:50:29.558079] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-14T19:50:29.942958] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T19:50:30.358063] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-14T19:50:31.090218] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T19:50:31.158033] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-14T19:50:31.523738] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T19:50:31.958065] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-14T19:50:32.707465] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T19:50:32.712741] [INFO ] [REMOTE ] KODK: Full fetch complete (63461 records). [2025-10-14T19:50:32.712861] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-14T19:50:32.766563] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-14T19:50:33.126572] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-14T19:50:33.126678] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-14T19:50:33.127697] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-14T19:50:33.127762] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-14T19:50:33.129084] [DEBUG] [LOCAL ] KODK: Trimmed 63461 records to 43707 (keeping 200 days of data) [2025-10-14T19:50:33.374774] [DEBUG] [LOCAL ] KODK: Primary data saved (43707 records). [2025-10-14T19:50:33.374897] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-14T19:50:33.374974] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KODK took 32.1s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-14T19:50:33.540824] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:33.544418] [DEBUG] [LOCAL ] KORE: Loaded 2146 existing records from primary storage. [2025-10-14T19:50:33.544566] [INFO ] [MAIN ] KORE: Loaded 2146 existing records. [2025-10-14T19:50:33.575405] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-14T19:50:33.733161] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:33.733451] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-14T19:50:33.733533] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-14T19:50:33.733786] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-14T19:50:33.733846] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-14T19:50:33.980425] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T19:50:34.131173] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:34.161546] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-14T19:50:34.358040] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-14T19:50:34.684411] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T19:50:35.158059] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-14T19:50:35.958078] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-14T19:50:36.142740] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T19:50:36.758033] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-14T19:50:37.076619] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-14T19:50:37.220945] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T19:50:37.258622] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T19:50:37.558075] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-14T19:50:38.358072] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-14T19:50:38.472105] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T19:50:38.877346] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-14T19:50:39.158086] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-14T19:50:39.958067] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-14T19:50:40.460129] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T19:50:40.758040] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-14T19:50:40.928443] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T19:50:41.558061] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-14T19:50:41.742063] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T19:50:42.219057] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T19:50:42.358045] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-14T19:50:43.158057] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-14T19:50:43.556998] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T19:50:43.958022] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-14T19:50:44.167390] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T19:50:44.430712] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T19:50:44.758063] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-14T19:50:45.558070] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-14T19:50:46.003175] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T19:50:46.358053] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-14T19:50:47.158133] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-14T19:50:47.323120] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T19:50:47.325621] [INFO ] [REMOTE ] KOP: Full fetch complete (25454 records). [2025-10-14T19:50:47.325715] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-14T19:50:47.473071] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-14T19:50:47.701352] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-14T19:50:47.701461] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-14T19:50:47.702135] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-14T19:50:47.702220] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-14T19:50:47.703052] [DEBUG] [LOCAL ] KOP: Trimmed 25454 records to 17462 (keeping 200 days of data) [2025-10-14T19:50:47.810501] [DEBUG] [LOCAL ] KOP: Primary data saved (17462 records). [2025-10-14T19:50:47.810703] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-14T19:50:47.810830] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KOP took 26.3s. Estimated remaining: 2h 43m 16s. Rate: 7.1 symbols/min [2025-10-14T19:50:47.984475] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:47.967748] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-14T19:50:48.019690] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-14T19:50:48.076082] [DEBUG] [LOCAL ] KOS: Loaded 53089 existing records from primary storage. [2025-10-14T19:50:48.076623] [INFO ] [MAIN ] KOS: Loaded 53089 existing records. [2025-10-14T19:50:48.249660] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:48.249924] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-14T19:50:48.249983] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-14T19:50:48.250857] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-14T19:50:48.250915] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-14T19:50:48.624031] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:48.758075] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-14T19:50:49.234237] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T19:50:49.237806] [INFO ] [REMOTE ] KOF: Full fetch complete (37800 records). [2025-10-14T19:50:49.237911] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-14T19:50:49.565848] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-14T19:50:49.656150] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-14T19:50:49.656270] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-14T19:50:49.657118] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-14T19:50:49.657183] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-14T19:50:49.658153] [DEBUG] [LOCAL ] KOF: Trimmed 37800 records to 26602 (keeping 200 days of data) [2025-10-14T19:50:49.826399] [DEBUG] [LOCAL ] KOF: Primary data saved (26602 records). [2025-10-14T19:50:49.826559] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-14T19:50:49.826672] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOF took 29.9s. Estimated remaining: 2h 43m 1s. Rate: 7.1 symbols/min [2025-10-14T19:50:49.995997] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:50.043244] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-14T19:50:50.043566] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-14T19:50:50.220586] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:50.220804] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-14T19:50:50.220854] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-14T19:50:50.221808] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-14T19:50:50.221868] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-14T19:50:50.361128] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-14T19:50:50.580906] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:50.627216] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T19:50:50.714062] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-14T19:50:51.158117] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-14T19:50:51.669874] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-14T19:50:51.958081] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-14T19:50:52.689761] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T19:50:52.695739] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-14T19:50:52.695866] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-14T19:50:52.760177] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-14T19:50:52.898628] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T19:50:52.899434] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:50:52.899518] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:50:52.899713] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-14T19:50:52.899847] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-14T19:50:52.899906] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-14T19:50:52.899983] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-14T19:50:52.900064] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KO took 53.3s. Estimated remaining: 2h 42m 48s. Rate: 7.1 symbols/min [2025-10-14T19:50:53.031488] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T19:50:53.114943] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:50:53.163856] [DEBUG] [LOCAL ] KRC: Loaded 48286 existing records from primary storage. [2025-10-14T19:50:53.164209] [INFO ] [MAIN ] KRC: Loaded 48286 existing records. [2025-10-14T19:50:53.280528] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-14T19:50:53.360705] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:50:53.360950] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-14T19:50:53.361000] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-14T19:50:53.361875] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-14T19:50:53.361935] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-14T19:50:53.568788] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-14T19:50:53.717881] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:50:54.144334] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T19:50:54.358071] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-14T19:50:54.818978] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T19:50:55.158089] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-14T19:50:55.958065] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-14T19:50:56.758049] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-14T19:50:56.812468] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T19:50:57.558056] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-14T19:50:57.859459] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T19:50:57.884392] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-14T19:50:58.312238] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T19:50:58.358104] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-14T19:50:59.158068] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-14T19:50:59.894878] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T19:50:59.958136] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-14T19:51:00.464018] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T19:51:00.495315] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T19:51:00.758070] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-14T19:51:01.497245] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T19:51:01.498254] [INFO ] [REMOTE ] KORE: Full fetch complete (5412 records). [2025-10-14T19:51:01.498320] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-14T19:51:01.563134] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-14T19:51:01.855841] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-14T19:51:01.855913] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-14T19:51:01.856053] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-14T19:51:01.856090] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-14T19:51:01.856419] [DEBUG] [LOCAL ] KORE: Trimmed 5412 records to 2171 (keeping 200 days of data) [2025-10-14T19:51:01.868439] [DEBUG] [LOCAL ] KORE: Primary data saved (2171 records). [2025-10-14T19:51:01.868497] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-14T19:51:01.868562] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KORE took 28.5s. Estimated remaining: 2h 42m 40s. Rate: 7.1 symbols/min [2025-10-14T19:51:02.062774] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:51:02.098865] [DEBUG] [LOCAL ] KREF: Loaded 37962 existing records from primary storage. [2025-10-14T19:51:02.099177] [INFO ] [MAIN ] KREF: Loaded 37962 existing records. [2025-10-14T19:51:02.307941] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:51:02.308151] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-14T19:51:02.308198] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-14T19:51:02.308916] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-14T19:51:02.308976] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-14T19:51:02.366178] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-14T19:51:02.686792] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:51:03.158093] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-14T19:51:03.509855] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T19:51:03.956600] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T19:51:03.965335] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-14T19:51:04.034258] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T19:51:04.758068] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-14T19:51:05.558042] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-14T19:51:05.674628] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T19:51:06.275472] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T19:51:06.358073] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-14T19:51:06.788337] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:51:07.158107] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-14T19:51:07.958065] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-14T19:51:08.188621] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T19:51:08.763330] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-14T19:51:08.778639] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T19:51:09.558081] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-14T19:51:09.848107] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T19:51:10.053289] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T19:51:10.358067] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-14T19:51:11.052185] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:51:11.158099] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-14T19:51:11.265340] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T19:51:11.958079] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-14T19:51:12.758077] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-14T19:51:13.050857] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T19:51:13.121634] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T19:51:13.558057] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-14T19:51:14.358069] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-14T19:51:14.396172] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T19:51:14.992839] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T19:51:15.158158] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-14T19:51:15.958131] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-14T19:51:16.250294] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T19:51:16.301785] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T19:51:16.758136] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-14T19:51:17.558089] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-14T19:51:17.607985] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T19:51:18.358115] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-14T19:51:18.402973] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T19:51:19.001114] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T19:51:19.158106] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-14T19:51:19.958050] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-14T19:51:20.189967] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T19:51:20.473883] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T19:51:20.758111] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-14T19:51:21.558108] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-14T19:51:21.707149] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T19:51:21.786831] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T19:51:22.358087] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-14T19:51:23.158057] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-14T19:51:23.531182] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T19:51:23.958087] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-14T19:51:24.145696] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T19:51:24.740686] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T19:51:24.758099] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-14T19:51:25.558089] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-14T19:51:25.742866] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T19:51:26.234276] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T19:51:26.240357] [INFO ] [REMOTE ] KOS: Full fetch complete (77029 records). [2025-10-14T19:51:26.240489] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-14T19:51:26.363189] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-14T19:51:26.642561] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-14T19:51:26.642636] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-14T19:51:26.643711] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-14T19:51:26.643771] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-14T19:51:26.645146] [DEBUG] [LOCAL ] KOS: Trimmed 77029 records to 53091 (keeping 200 days of data) [2025-10-14T19:51:26.951249] [DEBUG] [LOCAL ] KOS: Primary data saved (53091 records). [2025-10-14T19:51:26.951395] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-14T19:51:26.951474] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KOS took 39.1s. Estimated remaining: 2h 42m 47s. Rate: 7.1 symbols/min [2025-10-14T19:51:27.114267] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:51:27.164203] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-14T19:51:27.198113] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:51:27.242351] [DEBUG] [LOCAL ] KRG: Loaded 49255 existing records from primary storage. [2025-10-14T19:51:27.242700] [INFO ] [MAIN ] KRG: Loaded 49255 existing records. [2025-10-14T19:51:27.419037] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:51:27.419273] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-14T19:51:27.419321] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-14T19:51:27.420182] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-14T19:51:27.420241] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-14T19:51:27.778693] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:51:27.824825] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:51:27.829668] [INFO ] [REMOTE ] KREF: Full fetch complete (52817 records). [2025-10-14T19:51:27.829761] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-14T19:51:27.963244] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-14T19:51:28.253700] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-14T19:51:28.253783] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-14T19:51:28.254620] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-14T19:51:28.254688] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-14T19:51:28.255709] [DEBUG] [LOCAL ] KREF: Trimmed 52817 records to 38003 (keeping 200 days of data) [2025-10-14T19:51:28.487244] [DEBUG] [LOCAL ] KREF: Primary data saved (38003 records). [2025-10-14T19:51:28.487381] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-14T19:51:28.487459] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KREF took 26.6s. Estimated remaining: 2h 42m 32s. Rate: 7.1 symbols/min [2025-10-14T19:51:28.664106] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:51:28.664285] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-14T19:51:28.664322] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-14T19:51:28.664436] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-14T19:51:28.664477] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-14T19:51:28.664519] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-14T19:51:28.664551] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-14T19:51:28.758287] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-14T19:51:29.035496] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:51:29.063160] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:51:29.558057] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-14T19:51:29.983849] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T19:51:30.363210] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-14T19:51:30.378419] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T19:51:30.580310] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:51:30.580811] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-14T19:51:30.580915] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:51:30.580970] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-14T19:51:30.581005] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:51:30.581099] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-14T19:51:30.581180] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-14T19:51:30.581242] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-14T19:51:30.581316] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-14T19:51:30.581375] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KRMN took 2.1s. Estimated remaining: 2h 42m 17s. Rate: 7.1 symbols/min [2025-10-14T19:51:30.790405] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:51:30.832815] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T19:51:30.852557] [DEBUG] [LOCAL ] KRO: Loaded 26376 existing records from primary storage. [2025-10-14T19:51:30.852865] [INFO ] [MAIN ] KRO: Loaded 26376 existing records. [2025-10-14T19:51:31.034513] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:51:31.034747] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-14T19:51:31.034799] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-14T19:51:31.035304] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-14T19:51:31.035362] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-14T19:51:31.163199] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-14T19:51:31.401796] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:51:31.958071] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-14T19:51:32.758062] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-14T19:51:32.983353] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T19:51:33.032625] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T19:51:33.515368] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T19:51:33.521293] [INFO ] [REMOTE ] KR: Full fetch complete (77841 records). [2025-10-14T19:51:33.521411] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-14T19:51:33.563233] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-14T19:51:33.915204] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-14T19:51:33.915304] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-14T19:51:33.916359] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-14T19:51:33.916467] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-14T19:51:33.917954] [DEBUG] [LOCAL ] KR: Trimmed 77841 records to 53681 (keeping 200 days of data) [2025-10-14T19:51:34.243181] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-14T19:51:34.243315] [INFO ] [MAIN ] KR: Full history saved. [2025-10-14T19:51:34.243394] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KR took 44.4s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-14T19:51:34.361782] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-14T19:51:34.430885] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:51:34.465877] [DEBUG] [LOCAL ] KRP: Loaded 36498 existing records from primary storage. [2025-10-14T19:51:34.466215] [INFO ] [MAIN ] KRP: Loaded 36498 existing records. [2025-10-14T19:51:34.657923] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:51:34.669569] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T19:51:34.669772] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-14T19:51:34.674253] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-14T19:51:34.675073] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-14T19:51:34.675152] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-14T19:51:35.032515] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:51:35.158093] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-14T19:51:35.879299] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:51:35.884940] [INFO ] [REMOTE ] KRC: Full fetch complete (70002 records). [2025-10-14T19:51:35.885075] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-14T19:51:35.963168] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-14T19:51:36.299068] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-14T19:51:36.299408] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-14T19:51:36.300521] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-14T19:51:36.300587] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-14T19:51:36.302107] [DEBUG] [LOCAL ] KRC: Trimmed 70002 records to 48299 (keeping 200 days of data) [2025-10-14T19:51:36.537604] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T19:51:36.619932] [DEBUG] [LOCAL ] KRC: Primary data saved (48299 records). [2025-10-14T19:51:36.620064] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-14T19:51:36.620141] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KRC took 43.7s. Estimated remaining: 2h 41m 50s. Rate: 7.1 symbols/min [2025-10-14T19:51:36.763338] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-14T19:51:36.812794] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:51:36.859412] [DEBUG] [LOCAL ] KSS: Loaded 53596 existing records from primary storage. [2025-10-14T19:51:36.859746] [INFO ] [MAIN ] KSS: Loaded 53596 existing records. [2025-10-14T19:51:37.036421] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:51:37.036678] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-14T19:51:37.036738] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-14T19:51:37.037834] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-14T19:51:37.037893] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-14T19:51:37.392147] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:51:37.555678] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T19:51:37.564358] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-14T19:51:38.295928] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T19:51:38.358027] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-14T19:51:39.158053] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-14T19:51:39.239069] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T19:51:39.790216] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T19:51:39.958076] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-14T19:51:40.574788] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T19:51:40.758048] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-14T19:51:41.190336] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T19:51:41.558105] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-14T19:51:42.358075] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-14T19:51:42.775706] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T19:51:43.037213] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T19:51:43.158030] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-14T19:51:43.275491] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T19:51:43.958070] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-14T19:51:44.424843] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T19:51:44.758144] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-14T19:51:45.558089] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-14T19:51:45.836623] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T19:51:46.150696] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T19:51:46.358097] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-14T19:51:47.158098] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-14T19:51:47.236371] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T19:51:47.958033] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-14T19:51:48.260094] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T19:51:48.332625] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T19:51:48.758127] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-14T19:51:48.906080] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-14T19:51:49.558078] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-14T19:51:50.336145] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T19:51:50.358086] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-14T19:51:51.158070] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-14T19:51:51.581205] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T19:51:51.641884] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T19:51:51.958064] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-14T19:51:52.587886] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T19:51:52.758037] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-14T19:51:53.558037] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-14T19:51:53.794394] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T19:51:54.354664] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T19:51:54.363974] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-14T19:51:54.418727] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T19:51:55.158098] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-14T19:51:55.958101] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-14T19:51:56.260538] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T19:51:56.418737] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T19:51:56.758093] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-14T19:51:57.161089] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T19:51:57.558107] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-14T19:51:58.358125] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-14T19:51:58.871597] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-14T19:51:59.133502] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T19:51:59.166258] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-14T19:51:59.184523] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:51:59.958070] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-14T19:52:00.186574] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T19:52:00.758141] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-14T19:52:01.558097] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-14T19:52:01.738234] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T19:52:02.178422] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T19:52:02.358119] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-14T19:52:02.783423] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T19:52:03.158097] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-14T19:52:03.628494] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T19:52:03.632391] [INFO ] [REMOTE ] KRP: Full fetch complete (54966 records). [2025-10-14T19:52:03.632472] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-14T19:52:03.968099] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-14T19:52:04.010275] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-14T19:52:04.010343] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-14T19:52:04.011252] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-14T19:52:04.011312] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-14T19:52:04.012411] [DEBUG] [LOCAL ] KRP: Trimmed 54966 records to 36430 (keeping 200 days of data) [2025-10-14T19:52:04.225330] [DEBUG] [LOCAL ] KRP: Primary data saved (36430 records). [2025-10-14T19:52:04.225453] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-14T19:52:04.225529] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRP took 30.0s. Estimated remaining: 2h 41m 60s. Rate: 7.1 symbols/min [2025-10-14T19:52:04.391271] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:04.431309] [DEBUG] [LOCAL ] KT: Loaded 45544 existing records from primary storage. [2025-10-14T19:52:04.431621] [INFO ] [MAIN ] KT: Loaded 45544 existing records. [2025-10-14T19:52:04.604675] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:04.604858] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-14T19:52:04.604903] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-14T19:52:04.605575] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-14T19:52:04.605630] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-14T19:52:04.763526] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-14T19:52:04.907385] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T19:52:04.969198] [INFO ] [REMOTE ] KRG: Full fetch complete (71283 records). [2025-10-14T19:52:04.986954] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-14T19:52:04.990798] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:05.290991] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T19:52:05.320191] [INFO ] [REMOTE ] KRO: Full fetch complete (35210 records). [2025-10-14T19:52:05.341769] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-14T19:52:05.477487] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-14T19:52:05.488266] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-14T19:52:05.489311] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-14T19:52:05.489663] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-14T19:52:05.565473] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-14T19:52:05.565604] [DEBUG] [LOCAL ] KRG: Trimmed 71283 records to 49267 (keeping 200 days of data) [2025-10-14T19:52:05.978334] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-14T19:52:05.978711] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-14T19:52:05.982358] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-14T19:52:05.984823] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-14T19:52:06.011844] [DEBUG] [LOCAL ] KRO: Trimmed 35210 records to 26420 (keeping 200 days of data) [2025-10-14T19:52:06.186033] [DEBUG] [LOCAL ] KRG: Primary data saved (49267 records). [2025-10-14T19:52:06.211237] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-14T19:52:06.221365] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRG took 39.3s. Estimated remaining: 2h 41m 45s. Rate: 7.1 symbols/min [2025-10-14T19:52:06.221188] [DEBUG] [LOCAL ] KRO: Primary data saved (26420 records). [2025-10-14T19:52:06.253402] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-14T19:52:06.253542] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KRO took 35.7s. Estimated remaining: 2h 41m 29s. Rate: 7.1 symbols/min [2025-10-14T19:52:06.517527] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:06.568591] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:06.581447] [DEBUG] [LOCAL ] KTF: Loaded 11915 existing records from primary storage. [2025-10-14T19:52:06.581785] [INFO ] [MAIN ] KTF: Loaded 11915 existing records. [2025-10-14T19:52:06.736314] [DEBUG] [LOCAL ] KTB: Loaded 40542 existing records from primary storage. [2025-10-14T19:52:06.765139] [INFO ] [MAIN ] KTB: Loaded 40542 existing records. [2025-10-14T19:52:06.838404] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:06.851391] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-14T19:52:06.860234] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-14T19:52:06.882691] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-14T19:52:06.899243] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-14T19:52:07.084629] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:07.085220] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-14T19:52:07.085542] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-14T19:52:07.106504] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-14T19:52:07.128854] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-14T19:52:07.414432] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-14T19:52:07.503416] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-14T19:52:07.676845] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:07.667498] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-14T19:52:07.682257] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-14T19:52:07.783672] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:07.958057] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-14T19:52:08.677544] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:52:08.758103] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-14T19:52:09.005534] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T19:52:09.534367] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T19:52:09.556927] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T19:52:09.559122] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-14T19:52:10.358076] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-14T19:52:11.084664] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T19:52:11.158085] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-14T19:52:11.263734] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T19:52:11.269597] [INFO ] [REMOTE ] KSS: Full fetch complete (77756 records). [2025-10-14T19:52:11.269722] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-14T19:52:11.653847] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-14T19:52:11.653935] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-14T19:52:11.654947] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-14T19:52:11.655006] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-14T19:52:11.656332] [DEBUG] [LOCAL ] KSS: Trimmed 77756 records to 53595 (keeping 200 days of data) [2025-10-14T19:52:11.963353] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-14T19:52:11.968612] [DEBUG] [LOCAL ] KSS: Primary data saved (53595 records). [2025-10-14T19:52:11.969467] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-14T19:52:11.969548] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KSS took 35.3s. Estimated remaining: 2h 41m 18s. Rate: 7.1 symbols/min [2025-10-14T19:52:12.139090] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:12.139244] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-14T19:52:12.139281] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-14T19:52:12.139384] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-14T19:52:12.139425] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-14T19:52:12.139464] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-14T19:52:12.139495] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-14T19:52:12.253806] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T19:52:12.503507] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:12.758074] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-14T19:52:13.419777] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T19:52:13.558069] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-14T19:52:13.990732] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T19:52:14.358138] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-14T19:52:14.989538] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-14T19:52:15.043877] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T19:52:15.158073] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-14T19:52:15.958075] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-14T19:52:16.758048] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-14T19:52:16.813028] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T19:52:16.856783] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T19:52:17.558099] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-14T19:52:18.218192] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T19:52:18.253119] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T19:52:18.358128] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-14T19:52:19.158081] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-14T19:52:19.809952] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T19:52:19.914031] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T19:52:19.958023] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-14T19:52:20.758075] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-14T19:52:21.408427] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T19:52:21.434238] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T19:52:21.558069] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-14T19:52:22.358063] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-14T19:52:22.975320] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T19:52:23.158099] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-14T19:52:23.283160] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T19:52:23.958090] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-14T19:52:24.667927] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T19:52:24.758055] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-14T19:52:25.146122] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T19:52:25.558063] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-14T19:52:26.109103] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T19:52:26.358079] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-14T19:52:26.538395] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T19:52:27.158065] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-14T19:52:27.959574] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-14T19:52:27.985463] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T19:52:28.112542] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T19:52:28.758081] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-14T19:52:29.298519] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T19:52:29.546292] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T19:52:29.558025] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-14T19:52:30.358101] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-14T19:52:30.400180] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T19:52:31.158064] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-14T19:52:31.958112] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-14T19:52:31.987045] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T19:52:32.489853] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T19:52:32.501272] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T19:52:32.505505] [INFO ] [REMOTE ] KTB: Full fetch complete (58080 records). [2025-10-14T19:52:32.505698] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-14T19:52:32.763170] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-14T19:52:32.888755] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-14T19:52:32.888839] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-14T19:52:32.889778] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-14T19:52:32.889838] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-14T19:52:32.890985] [DEBUG] [LOCAL ] KTB: Trimmed 58080 records to 40489 (keeping 200 days of data) [2025-10-14T19:52:33.136872] [DEBUG] [LOCAL ] KTB: Primary data saved (40489 records). [2025-10-14T19:52:33.136991] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-14T19:52:33.137066] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KTB took 26.9s. Estimated remaining: 2h 41m 21s. Rate: 7.1 symbols/min [2025-10-14T19:52:33.304344] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:33.356516] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-14T19:52:33.356892] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-14T19:52:33.539944] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:33.540118] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-14T19:52:33.540169] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-14T19:52:33.541048] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-14T19:52:33.541106] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-14T19:52:33.563116] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-14T19:52:33.660438] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T19:52:33.910784] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:34.067477] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-14T19:52:34.358101] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-14T19:52:35.158070] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-14T19:52:35.877574] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T19:52:35.878980] [INFO ] [REMOTE ] KTF: Full fetch complete (17422 records). [2025-10-14T19:52:35.879051] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-14T19:52:35.962337] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-14T19:52:36.284319] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-14T19:52:36.287186] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-14T19:52:36.287856] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-14T19:52:36.287946] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-14T19:52:36.290446] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T19:52:36.301470] [DEBUG] [LOCAL ] KTF: Trimmed 17422 records to 11831 (keeping 200 days of data) [2025-10-14T19:52:36.371133] [DEBUG] [LOCAL ] KTF: Primary data saved (11831 records). [2025-10-14T19:52:36.371271] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-14T19:52:36.371352] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTF took 30.1s. Estimated remaining: 2h 41m 8s. Rate: 7.1 symbols/min [2025-10-14T19:52:36.539895] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:36.586214] [DEBUG] [LOCAL ] KVYO: Loaded 50682 existing records from primary storage. [2025-10-14T19:52:36.586547] [INFO ] [MAIN ] KVYO: Loaded 50682 existing records. [2025-10-14T19:52:36.776719] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:36.770958] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-14T19:52:36.777735] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-14T19:52:36.777824] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-14T19:52:36.778609] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-14T19:52:36.778696] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-14T19:52:37.146739] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:37.558052] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-14T19:52:37.616950] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T19:52:38.358083] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-14T19:52:38.456443] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T19:52:39.158105] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-14T19:52:39.298813] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T19:52:39.747852] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T19:52:39.958071] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-14T19:52:40.758093] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-14T19:52:40.876177] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T19:52:41.462183] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T19:52:41.558091] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-14T19:52:42.057897] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T19:52:42.358052] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-14T19:52:43.158074] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-14T19:52:43.312983] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:52:43.958089] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-14T19:52:44.003517] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T19:52:44.384329] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T19:52:44.758118] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-14T19:52:45.558085] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-14T19:52:45.762514] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T19:52:46.052522] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-14T19:52:46.261817] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T19:52:46.268473] [INFO ] [REMOTE ] KT: Full fetch complete (66539 records). [2025-10-14T19:52:46.268580] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-14T19:52:46.363235] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-14T19:52:46.666473] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-14T19:52:46.666563] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-14T19:52:46.667545] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-14T19:52:46.667696] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-14T19:52:46.669110] [DEBUG] [LOCAL ] KT: Trimmed 66539 records to 45503 (keeping 200 days of data) [2025-10-14T19:52:46.937406] [DEBUG] [LOCAL ] KT: Primary data saved (45503 records). [2025-10-14T19:52:46.937525] [INFO ] [MAIN ] KT: Full history saved. [2025-10-14T19:52:46.937600] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KT took 42.7s. Estimated remaining: 2h 41m 2s. Rate: 7.1 symbols/min [2025-10-14T19:52:47.053871] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T19:52:47.113735] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:47.147929] [DEBUG] [LOCAL ] KW: Loaded 40483 existing records from primary storage. [2025-10-14T19:52:47.148210] [INFO ] [MAIN ] KW: Loaded 40483 existing records. [2025-10-14T19:52:47.168192] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-14T19:52:47.329804] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:47.329997] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-14T19:52:47.330045] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-14T19:52:47.330721] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-14T19:52:47.330776] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-14T19:52:47.673348] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:47.958062] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-14T19:52:48.758089] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-14T19:52:49.103450] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T19:52:49.134435] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T19:52:49.270298] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T19:52:49.558100] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-14T19:52:50.358055] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-14T19:52:50.929088] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T19:52:51.158114] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-14T19:52:51.240546] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T19:52:51.242258] [INFO ] [REMOTE ] KUKE: Full fetch complete (8906 records). [2025-10-14T19:52:51.242324] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-14T19:52:51.417579] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T19:52:51.417856] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T19:52:51.417934] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T19:52:51.417986] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-14T19:52:51.418040] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-14T19:52:51.418080] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-14T19:52:51.418118] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-14T19:52:51.418171] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KUKE took 39.4s. Estimated remaining: 2h 40m 50s. Rate: 7.1 symbols/min [2025-10-14T19:52:51.582664] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:52:51.599312] [DEBUG] [LOCAL ] KWR: Loaded 16178 existing records from primary storage. [2025-10-14T19:52:51.599530] [INFO ] [MAIN ] KWR: Loaded 16178 existing records. [2025-10-14T19:52:51.774102] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:52:51.774325] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-14T19:52:51.774372] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-14T19:52:51.774801] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-14T19:52:51.774875] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-14T19:52:51.963237] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-14T19:52:52.127695] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:52:52.761574] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-14T19:52:52.764524] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T19:52:53.347441] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T19:52:53.451783] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T19:52:53.558052] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-14T19:52:54.358043] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-14T19:52:54.554048] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T19:52:55.158095] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-14T19:52:55.958061] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-14T19:52:56.029574] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T19:52:56.128211] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T19:52:56.758099] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-14T19:52:57.493478] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T19:52:57.558062] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-14T19:52:58.358069] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-14T19:52:58.478454] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:52:59.131343] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T19:52:59.158035] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-14T19:52:59.362749] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T19:52:59.958102] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-14T19:53:00.608995] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T19:53:00.758050] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-14T19:53:01.099743] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T19:53:01.558121] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-14T19:53:02.358036] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-14T19:53:02.490475] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T19:53:03.043385] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T19:53:03.158139] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-14T19:53:03.717613] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T19:53:03.958116] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-14T19:53:04.171133] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-14T19:53:04.758068] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-14T19:53:05.558062] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-14T19:53:05.948575] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T19:53:06.328237] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T19:53:06.358061] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-14T19:53:06.498899] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T19:53:07.158108] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-14T19:53:07.780274] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T19:53:07.958113] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-14T19:53:08.758062] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-14T19:53:08.993413] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T19:53:09.279723] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T19:53:09.558076] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-14T19:53:10.358107] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-14T19:53:10.545886] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T19:53:10.661816] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T19:53:11.158178] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-14T19:53:11.958080] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-14T19:53:12.156603] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T19:53:12.346436] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T19:53:12.758112] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-14T19:53:13.432239] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T19:53:13.437523] [INFO ] [REMOTE ] KW: Full fetch complete (57216 records). [2025-10-14T19:53:13.437794] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-14T19:53:13.564752] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-14T19:53:13.739134] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T19:53:13.784756] [INFO ] [REMOTE ] KVUE: Full fetch complete (77839 records). [2025-10-14T19:53:13.790497] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-14T19:53:14.014214] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-14T19:53:14.032954] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-14T19:53:14.049581] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-14T19:53:14.054085] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-14T19:53:14.173590] [DEBUG] [LOCAL ] KW: Trimmed 57216 records to 40532 (keeping 200 days of data) [2025-10-14T19:53:14.370009] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-14T19:53:14.377122] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-14T19:53:14.365605] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-14T19:53:14.382252] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-14T19:53:14.383977] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-14T19:53:14.397889] [DEBUG] [LOCAL ] KVUE: Trimmed 77839 records to 53667 (keeping 200 days of data) [2025-10-14T19:53:14.623243] [DEBUG] [LOCAL ] KW: Primary data saved (40532 records). [2025-10-14T19:53:14.623879] [INFO ] [MAIN ] KW: Full history saved. [2025-10-14T19:53:14.624251] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KW took 27.7s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-14T19:53:14.817502] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:14.955398] [DEBUG] [LOCAL ] KYN: Loaded 30165 existing records from primary storage. [2025-10-14T19:53:14.958451] [INFO ] [MAIN ] KYN: Loaded 30165 existing records. [2025-10-14T19:53:15.210542] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:53:15.213042] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-14T19:53:15.213412] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-14T19:53:15.216185] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-14T19:53:15.217038] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-14T19:53:15.339235] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-14T19:53:15.349796] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-14T19:53:15.360195] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KVUE took 42.2s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-14T19:53:15.679020] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T19:53:15.682066] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:15.711146] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-14T19:53:15.822174] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:15.825066] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T19:53:15.867809] [DEBUG] [LOCAL ] L: Loaded 41080 existing records from primary storage. [2025-10-14T19:53:15.868090] [INFO ] [MAIN ] L: Loaded 41080 existing records. [2025-10-14T19:53:15.963862] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-14T19:53:16.044318] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:53:16.044554] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-14T19:53:16.044599] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-14T19:53:16.045260] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-14T19:53:16.045316] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-14T19:53:16.390267] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:16.674480] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T19:53:16.676275] [INFO ] [REMOTE ] KWR: Full fetch complete (23654 records). [2025-10-14T19:53:16.676347] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-14T19:53:16.767955] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-14T19:53:17.066535] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-14T19:53:17.066702] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-14T19:53:17.067531] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-14T19:53:17.067763] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-14T19:53:17.075178] [DEBUG] [LOCAL ] KWR: Trimmed 23654 records to 16121 (keeping 200 days of data) [2025-10-14T19:53:17.087618] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T19:53:17.194457] [DEBUG] [LOCAL ] KWR: Primary data saved (16121 records). [2025-10-14T19:53:17.194697] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-14T19:53:17.194841] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KWR took 25.8s. Estimated remaining: 2h 40m 25s. Rate: 7.1 symbols/min [2025-10-14T19:53:17.373508] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:17.421521] [DEBUG] [LOCAL ] LAC: Loaded 52482 existing records from primary storage. [2025-10-14T19:53:17.421939] [INFO ] [MAIN ] LAC: Loaded 52482 existing records. [2025-10-14T19:53:17.563265] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-14T19:53:17.626716] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:53:17.626927] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-14T19:53:17.626973] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-14T19:53:17.627844] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-14T19:53:17.627901] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-14T19:53:17.981484] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:18.358108] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-14T19:53:18.507945] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T19:53:18.925709] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T19:53:19.158100] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-14T19:53:19.958102] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-14T19:53:20.196097] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T19:53:20.290367] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T19:53:20.758102] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-14T19:53:21.558039] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-14T19:53:21.636544] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T19:53:22.157133] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:53:22.358044] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-14T19:53:23.065846] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T19:53:23.158054] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-14T19:53:23.754658] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T19:53:23.958063] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-14T19:53:24.270362] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T19:53:24.758045] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-14T19:53:25.204104] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T19:53:25.558057] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-14T19:53:26.350059] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T19:53:26.358094] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-14T19:53:27.158055] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-14T19:53:27.267555] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T19:53:27.273363] [INFO ] [REMOTE ] KVYO: Full fetch complete (72016 records). [2025-10-14T19:53:27.273458] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-14T19:53:27.660012] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-14T19:53:27.660081] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-14T19:53:27.660989] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-14T19:53:27.661050] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-14T19:53:27.662446] [DEBUG] [LOCAL ] KVYO: Trimmed 72016 records to 50745 (keeping 200 days of data) [2025-10-14T19:53:27.949681] [DEBUG] [LOCAL ] KVYO: Primary data saved (50745 records). [2025-10-14T19:53:27.949806] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-14T19:53:27.949898] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KVYO took 51.6s. Estimated remaining: 2h 40m 18s. Rate: 7.1 symbols/min [2025-10-14T19:53:27.981706] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-14T19:53:28.122676] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:28.122932] [DEBUG] [LOCAL ] LAD: No existing data file found in primary storage. [2025-10-14T19:53:28.123014] [WARN ] [MAIN ] LAD: No existing data found, performing full refresh instead. [2025-10-14T19:53:28.123303] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-14T19:53:28.123410] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-14T19:53:28.123495] [DEBUG] [LOCAL ] LAD: No primary data file found to delete. [2025-10-14T19:53:28.123554] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-14T19:53:28.437220] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-14T19:53:28.518121] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:28.760855] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-14T19:53:28.765627] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T19:53:28.871605] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T19:53:29.558038] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-14T19:53:29.662312] [DEBUG] [REMOTE ] L: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-14T19:53:29.662488] [WARN ] [REMOTE ] L: No data returned for month 2025-05 [2025-10-14T19:53:29.662571] [FATAL] [REMOTE ] L: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:53:29.662685] [FATAL] [MAIN ] L: Failed to fetch primary data. [2025-10-14T19:53:29.662754] [WARN ] [MAIN ] L: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:53:29.662824] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-14T19:53:29.662882] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-14T19:53:29.662918] [INFO ] [LOCAL ] L: Starting deletion of derivative data. [2025-10-14T19:53:29.663084] [DEBUG] [LOCAL ] L: Deleted derivative data file. [2025-10-14T19:53:29.663179] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. L took 14.3s. Estimated remaining: 2h 40m 4s. Rate: 7.1 symbols/min [2025-10-14T19:53:29.831836] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:29.866566] [DEBUG] [LOCAL ] LADR: Loaded 39324 existing records from primary storage. [2025-10-14T19:53:29.866860] [INFO ] [MAIN ] LADR: Loaded 39324 existing records. [2025-10-14T19:53:30.042577] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:53:30.042896] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-14T19:53:30.043011] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-14T19:53:30.048895] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-14T19:53:30.054135] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-14T19:53:30.088182] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T19:53:30.363182] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-14T19:53:30.414677] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:31.158046] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-14T19:53:31.734198] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T19:53:31.958026] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-14T19:53:32.047775] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T19:53:32.758037] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-14T19:53:33.223298] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T19:53:33.558111] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-14T19:53:34.143538] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T19:53:34.358073] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-14T19:53:35.158046] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-14T19:53:35.353962] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T19:53:35.546945] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T19:53:35.958094] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-14T19:53:36.215607] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T19:53:36.758120] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-14T19:53:37.152340] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T19:53:37.558099] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-14T19:53:38.358086] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-14T19:53:38.642096] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T19:53:38.756107] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T19:53:38.759834] [INFO ] [REMOTE ] KYN: Full fetch complete (44488 records). [2025-10-14T19:53:38.759920] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-14T19:53:39.138452] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-14T19:53:39.138588] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-14T19:53:39.139444] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-14T19:53:39.139515] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-14T19:53:39.140582] [DEBUG] [LOCAL ] KYN: Trimmed 44488 records to 30240 (keeping 200 days of data) [2025-10-14T19:53:39.191495] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-14T19:53:39.325814] [DEBUG] [LOCAL ] KYN: Primary data saved (30240 records). [2025-10-14T19:53:39.325957] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-14T19:53:39.326037] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. KYN took 24.7s. Estimated remaining: 2h 39m 56s. Rate: 7.1 symbols/min [2025-10-14T19:53:39.498892] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:39.502937] [DEBUG] [LOCAL ] LANV: Loaded 2815 existing records from primary storage. [2025-10-14T19:53:39.503095] [INFO ] [MAIN ] LANV: Loaded 2815 existing records. [2025-10-14T19:53:39.682157] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:53:39.682535] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-14T19:53:39.682607] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-14T19:53:39.682837] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-14T19:53:39.682968] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-14T19:53:39.822000] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T19:53:39.963259] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-14T19:53:40.067032] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:40.261580] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T19:53:40.758062] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-14T19:53:41.558068] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-14T19:53:41.914613] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T19:53:41.947434] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-14T19:53:42.054810] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T19:53:42.358088] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-14T19:53:43.158056] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-14T19:53:43.428936] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T19:53:43.958055] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-14T19:53:44.503964] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T19:53:44.758077] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-14T19:53:45.033546] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T19:53:45.558070] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-14T19:53:45.820046] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T19:53:46.358126] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-14T19:53:46.810728] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-14T19:53:47.158131] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-14T19:53:47.395712] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T19:53:47.604401] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-14T19:53:47.958129] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-14T19:53:48.385023] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-14T19:53:48.758068] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-14T19:53:49.558078] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-14T19:53:49.834633] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T19:53:50.358101] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-14T19:53:50.622118] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-14T19:53:51.141763] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T19:53:51.158045] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-14T19:53:51.958091] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-14T19:53:52.657987] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T19:53:52.758052] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-14T19:53:53.106030] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T19:53:53.558039] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-14T19:53:53.989930] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T19:53:54.116414] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T19:53:54.358082] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-14T19:53:55.158054] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-14T19:53:55.475438] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T19:53:55.612446] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T19:53:55.958056] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-14T19:53:56.491249] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-14T19:53:56.758050] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-14T19:53:57.361673] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T19:53:57.558071] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-14T19:53:58.204284] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T19:53:58.205207] [INFO ] [REMOTE ] LANV: Full fetch complete (4327 records). [2025-10-14T19:53:58.205273] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-14T19:53:58.362191] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-14T19:53:58.562196] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-14T19:53:58.562268] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-14T19:53:58.562401] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-14T19:53:58.562438] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-14T19:53:58.562810] [DEBUG] [LOCAL ] LANV: Trimmed 4327 records to 2789 (keeping 200 days of data) [2025-10-14T19:53:58.578250] [DEBUG] [LOCAL ] LANV: Primary data saved (2789 records). [2025-10-14T19:53:58.578318] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-14T19:53:58.578382] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. LANV took 19.3s. Estimated remaining: 2h 39m 58s. Rate: 7.1 symbols/min [2025-10-14T19:53:58.743348] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:58.743534] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-14T19:53:58.743570] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-14T19:53:58.743702] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-14T19:53:58.743753] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-14T19:53:58.743794] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-14T19:53:58.743825] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-14T19:53:59.089013] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:53:59.158050] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-14T19:53:59.369531] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T19:53:59.369892] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-14T19:53:59.369978] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:53:59.370027] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-14T19:53:59.370070] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:53:59.370107] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-14T19:53:59.370159] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-14T19:53:59.370202] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-14T19:53:59.370239] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-14T19:53:59.370282] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. LAR took 0.8s. Estimated remaining: 2h 39m 42s. Rate: 7.1 symbols/min [2025-10-14T19:53:59.540193] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:53:59.554238] [DEBUG] [LOCAL ] LAW: Loaded 14500 existing records from primary storage. [2025-10-14T19:53:59.554488] [INFO ] [MAIN ] LAW: Loaded 14500 existing records. [2025-10-14T19:53:59.730671] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:53:59.730954] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-14T19:53:59.731003] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-14T19:53:59.731382] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-14T19:53:59.731439] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-14T19:53:59.966827] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-14T19:54:00.087814] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:00.111702] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T19:54:00.758068] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-14T19:54:01.558089] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-14T19:54:02.030402] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-14T19:54:02.163263] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T19:54:02.358061] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-14T19:54:02.580708] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T19:54:03.158147] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-14T19:54:03.873855] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T19:54:03.958150] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-14T19:54:04.758048] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-14T19:54:04.863633] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T19:54:05.185451] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-14T19:54:05.558062] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-14T19:54:06.062085] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T19:54:06.066786] [INFO ] [REMOTE ] LADR: Full fetch complete (55674 records). [2025-10-14T19:54:06.066880] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-14T19:54:06.361401] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-14T19:54:06.459628] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-14T19:54:06.468260] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-14T19:54:06.470078] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-14T19:54:06.469775] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-14T19:54:06.470198] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-14T19:54:06.474996] [DEBUG] [LOCAL ] LADR: Trimmed 55674 records to 39388 (keeping 200 days of data) [2025-10-14T19:54:06.710888] [DEBUG] [LOCAL ] LADR: Primary data saved (39388 records). [2025-10-14T19:54:06.711017] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-14T19:54:06.711090] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LADR took 37.0s. Estimated remaining: 2h 39m 33s. Rate: 7.1 symbols/min [2025-10-14T19:54:06.877458] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:06.914547] [DEBUG] [LOCAL ] LAZ: Loaded 44790 existing records from primary storage. [2025-10-14T19:54:06.914848] [INFO ] [MAIN ] LAZ: Loaded 44790 existing records. [2025-10-14T19:54:07.090880] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:07.091104] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-14T19:54:07.091169] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-14T19:54:07.091994] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-14T19:54:07.092050] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-14T19:54:07.165803] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-14T19:54:07.447976] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:07.958083] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-14T19:54:08.012497] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T19:54:08.283604] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T19:54:08.758055] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-14T19:54:09.450553] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T19:54:09.558047] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-14T19:54:09.610594] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T19:54:10.358094] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-14T19:54:10.747985] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T19:54:11.158120] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-14T19:54:11.925224] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T19:54:11.958072] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-14T19:54:12.047275] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T19:54:12.758132] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-14T19:54:13.558049] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-14T19:54:14.358110] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-14T19:54:14.521352] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-14T19:54:14.527524] [INFO ] [REMOTE ] LAC: Full fetch complete (76111 records). [2025-10-14T19:54:14.527701] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-14T19:54:14.736331] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T19:54:14.831377] [INFO ] [REMOTE ] LAD: Full fetch complete (35335 records). [2025-10-14T19:54:14.848052] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-14T19:54:15.076744] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-14T19:54:15.077102] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-14T19:54:15.093903] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-14T19:54:15.104333] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-14T19:54:15.160014] [DEBUG] [LOCAL ] LAC: Trimmed 76111 records to 52499 (keeping 200 days of data) [2025-10-14T19:54:15.375797] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-14T19:54:15.414636] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-14T19:54:15.479844] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-14T19:54:15.484990] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-14T19:54:15.488744] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-14T19:54:15.498098] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-14T19:54:15.507005] [DEBUG] [LOCAL ] LAD: Trimmed 35335 records to 23409 (keeping 200 days of data) [2025-10-14T19:54:15.797000] [DEBUG] [LOCAL ] LAD: Primary data saved (23409 records). [2025-10-14T19:54:15.819679] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-14T19:54:15.820359] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LAD took 47.9s. Estimated remaining: 2h 39m 25s. Rate: 7.1 symbols/min [2025-10-14T19:54:15.864416] [DEBUG] [LOCAL ] LAC: Primary data saved (52499 records). [2025-10-14T19:54:15.864600] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-14T19:54:15.864740] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAC took 58.7s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-14T19:54:15.866902] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T19:54:15.958080] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-14T19:54:16.398341] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T19:54:16.758106] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-14T19:54:17.533940] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:54:17.558026] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-14T19:54:17.574782] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T19:54:18.358093] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-14T19:54:19.221084] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T19:54:19.231538] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-14T19:54:19.275183] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T19:54:19.958126] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-14T19:54:20.750849] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T19:54:20.766244] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-14T19:54:20.986705] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T19:54:20.989175] [INFO ] [REMOTE ] LAW: Full fetch complete (20851 records). [2025-10-14T19:54:20.989243] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-14T19:54:21.353748] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-14T19:54:21.353829] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-14T19:54:21.354259] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-14T19:54:21.354296] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-14T19:54:21.354872] [DEBUG] [LOCAL ] LAW: Trimmed 20851 records to 14591 (keeping 200 days of data) [2025-10-14T19:54:21.433838] [DEBUG] [LOCAL ] LAW: Primary data saved (14591 records). [2025-10-14T19:54:21.433966] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-14T19:54:21.434043] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LAW took 22.1s. Estimated remaining: 2h 38m 58s. Rate: 7.1 symbols/min [2025-10-14T19:54:22.292439] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T19:54:22.301891] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-14T19:54:23.910257] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T19:54:23.920637] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-14T19:54:25.351060] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T19:54:25.360424] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-14T19:54:27.004080] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T19:54:27.015179] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-14T19:54:28.470553] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T19:54:28.475682] [INFO ] [REMOTE ] LAZ: Full fetch complete (65717 records). [2025-10-14T19:54:28.475819] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-14T19:54:28.875163] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-14T19:54:28.875265] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-14T19:54:28.877305] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-14T19:54:28.877374] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-14T19:54:28.879229] [DEBUG] [LOCAL ] LAZ: Trimmed 65717 records to 44781 (keeping 200 days of data) [2025-10-14T19:54:29.183001] [DEBUG] [LOCAL ] LAZ: Primary data saved (44781 records). [2025-10-14T19:54:29.183193] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-14T19:54:29.183296] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAZ took 22.5s. Estimated remaining: 2h 38m 49s. Rate: 7.1 symbols/min [2025-10-14T19:54:29.926172] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:29.958728] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:29.983567] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:29.984716] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:30.057942] [DEBUG] [LOCAL ] LCII: Loaded 27562 existing records from primary storage. [2025-10-14T19:54:30.069317] [INFO ] [MAIN ] LCII: Loaded 27562 existing records. [2025-10-14T19:54:30.081128] [DEBUG] [LOCAL ] LB: Loaded 37646 existing records from primary storage. [2025-10-14T19:54:30.117779] [INFO ] [MAIN ] LB: Loaded 37646 existing records. [2025-10-14T19:54:30.134604] [DEBUG] [LOCAL ] LBRT: Loaded 52952 existing records from primary storage. [2025-10-14T19:54:30.189436] [INFO ] [MAIN ] LBRT: Loaded 52952 existing records. [2025-10-14T19:54:30.294817] [DEBUG] [LOCAL ] LC: Loaded 48079 existing records from primary storage. [2025-10-14T19:54:30.531263] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:30.511752] [INFO ] [MAIN ] LC: Loaded 48079 existing records. [2025-10-14T19:54:30.537385] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-14T19:54:30.548565] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-14T19:54:30.589621] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-14T19:54:30.654480] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-14T19:54:30.874148] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:30.891215] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:30.913397] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-14T19:54:30.957449] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-14T19:54:30.972363] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-14T19:54:31.029763] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-14T19:54:31.029470] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:31.035483] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-14T19:54:31.044375] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-14T19:54:31.049779] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-14T19:54:31.055270] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-14T19:54:31.055453] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-14T19:54:31.074171] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-14T19:54:31.099802] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-14T19:54:31.100052] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-14T19:54:32.219616] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:32.316733] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-14T19:54:32.487097] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:32.529976] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-14T19:54:32.567526] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:32.582096] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-14T19:54:32.581734] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:32.584090] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-14T19:54:33.420340] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T19:54:33.424998] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-14T19:54:34.065888] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T19:54:34.074448] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-14T19:54:34.259079] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T19:54:34.269001] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-14T19:54:34.356938] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T19:54:34.370313] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-14T19:54:34.387590] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T19:54:34.393612] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-14T19:54:35.576948] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T19:54:35.586289] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-14T19:54:35.632250] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T19:54:35.637579] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-14T19:54:35.722738] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T19:54:35.734053] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-14T19:54:36.094608] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T19:54:36.105353] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-14T19:54:36.976441] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T19:54:36.983492] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-14T19:54:37.070615] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T19:54:37.078551] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-14T19:54:37.353935] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T19:54:37.365189] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-14T19:54:37.791759] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T19:54:37.801431] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-14T19:54:38.503949] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T19:54:38.512308] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-14T19:54:38.748624] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T19:54:39.169765] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-14T19:54:39.174427] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T19:54:39.348706] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T19:54:39.382621] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T19:54:39.958091] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-14T19:54:40.354215] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T19:54:40.758134] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-14T19:54:41.544680] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T19:54:41.558040] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-14T19:54:42.358103] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-14T19:54:42.566079] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T19:54:42.717101] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T19:54:43.108996] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T19:54:43.158026] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-14T19:54:43.958107] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-14T19:54:44.382357] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T19:54:44.758104] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-14T19:54:45.517094] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T19:54:45.558060] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-14T19:54:46.358075] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-14T19:54:46.391412] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T19:54:47.158039] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-14T19:54:47.270379] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T19:54:47.958045] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-14T19:54:48.459979] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T19:54:48.758178] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-14T19:54:49.377556] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T19:54:49.558086] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-14T19:54:49.644356] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-10-14T19:54:50.195056] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T19:54:50.358056] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-14T19:54:51.158102] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-14T19:54:51.246719] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T19:54:51.958075] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-14T19:54:52.251223] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T19:54:52.286735] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T19:54:52.758073] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-14T19:54:53.399069] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T19:54:53.405161] [INFO ] [REMOTE ] LC: Full fetch complete (70633 records). [2025-10-14T19:54:53.405310] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-14T19:54:53.571344] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-14T19:54:53.843175] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-14T19:54:53.843269] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-14T19:54:53.844440] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-14T19:54:53.844508] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-14T19:54:53.845966] [DEBUG] [LOCAL ] LC: Trimmed 70633 records to 48108 (keeping 200 days of data) [2025-10-14T19:54:54.122822] [DEBUG] [LOCAL ] LC: Primary data saved (48108 records). [2025-10-14T19:54:54.122948] [INFO ] [MAIN ] LC: Full history saved. [2025-10-14T19:54:54.123022] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LC took 24.9s. Estimated remaining: 2h 38m 55s. Rate: 7.1 symbols/min [2025-10-14T19:54:54.302230] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:54.334576] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T19:54:54.360462] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-14T19:54:54.379578] [DEBUG] [LOCAL ] LDI: Loaded 44727 existing records from primary storage. [2025-10-14T19:54:54.379901] [INFO ] [MAIN ] LDI: Loaded 44727 existing records. [2025-10-14T19:54:54.563985] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:54.564199] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-14T19:54:54.564248] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-14T19:54:54.564628] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-14T19:54:54.564723] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-14T19:54:54.883223] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T19:54:54.920769] [INFO ] [REMOTE ] LCII: Full fetch complete (39136 records). [2025-10-14T19:54:54.936639] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-14T19:54:54.958508] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:55.158491] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-14T19:54:55.358688] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-14T19:54:55.358798] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-14T19:54:55.360313] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-14T19:54:55.360376] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-14T19:54:55.361546] [DEBUG] [LOCAL ] LCII: Trimmed 39136 records to 27499 (keeping 200 days of data) [2025-10-14T19:54:55.545840] [DEBUG] [LOCAL ] LCII: Primary data saved (27499 records). [2025-10-14T19:54:55.546029] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-14T19:54:55.546129] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LCII took 26.4s. Estimated remaining: 2h 38m 40s. Rate: 7.1 symbols/min [2025-10-14T19:54:55.728501] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:54:55.778508] [DEBUG] [LOCAL ] LDOS: Loaded 45172 existing records from primary storage. [2025-10-14T19:54:55.778955] [INFO ] [MAIN ] LDOS: Loaded 45172 existing records. [2025-10-14T19:54:55.962791] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-14T19:54:55.970771] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:54:55.971361] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-14T19:54:55.971461] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-14T19:54:55.972587] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-14T19:54:55.972682] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-14T19:54:56.337504] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:54:56.366810] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-14T19:54:56.645707] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T19:54:56.758036] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-14T19:54:57.371903] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T19:54:57.558070] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-14T19:54:58.271329] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T19:54:58.358033] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-14T19:54:59.158091] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-14T19:54:59.208471] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T19:54:59.273325] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T19:54:59.958141] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-14T19:55:00.758087] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-14T19:55:00.861410] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T19:55:01.558080] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-14T19:55:01.727083] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-14T19:55:01.734875] [INFO ] [REMOTE ] LBRT: Full fetch complete (76819 records). [2025-10-14T19:55:01.735125] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-14T19:55:02.173451] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-14T19:55:02.173639] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-14T19:55:02.174805] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-14T19:55:02.174869] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-14T19:55:02.176401] [DEBUG] [LOCAL ] LBRT: Trimmed 76819 records to 52954 (keeping 200 days of data) [2025-10-14T19:55:02.264070] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T19:55:02.388964] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-14T19:55:02.541788] [DEBUG] [LOCAL ] LBRT: Primary data saved (52954 records). [2025-10-14T19:55:02.541928] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-14T19:55:02.542006] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LBRT took 33.4s. Estimated remaining: 2h 38m 31s. Rate: 7.1 symbols/min [2025-10-14T19:55:02.736013] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:55:02.751204] [DEBUG] [LOCAL ] LDP: Loaded 12892 existing records from primary storage. [2025-10-14T19:55:02.751437] [INFO ] [MAIN ] LDP: Loaded 12892 existing records. [2025-10-14T19:55:02.957113] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:55:02.957479] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-14T19:55:02.957559] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-14T19:55:02.957968] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-14T19:55:02.958047] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-14T19:55:03.187098] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-14T19:55:03.348798] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:55:03.767992] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T19:55:03.958078] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-14T19:55:04.523334] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-10-14T19:55:04.758076] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-14T19:55:04.980234] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T19:55:05.071438] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T19:55:05.075931] [INFO ] [REMOTE ] LB: Full fetch complete (56002 records). [2025-10-14T19:55:05.076029] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-14T19:55:05.459168] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-14T19:55:05.459258] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-14T19:55:05.460193] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-14T19:55:05.460257] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-14T19:55:05.461544] [DEBUG] [LOCAL ] LB: Trimmed 56002 records to 37450 (keeping 200 days of data) [2025-10-14T19:55:05.572693] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-14T19:55:05.686968] [DEBUG] [LOCAL ] LB: Primary data saved (37450 records). [2025-10-14T19:55:05.687110] [INFO ] [MAIN ] LB: Full history saved. [2025-10-14T19:55:05.687190] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LB took 36.5s. Estimated remaining: 2h 38m 17s. Rate: 7.1 symbols/min [2025-10-14T19:55:05.858717] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:55:05.897350] [DEBUG] [LOCAL ] LEA: Loaded 41508 existing records from primary storage. [2025-10-14T19:55:05.897667] [INFO ] [MAIN ] LEA: Loaded 41508 existing records. [2025-10-14T19:55:06.044891] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T19:55:06.121955] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:55:06.122217] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-14T19:55:06.122265] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-14T19:55:06.122725] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-14T19:55:06.122782] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-14T19:55:06.363213] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-14T19:55:06.475633] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:55:07.158099] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-14T19:55:07.360380] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T19:55:07.706139] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T19:55:07.958177] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-14T19:55:08.749935] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T19:55:08.758044] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-14T19:55:09.092780] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T19:55:09.558104] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-14T19:55:10.358094] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-14T19:55:10.548198] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T19:55:10.567766] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T19:55:11.158087] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-14T19:55:11.816780] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T19:55:11.958090] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-14T19:55:12.307973] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T19:55:12.758126] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-14T19:55:13.508631] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T19:55:13.504444] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T19:55:13.558093] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-14T19:55:14.358127] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-14T19:55:14.935402] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T19:55:15.158085] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-14T19:55:15.899997] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T19:55:15.958082] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-14T19:55:16.662799] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T19:55:16.758067] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-14T19:55:17.151143] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T19:55:17.558090] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-14T19:55:18.358111] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-14T19:55:18.412727] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T19:55:19.158115] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-14T19:55:19.282500] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-14T19:55:19.762526] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-14T19:55:19.958063] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-14T19:55:20.768849] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-14T19:55:20.778050] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T19:55:20.919768] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T19:55:21.558081] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-14T19:55:22.358142] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-14T19:55:22.993222] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-14T19:55:23.125514] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T19:55:23.158109] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-14T19:55:23.362619] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T19:55:23.368635] [INFO ] [REMOTE ] LDI: Full fetch complete (61621 records). [2025-10-14T19:55:23.368786] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-14T19:55:23.767724] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-14T19:55:23.767830] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-14T19:55:23.768921] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-14T19:55:23.768983] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-14T19:55:23.770192] [DEBUG] [LOCAL ] LDI: Trimmed 61621 records to 44773 (keeping 200 days of data) [2025-10-14T19:55:23.958971] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-14T19:55:24.036853] [DEBUG] [LOCAL ] LDI: Primary data saved (44773 records). [2025-10-14T19:55:24.037005] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-14T19:55:24.037090] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LDI took 29.9s. Estimated remaining: 2h 38m 18s. Rate: 7.1 symbols/min [2025-10-14T19:55:24.212015] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:55:24.256791] [DEBUG] [LOCAL ] LEG: Loaded 50184 existing records from primary storage. [2025-10-14T19:55:24.257194] [INFO ] [MAIN ] LEG: Loaded 50184 existing records. [2025-10-14T19:55:24.446527] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:55:24.446726] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-14T19:55:24.446780] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-14T19:55:24.447010] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-14T19:55:24.447049] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-14T19:55:24.760545] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-14T19:55:24.828817] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T19:55:24.869666] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:55:25.515188] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:55:25.549565] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T19:55:25.558048] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-14T19:55:26.358074] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-14T19:55:26.470614] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T19:55:27.158067] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-14T19:55:27.958067] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-14T19:55:27.991231] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:55:28.580531] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T19:55:28.758066] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-14T19:55:29.558047] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-14T19:55:29.691907] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T19:55:29.842676] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T19:55:30.358058] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-14T19:55:31.138046] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T19:55:31.158030] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-14T19:55:31.633135] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T19:55:31.958067] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-14T19:55:32.641233] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T19:55:32.758029] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-14T19:55:33.532216] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T19:55:33.536927] [INFO ] [REMOTE ] LDOS: Full fetch complete (67221 records). [2025-10-14T19:55:33.537019] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-14T19:55:33.568589] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-14T19:55:33.951191] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-14T19:55:33.951365] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-14T19:55:33.952363] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-14T19:55:33.952423] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-14T19:55:33.953764] [DEBUG] [LOCAL ] LDOS: Trimmed 67221 records to 45119 (keeping 200 days of data) [2025-10-14T19:55:34.209776] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T19:55:34.271890] [DEBUG] [LOCAL ] LDOS: Primary data saved (45119 records). [2025-10-14T19:55:34.272023] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-14T19:55:34.272103] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDOS took 38.7s. Estimated remaining: 2h 38m 11s. Rate: 7.1 symbols/min [2025-10-14T19:55:34.363312] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-14T19:55:34.446816] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:55:34.456157] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T19:55:34.510462] [DEBUG] [LOCAL ] LEN: Loaded 53175 existing records from primary storage. [2025-10-14T19:55:34.510840] [INFO ] [MAIN ] LEN: Loaded 53175 existing records. [2025-10-14T19:55:34.687563] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:55:34.687760] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-14T19:55:34.687811] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-14T19:55:34.688350] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-14T19:55:34.688406] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-14T19:55:35.039107] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:55:35.158078] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-14T19:55:35.812213] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T19:55:35.948747] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T19:55:35.950478] [INFO ] [REMOTE ] LDP: Full fetch complete (19007 records). [2025-10-14T19:55:35.950564] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-14T19:55:35.963291] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-14T19:55:36.323146] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-14T19:55:36.323261] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-14T19:55:36.323741] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-14T19:55:36.323801] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-14T19:55:36.324331] [DEBUG] [LOCAL ] LDP: Trimmed 19007 records to 12849 (keeping 200 days of data) [2025-10-14T19:55:36.400924] [DEBUG] [LOCAL ] LDP: Primary data saved (12849 records). [2025-10-14T19:55:36.401054] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-14T19:55:36.401167] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LDP took 33.9s. Estimated remaining: 2h 37m 57s. Rate: 7.1 symbols/min [2025-10-14T19:55:36.572089] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:55:36.572229] [DEBUG] [LOCAL ] LEO: No existing data file found in primary storage. [2025-10-14T19:55:36.572266] [WARN ] [MAIN ] LEO: No existing data found, performing full refresh instead. [2025-10-14T19:55:36.572392] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-14T19:55:36.572431] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-14T19:55:36.572470] [DEBUG] [LOCAL ] LEO: No primary data file found to delete. [2025-10-14T19:55:36.572502] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-14T19:55:36.763331] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-14T19:55:36.926908] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:55:37.558041] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-14T19:55:37.945101] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T19:55:38.358036] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-14T19:55:38.374597] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T19:55:38.379230] [INFO ] [REMOTE ] LEA: Full fetch complete (60628 records). [2025-10-14T19:55:38.379333] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-14T19:55:38.563003] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T19:55:38.785229] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-14T19:55:38.785306] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-14T19:55:38.786250] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-14T19:55:38.786322] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-14T19:55:38.787469] [DEBUG] [LOCAL ] LEA: Trimmed 60628 records to 41400 (keeping 200 days of data) [2025-10-14T19:55:39.076793] [DEBUG] [LOCAL ] LEA: Primary data saved (41400 records). [2025-10-14T19:55:39.076940] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-14T19:55:39.077038] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LEA took 33.4s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-14T19:55:39.163197] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-14T19:55:39.250734] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:55:39.300625] [DEBUG] [LOCAL ] LEVI: Loaded 51716 existing records from primary storage. [2025-10-14T19:55:39.300962] [INFO ] [MAIN ] LEVI: Loaded 51716 existing records. [2025-10-14T19:55:39.478965] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:55:39.479244] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-14T19:55:39.479366] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-14T19:55:39.479911] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-14T19:55:39.479968] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-14T19:55:39.861950] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:55:39.889216] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T19:55:39.958023] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-14T19:55:40.180345] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T19:55:40.758071] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-14T19:55:41.558081] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-14T19:55:41.705863] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:55:41.775780] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T19:55:42.358076] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-14T19:55:43.070890] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T19:55:43.158037] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-14T19:55:43.958048] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-14T19:55:44.165340] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T19:55:44.758056] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-14T19:55:45.562739] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-14T19:55:45.576058] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-14T19:55:45.613123] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T19:55:46.092790] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T19:55:46.358101] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-14T19:55:47.158047] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-14T19:55:47.356035] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T19:55:47.958132] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-14T19:55:48.180006] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T19:55:48.309607] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T19:55:48.758083] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-14T19:55:49.558049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-14T19:55:49.642924] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T19:55:49.661608] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T19:55:50.358090] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-14T19:55:51.158063] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-14T19:55:51.300794] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T19:55:51.644957] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T19:55:51.751463] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T19:55:51.958079] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-14T19:55:52.758082] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-14T19:55:53.558102] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-14T19:55:53.775617] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T19:55:54.358049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-14T19:55:54.500126] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T19:55:54.697891] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T19:55:55.158081] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-14T19:55:55.604766] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T19:55:55.958111] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-14T19:55:56.758050] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-14T19:55:56.870798] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T19:55:56.938882] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T19:55:57.558063] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-14T19:55:58.367189] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-14T19:55:58.372888] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T19:55:59.158049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-14T19:55:59.225580] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T19:55:59.318106] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T19:55:59.958063] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-14T19:56:00.646321] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T19:56:00.758041] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-14T19:56:01.558070] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-14T19:56:01.965063] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T19:56:02.062563] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T19:56:02.169322] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T19:56:02.171321] [INFO ] [REMOTE ] LEO: Full fetch complete (26641 records). [2025-10-14T19:56:02.171416] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-14T19:56:02.365968] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-14T19:56:02.545298] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-14T19:56:02.545380] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-14T19:56:02.545940] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-14T19:56:02.546002] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-14T19:56:02.546729] [DEBUG] [LOCAL ] LEO: Trimmed 26641 records to 16716 (keeping 200 days of data) [2025-10-14T19:56:02.642394] [DEBUG] [LOCAL ] LEO: Primary data saved (16716 records). [2025-10-14T19:56:02.642541] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-14T19:56:02.642616] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEO took 26.2s. Estimated remaining: 2h 37m 48s. Rate: 7.1 symbols/min [2025-10-14T19:56:02.816224] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:02.834902] [DEBUG] [LOCAL ] LFT: Loaded 18325 existing records from primary storage. [2025-10-14T19:56:02.835145] [INFO ] [MAIN ] LFT: Loaded 18325 existing records. [2025-10-14T19:56:03.020354] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:03.020590] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-14T19:56:03.020637] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-14T19:56:03.021059] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-14T19:56:03.021116] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-14T19:56:03.164602] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-14T19:56:03.383575] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:03.958097] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-14T19:56:04.303153] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T19:56:04.758049] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-14T19:56:05.028751] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T19:56:05.152528] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T19:56:05.558106] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-14T19:56:06.358098] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-14T19:56:06.639216] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T19:56:07.158056] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-14T19:56:07.317448] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T19:56:07.779536] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T19:56:07.895603] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T19:56:07.901241] [INFO ] [REMOTE ] LEG: Full fetch complete (73075 records). [2025-10-14T19:56:07.901347] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-14T19:56:07.967783] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-14T19:56:08.297941] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-14T19:56:08.298018] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-14T19:56:08.299023] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-14T19:56:08.299084] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-14T19:56:08.300371] [DEBUG] [LOCAL ] LEG: Trimmed 73075 records to 50183 (keeping 200 days of data) [2025-10-14T19:56:08.587955] [DEBUG] [LOCAL ] LEG: Primary data saved (50183 records). [2025-10-14T19:56:08.588086] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-14T19:56:08.588161] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEG took 44.6s. Estimated remaining: 2h 37m 38s. Rate: 7.1 symbols/min [2025-10-14T19:56:08.757629] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:08.758175] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-14T19:56:08.770040] [DEBUG] [LOCAL ] LGI: Loaded 10043 existing records from primary storage. [2025-10-14T19:56:08.770256] [INFO ] [MAIN ] LGI: Loaded 10043 existing records. [2025-10-14T19:56:08.949834] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:08.950050] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-14T19:56:08.950097] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-14T19:56:08.950249] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-14T19:56:08.950286] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-14T19:56:09.308772] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:09.558047] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-14T19:56:09.597034] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T19:56:09.995386] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-14T19:56:10.358114] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-14T19:56:11.162540] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T19:56:11.160560] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-14T19:56:11.174022] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T19:56:11.958080] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-14T19:56:12.758035] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-14T19:56:13.407710] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-14T19:56:13.561203] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-14T19:56:13.563014] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T19:56:13.749385] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-14T19:56:13.755354] [INFO ] [REMOTE ] LEVI: Full fetch complete (74781 records). [2025-10-14T19:56:13.755468] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-14T19:56:14.200880] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-14T19:56:14.200974] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-14T19:56:14.202199] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-14T19:56:14.202273] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-14T19:56:14.204327] [DEBUG] [LOCAL ] LEVI: Trimmed 74781 records to 51765 (keeping 200 days of data) [2025-10-14T19:56:14.381877] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-14T19:56:14.521148] [DEBUG] [LOCAL ] LEVI: Primary data saved (51765 records). [2025-10-14T19:56:14.521275] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-14T19:56:14.521353] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEVI took 35.4s. Estimated remaining: 2h 37m 27s. Rate: 7.1 symbols/min [2025-10-14T19:56:14.686399] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:14.724026] [DEBUG] [LOCAL ] LH: Loaded 37690 existing records from primary storage. [2025-10-14T19:56:14.724294] [INFO ] [MAIN ] LH: Loaded 37690 existing records. [2025-10-14T19:56:14.906097] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:14.906301] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-14T19:56:14.906348] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-14T19:56:14.906724] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-14T19:56:14.906781] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-14T19:56:15.019864] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T19:56:15.163350] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-14T19:56:15.277569] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:15.573631] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-14T19:56:15.579711] [INFO ] [REMOTE ] LEN: Full fetch complete (77190 records). [2025-10-14T19:56:15.579850] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-14T19:56:15.964927] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-14T19:56:15.966931] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-14T19:56:15.967017] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-14T19:56:15.968175] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-14T19:56:15.968351] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-14T19:56:15.969909] [DEBUG] [LOCAL ] LEN: Trimmed 77190 records to 53192 (keeping 200 days of data) [2025-10-14T19:56:16.073824] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T19:56:16.317318] [DEBUG] [LOCAL ] LEN: Primary data saved (53192 records). [2025-10-14T19:56:16.317487] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-14T19:56:16.317583] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEN took 42.0s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-14T19:56:16.483522] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:16.528178] [DEBUG] [LOCAL ] LHX: Loaded 48591 existing records from primary storage. [2025-10-14T19:56:16.528535] [INFO ] [MAIN ] LHX: Loaded 48591 existing records. [2025-10-14T19:56:16.701114] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:16.701323] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-14T19:56:16.701371] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-14T19:56:16.701984] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-14T19:56:16.702042] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-14T19:56:16.763289] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-14T19:56:16.997209] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T19:56:17.068468] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:17.558091] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-14T19:56:17.572135] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T19:56:18.358079] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-14T19:56:18.628968] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T19:56:19.158054] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-14T19:56:19.529565] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T19:56:19.958051] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-14T19:56:20.587710] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T19:56:20.605308] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T19:56:20.758067] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-14T19:56:21.558073] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-14T19:56:22.358068] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-14T19:56:22.382723] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T19:56:22.566770] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T19:56:23.158078] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-14T19:56:23.848372] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T19:56:23.863593] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T19:56:23.958070] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-14T19:56:24.724329] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T19:56:24.758074] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-14T19:56:25.558046] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-14T19:56:25.626796] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T19:56:26.358073] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-14T19:56:26.633261] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T19:56:26.760286] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-14T19:56:27.158096] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-14T19:56:27.956729] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T19:56:27.958787] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-14T19:56:27.960427] [INFO ] [REMOTE ] LGI: Full fetch complete (14508 records). [2025-10-14T19:56:27.960502] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-14T19:56:28.320415] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-14T19:56:28.320498] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-14T19:56:28.320893] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-14T19:56:28.320954] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-14T19:56:28.321425] [DEBUG] [LOCAL ] LGI: Trimmed 14508 records to 10092 (keeping 200 days of data) [2025-10-14T19:56:28.382132] [DEBUG] [LOCAL ] LGI: Primary data saved (10092 records). [2025-10-14T19:56:28.382262] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-14T19:56:28.382341] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LGI took 19.8s. Estimated remaining: 2h 37m 7s. Rate: 7.1 symbols/min [2025-10-14T19:56:28.552610] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:28.580711] [DEBUG] [LOCAL ] LII: Loaded 27925 existing records from primary storage. [2025-10-14T19:56:28.580968] [INFO ] [MAIN ] LII: Loaded 27925 existing records. [2025-10-14T19:56:28.761627] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-14T19:56:28.761514] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:28.762948] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-14T19:56:28.763042] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-14T19:56:28.763303] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-14T19:56:28.763344] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-14T19:56:29.116466] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:29.558082] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-14T19:56:29.770542] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T19:56:30.320144] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T19:56:30.358066] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-14T19:56:30.784425] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T19:56:31.158120] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-14T19:56:31.958061] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-14T19:56:32.046151] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T19:56:32.121124] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T19:56:32.742632] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T19:56:32.758016] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-14T19:56:33.558068] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-14T19:56:33.819034] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T19:56:34.358086] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-14T19:56:34.950174] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T19:56:35.158095] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-14T19:56:35.958097] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-14T19:56:36.220901] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T19:56:36.556449] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T19:56:36.672358] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T19:56:36.758031] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-14T19:56:37.558093] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-14T19:56:37.774431] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T19:56:37.776994] [INFO ] [REMOTE ] LFT: Full fetch complete (24057 records). [2025-10-14T19:56:37.777084] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-14T19:56:38.145173] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-14T19:56:38.145247] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-14T19:56:38.145741] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-14T19:56:38.145800] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-14T19:56:38.146373] [DEBUG] [LOCAL ] LFT: Trimmed 24057 records to 18370 (keeping 200 days of data) [2025-10-14T19:56:38.250726] [DEBUG] [LOCAL ] LFT: Primary data saved (18370 records). [2025-10-14T19:56:38.250855] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-14T19:56:38.250928] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LFT took 35.6s. Estimated remaining: 2h 37m 0s. Rate: 7.1 symbols/min [2025-10-14T19:56:38.363196] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-14T19:56:38.426925] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:38.467518] [DEBUG] [LOCAL ] LION: Loaded 46070 existing records from primary storage. [2025-10-14T19:56:38.467874] [INFO ] [MAIN ] LION: Loaded 46070 existing records. [2025-10-14T19:56:38.646702] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:38.646906] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-14T19:56:38.646998] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-14T19:56:38.647491] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-14T19:56:38.647548] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-14T19:56:39.007718] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:39.039491] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T19:56:39.158083] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-14T19:56:39.958061] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-14T19:56:40.247964] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T19:56:40.757114] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T19:56:40.765862] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-14T19:56:41.283934] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T19:56:41.558114] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-14T19:56:42.358036] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-14T19:56:42.614770] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T19:56:42.727215] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-14T19:56:43.158038] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-14T19:56:43.241084] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T19:56:43.958079] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-14T19:56:44.758098] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-14T19:56:45.052834] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T19:56:45.571451] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-14T19:56:45.574316] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T19:56:46.017467] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T19:56:46.358128] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-14T19:56:47.158086] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-14T19:56:47.434531] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T19:56:47.474558] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T19:56:47.958148] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-14T19:56:48.673328] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T19:56:48.758051] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-14T19:56:49.043211] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T19:56:49.558067] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-14T19:56:50.273928] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T19:56:50.358085] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-14T19:56:50.756345] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T19:56:51.158079] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-14T19:56:51.922453] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T19:56:51.958037] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-14T19:56:52.146118] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T19:56:52.758080] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-14T19:56:53.291291] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-14T19:56:53.558063] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-14T19:56:54.117605] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T19:56:54.358119] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-14T19:56:54.875118] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T19:56:55.158047] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-14T19:56:55.572898] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T19:56:55.958067] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-14T19:56:56.673073] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T19:56:56.677226] [INFO ] [REMOTE ] LH: Full fetch complete (54943 records). [2025-10-14T19:56:56.677330] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-14T19:56:56.768013] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-14T19:56:57.054418] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-14T19:56:57.054492] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-14T19:56:57.055414] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-14T19:56:57.055483] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-14T19:56:57.056557] [DEBUG] [LOCAL ] LH: Trimmed 54943 records to 37606 (keeping 200 days of data) [2025-10-14T19:56:57.297418] [DEBUG] [LOCAL ] LH: Primary data saved (37606 records). [2025-10-14T19:56:57.297552] [INFO ] [MAIN ] LH: Full history saved. [2025-10-14T19:56:57.298421] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LH took 42.8s. Estimated remaining: 2h 37m 1s. Rate: 7.1 symbols/min [2025-10-14T19:56:57.471339] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:56:57.503464] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T19:56:57.506616] [DEBUG] [LOCAL ] LITB: Loaded 4216 existing records from primary storage. [2025-10-14T19:56:57.507069] [INFO ] [MAIN ] LITB: Loaded 4216 existing records. [2025-10-14T19:56:57.572397] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-14T19:56:57.697479] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:56:57.697756] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-14T19:56:57.697811] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-14T19:56:57.698012] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-14T19:56:57.698070] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-14T19:56:58.062969] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:56:58.358069] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-14T19:56:58.470338] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T19:56:58.787497] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-14T19:56:58.892481] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T19:56:59.158135] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-14T19:56:59.958072] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-14T19:57:00.511709] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T19:57:00.758073] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-14T19:57:00.844898] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T19:57:00.850552] [INFO ] [REMOTE ] LHX: Full fetch complete (70703 records). [2025-10-14T19:57:00.850748] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-14T19:57:01.273318] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-14T19:57:01.273103] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T19:57:01.273552] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-14T19:57:01.276726] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-14T19:57:01.276824] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-14T19:57:01.279052] [DEBUG] [LOCAL ] LHX: Trimmed 70703 records to 48594 (keeping 200 days of data) [2025-10-14T19:57:01.560478] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-14T19:57:01.627715] [DEBUG] [LOCAL ] LHX: Primary data saved (48594 records). [2025-10-14T19:57:01.628124] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-14T19:57:01.628268] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LHX took 45.3s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-14T19:57:01.816030] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:01.874617] [DEBUG] [LOCAL ] LLY: Loaded 53276 existing records from primary storage. [2025-10-14T19:57:01.875172] [INFO ] [MAIN ] LLY: Loaded 53276 existing records. [2025-10-14T19:57:02.066211] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:02.066543] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-14T19:57:02.066597] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-14T19:57:02.068316] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-14T19:57:02.068388] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-14T19:57:02.357770] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T19:57:02.358066] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-14T19:57:02.440121] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:03.158067] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-14T19:57:03.709819] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T19:57:03.713283] [INFO ] [REMOTE ] LII: Full fetch complete (41331 records). [2025-10-14T19:57:03.713365] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-14T19:57:03.963301] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-14T19:57:04.085669] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-14T19:57:04.085759] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-14T19:57:04.086528] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-14T19:57:04.086567] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-14T19:57:04.087515] [DEBUG] [LOCAL ] LII: Trimmed 41331 records to 27855 (keeping 200 days of data) [2025-10-14T19:57:04.260841] [DEBUG] [LOCAL ] LII: Primary data saved (27855 records). [2025-10-14T19:57:04.260961] [INFO ] [MAIN ] LII: Full history saved. [2025-10-14T19:57:04.261031] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LII took 35.9s. Estimated remaining: 2h 36m 35s. Rate: 7.1 symbols/min [2025-10-14T19:57:04.429901] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:04.477568] [DEBUG] [LOCAL ] LMND: Loaded 52006 existing records from primary storage. [2025-10-14T19:57:04.478043] [INFO ] [MAIN ] LMND: Loaded 52006 existing records. [2025-10-14T19:57:04.657563] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:04.657875] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-14T19:57:04.657963] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-14T19:57:04.659053] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-14T19:57:04.659115] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-14T19:57:04.759958] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-14T19:57:04.973361] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T19:57:05.060950] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:05.535714] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T19:57:05.558030] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-14T19:57:06.102245] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T19:57:06.358031] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-14T19:57:06.520138] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-14T19:57:06.865376] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-14T19:57:07.158037] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-14T19:57:07.958075] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-14T19:57:08.758089] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-14T19:57:09.234230] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-14T19:57:09.558046] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-14T19:57:09.599478] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-14T19:57:09.682705] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T19:57:10.004845] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T19:57:10.358059] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-14T19:57:11.158094] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-14T19:57:11.926785] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T19:57:11.958033] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-14T19:57:12.758174] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-14T19:57:13.483768] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T19:57:13.490705] [INFO ] [REMOTE ] LION: Full fetch complete (56831 records). [2025-10-14T19:57:13.490958] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-14T19:57:13.560707] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-14T19:57:13.662022] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-14T19:57:13.976616] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-14T19:57:13.976731] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-14T19:57:13.977854] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-14T19:57:13.977920] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-14T19:57:13.979326] [DEBUG] [LOCAL ] LION: Trimmed 56831 records to 46175 (keeping 200 days of data) [2025-10-14T19:57:14.256160] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T19:57:14.269205] [DEBUG] [LOCAL ] LION: Primary data saved (46175 records). [2025-10-14T19:57:14.270333] [INFO ] [MAIN ] LION: Full history saved. [2025-10-14T19:57:14.270508] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LION took 36.0s. Estimated remaining: 2h 36m 28s. Rate: 7.1 symbols/min [2025-10-14T19:57:14.365059] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-14T19:57:14.474770] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:14.505341] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T19:57:14.554910] [DEBUG] [LOCAL ] LMT: Loaded 49667 existing records from primary storage. [2025-10-14T19:57:14.555279] [INFO ] [MAIN ] LMT: Loaded 49667 existing records. [2025-10-14T19:57:14.731364] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:14.731604] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-14T19:57:14.731676] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-14T19:57:14.732639] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-14T19:57:14.732727] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-14T19:57:15.093522] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:15.158043] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-14T19:57:15.958072] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-14T19:57:16.758096] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-14T19:57:16.879623] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-14T19:57:17.192162] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-14T19:57:17.324738] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T19:57:17.339156] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T19:57:17.340970] [INFO ] [REMOTE ] LITB: Full fetch complete (5673 records). [2025-10-14T19:57:17.341164] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-14T19:57:17.563333] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-14T19:57:17.701044] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-14T19:57:17.701166] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-14T19:57:17.701349] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-14T19:57:17.701387] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-14T19:57:17.701781] [DEBUG] [LOCAL ] LITB: Trimmed 5673 records to 4160 (keeping 200 days of data) [2025-10-14T19:57:17.724215] [DEBUG] [LOCAL ] LITB: Primary data saved (4160 records). [2025-10-14T19:57:17.724289] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-14T19:57:17.724360] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LITB took 20.4s. Estimated remaining: 2h 36m 16s. Rate: 7.1 symbols/min [2025-10-14T19:57:17.889557] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:17.937443] [DEBUG] [LOCAL ] LNC: Loaded 51595 existing records from primary storage. [2025-10-14T19:57:17.937803] [INFO ] [MAIN ] LNC: Loaded 51595 existing records. [2025-10-14T19:57:18.124417] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:18.124689] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-14T19:57:18.124748] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-14T19:57:18.125923] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-14T19:57:18.125993] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-14T19:57:18.370351] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-14T19:57:18.493806] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:19.158091] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-14T19:57:19.595736] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-14T19:57:19.958104] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-14T19:57:20.495227] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T19:57:20.758079] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-14T19:57:20.828854] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-14T19:57:21.558109] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-14T19:57:21.746748] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T19:57:21.980463] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T19:57:22.358057] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-14T19:57:23.158116] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-14T19:57:23.914085] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T19:57:23.958036] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-14T19:57:24.147545] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-14T19:57:24.758037] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-14T19:57:25.040271] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T19:57:25.558061] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-14T19:57:25.728846] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T19:57:26.358038] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-14T19:57:26.511000] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T19:57:27.158078] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-14T19:57:27.640975] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-14T19:57:27.958042] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-14T19:57:28.189278] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T19:57:28.758052] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-14T19:57:28.960287] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T19:57:29.558092] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-14T19:57:30.358083] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-14T19:57:30.467737] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-14T19:57:30.790682] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-14T19:57:31.158080] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-14T19:57:31.270689] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T19:57:31.958039] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-14T19:57:32.142294] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T19:57:32.758118] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-14T19:57:32.865204] [DEBUG] [REMOTE ] LMT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-14T19:57:32.865505] [WARN ] [REMOTE ] LMT: No data returned for month 2025-05 [2025-10-14T19:57:32.865610] [FATAL] [REMOTE ] LMT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T19:57:32.865759] [FATAL] [MAIN ] LMT: Failed to fetch primary data. [2025-10-14T19:57:32.865842] [WARN ] [MAIN ] LMT: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T19:57:32.865935] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-14T19:57:32.866055] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-10-14T19:57:32.866108] [INFO ] [LOCAL ] LMT: Starting deletion of derivative data. [2025-10-14T19:57:32.866334] [DEBUG] [LOCAL ] LMT: Deleted derivative data file. [2025-10-14T19:57:32.866416] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LMT took 18.6s. Estimated remaining: 2h 36m 13s. Rate: 7.1 symbols/min [2025-10-14T19:57:33.031121] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:33.037148] [DEBUG] [LOCAL ] LND: Loaded 5002 existing records from primary storage. [2025-10-14T19:57:33.037317] [INFO ] [MAIN ] LND: Loaded 5002 existing records. [2025-10-14T19:57:33.214744] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:33.214980] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-14T19:57:33.215042] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-14T19:57:33.215242] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-14T19:57:33.215297] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-14T19:57:33.572271] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-14T19:57:33.606363] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:33.743573] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T19:57:33.825275] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-14T19:57:34.358067] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-14T19:57:34.999846] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:57:35.158039] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-14T19:57:35.961130] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-14T19:57:36.091290] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T19:57:36.368538] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T19:57:36.758078] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-14T19:57:37.464068] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T19:57:37.558055] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-14T19:57:37.706114] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T19:57:38.358060] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-14T19:57:39.158096] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-14T19:57:39.726959] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-14T19:57:39.958063] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-14T19:57:40.758069] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-14T19:57:40.765019] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T19:57:40.858047] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-14T19:57:40.995853] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T19:57:41.558078] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-14T19:57:42.170962] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T19:57:42.358075] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-14T19:57:42.849338] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T19:57:43.051416] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T19:57:43.158113] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-14T19:57:43.906883] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T19:57:43.913585] [INFO ] [REMOTE ] LLY: Full fetch complete (77245 records). [2025-10-14T19:57:43.913844] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-14T19:57:43.963301] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-14T19:57:44.330451] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-14T19:57:44.330597] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-14T19:57:44.332085] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-14T19:57:44.332155] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-14T19:57:44.334139] [DEBUG] [LOCAL ] LLY: Trimmed 77245 records to 53265 (keeping 200 days of data) [2025-10-14T19:57:44.705030] [DEBUG] [LOCAL ] LLY: Primary data saved (53265 records). [2025-10-14T19:57:44.705323] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-14T19:57:44.705430] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LLY took 43.1s. Estimated remaining: 2h 36m 7s. Rate: 7.1 symbols/min [2025-10-14T19:57:44.768098] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-14T19:57:44.893669] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:44.951492] [DEBUG] [LOCAL ] LNG: Loaded 51287 existing records from primary storage. [2025-10-14T19:57:44.951993] [INFO ] [MAIN ] LNG: Loaded 51287 existing records. [2025-10-14T19:57:45.138725] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:45.139084] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-14T19:57:45.139138] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-14T19:57:45.140318] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-14T19:57:45.140380] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-14T19:57:45.537823] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:45.558073] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-14T19:57:45.774354] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T19:57:46.358048] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-14T19:57:46.869583] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-14T19:57:47.158087] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-14T19:57:47.426483] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T19:57:47.564986] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T19:57:47.571024] [INFO ] [REMOTE ] LNC: Full fetch complete (74514 records). [2025-10-14T19:57:47.571176] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-14T19:57:47.877535] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T19:57:47.960067] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-14T19:57:48.002107] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-14T19:57:48.002192] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-14T19:57:48.003268] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-14T19:57:48.003452] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-14T19:57:48.005046] [DEBUG] [LOCAL ] LNC: Trimmed 74514 records to 51593 (keeping 200 days of data) [2025-10-14T19:57:48.317094] [DEBUG] [LOCAL ] LNC: Primary data saved (51593 records). [2025-10-14T19:57:48.317218] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-14T19:57:48.317302] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LNC took 30.6s. Estimated remaining: 2h 35m 55s. Rate: 7.1 symbols/min [2025-10-14T19:57:48.489242] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:48.489429] [DEBUG] [LOCAL ] LNN: No existing data file found in primary storage. [2025-10-14T19:57:48.489465] [WARN ] [MAIN ] LNN: No existing data found, performing full refresh instead. [2025-10-14T19:57:48.489570] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-14T19:57:48.489610] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-14T19:57:48.489678] [DEBUG] [LOCAL ] LNN: No primary data file found to delete. [2025-10-14T19:57:48.489729] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-14T19:57:48.764930] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-14T19:57:48.845780] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:49.558077] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-14T19:57:50.134505] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-14T19:57:50.141205] [INFO ] [REMOTE ] LMND: Full fetch complete (75470 records). [2025-10-14T19:57:50.141365] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-14T19:57:50.314253] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T19:57:50.372886] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-14T19:57:50.570374] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-14T19:57:50.570551] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-14T19:57:50.571800] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-14T19:57:50.571911] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-14T19:57:50.573635] [DEBUG] [LOCAL ] LMND: Trimmed 75470 records to 52049 (keeping 200 days of data) [2025-10-14T19:57:50.688859] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-14T19:57:50.924816] [DEBUG] [LOCAL ] LMND: Primary data saved (52049 records). [2025-10-14T19:57:50.924966] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-14T19:57:50.925051] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LMND took 46.7s. Estimated remaining: 2h 35m 41s. Rate: 7.1 symbols/min [2025-10-14T19:57:51.100527] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:57:51.138703] [DEBUG] [LOCAL ] LOAR: Loaded 42298 existing records from primary storage. [2025-10-14T19:57:51.138989] [INFO ] [MAIN ] LOAR: Loaded 42298 existing records. [2025-10-14T19:57:51.169943] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-14T19:57:51.336491] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:57:51.336803] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-14T19:57:51.336870] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-14T19:57:51.337780] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-14T19:57:51.337842] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-14T19:57:51.524751] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T19:57:51.892154] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:57:51.893610] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T19:57:51.958133] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-14T19:57:52.558303] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T19:57:52.758043] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-14T19:57:53.558119] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-14T19:57:54.147338] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-14T19:57:54.223204] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T19:57:54.358100] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-14T19:57:55.158070] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-14T19:57:55.866074] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T19:57:55.958049] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-14T19:57:56.299405] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-14T19:57:56.758107] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-14T19:57:57.524549] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T19:57:57.558023] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-14T19:57:57.779115] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T19:57:58.033370] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T19:57:58.358047] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-14T19:57:59.158113] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-14T19:57:59.573971] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T19:57:59.958066] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-14T19:58:00.588633] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T19:58:00.589768] [INFO ] [REMOTE ] LND: Full fetch complete (7992 records). [2025-10-14T19:58:00.589835] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-14T19:58:00.769609] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-14T19:58:00.970609] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-14T19:58:00.970720] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-14T19:58:00.970965] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-14T19:58:00.971003] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-14T19:58:00.971378] [DEBUG] [LOCAL ] LND: Trimmed 7992 records to 4953 (keeping 200 days of data) [2025-10-14T19:58:00.999751] [DEBUG] [LOCAL ] LND: Primary data saved (4953 records). [2025-10-14T19:58:00.999860] [INFO ] [MAIN ] LND: Full history saved. [2025-10-14T19:58:00.999939] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LND took 28.1s. Estimated remaining: 2h 35m 34s. Rate: 7.1 symbols/min [2025-10-14T19:58:01.173272] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:58:01.199110] [DEBUG] [LOCAL ] LOB: Loaded 26773 existing records from primary storage. [2025-10-14T19:58:01.199410] [INFO ] [MAIN ] LOB: Loaded 26773 existing records. [2025-10-14T19:58:01.380178] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:58:01.380515] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-14T19:58:01.380627] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-14T19:58:01.381191] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-14T19:58:01.381247] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-14T19:58:01.559384] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-14T19:58:01.845885] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:58:01.848850] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-14T19:58:01.881345] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T19:58:02.358087] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-14T19:58:03.111196] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:58:03.158045] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-14T19:58:03.448271] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T19:58:03.958071] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-14T19:58:04.673869] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T19:58:04.758036] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-14T19:58:04.772137] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T19:58:05.558062] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-14T19:58:06.358098] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-14T19:58:06.467498] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T19:58:06.531351] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T19:58:07.158115] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-14T19:58:07.475119] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T19:58:07.958108] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-14T19:58:08.619440] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T19:58:08.758052] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-14T19:58:08.949467] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T19:58:09.558062] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-14T19:58:10.293969] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T19:58:10.358025] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-14T19:58:10.662206] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T19:58:11.158106] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-14T19:58:11.182890] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T19:58:11.958071] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-14T19:58:12.758090] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-14T19:58:12.999985] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T19:58:13.027920] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T19:58:13.349134] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T19:58:13.350803] [INFO ] [REMOTE ] LNN: Full fetch complete (15624 records). [2025-10-14T19:58:13.350869] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-14T19:58:13.566055] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-14T19:58:13.721855] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-14T19:58:13.721939] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-14T19:58:13.722292] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-14T19:58:13.722333] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-14T19:58:13.722872] [DEBUG] [LOCAL ] LNN: Trimmed 15624 records to 11373 (keeping 200 days of data) [2025-10-14T19:58:13.792147] [DEBUG] [LOCAL ] LNN: Primary data saved (11373 records). [2025-10-14T19:58:13.792270] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-14T19:58:13.792338] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LNN took 25.5s. Estimated remaining: 2h 35m 30s. Rate: 7.1 symbols/min [2025-10-14T19:58:13.959800] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:58:13.964793] [DEBUG] [LOCAL ] LOCL: Loaded 3674 existing records from primary storage. [2025-10-14T19:58:13.964945] [INFO ] [MAIN ] LOCL: Loaded 3674 existing records. [2025-10-14T19:58:14.142050] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:58:14.142224] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-14T19:58:14.142276] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-14T19:58:14.142468] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-14T19:58:14.142524] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-14T19:58:14.369401] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-14T19:58:14.494063] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:58:15.158054] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-14T19:58:15.444449] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T19:58:15.517170] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-14T19:58:15.869474] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T19:58:15.958077] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-14T19:58:16.758075] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-14T19:58:17.558040] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-14T19:58:17.927018] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T19:58:18.019711] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T19:58:18.358080] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-14T19:58:19.162884] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T19:58:19.161632] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-14T19:58:19.958034] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-14T19:58:20.328972] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T19:58:20.414016] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T19:58:20.540219] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T19:58:20.758077] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-14T19:58:21.100719] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T19:58:21.558058] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-14T19:58:22.358108] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-14T19:58:22.956440] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T19:58:23.158099] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-14T19:58:23.604841] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T19:58:23.958113] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-14T19:58:24.240669] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-14T19:58:24.684189] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T19:58:24.758040] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-14T19:58:25.505609] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T19:58:25.558066] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-14T19:58:26.365276] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-14T19:58:26.367282] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T19:58:26.373176] [INFO ] [REMOTE ] LNG: Full fetch complete (74758 records). [2025-10-14T19:58:26.373273] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-14T19:58:26.778030] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-14T19:58:26.778106] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-14T19:58:26.779159] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-14T19:58:26.779219] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-14T19:58:26.780597] [DEBUG] [LOCAL ] LNG: Trimmed 74758 records to 51269 (keeping 200 days of data) [2025-10-14T19:58:27.100469] [DEBUG] [LOCAL ] LNG: Primary data saved (51269 records). [2025-10-14T19:58:27.100614] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-14T19:58:27.100727] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LNG took 42.4s. Estimated remaining: 2h 35m 25s. Rate: 7.1 symbols/min [2025-10-14T19:58:27.163976] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-14T19:58:27.271429] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:58:27.300793] [DEBUG] [LOCAL ] LOMA: Loaded 32558 existing records from primary storage. [2025-10-14T19:58:27.301054] [INFO ] [MAIN ] LOMA: Loaded 32558 existing records. [2025-10-14T19:58:27.478562] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:58:27.478901] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-14T19:58:27.478974] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-14T19:58:27.484606] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-14T19:58:27.484702] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-14T19:58:27.571722] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T19:58:27.658511] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-14T19:58:27.855939] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:58:27.958058] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-14T19:58:28.758160] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-14T19:58:29.338949] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T19:58:29.558069] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-14T19:58:30.164390] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T19:58:30.175410] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T19:58:30.358035] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-14T19:58:30.917624] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-14T19:58:31.158096] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-14T19:58:31.958047] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-14T19:58:32.285220] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T19:58:32.758107] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-14T19:58:33.211336] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T19:58:33.558059] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-14T19:58:33.615810] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T19:58:34.139422] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T19:58:34.358061] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-14T19:58:35.158049] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-14T19:58:35.651311] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T19:58:35.656474] [INFO ] [REMOTE ] LOAR: Full fetch complete (56088 records). [2025-10-14T19:58:35.656616] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-14T19:58:35.831669] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T19:58:35.861910] [INFO ] [REMOTE ] LOCL: Full fetch complete (4473 records). [2025-10-14T19:58:35.924362] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-14T19:58:35.980317] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-14T19:58:36.223070] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-14T19:58:36.231687] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-14T19:58:36.232746] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-14T19:58:36.232826] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-14T19:58:36.325278] [DEBUG] [LOCAL ] LOAR: Trimmed 56088 records to 42212 (keeping 200 days of data) [2025-10-14T19:58:36.531937] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-14T19:58:36.532342] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-14T19:58:36.534947] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-14T19:58:36.538132] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-14T19:58:36.539539] [DEBUG] [LOCAL ] LOCL: Trimmed 4473 records to 3701 (keeping 200 days of data) [2025-10-14T19:58:36.575339] [DEBUG] [LOCAL ] LOCL: Primary data saved (3701 records). [2025-10-14T19:58:36.575475] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-14T19:58:36.575561] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LOCL took 22.8s. Estimated remaining: 2h 35m 18s. Rate: 7.1 symbols/min [2025-10-14T19:58:36.765020] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-14T19:58:36.863271] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:58:36.888618] [DEBUG] [LOCAL ] LOAR: Primary data saved (42212 records). [2025-10-14T19:58:36.888856] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-14T19:58:36.888945] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LOAR took 46.0s. Estimated remaining: 2h 35m 2s. Rate: 7.1 symbols/min [2025-10-14T19:58:37.081998] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:58:37.103609] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-14T19:58:37.103981] [INFO ] [MAIN ] LOW: Loaded 52993 existing records. [2025-10-14T19:58:37.320142] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:58:37.323013] [DEBUG] [LOCAL ] LPG: Loaded 39569 existing records from primary storage. [2025-10-14T19:58:37.323188] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-14T19:58:37.323504] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-14T19:58:37.324002] [INFO ] [MAIN ] LPG: Loaded 39569 existing records. [2025-10-14T19:58:37.329549] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-14T19:58:37.364389] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-14T19:58:37.421197] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T19:58:37.559380] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-14T19:58:37.664186] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:58:37.664962] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-14T19:58:37.670552] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-14T19:58:37.687083] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-14T19:58:37.698116] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-14T19:58:37.788105] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T19:58:38.170343] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:58:38.360813] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-14T19:58:38.392727] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:58:38.907860] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T19:58:39.158093] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-14T19:58:39.958047] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-14T19:58:40.244528] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T19:58:40.245555] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T19:58:40.259171] [INFO ] [REMOTE ] LOB: Full fetch complete (38159 records). [2025-10-14T19:58:40.259249] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-14T19:58:40.624104] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-14T19:58:40.624185] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-14T19:58:40.624946] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-14T19:58:40.625006] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-14T19:58:40.625840] [DEBUG] [LOCAL ] LOB: Trimmed 38159 records to 26746 (keeping 200 days of data) [2025-10-14T19:58:40.764183] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-14T19:58:40.784334] [DEBUG] [LOCAL ] LOB: Primary data saved (26746 records). [2025-10-14T19:58:40.784405] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-14T19:58:40.784475] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LOB took 39.8s. Estimated remaining: 2h 34m 50s. Rate: 7.1 symbols/min [2025-10-14T19:58:40.950364] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:58:40.975007] [DEBUG] [LOCAL ] LPL: Loaded 27908 existing records from primary storage. [2025-10-14T19:58:40.975261] [INFO ] [MAIN ] LPL: Loaded 27908 existing records. [2025-10-14T19:58:41.161232] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:58:41.161545] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-14T19:58:41.161827] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-14T19:58:41.162384] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-14T19:58:41.162443] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-14T19:58:41.491790] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T19:58:41.563565] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-14T19:58:41.575730] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:58:41.750561] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T19:58:42.358091] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-14T19:58:43.158098] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-14T19:58:43.278366] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T19:58:43.920935] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T19:58:43.958028] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-14T19:58:44.077601] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T19:58:44.758090] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-14T19:58:45.402321] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T19:58:45.558057] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-14T19:58:46.014894] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T19:58:46.358078] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-14T19:58:46.664605] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T19:58:47.158053] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-14T19:58:47.958065] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-14T19:58:48.258038] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T19:58:48.365801] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T19:58:48.758077] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-14T19:58:49.503358] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T19:58:49.558029] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-14T19:58:49.756604] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T19:58:50.358104] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-14T19:58:51.103866] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T19:58:51.158032] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-14T19:58:51.958091] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-14T19:58:52.313617] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T19:58:52.657187] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T19:58:52.758050] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-14T19:58:53.011132] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T19:58:53.558131] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-14T19:58:54.306794] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T19:58:54.358087] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-14T19:58:55.128972] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T19:58:55.158033] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-14T19:58:55.267700] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T19:58:55.958108] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-14T19:58:56.758048] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-14T19:58:56.982494] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T19:58:57.089052] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T19:58:57.558097] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-14T19:58:58.358056] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-14T19:58:58.489800] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T19:58:59.158042] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-14T19:58:59.446079] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T19:58:59.577549] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-14T19:58:59.958185] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-14T19:59:00.244961] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T19:59:00.249546] [INFO ] [REMOTE ] LOMA: Full fetch complete (47991 records). [2025-10-14T19:59:00.249697] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-14T19:59:00.760397] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-14T19:59:00.784373] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-14T19:59:00.785780] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-14T19:59:00.787296] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-14T19:59:00.787511] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-14T19:59:00.789202] [DEBUG] [LOCAL ] LOMA: Trimmed 47991 records to 32605 (keeping 200 days of data) [2025-10-14T19:59:01.068578] [DEBUG] [LOCAL ] LOMA: Primary data saved (32605 records). [2025-10-14T19:59:01.068794] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-14T19:59:01.068916] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LOMA took 34.0s. Estimated remaining: 2h 34m 52s. Rate: 7.1 symbols/min [2025-10-14T19:59:01.322335] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:01.364782] [DEBUG] [LOCAL ] LPX: Loaded 40079 existing records from primary storage. [2025-10-14T19:59:01.365143] [INFO ] [MAIN ] LPX: Loaded 40079 existing records. [2025-10-14T19:59:01.562628] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-14T19:59:01.587164] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:01.588369] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-14T19:59:01.588443] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-14T19:59:01.589317] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-14T19:59:01.589384] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-14T19:59:01.978598] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:02.020551] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T19:59:02.057800] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-14T19:59:02.358061] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-14T19:59:03.131946] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T19:59:03.158060] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-14T19:59:03.370198] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T19:59:03.958159] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-14T19:59:04.758100] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-14T19:59:04.981078] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T19:59:05.188082] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T19:59:05.558062] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-14T19:59:06.358097] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-14T19:59:07.102259] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-14T19:59:07.158097] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-14T19:59:07.471459] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-14T19:59:07.790092] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T19:59:07.958129] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-14T19:59:08.758111] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-14T19:59:09.047381] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T19:59:09.477534] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T19:59:09.558044] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-14T19:59:10.053948] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T19:59:10.058271] [INFO ] [REMOTE ] LPG: Full fetch complete (59239 records). [2025-10-14T19:59:10.058361] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-14T19:59:10.363219] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-14T19:59:10.437925] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-14T19:59:10.438005] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-14T19:59:10.438959] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-14T19:59:10.439024] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-14T19:59:10.440211] [DEBUG] [LOCAL ] LPG: Trimmed 59239 records to 39624 (keeping 200 days of data) [2025-10-14T19:59:10.676450] [DEBUG] [LOCAL ] LPG: Primary data saved (39624 records). [2025-10-14T19:59:10.676577] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-14T19:59:10.676675] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LPG took 33.8s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-14T19:59:10.845821] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:10.882489] [DEBUG] [LOCAL ] LRN: Loaded 39598 existing records from primary storage. [2025-10-14T19:59:10.882801] [INFO ] [MAIN ] LRN: Loaded 39598 existing records. [2025-10-14T19:59:11.062016] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:11.062300] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-14T19:59:11.062375] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-14T19:59:11.063090] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-14T19:59:11.063147] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-14T19:59:11.162125] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-14T19:59:11.377793] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T19:59:11.460374] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:11.825509] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T19:59:11.831449] [INFO ] [REMOTE ] LOW: Full fetch complete (76683 records). [2025-10-14T19:59:11.831568] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-14T19:59:11.960762] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-14T19:59:12.195183] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T19:59:12.260099] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-14T19:59:12.260172] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-14T19:59:12.261202] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-14T19:59:12.261264] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-14T19:59:12.262938] [DEBUG] [LOCAL ] LOW: Trimmed 76683 records to 52994 (keeping 200 days of data) [2025-10-14T19:59:12.582124] [DEBUG] [LOCAL ] LOW: Primary data saved (52994 records). [2025-10-14T19:59:12.582256] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-14T19:59:12.583010] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LOW took 36.0s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-14T19:59:12.751532] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:12.758080] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-14T19:59:12.791005] [DEBUG] [LOCAL ] LSPD: Loaded 42619 existing records from primary storage. [2025-10-14T19:59:12.791284] [INFO ] [MAIN ] LSPD: Loaded 42619 existing records. [2025-10-14T19:59:12.971277] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:12.971598] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-14T19:59:12.971695] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-14T19:59:12.972742] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-14T19:59:12.972801] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-14T19:59:13.336293] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:13.557534] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T19:59:13.565014] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-14T19:59:14.301219] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T19:59:14.358040] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-14T19:59:15.065421] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T19:59:15.158035] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-14T19:59:15.960400] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-14T19:59:15.963183] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T19:59:16.762828] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-14T19:59:16.765365] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T19:59:17.244203] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T19:59:17.249014] [INFO ] [REMOTE ] LPL: Full fetch complete (36736 records). [2025-10-14T19:59:17.249139] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-14T19:59:17.570252] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-14T19:59:17.618864] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-14T19:59:17.618947] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-14T19:59:17.619693] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-14T19:59:17.619755] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-14T19:59:17.620549] [DEBUG] [LOCAL ] LPL: Trimmed 36736 records to 28131 (keeping 200 days of data) [2025-10-14T19:59:17.780077] [DEBUG] [LOCAL ] LPL: Primary data saved (28131 records). [2025-10-14T19:59:17.780231] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-14T19:59:17.780318] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LPL took 37.0s. Estimated remaining: 2h 34m 19s. Rate: 7.1 symbols/min [2025-10-14T19:59:17.957509] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:17.987900] [DEBUG] [LOCAL ] LTC: Loaded 30464 existing records from primary storage. [2025-10-14T19:59:17.988164] [INFO ] [MAIN ] LTC: Loaded 30464 existing records. [2025-10-14T19:59:18.198954] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:18.199433] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-14T19:59:18.199565] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-14T19:59:18.200494] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-14T19:59:18.200555] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-14T19:59:18.371798] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-14T19:59:18.467302] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T19:59:18.625049] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:18.645819] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T19:59:19.158084] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-14T19:59:19.928472] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T19:59:19.955701] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T19:59:19.961608] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-14T19:59:20.758131] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-14T19:59:21.479161] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T19:59:21.558032] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-14T19:59:21.664995] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T19:59:22.358082] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-14T19:59:23.090910] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T19:59:23.158053] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-14T19:59:23.799231] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T19:59:23.958076] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-14T19:59:24.763173] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-14T19:59:24.778005] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T19:59:25.482980] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T19:59:25.558078] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-14T19:59:26.352908] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T19:59:26.361205] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-14T19:59:27.072186] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T19:59:27.158067] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-14T19:59:27.914483] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T19:59:27.958035] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-14T19:59:28.766543] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-14T19:59:28.784218] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T19:59:29.118991] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T19:59:29.558058] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-14T19:59:30.193993] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T19:59:30.358080] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-14T19:59:31.111543] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T19:59:31.158032] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-14T19:59:31.844669] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T19:59:31.958078] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-14T19:59:32.472516] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T19:59:32.758063] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-14T19:59:33.558093] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-14T19:59:33.590901] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T19:59:34.249805] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T19:59:34.358032] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-14T19:59:35.067754] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T19:59:35.158267] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-14T19:59:35.753076] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T19:59:35.958060] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-14T19:59:36.390297] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T19:59:36.758064] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-14T19:59:37.503748] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T19:59:37.509370] [INFO ] [REMOTE ] LSPD: Full fetch complete (61900 records). [2025-10-14T19:59:37.509513] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-14T19:59:37.563225] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-14T19:59:37.908678] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-14T19:59:37.908857] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-14T19:59:37.910092] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-14T19:59:37.910188] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-14T19:59:37.911411] [DEBUG] [LOCAL ] LSPD: Trimmed 61900 records to 42628 (keeping 200 days of data) [2025-10-14T19:59:38.130766] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T19:59:38.184946] [DEBUG] [LOCAL ] LSPD: Primary data saved (42628 records). [2025-10-14T19:59:38.185081] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-14T19:59:38.185162] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LSPD took 25.6s. Estimated remaining: 2h 34m 21s. Rate: 7.1 symbols/min [2025-10-14T19:59:38.356302] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:38.358049] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-14T19:59:38.403696] [DEBUG] [LOCAL ] LTH: Loaded 51751 existing records from primary storage. [2025-10-14T19:59:38.404019] [INFO ] [MAIN ] LTH: Loaded 51751 existing records. [2025-10-14T19:59:38.584515] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:38.584772] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-14T19:59:38.584824] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-14T19:59:38.585605] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-14T19:59:38.585735] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-14T19:59:38.956945] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:39.000121] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T19:59:39.158070] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-14T19:59:39.787926] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T19:59:39.793488] [INFO ] [REMOTE ] LPX: Full fetch complete (59043 records). [2025-10-14T19:59:39.793689] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-14T19:59:39.958265] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-14T19:59:40.196307] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-14T19:59:40.196414] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-14T19:59:40.197420] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-14T19:59:40.197482] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-14T19:59:40.198805] [DEBUG] [LOCAL ] LPX: Trimmed 59043 records to 40227 (keeping 200 days of data) [2025-10-14T19:59:40.449673] [DEBUG] [LOCAL ] LPX: Primary data saved (40227 records). [2025-10-14T19:59:40.449853] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-14T19:59:40.449966] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LPX took 39.4s. Estimated remaining: 2h 34m 7s. Rate: 7.1 symbols/min [2025-10-14T19:59:40.622023] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:40.647206] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T19:59:40.687122] [DEBUG] [LOCAL ] LTM: Loaded 38494 existing records from primary storage. [2025-10-14T19:59:40.687402] [INFO ] [MAIN ] LTM: Loaded 38494 existing records. [2025-10-14T19:59:40.763254] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-14T19:59:40.867605] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:40.867859] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-14T19:59:40.867907] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-14T19:59:40.868531] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-14T19:59:40.868590] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-14T19:59:41.230857] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:41.248739] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T19:59:41.558050] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-14T19:59:42.358133] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-14T19:59:42.359111] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T19:59:42.803195] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T19:59:43.158135] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-14T19:59:43.924880] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T19:59:43.958041] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-14T19:59:44.316849] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T19:59:44.758118] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-14T19:59:45.287524] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T19:59:45.558074] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-14T19:59:46.177735] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T19:59:46.181760] [INFO ] [REMOTE ] LRN: Full fetch complete (58409 records). [2025-10-14T19:59:46.181853] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-14T19:59:46.363488] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-14T19:59:46.594505] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-14T19:59:46.594583] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-14T19:59:46.595681] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-14T19:59:46.595742] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-14T19:59:46.596820] [DEBUG] [LOCAL ] LRN: Trimmed 58409 records to 39539 (keeping 200 days of data) [2025-10-14T19:59:46.832123] [DEBUG] [LOCAL ] LRN: Primary data saved (39539 records). [2025-10-14T19:59:46.832264] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-14T19:59:46.832349] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LRN took 36.2s. Estimated remaining: 2h 33m 57s. Rate: 7.1 symbols/min [2025-10-14T19:59:47.003520] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T19:59:47.045216] [DEBUG] [LOCAL ] LU: Loaded 48999 existing records from primary storage. [2025-10-14T19:59:47.045536] [INFO ] [MAIN ] LU: Loaded 48999 existing records. [2025-10-14T19:59:47.165512] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-14T19:59:47.200300] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T19:59:47.259832] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T19:59:47.260552] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-14T19:59:47.260908] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-14T19:59:47.261687] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-14T19:59:47.261744] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-14T19:59:47.618130] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T19:59:47.958079] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-14T19:59:48.108037] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T19:59:48.406338] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T19:59:48.758075] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-14T19:59:49.124017] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T19:59:49.558117] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-14T19:59:50.258749] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T19:59:50.358104] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-14T19:59:50.878817] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T19:59:51.158097] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-14T19:59:51.765568] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T19:59:51.847765] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T19:59:51.958083] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-14T19:59:52.758040] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-14T19:59:53.167887] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T19:59:53.558052] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-14T19:59:54.358104] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-14T19:59:54.483225] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T19:59:54.739551] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T19:59:55.158107] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-14T19:59:55.778186] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T19:59:55.782055] [INFO ] [REMOTE ] LTC: Full fetch complete (43655 records). [2025-10-14T19:59:55.782137] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-14T19:59:55.960104] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-14T19:59:56.169351] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-14T19:59:56.169452] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-14T19:59:56.170280] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-14T19:59:56.170339] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-14T19:59:56.171412] [DEBUG] [LOCAL ] LTC: Trimmed 43655 records to 30571 (keeping 200 days of data) [2025-10-14T19:59:56.359859] [DEBUG] [LOCAL ] LTC: Primary data saved (30571 records). [2025-10-14T19:59:56.359983] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-14T19:59:56.360070] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LTC took 38.6s. Estimated remaining: 2h 33m 49s. Rate: 7.1 symbols/min [2025-10-14T19:59:56.758108] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-14T19:59:56.879967] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T19:59:57.015516] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T19:59:57.558072] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-14T19:59:58.259964] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T19:59:58.358033] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-14T19:59:59.164514] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-14T19:59:59.183619] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T19:59:59.963200] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-14T19:59:59.980005] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T20:00:00.505443] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T20:00:00.758076] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-14T20:00:01.558150] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-14T20:00:02.072087] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-14T20:00:02.350358] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T20:00:02.359340] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-14T20:00:03.158153] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-14T20:00:03.371080] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T20:00:03.789010] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T20:00:03.958133] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-14T20:00:04.346596] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T20:00:04.758136] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-14T20:00:05.558096] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-14T20:00:05.693305] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T20:00:06.358151] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-14T20:00:06.725286] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T20:00:07.004199] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T20:00:07.158046] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-14T20:00:07.958104] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-14T20:00:08.281154] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-14T20:00:08.287167] [INFO ] [REMOTE ] LTH: Full fetch complete (74640 records). [2025-10-14T20:00:08.287313] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-14T20:00:08.698557] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-14T20:00:08.698670] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-14T20:00:08.699770] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-14T20:00:08.699832] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-14T20:00:08.701264] [DEBUG] [LOCAL ] LTH: Trimmed 74640 records to 51750 (keeping 200 days of data) [2025-10-14T20:00:08.999333] [DEBUG] [LOCAL ] LTH: Primary data saved (51750 records). [2025-10-14T20:00:08.999460] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-14T20:00:08.999540] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LTH took 30.8s. Estimated remaining: 2h 33m 44s. Rate: 7.1 symbols/min [2025-10-14T20:00:09.609517] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T20:00:09.620228] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-14T20:00:10.520155] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (3.36 seconds). [2025-10-14T20:00:10.525855] [INFO ] [REMOTE ] LTM: Full fetch complete (49907 records). [2025-10-14T20:00:10.525983] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-14T20:00:10.911485] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-14T20:00:10.911602] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-14T20:00:10.912502] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-14T20:00:10.912698] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-14T20:00:10.913936] [DEBUG] [LOCAL ] LTM: Trimmed 49907 records to 38583 (keeping 200 days of data) [2025-10-14T20:00:11.137279] [DEBUG] [LOCAL ] LTM: Primary data saved (38583 records). [2025-10-14T20:00:11.137421] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-14T20:00:11.137497] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LTM took 30.7s. Estimated remaining: 2h 33m 30s. Rate: 7.1 symbols/min [2025-10-14T20:00:11.257109] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T20:00:11.267707] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-14T20:00:12.941150] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T20:00:12.952255] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-14T20:00:14.492816] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T20:00:14.503296] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-14T20:00:16.197894] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T20:00:16.210268] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-14T20:00:17.883700] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-14T20:00:17.889922] [INFO ] [REMOTE ] LU: Full fetch complete (70686 records). [2025-10-14T20:00:17.890132] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-14T20:00:18.362509] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-14T20:00:18.362625] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-14T20:00:18.364145] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-14T20:00:18.364216] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-14T20:00:18.366428] [DEBUG] [LOCAL ] LU: Trimmed 70686 records to 49028 (keeping 200 days of data) [2025-10-14T20:00:18.675578] [DEBUG] [LOCAL ] LU: Primary data saved (49028 records). [2025-10-14T20:00:18.675807] [INFO ] [MAIN ] LU: Full history saved. [2025-10-14T20:00:18.675921] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LU took 31.8s. Estimated remaining: 2h 33m 21s. Rate: 7.1 symbols/min [2025-10-14T20:00:19.308063] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:19.338950] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:19.353021] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:19.365808] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-14T20:00:19.366224] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-14T20:00:19.385715] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:19.382419] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-14T20:00:19.385975] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-14T20:00:19.386403] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-14T20:00:19.386546] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-14T20:00:19.555552] [DEBUG] [LOCAL ] LUCK: Loaded 24238 existing records from primary storage. [2025-10-14T20:00:19.596020] [INFO ] [MAIN ] LUCK: Loaded 24238 existing records. [2025-10-14T20:00:19.848671] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-14T20:00:19.912891] [INFO ] [MAIN ] LUMN: Loaded 53646 existing records. [2025-10-14T20:00:19.962319] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-14T20:00:20.017478] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:20.013212] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-14T20:00:20.097352] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-14T20:00:20.158398] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:20.207191] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-14T20:00:20.212713] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-14T20:00:20.258901] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-14T20:00:20.285034] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-14T20:00:20.422899] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:00:20.490146] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-14T20:00:20.458900] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:20.526287] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:20.537362] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-14T20:00:20.532977] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:00:20.537692] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-14T20:00:20.537579] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-14T20:00:20.538058] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:00:20.538191] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-14T20:00:20.538670] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-14T20:00:20.549181] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-14T20:00:20.554412] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-14T20:00:20.583331] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-14T20:00:20.583679] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-14T20:00:20.591440] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-14T20:00:20.578267] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-14T20:00:20.592356] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LUXE took 1.9s. Estimated remaining: 2h 33m 7s. Rate: 7.1 symbols/min [2025-10-14T20:00:20.597521] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-14T20:00:20.655614] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-14T20:00:21.290921] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:21.326998] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:21.362581] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-14T20:00:21.759098] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:21.770190] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-14T20:00:21.804532] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:21.805499] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-14T20:00:21.841944] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-14T20:00:21.842579] [INFO ] [MAIN ] LVS: Loaded 53570 existing records. [2025-10-14T20:00:22.066178] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:22.066531] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-14T20:00:22.066586] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-14T20:00:22.066858] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-14T20:00:22.066939] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-14T20:00:22.474218] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:22.474869] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-14T20:00:22.492409] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T20:00:22.497959] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-14T20:00:23.850014] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T20:00:23.853806] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-14T20:00:23.877593] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-14T20:00:23.881835] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-14T20:00:23.933615] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T20:00:23.942818] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-14T20:00:24.301843] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T20:00:24.314306] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-14T20:00:25.252852] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T20:00:25.260245] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-14T20:00:25.726587] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T20:00:25.738061] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-14T20:00:25.866429] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-14T20:00:25.878341] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-14T20:00:26.100311] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T20:00:26.110972] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-14T20:00:26.400302] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T20:00:26.406757] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-14T20:00:27.435807] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T20:00:27.447138] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-14T20:00:27.642345] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T20:00:27.649332] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-14T20:00:27.687240] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T20:00:27.697761] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-14T20:00:27.973395] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T20:00:27.983757] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-14T20:00:28.574693] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T20:00:28.581495] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-14T20:00:29.009845] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T20:00:29.022501] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-14T20:00:29.178844] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T20:00:29.558104] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-14T20:00:29.610137] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T20:00:29.978447] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T20:00:30.358078] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-14T20:00:30.685222] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T20:00:31.158063] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-14T20:00:31.324901] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T20:00:31.455588] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T20:00:31.958058] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-14T20:00:32.661471] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T20:00:32.758037] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-14T20:00:32.894621] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T20:00:33.558059] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-14T20:00:34.358088] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-14T20:00:34.463373] [DEBUG] [REMOTE ] LVS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-14T20:00:34.463872] [WARN ] [REMOTE ] LVS: No data returned for month 2025-05 [2025-10-14T20:00:34.463974] [FATAL] [REMOTE ] LVS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:00:34.464078] [FATAL] [MAIN ] LVS: Failed to fetch primary data. [2025-10-14T20:00:34.464143] [WARN ] [MAIN ] LVS: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:00:34.464218] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-14T20:00:34.464321] [DEBUG] [LOCAL ] LVS: No primary data file found to delete. [2025-10-14T20:00:34.464385] [INFO ] [LOCAL ] LVS: Starting deletion of derivative data. [2025-10-14T20:00:34.464862] [DEBUG] [LOCAL ] LVS: Deleted derivative data file. [2025-10-14T20:00:34.465171] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LVS took 13.8s. Estimated remaining: 2h 33m 3s. Rate: 7.1 symbols/min [2025-10-14T20:00:34.644145] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:34.659536] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T20:00:34.701451] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T20:00:34.719666] [DEBUG] [LOCAL ] LVWR: Loaded 18399 existing records from primary storage. [2025-10-14T20:00:34.719946] [INFO ] [MAIN ] LVWR: Loaded 18399 existing records. [2025-10-14T20:00:34.895691] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:34.895886] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-14T20:00:34.895972] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-14T20:00:34.896190] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-14T20:00:34.896232] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-14T20:00:35.163348] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-14T20:00:35.268242] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:35.958044] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-14T20:00:36.758079] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-14T20:00:36.996553] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T20:00:37.340749] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T20:00:37.558049] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-14T20:00:37.948897] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-14T20:00:37.949088] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-14T20:00:38.358054] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-14T20:00:39.158105] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-14T20:00:39.721413] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T20:00:39.958055] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-14T20:00:40.264813] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T20:00:40.758060] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-14T20:00:41.558040] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-14T20:00:41.881754] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T20:00:42.358038] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-14T20:00:42.611136] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T20:00:42.613535] [INFO ] [REMOTE ] LUCK: Full fetch complete (40072 records). [2025-10-14T20:00:42.613605] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-14T20:00:42.970278] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-14T20:00:42.971197] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T20:00:43.083879] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-14T20:00:43.083958] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-14T20:00:43.084778] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-14T20:00:43.084841] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-14T20:00:43.085722] [DEBUG] [LOCAL ] LUCK: Trimmed 40072 records to 24199 (keeping 200 days of data) [2025-10-14T20:00:43.171914] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-14T20:00:43.230075] [DEBUG] [LOCAL ] LUCK: Primary data saved (24199 records). [2025-10-14T20:00:43.230203] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-14T20:00:43.230282] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LUCK took 24.6s. Estimated remaining: 2h 32m 55s. Rate: 7.1 symbols/min [2025-10-14T20:00:43.395947] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:43.442518] [DEBUG] [LOCAL ] LW: Loaded 51248 existing records from primary storage. [2025-10-14T20:00:43.442905] [INFO ] [MAIN ] LW: Loaded 51248 existing records. [2025-10-14T20:00:43.615706] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:43.615949] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-14T20:00:43.615995] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-14T20:00:43.616308] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-14T20:00:43.616364] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-14T20:00:43.961074] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-14T20:00:43.990186] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:44.569450] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-14T20:00:44.758077] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-14T20:00:45.334515] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-14T20:00:45.558076] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-14T20:00:46.358101] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-14T20:00:46.587166] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T20:00:46.622044] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T20:00:47.158143] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-14T20:00:47.958048] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-14T20:00:48.365548] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T20:00:48.758086] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-14T20:00:48.819068] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T20:00:49.558096] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-14T20:00:49.722479] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T20:00:50.358069] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-14T20:00:50.858706] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-14T20:00:50.864803] [INFO ] [REMOTE ] LUMN: Full fetch complete (77777 records). [2025-10-14T20:00:50.864910] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-14T20:00:51.162126] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-14T20:00:51.264682] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-14T20:00:51.264814] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-14T20:00:51.265927] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-14T20:00:51.266090] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-14T20:00:51.267550] [DEBUG] [LOCAL ] LUMN: Trimmed 77777 records to 53646 (keeping 200 days of data) [2025-10-14T20:00:51.380253] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T20:00:51.606158] [DEBUG] [LOCAL ] LUMN: Primary data saved (53646 records). [2025-10-14T20:00:51.606290] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-14T20:00:51.606365] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LUMN took 32.9s. Estimated remaining: 2h 32m 47s. Rate: 7.1 symbols/min [2025-10-14T20:00:51.775379] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:51.793271] [DEBUG] [LOCAL ] LXFR: Loaded 16750 existing records from primary storage. [2025-10-14T20:00:51.793496] [INFO ] [MAIN ] LXFR: Loaded 16750 existing records. [2025-10-14T20:00:51.959374] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-14T20:00:51.975057] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:51.975718] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-14T20:00:51.976192] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-14T20:00:51.977572] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-14T20:00:51.977748] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-14T20:00:52.132917] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T20:00:52.133909] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T20:00:52.404941] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:52.758120] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-14T20:00:53.558092] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-14T20:00:53.609449] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T20:00:53.846932] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T20:00:54.358092] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-14T20:00:55.158082] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-14T20:00:55.482604] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T20:00:55.958046] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-14T20:00:56.183360] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T20:00:56.208975] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T20:00:56.413367] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T20:00:56.419630] [INFO ] [REMOTE ] LUV: Full fetch complete (77860 records). [2025-10-14T20:00:56.419789] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-14T20:00:56.763187] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-14T20:00:56.813764] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-14T20:00:56.813870] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-14T20:00:56.815390] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-14T20:00:56.815472] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-14T20:00:56.817327] [DEBUG] [LOCAL ] LUV: Trimmed 77860 records to 53689 (keeping 200 days of data) [2025-10-14T20:00:57.145796] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-14T20:00:57.145925] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-14T20:00:57.146004] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUV took 38.5s. Estimated remaining: 2h 32m 36s. Rate: 7.1 symbols/min [2025-10-14T20:00:57.314180] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:57.360453] [DEBUG] [LOCAL ] LXP: Loaded 50766 existing records from primary storage. [2025-10-14T20:00:57.360956] [INFO ] [MAIN ] LXP: Loaded 50766 existing records. [2025-10-14T20:00:57.539368] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:57.539590] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-14T20:00:57.539692] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-14T20:00:57.540446] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-14T20:00:57.540508] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-14T20:00:57.563261] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-14T20:00:57.807976] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T20:00:57.832304] [INFO ] [REMOTE ] LVWR: Full fetch complete (20528 records). [2025-10-14T20:00:57.832479] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-14T20:00:58.050482] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:58.304027] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-14T20:00:58.304102] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-14T20:00:58.304505] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-14T20:00:58.304544] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-14T20:00:58.305156] [DEBUG] [LOCAL ] LVWR: Trimmed 20528 records to 18450 (keeping 200 days of data) [2025-10-14T20:00:58.377739] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-14T20:00:58.415676] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T20:00:58.426139] [DEBUG] [LOCAL ] LVWR: Primary data saved (18450 records). [2025-10-14T20:00:58.426235] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-14T20:00:58.426304] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LVWR took 24.0s. Estimated remaining: 2h 32m 21s. Rate: 7.1 symbols/min [2025-10-14T20:00:58.595171] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:00:58.626981] [DEBUG] [LOCAL ] LXU: Loaded 31881 existing records from primary storage. [2025-10-14T20:00:58.627260] [INFO ] [MAIN ] LXU: Loaded 31881 existing records. [2025-10-14T20:00:58.807300] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:00:58.807554] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-14T20:00:58.807615] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-14T20:00:58.808107] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-14T20:00:58.808168] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-14T20:00:59.162256] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-14T20:00:59.166130] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:00:59.958067] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-14T20:01:00.071295] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T20:01:00.133544] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T20:01:00.758078] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-14T20:01:01.558055] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-14T20:01:01.684586] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T20:01:01.742093] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T20:01:02.358059] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-14T20:01:02.685326] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T20:01:03.158054] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-14T20:01:03.342562] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T20:01:03.958099] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-14T20:01:04.641596] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T20:01:04.758108] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-14T20:01:04.976792] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T20:01:05.558091] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-14T20:01:06.358030] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-14T20:01:06.482732] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T20:01:07.061831] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T20:01:07.158109] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-14T20:01:07.338975] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T20:01:07.958090] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-14T20:01:08.507911] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T20:01:08.758104] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-14T20:01:09.335633] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T20:01:09.558076] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-14T20:01:09.787330] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T20:01:10.358053] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-14T20:01:11.162544] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-14T20:01:11.169994] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T20:01:11.437249] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T20:01:11.958069] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-14T20:01:12.273769] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T20:01:12.758084] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-14T20:01:13.558041] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-14T20:01:13.694119] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T20:01:13.746625] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T20:01:14.358106] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-14T20:01:15.158080] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-14T20:01:15.220527] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T20:01:15.255579] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T20:01:15.958071] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-14T20:01:16.758061] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-14T20:01:16.844615] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T20:01:17.558070] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-14T20:01:17.728093] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T20:01:17.778018] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T20:01:18.358057] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-14T20:01:19.158702] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-14T20:01:19.161553] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T20:01:19.310898] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T20:01:19.312922] [INFO ] [REMOTE ] LXFR: Full fetch complete (24779 records). [2025-10-14T20:01:19.313011] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-14T20:01:19.686038] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-14T20:01:19.686116] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-14T20:01:19.686676] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-14T20:01:19.686739] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-14T20:01:19.687468] [DEBUG] [LOCAL ] LXFR: Trimmed 24779 records to 16744 (keeping 200 days of data) [2025-10-14T20:01:19.786694] [DEBUG] [LOCAL ] LXFR: Primary data saved (16744 records). [2025-10-14T20:01:19.786833] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-14T20:01:19.786910] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LXFR took 28.2s. Estimated remaining: 2h 32m 24s. Rate: 7.1 symbols/min [2025-10-14T20:01:19.961607] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:01:19.961708] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-14T20:01:20.012197] [DEBUG] [LOCAL ] LYB: Loaded 53612 existing records from primary storage. [2025-10-14T20:01:20.012577] [INFO ] [MAIN ] LYB: Loaded 53612 existing records. [2025-10-14T20:01:20.198691] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:01:20.198942] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-14T20:01:20.198997] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-14T20:01:20.199990] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-14T20:01:20.200051] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-14T20:01:20.567224] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:01:20.758053] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-14T20:01:20.921025] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T20:01:20.927262] [INFO ] [REMOTE ] LW: Full fetch complete (74796 records). [2025-10-14T20:01:20.927402] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-14T20:01:21.367015] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-14T20:01:21.367119] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-14T20:01:21.368376] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-14T20:01:21.368471] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-14T20:01:21.370270] [DEBUG] [LOCAL ] LW: Trimmed 74796 records to 51232 (keeping 200 days of data) [2025-10-14T20:01:21.489436] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T20:01:21.585615] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-14T20:01:21.730424] [DEBUG] [LOCAL ] LW: Primary data saved (51232 records). [2025-10-14T20:01:21.730574] [INFO ] [MAIN ] LW: Full history saved. [2025-10-14T20:01:21.730680] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LW took 38.5s. Estimated remaining: 2h 32m 10s. Rate: 7.1 symbols/min [2025-10-14T20:01:21.928018] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:01:21.980070] [DEBUG] [LOCAL ] LYG: Loaded 52750 existing records from primary storage. [2025-10-14T20:01:21.980475] [INFO ] [MAIN ] LYG: Loaded 52750 existing records. [2025-10-14T20:01:22.168941] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:01:22.169209] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-14T20:01:22.169270] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-14T20:01:22.170536] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-14T20:01:22.170737] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-14T20:01:22.347483] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T20:01:22.382232] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-14T20:01:22.620261] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:01:23.158070] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-14T20:01:23.354865] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T20:01:23.958062] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-14T20:01:24.373361] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T20:01:24.485398] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T20:01:24.758085] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-14T20:01:25.251260] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T20:01:25.558076] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-14T20:01:26.345810] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T20:01:26.358032] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-14T20:01:26.667709] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T20:01:27.158088] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-14T20:01:27.958309] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-14T20:01:27.959410] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T20:01:27.967400] [INFO ] [REMOTE ] LXP: Full fetch complete (72846 records). [2025-10-14T20:01:27.967733] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-14T20:01:28.364858] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-14T20:01:28.364952] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-14T20:01:28.366050] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-14T20:01:28.366115] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-14T20:01:28.367568] [DEBUG] [LOCAL ] LXP: Trimmed 72846 records to 50740 (keeping 200 days of data) [2025-10-14T20:01:28.681874] [DEBUG] [LOCAL ] LXP: Primary data saved (50740 records). [2025-10-14T20:01:28.682004] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-14T20:01:28.682096] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LXP took 31.5s. Estimated remaining: 2h 32m 0s. Rate: 7.1 symbols/min [2025-10-14T20:01:28.759094] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-14T20:01:28.859799] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:01:28.887973] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T20:01:28.946511] [DEBUG] [LOCAL ] LYV: Loaded 51146 existing records from primary storage. [2025-10-14T20:01:28.947055] [INFO ] [MAIN ] LYV: Loaded 51146 existing records. [2025-10-14T20:01:29.126769] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:01:29.127041] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-14T20:01:29.127089] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-14T20:01:29.128194] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-14T20:01:29.128256] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-14T20:01:29.510711] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:01:29.558052] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-14T20:01:29.821717] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T20:01:30.102857] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T20:01:30.358061] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-14T20:01:31.019754] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T20:01:31.158064] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-14T20:01:31.958047] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-14T20:01:32.157889] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T20:01:32.758057] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-14T20:01:32.798152] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T20:01:33.558099] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T20:01:33.558208] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-14T20:01:33.593919] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T20:01:34.358122] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-14T20:01:35.158129] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-14T20:01:35.321101] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:01:35.536846] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T20:01:35.958080] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-14T20:01:36.758112] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-14T20:01:36.997765] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T20:01:37.196000] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T20:01:37.199607] [INFO ] [REMOTE ] LXU: Full fetch complete (45222 records). [2025-10-14T20:01:37.199725] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-14T20:01:37.564771] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-14T20:01:37.582680] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-14T20:01:37.582780] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-14T20:01:37.583597] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-14T20:01:37.583802] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-14T20:01:37.584883] [DEBUG] [LOCAL ] LXU: Trimmed 45222 records to 31836 (keeping 200 days of data) [2025-10-14T20:01:37.761024] [DEBUG] [LOCAL ] LXU: Primary data saved (31836 records). [2025-10-14T20:01:37.761155] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-14T20:01:37.761233] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LXU took 39.3s. Estimated remaining: 2h 31m 52s. Rate: 7.1 symbols/min [2025-10-14T20:01:37.937049] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:01:37.969009] [DEBUG] [LOCAL ] LZB: Loaded 35162 existing records from primary storage. [2025-10-14T20:01:37.969279] [INFO ] [MAIN ] LZB: Loaded 35162 existing records. [2025-10-14T20:01:38.158528] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:01:38.158801] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-14T20:01:38.158861] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-14T20:01:38.159700] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-14T20:01:38.159759] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-14T20:01:38.365599] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-14T20:01:38.564683] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T20:01:38.585119] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:01:39.158100] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-14T20:01:39.459191] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T20:01:39.958164] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-14T20:01:40.341194] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T20:01:40.394093] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T20:01:40.758144] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-14T20:01:41.558044] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-14T20:01:41.919291] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T20:01:42.366495] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-14T20:01:42.391851] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T20:01:42.833762] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T20:01:43.158105] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-14T20:01:43.958085] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-14T20:01:44.306666] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T20:01:44.758127] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-14T20:01:44.945203] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T20:01:45.324038] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T20:01:45.558069] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-14T20:01:46.358066] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-14T20:01:46.567048] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T20:01:47.158102] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-14T20:01:47.478668] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T20:01:47.862246] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:01:47.958119] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-14T20:01:48.758069] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-14T20:01:48.975403] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T20:01:49.558057] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-14T20:01:49.681609] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T20:01:50.107597] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T20:01:50.358081] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-14T20:01:51.158069] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-14T20:01:51.528513] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T20:01:51.574716] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T20:01:51.958110] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-14T20:01:52.758114] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-14T20:01:52.841445] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T20:01:53.558057] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-14T20:01:53.889325] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-14T20:01:54.358776] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-14T20:01:54.363208] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T20:01:55.158117] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-14T20:01:55.513495] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T20:01:55.935727] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T20:01:55.958041] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-14T20:01:56.758078] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-14T20:01:57.015352] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T20:01:57.350523] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T20:01:57.558054] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-14T20:01:58.226405] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T20:01:58.358053] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-14T20:01:59.061844] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T20:01:59.158069] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-14T20:01:59.958154] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-14T20:02:00.256513] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T20:02:00.266366] [INFO ] [REMOTE ] LYG: Full fetch complete (76226 records). [2025-10-14T20:02:00.266589] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-14T20:02:00.678528] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T20:02:00.724535] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-14T20:02:00.725106] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-14T20:02:00.726496] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-14T20:02:00.726578] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-14T20:02:00.728929] [DEBUG] [LOCAL ] LYG: Trimmed 76226 records to 52726 (keeping 200 days of data) [2025-10-14T20:02:00.776747] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-14T20:02:01.028784] [DEBUG] [LOCAL ] LYG: Primary data saved (52726 records). [2025-10-14T20:02:01.028913] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-14T20:02:01.028989] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LYG took 39.3s. Estimated remaining: 2h 31m 56s. Rate: 7.1 symbols/min [2025-10-14T20:02:01.195363] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:01.209343] [DEBUG] [LOCAL ] LZM: Loaded 14519 existing records from primary storage. [2025-10-14T20:02:01.209587] [INFO ] [MAIN ] LZM: Loaded 14519 existing records. [2025-10-14T20:02:01.392489] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:01.392909] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-14T20:02:01.392977] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-14T20:02:01.393394] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-14T20:02:01.393450] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-14T20:02:01.569275] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-14T20:02:01.794275] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:01.810618] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T20:02:01.817066] [INFO ] [REMOTE ] LYB: Full fetch complete (77619 records). [2025-10-14T20:02:01.817270] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-14T20:02:02.102210] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-14T20:02:02.269036] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-14T20:02:02.269116] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-14T20:02:02.270199] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-14T20:02:02.270315] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-14T20:02:02.271889] [DEBUG] [LOCAL ] LYB: Trimmed 77619 records to 53613 (keeping 200 days of data) [2025-10-14T20:02:02.363603] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-14T20:02:02.612145] [DEBUG] [LOCAL ] LYB: Primary data saved (53613 records). [2025-10-14T20:02:02.612329] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-14T20:02:02.612426] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LYB took 42.8s. Estimated remaining: 2h 31m 42s. Rate: 7.1 symbols/min [2025-10-14T20:02:02.784366] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:02.834284] [DEBUG] [LOCAL ] M: Loaded 53546 existing records from primary storage. [2025-10-14T20:02:02.834584] [INFO ] [MAIN ] M: Loaded 53546 existing records. [2025-10-14T20:02:03.039199] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:03.049244] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-14T20:02:03.049336] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-14T20:02:03.050260] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T20:02:03.053633] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-14T20:02:03.054161] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-14T20:02:03.091490] [INFO ] [REMOTE ] LZB: Full fetch complete (50732 records). [2025-10-14T20:02:03.097877] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-14T20:02:03.140688] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T20:02:03.180133] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-14T20:02:03.749956] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:03.834122] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-14T20:02:03.834204] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-14T20:02:03.835136] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-14T20:02:03.835198] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-14T20:02:03.836286] [DEBUG] [LOCAL ] LZB: Trimmed 50732 records to 35166 (keeping 200 days of data) [2025-10-14T20:02:03.948976] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T20:02:03.961175] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-14T20:02:04.086877] [DEBUG] [LOCAL ] LZB: Primary data saved (35166 records). [2025-10-14T20:02:04.087034] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-14T20:02:04.087117] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LZB took 26.3s. Estimated remaining: 2h 31m 28s. Rate: 7.1 symbols/min [2025-10-14T20:02:04.251669] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:04.299485] [DEBUG] [LOCAL ] MA: Loaded 52495 existing records from primary storage. [2025-10-14T20:02:04.299827] [INFO ] [MAIN ] MA: Loaded 52495 existing records. [2025-10-14T20:02:04.474552] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:04.474750] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-14T20:02:04.474800] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-14T20:02:04.475836] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-14T20:02:04.475893] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-14T20:02:04.775490] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T20:02:04.759257] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-14T20:02:04.840106] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:05.558077] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-14T20:02:06.358100] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-14T20:02:06.495335] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T20:02:06.538247] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T20:02:07.158050] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-14T20:02:07.958108] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-14T20:02:08.138784] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T20:02:08.304149] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-14T20:02:08.758086] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-14T20:02:08.781832] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T20:02:08.788566] [INFO ] [REMOTE ] LYV: Full fetch complete (74022 records). [2025-10-14T20:02:08.788797] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-14T20:02:09.240035] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-14T20:02:09.240207] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-14T20:02:09.241343] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-14T20:02:09.241406] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-14T20:02:09.242930] [DEBUG] [LOCAL ] LYV: Trimmed 74022 records to 51134 (keeping 200 days of data) [2025-10-14T20:02:09.544285] [DEBUG] [LOCAL ] LYV: Primary data saved (51134 records). [2025-10-14T20:02:09.544419] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-14T20:02:09.544496] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LYV took 40.9s. Estimated remaining: 2h 31m 17s. Rate: 7.1 symbols/min [2025-10-14T20:02:09.565466] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-14T20:02:09.727231] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:09.767890] [DEBUG] [LOCAL ] MAA: Loaded 42748 existing records from primary storage. [2025-10-14T20:02:09.768216] [INFO ] [MAIN ] MAA: Loaded 42748 existing records. [2025-10-14T20:02:09.949480] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:09.949762] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-14T20:02:09.949861] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-14T20:02:09.950764] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-14T20:02:09.950825] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-14T20:02:10.318147] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:10.358049] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-14T20:02:10.501436] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T20:02:10.675352] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-14T20:02:11.158066] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-14T20:02:11.726114] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T20:02:11.958073] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-14T20:02:12.557947] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T20:02:12.693590] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T20:02:12.758044] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-14T20:02:13.541314] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T20:02:13.558019] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-14T20:02:14.197540] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-14T20:02:14.358056] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-14T20:02:15.158066] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-14T20:02:15.958094] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-14T20:02:15.992516] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T20:02:16.758068] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-14T20:02:17.114617] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T20:02:17.558071] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-14T20:02:17.832769] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T20:02:18.213225] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T20:02:18.358058] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-14T20:02:18.503558] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T20:02:19.158093] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-14T20:02:19.958078] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-14T20:02:20.312851] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-14T20:02:20.758087] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-14T20:02:20.810030] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T20:02:20.812873] [INFO ] [REMOTE ] LZM: Full fetch complete (19277 records). [2025-10-14T20:02:20.812941] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-14T20:02:21.216396] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T20:02:21.261891] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-14T20:02:21.261978] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-14T20:02:21.262448] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-14T20:02:21.262490] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-14T20:02:21.263115] [DEBUG] [LOCAL ] LZM: Trimmed 19277 records to 14548 (keeping 200 days of data) [2025-10-14T20:02:21.340311] [DEBUG] [LOCAL ] LZM: Primary data saved (14548 records). [2025-10-14T20:02:21.340449] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-14T20:02:21.340527] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. LZM took 20.3s. Estimated remaining: 2h 31m 11s. Rate: 7.1 symbols/min [2025-10-14T20:02:21.509026] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:21.552404] [DEBUG] [LOCAL ] MAC: Loaded 49667 existing records from primary storage. [2025-10-14T20:02:21.552710] [INFO ] [MAIN ] MAC: Loaded 49667 existing records. [2025-10-14T20:02:21.563784] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-14T20:02:21.738809] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:21.739027] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-14T20:02:21.739074] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-14T20:02:21.740042] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-14T20:02:21.740102] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-14T20:02:22.096998] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:22.358089] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-14T20:02:22.638546] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T20:02:23.158103] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-14T20:02:23.728598] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T20:02:23.958129] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-14T20:02:24.290829] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T20:02:24.463881] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T20:02:24.758075] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-14T20:02:25.558093] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-14T20:02:25.810067] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T20:02:25.920104] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T20:02:26.358071] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-14T20:02:27.158069] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-14T20:02:27.686365] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-14T20:02:27.763329] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T20:02:27.958076] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-14T20:02:28.758090] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-14T20:02:28.788286] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T20:02:29.558074] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-14T20:02:30.139021] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-14T20:02:30.358060] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-14T20:02:30.634059] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T20:02:30.877782] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T20:02:31.158079] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-14T20:02:31.958045] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-14T20:02:32.384318] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T20:02:32.758106] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-14T20:02:33.105325] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T20:02:33.179212] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T20:02:33.558075] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-14T20:02:34.358051] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-14T20:02:34.432297] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T20:02:34.937721] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T20:02:35.158093] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-14T20:02:35.925511] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T20:02:35.958036] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-14T20:02:36.758060] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-14T20:02:37.009287] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T20:02:37.558078] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-14T20:02:38.115921] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-14T20:02:38.358087] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-14T20:02:38.449851] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T20:02:38.895557] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T20:02:39.158098] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-14T20:02:39.958095] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-14T20:02:40.230916] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T20:02:40.330430] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T20:02:40.758128] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-14T20:02:41.558045] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-14T20:02:41.592691] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T20:02:42.263404] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T20:02:42.268320] [INFO ] [REMOTE ] MAA: Full fetch complete (61423 records). [2025-10-14T20:02:42.268436] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-14T20:02:42.367887] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-14T20:02:42.654887] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-14T20:02:42.654962] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-14T20:02:42.656096] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-14T20:02:42.656157] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-14T20:02:42.657460] [DEBUG] [LOCAL ] MAA: Trimmed 61423 records to 42817 (keeping 200 days of data) [2025-10-14T20:02:42.921161] [DEBUG] [LOCAL ] MAA: Primary data saved (42817 records). [2025-10-14T20:02:42.921288] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-14T20:02:42.921378] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. MAA took 33.4s. Estimated remaining: 2h 31m 14s. Rate: 7.1 symbols/min [2025-10-14T20:02:43.093567] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:43.129416] [DEBUG] [LOCAL ] MAGN: Loaded 35865 existing records from primary storage. [2025-10-14T20:02:43.129724] [INFO ] [MAIN ] MAGN: Loaded 35865 existing records. [2025-10-14T20:02:43.160478] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-14T20:02:43.310981] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:43.311339] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-14T20:02:43.311418] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-14T20:02:43.311777] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-14T20:02:43.311869] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-14T20:02:43.690450] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-14T20:02:43.713206] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:43.958048] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-14T20:02:44.013878] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T20:02:44.019922] [INFO ] [REMOTE ] M: Full fetch complete (77659 records). [2025-10-14T20:02:44.020042] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-14T20:02:44.409611] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-14T20:02:44.409830] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-14T20:02:44.411021] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-14T20:02:44.411099] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-14T20:02:44.413538] [DEBUG] [LOCAL ] M: Trimmed 77659 records to 53546 (keeping 200 days of data) [2025-10-14T20:02:44.542369] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T20:02:44.762540] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-14T20:02:44.788105] [DEBUG] [LOCAL ] M: Primary data saved (53546 records). [2025-10-14T20:02:44.788219] [INFO ] [MAIN ] M: Full history saved. [2025-10-14T20:02:44.788295] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. M took 42.2s. Estimated remaining: 2h 30m 60s. Rate: 7.1 symbols/min [2025-10-14T20:02:44.952097] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:44.990487] [DEBUG] [LOCAL ] MAIN: Loaded 41692 existing records from primary storage. [2025-10-14T20:02:44.990835] [INFO ] [MAIN ] MAIN: Loaded 41692 existing records. [2025-10-14T20:02:45.162694] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:45.162921] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-14T20:02:45.162966] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-14T20:02:45.163290] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-14T20:02:45.163346] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-14T20:02:45.515175] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:45.558037] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-14T20:02:45.981284] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T20:02:46.358037] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-14T20:02:46.458676] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T20:02:46.847133] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T20:02:47.158064] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-14T20:02:47.958124] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-14T20:02:48.293239] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-14T20:02:48.299330] [INFO ] [REMOTE ] MA: Full fetch complete (76376 records). [2025-10-14T20:02:48.299463] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-14T20:02:48.761322] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-14T20:02:48.835433] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-14T20:02:48.835620] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-14T20:02:48.837640] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-14T20:02:48.837782] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-14T20:02:48.851442] [DEBUG] [LOCAL ] MA: Trimmed 76376 records to 52487 (keeping 200 days of data) [2025-10-14T20:02:48.879076] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T20:02:49.363110] [DEBUG] [LOCAL ] MA: Primary data saved (52487 records). [2025-10-14T20:02:49.363269] [INFO ] [MAIN ] MA: Full history saved. [2025-10-14T20:02:49.363355] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. MA took 45.3s. Estimated remaining: 2h 30m 48s. Rate: 7.1 symbols/min [2025-10-14T20:02:49.541737] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:49.565025] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-14T20:02:49.613231] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T20:02:49.614195] [DEBUG] [LOCAL ] MAN: Loaded 43860 existing records from primary storage. [2025-10-14T20:02:49.625710] [INFO ] [MAIN ] MAN: Loaded 43860 existing records. [2025-10-14T20:02:49.827336] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:49.827580] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-14T20:02:49.827678] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-14T20:02:49.828005] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-14T20:02:49.828045] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-14T20:02:50.189360] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:50.358067] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-14T20:02:50.414154] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T20:02:50.982294] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T20:02:51.158109] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-14T20:02:51.886508] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T20:02:51.958124] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-14T20:02:52.758070] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-14T20:02:52.835547] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-14T20:02:52.841254] [INFO ] [REMOTE ] MAC: Full fetch complete (71539 records). [2025-10-14T20:02:52.841361] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-14T20:02:53.239016] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-14T20:02:53.239100] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-14T20:02:53.240163] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-14T20:02:53.240225] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-14T20:02:53.241581] [DEBUG] [LOCAL ] MAC: Trimmed 71539 records to 49712 (keeping 200 days of data) [2025-10-14T20:02:53.509224] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T20:02:53.574490] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-14T20:02:53.611500] [DEBUG] [LOCAL ] MAC: Primary data saved (49712 records). [2025-10-14T20:02:53.611637] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-14T20:02:53.611758] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. MAC took 32.3s. Estimated remaining: 2h 30m 36s. Rate: 7.1 symbols/min [2025-10-14T20:02:53.782143] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:02:53.807337] [DEBUG] [LOCAL ] MANU: Loaded 26909 existing records from primary storage. [2025-10-14T20:02:53.807599] [INFO ] [MAIN ] MANU: Loaded 26909 existing records. [2025-10-14T20:02:53.985586] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:02:53.992636] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-14T20:02:54.003153] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-14T20:02:54.004580] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T20:02:54.004671] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-14T20:02:54.004859] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-14T20:02:54.364790] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:02:54.361109] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-14T20:02:55.158090] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-14T20:02:55.257968] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T20:02:55.334793] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T20:02:55.958101] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-14T20:02:56.265206] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:02:56.758070] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-14T20:02:57.312850] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T20:02:57.558094] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-14T20:02:58.247460] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T20:02:58.358111] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-14T20:02:59.158047] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-14T20:02:59.339079] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T20:02:59.494910] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T20:02:59.958133] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-14T20:03:00.146499] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T20:03:00.758062] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-14T20:03:01.245757] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T20:03:01.558105] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-14T20:03:02.023147] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T20:03:02.358064] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-14T20:03:03.158092] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-14T20:03:03.630431] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T20:03:03.958041] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-14T20:03:04.199913] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T20:03:04.246082] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T20:03:04.758120] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-14T20:03:05.374864] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T20:03:05.558085] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-14T20:03:06.073978] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T20:03:06.358077] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-14T20:03:06.517860] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T20:03:07.158078] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-14T20:03:07.857873] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T20:03:07.958111] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-14T20:03:08.475842] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T20:03:08.758081] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-14T20:03:09.324838] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T20:03:09.558078] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-14T20:03:10.358050] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-14T20:03:10.568057] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T20:03:11.158090] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-14T20:03:11.231153] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T20:03:11.447278] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T20:03:11.958120] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-14T20:03:12.614936] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T20:03:12.758075] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-14T20:03:13.527120] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T20:03:13.558038] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-14T20:03:14.358103] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-14T20:03:14.544068] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T20:03:14.812942] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T20:03:15.158108] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-14T20:03:15.770918] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T20:03:15.958069] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-14T20:03:16.496438] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T20:03:16.758096] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-14T20:03:17.318629] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T20:03:17.558073] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-14T20:03:18.358136] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-14T20:03:18.452568] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T20:03:19.013812] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T20:03:19.019014] [INFO ] [REMOTE ] MAGN: Full fetch complete (51594 records). [2025-10-14T20:03:19.019105] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-14T20:03:19.163135] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-14T20:03:19.413220] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-14T20:03:19.413296] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-14T20:03:19.414187] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-14T20:03:19.414249] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-14T20:03:19.415286] [DEBUG] [LOCAL ] MAGN: Trimmed 51594 records to 35969 (keeping 200 days of data) [2025-10-14T20:03:19.620583] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T20:03:19.646747] [INFO ] [REMOTE ] MAN: Full fetch complete (62420 records). [2025-10-14T20:03:19.648519] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-14T20:03:19.689519] [DEBUG] [LOCAL ] MAGN: Primary data saved (35969 records). [2025-10-14T20:03:19.723753] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-14T20:03:19.736249] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAGN took 36.8s. Estimated remaining: 2h 30m 42s. Rate: 7.1 symbols/min [2025-10-14T20:03:19.965759] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-14T20:03:20.067722] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:20.257356] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-14T20:03:20.257449] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-14T20:03:20.258514] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-14T20:03:20.258739] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-14T20:03:20.274063] [DEBUG] [LOCAL ] MAN: Trimmed 62420 records to 43935 (keeping 200 days of data) [2025-10-14T20:03:20.415439] [DEBUG] [LOCAL ] MAS: Loaded 52261 existing records from primary storage. [2025-10-14T20:03:20.419426] [INFO ] [MAIN ] MAS: Loaded 52261 existing records. [2025-10-14T20:03:20.725334] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:20.735631] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-14T20:03:20.741863] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-14T20:03:20.757754] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-14T20:03:20.757858] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-14T20:03:20.787881] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T20:03:20.892033] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-14T20:03:20.993089] [DEBUG] [LOCAL ] MAN: Primary data saved (43935 records). [2025-10-14T20:03:21.051599] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-14T20:03:21.063329] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. MAN took 31.7s. Estimated remaining: 2h 30m 28s. Rate: 7.1 symbols/min [2025-10-14T20:03:21.292786] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:21.356781] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:21.390069] [DEBUG] [LOCAL ] MATV: Loaded 35685 existing records from primary storage. [2025-10-14T20:03:21.390453] [INFO ] [MAIN ] MATV: Loaded 35685 existing records. [2025-10-14T20:03:21.570550] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-14T20:03:21.576267] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:21.577429] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-14T20:03:21.577490] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-14T20:03:21.578157] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-14T20:03:21.578278] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-14T20:03:21.953182] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:22.027723] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-14T20:03:22.038314] [INFO ] [REMOTE ] MAIN: Full fetch complete (60352 records). [2025-10-14T20:03:22.044053] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-14T20:03:22.044405] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T20:03:22.363135] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-14T20:03:22.466667] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-14T20:03:22.466740] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-14T20:03:22.467731] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-14T20:03:22.467792] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-14T20:03:22.469009] [DEBUG] [LOCAL ] MAIN: Trimmed 60352 records to 41746 (keeping 200 days of data) [2025-10-14T20:03:22.715447] [DEBUG] [LOCAL ] MAIN: Primary data saved (41746 records). [2025-10-14T20:03:22.715567] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-14T20:03:22.715664] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MAIN took 37.9s. Estimated remaining: 2h 30m 14s. Rate: 7.1 symbols/min [2025-10-14T20:03:22.883099] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:22.914224] [DEBUG] [LOCAL ] MATX: Loaded 31771 existing records from primary storage. [2025-10-14T20:03:22.914477] [INFO ] [MAIN ] MATX: Loaded 31771 existing records. [2025-10-14T20:03:23.093848] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:23.094119] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-14T20:03:23.094180] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-14T20:03:23.094908] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-14T20:03:23.094966] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-14T20:03:23.159068] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-14T20:03:23.486545] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:23.489132] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T20:03:23.536026] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T20:03:23.958064] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-14T20:03:24.661806] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T20:03:24.758028] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-14T20:03:25.551202] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T20:03:25.560805] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-14T20:03:25.718812] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T20:03:25.722181] [INFO ] [REMOTE ] MANU: Full fetch complete (38694 records). [2025-10-14T20:03:25.722259] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-14T20:03:26.088830] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-14T20:03:26.088911] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-14T20:03:26.089672] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-14T20:03:26.089733] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-14T20:03:26.090512] [DEBUG] [LOCAL ] MANU: Trimmed 38694 records to 27021 (keeping 200 days of data) [2025-10-14T20:03:26.244282] [DEBUG] [LOCAL ] MANU: Primary data saved (27021 records). [2025-10-14T20:03:26.244604] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-14T20:03:26.244704] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MANU took 32.6s. Estimated remaining: 2h 30m 1s. Rate: 7.1 symbols/min [2025-10-14T20:03:26.363160] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-14T20:03:26.416196] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:26.445912] [DEBUG] [LOCAL ] MAX: Loaded 30984 existing records from primary storage. [2025-10-14T20:03:26.446180] [INFO ] [MAIN ] MAX: Loaded 30984 existing records. [2025-10-14T20:03:26.624670] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:26.624879] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-14T20:03:26.624927] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-14T20:03:26.625402] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-14T20:03:26.625463] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-14T20:03:26.983317] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:26.999343] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T20:03:27.158038] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-14T20:03:27.571950] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T20:03:27.958076] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-14T20:03:28.425226] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T20:03:28.758045] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-14T20:03:29.132224] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T20:03:29.558076] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-14T20:03:30.358058] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-14T20:03:30.504725] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T20:03:30.838542] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T20:03:31.158109] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-14T20:03:31.331464] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T20:03:31.958116] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-14T20:03:32.758048] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-14T20:03:32.933408] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T20:03:32.963404] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T20:03:33.558095] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-14T20:03:34.067797] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T20:03:34.358075] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-14T20:03:34.772311] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T20:03:35.158069] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-14T20:03:35.958097] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-14T20:03:36.068404] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T20:03:36.271249] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T20:03:36.758117] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-14T20:03:36.862753] [DEBUG] [REMOTE ] MATX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-14T20:03:36.863205] [WARN ] [REMOTE ] MATX: No data returned for month 2025-04 [2025-10-14T20:03:36.863305] [FATAL] [REMOTE ] MATX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:03:36.863402] [FATAL] [MAIN ] MATX: Failed to fetch primary data. [2025-10-14T20:03:36.863443] [WARN ] [MAIN ] MATX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:03:36.863485] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-14T20:03:36.863548] [DEBUG] [LOCAL ] MATX: No primary data file found to delete. [2025-10-14T20:03:36.863584] [INFO ] [LOCAL ] MATX: Starting deletion of derivative data. [2025-10-14T20:03:36.863913] [DEBUG] [LOCAL ] MATX: Deleted derivative data file. [2025-10-14T20:03:36.864796] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MATX took 14.1s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-14T20:03:37.064958] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:37.115775] [DEBUG] [LOCAL ] MBC: Loaded 43762 existing records from primary storage. [2025-10-14T20:03:37.116328] [INFO ] [MAIN ] MBC: Loaded 43762 existing records. [2025-10-14T20:03:37.348211] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:37.349882] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T20:03:37.350030] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-14T20:03:37.356053] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-14T20:03:37.357532] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-14T20:03:37.357606] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-14T20:03:37.563165] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-14T20:03:37.716880] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:38.358101] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-14T20:03:39.158139] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-14T20:03:39.330789] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T20:03:39.954371] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T20:03:39.962355] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-14T20:03:40.455343] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T20:03:40.758126] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-14T20:03:41.306430] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T20:03:41.558086] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-14T20:03:42.251231] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T20:03:42.358155] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-14T20:03:43.003897] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T20:03:43.158162] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-14T20:03:43.812830] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T20:03:43.958074] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-14T20:03:44.585558] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T20:03:44.758098] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-14T20:03:45.386797] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T20:03:45.558064] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-14T20:03:46.358067] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-14T20:03:46.430608] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T20:03:47.049948] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T20:03:47.158072] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-14T20:03:47.447689] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T20:03:47.958125] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-14T20:03:48.580765] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T20:03:48.758139] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-14T20:03:49.427818] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T20:03:49.558078] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-14T20:03:50.064890] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T20:03:50.358096] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-14T20:03:50.832573] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T20:03:51.158097] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-14T20:03:51.914073] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T20:03:51.958106] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-14T20:03:52.570417] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T20:03:52.758080] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-14T20:03:52.933952] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T20:03:53.558120] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-14T20:03:54.142748] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T20:03:54.358078] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-14T20:03:54.909253] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T20:03:54.913072] [INFO ] [REMOTE ] MATV: Full fetch complete (52236 records). [2025-10-14T20:03:54.913178] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-14T20:03:55.163239] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-14T20:03:55.329273] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-14T20:03:55.329347] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-14T20:03:55.330247] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-14T20:03:55.330307] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-14T20:03:55.331345] [DEBUG] [LOCAL ] MATV: Trimmed 52236 records to 35662 (keeping 200 days of data) [2025-10-14T20:03:55.537462] [DEBUG] [LOCAL ] MATV: Primary data saved (35662 records). [2025-10-14T20:03:55.537889] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-14T20:03:55.537991] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MATV took 34.5s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-14T20:03:55.669851] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T20:03:55.748498] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:55.769621] [DEBUG] [LOCAL ] MBI: Loaded 24337 existing records from primary storage. [2025-10-14T20:03:55.769894] [INFO ] [MAIN ] MBI: Loaded 24337 existing records. [2025-10-14T20:03:55.944588] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:55.944799] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-14T20:03:55.944847] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-14T20:03:55.945338] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-14T20:03:55.945394] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-14T20:03:55.965805] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-14T20:03:56.320245] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:56.335393] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T20:03:56.758136] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-14T20:03:57.558071] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-14T20:03:57.785309] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-14T20:03:57.791264] [INFO ] [REMOTE ] MAS: Full fetch complete (75113 records). [2025-10-14T20:03:57.791411] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-14T20:03:58.192824] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-14T20:03:58.192959] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-14T20:03:58.194047] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-14T20:03:58.194109] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-14T20:03:58.195477] [DEBUG] [LOCAL ] MAS: Trimmed 75113 records to 52266 (keeping 200 days of data) [2025-10-14T20:03:58.314130] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T20:03:58.405118] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-14T20:03:58.554316] [DEBUG] [LOCAL ] MAS: Primary data saved (52266 records). [2025-10-14T20:03:58.554488] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-14T20:03:58.554617] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MAS took 38.8s. Estimated remaining: 2h 29m 42s. Rate: 7.1 symbols/min [2025-10-14T20:03:58.745543] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:03:58.784748] [DEBUG] [LOCAL ] MC: Loaded 44007 existing records from primary storage. [2025-10-14T20:03:58.785042] [INFO ] [MAIN ] MC: Loaded 44007 existing records. [2025-10-14T20:03:58.902595] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T20:03:58.990515] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:03:58.990769] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-14T20:03:58.990820] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-14T20:03:58.991531] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-14T20:03:58.991588] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-14T20:03:59.166460] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-14T20:03:59.353616] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:03:59.956853] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T20:03:59.965950] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-14T20:04:00.399052] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T20:04:00.758084] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-14T20:04:01.251933] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T20:04:01.558039] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-14T20:04:01.728062] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T20:04:02.358112] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-14T20:04:02.920260] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T20:04:03.158030] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-14T20:04:03.614952] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T20:04:03.958155] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-14T20:04:04.584283] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:04:04.758080] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-14T20:04:05.254587] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T20:04:05.558110] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-14T20:04:06.343819] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T20:04:06.358029] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-14T20:04:06.995971] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T20:04:07.158093] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-14T20:04:07.958046] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-14T20:04:08.050124] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T20:04:08.759750] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-14T20:04:08.761774] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T20:04:08.767468] [INFO ] [REMOTE ] MBC: Full fetch complete (63259 records). [2025-10-14T20:04:08.767594] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-14T20:04:09.153193] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-14T20:04:09.153285] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-14T20:04:09.154238] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-14T20:04:09.154298] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-14T20:04:09.155431] [DEBUG] [LOCAL ] MBC: Trimmed 63259 records to 43833 (keeping 200 days of data) [2025-10-14T20:04:09.406390] [DEBUG] [LOCAL ] MBC: Primary data saved (43833 records). [2025-10-14T20:04:09.406514] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-14T20:04:09.406587] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MBC took 32.5s. Estimated remaining: 2h 29m 35s. Rate: 7.1 symbols/min [2025-10-14T20:04:09.560377] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-14T20:04:09.581177] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:09.593213] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T20:04:09.600392] [INFO ] [REMOTE ] MAX: Full fetch complete (45518 records). [2025-10-14T20:04:09.600707] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-14T20:04:09.677887] [DEBUG] [LOCAL ] MCB: Loaded 11344 existing records from primary storage. [2025-10-14T20:04:09.694168] [INFO ] [MAIN ] MCB: Loaded 11344 existing records. [2025-10-14T20:04:10.032026] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:04:10.080480] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-14T20:04:10.101043] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-14T20:04:10.112451] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T20:04:10.106743] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-14T20:04:10.123402] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-14T20:04:10.309829] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-14T20:04:10.315045] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-14T20:04:10.326125] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-14T20:04:10.338271] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-14T20:04:10.365074] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-14T20:04:10.399794] [DEBUG] [LOCAL ] MAX: Trimmed 45518 records to 30978 (keeping 200 days of data) [2025-10-14T20:04:10.660361] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:10.732499] [DEBUG] [LOCAL ] MAX: Primary data saved (30978 records). [2025-10-14T20:04:10.732624] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-14T20:04:10.732732] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MAX took 44.5s. Estimated remaining: 2h 29m 21s. Rate: 7.1 symbols/min [2025-10-14T20:04:10.908126] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:10.908361] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-14T20:04:10.908410] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-14T20:04:10.908548] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-14T20:04:10.908589] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-14T20:04:10.908629] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-14T20:04:10.908694] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-14T20:04:11.162611] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-14T20:04:11.270796] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:11.317885] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T20:04:11.368921] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T20:04:11.958043] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-14T20:04:12.038142] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T20:04:12.758067] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-14T20:04:13.558047] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-14T20:04:13.858016] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T20:04:13.997635] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T20:04:14.358095] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-14T20:04:15.136000] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T20:04:15.158039] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-14T20:04:15.495591] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T20:04:15.958099] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-14T20:04:16.366821] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T20:04:16.514413] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T20:04:16.758071] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-14T20:04:17.558069] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-14T20:04:18.358066] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-14T20:04:18.371441] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T20:04:18.419257] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T20:04:19.158085] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-14T20:04:19.958112] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-14T20:04:20.373956] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T20:04:20.515386] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T20:04:20.758056] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-14T20:04:20.856506] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T20:04:21.558063] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-14T20:04:22.253973] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T20:04:22.358046] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-14T20:04:22.459771] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T20:04:23.158076] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-14T20:04:23.874023] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T20:04:23.958050] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-14T20:04:24.758035] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-14T20:04:25.122395] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T20:04:25.210748] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-14T20:04:25.558058] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-14T20:04:26.242732] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T20:04:26.247429] [INFO ] [REMOTE ] MC: Full fetch complete (62843 records). [2025-10-14T20:04:26.247517] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-14T20:04:26.363194] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-14T20:04:26.561569] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T20:04:26.601628] [INFO ] [REMOTE ] MBI: Full fetch complete (36472 records). [2025-10-14T20:04:26.610605] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-14T20:04:26.688054] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-14T20:04:26.714238] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-14T20:04:26.720962] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-14T20:04:26.726155] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-14T20:04:26.819164] [DEBUG] [LOCAL ] MC: Trimmed 62843 records to 43984 (keeping 200 days of data) [2025-10-14T20:04:27.157494] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-14T20:04:27.158181] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-14T20:04:27.159499] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-14T20:04:27.158586] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-14T20:04:27.163158] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-14T20:04:27.172471] [DEBUG] [LOCAL ] MBI: Trimmed 36472 records to 24329 (keeping 200 days of data) [2025-10-14T20:04:27.441100] [DEBUG] [LOCAL ] MBI: Primary data saved (24329 records). [2025-10-14T20:04:27.442395] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-14T20:04:27.442888] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MBI took 31.9s. Estimated remaining: 2h 29m 19s. Rate: 7.1 symbols/min [2025-10-14T20:04:27.523031] [DEBUG] [LOCAL ] MC: Primary data saved (43984 records). [2025-10-14T20:04:27.545439] [INFO ] [MAIN ] MC: Full history saved. [2025-10-14T20:04:27.553726] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MC took 29.0s. Estimated remaining: 2h 29m 4s. Rate: 7.1 symbols/min [2025-10-14T20:04:27.729596] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:27.804729] [DEBUG] [LOCAL ] MCI: Loaded 6520 existing records from primary storage. [2025-10-14T20:04:27.804502] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:27.805173] [INFO ] [MAIN ] MCI: Loaded 6520 existing records. [2025-10-14T20:04:27.989922] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:04:28.001400] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-14T20:04:28.001555] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-14T20:04:28.002027] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-14T20:04:28.002090] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-14T20:04:28.141034] [DEBUG] [LOCAL ] MCK: Loaded 38713 existing records from primary storage. [2025-10-14T20:04:28.151682] [INFO ] [MAIN ] MCK: Loaded 38713 existing records. [2025-10-14T20:04:28.214947] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T20:04:28.291179] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-14T20:04:28.558405] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:04:28.602315] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:28.602472] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-14T20:04:28.602792] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-14T20:04:28.603401] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-14T20:04:28.603458] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-14T20:04:28.778247] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-14T20:04:28.925523] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-14T20:04:29.001576] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:29.211309] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T20:04:29.429018] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T20:04:29.558083] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-14T20:04:30.358078] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-14T20:04:31.071992] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T20:04:31.158069] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-14T20:04:31.700392] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-14T20:04:31.719858] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T20:04:31.958109] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-14T20:04:32.758058] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-14T20:04:33.468155] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T20:04:33.569717] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-14T20:04:33.577152] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T20:04:34.225316] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T20:04:34.358146] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-14T20:04:35.149434] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T20:04:35.158017] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-14T20:04:35.867826] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T20:04:35.958053] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-14T20:04:36.758084] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-14T20:04:37.368528] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T20:04:37.558063] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-14T20:04:38.016883] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-14T20:04:38.036829] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-14T20:04:38.358067] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-14T20:04:39.079200] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T20:04:39.158070] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-14T20:04:39.958078] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-14T20:04:40.644159] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T20:04:40.758039] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-14T20:04:41.558066] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-14T20:04:41.590340] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:04:41.591581] [INFO ] [REMOTE ] MCI: Full fetch complete (10006 records). [2025-10-14T20:04:41.591667] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-14T20:04:41.951342] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-14T20:04:41.951505] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-14T20:04:41.951841] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-14T20:04:41.951917] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-14T20:04:41.952494] [DEBUG] [LOCAL ] MCI: Trimmed 10006 records to 6454 (keeping 200 days of data) [2025-10-14T20:04:42.017134] [DEBUG] [LOCAL ] MCI: Primary data saved (6454 records). [2025-10-14T20:04:42.019995] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-14T20:04:42.020083] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MCI took 14.6s. Estimated remaining: 2h 29m 0s. Rate: 7.1 symbols/min [2025-10-14T20:04:42.079699] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-14T20:04:42.209822] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:42.219543] [DEBUG] [LOCAL ] MCN: Loaded 8171 existing records from primary storage. [2025-10-14T20:04:42.219766] [INFO ] [MAIN ] MCN: Loaded 8171 existing records. [2025-10-14T20:04:42.358167] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-14T20:04:42.383546] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T20:04:42.433950] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:04:42.438544] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-14T20:04:42.438970] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-14T20:04:42.439196] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-14T20:04:42.439255] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-14T20:04:42.793119] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:43.158080] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-14T20:04:43.853623] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T20:04:43.958103] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-14T20:04:44.688418] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T20:04:44.758030] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-14T20:04:44.793107] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-14T20:04:45.558059] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-14T20:04:45.621513] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T20:04:46.340435] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T20:04:46.358028] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-14T20:04:47.127337] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T20:04:47.158120] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-14T20:04:47.958121] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-14T20:04:48.504469] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T20:04:48.755184] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T20:04:48.756808] [INFO ] [REMOTE ] MCB: Full fetch complete (16476 records). [2025-10-14T20:04:48.756874] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-14T20:04:48.767906] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-14T20:04:49.131727] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-14T20:04:49.131805] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-14T20:04:49.132146] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-14T20:04:49.132182] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-14T20:04:49.132705] [DEBUG] [LOCAL ] MCB: Trimmed 16476 records to 11326 (keeping 200 days of data) [2025-10-14T20:04:49.200383] [DEBUG] [LOCAL ] MCB: Primary data saved (11326 records). [2025-10-14T20:04:49.200506] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-14T20:04:49.200587] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MCB took 39.8s. Estimated remaining: 2h 28m 51s. Rate: 7.1 symbols/min [2025-10-14T20:04:49.373355] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:49.414010] [DEBUG] [LOCAL ] MCO: Loaded 39381 existing records from primary storage. [2025-10-14T20:04:49.414306] [INFO ] [MAIN ] MCO: Loaded 39381 existing records. [2025-10-14T20:04:49.558955] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-14T20:04:49.594606] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:04:49.595785] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-14T20:04:49.595844] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-14T20:04:49.596226] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-14T20:04:49.596283] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-14T20:04:49.998280] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:50.358080] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-14T20:04:50.422449] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T20:04:50.500894] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T20:04:51.158103] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-14T20:04:51.958065] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-14T20:04:52.565717] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-14T20:04:52.659302] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T20:04:52.708015] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T20:04:52.758038] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-14T20:04:53.558074] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-14T20:04:54.358033] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-14T20:04:54.789721] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T20:04:55.158102] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-14T20:04:55.219198] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T20:04:55.252880] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T20:04:55.634537] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T20:04:55.640355] [INFO ] [REMOTE ] MCD: Full fetch complete (77145 records). [2025-10-14T20:04:55.640473] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-14T20:04:55.858245] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T20:04:55.859171] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:04:55.859241] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:04:55.859312] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-14T20:04:55.859375] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-14T20:04:55.859410] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-14T20:04:55.859447] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-14T20:04:55.859507] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MCD took 45.1s. Estimated remaining: 2h 28m 41s. Rate: 7.1 symbols/min [2025-10-14T20:04:55.963185] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-14T20:04:56.057501] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:04:56.068254] [DEBUG] [LOCAL ] MCR: Loaded 8867 existing records from primary storage. [2025-10-14T20:04:56.068458] [INFO ] [MAIN ] MCR: Loaded 8867 existing records. [2025-10-14T20:04:56.252544] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:04:56.252793] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-14T20:04:56.252842] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-14T20:04:56.252990] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-14T20:04:56.253025] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-14T20:04:56.612403] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:04:56.758076] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-14T20:04:57.544011] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T20:04:57.558028] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-14T20:04:57.658441] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T20:04:58.358082] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-14T20:04:59.006483] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T20:04:59.158144] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-14T20:04:59.949487] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T20:04:59.964159] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-14T20:04:59.980697] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T20:05:00.758091] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-14T20:05:00.981482] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T20:05:01.558067] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-14T20:05:02.148379] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T20:05:02.360458] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-14T20:05:02.364299] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T20:05:03.158383] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-14T20:05:03.158780] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T20:05:03.958135] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-14T20:05:04.428219] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T20:05:04.758115] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-14T20:05:05.490400] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T20:05:05.558053] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-14T20:05:05.658570] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T20:05:05.968697] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-14T20:05:06.358075] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-14T20:05:07.158092] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-14T20:05:07.867803] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T20:05:07.890534] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T20:05:07.958028] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-14T20:05:08.758101] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-14T20:05:09.511373] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T20:05:09.558049] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-14T20:05:10.203327] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T20:05:10.344305] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T20:05:10.358022] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-14T20:05:11.091939] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T20:05:11.158063] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-14T20:05:11.958061] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-14T20:05:12.758088] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-14T20:05:12.812704] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T20:05:13.526831] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T20:05:13.565766] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-14T20:05:13.570841] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T20:05:14.330942] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:05:14.332315] [INFO ] [REMOTE ] MCN: Full fetch complete (11703 records). [2025-10-14T20:05:14.332381] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-14T20:05:14.363185] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-14T20:05:14.690358] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-14T20:05:14.690432] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-14T20:05:14.690709] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-14T20:05:14.690774] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-14T20:05:14.691247] [DEBUG] [LOCAL ] MCN: Trimmed 11703 records to 8186 (keeping 200 days of data) [2025-10-14T20:05:14.737476] [DEBUG] [LOCAL ] MCN: Primary data saved (8186 records). [2025-10-14T20:05:14.737591] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-14T20:05:14.737732] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCN took 32.7s. Estimated remaining: 2h 28m 41s. Rate: 7.1 symbols/min [2025-10-14T20:05:14.903867] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:14.924918] [DEBUG] [LOCAL ] MCS: Loaded 20981 existing records from primary storage. [2025-10-14T20:05:14.925157] [INFO ] [MAIN ] MCS: Loaded 20981 existing records. [2025-10-14T20:05:15.107281] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:15.107527] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-14T20:05:15.107576] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-14T20:05:15.107921] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-14T20:05:15.107979] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-14T20:05:15.163550] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-14T20:05:15.458815] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:15.848486] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-14T20:05:15.871618] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T20:05:15.958053] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-14T20:05:16.758050] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-14T20:05:17.070863] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:05:17.558104] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-14T20:05:18.358099] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-14T20:05:18.405682] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T20:05:18.688596] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T20:05:19.147281] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T20:05:19.158034] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-14T20:05:19.668951] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T20:05:19.958052] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-14T20:05:20.758081] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-14T20:05:20.984600] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:05:21.558052] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-14T20:05:22.338200] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T20:05:22.358026] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-14T20:05:22.713827] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:05:23.158037] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-14T20:05:23.964900] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-14T20:05:23.966523] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T20:05:23.971682] [INFO ] [REMOTE ] MCO: Full fetch complete (57615 records). [2025-10-14T20:05:23.971771] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-14T20:05:24.208772] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T20:05:24.372703] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-14T20:05:24.372791] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-14T20:05:24.373732] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-14T20:05:24.373796] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-14T20:05:24.375001] [DEBUG] [LOCAL ] MCO: Trimmed 57615 records to 39438 (keeping 200 days of data) [2025-10-14T20:05:24.615886] [DEBUG] [LOCAL ] MCO: Primary data saved (39438 records). [2025-10-14T20:05:24.616001] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-14T20:05:24.616634] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCO took 35.4s. Estimated remaining: 2h 28m 34s. Rate: 7.1 symbols/min [2025-10-14T20:05:24.783086] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-14T20:05:24.785555] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:24.802953] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T20:05:24.804542] [INFO ] [REMOTE ] MCR: Full fetch complete (14035 records). [2025-10-14T20:05:24.804612] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-14T20:05:24.881462] [DEBUG] [LOCAL ] MCY: Loaded 23898 existing records from primary storage. [2025-10-14T20:05:24.903408] [INFO ] [MAIN ] MCY: Loaded 23898 existing records. [2025-10-14T20:05:25.244994] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:25.273773] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-14T20:05:25.273897] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-14T20:05:25.279586] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-14T20:05:25.294943] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-14T20:05:25.462287] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-14T20:05:25.477715] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-14T20:05:25.513700] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-14T20:05:25.514770] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-14T20:05:25.539859] [DEBUG] [LOCAL ] MCR: Trimmed 14035 records to 8859 (keeping 200 days of data) [2025-10-14T20:05:25.558919] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-14T20:05:25.768017] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:25.779165] [DEBUG] [LOCAL ] MCR: Primary data saved (8859 records). [2025-10-14T20:05:25.779238] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-14T20:05:25.779303] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCR took 29.9s. Estimated remaining: 2h 28m 19s. Rate: 7.1 symbols/min [2025-10-14T20:05:25.955143] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T20:05:25.987109] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:26.023707] [DEBUG] [LOCAL ] MD: Loaded 38560 existing records from primary storage. [2025-10-14T20:05:26.024013] [INFO ] [MAIN ] MD: Loaded 38560 existing records. [2025-10-14T20:05:26.199046] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:26.199270] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-14T20:05:26.199320] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-14T20:05:26.200055] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-14T20:05:26.200112] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-14T20:05:26.359065] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-14T20:05:26.606287] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:27.158149] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-14T20:05:27.289321] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T20:05:27.293756] [INFO ] [REMOTE ] MCK: Full fetch complete (56783 records). [2025-10-14T20:05:27.293906] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-14T20:05:27.700818] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-14T20:05:27.701022] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-14T20:05:27.702167] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-14T20:05:27.702250] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-14T20:05:27.703593] [DEBUG] [LOCAL ] MCK: Trimmed 56783 records to 38649 (keeping 200 days of data) [2025-10-14T20:05:27.827790] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T20:05:27.965257] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-14T20:05:28.008358] [DEBUG] [LOCAL ] MCK: Primary data saved (38649 records). [2025-10-14T20:05:28.008550] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-14T20:05:28.008683] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MCK took 1m 0s. Estimated remaining: 2h 28m 6s. Rate: 7.1 symbols/min [2025-10-14T20:05:28.118713] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:05:28.758150] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-14T20:05:29.433200] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T20:05:29.558067] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-14T20:05:30.354843] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T20:05:30.363035] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-14T20:05:31.015047] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T20:05:31.158052] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-14T20:05:31.435723] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T20:05:31.958098] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-14T20:05:32.536767] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T20:05:32.758081] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-14T20:05:33.072327] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T20:05:33.558078] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-14T20:05:33.997046] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T20:05:34.358036] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-14T20:05:34.599622] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T20:05:35.158061] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-14T20:05:35.532552] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T20:05:35.949169] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T20:05:35.952479] [INFO ] [REMOTE ] MCS: Full fetch complete (30635 records). [2025-10-14T20:05:35.952581] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-14T20:05:35.965417] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-14T20:05:36.356613] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-14T20:05:36.356721] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-14T20:05:36.357327] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-14T20:05:36.357367] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-14T20:05:36.358196] [DEBUG] [LOCAL ] MCS: Trimmed 30635 records to 21059 (keeping 200 days of data) [2025-10-14T20:05:36.485330] [DEBUG] [LOCAL ] MCS: Primary data saved (21059 records). [2025-10-14T20:05:36.485485] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-14T20:05:36.485584] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MCS took 21.7s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-14T20:05:36.758195] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-14T20:05:37.515617] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T20:05:37.558052] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-14T20:05:37.984519] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T20:05:38.358173] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-14T20:05:38.998754] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T20:05:39.158155] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-14T20:05:39.589295] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T20:05:39.958112] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-14T20:05:40.650835] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T20:05:40.758028] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-14T20:05:41.062909] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T20:05:41.558056] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-14T20:05:42.109741] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T20:05:42.355449] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T20:05:42.360721] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-14T20:05:43.158087] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-14T20:05:43.786676] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T20:05:43.958047] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-14T20:05:44.270854] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T20:05:44.758128] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-14T20:05:45.338421] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T20:05:45.558047] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-14T20:05:45.793254] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T20:05:46.358092] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-14T20:05:46.914819] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T20:05:47.158119] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-14T20:05:47.527852] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T20:05:47.531550] [INFO ] [REMOTE ] MCY: Full fetch complete (41079 records). [2025-10-14T20:05:47.531722] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-14T20:05:47.945168] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-14T20:05:47.945275] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-14T20:05:47.946085] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-14T20:05:47.946146] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-14T20:05:47.947002] [DEBUG] [LOCAL ] MCY: Trimmed 41079 records to 23899 (keeping 200 days of data) [2025-10-14T20:05:48.091628] [DEBUG] [LOCAL ] MCY: Primary data saved (23899 records). [2025-10-14T20:05:48.091773] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-14T20:05:48.091859] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCY took 23.5s. Estimated remaining: 2h 27m 52s. Rate: 7.1 symbols/min [2025-10-14T20:05:48.641131] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T20:05:48.645502] [INFO ] [REMOTE ] MD: Full fetch complete (55144 records). [2025-10-14T20:05:48.645589] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-14T20:05:49.016916] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-14T20:05:49.016987] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-14T20:05:49.017845] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-14T20:05:49.017904] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-14T20:05:49.018905] [DEBUG] [LOCAL ] MD: Trimmed 55144 records to 38569 (keeping 200 days of data) [2025-10-14T20:05:49.237210] [DEBUG] [LOCAL ] MD: Primary data saved (38569 records). [2025-10-14T20:05:49.237353] [INFO ] [MAIN ] MD: Full history saved. [2025-10-14T20:05:49.237433] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MD took 23.5s. Estimated remaining: 2h 27m 37s. Rate: 7.1 symbols/min [2025-10-14T20:05:49.872532] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:49.897822] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:49.916257] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:49.897061] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:05:49.927734] [DEBUG] [LOCAL ] MDST: Loaded 5880 existing records from primary storage. [2025-10-14T20:05:49.931204] [DEBUG] [LOCAL ] MDV: Loaded 8497 existing records from primary storage. [2025-10-14T20:05:49.931812] [INFO ] [MAIN ] MDV: Loaded 8497 existing records. [2025-10-14T20:05:49.931526] [INFO ] [MAIN ] MDST: Loaded 5880 existing records. [2025-10-14T20:05:50.344152] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-14T20:05:50.343470] [DEBUG] [LOCAL ] MDU: Loaded 48090 existing records from primary storage. [2025-10-14T20:05:50.342265] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:50.345715] [INFO ] [MAIN ] MDU: Loaded 48090 existing records. [2025-10-14T20:05:50.346359] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-14T20:05:50.349285] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:50.349452] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-14T20:05:50.360472] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-14T20:05:50.349697] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-14T20:05:50.360416] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-14T20:05:50.384053] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-14T20:05:50.399551] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-14T20:05:50.661187] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-14T20:05:50.745515] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-14T20:05:50.801084] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:50.839257] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-14T20:05:50.863671] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-14T20:05:50.984357] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-14T20:05:51.006456] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-14T20:05:50.987257] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:05:51.102381] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-14T20:05:51.107755] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-14T20:05:51.141188] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-14T20:05:51.184400] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-14T20:05:51.789012] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:52.040368] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:51.967835] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-14T20:05:52.069504] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-14T20:05:52.220928] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:52.246744] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:05:52.247011] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-14T20:05:52.247425] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-14T20:05:52.711951] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T20:05:52.713924] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-14T20:05:52.830155] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T20:05:52.832028] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-14T20:05:53.213751] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T20:05:53.215686] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-14T20:05:53.444574] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T20:05:53.558020] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-14T20:05:53.770798] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T20:05:53.853522] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T20:05:53.875883] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T20:05:53.942571] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T20:05:54.358115] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-14T20:05:54.951437] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T20:05:55.158066] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-14T20:05:55.958088] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-14T20:05:56.131163] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T20:05:56.758132] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-14T20:05:57.324557] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-14T20:05:57.558069] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-14T20:05:57.789221] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T20:05:58.128110] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T20:05:58.358097] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-14T20:05:58.943246] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T20:05:59.158039] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-14T20:05:59.924939] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T20:05:59.958051] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-14T20:06:00.758083] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-14T20:06:00.842164] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T20:06:01.558060] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-14T20:06:02.358040] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-14T20:06:02.529140] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T20:06:02.893384] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-14T20:06:03.158114] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-14T20:06:03.329121] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T20:06:03.958074] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-14T20:06:04.659612] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T20:06:04.758101] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-14T20:06:04.811411] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T20:06:05.533846] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T20:06:05.558042] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-14T20:06:06.282585] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T20:06:06.358081] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-14T20:06:07.158105] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-14T20:06:07.958115] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-14T20:06:08.339983] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T20:06:08.758097] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-14T20:06:08.808384] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T20:06:08.840538] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T20:06:09.558066] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-14T20:06:10.261844] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T20:06:10.358082] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-14T20:06:10.726143] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T20:06:11.101754] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T20:06:11.158062] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-14T20:06:11.958114] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-14T20:06:11.967777] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:06:11.970292] [INFO ] [REMOTE ] MDST: Full fetch complete (8738 records). [2025-10-14T20:06:11.970386] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-14T20:06:12.341169] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-14T20:06:12.341244] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-14T20:06:12.341474] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-14T20:06:12.341512] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-14T20:06:12.341938] [DEBUG] [LOCAL ] MDST: Trimmed 8738 records to 5942 (keeping 200 days of data) [2025-10-14T20:06:12.377486] [DEBUG] [LOCAL ] MDST: Primary data saved (5942 records). [2025-10-14T20:06:12.377626] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-14T20:06:12.377771] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDST took 23.1s. Estimated remaining: 2h 27m 41s. Rate: 7.1 symbols/min [2025-10-14T20:06:12.550842] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:06:12.567705] [DEBUG] [LOCAL ] MEC: Loaded 16301 existing records from primary storage. [2025-10-14T20:06:12.567987] [INFO ] [MAIN ] MEC: Loaded 16301 existing records. [2025-10-14T20:06:12.751068] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:06:12.751289] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-14T20:06:12.751337] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-14T20:06:12.751713] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-14T20:06:12.751775] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-14T20:06:12.766206] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-14T20:06:13.119931] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:06:13.558090] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-14T20:06:13.633590] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T20:06:14.358068] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-14T20:06:14.366953] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:06:14.369607] [INFO ] [REMOTE ] MDV: Full fetch complete (11749 records). [2025-10-14T20:06:14.369821] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-14T20:06:14.758091] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-14T20:06:14.758194] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-14T20:06:14.758490] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-14T20:06:14.758560] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-14T20:06:14.759420] [DEBUG] [LOCAL ] MDV: Trimmed 11749 records to 8484 (keeping 200 days of data) [2025-10-14T20:06:14.812808] [DEBUG] [LOCAL ] MDV: Primary data saved (8484 records). [2025-10-14T20:06:14.812936] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-14T20:06:14.813017] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MDV took 25.6s. Estimated remaining: 2h 27m 27s. Rate: 7.1 symbols/min [2025-10-14T20:06:14.981033] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-14T20:06:15.049402] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:06:15.075334] [DEBUG] [LOCAL ] MED: Loaded 21262 existing records from primary storage. [2025-10-14T20:06:15.075624] [INFO ] [MAIN ] MED: Loaded 21262 existing records. [2025-10-14T20:06:15.163333] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-14T20:06:15.258132] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:06:15.258433] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-14T20:06:15.258492] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-14T20:06:15.258952] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-14T20:06:15.259010] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-14T20:06:15.371887] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T20:06:15.621510] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:06:15.958107] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-14T20:06:16.622274] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T20:06:16.758086] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-14T20:06:16.969098] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T20:06:17.558073] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-14T20:06:18.267358] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T20:06:18.310624] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T20:06:18.358036] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-14T20:06:19.158066] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-14T20:06:19.360986] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T20:06:19.958041] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-14T20:06:19.974352] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T20:06:20.758065] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-14T20:06:20.898228] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T20:06:21.558032] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-14T20:06:21.958258] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T20:06:22.358057] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-14T20:06:22.544728] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T20:06:23.158079] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-14T20:06:23.827825] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T20:06:23.958031] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-14T20:06:24.331848] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T20:06:24.758069] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-14T20:06:25.542203] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T20:06:25.558025] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-14T20:06:25.818487] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T20:06:26.358080] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-14T20:06:27.158063] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-14T20:06:27.203880] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T20:06:27.557014] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T20:06:27.958142] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-14T20:06:28.758084] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-14T20:06:28.917910] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:06:29.108724] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T20:06:29.496795] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T20:06:29.558070] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-14T20:06:30.358075] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-14T20:06:30.631291] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T20:06:31.158092] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-14T20:06:31.958102] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-14T20:06:32.071155] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T20:06:32.758039] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-14T20:06:32.920922] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-14T20:06:32.999745] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T20:06:33.326289] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T20:06:33.558058] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-14T20:06:34.358125] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-14T20:06:34.620212] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T20:06:35.158121] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-14T20:06:35.350163] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T20:06:35.958120] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-14T20:06:36.758106] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-14T20:06:36.901870] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T20:06:36.909000] [INFO ] [REMOTE ] MDU: Full fetch complete (70578 records). [2025-10-14T20:06:36.909156] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-14T20:06:37.142731] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T20:06:37.428461] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-14T20:06:37.428560] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-14T20:06:37.429853] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-14T20:06:37.429933] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-14T20:06:37.431541] [DEBUG] [LOCAL ] MDU: Trimmed 70578 records to 48090 (keeping 200 days of data) [2025-10-14T20:06:37.560840] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-14T20:06:37.861224] [DEBUG] [LOCAL ] MDU: Primary data saved (48090 records). [2025-10-14T20:06:37.861398] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-14T20:06:37.861531] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MDU took 48.6s. Estimated remaining: 2h 27m 30s. Rate: 7.1 symbols/min [2025-10-14T20:06:38.090227] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:06:38.124403] [DEBUG] [LOCAL ] MEG: Loaded 31520 existing records from primary storage. [2025-10-14T20:06:38.124841] [INFO ] [MAIN ] MEG: Loaded 31520 existing records. [2025-10-14T20:06:38.321144] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:06:38.321520] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-14T20:06:38.321575] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-14T20:06:38.322375] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-14T20:06:38.322437] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-14T20:06:38.365673] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-14T20:06:38.653732] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T20:06:38.745012] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T20:06:38.768384] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:06:39.158115] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-14T20:06:39.430088] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T20:06:39.432175] [INFO ] [REMOTE ] MEC: Full fetch complete (22834 records). [2025-10-14T20:06:39.432251] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-14T20:06:39.790523] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-14T20:06:39.790595] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-14T20:06:39.791062] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-14T20:06:39.791121] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-14T20:06:39.791733] [DEBUG] [LOCAL ] MEC: Trimmed 22834 records to 16347 (keeping 200 days of data) [2025-10-14T20:06:39.882738] [DEBUG] [LOCAL ] MEC: Primary data saved (16347 records). [2025-10-14T20:06:39.882871] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-14T20:06:39.882946] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MEC took 27.5s. Estimated remaining: 2h 27m 17s. Rate: 7.1 symbols/min [2025-10-14T20:06:39.963331] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-14T20:06:40.057837] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:06:40.077228] [DEBUG] [LOCAL ] MEGI: Loaded 19820 existing records from primary storage. [2025-10-14T20:06:40.077466] [INFO ] [MAIN ] MEGI: Loaded 19820 existing records. [2025-10-14T20:06:40.262385] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:06:40.262693] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-14T20:06:40.262753] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-14T20:06:40.263699] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-14T20:06:40.263788] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-14T20:06:40.619095] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:06:40.649465] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T20:06:40.758074] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-14T20:06:41.036892] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T20:06:41.040517] [INFO ] [REMOTE ] MED: Full fetch complete (32074 records). [2025-10-14T20:06:41.040715] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-14T20:06:41.421485] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-14T20:06:41.421551] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-14T20:06:41.422430] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-14T20:06:41.422504] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-14T20:06:41.423410] [DEBUG] [LOCAL ] MED: Trimmed 32074 records to 21244 (keeping 200 days of data) [2025-10-14T20:06:41.547911] [DEBUG] [LOCAL ] MED: Primary data saved (21244 records). [2025-10-14T20:06:41.548037] [INFO ] [MAIN ] MED: Full history saved. [2025-10-14T20:06:41.548135] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MED took 26.7s. Estimated remaining: 2h 27m 3s. Rate: 7.1 symbols/min [2025-10-14T20:06:41.563317] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-14T20:06:41.720765] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:06:41.748869] [DEBUG] [LOCAL ] MEI: Loaded 31737 existing records from primary storage. [2025-10-14T20:06:41.749146] [INFO ] [MAIN ] MEI: Loaded 31737 existing records. [2025-10-14T20:06:41.950524] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:06:41.950909] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-14T20:06:41.950966] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-14T20:06:41.951536] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-14T20:06:41.951595] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-14T20:06:42.070636] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T20:06:42.342813] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:06:42.358040] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-14T20:06:42.874327] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T20:06:43.158102] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-14T20:06:43.312002] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T20:06:43.767159] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T20:06:43.958058] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-14T20:06:44.758067] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-14T20:06:45.387012] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:06:45.487987] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:06:45.493956] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-14T20:06:45.494070] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-14T20:06:45.563277] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-14T20:06:45.907931] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-14T20:06:45.908007] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-14T20:06:45.909064] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-14T20:06:45.909123] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-14T20:06:45.910486] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-14T20:06:46.238225] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-14T20:06:46.238367] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-14T20:06:46.239055] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MDT took 57.0s. Estimated remaining: 2h 26m 52s. Rate: 7.1 symbols/min [2025-10-14T20:06:46.363224] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-14T20:06:46.413855] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:06:46.463674] [DEBUG] [LOCAL ] MET: Loaded 53320 existing records from primary storage. [2025-10-14T20:06:46.464010] [INFO ] [MAIN ] MET: Loaded 53320 existing records. [2025-10-14T20:06:46.642195] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:06:46.642413] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-14T20:06:46.642460] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-14T20:06:46.643286] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-14T20:06:46.643344] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-14T20:06:47.030275] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:06:47.048405] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T20:06:47.158082] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-14T20:06:47.363006] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T20:06:47.958111] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-14T20:06:48.457332] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T20:06:48.675384] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T20:06:48.758086] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-14T20:06:49.558064] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-14T20:06:50.218817] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T20:06:50.358081] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-14T20:06:50.747897] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T20:06:51.158110] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-14T20:06:51.801775] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T20:06:51.958060] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-14T20:06:52.044542] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-14T20:06:52.758101] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-14T20:06:53.558070] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-14T20:06:53.715898] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T20:06:53.714384] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T20:06:54.358066] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-14T20:06:54.735934] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T20:06:54.932409] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T20:06:55.158081] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-14T20:06:55.958075] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-14T20:06:56.374674] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:06:56.758064] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-14T20:06:56.925798] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T20:06:57.558059] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-14T20:06:57.799115] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T20:06:58.358065] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-14T20:06:59.158052] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-14T20:06:59.392558] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T20:06:59.574374] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T20:06:59.958049] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-14T20:07:00.338608] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T20:07:00.758058] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-14T20:07:01.558101] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-14T20:07:01.921584] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T20:07:01.996158] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T20:07:02.358072] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-14T20:07:02.478249] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T20:07:03.158067] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-14T20:07:03.958095] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-14T20:07:04.172355] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T20:07:04.242833] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T20:07:04.758100] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-14T20:07:05.078252] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T20:07:05.558022] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-14T20:07:05.938820] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T20:07:06.358077] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-14T20:07:06.932956] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T20:07:07.158111] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-14T20:07:07.638600] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T20:07:07.958128] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-14T20:07:08.483227] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T20:07:08.487583] [INFO ] [REMOTE ] MEG: Full fetch complete (47539 records). [2025-10-14T20:07:08.487752] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-14T20:07:08.763196] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-14T20:07:08.897479] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-14T20:07:08.897630] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-14T20:07:08.898541] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-14T20:07:08.898588] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-14T20:07:08.899526] [DEBUG] [LOCAL ] MEG: Trimmed 47539 records to 31553 (keeping 200 days of data) [2025-10-14T20:07:09.108377] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T20:07:09.123325] [DEBUG] [LOCAL ] MEG: Primary data saved (31553 records). [2025-10-14T20:07:09.123511] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-14T20:07:09.123636] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEG took 31.3s. Estimated remaining: 2h 26m 55s. Rate: 7.1 symbols/min [2025-10-14T20:07:09.304453] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:09.344447] [DEBUG] [LOCAL ] MFA: Loaded 45781 existing records from primary storage. [2025-10-14T20:07:09.344790] [INFO ] [MAIN ] MFA: Loaded 45781 existing records. [2025-10-14T20:07:09.529008] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:07:09.529271] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-14T20:07:09.529327] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-14T20:07:09.530162] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-14T20:07:09.530220] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-14T20:07:09.563189] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-14T20:07:09.887272] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:10.141868] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T20:07:10.358119] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-14T20:07:10.660151] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T20:07:11.158085] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-14T20:07:11.958042] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-14T20:07:12.014754] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T20:07:12.376961] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T20:07:12.380890] [INFO ] [REMOTE ] MEI: Full fetch complete (45561 records). [2025-10-14T20:07:12.381003] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-14T20:07:12.754487] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-14T20:07:12.754565] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-14T20:07:12.755402] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-14T20:07:12.755462] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-14T20:07:12.756386] [DEBUG] [LOCAL ] MEI: Trimmed 45561 records to 31735 (keeping 200 days of data) [2025-10-14T20:07:12.758084] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-14T20:07:12.940576] [DEBUG] [LOCAL ] MEI: Primary data saved (31735 records). [2025-10-14T20:07:12.940751] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-14T20:07:12.940842] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MEI took 31.4s. Estimated remaining: 2h 26m 42s. Rate: 7.1 symbols/min [2025-10-14T20:07:13.111317] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:13.117209] [DEBUG] [LOCAL ] MFAN: Loaded 4383 existing records from primary storage. [2025-10-14T20:07:13.117384] [INFO ] [MAIN ] MFAN: Loaded 4383 existing records. [2025-10-14T20:07:13.307447] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:07:13.307744] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-14T20:07:13.307799] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-14T20:07:13.307995] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-14T20:07:13.308036] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-14T20:07:13.570042] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-14T20:07:13.684382] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:13.716321] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T20:07:13.739172] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T20:07:13.741547] [INFO ] [REMOTE ] MEGI: Full fetch complete (29530 records). [2025-10-14T20:07:13.741618] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-14T20:07:14.101946] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-14T20:07:14.102058] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-14T20:07:14.102637] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-14T20:07:14.102720] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-14T20:07:14.103528] [DEBUG] [LOCAL ] MEGI: Trimmed 29530 records to 19859 (keeping 200 days of data) [2025-10-14T20:07:14.223255] [DEBUG] [LOCAL ] MEGI: Primary data saved (19859 records). [2025-10-14T20:07:14.223396] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-14T20:07:14.223477] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MEGI took 34.3s. Estimated remaining: 2h 26m 28s. Rate: 7.1 symbols/min [2025-10-14T20:07:14.363186] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-14T20:07:14.395076] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:14.400622] [DEBUG] [LOCAL ] MFAO: Loaded 3981 existing records from primary storage. [2025-10-14T20:07:14.400816] [INFO ] [MAIN ] MFAO: Loaded 3981 existing records. [2025-10-14T20:07:14.579070] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:07:14.579294] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-14T20:07:14.579340] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-14T20:07:14.579518] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-14T20:07:14.579561] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-14T20:07:14.916448] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T20:07:14.942917] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:14.971061] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:07:15.158061] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-14T20:07:15.686347] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-14T20:07:15.958068] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-14T20:07:16.533584] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T20:07:16.758063] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-14T20:07:17.558070] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-14T20:07:18.213355] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T20:07:18.239907] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T20:07:18.358097] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-14T20:07:19.056079] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T20:07:19.158090] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-14T20:07:19.958090] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-14T20:07:20.432806] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T20:07:20.763185] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-14T20:07:20.776333] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T20:07:21.361546] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-14T20:07:21.558091] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-14T20:07:22.358134] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-14T20:07:22.727217] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-14T20:07:23.158126] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-14T20:07:23.376237] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:07:23.538460] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-14T20:07:23.958063] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-14T20:07:24.758137] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-14T20:07:25.558093] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-14T20:07:25.803639] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T20:07:25.914247] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-14T20:07:26.358052] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-14T20:07:26.454440] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T20:07:26.947889] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T20:07:27.158147] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-14T20:07:27.726103] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T20:07:27.958062] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-14T20:07:28.472164] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-14T20:07:28.758074] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-14T20:07:29.558074] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-14T20:07:30.106354] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T20:07:30.322704] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T20:07:30.358151] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-14T20:07:30.908211] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T20:07:31.158106] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-14T20:07:31.716778] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-14T20:07:31.958165] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-14T20:07:32.758062] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-14T20:07:33.558078] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-14T20:07:33.602187] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T20:07:33.917274] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-14T20:07:34.186532] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T20:07:34.358060] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-14T20:07:35.158130] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-14T20:07:35.894510] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T20:07:35.958072] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-14T20:07:36.086501] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T20:07:36.405510] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T20:07:36.758152] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-14T20:07:37.336518] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:07:37.337540] [INFO ] [REMOTE ] MFAO: Full fetch complete (5443 records). [2025-10-14T20:07:37.337631] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-14T20:07:37.563180] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-14T20:07:37.707253] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-14T20:07:37.707324] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-14T20:07:37.707480] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-14T20:07:37.707538] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-14T20:07:37.707946] [DEBUG] [LOCAL ] MFAO: Trimmed 5443 records to 3994 (keeping 200 days of data) [2025-10-14T20:07:37.731268] [DEBUG] [LOCAL ] MFAO: Primary data saved (3994 records). [2025-10-14T20:07:37.731330] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-14T20:07:37.731394] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MFAO took 23.5s. Estimated remaining: 2h 26m 32s. Rate: 7.1 symbols/min [2025-10-14T20:07:37.903890] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:37.949243] [DEBUG] [LOCAL ] MFC: Loaded 51104 existing records from primary storage. [2025-10-14T20:07:37.949564] [INFO ] [MAIN ] MFC: Loaded 51104 existing records. [2025-10-14T20:07:38.137899] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:07:38.138206] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-14T20:07:38.138263] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-14T20:07:38.139193] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-14T20:07:38.139250] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-14T20:07:38.368347] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-14T20:07:38.470925] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T20:07:38.532969] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:38.533165] [INFO ] [REMOTE ] MET: Full fetch complete (77289 records). [2025-10-14T20:07:38.533725] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-14T20:07:38.957049] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-14T20:07:38.957134] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-14T20:07:38.958245] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-14T20:07:38.958307] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-14T20:07:38.959773] [DEBUG] [LOCAL ] MET: Trimmed 77289 records to 53318 (keeping 200 days of data) [2025-10-14T20:07:39.167344] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-14T20:07:39.279816] [DEBUG] [LOCAL ] MET: Primary data saved (53318 records). [2025-10-14T20:07:39.279947] [INFO ] [MAIN ] MET: Full history saved. [2025-10-14T20:07:39.280022] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MET took 53.0s. Estimated remaining: 2h 26m 18s. Rate: 7.1 symbols/min [2025-10-14T20:07:39.449176] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:39.489828] [DEBUG] [LOCAL ] MFG: Loaded 49426 existing records from primary storage. [2025-10-14T20:07:39.490152] [INFO ] [MAIN ] MFG: Loaded 49426 existing records. [2025-10-14T20:07:39.668390] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:07:39.668616] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-14T20:07:39.668695] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-14T20:07:39.669436] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-14T20:07:39.669491] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-14T20:07:39.965266] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-14T20:07:40.050773] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:40.118950] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:07:40.588888] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T20:07:40.758084] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-14T20:07:40.825494] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T20:07:41.242727] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T20:07:41.243877] [INFO ] [REMOTE ] MFAN: Full fetch complete (5900 records). [2025-10-14T20:07:41.243945] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-14T20:07:41.568574] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-14T20:07:41.608275] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-14T20:07:41.608354] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-14T20:07:41.608528] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-14T20:07:41.608565] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-14T20:07:41.608953] [DEBUG] [LOCAL ] MFAN: Trimmed 5900 records to 4390 (keeping 200 days of data) [2025-10-14T20:07:41.634881] [DEBUG] [LOCAL ] MFAN: Primary data saved (4390 records). [2025-10-14T20:07:41.634948] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-14T20:07:41.635016] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MFAN took 28.7s. Estimated remaining: 2h 26m 5s. Rate: 7.1 symbols/min [2025-10-14T20:07:41.800169] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:41.814577] [DEBUG] [LOCAL ] MFM: Loaded 14711 existing records from primary storage. [2025-10-14T20:07:41.814833] [INFO ] [MAIN ] MFM: Loaded 14711 existing records. [2025-10-14T20:07:41.989889] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:07:41.990124] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-14T20:07:41.990173] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-14T20:07:41.990507] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-14T20:07:41.990563] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-14T20:07:42.347389] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:42.358036] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-14T20:07:43.145518] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T20:07:43.158021] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-14T20:07:43.229474] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T20:07:43.866240] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T20:07:43.958104] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-14T20:07:44.758066] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-14T20:07:45.556770] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T20:07:45.566007] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-14T20:07:46.358043] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-14T20:07:46.488361] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T20:07:47.026777] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T20:07:47.158041] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-14T20:07:47.196898] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T20:07:47.958052] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-14T20:07:48.674578] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T20:07:48.758116] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-14T20:07:49.558101] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-14T20:07:49.670844] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T20:07:50.358141] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-14T20:07:50.401542] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T20:07:50.407006] [INFO ] [REMOTE ] MFA: Full fetch complete (65432 records). [2025-10-14T20:07:50.407149] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-14T20:07:50.797923] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-14T20:07:50.798003] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-14T20:07:50.799010] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-14T20:07:50.799075] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-14T20:07:50.800408] [DEBUG] [LOCAL ] MFA: Trimmed 65432 records to 45808 (keeping 200 days of data) [2025-10-14T20:07:51.076888] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T20:07:51.116580] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T20:07:51.134548] [DEBUG] [LOCAL ] MFA: Primary data saved (45808 records). [2025-10-14T20:07:51.134738] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-14T20:07:51.134867] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MFA took 42.0s. Estimated remaining: 2h 25m 57s. Rate: 7.1 symbols/min [2025-10-14T20:07:51.163954] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-14T20:07:51.315819] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:07:51.315996] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-14T20:07:51.316774] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-14T20:07:51.316904] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-14T20:07:51.316971] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-14T20:07:51.317039] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-14T20:07:51.317083] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-14T20:07:51.665694] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:07:51.958118] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-14T20:07:52.358312] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-14T20:07:52.758067] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-14T20:07:52.866898] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T20:07:53.007966] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-14T20:07:53.558114] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-14T20:07:54.358120] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-14T20:07:55.158044] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-14T20:07:55.301034] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T20:07:55.392399] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-14T20:07:55.963243] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-14T20:07:55.979510] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T20:07:56.758044] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-14T20:07:57.048499] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T20:07:57.558120] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-14T20:07:57.873629] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-14T20:07:58.322495] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T20:07:58.358028] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-14T20:07:58.660221] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-14T20:07:59.158056] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-14T20:07:59.395865] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-14T20:07:59.958052] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-14T20:08:00.758063] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-14T20:08:01.112413] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T20:08:01.558042] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-14T20:08:01.695536] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T20:08:01.895149] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-14T20:08:02.358086] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-14T20:08:02.826177] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T20:08:03.158063] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-14T20:08:03.632510] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-14T20:08:03.958070] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-14T20:08:04.758130] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-14T20:08:05.391376] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:08:05.392437] [INFO ] [REMOTE ] MFSB: Full fetch complete (1819 records). [2025-10-14T20:08:05.392506] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-14T20:08:05.560764] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-14T20:08:05.589555] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-14T20:08:05.590101] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:08:05.590321] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:08:05.590441] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-14T20:08:05.590547] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-14T20:08:05.590622] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-14T20:08:05.590792] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-14T20:08:05.590876] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFSB took 14.5s. Estimated remaining: 2h 25m 53s. Rate: 7.1 symbols/min [2025-10-14T20:08:05.763353] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:05.796356] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T20:08:05.799207] [DEBUG] [LOCAL ] MFSG: Loaded 5685 existing records from primary storage. [2025-10-14T20:08:05.810514] [INFO ] [MAIN ] MFSG: Loaded 5685 existing records. [2025-10-14T20:08:05.992953] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:05.993136] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-14T20:08:05.993184] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-14T20:08:05.993411] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-14T20:08:05.993469] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-14T20:08:06.339945] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:06.358061] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-14T20:08:06.687090] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-14T20:08:07.163215] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-14T20:08:07.183083] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T20:08:07.958104] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-14T20:08:08.758098] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-14T20:08:08.779724] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T20:08:08.944140] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T20:08:09.172943] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T20:08:09.558073] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-14T20:08:09.989050] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T20:08:10.358090] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-14T20:08:11.158103] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-14T20:08:11.958114] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-14T20:08:12.029259] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T20:08:12.432765] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T20:08:12.533904] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T20:08:12.758072] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-14T20:08:13.558064] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-14T20:08:14.358057] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-14T20:08:14.559726] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T20:08:14.852505] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T20:08:14.858150] [INFO ] [REMOTE ] MFC: Full fetch complete (74288 records). [2025-10-14T20:08:14.858250] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-14T20:08:15.163193] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-14T20:08:15.266327] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-14T20:08:15.266421] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-14T20:08:15.267500] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-14T20:08:15.267564] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-14T20:08:15.269068] [DEBUG] [LOCAL ] MFC: Trimmed 74288 records to 51097 (keeping 200 days of data) [2025-10-14T20:08:15.339703] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T20:08:15.588355] [DEBUG] [LOCAL ] MFC: Primary data saved (51097 records). [2025-10-14T20:08:15.588504] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-14T20:08:15.588584] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MFC took 37.9s. Estimated remaining: 2h 25m 46s. Rate: 7.1 symbols/min [2025-10-14T20:08:15.756743] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:15.768472] [DEBUG] [LOCAL ] MFSI: Loaded 11946 existing records from primary storage. [2025-10-14T20:08:15.768734] [INFO ] [MAIN ] MFSI: Loaded 11946 existing records. [2025-10-14T20:08:15.944076] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:15.944356] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-14T20:08:15.944409] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-14T20:08:15.944759] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-14T20:08:15.944815] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-14T20:08:15.965408] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-14T20:08:16.302718] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:16.758075] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-14T20:08:16.773227] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T20:08:16.875992] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T20:08:17.288467] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-14T20:08:17.558060] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-14T20:08:18.190093] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T20:08:18.358043] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-14T20:08:18.914726] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T20:08:19.158050] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-14T20:08:19.591979] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T20:08:19.958049] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-14T20:08:20.396791] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T20:08:20.758087] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-14T20:08:21.558046] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-14T20:08:21.621406] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T20:08:21.925458] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-14T20:08:22.358099] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-14T20:08:23.055256] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T20:08:23.158122] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-14T20:08:23.878400] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T20:08:23.958064] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-14T20:08:24.757242] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T20:08:24.759849] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-14T20:08:25.558057] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-14T20:08:26.361947] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-14T20:08:26.364735] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T20:08:26.393527] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T20:08:26.395572] [INFO ] [REMOTE ] MFM: Full fetch complete (19465 records). [2025-10-14T20:08:26.395639] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-14T20:08:26.747977] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-14T20:08:26.748049] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-14T20:08:26.748368] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-14T20:08:26.748406] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-14T20:08:26.748946] [DEBUG] [LOCAL ] MFM: Trimmed 19465 records to 14624 (keeping 200 days of data) [2025-10-14T20:08:26.833686] [DEBUG] [LOCAL ] MFM: Primary data saved (14624 records). [2025-10-14T20:08:26.833812] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-14T20:08:26.833896] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFM took 45.2s. Estimated remaining: 2h 25m 40s. Rate: 7.1 symbols/min [2025-10-14T20:08:26.985373] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T20:08:27.018334] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:27.022348] [DEBUG] [LOCAL ] MFSV: Loaded 2758 existing records from primary storage. [2025-10-14T20:08:27.022483] [INFO ] [MAIN ] MFSV: Loaded 2758 existing records. [2025-10-14T20:08:27.168435] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-14T20:08:27.197527] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:27.197901] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-14T20:08:27.197949] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-14T20:08:27.198144] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-14T20:08:27.198204] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-14T20:08:27.547068] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:27.757952] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T20:08:27.958039] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-14T20:08:28.284587] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-14T20:08:28.758078] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-14T20:08:29.091464] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-14T20:08:29.558068] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-14T20:08:29.971794] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T20:08:30.358038] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-14T20:08:31.030682] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T20:08:31.158091] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-14T20:08:31.788198] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-14T20:08:31.958069] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-14T20:08:32.758078] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-14T20:08:33.360488] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T20:08:33.558045] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-14T20:08:33.692729] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T20:08:33.698824] [INFO ] [REMOTE ] MFG: Full fetch complete (69435 records). [2025-10-14T20:08:33.698938] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-14T20:08:34.082608] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-14T20:08:34.082714] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-14T20:08:34.083774] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-14T20:08:34.083835] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-14T20:08:34.085263] [DEBUG] [LOCAL ] MFG: Trimmed 69435 records to 49518 (keeping 200 days of data) [2025-10-14T20:08:34.174276] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T20:08:34.358223] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-14T20:08:34.373903] [DEBUG] [LOCAL ] MFG: Primary data saved (49518 records). [2025-10-14T20:08:34.373997] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-14T20:08:34.374067] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFG took 55.1s. Estimated remaining: 2h 25m 30s. Rate: 7.1 symbols/min [2025-10-14T20:08:34.539050] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:34.554276] [DEBUG] [LOCAL ] MG: Loaded 15987 existing records from primary storage. [2025-10-14T20:08:34.554498] [INFO ] [MAIN ] MG: Loaded 15987 existing records. [2025-10-14T20:08:34.728919] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:34.729124] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-14T20:08:34.729171] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-14T20:08:34.729492] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-14T20:08:34.729548] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-14T20:08:34.879915] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T20:08:35.085103] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:35.158025] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-14T20:08:35.958099] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-14T20:08:36.236462] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T20:08:36.758066] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-14T20:08:36.780678] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T20:08:36.782034] [INFO ] [REMOTE ] MFSG: Full fetch complete (6482 records). [2025-10-14T20:08:36.782132] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-14T20:08:37.134291] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-14T20:08:37.134364] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-14T20:08:37.134531] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-14T20:08:37.134567] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-14T20:08:37.134973] [DEBUG] [LOCAL ] MFSG: Trimmed 6482 records to 5709 (keeping 200 days of data) [2025-10-14T20:08:37.168236] [DEBUG] [LOCAL ] MFSG: Primary data saved (5709 records). [2025-10-14T20:08:37.168327] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-14T20:08:37.168411] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFSG took 31.6s. Estimated remaining: 2h 25m 18s. Rate: 7.1 symbols/min [2025-10-14T20:08:37.342397] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:37.388419] [DEBUG] [LOCAL ] MGA: Loaded 50634 existing records from primary storage. [2025-10-14T20:08:37.388832] [INFO ] [MAIN ] MGA: Loaded 50634 existing records. [2025-10-14T20:08:37.567997] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-14T20:08:37.572532] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:37.572810] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-14T20:08:37.573697] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-14T20:08:37.574730] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-14T20:08:37.574810] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-14T20:08:37.876964] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T20:08:37.952229] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:38.358112] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-14T20:08:38.619888] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T20:08:39.158048] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-14T20:08:39.333897] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T20:08:39.958062] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-14T20:08:40.014834] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T20:08:40.237369] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-14T20:08:40.758069] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-14T20:08:41.558050] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-14T20:08:41.680754] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T20:08:41.682903] [INFO ] [REMOTE ] MFSI: Full fetch complete (14407 records). [2025-10-14T20:08:41.682972] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-14T20:08:42.053430] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-14T20:08:42.053503] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-14T20:08:42.053863] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-14T20:08:42.053922] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-14T20:08:42.054402] [DEBUG] [LOCAL ] MFSI: Trimmed 14407 records to 12037 (keeping 200 days of data) [2025-10-14T20:08:42.126059] [DEBUG] [LOCAL ] MFSI: Primary data saved (12037 records). [2025-10-14T20:08:42.126183] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-14T20:08:42.126260] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFSI took 26.5s. Estimated remaining: 2h 25m 6s. Rate: 7.1 symbols/min [2025-10-14T20:08:42.298107] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:42.303537] [DEBUG] [LOCAL ] MGF: Loaded 4272 existing records from primary storage. [2025-10-14T20:08:42.303742] [INFO ] [MAIN ] MGF: Loaded 4272 existing records. [2025-10-14T20:08:42.358175] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-14T20:08:42.486789] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:42.487002] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-14T20:08:42.487054] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-14T20:08:42.487272] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-14T20:08:42.487329] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-14T20:08:42.720469] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:08:42.801808] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T20:08:42.878697] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:43.158070] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-14T20:08:43.743347] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T20:08:43.958122] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-14T20:08:44.510414] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T20:08:44.758086] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-14T20:08:45.558046] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-14T20:08:45.983711] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T20:08:46.358087] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-14T20:08:46.523046] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T20:08:46.795062] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-14T20:08:47.158147] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-14T20:08:47.708226] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T20:08:47.958077] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-14T20:08:48.607569] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T20:08:48.758039] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-14T20:08:49.302199] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-14T20:08:49.558035] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-14T20:08:50.197864] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:08:50.199029] [INFO ] [REMOTE ] MFSV: Full fetch complete (3478 records). [2025-10-14T20:08:50.199094] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-14T20:08:50.362040] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-14T20:08:50.568228] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-14T20:08:50.568301] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-14T20:08:50.568414] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-14T20:08:50.568453] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-14T20:08:50.568823] [DEBUG] [LOCAL ] MFSV: Trimmed 3478 records to 2793 (keeping 200 days of data) [2025-10-14T20:08:50.587188] [DEBUG] [LOCAL ] MFSV: Primary data saved (2793 records). [2025-10-14T20:08:50.587278] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-14T20:08:50.587351] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MFSV took 23.8s. Estimated remaining: 2h 24m 58s. Rate: 7.1 symbols/min [2025-10-14T20:08:50.756619] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:08:50.808494] [DEBUG] [LOCAL ] MGM: Loaded 53606 existing records from primary storage. [2025-10-14T20:08:50.808820] [INFO ] [MAIN ] MGM: Loaded 53606 existing records. [2025-10-14T20:08:50.989289] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:08:50.989481] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-14T20:08:50.989525] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-14T20:08:50.990559] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-14T20:08:50.990616] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-14T20:08:51.163928] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-14T20:08:51.356954] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:08:51.471896] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T20:08:51.858408] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T20:08:51.958062] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-14T20:08:52.758282] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-14T20:08:53.558077] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-14T20:08:53.701495] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T20:08:54.358085] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-14T20:08:54.503979] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T20:08:54.530604] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T20:08:54.950955] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T20:08:55.158058] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-14T20:08:55.958112] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-14T20:08:56.529099] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T20:08:56.758067] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-14T20:08:56.855017] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T20:08:57.403355] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T20:08:57.558056] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-14T20:08:58.108886] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T20:08:58.358097] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-14T20:08:58.934707] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T20:08:59.158069] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-14T20:08:59.958068] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-14T20:09:00.758062] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-14T20:09:00.919182] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T20:09:00.955530] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T20:09:01.148303] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-14T20:09:01.558075] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-14T20:09:02.126587] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T20:09:02.127724] [INFO ] [REMOTE ] MGF: Full fetch complete (5862 records). [2025-10-14T20:09:02.127796] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-14T20:09:02.367689] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-14T20:09:02.506081] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-14T20:09:02.506157] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-14T20:09:02.506337] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-14T20:09:02.506377] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-14T20:09:02.506843] [DEBUG] [LOCAL ] MGF: Trimmed 5862 records to 4261 (keeping 200 days of data) [2025-10-14T20:09:02.533216] [DEBUG] [LOCAL ] MGF: Primary data saved (4261 records). [2025-10-14T20:09:02.533355] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-14T20:09:02.533437] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MGF took 20.4s. Estimated remaining: 2h 24m 52s. Rate: 7.1 symbols/min [2025-10-14T20:09:02.706939] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:02.713872] [DEBUG] [LOCAL ] MGR: Loaded 5648 existing records from primary storage. [2025-10-14T20:09:02.714056] [INFO ] [MAIN ] MGR: Loaded 5648 existing records. [2025-10-14T20:09:02.888975] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:02.889175] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-14T20:09:02.889221] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-14T20:09:02.889426] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-14T20:09:02.889465] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-14T20:09:03.167540] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-14T20:09:03.251374] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:03.958103] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-14T20:09:04.332632] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T20:09:04.690739] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T20:09:04.758088] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-14T20:09:04.950005] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T20:09:05.375496] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T20:09:05.558061] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-14T20:09:06.358064] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-14T20:09:06.463608] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T20:09:06.758359] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-14T20:09:07.158075] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-14T20:09:07.958067] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-14T20:09:08.758042] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-14T20:09:08.880192] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T20:09:08.916404] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T20:09:09.374783] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T20:09:09.558066] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-14T20:09:10.176326] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T20:09:10.358072] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-14T20:09:10.957224] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T20:09:11.158083] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-14T20:09:11.958067] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-14T20:09:12.528450] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T20:09:12.749079] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T20:09:12.758259] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-14T20:09:13.496480] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:09:13.558062] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-14T20:09:14.224362] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T20:09:14.358132] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-14T20:09:15.158105] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-14T20:09:15.250150] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:09:15.796678] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T20:09:15.958058] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-14T20:09:16.758097] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-14T20:09:16.884713] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T20:09:16.886782] [INFO ] [REMOTE ] MG: Full fetch complete (23664 records). [2025-10-14T20:09:16.886868] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-14T20:09:17.255837] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-14T20:09:17.255913] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-14T20:09:17.256421] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-14T20:09:17.256460] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-14T20:09:17.257082] [DEBUG] [LOCAL ] MG: Trimmed 23664 records to 15911 (keeping 200 days of data) [2025-10-14T20:09:17.347105] [DEBUG] [LOCAL ] MG: Primary data saved (15911 records). [2025-10-14T20:09:17.347235] [INFO ] [MAIN ] MG: Full history saved. [2025-10-14T20:09:17.347319] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MG took 43.0s. Estimated remaining: 2h 24m 49s. Rate: 7.1 symbols/min [2025-10-14T20:09:17.526291] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:17.529893] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:09:17.531210] [INFO ] [REMOTE ] MGR: Full fetch complete (8038 records). [2025-10-14T20:09:17.531294] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-14T20:09:17.568278] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-14T20:09:17.627608] [DEBUG] [LOCAL ] MGRB: Loaded 4045 existing records from primary storage. [2025-10-14T20:09:17.638393] [INFO ] [MAIN ] MGRB: Loaded 4045 existing records. [2025-10-14T20:09:17.998089] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:18.000571] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-14T20:09:18.000858] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-14T20:09:18.016786] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-14T20:09:18.027135] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-14T20:09:18.204362] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-14T20:09:18.222211] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-14T20:09:18.232613] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-14T20:09:18.256684] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-14T20:09:18.336298] [DEBUG] [LOCAL ] MGR: Trimmed 8038 records to 5625 (keeping 200 days of data) [2025-10-14T20:09:18.360412] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-14T20:09:18.459270] [DEBUG] [LOCAL ] MGR: Primary data saved (5625 records). [2025-10-14T20:09:18.474820] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-14T20:09:18.479245] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MGR took 15.9s. Estimated remaining: 2h 24m 35s. Rate: 7.1 symbols/min [2025-10-14T20:09:18.479138] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:18.643590] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:18.647210] [DEBUG] [LOCAL ] MGRD: Loaded 2220 existing records from primary storage. [2025-10-14T20:09:18.647345] [INFO ] [MAIN ] MGRD: Loaded 2220 existing records. [2025-10-14T20:09:18.820467] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:18.820710] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-14T20:09:18.820766] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-14T20:09:18.820947] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-14T20:09:18.821003] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-14T20:09:19.165048] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-14T20:09:19.169761] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:19.395739] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T20:09:19.879967] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T20:09:19.958093] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-14T20:09:20.200285] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T20:09:20.602787] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T20:09:20.758141] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-14T20:09:21.558063] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-14T20:09:22.063106] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-14T20:09:22.358073] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-14T20:09:22.419187] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T20:09:22.825197] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T20:09:23.158079] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-14T20:09:23.958079] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-14T20:09:24.524003] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T20:09:24.758052] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-14T20:09:24.851378] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T20:09:25.558106] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-14T20:09:25.983995] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T20:09:26.358112] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-14T20:09:26.732338] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T20:09:27.158135] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-14T20:09:27.655959] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T20:09:27.832386] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T20:09:27.838012] [INFO ] [REMOTE ] MGA: Full fetch complete (73754 records). [2025-10-14T20:09:27.838118] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-14T20:09:27.963234] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-14T20:09:28.231726] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-14T20:09:28.231822] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-14T20:09:28.233000] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-14T20:09:28.233065] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-14T20:09:28.235180] [DEBUG] [LOCAL ] MGA: Trimmed 73754 records to 50617 (keeping 200 days of data) [2025-10-14T20:09:28.544629] [DEBUG] [LOCAL ] MGA: Primary data saved (50617 records). [2025-10-14T20:09:28.544784] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-14T20:09:28.544873] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MGA took 51.4s. Estimated remaining: 2h 24m 27s. Rate: 7.1 symbols/min [2025-10-14T20:09:28.617439] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T20:09:28.725200] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:28.733136] [DEBUG] [LOCAL ] MGRE: Loaded 6672 existing records from primary storage. [2025-10-14T20:09:28.733319] [INFO ] [MAIN ] MGRE: Loaded 6672 existing records. [2025-10-14T20:09:28.763180] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-14T20:09:28.914669] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:28.914917] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-14T20:09:28.914965] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-14T20:09:28.915203] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-14T20:09:28.915260] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-14T20:09:29.270826] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:29.558060] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-14T20:09:30.099754] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-14T20:09:30.358177] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-14T20:09:30.699017] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T20:09:30.876384] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T20:09:31.158112] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-14T20:09:31.805802] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T20:09:31.958099] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-14T20:09:32.397670] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T20:09:32.758084] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-14T20:09:33.558066] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-14T20:09:34.261419] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T20:09:34.358126] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-14T20:09:34.630320] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T20:09:34.711220] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T20:09:35.158089] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-14T20:09:35.958097] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-14T20:09:36.559539] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T20:09:36.758045] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-14T20:09:36.794424] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T20:09:37.153496] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-14T20:09:37.558057] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-14T20:09:38.193449] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T20:09:38.358051] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-14T20:09:38.803870] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T20:09:39.158075] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-14T20:09:39.753495] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-14T20:09:39.958054] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-14T20:09:40.654815] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T20:09:40.758035] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-14T20:09:41.416177] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T20:09:41.558060] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-14T20:09:42.358090] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-14T20:09:43.060758] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T20:09:43.158024] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-14T20:09:43.323308] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T20:09:43.916398] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T20:09:43.958032] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-14T20:09:44.618703] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T20:09:44.758129] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-14T20:09:45.346715] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T20:09:45.558034] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-14T20:09:46.146753] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T20:09:46.358076] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-14T20:09:47.158108] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-14T20:09:47.643432] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T20:09:47.958044] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-14T20:09:48.384597] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T20:09:48.416631] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T20:09:48.758056] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-14T20:09:49.558055] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-14T20:09:49.988086] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T20:09:49.988883] [INFO ] [REMOTE ] MGRD: Full fetch complete (3508 records). [2025-10-14T20:09:49.988948] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-14T20:09:50.341766] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-14T20:09:50.341852] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-14T20:09:50.341979] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-14T20:09:50.342018] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-14T20:09:50.342380] [DEBUG] [LOCAL ] MGRD: Trimmed 3508 records to 2221 (keeping 200 days of data) [2025-10-14T20:09:50.355911] [DEBUG] [LOCAL ] MGRD: Primary data saved (2221 records). [2025-10-14T20:09:50.356004] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-14T20:09:50.356079] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGRD took 31.9s. Estimated remaining: 2h 24m 29s. Rate: 7.1 symbols/min [2025-10-14T20:09:50.367261] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-14T20:09:50.530230] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:50.577324] [DEBUG] [LOCAL ] MGY: Loaded 52411 existing records from primary storage. [2025-10-14T20:09:50.577639] [INFO ] [MAIN ] MGY: Loaded 52411 existing records. [2025-10-14T20:09:50.761814] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:50.762117] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-14T20:09:50.762188] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-14T20:09:50.772684] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-14T20:09:50.790191] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-14T20:09:50.869818] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T20:09:51.094775] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T20:09:51.175904] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:51.163204] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-14T20:09:51.855795] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:09:51.857127] [INFO ] [REMOTE ] MGRE: Full fetch complete (9354 records). [2025-10-14T20:09:51.857210] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-14T20:09:51.963208] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-14T20:09:52.247720] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-14T20:09:52.247811] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-14T20:09:52.248098] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-14T20:09:52.248139] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-14T20:09:52.248569] [DEBUG] [LOCAL ] MGRE: Trimmed 9354 records to 6639 (keeping 200 days of data) [2025-10-14T20:09:52.292080] [DEBUG] [LOCAL ] MGRE: Primary data saved (6639 records). [2025-10-14T20:09:52.292221] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-14T20:09:52.292309] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MGRE took 23.7s. Estimated remaining: 2h 24m 16s. Rate: 7.1 symbols/min [2025-10-14T20:09:52.464050] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:52.464213] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-14T20:09:52.464254] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-14T20:09:52.464362] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-14T20:09:52.464403] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-14T20:09:52.464443] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-14T20:09:52.464474] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-14T20:09:52.771197] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-14T20:09:52.811706] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:53.530835] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:09:53.559346] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-14T20:09:53.559701] [INFO ] [REMOTE ] MGM: Full fetch complete (77749 records). [2025-10-14T20:09:53.571324] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-14T20:09:53.575420] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T20:09:53.967292] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-14T20:09:53.967370] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-14T20:09:53.968481] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-14T20:09:53.968542] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-14T20:09:53.969967] [DEBUG] [LOCAL ] MGM: Trimmed 77749 records to 53607 (keeping 200 days of data) [2025-10-14T20:09:54.058173] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-14T20:09:54.277975] [DEBUG] [LOCAL ] MGM: Primary data saved (53607 records). [2025-10-14T20:09:54.278100] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-14T20:09:54.278175] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGM took 1m 4s. Estimated remaining: 2h 24m 2s. Rate: 7.1 symbols/min [2025-10-14T20:09:54.363231] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-14T20:09:54.451677] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:54.463493] [DEBUG] [LOCAL ] MHD: Loaded 12370 existing records from primary storage. [2025-10-14T20:09:54.463716] [INFO ] [MAIN ] MHD: Loaded 12370 existing records. [2025-10-14T20:09:54.647892] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:54.648069] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-14T20:09:54.648115] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-14T20:09:54.648416] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-14T20:09:54.648473] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-14T20:09:54.913685] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T20:09:54.925559] [INFO ] [REMOTE ] MGRB: Full fetch complete (5769 records). [2025-10-14T20:09:54.936107] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-14T20:09:55.129506] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:55.163160] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-14T20:09:55.369263] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-14T20:09:55.369366] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-14T20:09:55.369527] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-14T20:09:55.369566] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-14T20:09:55.369950] [DEBUG] [LOCAL ] MGRB: Trimmed 5769 records to 4036 (keeping 200 days of data) [2025-10-14T20:09:55.396693] [DEBUG] [LOCAL ] MGRB: Primary data saved (4036 records). [2025-10-14T20:09:55.396831] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-14T20:09:55.396917] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGRB took 38.0s. Estimated remaining: 2h 23m 48s. Rate: 7.1 symbols/min [2025-10-14T20:09:55.440405] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:09:55.478362] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-14T20:09:55.497454] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:09:55.499820] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-14T20:09:55.499930] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:09:55.500280] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-14T20:09:55.505711] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-14T20:09:55.515978] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-14T20:09:55.521159] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-14T20:09:55.538682] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MH took 3.2s. Estimated remaining: 2h 23m 34s. Rate: 7.1 symbols/min [2025-10-14T20:09:55.669863] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:55.741618] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:09:55.745861] [DEBUG] [LOCAL ] MHF: Loaded 8824 existing records from primary storage. [2025-10-14T20:09:55.746023] [INFO ] [MAIN ] MHF: Loaded 8824 existing records. [2025-10-14T20:09:55.933980] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:55.934185] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-14T20:09:55.934234] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-14T20:09:55.934368] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-14T20:09:55.934405] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-14T20:09:55.964223] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-14T20:09:56.051401] [DEBUG] [LOCAL ] MHK: Loaded 42155 existing records from primary storage. [2025-10-14T20:09:56.062816] [INFO ] [MAIN ] MHK: Loaded 42155 existing records. [2025-10-14T20:09:56.474063] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:09:56.492536] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-14T20:09:56.496898] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-14T20:09:56.496806] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:56.497575] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-14T20:09:56.497698] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-14T20:09:56.765571] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-14T20:09:56.846689] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:09:57.032499] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T20:09:57.304634] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T20:09:57.558069] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-14T20:09:58.336100] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T20:09:58.358039] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-14T20:09:59.158120] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-14T20:09:59.805574] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-14T20:09:59.933417] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T20:09:59.958079] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-14T20:10:00.758088] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-14T20:10:00.779049] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T20:10:01.558077] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-14T20:10:02.367354] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-14T20:10:02.373457] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T20:10:02.399390] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T20:10:03.161948] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-14T20:10:03.165387] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T20:10:03.958063] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-14T20:10:04.675131] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T20:10:04.758047] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-14T20:10:04.844509] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T20:10:05.558097] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-14T20:10:05.731847] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T20:10:06.358062] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-14T20:10:07.167255] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-14T20:10:07.172668] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T20:10:07.392454] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T20:10:07.958059] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-14T20:10:08.729388] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T20:10:08.758079] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-14T20:10:08.885492] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T20:10:09.491524] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T20:10:09.558026] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-14T20:10:10.229832] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T20:10:10.358042] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-14T20:10:11.158048] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-14T20:10:11.205983] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T20:10:11.958064] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-14T20:10:12.732825] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T20:10:12.758024] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-14T20:10:12.789816] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T20:10:13.558061] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-14T20:10:14.275508] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T20:10:14.358040] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-14T20:10:14.499128] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T20:10:14.886321] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-14T20:10:15.158064] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-14T20:10:15.958050] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-14T20:10:16.051206] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:10:16.758065] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-14T20:10:17.470079] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T20:10:17.526049] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T20:10:17.558022] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-14T20:10:18.358040] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-14T20:10:18.500434] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T20:10:19.158051] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-14T20:10:19.963165] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-14T20:10:19.979853] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T20:10:20.497886] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T20:10:20.542934] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:10:20.544602] [INFO ] [REMOTE ] MHD: Full fetch complete (18366 records). [2025-10-14T20:10:20.544727] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-14T20:10:20.763251] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-14T20:10:20.904248] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-14T20:10:20.904315] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-14T20:10:20.904700] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-14T20:10:20.904758] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-14T20:10:20.905247] [DEBUG] [LOCAL ] MHD: Trimmed 18366 records to 12325 (keeping 200 days of data) [2025-10-14T20:10:20.976862] [DEBUG] [LOCAL ] MHD: Primary data saved (12325 records). [2025-10-14T20:10:20.976972] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-14T20:10:20.977042] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MHD took 26.7s. Estimated remaining: 2h 23m 38s. Rate: 7.1 symbols/min [2025-10-14T20:10:21.148044] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:21.148182] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-14T20:10:21.148218] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-14T20:10:21.148337] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-14T20:10:21.148406] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-14T20:10:21.148467] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-14T20:10:21.148528] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-14T20:10:21.502059] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:21.558030] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-14T20:10:21.567864] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T20:10:21.569425] [INFO ] [REMOTE ] MHF: Full fetch complete (12774 records). [2025-10-14T20:10:21.569494] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-14T20:10:21.904043] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-14T20:10:21.928767] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-14T20:10:21.928817] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-14T20:10:21.929099] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-14T20:10:21.929135] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-14T20:10:21.929551] [DEBUG] [LOCAL ] MHF: Trimmed 12774 records to 8845 (keeping 200 days of data) [2025-10-14T20:10:21.978231] [DEBUG] [LOCAL ] MHF: Primary data saved (8845 records). [2025-10-14T20:10:21.978325] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-14T20:10:21.978396] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MHF took 26.6s. Estimated remaining: 2h 23m 24s. Rate: 7.1 symbols/min [2025-10-14T20:10:22.144629] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:22.153989] [DEBUG] [LOCAL ] MHN: Loaded 7534 existing records from primary storage. [2025-10-14T20:10:22.154164] [INFO ] [MAIN ] MHN: Loaded 7534 existing records. [2025-10-14T20:10:22.327870] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:10:22.328017] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-14T20:10:22.328062] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-14T20:10:22.328193] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-14T20:10:22.328231] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-14T20:10:22.363214] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-14T20:10:22.675843] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:22.763042] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T20:10:23.158087] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-14T20:10:23.901064] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T20:10:23.958106] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-14T20:10:24.736313] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T20:10:24.758113] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-14T20:10:25.487199] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T20:10:25.558040] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-14T20:10:26.266496] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T20:10:26.358073] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-14T20:10:27.158095] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-14T20:10:27.958084] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-14T20:10:27.990506] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T20:10:28.022414] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T20:10:28.202235] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-14T20:10:28.758096] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-14T20:10:29.095089] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-14T20:10:29.558097] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-14T20:10:30.358151] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-14T20:10:30.787288] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-14T20:10:31.083827] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T20:10:31.158097] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-14T20:10:31.735709] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T20:10:31.958194] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-14T20:10:32.315555] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T20:10:32.758096] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-14T20:10:33.001619] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-14T20:10:33.558108] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-14T20:10:34.244459] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T20:10:34.358070] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-14T20:10:35.158075] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-14T20:10:35.471562] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-14T20:10:35.912689] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T20:10:35.958073] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-14T20:10:36.758120] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-14T20:10:37.558073] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-14T20:10:37.613296] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T20:10:38.013947] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T20:10:38.237297] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T20:10:38.358075] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-14T20:10:38.709007] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-14T20:10:39.158075] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-14T20:10:39.521904] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-14T20:10:39.522553] [INFO ] [REMOTE ] MHLA: Full fetch complete (1499 records). [2025-10-14T20:10:39.522618] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-14T20:10:39.701876] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-14T20:10:39.702066] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:10:39.702133] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:10:39.702189] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-14T20:10:39.702244] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-14T20:10:39.702288] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-14T20:10:39.702332] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-14T20:10:39.702389] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MHLA took 18.7s. Estimated remaining: 2h 23m 22s. Rate: 7.1 symbols/min [2025-10-14T20:10:39.875732] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:39.900425] [DEBUG] [LOCAL ] MHO: Loaded 23748 existing records from primary storage. [2025-10-14T20:10:39.900710] [INFO ] [MAIN ] MHO: Loaded 23748 existing records. [2025-10-14T20:10:39.963238] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-14T20:10:40.088696] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:10:40.088877] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-14T20:10:40.088943] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-14T20:10:40.089284] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-14T20:10:40.089360] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-14T20:10:40.455174] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:40.743477] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T20:10:40.758028] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-14T20:10:41.558062] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-14T20:10:42.324598] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T20:10:42.326181] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T20:10:42.358030] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-14T20:10:43.063611] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T20:10:43.158057] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-14T20:10:43.762227] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:10:43.763457] [INFO ] [REMOTE ] MHN: Full fetch complete (11597 records). [2025-10-14T20:10:43.763523] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-14T20:10:43.967368] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-14T20:10:44.131128] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-14T20:10:44.131201] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-14T20:10:44.131472] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-14T20:10:44.131517] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-14T20:10:44.131989] [DEBUG] [LOCAL ] MHN: Trimmed 11597 records to 7527 (keeping 200 days of data) [2025-10-14T20:10:44.176314] [DEBUG] [LOCAL ] MHN: Primary data saved (7527 records). [2025-10-14T20:10:44.176447] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-14T20:10:44.176527] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MHN took 22.2s. Estimated remaining: 2h 23m 11s. Rate: 7.1 symbols/min [2025-10-14T20:10:44.353263] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:44.353418] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-14T20:10:44.353459] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-14T20:10:44.353568] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-14T20:10:44.353609] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-14T20:10:44.353675] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-14T20:10:44.353727] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-14T20:10:44.710907] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:44.758029] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-14T20:10:45.410428] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T20:10:45.558065] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-14T20:10:45.749326] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:10:45.749673] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-14T20:10:45.749761] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:10:45.749811] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-14T20:10:45.749873] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:10:45.749956] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-14T20:10:45.750069] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-14T20:10:45.750152] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-14T20:10:45.750204] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-14T20:10:45.750252] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MIAX took 1.6s. Estimated remaining: 2h 22m 57s. Rate: 7.1 symbols/min [2025-10-14T20:10:45.936206] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:45.952761] [DEBUG] [LOCAL ] MIN: Loaded 13831 existing records from primary storage. [2025-10-14T20:10:45.953015] [INFO ] [MAIN ] MIN: Loaded 13831 existing records. [2025-10-14T20:10:46.148180] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:10:46.148392] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-14T20:10:46.148439] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-14T20:10:46.148726] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-14T20:10:46.148784] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-14T20:10:46.368701] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-14T20:10:46.525319] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:46.636790] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T20:10:47.158095] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-14T20:10:47.822078] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T20:10:47.958066] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-14T20:10:48.758118] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-14T20:10:48.904483] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:10:49.280111] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T20:10:49.310620] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T20:10:49.558064] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-14T20:10:50.358084] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-14T20:10:51.158086] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-14T20:10:51.234167] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T20:10:51.809174] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T20:10:51.813889] [INFO ] [REMOTE ] MHK: Full fetch complete (61021 records). [2025-10-14T20:10:51.814004] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-14T20:10:51.963244] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-14T20:10:52.215319] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-14T20:10:52.215391] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-14T20:10:52.216470] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-14T20:10:52.216532] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-14T20:10:52.217821] [DEBUG] [LOCAL ] MHK: Trimmed 61021 records to 42126 (keeping 200 days of data) [2025-10-14T20:10:52.443800] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T20:10:52.461999] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T20:10:52.505387] [DEBUG] [LOCAL ] MHK: Primary data saved (42126 records). [2025-10-14T20:10:52.505492] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-14T20:10:52.505578] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHK took 57.0s. Estimated remaining: 2h 22m 48s. Rate: 7.1 symbols/min [2025-10-14T20:10:52.697082] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:52.741791] [DEBUG] [LOCAL ] MIR: Loaded 51221 existing records from primary storage. [2025-10-14T20:10:52.742102] [INFO ] [MAIN ] MIR: Loaded 51221 existing records. [2025-10-14T20:10:52.763246] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-14T20:10:52.921001] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:10:52.921175] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-14T20:10:52.921221] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-14T20:10:52.922022] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-14T20:10:52.922078] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-14T20:10:53.269176] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:53.558049] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-14T20:10:54.358041] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-14T20:10:54.503673] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T20:10:54.509469] [INFO ] [REMOTE ] MGY: Full fetch complete (75926 records). [2025-10-14T20:10:54.509568] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-14T20:10:54.902930] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-14T20:10:54.903054] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-14T20:10:54.904173] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-14T20:10:54.904290] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-14T20:10:54.905729] [DEBUG] [LOCAL ] MGY: Trimmed 75926 records to 52419 (keeping 200 days of data) [2025-10-14T20:10:55.119264] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:10:55.188708] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-14T20:10:55.239562] [DEBUG] [LOCAL ] MGY: Primary data saved (52419 records). [2025-10-14T20:10:55.239691] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-14T20:10:55.239795] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MGY took 1m 5s. Estimated remaining: 2h 22m 35s. Rate: 7.1 symbols/min [2025-10-14T20:10:55.431729] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:10:55.443292] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-14T20:10:55.443661] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-14T20:10:55.445052] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T20:10:55.444031] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-14T20:10:55.455404] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-14T20:10:55.455506] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-14T20:10:55.455554] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-14T20:10:55.808077] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:10:55.942471] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T20:10:55.958027] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-14T20:10:56.290042] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-14T20:10:56.758142] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-14T20:10:57.558054] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-14T20:10:57.925119] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T20:10:58.356989] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T20:10:58.361804] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-14T20:10:59.137840] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T20:10:59.158048] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-14T20:10:59.963173] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-14T20:10:59.966368] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T20:11:00.758061] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-14T20:11:01.558083] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-14T20:11:01.772304] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T20:11:01.802236] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T20:11:01.918703] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T20:11:02.358058] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-14T20:11:03.158046] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-14T20:11:03.394596] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T20:11:03.524633] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-14T20:11:03.958082] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-14T20:11:04.758060] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-14T20:11:05.076897] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T20:11:05.558092] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-14T20:11:05.754395] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T20:11:06.358071] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-14T20:11:06.899597] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T20:11:07.158072] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-14T20:11:07.963625] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-14T20:11:07.966337] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T20:11:08.468810] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T20:11:08.511432] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T20:11:08.758093] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-14T20:11:09.550632] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T20:11:09.558021] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-14T20:11:10.358061] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-14T20:11:10.496430] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-14T20:11:10.498949] [INFO ] [REMOTE ] MIN: Full fetch complete (18074 records). [2025-10-14T20:11:10.499024] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-14T20:11:10.870661] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-14T20:11:10.870762] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-14T20:11:10.871158] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-14T20:11:10.871199] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-14T20:11:10.871802] [DEBUG] [LOCAL ] MIN: Trimmed 18074 records to 13860 (keeping 200 days of data) [2025-10-14T20:11:10.953218] [DEBUG] [LOCAL ] MIN: Primary data saved (13860 records). [2025-10-14T20:11:10.953359] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-14T20:11:10.953437] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MIN took 25.2s. Estimated remaining: 2h 22m 32s. Rate: 7.1 symbols/min [2025-10-14T20:11:11.158098] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-14T20:11:11.340741] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T20:11:11.958095] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-14T20:11:12.758041] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-14T20:11:12.812836] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T20:11:13.031993] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T20:11:13.034794] [INFO ] [REMOTE ] MHO: Full fetch complete (36677 records). [2025-10-14T20:11:13.034876] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-14T20:11:13.345786] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T20:11:13.433464] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-14T20:11:13.433533] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-14T20:11:13.434343] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-14T20:11:13.434407] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-14T20:11:13.435238] [DEBUG] [LOCAL ] MHO: Trimmed 36677 records to 23765 (keeping 200 days of data) [2025-10-14T20:11:13.558719] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-14T20:11:13.581625] [DEBUG] [LOCAL ] MHO: Primary data saved (23765 records). [2025-10-14T20:11:13.582040] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-14T20:11:13.582138] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MHO took 33.9s. Estimated remaining: 2h 22m 19s. Rate: 7.1 symbols/min [2025-10-14T20:11:13.997714] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T20:11:14.358096] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-14T20:11:15.158102] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-14T20:11:15.519609] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T20:11:15.943129] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T20:11:15.958026] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-14T20:11:16.758079] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-14T20:11:17.089682] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T20:11:17.558129] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-14T20:11:17.715786] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T20:11:17.992762] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T20:11:18.358097] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-14T20:11:18.694062] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T20:11:19.158126] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-14T20:11:19.958100] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-14T20:11:20.442272] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T20:11:20.443276] [INFO ] [REMOTE ] MITN: Full fetch complete (2360 records). [2025-10-14T20:11:20.443357] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-14T20:11:20.638023] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T20:11:20.638295] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:11:20.638435] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:11:20.638507] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-14T20:11:20.638571] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-14T20:11:20.638606] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-14T20:11:20.638686] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-14T20:11:20.638761] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MITN took 25.4s. Estimated remaining: 2h 22m 10s. Rate: 7.1 symbols/min [2025-10-14T20:11:20.849551] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T20:11:20.860187] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-14T20:11:22.666818] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T20:11:22.678102] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-14T20:11:24.315588] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T20:11:24.327460] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-14T20:11:26.169043] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T20:11:26.180852] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-14T20:11:27.993271] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T20:11:27.999168] [INFO ] [REMOTE ] MIR: Full fetch complete (73747 records). [2025-10-14T20:11:27.999290] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-14T20:11:28.388597] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-14T20:11:28.388880] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-14T20:11:28.390057] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-14T20:11:28.390121] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-14T20:11:28.391696] [DEBUG] [LOCAL ] MIR: Trimmed 73747 records to 51242 (keeping 200 days of data) [2025-10-14T20:11:28.682900] [DEBUG] [LOCAL ] MIR: Primary data saved (51242 records). [2025-10-14T20:11:28.683034] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-14T20:11:28.683111] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MIR took 36.2s. Estimated remaining: 2h 22m 1s. Rate: 7.1 symbols/min [2025-10-14T20:11:29.307531] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:29.384567] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:29.432443] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:29.459750] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:29.468471] [DEBUG] [LOCAL ] MITP: Loaded 2330 existing records from primary storage. [2025-10-14T20:11:29.468861] [INFO ] [MAIN ] MITP: Loaded 2330 existing records. [2025-10-14T20:11:29.486338] [DEBUG] [LOCAL ] MIY: Loaded 6239 existing records from primary storage. [2025-10-14T20:11:29.536470] [INFO ] [MAIN ] MIY: Loaded 6239 existing records. [2025-10-14T20:11:29.689349] [DEBUG] [LOCAL ] MITT: Loaded 22766 existing records from primary storage. [2025-10-14T20:11:29.749957] [INFO ] [MAIN ] MITT: Loaded 22766 existing records. [2025-10-14T20:11:29.869333] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:29.913753] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-14T20:11:29.965480] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-14T20:11:30.031034] [DEBUG] [LOCAL ] MKC: Loaded 52521 existing records from primary storage. [2025-10-14T20:11:30.009979] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-14T20:11:30.031320] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-14T20:11:30.066579] [INFO ] [MAIN ] MKC: Loaded 52521 existing records. [2025-10-14T20:11:30.055301] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:30.092626] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-14T20:11:30.101713] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-14T20:11:30.150975] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-14T20:11:30.156595] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-14T20:11:30.181161] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:30.299053] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-14T20:11:30.344154] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-14T20:11:30.432488] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-14T20:11:30.450742] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-14T20:11:30.861807] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:30.875349] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-14T20:11:30.952479] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-14T20:11:31.087030] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-14T20:11:31.103325] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:31.100469] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-14T20:11:31.125545] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-14T20:11:31.369100] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:31.416810] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-14T20:11:31.660404] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:31.682980] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-14T20:11:31.761888] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:31.762131] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-14T20:11:31.808316] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T20:11:31.810198] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-14T20:11:32.242896] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T20:11:32.245294] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T20:11:32.248112] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-14T20:11:32.249315] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-14T20:11:32.664846] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-14T20:11:32.666032] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-14T20:11:32.910800] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T20:11:32.912624] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-14T20:11:33.036572] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T20:11:33.044229] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-14T20:11:33.147243] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T20:11:33.150431] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-14T20:11:33.148975] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T20:11:33.161874] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-14T20:11:33.344738] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T20:11:33.475979] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-14T20:11:33.558094] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-14T20:11:34.203316] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T20:11:34.262507] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T20:11:34.358095] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-14T20:11:34.490344] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T20:11:34.681735] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-14T20:11:35.158075] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-14T20:11:35.568160] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T20:11:35.958064] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-14T20:11:36.443249] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-14T20:11:36.758071] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-14T20:11:37.558056] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-14T20:11:37.976835] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-14T20:11:38.358038] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-14T20:11:38.470813] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T20:11:38.752794] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-14T20:11:39.158074] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-14T20:11:39.958070] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-14T20:11:40.539531] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T20:11:40.758052] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-14T20:11:40.948336] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T20:11:41.412587] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T20:11:41.558085] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-14T20:11:41.978243] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T20:11:42.358079] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-14T20:11:43.047786] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T20:11:43.158097] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-14T20:11:43.958060] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-14T20:11:44.321905] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:11:44.421345] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T20:11:44.422111] [INFO ] [REMOTE ] MITP: Full fetch complete (3277 records). [2025-10-14T20:11:44.422178] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-14T20:11:44.763171] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-14T20:11:44.807090] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-14T20:11:44.807172] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-14T20:11:44.807304] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-14T20:11:44.807343] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-14T20:11:44.807758] [DEBUG] [LOCAL ] MITP: Trimmed 3277 records to 2327 (keeping 200 days of data) [2025-10-14T20:11:44.822767] [DEBUG] [LOCAL ] MITP: Primary data saved (2327 records). [2025-10-14T20:11:44.822896] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-14T20:11:44.822982] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MITP took 16.1s. Estimated remaining: 2h 21m 58s. Rate: 7.1 symbols/min [2025-10-14T20:11:44.994157] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:45.026272] [DEBUG] [LOCAL ] MKL: Loaded 34005 existing records from primary storage. [2025-10-14T20:11:45.026547] [INFO ] [MAIN ] MKL: Loaded 34005 existing records. [2025-10-14T20:11:45.199418] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:45.199623] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-14T20:11:45.199702] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-14T20:11:45.200558] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-14T20:11:45.200614] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-14T20:11:45.555292] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:45.558063] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-14T20:11:46.358080] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-14T20:11:46.861568] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-14T20:11:46.893128] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T20:11:47.102928] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T20:11:47.158064] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-14T20:11:47.958075] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-14T20:11:48.367365] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-14T20:11:48.367220] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T20:11:48.758058] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-14T20:11:49.371827] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-14T20:11:49.558044] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-14T20:11:50.358097] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-14T20:11:50.717035] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T20:11:51.158055] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-14T20:11:51.740621] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T20:11:51.958050] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-14T20:11:52.252552] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T20:11:52.758109] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-14T20:11:53.356372] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:11:53.454300] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:11:53.455681] [INFO ] [REMOTE ] MIY: Full fetch complete (9029 records). [2025-10-14T20:11:53.455749] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-14T20:11:53.563170] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-14T20:11:53.849501] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-14T20:11:53.849574] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-14T20:11:53.849815] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-14T20:11:53.849875] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-14T20:11:53.850297] [DEBUG] [LOCAL ] MIY: Trimmed 9029 records to 6234 (keeping 200 days of data) [2025-10-14T20:11:53.889073] [DEBUG] [LOCAL ] MIY: Primary data saved (6234 records). [2025-10-14T20:11:53.889212] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-14T20:11:53.889290] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MIY took 25.2s. Estimated remaining: 2h 21m 50s. Rate: 7.1 symbols/min [2025-10-14T20:11:54.056149] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:54.093011] [DEBUG] [LOCAL ] MLI: Loaded 43523 existing records from primary storage. [2025-10-14T20:11:54.093340] [INFO ] [MAIN ] MLI: Loaded 43523 existing records. [2025-10-14T20:11:54.267471] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:54.267772] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-14T20:11:54.267833] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-14T20:11:54.268509] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-14T20:11:54.268566] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-14T20:11:54.363145] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-14T20:11:54.635688] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:54.651155] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T20:11:55.158105] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-14T20:11:55.769879] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T20:11:55.862704] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T20:11:55.958053] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-14T20:11:56.758100] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-14T20:11:57.088018] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T20:11:57.090948] [INFO ] [REMOTE ] MITT: Full fetch complete (34118 records). [2025-10-14T20:11:57.091042] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-14T20:11:57.475518] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-14T20:11:57.475609] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-14T20:11:57.476312] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-14T20:11:57.476361] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-14T20:11:57.477078] [DEBUG] [LOCAL ] MITT: Trimmed 34118 records to 22725 (keeping 200 days of data) [2025-10-14T20:11:57.561520] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-14T20:11:57.613669] [DEBUG] [LOCAL ] MITT: Primary data saved (22725 records). [2025-10-14T20:11:57.613782] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-14T20:11:57.613853] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MITT took 28.9s. Estimated remaining: 2h 21m 38s. Rate: 7.1 symbols/min [2025-10-14T20:11:57.782978] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:11:57.808859] [DEBUG] [LOCAL ] MLM: Loaded 29307 existing records from primary storage. [2025-10-14T20:11:57.809106] [INFO ] [MAIN ] MLM: Loaded 29307 existing records. [2025-10-14T20:11:57.989736] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:11:57.989931] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-14T20:11:57.989977] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-14T20:11:57.990558] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-14T20:11:57.990614] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-14T20:11:58.371109] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-14T20:11:58.376354] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:11:58.404359] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T20:11:58.968140] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T20:11:59.158075] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-14T20:11:59.818470] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T20:11:59.958040] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-14T20:12:00.633790] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T20:12:00.758031] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-14T20:12:01.272325] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T20:12:01.558058] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-14T20:12:02.358078] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-14T20:12:02.529754] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T20:12:03.023374] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T20:12:03.158096] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-14T20:12:03.958050] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-14T20:12:04.286438] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T20:12:04.758126] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-14T20:12:04.812946] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T20:12:05.274044] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T20:12:05.558067] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-14T20:12:06.163576] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T20:12:06.358082] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-14T20:12:06.928208] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T20:12:07.158073] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-14T20:12:07.416211] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T20:12:07.958068] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-14T20:12:08.697333] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T20:12:08.758045] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-14T20:12:09.347922] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T20:12:09.558065] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-14T20:12:10.358147] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-14T20:12:10.460870] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T20:12:11.158047] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-14T20:12:11.313521] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T20:12:11.863756] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T20:12:11.958025] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-14T20:12:12.595997] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T20:12:12.758066] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-14T20:12:13.564212] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-14T20:12:13.579790] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T20:12:14.358071] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-14T20:12:14.578162] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T20:12:15.141301] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T20:12:15.158027] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-14T20:12:15.958041] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-14T20:12:16.004861] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T20:12:16.743556] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T20:12:16.758028] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-14T20:12:17.558103] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-14T20:12:17.697633] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T20:12:17.703568] [INFO ] [REMOTE ] MKC: Full fetch complete (75909 records). [2025-10-14T20:12:17.703702] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-14T20:12:18.106740] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-14T20:12:18.106837] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-14T20:12:18.108048] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-14T20:12:18.108113] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-14T20:12:18.110436] [DEBUG] [LOCAL ] MKC: Trimmed 75909 records to 52523 (keeping 200 days of data) [2025-10-14T20:12:18.361888] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-14T20:12:18.451284] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T20:12:18.480571] [DEBUG] [LOCAL ] MKC: Primary data saved (52523 records). [2025-10-14T20:12:18.480720] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-14T20:12:18.480805] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MKC took 49.8s. Estimated remaining: 2h 21m 39s. Rate: 7.1 symbols/min [2025-10-14T20:12:18.657131] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:12:18.682153] [DEBUG] [LOCAL ] MLNK: Loaded 26227 existing records from primary storage. [2025-10-14T20:12:18.682428] [INFO ] [MAIN ] MLNK: Loaded 26227 existing records. [2025-10-14T20:12:18.873147] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:12:18.873486] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-14T20:12:18.873601] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-14T20:12:18.880961] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-14T20:12:18.892926] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-14T20:12:18.899310] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T20:12:19.164166] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-14T20:12:19.271418] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:12:19.795677] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T20:12:19.958066] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-14T20:12:20.758071] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-14T20:12:21.019666] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T20:12:21.303043] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T20:12:21.306893] [INFO ] [REMOTE ] MKL: Full fetch complete (49790 records). [2025-10-14T20:12:21.306975] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-14T20:12:21.563756] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-14T20:12:21.693805] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-14T20:12:21.693888] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-14T20:12:21.694771] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-14T20:12:21.694833] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-14T20:12:21.695908] [DEBUG] [LOCAL ] MKL: Trimmed 49790 records to 34026 (keeping 200 days of data) [2025-10-14T20:12:21.910989] [DEBUG] [LOCAL ] MKL: Primary data saved (34026 records). [2025-10-14T20:12:21.911138] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-14T20:12:21.911218] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MKL took 37.1s. Estimated remaining: 2h 21m 27s. Rate: 7.1 symbols/min [2025-10-14T20:12:22.097249] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:12:22.109131] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T20:12:22.119764] [DEBUG] [LOCAL ] MLP: Loaded 3050 existing records from primary storage. [2025-10-14T20:12:22.120014] [INFO ] [MAIN ] MLP: Loaded 3050 existing records. [2025-10-14T20:12:22.318294] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:12:22.318512] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-14T20:12:22.318561] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-14T20:12:22.318782] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-14T20:12:22.318841] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-14T20:12:22.366466] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-14T20:12:22.718111] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:12:22.835374] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T20:12:22.840247] [INFO ] [REMOTE ] MLI: Full fetch complete (63165 records). [2025-10-14T20:12:22.840385] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-14T20:12:23.163305] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-14T20:12:23.239556] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-14T20:12:23.239636] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-14T20:12:23.240698] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-14T20:12:23.240758] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-14T20:12:23.242091] [DEBUG] [LOCAL ] MLI: Trimmed 63165 records to 43535 (keeping 200 days of data) [2025-10-14T20:12:23.529146] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-14T20:12:23.541821] [DEBUG] [LOCAL ] MLI: Primary data saved (43535 records). [2025-10-14T20:12:23.542291] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-14T20:12:23.542772] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MLI took 29.7s. Estimated remaining: 2h 21m 13s. Rate: 7.1 symbols/min [2025-10-14T20:12:23.721373] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:12:23.734439] [DEBUG] [LOCAL ] MLR: Loaded 12481 existing records from primary storage. [2025-10-14T20:12:23.734688] [INFO ] [MAIN ] MLR: Loaded 12481 existing records. [2025-10-14T20:12:23.842708] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T20:12:23.931975] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:12:23.932261] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-14T20:12:23.932318] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-14T20:12:23.932639] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-14T20:12:23.932725] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-14T20:12:23.963196] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-14T20:12:24.288791] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:12:24.605204] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T20:12:24.758068] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-14T20:12:25.558052] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-14T20:12:26.040308] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T20:12:26.061799] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T20:12:26.358078] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-14T20:12:27.158083] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-14T20:12:27.571807] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T20:12:27.958045] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-14T20:12:28.273810] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T20:12:28.758069] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-14T20:12:28.769363] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T20:12:29.558069] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-14T20:12:29.850141] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T20:12:30.358107] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-14T20:12:30.805451] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T20:12:30.808496] [INFO ] [REMOTE ] MLM: Full fetch complete (45227 records). [2025-10-14T20:12:30.808576] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-14T20:12:31.163321] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-14T20:12:31.211536] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-14T20:12:31.211629] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-14T20:12:31.212567] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-14T20:12:31.212624] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-14T20:12:31.213532] [DEBUG] [LOCAL ] MLM: Trimmed 45227 records to 29280 (keeping 200 days of data) [2025-10-14T20:12:31.404058] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T20:12:31.421956] [DEBUG] [LOCAL ] MLM: Primary data saved (29280 records). [2025-10-14T20:12:31.422108] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-14T20:12:31.422198] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MLM took 33.8s. Estimated remaining: 2h 21m 4s. Rate: 7.1 symbols/min [2025-10-14T20:12:31.596174] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:12:31.642714] [DEBUG] [LOCAL ] MMC: Loaded 51918 existing records from primary storage. [2025-10-14T20:12:31.643110] [INFO ] [MAIN ] MMC: Loaded 51918 existing records. [2025-10-14T20:12:31.840089] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:12:31.840363] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-14T20:12:31.840414] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-14T20:12:31.841519] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-14T20:12:31.841577] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-14T20:12:31.963253] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-14T20:12:32.174753] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T20:12:32.241310] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:12:32.465624] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T20:12:32.758066] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-14T20:12:33.558081] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-14T20:12:34.358134] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-14T20:12:34.369585] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T20:12:34.477297] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T20:12:34.960358] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-14T20:12:35.158074] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-14T20:12:35.958102] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-14T20:12:36.324988] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T20:12:36.758106] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-14T20:12:37.558066] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-14T20:12:37.564983] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T20:12:37.863872] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T20:12:38.358041] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-14T20:12:38.591257] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T20:12:39.158090] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-14T20:12:39.958149] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-14T20:12:40.164718] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T20:12:40.758117] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-14T20:12:40.907280] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-14T20:12:41.373850] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T20:12:41.518516] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (3.16 seconds). [2025-10-14T20:12:41.558038] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-14T20:12:42.358119] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-14T20:12:43.097236] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:12:43.158109] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-14T20:12:43.443320] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T20:12:43.958055] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-14T20:12:44.189850] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T20:12:44.758120] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-14T20:12:45.232450] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T20:12:45.558079] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-14T20:12:45.740708] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T20:12:46.109343] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T20:12:46.358055] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-14T20:12:46.948201] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T20:12:46.949115] [INFO ] [REMOTE ] MLP: Full fetch complete (4447 records). [2025-10-14T20:12:46.949185] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-14T20:12:47.164672] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-14T20:12:47.319211] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-14T20:12:47.319290] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-14T20:12:47.319434] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-14T20:12:47.319473] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-14T20:12:47.319865] [DEBUG] [LOCAL ] MLP: Trimmed 4447 records to 3066 (keeping 200 days of data) [2025-10-14T20:12:47.337431] [DEBUG] [LOCAL ] MLP: Primary data saved (3066 records). [2025-10-14T20:12:47.337540] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-14T20:12:47.337669] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MLP took 25.4s. Estimated remaining: 2h 21m 1s. Rate: 7.1 symbols/min [2025-10-14T20:12:47.505368] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:12:47.516951] [DEBUG] [LOCAL ] MMD: Loaded 10880 existing records from primary storage. [2025-10-14T20:12:47.517181] [INFO ] [MAIN ] MMD: Loaded 10880 existing records. [2025-10-14T20:12:47.715167] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:12:47.715394] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-14T20:12:47.715451] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-14T20:12:47.715787] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-14T20:12:47.715847] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-14T20:12:47.958898] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-14T20:12:48.132219] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:12:48.144843] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T20:12:48.758086] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-14T20:12:49.558033] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-14T20:12:49.766008] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T20:12:49.766968] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T20:12:50.358062] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-14T20:12:50.898339] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T20:12:51.137438] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T20:12:51.158026] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-14T20:12:51.958087] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-14T20:12:52.009938] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T20:12:52.758057] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-14T20:12:52.892030] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T20:12:53.558061] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-14T20:12:54.358089] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-14T20:12:54.440382] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T20:12:54.869100] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T20:12:55.158023] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-14T20:12:55.232004] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T20:12:55.958052] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-14T20:12:56.513290] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T20:12:56.758073] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-14T20:12:57.558067] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-14T20:12:57.759878] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:12:58.089855] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-14T20:12:58.358050] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-14T20:12:58.480271] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T20:12:59.158061] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-14T20:12:59.958073] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-14T20:13:00.073452] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T20:13:00.175491] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T20:13:00.699441] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:13:00.701537] [INFO ] [REMOTE ] MLR: Full fetch complete (19039 records). [2025-10-14T20:13:00.701603] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-14T20:13:00.763188] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-14T20:13:01.071870] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-14T20:13:01.071960] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-14T20:13:01.072484] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-14T20:13:01.072546] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-14T20:13:01.073195] [DEBUG] [LOCAL ] MLR: Trimmed 19039 records to 12475 (keeping 200 days of data) [2025-10-14T20:13:01.150089] [DEBUG] [LOCAL ] MLR: Primary data saved (12475 records). [2025-10-14T20:13:01.150221] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-14T20:13:01.150300] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MLR took 37.6s. Estimated remaining: 2h 20m 57s. Rate: 7.1 symbols/min [2025-10-14T20:13:01.323506] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:01.338255] [DEBUG] [LOCAL ] MMI: Loaded 15401 existing records from primary storage. [2025-10-14T20:13:01.338461] [INFO ] [MAIN ] MMI: Loaded 15401 existing records. [2025-10-14T20:13:01.517307] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:13:01.517509] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-14T20:13:01.517562] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-14T20:13:01.517976] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-14T20:13:01.518032] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-14T20:13:01.563105] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-14T20:13:01.789014] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T20:13:01.915711] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:02.358063] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-14T20:13:02.922437] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T20:13:02.927383] [INFO ] [REMOTE ] MLNK: Full fetch complete (36721 records). [2025-10-14T20:13:02.927549] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-14T20:13:03.163923] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-14T20:13:03.468290] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-14T20:13:03.468381] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-14T20:13:03.469299] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-14T20:13:03.469365] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-14T20:13:03.470546] [DEBUG] [LOCAL ] MLNK: Trimmed 36721 records to 26497 (keeping 200 days of data) [2025-10-14T20:13:03.639608] [DEBUG] [LOCAL ] MLNK: Primary data saved (26497 records). [2025-10-14T20:13:03.639778] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-14T20:13:03.639866] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MLNK took 45.2s. Estimated remaining: 2h 20m 44s. Rate: 7.1 symbols/min [2025-10-14T20:13:03.847473] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:03.847756] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-14T20:13:03.847813] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-14T20:13:03.847937] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-14T20:13:03.847980] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-14T20:13:03.848021] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-14T20:13:03.848052] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-14T20:13:03.958106] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-14T20:13:04.214850] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:04.427604] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-14T20:13:04.451274] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T20:13:04.471591] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-14T20:13:04.758067] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-14T20:13:04.962677] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:13:04.963161] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-14T20:13:04.963261] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:13:04.963311] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-14T20:13:04.963372] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:13:04.963446] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-14T20:13:04.963546] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-14T20:13:04.963591] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-14T20:13:04.963629] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-14T20:13:04.963721] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MMID took 1.3s. Estimated remaining: 2h 20m 30s. Rate: 7.1 symbols/min [2025-10-14T20:13:05.134691] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:05.134871] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-14T20:13:05.134909] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-14T20:13:05.135016] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-14T20:13:05.135056] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-14T20:13:05.135094] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-14T20:13:05.135124] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-14T20:13:05.484821] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:05.558037] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-14T20:13:06.011140] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T20:13:06.358106] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-14T20:13:07.118362] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T20:13:07.158057] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-14T20:13:07.950920] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T20:13:07.958018] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-14T20:13:08.696861] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:13:08.758031] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-14T20:13:09.514980] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T20:13:09.558074] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-14T20:13:10.288879] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:13:10.294699] [INFO ] [REMOTE ] MMC: Full fetch complete (74972 records). [2025-10-14T20:13:10.294814] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-14T20:13:10.363154] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-14T20:13:10.708139] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-14T20:13:10.708213] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-14T20:13:10.709273] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-14T20:13:10.709333] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-14T20:13:10.710854] [DEBUG] [LOCAL ] MMC: Trimmed 74972 records to 51919 (keeping 200 days of data) [2025-10-14T20:13:11.028587] [DEBUG] [LOCAL ] MMC: Primary data saved (51919 records). [2025-10-14T20:13:11.028742] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-14T20:13:11.028824] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MMC took 39.6s. Estimated remaining: 2h 20m 20s. Rate: 7.1 symbols/min [2025-10-14T20:13:11.163130] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-14T20:13:11.219721] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:11.229769] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T20:13:11.280384] [DEBUG] [LOCAL ] MMM: Loaded 53123 existing records from primary storage. [2025-10-14T20:13:11.280771] [INFO ] [MAIN ] MMM: Loaded 53123 existing records. [2025-10-14T20:13:11.456024] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:13:11.456232] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-14T20:13:11.456277] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-14T20:13:11.457346] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-14T20:13:11.457406] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-14T20:13:11.805073] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:11.958080] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-14T20:13:12.011781] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T20:13:12.758054] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-14T20:13:13.523082] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T20:13:13.558030] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-14T20:13:13.722511] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T20:13:14.358051] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-14T20:13:14.501125] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:13:14.977349] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T20:13:14.978963] [INFO ] [REMOTE ] MMD: Full fetch complete (17361 records). [2025-10-14T20:13:14.979031] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-14T20:13:15.165629] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-14T20:13:15.350180] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-14T20:13:15.350257] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-14T20:13:15.350755] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-14T20:13:15.350816] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-14T20:13:15.351339] [DEBUG] [LOCAL ] MMD: Trimmed 17361 records to 10886 (keeping 200 days of data) [2025-10-14T20:13:15.417522] [DEBUG] [LOCAL ] MMD: Primary data saved (10886 records). [2025-10-14T20:13:15.417718] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-14T20:13:15.417814] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMD took 28.1s. Estimated remaining: 2h 20m 9s. Rate: 7.1 symbols/min [2025-10-14T20:13:15.587807] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:15.622166] [DEBUG] [LOCAL ] MMS: Loaded 33729 existing records from primary storage. [2025-10-14T20:13:15.622566] [INFO ] [MAIN ] MMS: Loaded 33729 existing records. [2025-10-14T20:13:15.808827] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:13:15.809028] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-14T20:13:15.809075] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-14T20:13:15.809685] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-14T20:13:15.809744] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-14T20:13:15.969926] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-14T20:13:16.170014] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:16.371377] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T20:13:16.758094] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-14T20:13:17.558067] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-14T20:13:18.220948] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-14T20:13:18.332436] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T20:13:18.365531] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-14T20:13:18.368330] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T20:13:19.123633] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T20:13:19.158035] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-14T20:13:19.958097] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-14T20:13:19.967738] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T20:13:20.758084] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-14T20:13:21.558090] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-14T20:13:21.947205] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T20:13:22.029734] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T20:13:22.358051] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-14T20:13:22.484120] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T20:13:23.158050] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-14T20:13:23.775507] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T20:13:23.958073] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-14T20:13:24.389511] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-14T20:13:24.758068] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-14T20:13:24.972952] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T20:13:25.265695] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T20:13:25.558066] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-14T20:13:26.358112] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-14T20:13:27.005502] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T20:13:27.030201] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T20:13:27.158080] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-14T20:13:27.958088] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-14T20:13:28.158120] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T20:13:28.365203] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T20:13:28.758062] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-14T20:13:29.558039] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-14T20:13:29.889249] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T20:13:30.133567] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T20:13:30.358071] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-14T20:13:31.158101] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-14T20:13:31.958033] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-14T20:13:32.428720] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-14T20:13:32.502302] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-14T20:13:32.521334] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T20:13:32.758051] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-14T20:13:33.558059] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-14T20:13:34.358078] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-14T20:13:34.483304] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T20:13:34.702200] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T20:13:35.158048] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-14T20:13:35.402405] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-14T20:13:35.846391] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:13:35.847254] [INFO ] [REMOTE ] MMKT: Full fetch complete (2120 records). [2025-10-14T20:13:35.847322] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-14T20:13:35.959856] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-14T20:13:36.040186] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T20:13:36.040366] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:13:36.040410] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:13:36.040449] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-14T20:13:36.040501] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-14T20:13:36.040534] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-14T20:13:36.040580] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-14T20:13:36.040632] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMKT took 31.1s. Estimated remaining: 2h 20m 9s. Rate: 7.1 symbols/min [2025-10-14T20:13:36.210994] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:36.221297] [DEBUG] [LOCAL ] MMT: Loaded 10402 existing records from primary storage. [2025-10-14T20:13:36.221493] [INFO ] [MAIN ] MMT: Loaded 10402 existing records. [2025-10-14T20:13:36.405095] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:13:36.405268] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-14T20:13:36.405321] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-14T20:13:36.405778] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-14T20:13:36.405845] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-14T20:13:36.768507] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-14T20:13:36.774046] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:37.306976] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T20:13:37.558055] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-14T20:13:37.574674] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T20:13:38.358075] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-14T20:13:39.158061] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-14T20:13:39.617433] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-14T20:13:39.656076] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T20:13:39.658557] [INFO ] [REMOTE ] MMI: Full fetch complete (21605 records). [2025-10-14T20:13:39.658632] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-14T20:13:39.963225] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-14T20:13:40.033249] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-14T20:13:40.033349] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-14T20:13:40.033886] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-14T20:13:40.033947] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-14T20:13:40.034575] [DEBUG] [LOCAL ] MMI: Trimmed 21605 records to 15459 (keeping 200 days of data) [2025-10-14T20:13:40.129673] [DEBUG] [LOCAL ] MMI: Primary data saved (15459 records). [2025-10-14T20:13:40.129874] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-14T20:13:40.129985] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMI took 39.0s. Estimated remaining: 2h 19m 58s. Rate: 7.1 symbols/min [2025-10-14T20:13:40.324448] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:40.322959] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-14T20:13:40.347678] [DEBUG] [LOCAL ] MMU: Loaded 16653 existing records from primary storage. [2025-10-14T20:13:40.347914] [INFO ] [MAIN ] MMU: Loaded 16653 existing records. [2025-10-14T20:13:40.527889] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:13:40.528090] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-14T20:13:40.528138] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-14T20:13:40.528508] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-14T20:13:40.528578] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-14T20:13:40.763168] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-14T20:13:40.901394] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:40.902498] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T20:13:41.558060] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-14T20:13:42.167827] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T20:13:42.358037] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-14T20:13:42.594146] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T20:13:43.158141] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-14T20:13:43.958050] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-14T20:13:43.981813] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T20:13:44.335063] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T20:13:44.758109] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-14T20:13:45.389470] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T20:13:45.558039] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-14T20:13:45.639901] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T20:13:46.358104] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-14T20:13:47.158077] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-14T20:13:47.455847] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T20:13:47.863603] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T20:13:47.867676] [INFO ] [REMOTE ] MMS: Full fetch complete (51559 records). [2025-10-14T20:13:47.867769] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-14T20:13:47.963199] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-14T20:13:48.191534] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:13:48.277370] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-14T20:13:48.277478] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-14T20:13:48.279295] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-14T20:13:48.279368] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-14T20:13:48.280580] [DEBUG] [LOCAL ] MMS: Trimmed 51559 records to 33783 (keeping 200 days of data) [2025-10-14T20:13:48.487218] [DEBUG] [LOCAL ] MMS: Primary data saved (33783 records). [2025-10-14T20:13:48.487344] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-14T20:13:48.487422] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMS took 33.1s. Estimated remaining: 2h 19m 49s. Rate: 7.1 symbols/min [2025-10-14T20:13:48.658095] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:13:48.680915] [DEBUG] [LOCAL ] MNR: Loaded 24761 existing records from primary storage. [2025-10-14T20:13:48.681158] [INFO ] [MAIN ] MNR: Loaded 24761 existing records. [2025-10-14T20:13:48.760588] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-14T20:13:48.790183] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T20:13:48.871403] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:13:48.871623] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-14T20:13:48.871708] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-14T20:13:48.872228] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-14T20:13:48.872284] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-14T20:13:49.223883] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:13:49.558040] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-14T20:13:49.718551] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T20:13:50.245400] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T20:13:50.358060] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-14T20:13:51.158065] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-14T20:13:51.549179] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T20:13:51.958090] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-14T20:13:52.157473] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T20:13:52.758082] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-14T20:13:53.109236] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T20:13:53.558062] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-14T20:13:54.358035] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-14T20:13:54.479037] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T20:13:54.908457] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-14T20:13:55.148673] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T20:13:55.158025] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-14T20:13:55.958082] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-14T20:13:56.551466] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T20:13:56.758065] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-14T20:13:56.881286] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T20:13:57.558035] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-14T20:13:57.937772] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T20:13:58.148431] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T20:13:58.358086] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-14T20:13:59.125237] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:13:59.131774] [INFO ] [REMOTE ] MMM: Full fetch complete (77191 records). [2025-10-14T20:13:59.132045] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-14T20:13:59.163299] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-14T20:13:59.543986] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-14T20:13:59.544078] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-14T20:13:59.545225] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-14T20:13:59.545292] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-14T20:13:59.546854] [DEBUG] [LOCAL ] MMM: Trimmed 77191 records to 53116 (keeping 200 days of data) [2025-10-14T20:13:59.877929] [DEBUG] [LOCAL ] MMM: Primary data saved (53116 records). [2025-10-14T20:13:59.878060] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-14T20:13:59.878138] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMM took 48.8s. Estimated remaining: 2h 19m 43s. Rate: 7.1 symbols/min [2025-10-14T20:13:59.963237] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-14T20:14:00.070003] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:00.114467] [DEBUG] [LOCAL ] MNSO: Loaded 44187 existing records from primary storage. [2025-10-14T20:14:00.114820] [INFO ] [MAIN ] MNSO: Loaded 44187 existing records. [2025-10-14T20:14:00.295505] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:14:00.295750] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-14T20:14:00.295820] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-14T20:14:00.296678] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-14T20:14:00.296739] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-14T20:14:00.583415] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T20:14:00.675694] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:00.758029] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-14T20:14:01.166849] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T20:14:01.558057] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-14T20:14:02.358079] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-14T20:14:02.476607] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T20:14:02.483357] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T20:14:03.158058] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-14T20:14:03.581144] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T20:14:03.958088] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-14T20:14:04.106352] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T20:14:04.482735] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-14T20:14:04.758066] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-14T20:14:05.558043] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-14T20:14:05.767678] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T20:14:06.358038] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-14T20:14:06.511375] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T20:14:06.513939] [INFO ] [REMOTE ] MMU: Full fetch complete (25159 records). [2025-10-14T20:14:06.514013] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-14T20:14:06.890735] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-14T20:14:06.890817] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-14T20:14:06.891438] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-14T20:14:06.891477] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-14T20:14:06.892130] [DEBUG] [LOCAL ] MMU: Trimmed 25159 records to 16581 (keeping 200 days of data) [2025-10-14T20:14:06.993762] [DEBUG] [LOCAL ] MMU: Primary data saved (16581 records). [2025-10-14T20:14:06.993906] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-14T20:14:06.993990] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MMU took 26.9s. Estimated remaining: 2h 19m 33s. Rate: 7.1 symbols/min [2025-10-14T20:14:07.081427] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T20:14:07.167045] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-14T20:14:07.189868] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:07.190111] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-14T20:14:07.190157] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-14T20:14:07.190267] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-14T20:14:07.190308] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-14T20:14:07.190351] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-14T20:14:07.190384] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-14T20:14:07.550295] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:07.663547] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-14T20:14:07.958065] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-14T20:14:08.163839] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:14:08.164074] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-14T20:14:08.164173] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:14:08.164218] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-14T20:14:08.164250] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:14:08.164286] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-14T20:14:08.164361] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-14T20:14:08.164423] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-14T20:14:08.164502] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-14T20:14:08.164579] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MNTN took 1.2s. Estimated remaining: 2h 19m 20s. Rate: 7.1 symbols/min [2025-10-14T20:14:08.329751] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:08.329941] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-14T20:14:08.329978] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-14T20:14:08.330085] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-14T20:14:08.330124] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-14T20:14:08.330185] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-14T20:14:08.330218] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-14T20:14:08.701598] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:08.758046] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-14T20:14:09.558044] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-14T20:14:09.570758] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:14:09.572217] [INFO ] [REMOTE ] MMT: Full fetch complete (16052 records). [2025-10-14T20:14:09.572282] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-14T20:14:09.930960] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-14T20:14:09.931049] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-14T20:14:09.931387] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-14T20:14:09.931425] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-14T20:14:09.931935] [DEBUG] [LOCAL ] MMT: Trimmed 16052 records to 10364 (keeping 200 days of data) [2025-10-14T20:14:09.991075] [DEBUG] [LOCAL ] MMT: Primary data saved (10364 records). [2025-10-14T20:14:09.991199] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-14T20:14:09.991273] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MMT took 34.0s. Estimated remaining: 2h 19m 7s. Rate: 7.1 symbols/min [2025-10-14T20:14:10.160464] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:10.201019] [DEBUG] [LOCAL ] MOD: Loaded 44860 existing records from primary storage. [2025-10-14T20:14:10.201310] [INFO ] [MAIN ] MOD: Loaded 44860 existing records. [2025-10-14T20:14:10.371073] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-14T20:14:10.376426] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:14:10.377729] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-14T20:14:10.377801] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-14T20:14:10.378515] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-14T20:14:10.378688] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-14T20:14:10.729055] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:11.158048] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-14T20:14:11.206448] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T20:14:11.652831] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T20:14:11.958070] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-14T20:14:12.697700] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T20:14:12.758071] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-14T20:14:13.218297] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T20:14:13.558066] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-14T20:14:14.358051] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-14T20:14:14.410814] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T20:14:14.663723] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T20:14:15.164521] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-14T20:14:15.166483] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T20:14:15.958073] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-14T20:14:16.758059] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-14T20:14:16.988550] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T20:14:17.526102] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-14T20:14:17.558043] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-14T20:14:18.358087] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-14T20:14:18.569245] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T20:14:19.158104] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-14T20:14:19.898477] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-14T20:14:19.958115] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-14T20:14:20.161592] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T20:14:20.758122] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-14T20:14:20.816692] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T20:14:21.558067] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-14T20:14:21.802215] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T20:14:21.807146] [INFO ] [REMOTE ] MNR: Full fetch complete (36810 records). [2025-10-14T20:14:21.807341] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-14T20:14:22.269086] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-14T20:14:22.269263] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-14T20:14:22.270062] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-14T20:14:22.270170] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-14T20:14:22.300413] [DEBUG] [LOCAL ] MNR: Trimmed 36810 records to 24830 (keeping 200 days of data) [2025-10-14T20:14:22.302732] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-14T20:14:22.362632] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-14T20:14:22.464858] [DEBUG] [LOCAL ] MNR: Primary data saved (24830 records). [2025-10-14T20:14:22.464997] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-14T20:14:22.465078] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNR took 34.0s. Estimated remaining: 2h 19m 1s. Rate: 7.1 symbols/min [2025-10-14T20:14:22.636526] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:22.681312] [DEBUG] [LOCAL ] MODG: Loaded 51582 existing records from primary storage. [2025-10-14T20:14:22.681632] [INFO ] [MAIN ] MODG: Loaded 51582 existing records. [2025-10-14T20:14:22.857727] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:14:22.857995] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-14T20:14:22.858053] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-14T20:14:22.858777] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-14T20:14:22.858836] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-14T20:14:23.163313] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-14T20:14:23.218772] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:23.405112] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T20:14:23.958110] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-14T20:14:24.745975] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-14T20:14:24.758017] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-14T20:14:25.573247] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-14T20:14:25.576286] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-14T20:14:25.699159] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T20:14:26.361351] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-14T20:14:26.369025] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T20:14:27.158123] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-14T20:14:27.371422] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T20:14:27.958077] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-14T20:14:28.674144] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-14T20:14:28.758047] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-14T20:14:28.935790] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T20:14:29.229804] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T20:14:29.558074] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-14T20:14:30.358077] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-14T20:14:30.992829] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-14T20:14:31.163210] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-14T20:14:31.181732] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T20:14:31.877797] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T20:14:31.958124] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-14T20:14:32.758163] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-14T20:14:33.114603] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-14T20:14:33.211459] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T20:14:33.558075] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-14T20:14:34.006858] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T20:14:34.358144] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-14T20:14:35.140321] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T20:14:35.158057] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-14T20:14:35.964400] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-14T20:14:35.980699] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T20:14:36.758073] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-14T20:14:37.367590] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-14T20:14:37.558085] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-14T20:14:37.743403] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T20:14:38.358084] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-14T20:14:38.602236] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T20:14:39.158099] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-14T20:14:39.693392] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-14T20:14:39.958055] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-14T20:14:40.182217] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:14:40.758041] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-14T20:14:41.052764] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T20:14:41.057472] [INFO ] [REMOTE ] MOD: Full fetch complete (66294 records). [2025-10-14T20:14:41.057611] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-14T20:14:41.462400] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-14T20:14:41.462473] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-14T20:14:41.463472] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-14T20:14:41.463534] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-14T20:14:41.464763] [DEBUG] [LOCAL ] MOD: Trimmed 66294 records to 44823 (keeping 200 days of data) [2025-10-14T20:14:41.563116] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-14T20:14:41.710891] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T20:14:41.774256] [DEBUG] [LOCAL ] MOD: Primary data saved (44823 records). [2025-10-14T20:14:41.774374] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-14T20:14:41.774447] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MOD took 31.8s. Estimated remaining: 2h 19m 0s. Rate: 7.1 symbols/min [2025-10-14T20:14:41.943749] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:41.981711] [DEBUG] [LOCAL ] MOH: Loaded 42417 existing records from primary storage. [2025-10-14T20:14:41.981998] [INFO ] [MAIN ] MOH: Loaded 42417 existing records. [2025-10-14T20:14:42.164080] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:14:42.164352] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-14T20:14:42.164400] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-14T20:14:42.165149] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-14T20:14:42.165208] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-14T20:14:42.374389] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-14T20:14:42.524749] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:43.043593] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-14T20:14:43.158108] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-14T20:14:43.919559] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-14T20:14:43.958035] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-14T20:14:44.096886] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T20:14:44.102035] [INFO ] [REMOTE ] MNSO: Full fetch complete (64589 records). [2025-10-14T20:14:44.102151] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-14T20:14:44.495263] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-14T20:14:44.495505] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-14T20:14:44.496571] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-14T20:14:44.496857] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-14T20:14:44.517145] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T20:14:44.525446] [DEBUG] [LOCAL ] MNSO: Trimmed 64589 records to 44150 (keeping 200 days of data) [2025-10-14T20:14:44.629219] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:14:44.638090] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-14T20:14:44.639473] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-14T20:14:44.758619] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-14T20:14:44.941208] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T20:14:44.967938] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:14:44.968219] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:14:44.970757] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-14T20:14:44.971271] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-14T20:14:44.972390] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-14T20:14:44.973795] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-14T20:14:44.973933] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MO took 36.8s. Estimated remaining: 2h 18m 48s. Rate: 7.1 symbols/min [2025-10-14T20:14:45.193095] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:45.208142] [DEBUG] [LOCAL ] MNSO: Primary data saved (44150 records). [2025-10-14T20:14:45.208247] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-14T20:14:45.208323] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MNSO took 45.3s. Estimated remaining: 2h 18m 34s. Rate: 7.1 symbols/min [2025-10-14T20:14:45.394792] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:45.394989] [DEBUG] [LOCAL ] MOV: No existing data file found in primary storage. [2025-10-14T20:14:45.395033] [WARN ] [MAIN ] MOV: No existing data found, performing full refresh instead. [2025-10-14T20:14:45.395171] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-14T20:14:45.395238] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-14T20:14:45.395289] [DEBUG] [LOCAL ] MOV: No primary data file found to delete. [2025-10-14T20:14:45.395321] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-14T20:14:45.555932] [DEBUG] [LOCAL ] MOS: Loaded 53504 existing records from primary storage. [2025-10-14T20:14:45.561466] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-14T20:14:45.597434] [INFO ] [MAIN ] MOS: Loaded 53504 existing records. [2025-10-14T20:14:45.997588] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:46.002013] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:14:46.002801] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-14T20:14:46.002868] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-14T20:14:46.003901] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-14T20:14:46.003992] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-14T20:14:46.359684] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-14T20:14:46.363421] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:46.660313] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T20:14:47.070041] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T20:14:47.158063] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-14T20:14:47.433695] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T20:14:47.958100] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-14T20:14:48.758153] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-14T20:14:48.992211] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T20:14:49.558048] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-14T20:14:49.849456] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T20:14:50.223378] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T20:14:50.358029] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-14T20:14:51.158060] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-14T20:14:51.241575] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T20:14:51.524115] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T20:14:51.958073] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-14T20:14:52.758071] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-14T20:14:52.898548] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T20:14:53.180099] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-14T20:14:53.558096] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-14T20:14:54.367396] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-14T20:14:54.372770] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T20:14:54.538047] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T20:14:55.158068] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-14T20:14:55.862184] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T20:14:55.868604] [INFO ] [REMOTE ] MODG: Full fetch complete (74889 records). [2025-10-14T20:14:55.868803] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-14T20:14:55.963206] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-14T20:14:56.154111] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T20:14:56.308002] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-14T20:14:56.308097] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-14T20:14:56.309511] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-14T20:14:56.309591] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-14T20:14:56.311253] [DEBUG] [LOCAL ] MODG: Trimmed 74889 records to 51587 (keeping 200 days of data) [2025-10-14T20:14:56.603809] [DEBUG] [LOCAL ] MODG: Primary data saved (51587 records). [2025-10-14T20:14:56.603951] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-14T20:14:56.604043] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MODG took 34.1s. Estimated remaining: 2h 18m 27s. Rate: 7.1 symbols/min [2025-10-14T20:14:56.759509] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-14T20:14:56.783557] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:14:56.783758] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-10-14T20:14:56.783803] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-10-14T20:14:56.783911] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-14T20:14:56.783951] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-14T20:14:56.783990] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-14T20:14:56.784021] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-14T20:14:57.132966] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:14:57.558039] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-14T20:14:57.619058] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T20:14:58.358050] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-14T20:14:58.482316] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T20:14:59.158065] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-14T20:14:59.745322] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T20:14:59.958052] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-14T20:15:00.081534] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-14T20:15:00.758052] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-14T20:15:00.998119] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T20:15:01.558077] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-14T20:15:01.933254] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T20:15:02.358092] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-14T20:15:02.410435] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T20:15:03.158081] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-14T20:15:03.245426] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T20:15:03.958122] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-14T20:15:04.464763] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T20:15:04.758121] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-14T20:15:05.119490] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:15:05.170189] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-14T20:15:05.558070] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-14T20:15:06.358047] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-14T20:15:06.688512] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T20:15:06.721877] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T20:15:07.158108] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-14T20:15:07.958067] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-14T20:15:08.197624] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T20:15:08.758088] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-14T20:15:09.026680] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T20:15:09.040693] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T20:15:09.558113] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-14T20:15:10.358067] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-14T20:15:10.708080] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T20:15:11.158135] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-14T20:15:11.738923] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T20:15:11.933263] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T20:15:11.938874] [INFO ] [REMOTE ] MOH: Full fetch complete (59016 records). [2025-10-14T20:15:11.939002] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-14T20:15:11.963274] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-14T20:15:12.341473] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-14T20:15:12.341587] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-14T20:15:12.342557] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-14T20:15:12.342617] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-14T20:15:12.343822] [DEBUG] [LOCAL ] MOH: Trimmed 59016 records to 42497 (keeping 200 days of data) [2025-10-14T20:15:12.602722] [DEBUG] [LOCAL ] MOH: Primary data saved (42497 records). [2025-10-14T20:15:12.602854] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-14T20:15:12.602930] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MOH took 30.8s. Estimated remaining: 2h 18m 24s. Rate: 7.1 symbols/min [2025-10-14T20:15:12.767437] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-14T20:15:12.770126] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:15:12.777881] [DEBUG] [LOCAL ] MPA: Loaded 5337 existing records from primary storage. [2025-10-14T20:15:12.778090] [INFO ] [MAIN ] MPA: Loaded 5337 existing records. [2025-10-14T20:15:12.959122] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:15:12.959373] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-14T20:15:12.959428] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-14T20:15:12.959686] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-14T20:15:12.959745] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-14T20:15:13.321490] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:15:13.351325] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T20:15:13.533441] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T20:15:13.558044] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-14T20:15:14.013552] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-14T20:15:14.144716] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T20:15:14.358074] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-14T20:15:15.158072] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-14T20:15:15.958045] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-14T20:15:16.256480] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T20:15:16.582980] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-14T20:15:16.758061] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-14T20:15:17.558043] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-14T20:15:17.691234] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T20:15:18.039012] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-14T20:15:18.358114] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-14T20:15:19.158044] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-14T20:15:19.224888] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-14T20:15:19.248562] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:15:19.694707] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T20:15:19.958063] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-14T20:15:20.758107] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-14T20:15:20.979708] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T20:15:20.983280] [INFO ] [REMOTE ] MOV: Full fetch complete (30559 records). [2025-10-14T20:15:20.983393] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-14T20:15:21.367407] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-14T20:15:21.367541] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-14T20:15:21.368272] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-14T20:15:21.368334] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-14T20:15:21.369169] [DEBUG] [LOCAL ] MOV: Trimmed 30559 records to 21725 (keeping 200 days of data) [2025-10-14T20:15:21.501715] [DEBUG] [LOCAL ] MOV: Primary data saved (21725 records). [2025-10-14T20:15:21.501837] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-14T20:15:21.501909] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MOV took 36.3s. Estimated remaining: 2h 18m 16s. Rate: 7.1 symbols/min [2025-10-14T20:15:21.567708] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-14T20:15:21.712594] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:15:21.760518] [DEBUG] [LOCAL ] MPC: Loaded 52061 existing records from primary storage. [2025-10-14T20:15:21.760867] [INFO ] [MAIN ] MPC: Loaded 52061 existing records. [2025-10-14T20:15:21.938701] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:15:21.938968] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-14T20:15:21.939018] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-14T20:15:21.940118] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-14T20:15:21.940177] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-14T20:15:22.240984] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T20:15:22.314225] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:15:22.358035] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-14T20:15:22.560252] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T20:15:22.566286] [INFO ] [REMOTE ] MOS: Full fetch complete (77618 records). [2025-10-14T20:15:22.566417] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-14T20:15:22.943208] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T20:15:22.968350] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-14T20:15:22.968403] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-14T20:15:22.969518] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-14T20:15:22.969578] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-14T20:15:22.970964] [DEBUG] [LOCAL ] MOS: Trimmed 77618 records to 53506 (keeping 200 days of data) [2025-10-14T20:15:23.177086] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-14T20:15:23.290416] [DEBUG] [LOCAL ] MOS: Primary data saved (53506 records). [2025-10-14T20:15:23.290544] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-14T20:15:23.290620] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MOS took 38.3s. Estimated remaining: 2h 18m 3s. Rate: 7.1 symbols/min [2025-10-14T20:15:23.457908] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:15:23.502056] [DEBUG] [LOCAL ] MPLX: Loaded 50742 existing records from primary storage. [2025-10-14T20:15:23.502343] [INFO ] [MAIN ] MPLX: Loaded 50742 existing records. [2025-10-14T20:15:23.682431] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:15:23.683461] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-14T20:15:23.683518] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-14T20:15:23.684931] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-14T20:15:23.684999] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-14T20:15:23.960151] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-14T20:15:24.037538] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:15:24.736198] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T20:15:24.758120] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-14T20:15:25.055681] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T20:15:25.558075] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-14T20:15:26.358081] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-14T20:15:26.505632] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T20:15:27.023488] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T20:15:27.158089] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-14T20:15:27.859130] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T20:15:27.963176] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-14T20:15:27.978127] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-14T20:15:28.758112] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-14T20:15:29.558055] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-14T20:15:29.697609] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T20:15:30.358088] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-14T20:15:30.504296] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T20:15:31.158178] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-14T20:15:31.842584] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-14T20:15:31.963163] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-14T20:15:31.984243] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-14T20:15:32.185317] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T20:15:32.639612] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T20:15:32.758147] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-14T20:15:33.558069] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-14T20:15:34.358084] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-14T20:15:34.504019] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T20:15:34.913933] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T20:15:35.158068] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-14T20:15:35.958076] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-14T20:15:36.110436] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-14T20:15:36.758062] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-14T20:15:37.060617] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T20:15:37.273592] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T20:15:37.274761] [INFO ] [REMOTE ] MPA: Full fetch complete (7108 records). [2025-10-14T20:15:37.274832] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-14T20:15:37.558723] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-14T20:15:37.646567] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-14T20:15:37.646685] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-14T20:15:37.646939] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-14T20:15:37.647014] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-14T20:15:37.647606] [DEBUG] [LOCAL ] MPA: Trimmed 7108 records to 5354 (keeping 200 days of data) [2025-10-14T20:15:37.681384] [DEBUG] [LOCAL ] MPA: Primary data saved (5354 records). [2025-10-14T20:15:37.681547] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-14T20:15:37.681771] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MPA took 25.1s. Estimated remaining: 2h 17m 59s. Rate: 7.1 symbols/min [2025-10-14T20:15:37.899754] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-14T20:15:37.902187] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:15:37.921292] [DEBUG] [LOCAL ] MPV: Loaded 4856 existing records from primary storage. [2025-10-14T20:15:37.921535] [INFO ] [MAIN ] MPV: Loaded 4856 existing records. [2025-10-14T20:15:38.119342] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:15:38.119584] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-14T20:15:38.119632] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-14T20:15:38.119906] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-14T20:15:38.119961] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-14T20:15:38.367943] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-14T20:15:38.485033] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:15:39.158083] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-14T20:15:39.379963] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:15:39.933173] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T20:15:39.958063] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-14T20:15:40.195695] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T20:15:40.581715] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T20:15:40.758112] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-14T20:15:41.272494] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-14T20:15:41.558055] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-14T20:15:42.205045] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T20:15:42.358077] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-14T20:15:43.158076] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-14T20:15:43.771956] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-14T20:15:43.958076] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-14T20:15:44.636664] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-14T20:15:44.758088] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-14T20:15:44.898494] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-14T20:15:44.904751] [INFO ] [REMOTE ] MP: Full fetch complete (77538 records). [2025-10-14T20:15:44.904926] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-14T20:15:45.298154] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-14T20:15:45.298251] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-14T20:15:45.299380] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-14T20:15:45.299447] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-14T20:15:45.301072] [DEBUG] [LOCAL ] MP: Trimmed 77538 records to 53720 (keeping 200 days of data) [2025-10-14T20:15:45.415365] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T20:15:45.584314] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-14T20:15:45.634079] [DEBUG] [LOCAL ] MP: Primary data saved (53720 records). [2025-10-14T20:15:45.634200] [INFO ] [MAIN ] MP: Full history saved. [2025-10-14T20:15:45.634271] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MP took 49.0s. Estimated remaining: 2h 17m 50s. Rate: 7.1 symbols/min [2025-10-14T20:15:45.802840] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:15:45.847901] [DEBUG] [LOCAL ] MPW: Loaded 53499 existing records from primary storage. [2025-10-14T20:15:45.848203] [INFO ] [MAIN ] MPW: Loaded 53499 existing records. [2025-10-14T20:15:46.023849] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:15:46.024045] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-14T20:15:46.024091] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-14T20:15:46.025021] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-14T20:15:46.025078] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-14T20:15:46.363246] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-14T20:15:46.395199] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:15:46.946422] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T20:15:47.158075] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-14T20:15:47.236960] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T20:15:47.958102] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-14T20:15:48.758038] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-14T20:15:49.201911] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T20:15:49.341446] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T20:15:49.558030] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-14T20:15:49.760746] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T20:15:50.358082] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-14T20:15:51.158093] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-14T20:15:51.290703] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T20:15:51.732261] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T20:15:51.958053] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-14T20:15:52.456188] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-14T20:15:52.758065] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-14T20:15:53.325768] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T20:15:53.558071] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-14T20:15:54.358141] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-14T20:15:54.564995] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T20:15:54.999828] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:15:55.000831] [INFO ] [REMOTE ] MPV: Full fetch complete (7864 records). [2025-10-14T20:15:55.000900] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-14T20:15:55.159371] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-14T20:15:55.371502] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-14T20:15:55.371670] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-14T20:15:55.371960] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-14T20:15:55.372155] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-14T20:15:55.372822] [DEBUG] [LOCAL ] MPV: Trimmed 7864 records to 4759 (keeping 200 days of data) [2025-10-14T20:15:55.422032] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T20:15:55.440348] [DEBUG] [LOCAL ] MPV: Primary data saved (4759 records). [2025-10-14T20:15:55.440456] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-14T20:15:55.440528] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MPV took 17.8s. Estimated remaining: 2h 17m 43s. Rate: 7.1 symbols/min [2025-10-14T20:15:55.605791] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:15:55.611144] [DEBUG] [LOCAL ] MPX: Loaded 4063 existing records from primary storage. [2025-10-14T20:15:55.611329] [INFO ] [MAIN ] MPX: Loaded 4063 existing records. [2025-10-14T20:15:55.785535] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:15:55.785776] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-14T20:15:55.785825] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-14T20:15:55.786041] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-14T20:15:55.786099] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-14T20:15:55.963241] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-14T20:15:56.178163] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:15:56.758099] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-14T20:15:56.957762] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T20:15:57.558085] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-14T20:15:57.790267] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T20:15:58.358137] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-14T20:15:58.735254] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T20:15:59.043522] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T20:15:59.158041] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-14T20:15:59.674142] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T20:15:59.680039] [INFO ] [REMOTE ] MPLX: Full fetch complete (74252 records). [2025-10-14T20:15:59.680160] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-14T20:15:59.963194] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-14T20:16:00.085255] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-14T20:16:00.085336] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-14T20:16:00.086519] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-14T20:16:00.086583] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-14T20:16:00.088126] [DEBUG] [LOCAL ] MPLX: Trimmed 74252 records to 50755 (keeping 200 days of data) [2025-10-14T20:16:00.395789] [DEBUG] [LOCAL ] MPLX: Primary data saved (50755 records). [2025-10-14T20:16:00.395928] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-14T20:16:00.396004] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MPLX took 37.1s. Estimated remaining: 2h 17m 32s. Rate: 7.1 symbols/min [2025-10-14T20:16:00.573115] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:00.582130] [DEBUG] [LOCAL ] MQT: Loaded 8340 existing records from primary storage. [2025-10-14T20:16:00.582334] [INFO ] [MAIN ] MQT: Loaded 8340 existing records. [2025-10-14T20:16:00.761692] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-14T20:16:00.765166] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:16:00.765428] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-14T20:16:00.765665] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-14T20:16:00.766592] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-14T20:16:00.766699] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-14T20:16:01.152718] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:16:01.209041] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-14T20:16:01.353577] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T20:16:01.558217] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-14T20:16:02.148833] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T20:16:02.172629] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T20:16:02.358082] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-14T20:16:03.158105] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-14T20:16:03.958081] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-14T20:16:04.083980] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T20:16:04.386208] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T20:16:04.626949] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T20:16:04.758064] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-14T20:16:05.475032] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T20:16:05.558074] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-14T20:16:06.358107] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-14T20:16:07.158062] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-14T20:16:07.215835] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T20:16:07.473496] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T20:16:07.706261] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T20:16:07.958096] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-14T20:16:08.758104] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-14T20:16:09.558087] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-14T20:16:10.061529] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-14T20:16:10.282103] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T20:16:10.358035] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-14T20:16:10.612514] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T20:16:11.158080] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-14T20:16:11.241739] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T20:16:11.958096] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-14T20:16:12.758107] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-14T20:16:12.772348] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T20:16:12.968053] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T20:16:13.531847] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:16:13.537226] [INFO ] [REMOTE ] MPC: Full fetch complete (75516 records). [2025-10-14T20:16:13.537391] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-14T20:16:13.538169] [FATAL] [VALIDATOR ] MPC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:16:13.538258] [FATAL] [MAIN ] MPC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:16:13.538301] [WARN ] [MAIN ] MPC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:16:13.538341] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-14T20:16:13.538399] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-14T20:16:13.538434] [INFO ] [LOCAL ] MPC: Starting deletion of derivative data. [2025-10-14T20:16:13.538660] [DEBUG] [LOCAL ] MPC: Deleted derivative data file. [2025-10-14T20:16:13.538754] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPC took 52.0s. Estimated remaining: 2h 17m 27s. Rate: 7.1 symbols/min [2025-10-14T20:16:13.568461] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-14T20:16:13.713594] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:13.713801] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-14T20:16:13.713844] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-14T20:16:13.713956] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-14T20:16:13.714005] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-14T20:16:13.714047] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-14T20:16:13.714079] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-14T20:16:14.070851] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:16:14.358099] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-14T20:16:15.158079] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-14T20:16:15.623525] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T20:16:15.757913] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-14T20:16:15.958063] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-14T20:16:16.214604] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T20:16:16.758131] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-14T20:16:16.803593] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T20:16:17.448545] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T20:16:17.558062] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-14T20:16:18.318027] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T20:16:18.358066] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-14T20:16:19.003796] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T20:16:19.158137] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-14T20:16:19.958083] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-14T20:16:20.239588] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T20:16:20.758120] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-14T20:16:21.435445] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T20:16:21.558080] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-14T20:16:21.673383] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T20:16:21.679507] [INFO ] [REMOTE ] MPW: Full fetch complete (77600 records). [2025-10-14T20:16:21.679713] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-14T20:16:22.164254] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-14T20:16:22.164073] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T20:16:22.164506] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-14T20:16:22.166180] [INFO ] [REMOTE ] MPX: Full fetch complete (6623 records). [2025-10-14T20:16:22.168082] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-14T20:16:22.168187] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-14T20:16:22.168547] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-14T20:16:22.281055] [DEBUG] [LOCAL ] MPW: Trimmed 77600 records to 53496 (keeping 200 days of data) [2025-10-14T20:16:22.372718] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-14T20:16:22.869181] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-14T20:16:22.872377] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-14T20:16:22.872574] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-14T20:16:22.877365] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-14T20:16:22.907385] [DEBUG] [LOCAL ] MPX: Trimmed 6623 records to 4071 (keeping 200 days of data) [2025-10-14T20:16:22.977509] [DEBUG] [LOCAL ] MPX: Primary data saved (4071 records). [2025-10-14T20:16:22.981740] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-14T20:16:22.981850] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MPX took 27.5s. Estimated remaining: 2h 17m 19s. Rate: 7.1 symbols/min [2025-10-14T20:16:22.981612] [DEBUG] [LOCAL ] MPW: Primary data saved (53496 records). [2025-10-14T20:16:23.025971] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-14T20:16:23.058387] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MPW took 37.4s. Estimated remaining: 2h 17m 4s. Rate: 7.1 symbols/min [2025-10-14T20:16:23.166726] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-14T20:16:23.262500] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:23.278939] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-14T20:16:23.284307] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-14T20:16:23.340870] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:23.348188] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-14T20:16:23.349727] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T20:16:23.349069] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-14T20:16:23.349903] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-14T20:16:23.355111] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-14T20:16:23.355228] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-14T20:16:23.355348] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-14T20:16:23.355435] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-14T20:16:23.355495] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-14T20:16:23.399060] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-14T20:16:23.419677] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-14T20:16:23.961036] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-14T20:16:24.058638] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:16:24.090293] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T20:16:24.121146] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:16:24.758091] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-14T20:16:25.292149] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T20:16:25.307283] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T20:16:25.558069] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-14T20:16:26.358062] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-14T20:16:26.397128] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T20:16:27.158085] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-14T20:16:27.958094] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-14T20:16:28.149106] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T20:16:28.341501] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T20:16:28.727270] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T20:16:28.758033] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-14T20:16:29.562116] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-14T20:16:29.563944] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T20:16:30.358106] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-14T20:16:30.942104] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T20:16:31.158069] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-14T20:16:31.420285] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T20:16:31.873907] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:16:31.875308] [INFO ] [REMOTE ] MQT: Full fetch complete (13182 records). [2025-10-14T20:16:31.875398] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-14T20:16:31.963171] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-14T20:16:32.247862] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-14T20:16:32.247938] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-14T20:16:32.248235] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-14T20:16:32.248271] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-14T20:16:32.248799] [DEBUG] [LOCAL ] MQT: Trimmed 13182 records to 8306 (keeping 200 days of data) [2025-10-14T20:16:32.297218] [DEBUG] [LOCAL ] MQT: Primary data saved (8306 records). [2025-10-14T20:16:32.297335] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-14T20:16:32.297409] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MQT took 31.9s. Estimated remaining: 2h 16m 57s. Rate: 7.1 symbols/min [2025-10-14T20:16:32.466319] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:32.466445] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-14T20:16:32.466482] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-14T20:16:32.466593] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-14T20:16:32.466637] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-14T20:16:32.466723] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-14T20:16:32.466761] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-14T20:16:32.763267] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-14T20:16:32.824187] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:16:33.538145] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T20:16:33.558044] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-14T20:16:33.905585] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T20:16:34.358074] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-14T20:16:34.675454] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:16:34.675818] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-14T20:16:34.675902] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:16:34.675950] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-14T20:16:34.676007] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:16:34.676081] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-14T20:16:34.676140] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-14T20:16:34.676175] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-14T20:16:34.676214] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-14T20:16:34.676258] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MRP took 2.4s. Estimated remaining: 2h 16m 44s. Rate: 7.1 symbols/min [2025-10-14T20:16:34.995514] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T20:16:35.158102] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-14T20:16:35.958119] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-14T20:16:36.758144] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-14T20:16:37.081842] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T20:16:37.277658] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-14T20:16:37.558087] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-14T20:16:37.972018] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T20:16:38.358068] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-14T20:16:39.158068] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-14T20:16:39.839483] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-14T20:16:39.880742] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T20:16:39.921102] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T20:16:39.958037] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-14T20:16:40.544272] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T20:16:40.546639] [INFO ] [REMOTE ] MQY: Full fetch complete (26564 records). [2025-10-14T20:16:40.546739] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-14T20:16:40.547191] [FATAL] [VALIDATOR ] MQY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:16:40.547276] [FATAL] [MAIN ] MQY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:16:40.547319] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:16:40.547364] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-14T20:16:40.547418] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-14T20:16:40.547454] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-14T20:16:40.547493] [DEBUG] [LOCAL ] MQY: No derivative data file found to delete. [2025-10-14T20:16:40.547547] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MQY took 27.0s. Estimated remaining: 2h 16m 34s. Rate: 7.1 symbols/min [2025-10-14T20:16:40.758115] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-14T20:16:41.558116] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-14T20:16:42.265417] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T20:16:42.358034] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-14T20:16:43.758861] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-14T20:16:43.775359] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T20:16:43.783851] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-14T20:16:43.958128] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-14T20:16:45.623949] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T20:16:45.634711] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-14T20:16:46.256304] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-14T20:16:46.268026] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-14T20:16:47.114194] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T20:16:47.121740] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-14T20:16:48.505155] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-14T20:16:48.516440] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-14T20:16:48.559734] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T20:16:48.568127] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-14T20:16:49.246406] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:16:49.252456] [INFO ] [REMOTE ] MRC: Full fetch complete (54624 records). [2025-10-14T20:16:49.252704] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-14T20:16:49.253624] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:16:49.253771] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:16:49.253833] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:16:49.253912] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-14T20:16:49.254026] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-14T20:16:49.254089] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-14T20:16:49.254144] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-14T20:16:49.254218] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MRC took 26.3s. Estimated remaining: 2h 16m 25s. Rate: 7.1 symbols/min [2025-10-14T20:16:50.776155] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-14T20:16:50.792603] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-14T20:16:53.243153] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-14T20:16:53.255151] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-14T20:16:55.587581] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-14T20:16:55.599005] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-14T20:16:58.053246] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-14T20:16:58.064533] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-14T20:16:58.836254] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:16:58.841921] [INFO ] [REMOTE ] MRK: Full fetch complete (77578 records). [2025-10-14T20:16:58.842157] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-14T20:16:58.842916] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:16:58.843028] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:16:58.843072] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:16:58.843118] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-14T20:16:58.843174] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-14T20:16:58.843209] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-14T20:16:58.843254] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-14T20:16:58.843310] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MRK took 35.8s. Estimated remaining: 2h 16m 18s. Rate: 7.1 symbols/min [2025-10-14T20:16:59.412512] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:59.444397] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-14T20:16:59.470683] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-14T20:16:59.586951] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:59.619266] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-14T20:16:59.623206] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:59.644597] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:16:59.645570] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-14T20:16:59.645383] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-14T20:16:59.646136] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-14T20:16:59.646240] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-14T20:16:59.646522] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-14T20:16:59.646878] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-14T20:16:59.647028] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-14T20:16:59.647146] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-14T20:16:59.647268] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-14T20:16:59.676824] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-14T20:16:59.661257] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-14T20:16:59.677147] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-14T20:16:59.691545] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-14T20:16:59.769295] [DEBUG] [LOCAL ] MSB: Loaded 7768 existing records from primary storage. [2025-10-14T20:16:59.768511] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-14T20:16:59.818953] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-14T20:16:59.795522] [INFO ] [MAIN ] MSB: Loaded 7768 existing records. [2025-10-14T20:17:00.653915] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:17:00.738230] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-14T20:17:00.784729] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-14T20:17:00.857456] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:00.879296] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-14T20:17:00.925312] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-14T20:17:01.017969] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:00.987992] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-14T20:17:01.025492] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-14T20:17:01.241944] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:01.267753] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-14T20:17:01.479205] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T20:17:01.490373] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-14T20:17:01.494351] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:01.495483] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-14T20:17:02.030400] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T20:17:02.031677] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-14T20:17:02.178835] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T20:17:02.181049] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-14T20:17:02.504399] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T20:17:02.505857] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-14T20:17:02.624069] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T20:17:02.629540] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-14T20:17:03.177700] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T20:17:03.179184] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-14T20:17:03.181756] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-14T20:17:03.193251] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-14T20:17:03.348486] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T20:17:03.352594] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-14T20:17:03.537160] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T20:17:03.541018] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-14T20:17:03.702840] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-14T20:17:03.703753] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-14T20:17:04.187059] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T20:17:04.188069] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-14T20:17:04.292158] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T20:17:04.295725] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-14T20:17:04.524297] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T20:17:04.547437] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T20:17:04.758139] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-14T20:17:05.118474] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T20:17:05.190763] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T20:17:05.558067] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-14T20:17:05.698998] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:17:05.972984] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-14T20:17:06.358092] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-14T20:17:06.966931] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T20:17:07.158117] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-14T20:17:07.819556] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T20:17:07.958071] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-14T20:17:08.758121] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-14T20:17:08.890432] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T20:17:09.558065] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-14T20:17:10.086156] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T20:17:10.358035] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-14T20:17:10.377085] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T20:17:11.158086] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-14T20:17:11.602864] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T20:17:11.958093] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-14T20:17:12.758079] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-14T20:17:12.934164] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T20:17:13.103129] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T20:17:13.560289] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-14T20:17:13.565678] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T20:17:13.985725] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T20:17:13.986668] [INFO ] [REMOTE ] MSC: Full fetch complete (2533 records). [2025-10-14T20:17:13.986752] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-14T20:17:14.175018] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-14T20:17:14.175209] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:17:14.175278] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:17:14.175351] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-14T20:17:14.175412] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-14T20:17:14.175449] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-14T20:17:14.175488] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-14T20:17:14.175542] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSC took 15.3s. Estimated remaining: 2h 16m 14s. Rate: 7.1 symbols/min [2025-10-14T20:17:14.352339] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:14.352496] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-14T20:17:14.352539] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-14T20:17:14.352695] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-14T20:17:14.352747] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-14T20:17:14.352788] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-14T20:17:14.352819] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-14T20:17:14.364345] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-14T20:17:14.722952] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:15.158108] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-14T20:17:15.516579] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T20:17:15.958051] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-14T20:17:16.093705] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T20:17:16.758096] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-14T20:17:17.023161] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T20:17:17.558055] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-14T20:17:18.248180] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T20:17:18.358068] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-14T20:17:18.503938] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T20:17:19.158079] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-14T20:17:19.890912] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T20:17:19.958100] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-14T20:17:20.225075] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T20:17:20.758117] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-14T20:17:21.389312] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:17:21.391367] [INFO ] [REMOTE ] MSA: Full fetch complete (25594 records). [2025-10-14T20:17:21.391438] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-14T20:17:21.391867] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:17:21.391948] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:17:21.392019] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:17:21.392087] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-14T20:17:21.392161] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-14T20:17:21.392226] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-14T20:17:21.392316] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-14T20:17:21.392375] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MSA took 22.5s. Estimated remaining: 2h 16m 5s. Rate: 7.1 symbols/min [2025-10-14T20:17:21.562766] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:21.559343] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-14T20:17:21.578821] [DEBUG] [LOCAL ] MSD: Loaded 16426 existing records from primary storage. [2025-10-14T20:17:21.579058] [INFO ] [MAIN ] MSD: Loaded 16426 existing records. [2025-10-14T20:17:21.757708] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:17:21.757903] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-14T20:17:21.757948] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-14T20:17:21.758367] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-14T20:17:21.758423] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-14T20:17:22.156605] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:22.188601] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-14T20:17:22.358042] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-14T20:17:23.158071] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-14T20:17:23.192763] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T20:17:23.219364] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T20:17:23.958097] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-14T20:17:24.758050] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-14T20:17:24.878210] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T20:17:25.500897] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-14T20:17:25.558064] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-14T20:17:26.213668] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T20:17:26.214962] [INFO ] [REMOTE ] MSB: Full fetch complete (12940 records). [2025-10-14T20:17:26.215030] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-14T20:17:26.361881] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-14T20:17:26.626264] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T20:17:26.626498] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-14T20:17:26.633724] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-14T20:17:26.634405] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-14T20:17:26.634483] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-14T20:17:26.635326] [DEBUG] [LOCAL ] MSB: Trimmed 12940 records to 7777 (keeping 200 days of data) [2025-10-14T20:17:26.683997] [DEBUG] [LOCAL ] MSB: Primary data saved (7777 records). [2025-10-14T20:17:26.684134] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-14T20:17:26.684211] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MSB took 27.8s. Estimated remaining: 2h 15m 54s. Rate: 7.1 symbols/min [2025-10-14T20:17:26.854897] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:26.855063] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-14T20:17:26.855099] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-14T20:17:26.855213] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-14T20:17:26.855255] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-14T20:17:26.855296] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-14T20:17:26.855329] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-14T20:17:27.173856] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-14T20:17:27.214991] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:27.958167] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-14T20:17:28.454717] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-14T20:17:28.504747] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T20:17:28.758083] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-14T20:17:29.506756] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T20:17:29.558051] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-14T20:17:29.732749] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T20:17:30.358081] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-14T20:17:30.796972] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T20:17:31.158043] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-14T20:17:31.340167] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T20:17:31.958069] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-14T20:17:32.668893] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T20:17:32.758028] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-14T20:17:33.069115] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T20:17:33.558056] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-14T20:17:34.327485] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T20:17:34.358029] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-14T20:17:34.496200] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T20:17:35.158066] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-14T20:17:35.933795] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T20:17:35.958073] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-14T20:17:36.758054] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-14T20:17:36.903408] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T20:17:37.445963] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T20:17:37.558051] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-14T20:17:38.271467] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T20:17:38.358042] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-14T20:17:38.690279] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T20:17:39.158056] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-14T20:17:39.810682] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T20:17:39.958096] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-14T20:17:40.042961] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T20:17:40.758056] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-14T20:17:41.328567] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T20:17:41.558076] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-14T20:17:42.164638] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T20:17:42.358101] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-14T20:17:42.683506] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T20:17:43.158054] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-14T20:17:43.958065] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-14T20:17:44.627619] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-14T20:17:44.758095] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-14T20:17:44.860046] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T20:17:45.558091] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-14T20:17:45.608744] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T20:17:46.358038] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-14T20:17:46.796194] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T20:17:46.860011] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T20:17:47.158098] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-14T20:17:47.504701] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T20:17:47.958066] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-14T20:17:48.758112] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-14T20:17:49.097281] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T20:17:49.314165] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-14T20:17:49.558088] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-14T20:17:50.057588] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T20:17:50.280486] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:17:50.286091] [INFO ] [REMOTE ] MS: Full fetch complete (77466 records). [2025-10-14T20:17:50.286238] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-14T20:17:50.287135] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:17:50.287235] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:17:50.287278] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:17:50.287317] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-14T20:17:50.287374] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-14T20:17:50.287411] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-14T20:17:50.287451] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-14T20:17:50.287508] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MS took 51.4s. Estimated remaining: 2h 15m 56s. Rate: 7.1 symbols/min [2025-10-14T20:17:50.363228] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-14T20:17:50.467870] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:50.468020] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-14T20:17:50.468056] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-14T20:17:50.468162] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-14T20:17:50.468202] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-14T20:17:50.468243] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-14T20:17:50.468275] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-14T20:17:50.876255] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:51.158086] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-14T20:17:51.508682] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T20:17:51.511617] [INFO ] [REMOTE ] MSD: Full fetch complete (23080 records). [2025-10-14T20:17:51.511741] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-14T20:17:51.901479] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-14T20:17:51.901596] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-14T20:17:51.902124] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-14T20:17:51.902186] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-14T20:17:51.902992] [DEBUG] [LOCAL ] MSD: Trimmed 23080 records to 16509 (keeping 200 days of data) [2025-10-14T20:17:51.970762] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-14T20:17:52.000076] [DEBUG] [LOCAL ] MSD: Primary data saved (16509 records). [2025-10-14T20:17:52.000202] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-14T20:17:52.000279] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSD took 30.6s. Estimated remaining: 2h 15m 43s. Rate: 7.1 symbols/min [2025-10-14T20:17:52.170699] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:52.170890] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-14T20:17:52.170927] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-14T20:17:52.171081] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-14T20:17:52.171121] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-14T20:17:52.171161] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-14T20:17:52.171193] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-14T20:17:52.532230] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:52.645596] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T20:17:52.714322] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:17:52.717518] [INFO ] [REMOTE ] MSCI: Full fetch complete (50138 records). [2025-10-14T20:17:52.717675] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-14T20:17:52.718323] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:17:52.718410] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:17:52.718453] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:17:52.718492] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-14T20:17:52.718546] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-14T20:17:52.718581] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-14T20:17:52.718618] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-14T20:17:52.718702] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSCI took 38.5s. Estimated remaining: 2h 15m 29s. Rate: 7.1 symbols/min [2025-10-14T20:17:52.763156] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-14T20:17:52.893311] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:52.893509] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-14T20:17:52.893554] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-14T20:17:52.893697] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-14T20:17:52.893777] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-14T20:17:52.893827] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-14T20:17:52.893859] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-14T20:17:53.242152] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:53.558093] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-14T20:17:54.358073] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-14T20:17:54.485843] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T20:17:54.503145] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T20:17:55.158080] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-14T20:17:55.638081] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T20:17:55.958075] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-14T20:17:56.661567] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T20:17:56.662538] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:17:56.676103] [INFO ] [REMOTE ] MSDL: Full fetch complete (55497 records). [2025-10-14T20:17:56.676216] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-14T20:17:56.676935] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:17:56.677020] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:17:56.677062] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:17:56.677100] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-14T20:17:56.677171] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-14T20:17:56.677225] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-14T20:17:56.677266] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-14T20:17:56.677322] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSDL took 30.0s. Estimated remaining: 2h 15m 18s. Rate: 7.1 symbols/min [2025-10-14T20:17:56.763198] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-14T20:17:56.849941] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:56.850133] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-14T20:17:56.850169] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-14T20:17:56.850279] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-14T20:17:56.850319] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-14T20:17:56.850358] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-14T20:17:56.850389] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-14T20:17:57.248239] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:17:57.558063] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-14T20:17:57.693834] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T20:17:58.358037] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-14T20:17:58.597457] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T20:17:59.158053] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-14T20:17:59.346904] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T20:17:59.409129] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:17:59.409461] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-14T20:17:59.409562] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:17:59.409683] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-14T20:17:59.409756] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:17:59.409827] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-14T20:17:59.409890] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-14T20:17:59.409927] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-14T20:17:59.409968] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-14T20:17:59.410012] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSIF took 2.7s. Estimated remaining: 2h 15m 6s. Rate: 7.1 symbols/min [2025-10-14T20:17:59.619338] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:17:59.619576] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-14T20:17:59.619622] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-14T20:17:59.619989] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-14T20:17:59.620040] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-14T20:17:59.620083] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-14T20:17:59.620114] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-14T20:17:59.961243] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-14T20:18:00.083250] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:18:00.758083] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-14T20:18:01.558060] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-14T20:18:01.821911] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T20:18:02.019039] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T20:18:02.358070] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-14T20:18:03.056554] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:18:03.158051] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-14T20:18:03.944775] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T20:18:03.964668] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-14T20:18:03.966805] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T20:18:04.758047] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-14T20:18:05.559133] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T20:18:05.558244] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-14T20:18:06.022060] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-14T20:18:06.358078] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-14T20:18:06.981188] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T20:18:07.158081] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-14T20:18:07.856706] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:18:07.958041] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-14T20:18:08.356099] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T20:18:08.617374] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T20:18:08.758085] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-14T20:18:09.558094] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-14T20:18:10.358094] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-14T20:18:10.553391] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T20:18:10.957622] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T20:18:11.092487] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T20:18:11.158047] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-14T20:18:11.958072] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-14T20:18:12.286729] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T20:18:12.758062] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-14T20:18:13.386739] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T20:18:13.558046] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-14T20:18:14.041932] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T20:18:14.358069] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-14T20:18:14.836723] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T20:18:15.158063] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-14T20:18:15.526383] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T20:18:15.958101] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-14T20:18:16.475235] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T20:18:16.758107] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-14T20:18:17.558060] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-14T20:18:17.713580] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T20:18:18.169221] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T20:18:18.358042] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-14T20:18:18.720868] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T20:18:19.158089] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-14T20:18:19.565039] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T20:18:19.567618] [INFO ] [REMOTE ] MSGS: Full fetch complete (23461 records). [2025-10-14T20:18:19.567740] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-14T20:18:19.568342] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:18:19.568430] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:18:19.568482] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:18:19.568561] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-14T20:18:19.568667] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-14T20:18:19.568725] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-14T20:18:19.568771] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-14T20:18:19.568826] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSGS took 27.6s. Estimated remaining: 2h 15m 5s. Rate: 7.1 symbols/min [2025-10-14T20:18:19.776182] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:18:19.776407] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-14T20:18:19.776484] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-14T20:18:19.776806] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-14T20:18:19.776948] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-14T20:18:19.777082] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-14T20:18:19.777142] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-14T20:18:19.884513] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T20:18:19.963252] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-14T20:18:20.195585] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:18:20.758121] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-14T20:18:21.436836] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T20:18:21.558068] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-14T20:18:22.358072] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-14T20:18:22.408151] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T20:18:22.885109] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T20:18:23.158047] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-14T20:18:23.958083] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-14T20:18:23.969054] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:18:23.972845] [INFO ] [REMOTE ] MSGE: Full fetch complete (40072 records). [2025-10-14T20:18:23.972942] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-14T20:18:23.973451] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:18:23.973533] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:18:23.973579] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:18:23.973662] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-14T20:18:23.973741] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-14T20:18:23.973776] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-14T20:18:23.973817] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-14T20:18:23.973872] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSGE took 33.7s. Estimated remaining: 2h 14m 54s. Rate: 7.1 symbols/min [2025-10-14T20:18:24.168699] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T20:18:24.186430] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:18:24.193954] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-14T20:18:24.194258] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-14T20:18:24.194494] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-14T20:18:24.194547] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-14T20:18:24.195035] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-14T20:18:24.195080] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-14T20:18:24.566909] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:18:24.758066] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-14T20:18:25.558055] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-14T20:18:25.853923] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T20:18:26.224818] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T20:18:26.358069] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-14T20:18:26.570856] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T20:18:27.158099] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-14T20:18:27.958068] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-14T20:18:28.050201] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T20:18:28.621379] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T20:18:28.758082] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-14T20:18:29.558052] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-14T20:18:29.641477] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T20:18:30.298424] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:18:30.304319] [INFO ] [REMOTE ] MSM: Full fetch complete (51762 records). [2025-10-14T20:18:30.304452] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-14T20:18:30.305316] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:18:30.305432] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:18:30.305481] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:18:30.305530] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-14T20:18:30.305598] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-14T20:18:30.305665] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-14T20:18:30.305758] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-14T20:18:30.305841] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MSM took 30.9s. Estimated remaining: 2h 14m 44s. Rate: 7.1 symbols/min [2025-10-14T20:18:30.363434] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-14T20:18:30.484140] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:18:30.509469] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:18:30.530796] [DEBUG] [LOCAL ] MTD: Loaded 15417 existing records from primary storage. [2025-10-14T20:18:30.531066] [INFO ] [MAIN ] MTD: Loaded 15417 existing records. [2025-10-14T20:18:30.703470] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:18:30.703690] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-14T20:18:30.703747] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-14T20:18:30.704213] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-14T20:18:30.704271] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-14T20:18:31.052455] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:18:31.158028] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-14T20:18:31.958047] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-14T20:18:32.074355] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T20:18:32.176686] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T20:18:32.758061] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-14T20:18:33.558064] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-14T20:18:33.630230] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T20:18:33.743282] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T20:18:34.358117] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-14T20:18:35.158098] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-14T20:18:35.284066] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T20:18:35.743066] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T20:18:35.958138] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-14T20:18:36.724229] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T20:18:36.758030] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-14T20:18:37.079036] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T20:18:37.224918] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T20:18:37.228701] [INFO ] [REMOTE ] MSI: Full fetch complete (57761 records). [2025-10-14T20:18:37.228794] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-14T20:18:37.229327] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:18:37.229408] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:18:37.229481] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:18:37.229549] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-14T20:18:37.229609] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-14T20:18:37.229669] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-14T20:18:37.229750] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-14T20:18:37.229813] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MSI took 44.5s. Estimated remaining: 2h 14m 35s. Rate: 7.1 symbols/min [2025-10-14T20:18:37.397305] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:18:37.397476] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-14T20:18:37.397516] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-14T20:18:37.397637] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-14T20:18:37.397724] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-14T20:18:37.397786] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-14T20:18:37.397826] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-14T20:18:37.560584] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-14T20:18:37.768308] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:18:38.358038] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-14T20:18:38.676696] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T20:18:39.158118] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-14T20:18:39.958048] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-14T20:18:40.234092] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T20:18:40.524758] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T20:18:40.758085] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-14T20:18:41.558052] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-14T20:18:41.869111] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-14T20:18:42.358104] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-14T20:18:42.572275] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T20:18:42.847542] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T20:18:43.158056] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-14T20:18:43.958042] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-14T20:18:44.214517] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T20:18:44.758046] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-14T20:18:44.998697] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T20:18:45.174119] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T20:18:45.558066] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-14T20:18:46.184438] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:18:46.358077] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-14T20:18:47.011513] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T20:18:47.158032] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-14T20:18:47.491963] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T20:18:47.958069] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-14T20:18:48.758104] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-14T20:18:48.788436] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T20:18:49.186206] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T20:18:49.558055] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-14T20:18:50.358050] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-14T20:18:50.635667] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T20:18:51.158106] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-14T20:18:51.241357] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T20:18:51.364567] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T20:18:51.958083] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-14T20:18:52.679594] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T20:18:52.758150] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-14T20:18:53.558065] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-14T20:18:53.909000] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T20:18:54.358056] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-14T20:18:54.521993] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T20:18:55.158059] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-14T20:18:55.423833] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-14T20:18:55.958041] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-14T20:18:56.160987] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:18:56.339108] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T20:18:56.758061] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-14T20:18:57.558098] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-14T20:18:57.607577] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T20:18:57.624106] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T20:18:57.627292] [INFO ] [REMOTE ] MTD: Full fetch complete (21337 records). [2025-10-14T20:18:57.627909] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-14T20:18:58.002112] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-14T20:18:58.002193] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-14T20:18:58.002621] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-14T20:18:58.002691] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-14T20:18:58.003253] [DEBUG] [LOCAL ] MTD: Trimmed 21337 records to 15443 (keeping 200 days of data) [2025-10-14T20:18:58.103516] [DEBUG] [LOCAL ] MTD: Primary data saved (15443 records). [2025-10-14T20:18:58.103688] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-14T20:18:58.103786] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MTD took 27.8s. Estimated remaining: 2h 14m 35s. Rate: 7.1 symbols/min [2025-10-14T20:18:58.274578] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:18:58.274786] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-14T20:18:58.274831] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-14T20:18:58.274941] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-14T20:18:58.274986] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-14T20:18:58.275026] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-14T20:18:58.275057] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-14T20:18:58.363141] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-14T20:18:58.634620] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:18:59.158067] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-14T20:18:59.389317] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T20:18:59.906923] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T20:18:59.958038] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-14T20:19:00.628170] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:19:00.633210] [INFO ] [REMOTE ] MTB: Full fetch complete (67656 records). [2025-10-14T20:19:00.633442] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-14T20:19:00.634350] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:19:00.634437] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:00.634482] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:00.634550] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-14T20:19:00.634614] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-14T20:19:00.634684] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-14T20:19:00.634748] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-14T20:19:00.634810] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MTB took 36.7s. Estimated remaining: 2h 14m 22s. Rate: 7.1 symbols/min [2025-10-14T20:19:00.764332] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-14T20:19:00.795314] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T20:19:00.869900] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:00.870072] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-14T20:19:00.870113] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-14T20:19:00.870224] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-14T20:19:00.870272] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-14T20:19:00.870314] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-14T20:19:00.870348] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-14T20:19:01.295114] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:01.558142] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-14T20:19:02.358089] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-14T20:19:02.608088] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T20:19:03.158043] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-14T20:19:03.355059] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T20:19:03.701308] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T20:19:03.706502] [INFO ] [REMOTE ] MT: Full fetch complete (73334 records). [2025-10-14T20:19:03.706684] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-14T20:19:03.707345] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:19:03.707423] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:03.707487] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:03.707590] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-14T20:19:03.707702] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-14T20:19:03.707753] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-14T20:19:03.707795] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-14T20:19:03.707850] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MT took 44.1s. Estimated remaining: 2h 14m 10s. Rate: 7.1 symbols/min [2025-10-14T20:19:03.876533] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:03.876750] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-14T20:19:03.876819] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-14T20:19:03.877009] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-14T20:19:03.877108] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-14T20:19:03.877193] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-14T20:19:03.877243] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-14T20:19:03.963261] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-14T20:19:04.057843] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T20:19:04.263698] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:04.758060] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-14T20:19:05.558046] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-14T20:19:05.796455] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T20:19:06.358128] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-14T20:19:06.482960] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T20:19:07.158106] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-14T20:19:07.292871] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T20:19:07.946005] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T20:19:07.958016] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-14T20:19:08.767887] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-14T20:19:08.773608] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T20:19:09.519193] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T20:19:09.558050] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-14T20:19:10.358054] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-14T20:19:10.672400] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T20:19:10.854462] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T20:19:11.158074] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-14T20:19:11.963212] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-14T20:19:11.967823] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T20:19:12.758062] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-14T20:19:12.982259] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:19:13.558086] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-14T20:19:13.810529] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T20:19:14.358065] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-14T20:19:14.401395] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T20:19:14.933076] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T20:19:15.158073] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-14T20:19:15.958142] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-14T20:19:16.122769] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T20:19:16.758081] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-14T20:19:16.938572] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T20:19:17.387933] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T20:19:17.558082] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-14T20:19:18.358064] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-14T20:19:18.508993] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T20:19:18.920800] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T20:19:19.064443] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:19:19.070237] [INFO ] [REMOTE ] MTDR: Full fetch complete (73614 records). [2025-10-14T20:19:19.070386] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-14T20:19:19.071224] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:19:19.071318] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:19.071362] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:19.071404] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-14T20:19:19.071470] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-14T20:19:19.071507] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-14T20:19:19.071549] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-14T20:19:19.071613] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MTDR took 41.8s. Estimated remaining: 2h 14m 6s. Rate: 7.1 symbols/min [2025-10-14T20:19:19.163612] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-14T20:19:19.255724] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:19.255960] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-14T20:19:19.256005] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-14T20:19:19.256126] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-14T20:19:19.256167] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-14T20:19:19.256212] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-14T20:19:19.256244] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-14T20:19:19.654719] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:19.958077] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-14T20:19:20.482914] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-14T20:19:20.781030] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-14T20:19:20.798611] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T20:19:21.558079] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-14T20:19:22.318666] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T20:19:22.358110] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-14T20:19:23.158051] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-14T20:19:23.529816] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T20:19:23.958062] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-14T20:19:24.191638] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T20:19:24.758032] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-14T20:19:24.956381] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T20:19:25.134385] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T20:19:25.558067] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-14T20:19:26.282116] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T20:19:26.358044] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-14T20:19:27.025590] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T20:19:27.158093] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-14T20:19:27.958131] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-14T20:19:28.167508] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T20:19:28.548828] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T20:19:28.761140] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-14T20:19:28.764966] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T20:19:29.430834] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:19:29.436625] [INFO ] [REMOTE ] MTG: Full fetch complete (73815 records). [2025-10-14T20:19:29.436812] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-14T20:19:29.437672] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:19:29.437766] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:29.437811] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:29.437884] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-14T20:19:29.438161] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-14T20:19:29.438369] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-14T20:19:29.438432] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-14T20:19:29.438564] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTG took 31.3s. Estimated remaining: 2h 13m 59s. Rate: 7.1 symbols/min [2025-10-14T20:19:29.563209] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-14T20:19:29.616415] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:29.616630] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-14T20:19:29.616710] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-14T20:19:29.616834] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-14T20:19:29.616927] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-14T20:19:29.616989] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-14T20:19:29.617022] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-14T20:19:29.962559] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:30.358117] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-14T20:19:31.158111] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-14T20:19:31.348330] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T20:19:31.575764] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-14T20:19:31.958048] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-14T20:19:32.111471] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T20:19:32.423494] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-14T20:19:32.758071] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-14T20:19:33.211377] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-14T20:19:33.558073] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-14T20:19:34.011374] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T20:19:34.358095] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-14T20:19:35.046885] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:19:35.051330] [INFO ] [REMOTE ] MTH: Full fetch complete (63420 records). [2025-10-14T20:19:35.051421] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-14T20:19:35.052115] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:19:35.052199] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:35.052241] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:35.052278] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-14T20:19:35.052333] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-14T20:19:35.052367] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-14T20:19:35.052405] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-14T20:19:35.052456] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTH took 34.4s. Estimated remaining: 2h 13m 49s. Rate: 7.1 symbols/min [2025-10-14T20:19:35.163172] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-14T20:19:35.236371] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:35.236549] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-14T20:19:35.236593] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-14T20:19:35.236724] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-14T20:19:35.236770] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-14T20:19:35.236812] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-14T20:19:35.236845] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-14T20:19:35.592518] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:35.958069] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-14T20:19:36.128921] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T20:19:36.673120] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T20:19:36.758135] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-14T20:19:37.558068] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-14T20:19:38.067568] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-14T20:19:38.274791] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T20:19:38.358040] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-14T20:19:38.788528] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T20:19:39.158107] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-14T20:19:39.567292] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T20:19:39.958075] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-14T20:19:40.758146] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-14T20:19:41.177791] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T20:19:41.178502] [INFO ] [REMOTE ] MTR: Full fetch complete (2428 records). [2025-10-14T20:19:41.178568] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-14T20:19:41.300548] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T20:19:41.400617] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T20:19:41.400871] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:41.400955] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:41.401037] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-14T20:19:41.401120] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-14T20:19:41.401177] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-14T20:19:41.401258] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-14T20:19:41.401333] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTR took 22.3s. Estimated remaining: 2h 13m 39s. Rate: 7.1 symbols/min [2025-10-14T20:19:41.569004] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-14T20:19:41.572344] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:41.573144] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-14T20:19:41.573187] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-14T20:19:41.573292] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-14T20:19:41.573332] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-14T20:19:41.573373] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-14T20:19:41.573404] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-14T20:19:41.929523] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:42.353426] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:19:42.358191] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-14T20:19:42.358111] [INFO ] [REMOTE ] MTN: Full fetch complete (56404 records). [2025-10-14T20:19:42.359284] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-14T20:19:42.360144] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:19:42.360361] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:19:42.360458] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:19:42.360578] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-14T20:19:42.360690] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-14T20:19:42.360748] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-14T20:19:42.360793] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-14T20:19:42.360864] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTN took 38.7s. Estimated remaining: 2h 13m 25s. Rate: 7.1 symbols/min [2025-10-14T20:19:42.528411] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:19:42.528586] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-14T20:19:42.528625] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-14T20:19:42.528786] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-14T20:19:42.528840] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-14T20:19:42.528883] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-14T20:19:42.528914] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-14T20:19:42.896348] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:19:43.158133] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-14T20:19:43.325212] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T20:19:43.958079] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-14T20:19:44.412964] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T20:19:44.758050] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-14T20:19:45.019870] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T20:19:45.558057] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-14T20:19:46.077169] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T20:19:46.358082] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-14T20:19:46.600490] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T20:19:47.158127] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-14T20:19:47.266989] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-14T20:19:47.958095] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-14T20:19:48.226782] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T20:19:48.758077] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-14T20:19:49.397927] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T20:19:49.558069] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-14T20:19:49.907273] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T20:19:50.358041] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-14T20:19:51.007636] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T20:19:51.158071] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-14T20:19:51.184609] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T20:19:51.958072] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-14T20:19:52.190771] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T20:19:52.758088] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-14T20:19:53.285715] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T20:19:53.558049] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-14T20:19:53.922816] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:19:54.358090] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-14T20:19:54.627056] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T20:19:55.158072] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-14T20:19:55.716526] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T20:19:55.876168] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T20:19:55.958068] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-14T20:19:56.758074] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-14T20:19:57.139904] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T20:19:57.558039] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-14T20:19:57.955760] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T20:19:58.358070] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-14T20:19:58.934988] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T20:19:59.158051] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-14T20:19:59.385318] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T20:19:59.958086] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-14T20:20:00.443698] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T20:20:00.758099] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-14T20:20:01.558126] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-14T20:20:02.358188] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-14T20:20:03.549442] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (3.59 seconds). [2025-10-14T20:20:03.556245] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-14T20:20:04.107820] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (3.35 seconds). [2025-10-14T20:20:04.114248] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-14T20:20:04.542284] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-14T20:20:04.703443] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-10-14T20:20:04.736860] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T20:20:04.758037] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-14T20:20:05.093908] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T20:20:05.558093] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-14T20:20:06.216515] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T20:20:06.230634] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:20:06.234015] [INFO ] [REMOTE ] MTUS: Full fetch complete (41330 records). [2025-10-14T20:20:06.234124] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-14T20:20:06.234764] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:20:06.234854] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:20:06.234899] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:20:06.234969] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-14T20:20:06.235041] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-14T20:20:06.235110] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-14T20:20:06.235152] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-14T20:20:06.235210] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTUS took 31.2s. Estimated remaining: 2h 13m 27s. Rate: 7.1 symbols/min [2025-10-14T20:20:06.363210] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-14T20:20:06.424927] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:06.425197] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-14T20:20:06.425250] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-14T20:20:06.425379] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-14T20:20:06.425424] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-14T20:20:06.425469] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-14T20:20:06.425503] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-14T20:20:06.808481] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:07.158104] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-14T20:20:07.815897] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T20:20:07.958119] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-14T20:20:08.532012] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T20:20:08.758106] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-14T20:20:09.096238] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T20:20:09.558067] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-14T20:20:09.891111] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T20:20:10.193076] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:20:10.195876] [INFO ] [REMOTE ] MTW: Full fetch complete (38023 records). [2025-10-14T20:20:10.195973] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-14T20:20:10.196695] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:20:10.196781] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:20:10.196822] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:20:10.196860] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-14T20:20:10.196914] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-14T20:20:10.196950] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-14T20:20:10.196989] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-14T20:20:10.197044] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTW took 28.8s. Estimated remaining: 2h 13m 16s. Rate: 7.1 symbols/min [2025-10-14T20:20:10.366323] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-14T20:20:10.387606] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:10.399959] [DEBUG] [LOCAL ] MUA: Loaded 11599 existing records from primary storage. [2025-10-14T20:20:10.400266] [INFO ] [MAIN ] MUA: Loaded 11599 existing records. [2025-10-14T20:20:10.583606] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:20:10.583886] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-14T20:20:10.583966] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-14T20:20:10.584261] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-14T20:20:10.584318] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-14T20:20:10.940050] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:11.158086] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-14T20:20:11.534600] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T20:20:11.958087] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-14T20:20:12.758128] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-14T20:20:12.846920] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T20:20:12.894610] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T20:20:13.558080] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-14T20:20:14.355624] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T20:20:14.361866] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-14T20:20:14.649942] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T20:20:15.158119] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-14T20:20:15.958082] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-14T20:20:16.071993] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T20:20:16.234260] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T20:20:16.758089] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-14T20:20:17.196908] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T20:20:17.355077] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:20:17.357156] [INFO ] [REMOTE ] MTRN: Full fetch complete (23726 records). [2025-10-14T20:20:17.357240] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-14T20:20:17.357747] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:20:17.357831] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:20:17.357872] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:20:17.357910] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-14T20:20:17.357964] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-14T20:20:17.357998] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-14T20:20:17.358036] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-14T20:20:17.358087] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTRN took 47.9s. Estimated remaining: 2h 13m 7s. Rate: 7.1 symbols/min [2025-10-14T20:20:17.535795] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:17.535994] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-14T20:20:17.536058] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-14T20:20:17.536196] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-14T20:20:17.536238] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-14T20:20:17.536281] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-14T20:20:17.536314] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-14T20:20:17.566359] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-14T20:20:17.912620] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:18.358059] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-14T20:20:18.719933] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T20:20:19.158062] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-14T20:20:19.733126] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T20:20:19.787330] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:20:19.789442] [INFO ] [REMOTE ] MTX: Full fetch complete (31130 records). [2025-10-14T20:20:19.789509] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-14T20:20:19.789970] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:20:19.790051] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:20:19.790092] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:20:19.790184] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-14T20:20:19.790264] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-14T20:20:19.790303] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-14T20:20:19.790343] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-14T20:20:19.790395] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MTX took 37.4s. Estimated remaining: 2h 12m 54s. Rate: 7.1 symbols/min [2025-10-14T20:20:19.964457] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-14T20:20:19.969150] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:19.982479] [DEBUG] [LOCAL ] MUE: Loaded 11803 existing records from primary storage. [2025-10-14T20:20:19.982715] [INFO ] [MAIN ] MUE: Loaded 11803 existing records. [2025-10-14T20:20:20.169178] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:20:20.169430] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-14T20:20:20.169477] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-14T20:20:20.169875] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-14T20:20:20.169933] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-14T20:20:20.526259] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:20.758037] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-14T20:20:21.142255] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:20:21.558051] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-14T20:20:21.739308] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T20:20:22.358116] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-14T20:20:23.158056] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-14T20:20:23.362789] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T20:20:23.388729] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:20:23.935392] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T20:20:23.958040] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-14T20:20:24.758080] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-14T20:20:24.770143] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T20:20:25.558050] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-14T20:20:25.977022] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T20:20:26.358041] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-14T20:20:26.434113] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T20:20:27.158107] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-14T20:20:27.958077] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-14T20:20:28.104502] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T20:20:28.264183] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T20:20:28.699485] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T20:20:28.758098] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-14T20:20:29.558097] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-14T20:20:30.358046] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-14T20:20:30.501321] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T20:20:30.520231] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T20:20:31.158106] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-14T20:20:31.403750] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T20:20:31.958049] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-14T20:20:32.041101] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T20:20:32.758074] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-14T20:20:33.087123] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T20:20:33.558070] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-14T20:20:34.286755] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T20:20:34.337358] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T20:20:34.358032] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-14T20:20:35.158115] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-14T20:20:35.553876] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T20:20:35.958046] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-14T20:20:36.176736] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T20:20:36.758067] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-14T20:20:37.214192] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T20:20:37.558068] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-14T20:20:37.773225] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T20:20:38.358074] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-14T20:20:38.880227] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T20:20:39.158118] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-14T20:20:39.847625] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:20:39.850599] [INFO ] [REMOTE ] MUC: Full fetch complete (29517 records). [2025-10-14T20:20:39.850793] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-14T20:20:39.851614] [FATAL] [VALIDATOR ] MUC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:20:39.851931] [FATAL] [MAIN ] MUC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:20:39.852016] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:20:39.852064] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-14T20:20:39.852128] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-14T20:20:39.852164] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-14T20:20:39.852203] [DEBUG] [LOCAL ] MUC: No derivative data file found to delete. [2025-10-14T20:20:39.852267] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MUC took 22.5s. Estimated remaining: 2h 12m 53s. Rate: 7.1 symbols/min [2025-10-14T20:20:39.969096] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-14T20:20:40.055133] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:40.055838] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-14T20:20:40.055917] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-14T20:20:40.056320] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-14T20:20:40.056625] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-14T20:20:40.056902] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-14T20:20:40.056963] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-14T20:20:40.337956] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T20:20:40.720246] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:40.758135] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-14T20:20:40.899353] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T20:20:41.361208] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T20:20:41.558103] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-14T20:20:42.358052] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-14T20:20:42.520577] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:20:43.158117] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-14T20:20:43.958057] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-14T20:20:44.144329] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T20:20:44.600521] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T20:20:44.638675] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T20:20:44.758092] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-14T20:20:44.866593] [DEBUG] [REMOTE ] MUA: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-14T20:20:44.867091] [WARN ] [REMOTE ] MUA: No data returned for month 2025-08 [2025-10-14T20:20:44.867190] [FATAL] [REMOTE ] MUA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:20:44.867285] [FATAL] [MAIN ] MUA: Failed to fetch primary data. [2025-10-14T20:20:44.867348] [WARN ] [MAIN ] MUA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:20:44.867426] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-14T20:20:44.867499] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-14T20:20:44.867539] [INFO ] [LOCAL ] MUA: Starting deletion of derivative data. [2025-10-14T20:20:44.868033] [DEBUG] [LOCAL ] MUA: Deleted derivative data file. [2025-10-14T20:20:44.868130] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MUA took 34.7s. Estimated remaining: 2h 12m 43s. Rate: 7.1 symbols/min [2025-10-14T20:20:45.047183] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:45.047441] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-14T20:20:45.047480] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-14T20:20:45.047659] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-14T20:20:45.047718] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-14T20:20:45.047766] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-14T20:20:45.047801] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-14T20:20:45.427868] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:45.558086] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-14T20:20:46.358130] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-14T20:20:47.158084] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-14T20:20:47.390529] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T20:20:47.505276] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T20:20:47.958070] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-14T20:20:48.260501] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T20:20:48.758039] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-14T20:20:48.918081] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T20:20:49.558066] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-14T20:20:50.358063] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-14T20:20:50.546184] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T20:20:50.601422] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T20:20:51.072429] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:20:51.075104] [INFO ] [REMOTE ] MUE: Full fetch complete (15927 records). [2025-10-14T20:20:51.075199] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-14T20:20:51.163298] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-14T20:20:51.470400] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-14T20:20:51.470478] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-14T20:20:51.470868] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-14T20:20:51.470930] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-14T20:20:51.471519] [DEBUG] [LOCAL ] MUE: Trimmed 15927 records to 11872 (keeping 200 days of data) [2025-10-14T20:20:51.546771] [DEBUG] [LOCAL ] MUE: Primary data saved (11872 records). [2025-10-14T20:20:51.546940] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-14T20:20:51.547054] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MUE took 31.8s. Estimated remaining: 2h 12m 33s. Rate: 7.1 symbols/min [2025-10-14T20:20:51.736362] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:51.736525] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-14T20:20:51.736564] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-14T20:20:51.736703] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-14T20:20:51.736754] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-14T20:20:51.736795] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-14T20:20:51.736826] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-14T20:20:51.974902] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-14T20:20:52.062843] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T20:20:52.119943] [INFO ] [REMOTE ] MTZ: Full fetch complete (63348 records). [2025-10-14T20:20:52.128026] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-14T20:20:52.140605] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:52.141191] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:20:52.141282] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:20:52.141325] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:20:52.141393] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-14T20:20:52.141454] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-14T20:20:52.141489] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-14T20:20:52.141527] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-14T20:20:52.141579] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MTZ took 45.9s. Estimated remaining: 2h 12m 19s. Rate: 7.1 symbols/min [2025-10-14T20:20:52.325521] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:20:52.325726] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-14T20:20:52.325781] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-14T20:20:52.325897] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-14T20:20:52.325938] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-14T20:20:52.325979] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-14T20:20:52.326011] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-14T20:20:52.695807] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:20:52.758031] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-14T20:20:53.045993] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T20:20:53.558066] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-14T20:20:53.914279] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T20:20:54.358071] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-14T20:20:55.158035] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-14T20:20:55.199301] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T20:20:55.553545] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T20:20:55.958057] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-14T20:20:56.088316] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T20:20:56.758096] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-14T20:20:57.558090] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-14T20:20:57.720291] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T20:20:58.358064] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-14T20:20:58.484328] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T20:20:58.587916] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:20:59.158061] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-14T20:20:59.970245] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-14T20:20:59.976486] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T20:21:00.131765] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T20:21:00.758114] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-14T20:21:01.558087] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-14T20:21:01.947033] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T20:21:02.358118] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-14T20:21:02.759169] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T20:21:02.796607] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T20:21:03.158099] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-14T20:21:03.958051] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-14T20:21:04.376818] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T20:21:04.758051] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-14T20:21:04.912207] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T20:21:05.202286] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T20:21:05.558064] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-14T20:21:06.112163] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T20:21:06.358087] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-14T20:21:07.158046] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-14T20:21:07.574074] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T20:21:07.862345] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T20:21:07.958041] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-14T20:21:08.758101] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-14T20:21:08.926424] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T20:21:09.213475] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T20:21:09.558069] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-14T20:21:10.358078] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-14T20:21:10.483425] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T20:21:10.891759] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T20:21:11.158116] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-14T20:21:11.321762] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:21:11.958089] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-14T20:21:12.758092] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-14T20:21:13.004024] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T20:21:13.558040] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-14T20:21:13.807783] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T20:21:14.055018] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-14T20:21:14.358082] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-14T20:21:14.500745] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T20:21:15.158042] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-14T20:21:15.357819] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T20:21:15.958119] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-14T20:21:16.758065] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-14T20:21:16.916929] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T20:21:17.558126] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-14T20:21:17.943424] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T20:21:17.949903] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T20:21:18.358109] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-14T20:21:18.861091] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:21:18.863180] [INFO ] [REMOTE ] MUJ: Full fetch complete (19780 records). [2025-10-14T20:21:18.863247] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-14T20:21:18.863713] [FATAL] [VALIDATOR ] MUJ: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:21:18.863805] [FATAL] [MAIN ] MUJ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:21:18.863879] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:21:18.863965] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-14T20:21:18.864041] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-14T20:21:18.864078] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-14T20:21:18.864118] [DEBUG] [LOCAL ] MUJ: No derivative data file found to delete. [2025-10-14T20:21:18.864171] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUJ took 34.0s. Estimated remaining: 2h 12m 23s. Rate: 7.1 symbols/min [2025-10-14T20:21:19.040366] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:19.040536] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-14T20:21:19.040575] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-14T20:21:19.040768] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-14T20:21:19.040827] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-14T20:21:19.040897] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-14T20:21:19.040963] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-14T20:21:19.162894] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-14T20:21:19.421818] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:19.451765] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T20:21:19.958062] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-14T20:21:20.407774] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T20:21:20.761535] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-14T20:21:20.765327] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:21:20.771248] [INFO ] [REMOTE ] MUR: Full fetch complete (76362 records). [2025-10-14T20:21:20.771383] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-14T20:21:20.772077] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:21:20.772170] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:21:20.772220] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:21:20.772289] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-14T20:21:20.772355] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-14T20:21:20.772408] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-14T20:21:20.772449] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-14T20:21:20.772505] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUR took 29.2s. Estimated remaining: 2h 12m 10s. Rate: 7.1 symbols/min [2025-10-14T20:21:20.957167] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:20.957346] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-14T20:21:20.957391] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-14T20:21:20.957505] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-14T20:21:20.957567] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-14T20:21:20.957842] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-14T20:21:20.957882] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-14T20:21:21.086757] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-14T20:21:21.321098] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:21.558065] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-14T20:21:22.358074] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-14T20:21:22.683811] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:21:22.684119] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-14T20:21:22.684252] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:21:22.684383] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-14T20:21:22.684469] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:21:22.684563] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-14T20:21:22.684676] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-14T20:21:22.684743] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-14T20:21:22.684790] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-14T20:21:22.684837] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUSE took 3.8s. Estimated remaining: 2h 11m 58s. Rate: 7.1 symbols/min [2025-10-14T20:21:22.860693] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:22.874629] [DEBUG] [LOCAL ] MVF: Loaded 12853 existing records from primary storage. [2025-10-14T20:21:22.874924] [INFO ] [MAIN ] MVF: Loaded 12853 existing records. [2025-10-14T20:21:23.065552] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:21:23.065842] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-14T20:21:23.065896] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-14T20:21:23.066226] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-14T20:21:23.066283] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-14T20:21:23.163277] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-14T20:21:23.478701] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:23.512054] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T20:21:23.813208] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T20:21:23.816938] [INFO ] [REMOTE ] MUSA: Full fetch complete (35033 records). [2025-10-14T20:21:23.817083] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-14T20:21:23.817827] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:21:23.817932] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:21:23.818014] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:21:23.818099] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-14T20:21:23.818181] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-14T20:21:23.818237] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-14T20:21:23.818320] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-14T20:21:23.818416] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MUSA took 31.7s. Estimated remaining: 2h 11m 44s. Rate: 7.1 symbols/min [2025-10-14T20:21:23.964871] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-14T20:21:23.999860] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:24.009774] [DEBUG] [LOCAL ] MVO: Loaded 8739 existing records from primary storage. [2025-10-14T20:21:24.009997] [INFO ] [MAIN ] MVO: Loaded 8739 existing records. [2025-10-14T20:21:24.204402] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:21:24.204676] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-14T20:21:24.204745] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-14T20:21:24.205011] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-14T20:21:24.205068] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-14T20:21:24.558105] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:24.758087] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-14T20:21:25.103676] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T20:21:25.558056] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-14T20:21:26.255992] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T20:21:26.358079] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-14T20:21:26.463295] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T20:21:27.158069] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-14T20:21:27.958062] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-14T20:21:28.090593] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T20:21:28.202946] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T20:21:28.547836] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T20:21:28.758048] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-14T20:21:29.558067] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-14T20:21:30.314876] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T20:21:30.358031] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-14T20:21:30.405175] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T20:21:31.158032] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-14T20:21:31.313862] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T20:21:31.958049] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-14T20:21:32.184573] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T20:21:32.758059] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-14T20:21:32.870800] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-14T20:21:33.558063] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-14T20:21:34.247215] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T20:21:34.266942] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T20:21:34.358061] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-14T20:21:35.158076] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-14T20:21:35.172180] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T20:21:35.850146] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:21:35.855638] [INFO ] [REMOTE ] MUFG: Full fetch complete (75419 records). [2025-10-14T20:21:35.855828] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-14T20:21:35.856526] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:21:35.856622] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:21:35.856762] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:21:35.856838] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-14T20:21:35.856904] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-14T20:21:35.856940] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-14T20:21:35.856982] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-14T20:21:35.857039] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUFG took 56.0s. Estimated remaining: 2h 11m 38s. Rate: 7.1 symbols/min [2025-10-14T20:21:35.963201] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-14T20:21:36.053211] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:36.063556] [DEBUG] [LOCAL ] MVT: Loaded 10048 existing records from primary storage. [2025-10-14T20:21:36.063800] [INFO ] [MAIN ] MVT: Loaded 10048 existing records. [2025-10-14T20:21:36.241946] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:21:36.242163] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-14T20:21:36.242229] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-14T20:21:36.242548] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-14T20:21:36.242608] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-14T20:21:36.618204] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:36.758069] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-14T20:21:37.542105] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T20:21:37.558029] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-14T20:21:37.696423] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:21:38.358061] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-14T20:21:39.096183] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T20:21:39.158081] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-14T20:21:39.261181] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T20:21:39.958056] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-14T20:21:40.651350] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T20:21:40.758073] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-14T20:21:40.842268] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T20:21:41.401390] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T20:21:41.558047] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-14T20:21:42.034931] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T20:21:42.358051] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-14T20:21:43.158112] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-14T20:21:43.364480] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T20:21:43.958057] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-14T20:21:43.976583] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T20:21:44.758057] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-14T20:21:44.786940] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T20:21:45.380842] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T20:21:45.558070] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-14T20:21:46.312396] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T20:21:46.358070] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-14T20:21:47.158054] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-14T20:21:47.171147] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T20:21:47.958062] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-14T20:21:48.758050] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-14T20:21:48.942120] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T20:21:48.979787] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T20:21:49.558086] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-14T20:21:49.659637] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T20:21:50.358119] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-14T20:21:50.559201] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:21:51.158043] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-14T20:21:51.864310] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T20:21:51.958035] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-14T20:21:51.972870] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T20:21:52.758090] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-14T20:21:53.558055] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-14T20:21:53.622322] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T20:21:53.624871] [INFO ] [REMOTE ] MVF: Full fetch complete (18565 records). [2025-10-14T20:21:53.625075] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-14T20:21:53.871364] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-14T20:21:54.070979] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-14T20:21:54.071059] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-14T20:21:54.071440] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-14T20:21:54.071498] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-14T20:21:54.072066] [DEBUG] [LOCAL ] MVF: Trimmed 18565 records to 12789 (keeping 200 days of data) [2025-10-14T20:21:54.145489] [DEBUG] [LOCAL ] MVF: Primary data saved (12789 records). [2025-10-14T20:21:54.145622] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-14T20:21:54.145747] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MVF took 31.5s. Estimated remaining: 2h 11m 36s. Rate: 7.1 symbols/min [2025-10-14T20:21:54.304890] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T20:21:54.335367] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:54.335937] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-14T20:21:54.335983] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-14T20:21:54.336099] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-14T20:21:54.336164] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-14T20:21:54.336228] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-14T20:21:54.336265] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-14T20:21:54.366561] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-14T20:21:54.696372] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:55.158056] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-14T20:21:55.289173] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T20:21:55.958053] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-14T20:21:55.973980] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T20:21:56.758056] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-14T20:21:56.845006] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T20:21:57.558043] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-14T20:21:57.714869] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T20:21:57.720178] [INFO ] [REMOTE ] MUX: Full fetch complete (60191 records). [2025-10-14T20:21:57.720281] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-14T20:21:57.720953] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:21:57.721036] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:21:57.721090] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:21:57.721174] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-14T20:21:57.721250] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-14T20:21:57.721296] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-14T20:21:57.721349] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-14T20:21:57.721428] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MUX took 36.9s. Estimated remaining: 2h 11m 25s. Rate: 7.1 symbols/min [2025-10-14T20:21:57.896327] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:21:57.917177] [DEBUG] [LOCAL ] MX: Loaded 22418 existing records from primary storage. [2025-10-14T20:21:57.917688] [INFO ] [MAIN ] MX: Loaded 22418 existing records. [2025-10-14T20:21:58.103604] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:21:58.103879] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-14T20:21:58.103966] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-14T20:21:58.104386] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-14T20:21:58.104445] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-14T20:21:58.359491] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-14T20:21:58.425395] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T20:21:58.484066] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:21:59.158107] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-14T20:21:59.348045] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T20:21:59.958087] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-14T20:22:00.728109] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T20:22:00.758037] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-14T20:22:00.786105] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:22:00.787607] [INFO ] [REMOTE ] MVO: Full fetch complete (14595 records). [2025-10-14T20:22:00.787700] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-14T20:22:01.168986] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-14T20:22:01.169069] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-14T20:22:01.169433] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-14T20:22:01.169497] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-14T20:22:01.170135] [DEBUG] [LOCAL ] MVO: Trimmed 14595 records to 8805 (keeping 200 days of data) [2025-10-14T20:22:01.222315] [DEBUG] [LOCAL ] MVO: Primary data saved (8805 records). [2025-10-14T20:22:01.222477] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-14T20:22:01.222565] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MVO took 37.4s. Estimated remaining: 2h 11m 13s. Rate: 7.1 symbols/min [2025-10-14T20:22:01.462060] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:22:01.462279] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-14T20:22:01.462327] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-14T20:22:01.462441] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-14T20:22:01.462482] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-14T20:22:01.462524] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-14T20:22:01.462556] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-14T20:22:01.563247] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-14T20:22:01.821233] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:22:02.358093] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-14T20:22:02.453441] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T20:22:02.914207] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T20:22:02.941305] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T20:22:03.158116] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-14T20:22:03.958073] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-14T20:22:04.672105] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:22:04.674190] [INFO ] [REMOTE ] MVT: Full fetch complete (14227 records). [2025-10-14T20:22:04.674376] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-14T20:22:04.760211] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-14T20:22:05.062952] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T20:22:05.104219] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-14T20:22:05.104414] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-14T20:22:05.105100] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-14T20:22:05.105179] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-14T20:22:05.105915] [DEBUG] [LOCAL ] MVT: Trimmed 14227 records to 10023 (keeping 200 days of data) [2025-10-14T20:22:05.164244] [DEBUG] [LOCAL ] MVT: Primary data saved (10023 records). [2025-10-14T20:22:05.164369] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-14T20:22:05.164445] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MVT took 29.3s. Estimated remaining: 2h 11m 2s. Rate: 7.1 symbols/min [2025-10-14T20:22:05.558068] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-14T20:22:05.815763] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T20:22:06.358070] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-14T20:22:07.158116] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-14T20:22:07.429090] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T20:22:07.479532] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T20:22:07.687261] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-14T20:22:07.958076] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-14T20:22:08.758118] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-14T20:22:09.132290] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T20:22:09.558065] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-14T20:22:09.939130] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-14T20:22:10.358079] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-14T20:22:10.409749] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T20:22:10.902977] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T20:22:11.158120] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-14T20:22:11.958167] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-14T20:22:12.679507] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T20:22:12.758077] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-14T20:22:13.093983] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T20:22:13.558103] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-14T20:22:14.062894] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T20:22:14.358081] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-14T20:22:14.456801] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T20:22:14.752939] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-14T20:22:15.158074] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-14T20:22:15.958115] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-14T20:22:16.623999] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T20:22:16.758441] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-14T20:22:16.790013] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T20:22:17.558069] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-14T20:22:18.367289] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-14T20:22:18.370261] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T20:22:18.674090] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T20:22:18.724370] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T20:22:19.158164] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-14T20:22:19.958129] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-14T20:22:20.758218] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-14T20:22:20.806578] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T20:22:21.070246] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T20:22:21.143415] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-14T20:22:21.558155] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-14T20:22:22.070180] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-14T20:22:22.358077] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-14T20:22:22.902944] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T20:22:23.158196] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-14T20:22:23.958120] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-14T20:22:24.466614] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T20:22:24.536995] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:22:24.541633] [INFO ] [REMOTE ] MWA: Full fetch complete (67486 records). [2025-10-14T20:22:24.541785] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-14T20:22:24.542381] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:22:24.542465] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:22:24.542508] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:22:24.542546] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-14T20:22:24.542600] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-14T20:22:24.542635] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-14T20:22:24.542723] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-14T20:22:24.542785] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MWA took 30.4s. Estimated remaining: 2h 11m 0s. Rate: 7.1 symbols/min [2025-10-14T20:22:24.758087] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-14T20:22:25.558096] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-14T20:22:25.900890] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T20:22:25.901862] [INFO ] [REMOTE ] MXE: Full fetch complete (2613 records). [2025-10-14T20:22:25.902008] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-14T20:22:26.032223] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T20:22:26.104039] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T20:22:26.104256] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:22:26.104324] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:22:26.104399] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-14T20:22:26.104460] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-14T20:22:26.104494] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-14T20:22:26.104549] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-14T20:22:26.104603] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MXE took 24.9s. Estimated remaining: 2h 10m 47s. Rate: 7.1 symbols/min [2025-10-14T20:22:26.358122] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-14T20:22:27.417803] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T20:22:27.420786] [INFO ] [REMOTE ] MX: Full fetch complete (31668 records). [2025-10-14T20:22:27.420877] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-14T20:22:27.832746] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-14T20:22:27.832855] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-14T20:22:27.833922] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-14T20:22:27.833990] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-14T20:22:27.835084] [DEBUG] [LOCAL ] MX: Trimmed 31668 records to 22352 (keeping 200 days of data) [2025-10-14T20:22:27.973076] [DEBUG] [LOCAL ] MX: Primary data saved (22352 records). [2025-10-14T20:22:27.973249] [INFO ] [MAIN ] MX: Full history saved. [2025-10-14T20:22:27.973343] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MX took 30.3s. Estimated remaining: 2h 10m 35s. Rate: 7.1 symbols/min [2025-10-14T20:22:28.665900] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:22:28.699884] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-14T20:22:28.701931] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:22:28.735197] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:22:28.758182] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-14T20:22:28.757801] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:22:28.752053] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-14T20:22:28.758828] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-14T20:22:28.759140] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-14T20:22:28.759375] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-14T20:22:28.759871] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-14T20:22:28.759981] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-14T20:22:28.760108] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-14T20:22:28.760268] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-14T20:22:28.760377] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-14T20:22:28.758477] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-14T20:22:28.765788] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-14T20:22:28.766038] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-14T20:22:28.766305] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-14T20:22:28.775424] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-14T20:22:28.780900] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-14T20:22:28.775595] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-14T20:22:28.829208] [DEBUG] [LOCAL ] MXF: Loaded 5650 existing records from primary storage. [2025-10-14T20:22:28.890297] [INFO ] [MAIN ] MXF: Loaded 5650 existing records. [2025-10-14T20:22:29.728568] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:22:29.820808] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-14T20:22:29.851261] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-14T20:22:29.893108] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-14T20:22:29.925241] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-14T20:22:30.055064] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:22:30.080025] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:22:30.132046] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-14T20:22:30.131814] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-14T20:22:30.213012] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:22:30.225322] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-14T20:22:30.498216] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:22:30.498502] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-14T20:22:31.377940] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T20:22:31.382756] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-14T20:22:31.415342] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T20:22:31.418076] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-14T20:22:31.470522] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T20:22:31.491958] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T20:22:31.958060] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-14T20:22:32.311439] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T20:22:32.321674] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T20:22:32.758071] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-14T20:22:33.202183] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T20:22:33.558047] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-14T20:22:33.792382] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:22:34.358078] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-14T20:22:34.717575] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T20:22:35.158098] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-14T20:22:35.181774] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T20:22:35.958073] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-14T20:22:36.605068] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T20:22:36.751485] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T20:22:36.758023] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-14T20:22:37.386240] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T20:22:37.558064] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-14T20:22:38.358065] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-14T20:22:38.754761] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T20:22:39.158051] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-14T20:22:39.542565] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:22:39.923895] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T20:22:39.958092] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-14T20:22:40.758080] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-14T20:22:41.068024] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T20:22:41.404979] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T20:22:41.558105] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-14T20:22:42.358151] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-14T20:22:42.699111] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T20:22:43.158111] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-14T20:22:43.502359] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T20:22:43.958077] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-14T20:22:44.400218] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T20:22:44.758090] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-14T20:22:45.040033] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T20:22:45.558098] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-14T20:22:45.652997] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T20:22:46.358064] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-14T20:22:46.740951] [DEBUG] [REMOTE ] MXF: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-14T20:22:46.741343] [WARN ] [REMOTE ] MXF: No data returned for month 2025-07 [2025-10-14T20:22:46.741429] [FATAL] [REMOTE ] MXF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:22:46.741519] [FATAL] [MAIN ] MXF: Failed to fetch primary data. [2025-10-14T20:22:46.741605] [WARN ] [MAIN ] MXF: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:22:46.741698] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-14T20:22:46.741785] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-14T20:22:46.741834] [INFO ] [LOCAL ] MXF: Starting deletion of derivative data. [2025-10-14T20:22:46.742035] [DEBUG] [LOCAL ] MXF: Deleted derivative data file. [2025-10-14T20:22:46.742132] [INFO ] [MAIN ] Update Progress: 1441/2369 symbols completed. MXF took 18.8s. Estimated remaining: 2h 10m 33s. Rate: 7.1 symbols/min [2025-10-14T20:22:46.869996] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T20:22:46.941089] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:22:46.952828] [DEBUG] [LOCAL ] MYN: Loaded 9831 existing records from primary storage. [2025-10-14T20:22:46.953086] [INFO ] [MAIN ] MYN: Loaded 9831 existing records. [2025-10-14T20:22:47.166559] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-14T20:22:47.173891] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:22:47.174853] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-14T20:22:47.174928] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-14T20:22:47.175315] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-14T20:22:47.175396] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-14T20:22:47.551241] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:22:47.958068] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-14T20:22:48.463109] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T20:22:48.758074] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-14T20:22:48.825176] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T20:22:49.558056] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-14T20:22:49.666855] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T20:22:50.231915] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T20:22:50.358059] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-14T20:22:51.158083] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-14T20:22:51.250014] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T20:22:51.958061] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-14T20:22:52.206611] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T20:22:52.758067] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-14T20:22:53.558069] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-14T20:22:54.358058] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-14T20:23:05.017072] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (10.66 seconds). [2025-10-14T20:23:05.020742] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-14T20:23:05.191005] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (12.43 seconds). [2025-10-14T20:23:05.193951] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-14T20:23:05.256712] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (11.70 seconds). [2025-10-14T20:23:05.260886] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-14T20:23:06.262825] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (14.30 seconds). [2025-10-14T20:23:06.268506] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-14T20:23:06.974513] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T20:23:06.977815] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-14T20:23:07.012485] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T20:23:07.015436] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-14T20:23:07.128198] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T20:23:07.132601] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-14T20:23:07.148798] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T20:23:07.154160] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-14T20:23:07.771710] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T20:23:07.775072] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-14T20:23:07.789762] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:23:07.793004] [INFO ] [REMOTE ] MYE: Full fetch complete (36078 records). [2025-10-14T20:23:07.793080] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-14T20:23:07.793547] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:07.793629] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:07.793727] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:07.793800] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-14T20:23:07.793862] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-14T20:23:07.793896] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-14T20:23:07.793954] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-14T20:23:07.794007] [INFO ] [MAIN ] Update Progress: 1442/2369 symbols completed. MYE took 39.8s. Estimated remaining: 2h 10m 33s. Rate: 7.1 symbols/min [2025-10-14T20:23:07.965829] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:07.966079] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-14T20:23:07.966155] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-14T20:23:07.966325] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-14T20:23:07.966380] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-14T20:23:07.973756] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-14T20:23:07.978224] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-14T20:23:08.027168] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:23:08.071843] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T20:23:08.086392] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-14T20:23:08.098285] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-14T20:23:08.360233] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:08.360732] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-14T20:23:08.464817] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T20:23:08.472804] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-14T20:23:08.472976] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T20:23:08.475673] [INFO ] [REMOTE ] MYI: Full fetch complete (28566 records). [2025-10-14T20:23:08.475743] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-14T20:23:08.476177] [FATAL] [VALIDATOR ] MYI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:08.476278] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:08.476320] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:08.476358] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-14T20:23:08.476406] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-14T20:23:08.476439] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-14T20:23:08.476555] [DEBUG] [LOCAL ] MYI: No derivative data file found to delete. [2025-10-14T20:23:08.476626] [INFO ] [MAIN ] Update Progress: 1443/2369 symbols completed. MYI took 40.5s. Estimated remaining: 2h 10m 19s. Rate: 7.1 symbols/min [2025-10-14T20:23:08.645704] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:08.645857] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-14T20:23:08.645894] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-14T20:23:08.645998] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-14T20:23:08.646037] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-14T20:23:08.646076] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-14T20:23:08.646106] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-14T20:23:08.766223] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-14T20:23:08.809857] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-14T20:23:08.961621] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T20:23:09.003441] [INFO ] [REMOTE ] MYD: Full fetch complete (20190 records). [2025-10-14T20:23:09.006096] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-14T20:23:09.014068] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:09.034528] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:09.034861] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-14T20:23:09.034599] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:09.035624] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:09.035736] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-14T20:23:09.035831] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-14T20:23:09.035894] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-14T20:23:09.035966] [DEBUG] [LOCAL ] MYD: No derivative data file found to delete. [2025-10-14T20:23:09.036031] [INFO ] [MAIN ] Update Progress: 1444/2369 symbols completed. MYD took 41.1s. Estimated remaining: 2h 10m 6s. Rate: 7.1 symbols/min [2025-10-14T20:23:09.205750] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:09.205879] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-14T20:23:09.205915] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-14T20:23:09.206025] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-14T20:23:09.206122] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-14T20:23:09.206185] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-14T20:23:09.206232] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-14T20:23:09.550052] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T20:23:09.592529] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-14T20:23:09.596710] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:09.597693] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-14T20:23:09.790145] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T20:23:09.793220] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-14T20:23:10.138277] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T20:23:10.144834] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-14T20:23:10.743965] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-14T20:23:10.747027] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-14T20:23:10.907516] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T20:23:10.934546] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T20:23:11.158078] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-14T20:23:11.358507] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T20:23:11.425025] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T20:23:11.958103] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-14T20:23:12.182885] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T20:23:12.758046] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-14T20:23:13.092955] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T20:23:13.558064] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-14T20:23:14.161451] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T20:23:14.358040] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-14T20:23:14.757629] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T20:23:15.158070] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-14T20:23:15.958085] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-14T20:23:16.002090] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T20:23:16.492534] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T20:23:16.758073] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-14T20:23:16.879501] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T20:23:17.558060] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-14T20:23:17.998158] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T20:23:18.358065] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-14T20:23:19.129526] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:23:19.130910] [INFO ] [REMOTE ] MYN: Full fetch complete (15062 records). [2025-10-14T20:23:19.130977] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-14T20:23:19.163132] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-14T20:23:19.358552] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T20:23:19.557046] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-14T20:23:19.557118] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-14T20:23:19.557481] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-14T20:23:19.557543] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-14T20:23:19.558126] [DEBUG] [LOCAL ] MYN: Trimmed 15062 records to 9799 (keeping 200 days of data) [2025-10-14T20:23:19.618574] [DEBUG] [LOCAL ] MYN: Primary data saved (9799 records). [2025-10-14T20:23:19.618717] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-14T20:23:19.618806] [INFO ] [MAIN ] Update Progress: 1445/2369 symbols completed. MYN took 32.9s. Estimated remaining: 2h 9m 59s. Rate: 7.1 symbols/min [2025-10-14T20:23:19.794609] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:19.794784] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-14T20:23:19.794834] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-14T20:23:19.794944] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-14T20:23:19.794984] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-14T20:23:19.795024] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-14T20:23:19.795056] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-14T20:23:19.964090] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-14T20:23:20.174459] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:20.616958] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T20:23:20.758076] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-14T20:23:21.257707] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T20:23:21.558038] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-14T20:23:21.646461] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T20:23:22.358089] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-14T20:23:22.766449] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T20:23:23.158082] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-14T20:23:23.675624] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T20:23:23.958064] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-14T20:23:23.996048] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T20:23:24.758036] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-14T20:23:25.309637] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T20:23:25.558090] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-14T20:23:25.624775] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T20:23:26.358037] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-14T20:23:26.430024] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T20:23:27.158211] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-14T20:23:27.554116] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T20:23:27.958075] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-14T20:23:28.608968] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T20:23:28.758106] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-14T20:23:28.804337] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T20:23:29.558078] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-14T20:23:29.964500] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T20:23:30.358093] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-14T20:23:30.919419] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T20:23:31.158066] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-14T20:23:31.938206] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T20:23:31.958050] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-14T20:23:31.991981] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T20:23:32.758121] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-14T20:23:33.423072] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T20:23:33.558057] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-14T20:23:34.231446] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T20:23:34.243564] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T20:23:34.358073] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-14T20:23:35.158131] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-14T20:23:35.273327] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T20:23:35.958090] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-14T20:23:36.618903] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T20:23:36.758079] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-14T20:23:37.547087] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T20:23:37.558024] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-14T20:23:37.622183] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T20:23:38.358060] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-14T20:23:39.058421] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:23:39.058211] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T20:23:39.068901] [INFO ] [REMOTE ] NAC: Full fetch complete (35453 records). [2025-10-14T20:23:39.069011] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-14T20:23:39.069867] [FATAL] [VALIDATOR ] NAC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:39.069959] [FATAL] [MAIN ] NAC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:39.070034] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:39.070124] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-14T20:23:39.070202] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-14T20:23:39.070240] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-14T20:23:39.070278] [DEBUG] [LOCAL ] NAC: No derivative data file found to delete. [2025-10-14T20:23:39.070330] [INFO ] [MAIN ] Update Progress: 1446/2369 symbols completed. NAC took 30.6s. Estimated remaining: 2h 9m 57s. Rate: 7.1 symbols/min [2025-10-14T20:23:39.163173] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-14T20:23:39.251890] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:39.292726] [DEBUG] [LOCAL ] NAT: Loaded 49203 existing records from primary storage. [2025-10-14T20:23:39.293010] [INFO ] [MAIN ] NAT: Loaded 49203 existing records. [2025-10-14T20:23:39.469544] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:23:39.469780] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-14T20:23:39.469833] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-14T20:23:39.470684] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-14T20:23:39.470742] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-14T20:23:39.836534] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:39.958053] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-14T20:23:40.615072] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T20:23:40.758087] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-14T20:23:41.378035] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T20:23:41.381550] [INFO ] [REMOTE ] NAD: Full fetch complete (48919 records). [2025-10-14T20:23:41.381692] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-14T20:23:41.382315] [FATAL] [VALIDATOR ] NAD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:41.382397] [FATAL] [MAIN ] NAD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:41.382472] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:41.382553] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-14T20:23:41.382636] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-14T20:23:41.382737] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-14T20:23:41.382800] [DEBUG] [LOCAL ] NAD: No derivative data file found to delete. [2025-10-14T20:23:41.382877] [INFO ] [MAIN ] Update Progress: 1447/2369 symbols completed. NAD took 32.3s. Estimated remaining: 2h 9m 45s. Rate: 7.1 symbols/min [2025-10-14T20:23:41.558890] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-14T20:23:41.562564] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:41.563086] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-14T20:23:41.563132] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-14T20:23:41.563481] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-14T20:23:41.563526] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-14T20:23:41.563570] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-14T20:23:41.563605] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-14T20:23:41.984232] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:42.017784] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-14T20:23:42.358082] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-14T20:23:43.124592] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T20:23:43.158026] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-14T20:23:43.354024] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T20:23:43.905075] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:23:43.909301] [INFO ] [REMOTE ] NABL: Full fetch complete (56754 records). [2025-10-14T20:23:43.909428] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-14T20:23:43.910098] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:43.910183] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:43.910225] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:43.910265] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-14T20:23:43.910320] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-14T20:23:43.910359] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-14T20:23:43.910444] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-14T20:23:43.910506] [INFO ] [MAIN ] Update Progress: 1448/2369 symbols completed. NABL took 36.1s. Estimated remaining: 2h 9m 33s. Rate: 7.1 symbols/min [2025-10-14T20:23:43.964836] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-14T20:23:44.087432] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:44.091503] [DEBUG] [LOCAL ] NAZ: Loaded 2646 existing records from primary storage. [2025-10-14T20:23:44.091697] [INFO ] [MAIN ] NAZ: Loaded 2646 existing records. [2025-10-14T20:23:44.277413] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:23:44.277681] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-14T20:23:44.277739] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-14T20:23:44.277932] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-14T20:23:44.277989] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-14T20:23:44.649792] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:44.758075] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-14T20:23:45.202991] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T20:23:45.456369] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T20:23:45.558045] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-14T20:23:46.358060] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-14T20:23:47.158098] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-14T20:23:47.388753] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T20:23:47.728872] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T20:23:47.790543] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T20:23:47.958092] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-14T20:23:48.758068] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-14T20:23:49.366909] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T20:23:49.558080] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-14T20:23:49.645416] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T20:23:50.358061] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-14T20:23:50.991171] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:23:50.998868] [INFO ] [REMOTE ] NAN: Full fetch complete (13486 records). [2025-10-14T20:23:51.010723] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-14T20:23:51.011990] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T20:23:51.012361] [FATAL] [VALIDATOR ] NAN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:23:51.019022] [FATAL] [MAIN ] NAN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:23:51.019423] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:23:51.019826] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-14T20:23:51.019891] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-14T20:23:51.019927] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-14T20:23:51.019966] [DEBUG] [LOCAL ] NAN: No derivative data file found to delete. [2025-10-14T20:23:51.020018] [INFO ] [MAIN ] Update Progress: 1449/2369 symbols completed. NAN took 31.4s. Estimated remaining: 2h 9m 23s. Rate: 7.1 symbols/min [2025-10-14T20:23:51.163175] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-14T20:23:51.196523] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:23:51.207853] [DEBUG] [LOCAL ] NBB: Loaded 9057 existing records from primary storage. [2025-10-14T20:23:51.208071] [INFO ] [MAIN ] NBB: Loaded 9057 existing records. [2025-10-14T20:23:51.387894] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:23:51.388122] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-14T20:23:51.388169] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-14T20:23:51.388440] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-14T20:23:51.388496] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-14T20:23:51.738717] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:23:51.844127] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T20:23:51.958053] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-14T20:23:52.758028] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-14T20:23:52.772584] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T20:23:53.558085] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-14T20:23:54.171519] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T20:23:54.358088] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-14T20:23:54.504678] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T20:23:54.989768] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T20:23:55.158062] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-14T20:23:55.958081] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-14T20:23:56.758059] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-14T20:23:57.199521] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T20:23:57.558081] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-14T20:23:58.120593] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-10-14T20:23:58.358062] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-14T20:23:58.415697] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T20:23:58.666843] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T20:23:59.158058] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-14T20:23:59.706997] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T20:23:59.916223] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:23:59.958053] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-14T20:24:00.758043] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-14T20:24:00.784051] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T20:24:01.558066] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-14T20:24:02.358044] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-14T20:24:02.558858] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T20:24:02.589616] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T20:24:03.158123] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-14T20:24:03.313495] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:24:03.958086] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-14T20:24:04.135950] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T20:24:04.758121] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-14T20:24:05.395785] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T20:24:05.404185] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T20:24:05.558045] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-14T20:24:06.358055] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-14T20:24:06.388190] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T20:24:07.158059] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-14T20:24:07.918342] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T20:24:07.958021] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-14T20:24:08.055427] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T20:24:08.758065] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-14T20:24:09.319396] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T20:24:09.470543] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T20:24:09.558046] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-14T20:24:10.275752] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:24:10.279224] [INFO ] [REMOTE ] NATL: Full fetch complete (45196 records). [2025-10-14T20:24:10.279308] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-14T20:24:10.279898] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:24:10.279982] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:24:10.280024] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:24:10.280084] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-14T20:24:10.280145] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-14T20:24:10.280181] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-14T20:24:10.280219] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-14T20:24:10.280272] [INFO ] [MAIN ] Update Progress: 1450/2369 symbols completed. NATL took 28.9s. Estimated remaining: 2h 9m 22s. Rate: 7.1 symbols/min [2025-10-14T20:24:10.363121] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-14T20:24:10.455166] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:10.455315] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-14T20:24:10.455352] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-14T20:24:10.455465] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-14T20:24:10.455532] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-14T20:24:10.455598] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-14T20:24:10.455663] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-14T20:24:10.814923] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:11.029500] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-14T20:24:11.158045] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-14T20:24:11.958096] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-14T20:24:12.030081] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T20:24:12.758118] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-14T20:24:13.108557] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T20:24:13.558080] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-14T20:24:13.586249] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:24:13.587769] [INFO ] [REMOTE ] NBB: Full fetch complete (13657 records). [2025-10-14T20:24:13.587835] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-14T20:24:13.965920] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-14T20:24:13.966001] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-14T20:24:13.966344] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-14T20:24:13.966418] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-14T20:24:13.966924] [DEBUG] [LOCAL ] NBB: Trimmed 13657 records to 9084 (keeping 200 days of data) [2025-10-14T20:24:14.021813] [DEBUG] [LOCAL ] NBB: Primary data saved (9084 records). [2025-10-14T20:24:14.021934] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-14T20:24:14.022008] [INFO ] [MAIN ] Update Progress: 1451/2369 symbols completed. NBB took 23.0s. Estimated remaining: 2h 9m 10s. Rate: 7.1 symbols/min [2025-10-14T20:24:14.193994] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:14.194216] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-14T20:24:14.194272] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-14T20:24:14.194392] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-14T20:24:14.194434] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-14T20:24:14.194476] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-14T20:24:14.194507] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-14T20:24:14.371870] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-14T20:24:14.563971] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:14.635182] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T20:24:15.028743] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T20:24:15.158073] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-14T20:24:15.958100] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-14T20:24:16.597673] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T20:24:16.758134] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-14T20:24:17.130191] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T20:24:17.558059] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-14T20:24:17.806039] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T20:24:18.358106] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-14T20:24:18.523586] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T20:24:18.856821] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:24:18.858130] [INFO ] [REMOTE ] NAZ: Full fetch complete (4231 records). [2025-10-14T20:24:18.858216] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-14T20:24:19.162432] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-14T20:24:19.240180] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-14T20:24:19.240257] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-14T20:24:19.240446] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-14T20:24:19.240490] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-14T20:24:19.240854] [DEBUG] [LOCAL ] NAZ: Trimmed 4231 records to 2657 (keeping 200 days of data) [2025-10-14T20:24:19.256857] [DEBUG] [LOCAL ] NAZ: Primary data saved (2657 records). [2025-10-14T20:24:19.256914] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-14T20:24:19.256978] [INFO ] [MAIN ] Update Progress: 1452/2369 symbols completed. NAZ took 35.3s. Estimated remaining: 2h 8m 60s. Rate: 7.1 symbols/min [2025-10-14T20:24:19.426732] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:19.426903] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-14T20:24:19.426942] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-14T20:24:19.427053] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-14T20:24:19.427094] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-14T20:24:19.427135] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-14T20:24:19.427167] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-14T20:24:19.782328] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:19.958131] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-14T20:24:20.566149] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:24:20.758124] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-14T20:24:21.514577] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T20:24:21.558023] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-14T20:24:21.581064] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T20:24:22.358082] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-14T20:24:23.158037] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-14T20:24:23.297878] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T20:24:23.544376] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:24:23.958065] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-14T20:24:24.482351] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T20:24:24.758057] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-14T20:24:24.896974] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:24:25.558046] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-14T20:24:26.283912] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T20:24:26.358064] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-14T20:24:27.158058] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-14T20:24:27.368426] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T20:24:27.958121] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-14T20:24:28.110148] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T20:24:28.300227] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T20:24:28.758130] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-14T20:24:29.558086] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-14T20:24:29.579738] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T20:24:29.585381] [INFO ] [REMOTE ] NAT: Full fetch complete (72218 records). [2025-10-14T20:24:29.585481] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-14T20:24:29.971561] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-14T20:24:29.971750] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-14T20:24:29.973003] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-14T20:24:29.973136] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-14T20:24:29.974516] [DEBUG] [LOCAL ] NAT: Trimmed 72218 records to 49216 (keeping 200 days of data) [2025-10-14T20:24:30.256818] [DEBUG] [LOCAL ] NAT: Primary data saved (49216 records). [2025-10-14T20:24:30.256938] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-14T20:24:30.257013] [INFO ] [MAIN ] Update Progress: 1453/2369 symbols completed. NAT took 51.2s. Estimated remaining: 2h 8m 53s. Rate: 7.1 symbols/min [2025-10-14T20:24:30.360738] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-14T20:24:30.435743] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T20:24:30.452592] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:30.463233] [DEBUG] [LOCAL ] NC: Loaded 1951 existing records from primary storage. [2025-10-14T20:24:30.463375] [INFO ] [MAIN ] NC: Loaded 1951 existing records. [2025-10-14T20:24:30.639472] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:24:30.639706] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-14T20:24:30.639768] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-14T20:24:30.639944] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-14T20:24:30.640000] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-14T20:24:30.999761] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:31.019351] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T20:24:31.158042] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-14T20:24:31.605468] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T20:24:31.674144] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-14T20:24:31.958077] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-14T20:24:32.758069] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-14T20:24:33.196019] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T20:24:33.331269] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T20:24:33.558056] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-14T20:24:34.114233] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T20:24:34.358060] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-14T20:24:35.158070] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-14T20:24:35.837591] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T20:24:35.958034] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-14T20:24:36.281859] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T20:24:36.758081] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-14T20:24:37.451358] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T20:24:37.558036] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-14T20:24:37.920108] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T20:24:38.358076] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-14T20:24:39.158058] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-14T20:24:39.487620] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-14T20:24:39.557324] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T20:24:39.953511] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T20:24:39.958336] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-14T20:24:40.758067] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-14T20:24:41.558066] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-14T20:24:41.693073] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T20:24:41.868284] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T20:24:42.358087] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-14T20:24:42.730040] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T20:24:43.052928] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:24:43.056291] [INFO ] [REMOTE ] NBR: Full fetch complete (49151 records). [2025-10-14T20:24:43.056380] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-14T20:24:43.057010] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:24:43.057132] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:24:43.057199] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:24:43.057268] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-14T20:24:43.057329] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-14T20:24:43.057364] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-14T20:24:43.057403] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-14T20:24:43.057454] [INFO ] [MAIN ] Update Progress: 1454/2369 symbols completed. NBR took 29.0s. Estimated remaining: 2h 8m 47s. Rate: 7.1 symbols/min [2025-10-14T20:24:43.158904] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-14T20:24:43.232793] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:43.243191] [DEBUG] [LOCAL ] NCA: Loaded 9998 existing records from primary storage. [2025-10-14T20:24:43.243411] [INFO ] [MAIN ] NCA: Loaded 9998 existing records. [2025-10-14T20:24:43.425343] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:24:43.425559] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-14T20:24:43.425614] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-14T20:24:43.425926] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-14T20:24:43.425981] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-14T20:24:43.683730] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T20:24:43.786826] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:43.958038] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-14T20:24:44.758070] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-14T20:24:45.078415] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T20:24:45.558108] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-14T20:24:45.730031] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T20:24:46.358063] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-14T20:24:46.857326] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T20:24:46.979777] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T20:24:47.158070] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-14T20:24:47.958042] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-14T20:24:48.302388] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T20:24:48.695384] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-14T20:24:48.758074] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-14T20:24:49.558106] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-14T20:24:49.923997] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T20:24:50.358068] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-14T20:24:50.410292] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T20:24:50.953104] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:24:50.956679] [INFO ] [REMOTE ] NBXG: Full fetch complete (32475 records). [2025-10-14T20:24:50.956835] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-14T20:24:50.957532] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:24:50.957719] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:24:50.957807] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:24:50.957883] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-14T20:24:50.957956] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-14T20:24:50.957995] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-14T20:24:50.958036] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-14T20:24:50.958100] [INFO ] [MAIN ] Update Progress: 1455/2369 symbols completed. NBXG took 31.7s. Estimated remaining: 2h 8m 39s. Rate: 7.1 symbols/min [2025-10-14T20:24:51.131734] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:51.132057] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-14T20:24:51.132114] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-14T20:24:51.132233] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-14T20:24:51.132274] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-14T20:24:51.132314] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-14T20:24:51.132344] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-14T20:24:51.163176] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-14T20:24:51.509469] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:51.958042] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-14T20:24:52.177234] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T20:24:52.331624] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T20:24:52.334940] [INFO ] [REMOTE ] NBHC: Full fetch complete (32580 records). [2025-10-14T20:24:52.335039] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-14T20:24:52.335536] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:24:52.335608] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:24:52.335681] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:24:52.335745] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-14T20:24:52.335834] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-14T20:24:52.335894] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-14T20:24:52.335952] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-14T20:24:52.336045] [INFO ] [MAIN ] Update Progress: 1456/2369 symbols completed. NBHC took 42.1s. Estimated remaining: 2h 8m 26s. Rate: 7.1 symbols/min [2025-10-14T20:24:52.510951] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:24:52.511165] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-14T20:24:52.511206] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-14T20:24:52.511321] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-14T20:24:52.511361] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-14T20:24:52.511400] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-14T20:24:52.511430] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-14T20:24:52.763359] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-14T20:24:52.880214] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:24:53.558085] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-14T20:24:53.798695] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T20:24:54.358090] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-14T20:24:55.158058] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-14T20:24:55.715588] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-14T20:24:55.788679] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T20:24:55.801783] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T20:24:55.958068] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-14T20:24:56.758041] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-14T20:24:56.817953] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T20:24:57.291739] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T20:24:57.558122] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-14T20:24:58.358058] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-14T20:24:58.372381] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T20:24:59.158111] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-14T20:24:59.645685] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T20:24:59.660860] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T20:24:59.958098] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-14T20:25:00.469808] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-14T20:25:00.758073] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-14T20:25:01.558132] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-14T20:25:01.665180] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T20:25:02.358114] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-14T20:25:03.158110] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-14T20:25:03.606292] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T20:25:03.690623] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-14T20:25:03.958092] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-14T20:25:04.046002] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:25:04.758045] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-14T20:25:05.558070] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-14T20:25:06.011058] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-14T20:25:06.039027] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-14T20:25:06.221955] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T20:25:06.223162] [INFO ] [REMOTE ] NCA: Full fetch complete (14750 records). [2025-10-14T20:25:06.223228] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-14T20:25:06.363152] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-14T20:25:06.586999] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-14T20:25:06.587074] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-14T20:25:06.587422] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-14T20:25:06.587483] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-14T20:25:06.587996] [DEBUG] [LOCAL ] NCA: Trimmed 14750 records to 10006 (keeping 200 days of data) [2025-10-14T20:25:06.645842] [DEBUG] [LOCAL ] NCA: Primary data saved (10006 records). [2025-10-14T20:25:06.645966] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-14T20:25:06.646042] [INFO ] [MAIN ] Update Progress: 1457/2369 symbols completed. NCA took 23.6s. Estimated remaining: 2h 8m 21s. Rate: 7.1 symbols/min [2025-10-14T20:25:06.814665] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:06.829294] [DEBUG] [LOCAL ] NCV: Loaded 14007 existing records from primary storage. [2025-10-14T20:25:06.829512] [INFO ] [MAIN ] NCV: Loaded 14007 existing records. [2025-10-14T20:25:07.006746] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:25:07.006968] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-14T20:25:07.007021] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-14T20:25:07.007352] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-14T20:25:07.007409] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-14T20:25:07.179949] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-14T20:25:07.364550] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:07.640169] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T20:25:07.958052] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-14T20:25:08.758091] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-14T20:25:09.111820] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T20:25:09.248383] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T20:25:09.302433] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-14T20:25:09.558112] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-14T20:25:10.358093] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-14T20:25:10.771217] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T20:25:10.911412] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T20:25:11.158113] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-14T20:25:11.958067] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-14T20:25:12.080896] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T20:25:12.758089] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-14T20:25:13.558050] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-14T20:25:14.029341] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T20:25:14.213618] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-14T20:25:14.235996] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T20:25:14.358075] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-14T20:25:15.158048] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-14T20:25:15.533431] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:25:15.704684] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T20:25:15.705503] [INFO ] [REMOTE ] NC: Full fetch complete (2759 records). [2025-10-14T20:25:15.705569] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-14T20:25:15.963156] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-14T20:25:16.069067] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-14T20:25:16.069142] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-14T20:25:16.069250] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-14T20:25:16.069287] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-14T20:25:16.069608] [DEBUG] [LOCAL ] NC: Trimmed 2759 records to 1957 (keeping 200 days of data) [2025-10-14T20:25:16.081607] [DEBUG] [LOCAL ] NC: Primary data saved (1957 records). [2025-10-14T20:25:16.081702] [INFO ] [MAIN ] NC: Full history saved. [2025-10-14T20:25:16.081793] [INFO ] [MAIN ] Update Progress: 1458/2369 symbols completed. NC took 45.8s. Estimated remaining: 2h 8m 13s. Rate: 7.1 symbols/min [2025-10-14T20:25:16.251785] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:16.264450] [DEBUG] [LOCAL ] NCZ: Loaded 12406 existing records from primary storage. [2025-10-14T20:25:16.264697] [INFO ] [MAIN ] NCZ: Loaded 12406 existing records. [2025-10-14T20:25:16.439606] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:25:16.439830] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-14T20:25:16.439876] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-14T20:25:16.440208] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-14T20:25:16.440264] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-14T20:25:16.763937] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-14T20:25:16.793635] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:17.043177] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T20:25:17.558074] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-14T20:25:18.358062] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-14T20:25:18.625351] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T20:25:18.811252] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T20:25:19.110705] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T20:25:19.158030] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-14T20:25:19.726524] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T20:25:19.729732] [INFO ] [REMOTE ] NCDL: Full fetch complete (32869 records). [2025-10-14T20:25:19.729808] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-14T20:25:19.730296] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:25:19.730392] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:25:19.730469] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:25:19.730562] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-14T20:25:19.730672] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-14T20:25:19.730731] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-14T20:25:19.730783] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-14T20:25:19.730838] [INFO ] [MAIN ] Update Progress: 1459/2369 symbols completed. NCDL took 28.8s. Estimated remaining: 2h 8m 2s. Rate: 7.1 symbols/min [2025-10-14T20:25:19.909131] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:19.909285] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-14T20:25:19.909341] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-14T20:25:19.909481] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-14T20:25:19.909545] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-14T20:25:19.909592] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-14T20:25:19.909626] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-14T20:25:19.965289] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-14T20:25:20.280764] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:20.758061] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-14T20:25:21.558062] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-14T20:25:22.199794] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T20:25:22.241605] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-14T20:25:22.362156] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-14T20:25:22.364349] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T20:25:23.158068] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-14T20:25:23.958047] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-14T20:25:24.151739] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T20:25:24.638245] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-14T20:25:24.659781] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-14T20:25:24.758032] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-14T20:25:25.558034] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-14T20:25:25.630358] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T20:25:26.358086] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-14T20:25:26.961166] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:25:27.158083] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-14T20:25:27.958067] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-14T20:25:27.967095] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T20:25:28.241913] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T20:25:28.758038] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-14T20:25:29.046800] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T20:25:29.558064] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-14T20:25:29.757087] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T20:25:30.295380] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:25:30.358109] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-14T20:25:31.158041] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-14T20:25:31.298138] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:25:31.958046] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-14T20:25:32.209282] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T20:25:32.758048] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-14T20:25:33.063033] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T20:25:33.558083] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-14T20:25:33.762362] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:25:34.358167] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-14T20:25:34.522212] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T20:25:35.156478] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T20:25:35.158999] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-14T20:25:35.160549] [INFO ] [REMOTE ] NCV: Full fetch complete (22529 records). [2025-10-14T20:25:35.160666] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-14T20:25:35.546794] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-14T20:25:35.546871] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-14T20:25:35.547320] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-14T20:25:35.547358] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-14T20:25:35.547979] [DEBUG] [LOCAL ] NCV: Trimmed 22529 records to 13971 (keeping 200 days of data) [2025-10-14T20:25:35.632299] [DEBUG] [LOCAL ] NCV: Primary data saved (13971 records). [2025-10-14T20:25:35.632432] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-14T20:25:35.632509] [INFO ] [MAIN ] Update Progress: 1460/2369 symbols completed. NCV took 29.0s. Estimated remaining: 2h 7m 58s. Rate: 7.1 symbols/min [2025-10-14T20:25:35.807818] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:35.808276] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-14T20:25:35.808335] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-14T20:25:35.808488] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-14T20:25:35.808529] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-14T20:25:35.808569] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-14T20:25:35.808601] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-14T20:25:35.965208] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-14T20:25:36.188197] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:36.268705] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T20:25:36.758114] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-14T20:25:37.558058] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-14T20:25:38.044683] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-14T20:25:38.200613] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T20:25:38.358043] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-14T20:25:38.519064] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:25:39.158115] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-14T20:25:39.958107] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-14T20:25:40.083928] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T20:25:40.283520] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T20:25:40.758051] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-14T20:25:40.976005] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T20:25:41.558054] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-14T20:25:41.833832] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T20:25:42.358052] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-14T20:25:42.428756] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T20:25:43.158067] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-14T20:25:43.530447] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T20:25:43.958068] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-14T20:25:44.054155] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T20:25:44.514078] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T20:25:44.516256] [INFO ] [REMOTE ] NDMO: Full fetch complete (23774 records). [2025-10-14T20:25:44.516343] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-14T20:25:44.516912] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:25:44.516999] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:25:44.517042] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:25:44.517113] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-14T20:25:44.517175] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-14T20:25:44.517211] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-14T20:25:44.517253] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-14T20:25:44.517309] [INFO ] [MAIN ] Update Progress: 1461/2369 symbols completed. NDMO took 24.8s. Estimated remaining: 2h 7m 50s. Rate: 7.1 symbols/min [2025-10-14T20:25:44.727877] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:44.728119] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-14T20:25:44.728168] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-14T20:25:44.728279] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-14T20:25:44.728345] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-14T20:25:44.728395] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-14T20:25:44.728427] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-14T20:25:44.763160] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-14T20:25:45.080529] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:45.558054] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-14T20:25:45.850377] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T20:25:46.296304] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:25:46.302905] [INFO ] [REMOTE ] NCLH: Full fetch complete (77543 records). [2025-10-14T20:25:46.303116] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-14T20:25:46.304010] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:25:46.304103] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:25:46.304145] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:25:46.304188] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-14T20:25:46.304307] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-14T20:25:46.304351] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-14T20:25:46.304392] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-14T20:25:46.304454] [INFO ] [MAIN ] Update Progress: 1462/2369 symbols completed. NCLH took 54.0s. Estimated remaining: 2h 7m 37s. Rate: 7.1 symbols/min [2025-10-14T20:25:46.364786] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-14T20:25:46.488213] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:46.488394] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-14T20:25:46.488431] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-14T20:25:46.488545] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-14T20:25:46.488585] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-14T20:25:46.488625] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-14T20:25:46.488694] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-14T20:25:46.861332] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:47.158102] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-14T20:25:47.958076] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-14T20:25:48.095717] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T20:25:48.758079] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-14T20:25:48.796173] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T20:25:48.926129] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T20:25:49.558076] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-14T20:25:50.161895] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:25:50.358066] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-14T20:25:51.158072] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-14T20:25:51.372381] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T20:25:51.967832] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-14T20:25:51.991162] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-14T20:25:52.758048] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-14T20:25:53.171571] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-14T20:25:53.388344] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T20:25:53.502979] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:25:53.505471] [INFO ] [REMOTE ] NCZ: Full fetch complete (21184 records). [2025-10-14T20:25:53.505553] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-14T20:25:53.567793] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-14T20:25:53.870252] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-14T20:25:53.870331] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-14T20:25:53.870799] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-14T20:25:53.870859] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-14T20:25:53.871440] [DEBUG] [LOCAL ] NCZ: Trimmed 21184 records to 12381 (keeping 200 days of data) [2025-10-14T20:25:53.950003] [DEBUG] [LOCAL ] NCZ: Primary data saved (12381 records). [2025-10-14T20:25:53.950161] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-14T20:25:53.950247] [INFO ] [MAIN ] Update Progress: 1463/2369 symbols completed. NCZ took 37.9s. Estimated remaining: 2h 7m 28s. Rate: 7.1 symbols/min [2025-10-14T20:25:54.118892] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:25:54.119079] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-14T20:25:54.119116] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-14T20:25:54.119281] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-14T20:25:54.119328] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-14T20:25:54.119368] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-14T20:25:54.119399] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-14T20:25:54.363275] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-14T20:25:54.477050] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:25:55.067488] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:25:55.158045] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-14T20:25:55.958110] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-14T20:25:56.597766] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-14T20:25:56.758031] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-14T20:25:56.858077] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T20:25:57.558071] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-14T20:25:57.867107] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T20:25:58.358093] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-14T20:25:58.645022] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-14T20:25:59.146166] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T20:25:59.158027] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-14T20:25:59.958049] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-14T20:26:00.269861] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T20:26:00.758121] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-14T20:26:01.526571] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-14T20:26:01.558029] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-14T20:26:01.884529] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T20:26:02.234905] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T20:26:02.358083] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-14T20:26:03.158101] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-14T20:26:03.958112] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-14T20:26:04.298481] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-14T20:26:04.462172] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-10-14T20:26:04.758107] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-14T20:26:05.417237] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-14T20:26:05.558067] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-14T20:26:05.630795] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T20:26:06.358101] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-14T20:26:06.463424] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T20:26:07.158116] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-14T20:26:07.593790] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T20:26:07.958056] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-14T20:26:08.287981] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T20:26:08.375691] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-14T20:26:08.758079] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-14T20:26:09.558099] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-14T20:26:09.875636] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T20:26:10.358069] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-14T20:26:10.856804] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-14T20:26:11.158080] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-14T20:26:11.470934] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T20:26:11.548279] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T20:26:11.958100] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-14T20:26:12.758067] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-14T20:26:13.421252] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T20:26:13.498811] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:26:13.502394] [INFO ] [REMOTE ] NEA: Full fetch complete (51153 records). [2025-10-14T20:26:13.502508] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-14T20:26:13.503080] [FATAL] [VALIDATOR ] NEA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:26:13.503181] [FATAL] [MAIN ] NEA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:26:13.503233] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:26:13.503307] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-14T20:26:13.503381] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-14T20:26:13.503458] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-14T20:26:13.503538] [DEBUG] [LOCAL ] NEA: No derivative data file found to delete. [2025-10-14T20:26:13.503608] [INFO ] [MAIN ] Update Progress: 1464/2369 symbols completed. NEA took 29.0s. Estimated remaining: 2h 7m 27s. Rate: 7.1 symbols/min [2025-10-14T20:26:13.567266] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-14T20:26:13.679714] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:13.679897] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-14T20:26:13.679937] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-14T20:26:13.680052] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-14T20:26:13.680094] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-14T20:26:13.680138] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-14T20:26:13.680172] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-14T20:26:14.040592] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:14.080632] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T20:26:14.358059] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-14T20:26:15.158063] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-14T20:26:15.809949] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-14T20:26:15.958046] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-14T20:26:16.625747] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-14T20:26:16.758038] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-14T20:26:16.837862] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T20:26:17.558145] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-14T20:26:18.368688] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-14T20:26:18.374333] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-14T20:26:19.027481] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-14T20:26:19.158080] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-14T20:26:19.306263] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T20:26:19.856164] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:26:19.861610] [INFO ] [REMOTE ] NEE: Full fetch complete (77497 records). [2025-10-14T20:26:19.861757] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-14T20:26:19.862415] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:26:19.862503] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:26:19.862545] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:26:19.862583] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-14T20:26:19.862637] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-14T20:26:19.862717] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-14T20:26:19.862763] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-14T20:26:19.862819] [INFO ] [MAIN ] Update Progress: 1465/2369 symbols completed. NEE took 33.6s. Estimated remaining: 2h 7m 17s. Rate: 7.1 symbols/min [2025-10-14T20:26:19.963575] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-14T20:26:20.032377] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:20.032531] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-14T20:26:20.032567] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-14T20:26:20.032723] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-14T20:26:20.032775] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-14T20:26:20.032817] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-14T20:26:20.032848] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-14T20:26:20.402271] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:20.433780] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-14T20:26:20.758090] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-14T20:26:21.478847] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T20:26:21.558070] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-14T20:26:22.201619] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-14T20:26:22.312727] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T20:26:22.358045] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-14T20:26:23.121231] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:26:23.158111] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-14T20:26:23.901566] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T20:26:23.958051] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-14T20:26:24.758106] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-14T20:26:25.558060] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-14T20:26:26.358055] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-14T20:26:26.641500] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T20:26:26.925120] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-14T20:26:27.158075] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-14T20:26:27.418771] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T20:26:27.637611] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T20:26:27.958062] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-14T20:26:28.758067] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-14T20:26:29.173767] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T20:26:29.558122] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-14T20:26:30.307749] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:26:30.313129] [INFO ] [REMOTE ] NE: Full fetch complete (75322 records). [2025-10-14T20:26:30.313270] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-14T20:26:30.314011] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:26:30.314115] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:26:30.314156] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:26:30.314194] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-14T20:26:30.314248] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-14T20:26:30.314281] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-14T20:26:30.314318] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-14T20:26:30.314379] [INFO ] [MAIN ] Update Progress: 1466/2369 symbols completed. NE took 54.7s. Estimated remaining: 2h 7m 10s. Rate: 7.1 symbols/min [2025-10-14T20:26:30.379908] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-14T20:26:30.495269] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:30.501366] [DEBUG] [LOCAL ] NEXA: Loaded 4997 existing records from primary storage. [2025-10-14T20:26:30.501532] [INFO ] [MAIN ] NEXA: Loaded 4997 existing records. [2025-10-14T20:26:30.688394] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:26:30.688727] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-14T20:26:30.688826] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-14T20:26:30.689293] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-14T20:26:30.689354] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-14T20:26:31.068058] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:31.097541] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-14T20:26:31.115525] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:26:31.149322] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (7.19 seconds). [2025-10-14T20:26:31.160122] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-14T20:26:31.958054] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-14T20:26:32.212969] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T20:26:32.758174] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-14T20:26:32.904354] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T20:26:33.558103] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-14T20:26:34.358094] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-14T20:26:34.420729] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T20:26:35.158056] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-14T20:26:35.272153] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-14T20:26:35.830629] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:26:35.832012] [INFO ] [REMOTE ] NEU: Full fetch complete (10719 records). [2025-10-14T20:26:35.832081] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-14T20:26:35.832547] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:26:35.832626] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:26:35.832715] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:26:35.832787] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-14T20:26:35.832846] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-14T20:26:35.832880] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-14T20:26:35.832918] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-14T20:26:35.833004] [INFO ] [MAIN ] Update Progress: 1467/2369 symbols completed. NEU took 16.0s. Estimated remaining: 2h 6m 59s. Rate: 7.1 symbols/min [2025-10-14T20:26:35.971066] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-14T20:26:36.001777] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:36.001904] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-14T20:26:36.001939] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-14T20:26:36.002041] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-14T20:26:36.002081] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-14T20:26:36.002120] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-14T20:26:36.002152] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-14T20:26:36.357064] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:36.518909] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-14T20:26:36.685826] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:26:36.691527] [INFO ] [REMOTE ] NEM: Full fetch complete (77497 records). [2025-10-14T20:26:36.691742] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-14T20:26:36.692532] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:26:36.692631] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:26:36.692727] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:26:36.692813] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-14T20:26:36.692889] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-14T20:26:36.692925] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-14T20:26:36.692964] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-14T20:26:36.693020] [INFO ] [MAIN ] Update Progress: 1468/2369 symbols completed. NEM took 42.7s. Estimated remaining: 2h 6m 46s. Rate: 7.1 symbols/min [2025-10-14T20:26:36.763211] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-14T20:26:36.865186] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:36.865346] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-14T20:26:36.865384] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-14T20:26:36.865496] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-14T20:26:36.865537] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-14T20:26:36.865625] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-14T20:26:36.865702] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-14T20:26:37.216967] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:37.558069] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-14T20:26:37.651831] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T20:26:38.358067] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-14T20:26:38.689087] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T20:26:39.055157] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T20:26:39.158093] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-14T20:26:39.958100] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-14T20:26:40.758042] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-14T20:26:41.150904] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:26:41.427409] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-14T20:26:41.558054] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-14T20:26:42.333899] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T20:26:42.358031] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-14T20:26:42.633535] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T20:26:42.985911] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T20:26:43.158062] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-14T20:26:43.958072] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-14T20:26:44.513080] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-14T20:26:44.758065] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-14T20:26:45.355861] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-14T20:26:45.448086] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T20:26:45.558039] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-14T20:26:46.358114] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-14T20:26:47.124939] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T20:26:47.158078] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-14T20:26:47.821860] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T20:26:47.902695] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:26:47.958070] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-14T20:26:48.321479] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-14T20:26:48.758072] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-14T20:26:48.862393] [DEBUG] [REMOTE ] NEXA: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-14T20:26:48.862901] [WARN ] [REMOTE ] NEXA: No data returned for month 2025-09 [2025-10-14T20:26:48.863001] [FATAL] [REMOTE ] NEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:26:48.863106] [FATAL] [MAIN ] NEXA: Failed to fetch primary data. [2025-10-14T20:26:48.863143] [WARN ] [MAIN ] NEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:26:48.863188] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-14T20:26:48.863256] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-14T20:26:48.863310] [INFO ] [LOCAL ] NEXA: Starting deletion of derivative data. [2025-10-14T20:26:48.863752] [DEBUG] [LOCAL ] NEXA: Deleted derivative data file. [2025-10-14T20:26:48.864004] [INFO ] [MAIN ] Update Progress: 1469/2369 symbols completed. NEXA took 18.5s. Estimated remaining: 2h 6m 40s. Rate: 7.1 symbols/min [2025-10-14T20:26:49.033255] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:49.033455] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-14T20:26:49.033494] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-14T20:26:49.033607] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-14T20:26:49.033673] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-14T20:26:49.033736] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-14T20:26:49.033769] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-14T20:26:49.418894] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:49.558041] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-14T20:26:50.358068] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-14T20:26:51.158124] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-14T20:26:51.228163] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T20:26:51.915867] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T20:26:51.958054] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-14T20:26:51.985570] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T20:26:52.758116] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-14T20:26:53.558079] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-14T20:26:53.658426] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T20:26:53.972025] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T20:26:54.358060] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-14T20:26:54.776180] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:26:55.158098] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-14T20:26:55.481544] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T20:26:55.958065] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-14T20:26:56.758100] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-14T20:26:57.544693] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-14T20:26:57.558019] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-14T20:26:57.662343] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T20:26:57.939207] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T20:26:57.944692] [INFO ] [REMOTE ] NET: Full fetch complete (76507 records). [2025-10-14T20:26:57.944866] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-14T20:26:57.945681] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:26:57.945764] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:26:57.945805] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:26:57.945844] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-14T20:26:57.945898] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-14T20:26:57.945934] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-14T20:26:57.945974] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-14T20:26:57.946027] [INFO ] [MAIN ] Update Progress: 1470/2369 symbols completed. NET took 44.4s. Estimated remaining: 2h 6m 32s. Rate: 7.1 symbols/min [2025-10-14T20:26:58.116322] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:26:58.145943] [DEBUG] [LOCAL ] NGL: Loaded 29979 existing records from primary storage. [2025-10-14T20:26:58.146209] [INFO ] [MAIN ] NGL: Loaded 29979 existing records. [2025-10-14T20:26:58.324406] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:26:58.324622] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-14T20:26:58.324698] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-14T20:26:58.324964] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-14T20:26:58.325020] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-14T20:26:58.366906] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-14T20:26:58.685276] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:26:58.710154] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T20:26:59.158053] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-14T20:26:59.958066] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-14T20:27:00.184982] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T20:27:00.758048] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-14T20:27:00.880133] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T20:27:00.937455] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T20:27:01.558076] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-14T20:27:02.107891] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T20:27:02.358089] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-14T20:27:03.099036] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T20:27:03.158120] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-14T20:27:03.958157] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-14T20:27:04.189791] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T20:27:04.435168] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T20:27:04.758158] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-14T20:27:05.184458] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T20:27:05.558066] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-14T20:27:05.998533] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T20:27:06.358081] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-14T20:27:07.158118] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-14T20:27:07.476095] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T20:27:07.958051] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-14T20:27:08.104054] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T20:27:08.359995] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T20:27:08.758079] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-14T20:27:09.558073] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-14T20:27:09.629427] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T20:27:10.358097] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-14T20:27:10.388533] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T20:27:10.667849] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T20:27:11.158068] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-14T20:27:11.958037] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-14T20:27:12.235251] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T20:27:12.346802] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T20:27:12.758056] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-14T20:27:13.253683] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T20:27:13.558088] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-14T20:27:14.358097] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-14T20:27:14.414728] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T20:27:14.915501] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T20:27:15.045498] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:27:15.049843] [INFO ] [REMOTE ] NFG: Full fetch complete (56890 records). [2025-10-14T20:27:15.049954] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-14T20:27:15.050518] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:27:15.050607] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:27:15.050682] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:27:15.050753] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-14T20:27:15.050812] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-14T20:27:15.050847] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-14T20:27:15.050885] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-14T20:27:15.050939] [INFO ] [MAIN ] Update Progress: 1471/2369 symbols completed. NFG took 39.2s. Estimated remaining: 2h 6m 29s. Rate: 7.1 symbols/min [2025-10-14T20:27:15.163174] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-14T20:27:15.222162] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:27:15.234946] [DEBUG] [LOCAL ] NGS: Loaded 11252 existing records from primary storage. [2025-10-14T20:27:15.235158] [INFO ] [MAIN ] NGS: Loaded 11252 existing records. [2025-10-14T20:27:15.412716] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:27:15.412898] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-14T20:27:15.412966] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-14T20:27:15.413205] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-14T20:27:15.413246] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-14T20:27:15.767063] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:27:15.958072] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-14T20:27:16.366185] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T20:27:16.758077] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-14T20:27:16.775933] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T20:27:17.558074] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-14T20:27:18.190113] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:27:18.192561] [INFO ] [REMOTE ] NFJ: Full fetch complete (30088 records). [2025-10-14T20:27:18.192669] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-14T20:27:18.193170] [FATAL] [VALIDATOR ] NFJ: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:27:18.193249] [FATAL] [MAIN ] NFJ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:27:18.193310] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:27:18.193378] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-14T20:27:18.193443] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-14T20:27:18.193478] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-14T20:27:18.193517] [DEBUG] [LOCAL ] NFJ: No derivative data file found to delete. [2025-10-14T20:27:18.193571] [INFO ] [MAIN ] Update Progress: 1472/2369 symbols completed. NFJ took 41.5s. Estimated remaining: 2h 6m 17s. Rate: 7.1 symbols/min [2025-10-14T20:27:18.366966] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:27:18.364340] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-14T20:27:18.367150] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-14T20:27:18.367222] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-14T20:27:18.368275] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-14T20:27:18.368345] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-14T20:27:18.368609] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-14T20:27:18.368757] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-14T20:27:18.615825] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T20:27:18.761587] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:27:19.158052] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-14T20:27:19.422433] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T20:27:19.958076] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-14T20:27:20.215456] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T20:27:20.758068] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-14T20:27:21.035010] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T20:27:21.558067] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-14T20:27:21.783226] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T20:27:22.358065] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-14T20:27:23.028801] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T20:27:23.145222] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T20:27:23.158028] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-14T20:27:23.958038] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-14T20:27:24.175445] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T20:27:24.698429] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:27:24.703299] [INFO ] [REMOTE ] NGG: Full fetch complete (66121 records). [2025-10-14T20:27:24.703426] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-14T20:27:24.704086] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:27:24.704174] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:27:24.704217] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:27:24.704255] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-14T20:27:24.704309] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-14T20:27:24.704344] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-14T20:27:24.704416] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-14T20:27:24.704495] [INFO ] [MAIN ] Update Progress: 1473/2369 symbols completed. NGG took 35.8s. Estimated remaining: 2h 6m 8s. Rate: 7.1 symbols/min [2025-10-14T20:27:24.765696] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-14T20:27:24.879318] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:27:24.879483] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-14T20:27:24.879520] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-14T20:27:24.879635] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-14T20:27:24.879714] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-14T20:27:24.879773] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-14T20:27:24.879833] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-14T20:27:25.288942] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:27:25.558126] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-14T20:27:25.573467] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T20:27:26.358050] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-14T20:27:26.700541] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T20:27:27.158069] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-14T20:27:27.224823] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T20:27:27.958089] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-14T20:27:28.396316] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T20:27:28.758070] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-14T20:27:28.962793] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T20:27:29.558032] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-14T20:27:29.858866] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T20:27:30.358072] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-14T20:27:30.399152] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T20:27:31.158050] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-14T20:27:31.304151] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-14T20:27:31.958065] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-14T20:27:32.022635] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T20:27:32.758043] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-14T20:27:32.975529] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T20:27:33.558071] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-14T20:27:34.246846] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T20:27:34.358041] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-14T20:27:34.455106] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T20:27:35.158081] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-14T20:27:35.801920] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T20:27:35.958047] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-14T20:27:35.972790] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:27:35.974273] [INFO ] [REMOTE ] NGS: Full fetch complete (17158 records). [2025-10-14T20:27:35.974339] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-14T20:27:36.344537] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-14T20:27:36.344619] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-14T20:27:36.345052] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-14T20:27:36.345108] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-14T20:27:36.345609] [DEBUG] [LOCAL ] NGS: Trimmed 17158 records to 11198 (keeping 200 days of data) [2025-10-14T20:27:36.412086] [DEBUG] [LOCAL ] NGS: Primary data saved (11198 records). [2025-10-14T20:27:36.412208] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-14T20:27:36.412281] [INFO ] [MAIN ] Update Progress: 1474/2369 symbols completed. NGS took 21.4s. Estimated remaining: 2h 6m 1s. Rate: 7.1 symbols/min [2025-10-14T20:27:36.585271] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:27:36.585453] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-14T20:27:36.585493] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-14T20:27:36.585614] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-14T20:27:36.585684] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-14T20:27:36.585757] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-14T20:27:36.585793] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-14T20:27:36.761555] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-14T20:27:36.945223] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:27:37.335568] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T20:27:37.558065] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-14T20:27:38.065325] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T20:27:38.358040] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-14T20:27:38.663609] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T20:27:39.158071] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-14T20:27:39.647347] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T20:27:39.958104] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-14T20:27:40.439956] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T20:27:40.442810] [INFO ] [REMOTE ] NGL: Full fetch complete (41547 records). [2025-10-14T20:27:40.442967] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-14T20:27:40.763152] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-14T20:27:40.852658] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-14T20:27:40.852741] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-14T20:27:40.853545] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-14T20:27:40.853582] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-14T20:27:40.854402] [DEBUG] [LOCAL ] NGL: Trimmed 41547 records to 29950 (keeping 200 days of data) [2025-10-14T20:27:41.020368] [DEBUG] [LOCAL ] NGL: Primary data saved (29950 records). [2025-10-14T20:27:41.020505] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-14T20:27:41.020595] [INFO ] [MAIN ] Update Progress: 1475/2369 symbols completed. NGL took 43.1s. Estimated remaining: 2h 5m 50s. Rate: 7.1 symbols/min [2025-10-14T20:27:41.195832] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:27:41.196079] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-14T20:27:41.196125] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-14T20:27:41.196236] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-14T20:27:41.196277] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-14T20:27:41.196316] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-14T20:27:41.196347] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-14T20:27:41.370758] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T20:27:41.570412] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-14T20:27:41.575080] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:27:41.668752] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T20:27:42.358065] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-14T20:27:42.739282] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T20:27:43.158096] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-14T20:27:43.630941] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T20:27:43.958061] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-14T20:27:44.758028] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-14T20:27:45.028149] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T20:27:45.270764] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T20:27:45.558064] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-14T20:27:45.885091] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T20:27:46.358037] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-14T20:27:46.674133] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T20:27:47.158071] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-14T20:27:47.958083] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-14T20:27:48.175193] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T20:27:48.371900] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T20:27:48.758064] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-14T20:27:49.071994] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T20:27:49.313665] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T20:27:49.316196] [INFO ] [REMOTE ] NGVC: Full fetch complete (30784 records). [2025-10-14T20:27:49.316263] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-14T20:27:49.316703] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:27:49.316785] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:27:49.316826] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:27:49.316888] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-14T20:27:49.316946] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-14T20:27:49.316980] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-14T20:27:49.317019] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-14T20:27:49.317069] [INFO ] [MAIN ] Update Progress: 1476/2369 symbols completed. NGVC took 31.1s. Estimated remaining: 2h 5m 42s. Rate: 7.1 symbols/min [2025-10-14T20:27:49.485854] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:27:49.486037] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-14T20:27:49.486121] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-14T20:27:49.486203] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-14T20:27:49.486262] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-14T20:27:49.486345] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-14T20:27:49.486389] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-14T20:27:49.563352] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-14T20:27:49.857760] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:27:50.358061] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-14T20:27:50.894226] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T20:27:51.158056] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-14T20:27:51.958045] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-14T20:27:52.186772] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T20:27:52.369484] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T20:27:52.563861] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T20:27:52.758109] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-14T20:27:53.558099] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-14T20:27:53.819149] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T20:27:54.358124] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-14T20:27:54.450231] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T20:27:55.158071] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-14T20:27:55.958085] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-14T20:27:56.261407] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T20:27:56.285011] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T20:27:56.758041] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-14T20:27:56.979563] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T20:27:57.400028] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:27:57.402607] [INFO ] [REMOTE ] NGVT: Full fetch complete (34300 records). [2025-10-14T20:27:57.402714] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-14T20:27:57.403188] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:27:57.403269] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:27:57.403310] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:27:57.403347] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-14T20:27:57.403399] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-14T20:27:57.403430] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-14T20:27:57.403468] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-14T20:27:57.403525] [INFO ] [MAIN ] Update Progress: 1477/2369 symbols completed. NGVT took 32.7s. Estimated remaining: 2h 5m 33s. Rate: 7.1 symbols/min [2025-10-14T20:27:57.558068] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-14T20:27:58.319139] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:27:58.358193] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-14T20:27:59.158121] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-14T20:27:59.616967] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T20:27:59.958121] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-14T20:28:00.758147] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-14T20:28:01.134457] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T20:28:01.158280] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T20:28:01.558078] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-14T20:28:01.687372] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T20:28:02.358065] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-14T20:28:03.158077] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-14T20:28:03.407223] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T20:28:03.442553] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T20:28:03.958122] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-14T20:28:04.174042] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T20:28:04.758111] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-14T20:28:05.558051] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-14T20:28:05.588363] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T20:28:05.941357] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-14T20:28:06.358126] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-14T20:28:06.652530] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T20:28:07.158045] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-14T20:28:07.213124] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T20:28:07.958041] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-14T20:28:08.184235] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T20:28:08.617741] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T20:28:08.758043] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-14T20:28:09.553075] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T20:28:09.558013] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-14T20:28:10.358063] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-14T20:28:10.455525] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T20:28:11.158071] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-14T20:28:11.632789] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T20:28:11.634306] [INFO ] [REMOTE ] NIC: Full fetch complete (12313 records). [2025-10-14T20:28:11.634373] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-14T20:28:11.634766] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:28:11.634846] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:28:11.634891] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:28:11.634968] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-14T20:28:11.635030] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-14T20:28:11.635063] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-14T20:28:11.635100] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-14T20:28:11.635150] [INFO ] [MAIN ] Update Progress: 1478/2369 symbols completed. NIC took 22.3s. Estimated remaining: 2h 5m 28s. Rate: 7.1 symbols/min [2025-10-14T20:28:11.958065] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-14T20:28:12.312018] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T20:28:12.758073] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-14T20:28:13.134533] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T20:28:13.558060] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-14T20:28:13.937351] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T20:28:13.939914] [INFO ] [REMOTE ] NHI: Full fetch complete (31224 records). [2025-10-14T20:28:13.940055] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-14T20:28:13.940695] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:28:13.940777] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:28:13.940822] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:28:13.940905] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-14T20:28:13.940984] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-14T20:28:13.941033] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-14T20:28:13.941088] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-14T20:28:13.941161] [INFO ] [MAIN ] Update Progress: 1479/2369 symbols completed. NHI took 37.5s. Estimated remaining: 2h 5m 16s. Rate: 7.1 symbols/min [2025-10-14T20:28:14.230565] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T20:28:14.358068] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-14T20:28:16.340922] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T20:28:16.353378] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-14T20:28:17.179393] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:28:17.184807] [INFO ] [REMOTE ] NI: Full fetch complete (77058 records). [2025-10-14T20:28:17.184935] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-14T20:28:17.185599] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:28:17.185707] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:28:17.185751] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:28:17.185815] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-14T20:28:17.185875] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-14T20:28:17.185909] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-14T20:28:17.185946] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-14T20:28:17.186000] [INFO ] [MAIN ] Update Progress: 1480/2369 symbols completed. NI took 36.2s. Estimated remaining: 2h 5m 5s. Rate: 7.1 symbols/min [2025-10-14T20:28:17.961276] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:18.042582] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:18.058310] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:18.066954] [DEBUG] [LOCAL ] NIM: No existing data file found in primary storage. [2025-10-14T20:28:18.066316] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:18.067114] [WARN ] [MAIN ] NIM: No existing data found, performing full refresh instead. [2025-10-14T20:28:18.067446] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-14T20:28:18.067499] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-14T20:28:18.067549] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-14T20:28:18.067668] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-14T20:28:18.205371] [DEBUG] [LOCAL ] NIE: Loaded 12028 existing records from primary storage. [2025-10-14T20:28:18.216633] [INFO ] [MAIN ] NIE: Loaded 12028 existing records. [2025-10-14T20:28:18.275260] [DEBUG] [LOCAL ] NINE: Loaded 28123 existing records from primary storage. [2025-10-14T20:28:18.308838] [INFO ] [MAIN ] NINE: Loaded 28123 existing records. [2025-10-14T20:28:18.727919] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-14T20:28:18.847823] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-14T20:28:18.918590] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:28:19.053148] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-14T20:28:19.152843] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-14T20:28:19.189444] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:28:19.211944] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:19.212006] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-14T20:28:19.207329] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-14T20:28:19.212491] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-14T20:28:19.213359] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-14T20:28:19.212592] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-14T20:28:19.245336] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-14T20:28:19.329310] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-14T20:28:19.328958] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:28:19.389321] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-14T20:28:19.435123] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-14T20:28:19.504130] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-14T20:28:19.514737] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-14T20:28:20.203566] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T20:28:20.300712] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:20.306832] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-14T20:28:20.336703] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:20.333305] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-14T20:28:20.346898] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-14T20:28:20.432497] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:20.432829] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-14T20:28:21.056775] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T20:28:21.058431] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-14T20:28:21.325701] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T20:28:21.328619] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-14T20:28:21.762572] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T20:28:21.764719] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-14T20:28:21.975613] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T20:28:22.216383] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T20:28:22.358038] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-14T20:28:22.565408] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T20:28:23.018694] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-14T20:28:23.159114] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-14T20:28:23.161273] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T20:28:23.958080] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-14T20:28:24.758101] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-14T20:28:25.262177] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-14T20:28:25.558075] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-14T20:28:25.692537] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T20:28:26.048824] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T20:28:26.358062] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-14T20:28:26.500878] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T20:28:27.158055] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-14T20:28:27.958069] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-14T20:28:28.131485] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T20:28:28.379781] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-14T20:28:28.565862] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-14T20:28:28.758047] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-14T20:28:29.558063] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-14T20:28:30.221864] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T20:28:30.358051] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-14T20:28:31.004927] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T20:28:31.158057] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-14T20:28:31.347377] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-14T20:28:31.958063] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-14T20:28:32.572501] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T20:28:32.758045] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-14T20:28:32.862363] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T20:28:33.425778] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-14T20:28:33.558079] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-14T20:28:34.358064] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-14T20:28:35.158070] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-14T20:28:35.260255] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T20:28:35.729894] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-14T20:28:35.954952] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-14T20:28:35.965092] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-14T20:28:36.758050] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-14T20:28:37.308731] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T20:28:37.474455] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T20:28:37.558030] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-14T20:28:38.358099] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-14T20:28:38.986828] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T20:28:39.158067] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-14T20:28:39.682023] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T20:28:39.682843] [INFO ] [REMOTE ] NIM: Full fetch complete (6421 records). [2025-10-14T20:28:39.682910] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-14T20:28:39.965964] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-14T20:28:40.085144] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-14T20:28:40.085226] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-14T20:28:40.085453] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-14T20:28:40.085532] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-14T20:28:40.086141] [DEBUG] [LOCAL ] NIM: Trimmed 6421 records to 3542 (keeping 200 days of data) [2025-10-14T20:28:40.113633] [DEBUG] [LOCAL ] NIM: Primary data saved (3542 records). [2025-10-14T20:28:40.113845] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-14T20:28:40.113970] [INFO ] [MAIN ] Update Progress: 1481/2369 symbols completed. NIM took 22.9s. Estimated remaining: 2h 5m 5s. Rate: 7.1 symbols/min [2025-10-14T20:28:40.311664] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:40.311864] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-14T20:28:40.311922] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-14T20:28:40.312036] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-14T20:28:40.312081] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-14T20:28:40.312121] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-14T20:28:40.312154] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-14T20:28:40.694960] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:40.758048] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-14T20:28:40.862876] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-14T20:28:41.069881] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:28:41.070231] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-14T20:28:41.070318] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:28:41.070363] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-14T20:28:41.070422] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:28:41.070494] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-14T20:28:41.070555] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-14T20:28:41.070589] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-14T20:28:41.070631] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-14T20:28:41.070718] [INFO ] [MAIN ] Update Progress: 1482/2369 symbols completed. NIQ took 1.0s. Estimated remaining: 2h 4m 52s. Rate: 7.1 symbols/min [2025-10-14T20:28:41.245199] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:41.245399] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-14T20:28:41.245436] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-14T20:28:41.245549] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-14T20:28:41.245593] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-14T20:28:41.245637] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-14T20:28:41.245730] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-14T20:28:41.563174] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-14T20:28:41.616445] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:41.843818] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T20:28:42.358039] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-14T20:28:43.158107] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-14T20:28:43.763309] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T20:28:43.799210] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-14T20:28:43.844293] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T20:28:43.958070] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-14T20:28:44.758044] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-14T20:28:44.780770] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T20:28:45.558082] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-14T20:28:46.358073] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-14T20:28:47.103852] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T20:28:47.158045] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-14T20:28:47.214064] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-14T20:28:47.265268] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T20:28:47.958063] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-14T20:28:48.256612] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T20:28:48.758068] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-14T20:28:49.503900] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:28:49.505997] [INFO ] [REMOTE ] NIE: Full fetch complete (16757 records). [2025-10-14T20:28:49.506072] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-14T20:28:49.563494] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-14T20:28:49.871590] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-14T20:28:49.871702] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-14T20:28:49.872114] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-14T20:28:49.872156] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-14T20:28:49.872672] [DEBUG] [LOCAL ] NIE: Trimmed 16757 records to 11926 (keeping 200 days of data) [2025-10-14T20:28:49.943386] [DEBUG] [LOCAL ] NIE: Primary data saved (11926 records). [2025-10-14T20:28:49.943522] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-14T20:28:49.943603] [INFO ] [MAIN ] Update Progress: 1483/2369 symbols completed. NIE took 32.8s. Estimated remaining: 2h 4m 44s. Rate: 7.1 symbols/min [2025-10-14T20:28:50.110382] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:50.110547] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-14T20:28:50.110585] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-14T20:28:50.110720] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-14T20:28:50.110767] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-14T20:28:50.110809] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-14T20:28:50.110841] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-14T20:28:50.360691] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-14T20:28:50.470072] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:50.534405] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-14T20:28:50.908754] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T20:28:51.158055] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-14T20:28:51.643058] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T20:28:51.958064] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-14T20:28:52.758066] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-14T20:28:53.351154] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T20:28:53.513226] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-14T20:28:53.558041] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-14T20:28:54.294543] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:28:54.300512] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-14T20:28:54.300639] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-14T20:28:54.363146] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-14T20:28:54.686570] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-14T20:28:54.686673] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-14T20:28:54.687843] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-14T20:28:54.687910] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-14T20:28:54.689328] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 53802 (keeping 200 days of data) [2025-10-14T20:28:55.002132] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-14T20:28:55.002265] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-14T20:28:55.002340] [INFO ] [MAIN ] Update Progress: 1484/2369 symbols completed. NIO took 37.8s. Estimated remaining: 2h 4m 33s. Rate: 7.1 symbols/min [2025-10-14T20:28:55.176226] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:55.173497] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-14T20:28:55.193993] [DEBUG] [LOCAL ] NKX: Loaded 13621 existing records from primary storage. [2025-10-14T20:28:55.194296] [INFO ] [MAIN ] NKX: Loaded 13621 existing records. [2025-10-14T20:28:55.429045] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-14T20:28:55.433113] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:28:55.443680] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-14T20:28:55.444222] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-14T20:28:55.444497] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-14T20:28:55.444572] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-14T20:28:55.847172] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:55.958027] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-14T20:28:56.061304] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T20:28:56.077180] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T20:28:56.080280] [INFO ] [REMOTE ] NINE: Full fetch complete (43396 records). [2025-10-14T20:28:56.080359] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-14T20:28:56.520706] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-14T20:28:56.520829] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-14T20:28:56.521778] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-14T20:28:56.521871] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-14T20:28:56.523059] [DEBUG] [LOCAL ] NINE: Trimmed 43396 records to 28294 (keeping 200 days of data) [2025-10-14T20:28:56.702110] [DEBUG] [LOCAL ] NINE: Primary data saved (28294 records). [2025-10-14T20:28:56.702232] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-14T20:28:56.702309] [INFO ] [MAIN ] Update Progress: 1485/2369 symbols completed. NINE took 39.5s. Estimated remaining: 2h 4m 21s. Rate: 7.1 symbols/min [2025-10-14T20:28:56.767202] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-14T20:28:56.912285] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:28:56.912521] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-14T20:28:56.912569] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-14T20:28:56.912702] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-14T20:28:56.912770] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-14T20:28:56.912843] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-14T20:28:56.912897] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-14T20:28:57.161786] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T20:28:57.356015] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:28:57.558053] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-14T20:28:58.272065] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T20:28:58.358053] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-14T20:28:59.158092] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-14T20:28:59.322328] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-14T20:28:59.823251] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T20:28:59.931233] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T20:28:59.958021] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-14T20:29:00.758107] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-14T20:29:01.411524] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T20:29:01.462189] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T20:29:01.558025] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-14T20:29:02.358156] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-14T20:29:03.158045] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-14T20:29:03.226309] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T20:29:03.958119] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-14T20:29:04.049968] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T20:29:04.631399] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T20:29:04.632983] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-14T20:29:04.758032] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-14T20:29:05.558038] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-14T20:29:05.563631] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T20:29:06.358044] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-14T20:29:06.520471] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T20:29:07.115324] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T20:29:07.158056] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-14T20:29:07.958067] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-14T20:29:08.692429] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T20:29:08.733470] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T20:29:08.758038] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-14T20:29:09.558122] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-14T20:29:10.348756] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T20:29:10.358021] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-14T20:29:10.651164] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T20:29:11.158107] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-14T20:29:11.660309] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T20:29:11.830130] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-14T20:29:11.958056] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-14T20:29:12.672623] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:29:12.676912] [INFO ] [REMOTE ] NJR: Full fetch complete (54635 records). [2025-10-14T20:29:12.677055] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-14T20:29:12.677715] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:29:12.677820] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:29:12.677862] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:29:12.677926] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-14T20:29:12.677988] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-14T20:29:12.678025] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-14T20:29:12.678062] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-14T20:29:12.678116] [INFO ] [MAIN ] Update Progress: 1486/2369 symbols completed. NJR took 31.6s. Estimated remaining: 2h 4m 17s. Rate: 7.1 symbols/min [2025-10-14T20:29:12.763248] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-14T20:29:12.853405] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:12.853610] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-14T20:29:12.853674] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-14T20:29:12.853790] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-14T20:29:12.853829] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-14T20:29:12.853869] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-14T20:29:12.853899] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-14T20:29:13.210155] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:13.482209] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T20:29:13.558083] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-14T20:29:14.358104] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-14T20:29:14.522180] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T20:29:15.028941] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T20:29:15.158059] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-14T20:29:15.958100] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-14T20:29:15.993730] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T20:29:16.758085] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-14T20:29:16.813590] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T20:29:17.558048] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-14T20:29:17.871110] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T20:29:18.333720] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T20:29:18.358031] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-14T20:29:19.158043] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-14T20:29:19.383001] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T20:29:19.857327] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:29:19.858437] [INFO ] [REMOTE ] NL: Full fetch complete (6902 records). [2025-10-14T20:29:19.858526] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-14T20:29:19.959997] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-14T20:29:20.039161] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T20:29:20.039393] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:29:20.039461] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:29:20.039533] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-14T20:29:20.039594] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-14T20:29:20.039630] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-14T20:29:20.039710] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-14T20:29:20.039774] [INFO ] [MAIN ] Update Progress: 1487/2369 symbols completed. NL took 23.3s. Estimated remaining: 2h 4m 8s. Rate: 7.1 symbols/min [2025-10-14T20:29:20.207325] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:20.207516] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-14T20:29:20.207584] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-14T20:29:20.207728] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-14T20:29:20.207774] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-14T20:29:20.207817] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-14T20:29:20.207850] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-14T20:29:20.568106] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:20.758041] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-14T20:29:20.837765] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T20:29:21.558040] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-14T20:29:21.607238] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T20:29:22.225592] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T20:29:22.358050] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-14T20:29:23.158068] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-14T20:29:23.958046] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-14T20:29:24.193379] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T20:29:24.376310] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T20:29:24.758123] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-14T20:29:24.956117] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:29:25.558095] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-14T20:29:26.358106] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-14T20:29:27.158059] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-14T20:29:27.166106] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:29:27.167951] [INFO ] [REMOTE ] NKX: Full fetch complete (19154 records). [2025-10-14T20:29:27.168023] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-14T20:29:27.623821] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-14T20:29:27.624121] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-14T20:29:27.624836] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-14T20:29:27.624986] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-14T20:29:27.626806] [DEBUG] [LOCAL ] NKX: Trimmed 19154 records to 13596 (keeping 200 days of data) [2025-10-14T20:29:27.706958] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-14T20:29:27.776098] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T20:29:27.822507] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-14T20:29:27.857379] [DEBUG] [LOCAL ] NKX: Primary data saved (13596 records). [2025-10-14T20:29:27.857597] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-14T20:29:27.857751] [INFO ] [MAIN ] Update Progress: 1488/2369 symbols completed. NKX took 32.9s. Estimated remaining: 2h 3m 59s. Rate: 7.1 symbols/min [2025-10-14T20:29:27.963351] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-14T20:29:28.081180] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:28.098324] [DEBUG] [LOCAL ] NMAI: Loaded 12919 existing records from primary storage. [2025-10-14T20:29:28.098675] [INFO ] [MAIN ] NMAI: Loaded 12919 existing records. [2025-10-14T20:29:28.334255] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:29:28.334514] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-14T20:29:28.334568] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-14T20:29:28.334804] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-14T20:29:28.334892] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-14T20:29:28.765868] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:28.762298] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-14T20:29:29.558049] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-14T20:29:29.623039] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T20:29:30.358033] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-14T20:29:30.846140] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-14T20:29:31.158044] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-14T20:29:31.371212] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T20:29:31.426229] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T20:29:31.958114] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-14T20:29:32.758126] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-14T20:29:32.988629] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T20:29:33.558080] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-14T20:29:33.621581] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T20:29:33.971058] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-14T20:29:34.358085] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-14T20:29:34.489787] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-14T20:29:35.158053] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-14T20:29:35.378955] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T20:29:35.958063] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-14T20:29:36.758046] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-14T20:29:36.971264] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T20:29:37.558059] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-14T20:29:37.772339] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-14T20:29:38.358053] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-14T20:29:38.406670] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T20:29:38.920920] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-14T20:29:39.158078] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-14T20:29:39.958917] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-14T20:29:39.959754] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T20:29:40.758052] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-14T20:29:41.017233] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T20:29:41.052882] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-14T20:29:41.558069] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-14T20:29:41.762073] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T20:29:41.845896] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-14T20:29:41.847348] [INFO ] [REMOTE ] NLOP: Full fetch complete (17692 records). [2025-10-14T20:29:41.847417] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-14T20:29:41.847878] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:29:41.847958] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:29:41.847999] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:29:41.848043] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-14T20:29:41.848099] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-14T20:29:41.848133] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-14T20:29:41.848172] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-14T20:29:41.848221] [INFO ] [MAIN ] Update Progress: 1489/2369 symbols completed. NLOP took 29.2s. Estimated remaining: 2h 3m 54s. Rate: 7.1 symbols/min [2025-10-14T20:29:42.017547] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:42.017782] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-14T20:29:42.017827] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-14T20:29:42.017936] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-14T20:29:42.017975] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-14T20:29:42.018014] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-14T20:29:42.018050] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-14T20:29:42.359389] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-14T20:29:42.396965] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:43.158057] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-14T20:29:43.958113] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-14T20:29:44.275156] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:29:44.275448] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-14T20:29:44.275533] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:29:44.275581] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-14T20:29:44.275670] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:29:44.275742] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-14T20:29:44.275801] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-14T20:29:44.275837] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-14T20:29:44.275876] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-14T20:29:44.275920] [INFO ] [MAIN ] Update Progress: 1490/2369 symbols completed. NMAX took 2.4s. Estimated remaining: 2h 3m 42s. Rate: 7.1 symbols/min [2025-10-14T20:29:44.445442] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:44.445599] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-14T20:29:44.445733] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-14T20:29:44.445843] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-14T20:29:44.445884] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-14T20:29:44.445924] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-14T20:29:44.445956] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-14T20:29:44.763312] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-14T20:29:44.803963] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:44.836407] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-14T20:29:45.396236] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-14T20:29:45.558053] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-14T20:29:45.810827] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T20:29:46.358062] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-14T20:29:47.158036] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-14T20:29:47.575270] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T20:29:47.658884] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T20:29:47.958061] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-14T20:29:48.758044] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-14T20:29:49.539580] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-14T20:29:49.558022] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-14T20:29:49.618436] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T20:29:49.655572] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T20:29:50.097329] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T20:29:50.103225] [INFO ] [REMOTE ] NKE: Full fetch complete (76827 records). [2025-10-14T20:29:50.103356] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-14T20:29:50.104088] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:29:50.104188] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:29:50.104275] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:29:50.104368] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-14T20:29:50.104447] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-14T20:29:50.104485] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-14T20:29:50.104544] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-14T20:29:50.104601] [INFO ] [MAIN ] Update Progress: 1491/2369 symbols completed. NKE took 1m 0s. Estimated remaining: 2h 3m 32s. Rate: 7.1 symbols/min [2025-10-14T20:29:50.304325] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:50.317159] [DEBUG] [LOCAL ] NMG: Loaded 9936 existing records from primary storage. [2025-10-14T20:29:50.317385] [INFO ] [MAIN ] NMG: Loaded 9936 existing records. [2025-10-14T20:29:50.363147] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-14T20:29:50.507608] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:29:50.507851] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-14T20:29:50.507899] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-14T20:29:50.508058] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-14T20:29:50.508111] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-14T20:29:50.859455] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:51.158066] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-14T20:29:51.958044] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-14T20:29:52.187439] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T20:29:52.505664] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-14T20:29:52.758042] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-14T20:29:52.954255] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T20:29:53.304765] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T20:29:53.306734] [INFO ] [REMOTE ] NMAI: Full fetch complete (19778 records). [2025-10-14T20:29:53.306806] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-14T20:29:53.563174] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-14T20:29:53.710230] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-14T20:29:53.710305] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-14T20:29:53.710733] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-14T20:29:53.710793] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-14T20:29:53.711325] [DEBUG] [LOCAL ] NMAI: Trimmed 19778 records to 12852 (keeping 200 days of data) [2025-10-14T20:29:53.791367] [DEBUG] [LOCAL ] NMAI: Primary data saved (12852 records). [2025-10-14T20:29:53.791515] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-14T20:29:53.791595] [INFO ] [MAIN ] Update Progress: 1492/2369 symbols completed. NMAI took 25.9s. Estimated remaining: 2h 3m 20s. Rate: 7.1 symbols/min [2025-10-14T20:29:53.960762] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:29:53.967388] [DEBUG] [LOCAL ] NMI: Loaded 4062 existing records from primary storage. [2025-10-14T20:29:53.967591] [INFO ] [MAIN ] NMI: Loaded 4062 existing records. [2025-10-14T20:29:54.141169] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:29:54.141394] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-14T20:29:54.141441] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-14T20:29:54.141604] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-14T20:29:54.141696] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-14T20:29:54.363287] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-14T20:29:54.520119] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:29:54.639083] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T20:29:55.158077] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-14T20:29:55.882801] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T20:29:55.958066] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-14T20:29:56.495191] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-14T20:29:56.580025] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T20:29:56.758060] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-14T20:29:57.458772] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T20:29:57.558032] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-14T20:29:58.082720] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T20:29:58.358051] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-14T20:29:59.011538] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T20:29:59.158048] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-14T20:29:59.958103] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-14T20:29:59.992188] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T20:30:00.758038] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-14T20:30:01.071944] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:30:01.558078] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-14T20:30:02.032563] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T20:30:02.358075] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-14T20:30:02.745492] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:30:03.158085] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-14T20:30:03.958043] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-14T20:30:04.100213] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T20:30:04.758040] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-14T20:30:04.968007] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-14T20:30:05.143582] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-14T20:30:05.443173] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T20:30:05.558043] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-14T20:30:06.358044] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-14T20:30:06.488041] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T20:30:06.493913] [INFO ] [REMOTE ] NLY: Full fetch complete (77313 records). [2025-10-14T20:30:06.494085] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-14T20:30:06.495009] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:30:06.495106] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:30:06.495188] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:30:06.495276] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-14T20:30:06.495371] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-14T20:30:06.495439] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-14T20:30:06.495540] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-14T20:30:06.495676] [INFO ] [MAIN ] Update Progress: 1493/2369 symbols completed. NLY took 46.5s. Estimated remaining: 2h 3m 15s. Rate: 7.1 symbols/min [2025-10-14T20:30:06.666324] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:30:06.666491] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-14T20:30:06.666528] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-14T20:30:06.666638] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-14T20:30:06.666716] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-14T20:30:06.666762] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-14T20:30:06.666795] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-14T20:30:07.030685] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:30:07.158049] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-14T20:30:07.418116] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T20:30:07.801845] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T20:30:07.958061] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-14T20:30:08.758111] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-14T20:30:09.065533] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T20:30:09.558043] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-14T20:30:09.924832] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T20:30:10.212035] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T20:30:10.358068] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-14T20:30:11.113194] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T20:30:11.158039] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-14T20:30:11.854915] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T20:30:11.958090] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-14T20:30:12.758082] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-14T20:30:13.017743] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T20:30:13.558049] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-14T20:30:13.614345] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T20:30:14.243169] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T20:30:14.358098] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-14T20:30:15.134512] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T20:30:15.158039] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-14T20:30:15.958054] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-14T20:30:16.214157] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T20:30:16.484976] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T20:30:16.758067] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-14T20:30:17.558062] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-14T20:30:17.809913] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T20:30:18.057803] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T20:30:18.358048] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-14T20:30:19.158079] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-14T20:30:19.573119] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T20:30:19.758433] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T20:30:19.958066] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-14T20:30:20.454177] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-14T20:30:20.758069] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-14T20:30:21.558079] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-14T20:30:21.693387] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T20:30:22.271155] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T20:30:22.358036] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-14T20:30:23.158079] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-14T20:30:23.658032] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T20:30:23.662231] [INFO ] [REMOTE ] NMG: Full fetch complete (14768 records). [2025-10-14T20:30:23.662312] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-14T20:30:23.777734] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T20:30:23.799252] [INFO ] [REMOTE ] NMCO: Full fetch complete (23383 records). [2025-10-14T20:30:23.809763] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-14T20:30:23.838824] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:30:23.850342] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:30:23.879397] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:30:23.931069] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-14T20:30:23.963370] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-14T20:30:23.963210] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-14T20:30:23.968806] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-14T20:30:23.970002] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-14T20:30:23.980922] [INFO ] [MAIN ] Update Progress: 1494/2369 symbols completed. NMCO took 39.7s. Estimated remaining: 2h 3m 11s. Rate: 7.1 symbols/min [2025-10-14T20:30:24.242195] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-14T20:30:24.257547] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-14T20:30:24.260957] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:30:24.261760] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-14T20:30:24.261824] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-14T20:30:24.262338] [DEBUG] [LOCAL ] NMG: Trimmed 14768 records to 10296 (keeping 200 days of data) [2025-10-14T20:30:24.345259] [DEBUG] [LOCAL ] NMR: Loaded 35423 existing records from primary storage. [2025-10-14T20:30:24.347669] [DEBUG] [LOCAL ] NMG: Primary data saved (10296 records). [2025-10-14T20:30:24.347899] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-14T20:30:24.348006] [INFO ] [MAIN ] Update Progress: 1495/2369 symbols completed. NMG took 34.2s. Estimated remaining: 2h 2m 58s. Rate: 7.1 symbols/min [2025-10-14T20:30:24.347799] [INFO ] [MAIN ] NMR: Loaded 35423 existing records. [2025-10-14T20:30:24.678192] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:30:24.709376] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:30:24.710102] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-14T20:30:24.710163] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-14T20:30:24.710478] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-14T20:30:24.710535] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-14T20:30:24.760854] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-14T20:30:24.761720] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T20:30:24.801194] [DEBUG] [LOCAL ] NMS: Loaded 2931 existing records from primary storage. [2025-10-14T20:30:24.827742] [INFO ] [MAIN ] NMS: Loaded 2931 existing records. [2025-10-14T20:30:25.195503] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:30:25.201502] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-14T20:30:25.206731] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-14T20:30:25.234513] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-14T20:30:25.244806] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-14T20:30:25.344627] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:30:25.563156] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-14T20:30:25.635989] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:30:25.853557] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T20:30:26.358096] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-14T20:30:26.972633] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T20:30:27.083031] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T20:30:27.158037] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-14T20:30:27.958063] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-14T20:30:28.450357] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T20:30:28.451248] [INFO ] [REMOTE ] NMI: Full fetch complete (5794 records). [2025-10-14T20:30:28.451314] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-14T20:30:28.758811] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-14T20:30:28.797144] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T20:30:28.845146] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-14T20:30:28.845226] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-14T20:30:28.845380] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-14T20:30:28.845418] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-14T20:30:28.845902] [DEBUG] [LOCAL ] NMI: Trimmed 5794 records to 4060 (keeping 200 days of data) [2025-10-14T20:30:28.869736] [DEBUG] [LOCAL ] NMI: Primary data saved (4060 records). [2025-10-14T20:30:28.869806] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-14T20:30:28.869892] [INFO ] [MAIN ] Update Progress: 1496/2369 symbols completed. NMI took 35.1s. Estimated remaining: 2h 2m 48s. Rate: 7.1 symbols/min [2025-10-14T20:30:29.041679] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:30:29.047163] [DEBUG] [LOCAL ] NMT: Loaded 2835 existing records from primary storage. [2025-10-14T20:30:29.047333] [INFO ] [MAIN ] NMT: Loaded 2835 existing records. [2025-10-14T20:30:29.224016] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:30:29.224608] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-14T20:30:29.224688] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-14T20:30:29.224832] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-14T20:30:29.224872] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-14T20:30:29.414046] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T20:30:29.563198] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-14T20:30:29.603604] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:30:30.120388] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T20:30:30.358073] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-14T20:30:31.136093] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T20:30:31.158022] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-14T20:30:31.789361] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T20:30:31.958064] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-14T20:30:32.582352] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T20:30:32.758050] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-14T20:30:33.373033] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T20:30:33.558042] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-14T20:30:34.088991] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-14T20:30:34.358053] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-14T20:30:34.895952] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-14T20:30:35.158096] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-14T20:30:35.958080] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-14T20:30:36.223675] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T20:30:36.617730] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T20:30:36.758053] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-14T20:30:37.558087] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-14T20:30:37.713088] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T20:30:38.130235] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T20:30:38.358086] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-14T20:30:38.890291] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T20:30:38.892156] [INFO ] [REMOTE ] NMM: Full fetch complete (21681 records). [2025-10-14T20:30:38.892224] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-14T20:30:38.892609] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:30:38.892709] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:30:38.892751] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:30:38.892792] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-14T20:30:38.892843] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-14T20:30:38.892880] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-14T20:30:38.892963] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-14T20:30:38.893068] [INFO ] [MAIN ] Update Progress: 1497/2369 symbols completed. NMM took 32.4s. Estimated remaining: 2h 2m 40s. Rate: 7.1 symbols/min [2025-10-14T20:30:39.059045] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:30:39.059214] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-14T20:30:39.059251] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-14T20:30:39.059357] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-14T20:30:39.059396] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-14T20:30:39.059436] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-14T20:30:39.059465] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-14T20:30:39.162690] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-14T20:30:39.413493] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:30:39.735599] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T20:30:39.958064] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-14T20:30:40.758056] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-14T20:30:41.287547] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-14T20:30:41.467419] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T20:30:41.558036] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-14T20:30:42.358056] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-14T20:30:43.066977] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T20:30:43.158051] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-14T20:30:43.588805] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T20:30:43.643761] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T20:30:43.958071] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-14T20:30:44.635056] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T20:30:44.758036] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-14T20:30:45.546396] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T20:30:45.558014] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-14T20:30:46.138549] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:30:46.139444] [INFO ] [REMOTE ] NMS: Full fetch complete (4081 records). [2025-10-14T20:30:46.139516] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-14T20:30:46.363163] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-14T20:30:46.500004] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-14T20:30:46.500073] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-14T20:30:46.500199] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-14T20:30:46.500235] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-14T20:30:46.500566] [DEBUG] [LOCAL ] NMS: Trimmed 4081 records to 2907 (keeping 200 days of data) [2025-10-14T20:30:46.517715] [DEBUG] [LOCAL ] NMS: Primary data saved (2907 records). [2025-10-14T20:30:46.517773] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-14T20:30:46.517832] [INFO ] [MAIN ] Update Progress: 1498/2369 symbols completed. NMS took 22.2s. Estimated remaining: 2h 2m 31s. Rate: 7.1 symbols/min [2025-10-14T20:30:46.683688] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:30:46.697299] [DEBUG] [LOCAL ] NNI: Loaded 10413 existing records from primary storage. [2025-10-14T20:30:46.697541] [INFO ] [MAIN ] NNI: Loaded 10413 existing records. [2025-10-14T20:30:46.896962] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:30:46.897197] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-14T20:30:46.897244] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-14T20:30:46.897435] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-14T20:30:46.897494] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-14T20:30:47.167242] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-14T20:30:47.274158] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:30:47.825957] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T20:30:47.958049] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-14T20:30:48.105907] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T20:30:48.758048] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-14T20:30:48.790824] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T20:30:49.558074] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-14T20:30:50.239600] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T20:30:50.306443] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T20:30:50.358029] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-14T20:30:51.158104] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-14T20:30:51.729872] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T20:30:51.778033] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T20:30:51.958057] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-14T20:30:52.699725] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-14T20:30:52.758022] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-14T20:30:53.462338] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-14T20:30:53.558047] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-14T20:30:54.358048] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-14T20:30:54.679705] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T20:30:54.943462] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T20:30:55.158072] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-14T20:30:55.958084] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-14T20:30:56.538498] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T20:30:56.758065] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-14T20:30:57.505777] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T20:30:57.558023] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-14T20:30:57.870877] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T20:30:58.358074] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-14T20:30:59.017242] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T20:30:59.037045] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-14T20:30:59.158038] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-14T20:30:59.958064] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-14T20:30:59.999022] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T20:31:00.536715] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T20:31:00.758069] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-14T20:31:01.403904] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T20:31:01.558085] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-14T20:31:02.358084] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-14T20:31:02.520087] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T20:31:03.158090] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-14T20:31:03.607619] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T20:31:03.608618] [INFO ] [REMOTE ] NMT: Full fetch complete (4005 records). [2025-10-14T20:31:03.608830] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-14T20:31:03.932341] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T20:31:03.961172] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-14T20:31:04.024896] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-14T20:31:04.024981] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-14T20:31:04.025123] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-14T20:31:04.025161] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-14T20:31:04.025514] [DEBUG] [LOCAL ] NMT: Trimmed 4005 records to 2829 (keeping 200 days of data) [2025-10-14T20:31:04.045432] [DEBUG] [LOCAL ] NMT: Primary data saved (2829 records). [2025-10-14T20:31:04.045559] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-14T20:31:04.045702] [INFO ] [MAIN ] Update Progress: 1499/2369 symbols completed. NMT took 35.2s. Estimated remaining: 2h 2m 28s. Rate: 7.1 symbols/min [2025-10-14T20:31:04.233625] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:04.233774] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-14T20:31:04.233816] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-14T20:31:04.233927] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-14T20:31:04.233968] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-14T20:31:04.234007] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-14T20:31:04.234037] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-14T20:31:04.585140] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:04.758037] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-14T20:31:05.107741] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T20:31:05.558061] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-14T20:31:06.341979] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T20:31:06.358034] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-14T20:31:06.787984] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T20:31:07.158102] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-14T20:31:07.814619] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T20:31:07.819401] [INFO ] [REMOTE ] NMR: Full fetch complete (51164 records). [2025-10-14T20:31:07.819533] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-14T20:31:07.970904] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-14T20:31:08.227992] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-14T20:31:08.228079] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-14T20:31:08.229014] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-14T20:31:08.229077] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-14T20:31:08.230187] [DEBUG] [LOCAL ] NMR: Trimmed 51164 records to 35529 (keeping 200 days of data) [2025-10-14T20:31:08.432063] [DEBUG] [LOCAL ] NMR: Primary data saved (35529 records). [2025-10-14T20:31:08.432205] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-14T20:31:08.432281] [INFO ] [MAIN ] Update Progress: 1500/2369 symbols completed. NMR took 44.4s. Estimated remaining: 2h 2m 17s. Rate: 7.1 symbols/min [2025-10-14T20:31:08.601547] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:08.609504] [DEBUG] [LOCAL ] NNY: Loaded 5632 existing records from primary storage. [2025-10-14T20:31:08.609728] [INFO ] [MAIN ] NNY: Loaded 5632 existing records. [2025-10-14T20:31:08.763127] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-14T20:31:08.792381] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:31:08.793554] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-14T20:31:08.793675] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-14T20:31:08.793989] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-14T20:31:08.794263] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-14T20:31:09.102854] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T20:31:09.130324] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-14T20:31:09.227237] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:09.558077] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-14T20:31:10.122141] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T20:31:10.358092] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-14T20:31:10.542496] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T20:31:11.158126] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-14T20:31:11.197064] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T20:31:11.958073] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-14T20:31:12.758042] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-14T20:31:12.827503] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T20:31:12.844920] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T20:31:13.558048] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-14T20:31:13.641258] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T20:31:14.358120] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-14T20:31:15.158070] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-14T20:31:15.326425] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T20:31:15.501263] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T20:31:15.958035] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-14T20:31:16.215387] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T20:31:16.758062] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-14T20:31:17.558030] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-14T20:31:17.864763] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T20:31:17.866214] [INFO ] [REMOTE ] NNI: Full fetch complete (12914 records). [2025-10-14T20:31:17.866282] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-14T20:31:18.203725] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T20:31:18.227725] [INFO ] [REMOTE ] NMZ: Full fetch complete (31292 records). [2025-10-14T20:31:18.263192] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-14T20:31:18.263100] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-14T20:31:18.277355] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:31:18.278129] [FATAL] [MAIN ] NMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:31:18.301825] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-14T20:31:18.301941] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-14T20:31:18.302535] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-14T20:31:18.302613] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-14T20:31:18.302666] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:31:18.302869] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-14T20:31:18.302980] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-14T20:31:18.303318] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-14T20:31:18.303562] [DEBUG] [LOCAL ] NNI: Trimmed 12914 records to 10427 (keeping 200 days of data) [2025-10-14T20:31:18.303501] [DEBUG] [LOCAL ] NMZ: No derivative data file found to delete. [2025-10-14T20:31:18.303753] [INFO ] [MAIN ] Update Progress: 1501/2369 symbols completed. NMZ took 39.4s. Estimated remaining: 2h 2m 9s. Rate: 7.1 symbols/min [2025-10-14T20:31:18.362853] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-14T20:31:18.545511] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:18.544099] [DEBUG] [LOCAL ] NNI: Primary data saved (10427 records). [2025-10-14T20:31:18.545667] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-14T20:31:18.545769] [INFO ] [MAIN ] Update Progress: 1502/2369 symbols completed. NNI took 32.0s. Estimated remaining: 2h 1m 56s. Rate: 7.1 symbols/min [2025-10-14T20:31:18.588708] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-14T20:31:18.621470] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-14T20:31:18.645813] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-14T20:31:18.645884] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-14T20:31:18.648744] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-14T20:31:18.648820] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-14T20:31:18.869532] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:18.877825] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-14T20:31:18.878479] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-14T20:31:18.879331] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-14T20:31:18.879395] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-14T20:31:18.894882] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-14T20:31:18.894959] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-14T20:31:19.170489] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-14T20:31:19.263371] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:19.445781] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:19.958092] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-14T20:31:19.988221] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T20:31:20.104611] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T20:31:20.758049] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-14T20:31:21.245429] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T20:31:21.326315] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T20:31:21.558100] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-14T20:31:22.358056] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-14T20:31:22.473091] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T20:31:23.158095] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-14T20:31:23.426940] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T20:31:23.958168] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-14T20:31:24.719741] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:31:24.758036] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-14T20:31:24.884321] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T20:31:25.464925] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T20:31:25.558068] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-14T20:31:26.358036] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-14T20:31:26.441563] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T20:31:27.158093] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-14T20:31:27.348172] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T20:31:27.958128] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-14T20:31:28.758054] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-14T20:31:29.007219] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T20:31:29.055250] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T20:31:29.558096] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-14T20:31:29.894341] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T20:31:30.337204] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T20:31:30.358032] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-14T20:31:31.044763] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T20:31:31.158069] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-14T20:31:31.958075] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-14T20:31:32.758083] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-14T20:31:32.999893] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T20:31:33.349421] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T20:31:33.558114] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-14T20:31:33.922877] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T20:31:34.092446] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T20:31:34.358035] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-14T20:31:35.158068] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-14T20:31:35.199111] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T20:31:35.958068] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-14T20:31:36.632019] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T20:31:36.758026] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-14T20:31:36.929296] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T20:31:37.313845] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T20:31:37.558056] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-14T20:31:38.248003] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:31:38.252857] [INFO ] [REMOTE ] NNN: Full fetch complete (70003 records). [2025-10-14T20:31:38.252966] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-14T20:31:38.253591] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:31:38.253693] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:31:38.253738] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:31:38.253779] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-14T20:31:38.253847] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-14T20:31:38.253908] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-14T20:31:38.253949] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-14T20:31:38.254003] [INFO ] [MAIN ] Update Progress: 1503/2369 symbols completed. NNN took 34.2s. Estimated remaining: 2h 1m 54s. Rate: 7.1 symbols/min [2025-10-14T20:31:38.361441] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-14T20:31:38.431732] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:38.431889] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-14T20:31:38.431927] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-14T20:31:38.432036] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-14T20:31:38.432077] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-14T20:31:38.432118] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-14T20:31:38.432151] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-14T20:31:38.795087] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:39.158061] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-14T20:31:39.321901] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T20:31:39.958064] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-14T20:31:40.758059] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-14T20:31:40.950244] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T20:31:41.120309] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T20:31:41.391397] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:31:41.392445] [INFO ] [REMOTE ] NNY: Full fetch complete (8431 records). [2025-10-14T20:31:41.392511] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-14T20:31:41.563939] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-14T20:31:41.750966] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-14T20:31:41.751039] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-14T20:31:41.751243] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-14T20:31:41.751278] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-14T20:31:41.751690] [DEBUG] [LOCAL ] NNY: Trimmed 8431 records to 5641 (keeping 200 days of data) [2025-10-14T20:31:41.784469] [DEBUG] [LOCAL ] NNY: Primary data saved (5641 records). [2025-10-14T20:31:41.784566] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-14T20:31:41.784661] [INFO ] [MAIN ] Update Progress: 1504/2369 symbols completed. NNY took 33.4s. Estimated remaining: 2h 1m 43s. Rate: 7.1 symbols/min [2025-10-14T20:31:41.961924] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:41.962092] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-14T20:31:41.962130] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-14T20:31:41.962244] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-14T20:31:41.962284] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-14T20:31:41.962333] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-14T20:31:41.962364] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-14T20:31:42.324360] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:42.358052] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-14T20:31:42.633082] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T20:31:43.158103] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-14T20:31:43.958092] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-14T20:31:44.106319] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T20:31:44.157636] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T20:31:44.758051] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-14T20:31:45.013835] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T20:31:45.558098] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-14T20:31:46.358051] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-14T20:31:46.542201] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T20:31:46.816889] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T20:31:47.158039] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-14T20:31:47.324924] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T20:31:47.831715] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:31:47.834171] [INFO ] [REMOTE ] NOAH: Full fetch complete (27848 records). [2025-10-14T20:31:47.834241] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-14T20:31:47.834738] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:31:47.834921] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:31:47.834989] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:31:47.835059] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-14T20:31:47.835170] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-14T20:31:47.835234] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-14T20:31:47.835283] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-14T20:31:47.835355] [INFO ] [MAIN ] Update Progress: 1505/2369 symbols completed. NOAH took 29.3s. Estimated remaining: 2h 1m 33s. Rate: 7.1 symbols/min [2025-10-14T20:31:47.963162] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-14T20:31:48.006740] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:48.058174] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-14T20:31:48.058479] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-14T20:31:48.234566] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:31:48.234833] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-14T20:31:48.234888] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-14T20:31:48.235445] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-14T20:31:48.235503] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-14T20:31:48.596351] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:48.758058] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-14T20:31:49.558045] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-14T20:31:49.710882] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T20:31:50.358046] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-14T20:31:50.489963] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T20:31:50.544579] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T20:31:51.158009] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-14T20:31:51.958035] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-14T20:31:52.149581] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T20:31:52.356519] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T20:31:52.758066] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-14T20:31:53.558097] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-14T20:31:53.792563] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T20:31:53.981482] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T20:31:54.358062] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-14T20:31:55.058773] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T20:31:55.158089] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-14T20:31:55.958041] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-14T20:31:56.329504] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-14T20:31:56.637623] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:31:56.640124] [INFO ] [REMOTE ] NOA: Full fetch complete (22247 records). [2025-10-14T20:31:56.640359] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-14T20:31:56.641010] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:31:56.641135] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:31:56.641236] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:31:56.641310] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-14T20:31:56.641374] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-14T20:31:56.641453] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-14T20:31:56.641515] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-14T20:31:56.641570] [INFO ] [MAIN ] Update Progress: 1506/2369 symbols completed. NOA took 38.3s. Estimated remaining: 2h 1m 25s. Rate: 7.1 symbols/min [2025-10-14T20:31:56.767751] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-14T20:31:56.820161] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:31:56.820423] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-14T20:31:56.820489] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-14T20:31:56.820691] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-14T20:31:56.820817] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-14T20:31:56.820903] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-14T20:31:56.821017] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-14T20:31:56.997158] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T20:31:57.219212] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:31:57.558062] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-14T20:31:58.071392] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-14T20:31:58.358041] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-14T20:31:58.699729] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T20:31:59.158072] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-14T20:31:59.578353] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-14T20:31:59.892157] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T20:31:59.958051] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-14T20:32:00.428227] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T20:32:00.758101] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-14T20:32:01.558045] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-14T20:32:02.082159] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T20:32:02.358056] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-14T20:32:03.031343] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-14T20:32:03.158102] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-14T20:32:03.958106] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-14T20:32:04.428744] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T20:32:04.695553] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-14T20:32:04.758029] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-14T20:32:05.558055] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-14T20:32:06.004895] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T20:32:06.055902] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-14T20:32:06.358079] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-14T20:32:06.745732] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-14T20:32:06.761941] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-14T20:32:07.158142] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-14T20:32:07.958084] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-14T20:32:08.758079] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-14T20:32:09.486881] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-14T20:32:09.558028] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-14T20:32:09.838287] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T20:32:10.358096] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-14T20:32:10.658678] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T20:32:11.158093] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-14T20:32:11.582324] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-14T20:32:11.958047] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-14T20:32:12.086806] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T20:32:12.253584] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-14T20:32:12.758067] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-14T20:32:13.558071] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-14T20:32:13.647620] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T20:32:14.113996] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-14T20:32:14.358031] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-14T20:32:14.450118] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T20:32:15.158087] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-14T20:32:15.768179] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-14T20:32:15.958044] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-14T20:32:16.075725] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T20:32:16.423124] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T20:32:16.423841] [INFO ] [REMOTE ] NOM: Full fetch complete (1568 records). [2025-10-14T20:32:16.423907] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-14T20:32:16.600771] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-14T20:32:16.601143] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:32:16.601211] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:32:16.601278] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-14T20:32:16.601341] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-14T20:32:16.601375] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-14T20:32:16.601413] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-14T20:32:16.601464] [INFO ] [MAIN ] Update Progress: 1507/2369 symbols completed. NOM took 20.0s. Estimated remaining: 2h 1m 23s. Rate: 7.1 symbols/min [2025-10-14T20:32:16.768971] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-14T20:32:16.772380] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:16.772506] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-14T20:32:16.773321] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-14T20:32:16.773430] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-14T20:32:16.773471] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-14T20:32:16.773512] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-14T20:32:16.773557] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-14T20:32:17.129558] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:17.558070] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-14T20:32:18.358092] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-14T20:32:18.834030] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-14T20:32:19.063458] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T20:32:19.158061] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-14T20:32:19.561914] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T20:32:19.958079] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-14T20:32:20.393355] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T20:32:20.758052] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-14T20:32:21.143945] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T20:32:21.147821] [INFO ] [REMOTE ] NOC: Full fetch complete (61505 records). [2025-10-14T20:32:21.147915] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-14T20:32:21.148460] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:32:21.148542] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:32:21.148584] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:32:21.148620] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-14T20:32:21.148704] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-14T20:32:21.148751] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-14T20:32:21.148794] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-14T20:32:21.148846] [INFO ] [MAIN ] Update Progress: 1508/2369 symbols completed. NOC took 42.9s. Estimated remaining: 2h 1m 13s. Rate: 7.1 symbols/min [2025-10-14T20:32:21.320998] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:21.359238] [DEBUG] [LOCAL ] NOTE: Loaded 40651 existing records from primary storage. [2025-10-14T20:32:21.359495] [INFO ] [MAIN ] NOTE: Loaded 40651 existing records. [2025-10-14T20:32:21.559585] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-14T20:32:21.559483] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:32:21.570532] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-14T20:32:21.570728] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-14T20:32:21.571328] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-14T20:32:21.572618] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T20:32:21.572787] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-14T20:32:21.930197] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:22.358109] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-14T20:32:22.980911] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T20:32:23.098734] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:32:23.104535] [INFO ] [REMOTE ] NOG: Full fetch complete (73730 records). [2025-10-14T20:32:23.104777] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-14T20:32:23.106780] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:32:23.106982] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:32:23.107051] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:32:23.107129] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-14T20:32:23.107199] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-14T20:32:23.107236] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-14T20:32:23.107278] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-14T20:32:23.107395] [INFO ] [MAIN ] Update Progress: 1509/2369 symbols completed. NOG took 41.3s. Estimated remaining: 2h 1m 0s. Rate: 7.1 symbols/min [2025-10-14T20:32:23.166030] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-14T20:32:23.298976] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:23.299138] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-14T20:32:23.299176] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-14T20:32:23.299307] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-14T20:32:23.299379] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-14T20:32:23.299436] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-14T20:32:23.299470] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-14T20:32:23.679803] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:23.958325] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-14T20:32:24.758062] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-14T20:32:25.459452] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-14T20:32:25.558064] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-14T20:32:25.923431] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-14T20:32:26.000756] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T20:32:26.358056] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-14T20:32:27.158068] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-14T20:32:27.778522] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-14T20:32:27.874470] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T20:32:27.958025] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-14T20:32:28.428082] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T20:32:28.758075] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-14T20:32:29.558042] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-14T20:32:29.865743] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-14T20:32:30.358072] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-14T20:32:30.615114] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T20:32:31.158072] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-14T20:32:31.305186] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T20:32:31.958071] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-14T20:32:32.545993] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-14T20:32:32.625020] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T20:32:32.758090] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-14T20:32:33.558046] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-14T20:32:33.995556] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-14T20:32:34.358071] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-14T20:32:35.026781] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-14T20:32:35.032589] [INFO ] [REMOTE ] NOK: Full fetch complete (77755 records). [2025-10-14T20:32:35.032734] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-14T20:32:35.173039] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-14T20:32:35.453566] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-14T20:32:35.453753] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-14T20:32:35.455010] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-14T20:32:35.462906] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-14T20:32:35.478022] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T20:32:35.488479] [DEBUG] [LOCAL ] NOK: Trimmed 77755 records to 53622 (keeping 200 days of data) [2025-10-14T20:32:35.802500] [DEBUG] [LOCAL ] NOK: Primary data saved (53622 records). [2025-10-14T20:32:35.802691] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-14T20:32:35.802786] [INFO ] [MAIN ] Update Progress: 1510/2369 symbols completed. NOK took 48.0s. Estimated remaining: 2h 0m 54s. Rate: 7.1 symbols/min [2025-10-14T20:32:35.979133] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-14T20:32:35.982791] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:35.982956] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-14T20:32:35.983766] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-14T20:32:35.984042] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-14T20:32:35.984149] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-14T20:32:35.984255] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-14T20:32:35.984408] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-14T20:32:36.134840] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T20:32:36.389214] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:36.720531] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T20:32:36.758064] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-14T20:32:37.558062] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-14T20:32:37.920359] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T20:32:38.350909] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T20:32:38.359068] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-14T20:32:39.158080] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-14T20:32:39.331907] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T20:32:39.726404] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T20:32:39.958089] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-14T20:32:40.406576] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T20:32:40.758074] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-14T20:32:41.558089] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-14T20:32:41.774357] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T20:32:42.316531] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T20:32:42.358082] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-14T20:32:43.158107] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-14T20:32:43.746006] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-14T20:32:43.820368] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T20:32:43.958049] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-14T20:32:44.466297] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T20:32:44.758188] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-14T20:32:45.558077] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-14T20:32:45.902441] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T20:32:46.122248] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T20:32:46.268504] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:32:46.273722] [INFO ] [REMOTE ] NOMD: Full fetch complete (59765 records). [2025-10-14T20:32:46.273880] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-14T20:32:46.274486] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:32:46.274584] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:32:46.274626] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:32:46.274700] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-14T20:32:46.274766] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-14T20:32:46.274800] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-14T20:32:46.274837] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-14T20:32:46.274898] [INFO ] [MAIN ] Update Progress: 1511/2369 symbols completed. NOMD took 29.7s. Estimated remaining: 2h 0m 47s. Rate: 7.1 symbols/min [2025-10-14T20:32:46.363140] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-14T20:32:46.448433] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:46.448589] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-14T20:32:46.448625] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-14T20:32:46.448800] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-14T20:32:46.448841] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-14T20:32:46.448881] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-14T20:32:46.448911] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-14T20:32:46.806023] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:47.158077] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-14T20:32:47.958111] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-14T20:32:48.350689] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T20:32:48.354194] [INFO ] [REMOTE ] NOTE: Full fetch complete (62296 records). [2025-10-14T20:32:48.354300] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-14T20:32:48.760850] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-14T20:32:48.760542] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-14T20:32:48.761079] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-14T20:32:48.763540] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-14T20:32:48.763723] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-14T20:32:48.765229] [DEBUG] [LOCAL ] NOTE: Trimmed 62296 records to 40495 (keeping 200 days of data) [2025-10-14T20:32:48.791324] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-14T20:32:49.032373] [DEBUG] [LOCAL ] NOTE: Primary data saved (40495 records). [2025-10-14T20:32:49.032493] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-14T20:32:49.032564] [INFO ] [MAIN ] Update Progress: 1512/2369 symbols completed. NOTE took 27.9s. Estimated remaining: 2h 0m 35s. Rate: 7.1 symbols/min [2025-10-14T20:32:49.175217] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:32:49.206768] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:49.206957] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-14T20:32:49.204244] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-14T20:32:49.207041] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:32:49.207188] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-14T20:32:49.207084] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-14T20:32:49.207383] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-14T20:32:49.207265] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:32:49.207575] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-14T20:32:49.207506] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-14T20:32:49.207722] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-14T20:32:49.207823] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-14T20:32:49.207866] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-14T20:32:49.207958] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-14T20:32:49.240292] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-14T20:32:49.274739] [INFO ] [MAIN ] Update Progress: 1513/2369 symbols completed. NP took 3.0s. Estimated remaining: 2h 0m 22s. Rate: 7.1 symbols/min [2025-10-14T20:32:49.566811] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-14T20:32:49.594084] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:49.657399] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-14T20:32:49.669091] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-14T20:32:49.674820] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-14T20:32:49.685134] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-14T20:32:49.690332] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-14T20:32:49.709384] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-14T20:32:49.836223] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:50.120497] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:50.215476] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T20:32:50.358024] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-14T20:32:51.158107] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-14T20:32:51.415837] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T20:32:51.499164] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:32:51.499462] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-14T20:32:51.499555] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:32:51.499604] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-14T20:32:51.499636] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:32:51.499731] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-14T20:32:51.499789] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-14T20:32:51.499824] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-14T20:32:51.499862] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-14T20:32:51.499904] [INFO ] [MAIN ] Update Progress: 1514/2369 symbols completed. NPB took 2.5s. Estimated remaining: 2h 0m 10s. Rate: 7.1 symbols/min [2025-10-14T20:32:51.670024] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:32:51.682764] [DEBUG] [LOCAL ] NPFD: Loaded 9968 existing records from primary storage. [2025-10-14T20:32:51.682959] [INFO ] [MAIN ] NPFD: Loaded 9968 existing records. [2025-10-14T20:32:51.862225] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:32:51.862428] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-14T20:32:51.862622] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-14T20:32:51.862861] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-14T20:32:51.862932] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-14T20:32:51.965489] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-14T20:32:52.181849] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-14T20:32:52.271251] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:32:52.758078] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-14T20:32:53.558063] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-14T20:32:53.850618] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T20:32:53.936390] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:32:54.210346] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T20:32:54.358063] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-14T20:32:55.158067] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-14T20:32:55.958037] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-14T20:32:56.033405] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T20:32:56.763831] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-14T20:32:56.769502] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-14T20:32:57.558073] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-14T20:32:57.579391] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T20:32:57.894859] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T20:32:58.358166] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-14T20:32:59.158085] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-14T20:32:59.695563] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-14T20:32:59.958095] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-14T20:32:59.980371] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T20:33:00.194629] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T20:33:00.758058] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-14T20:33:01.558112] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-14T20:33:01.663184] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T20:33:01.927048] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T20:33:02.358153] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-14T20:33:03.149923] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T20:33:03.160350] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-14T20:33:03.960999] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-14T20:33:03.962805] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T20:33:04.265342] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T20:33:04.583557] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T20:33:04.758105] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-14T20:33:05.558098] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-14T20:33:06.358050] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-14T20:33:06.821278] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T20:33:07.063711] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-14T20:33:07.089462] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:33:07.096080] [INFO ] [REMOTE ] NOV: Full fetch complete (76769 records). [2025-10-14T20:33:07.096177] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-14T20:33:07.096880] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:33:07.096989] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:33:07.097030] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:33:07.097070] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-14T20:33:07.097124] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-14T20:33:07.097158] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-14T20:33:07.097196] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-14T20:33:07.097251] [INFO ] [MAIN ] Update Progress: 1515/2369 symbols completed. NOV took 44.0s. Estimated remaining: 2h 0m 6s. Rate: 7.1 symbols/min [2025-10-14T20:33:07.163255] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-14T20:33:07.268037] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:33:07.278159] [DEBUG] [LOCAL ] NPK: Loaded 8253 existing records from primary storage. [2025-10-14T20:33:07.278366] [INFO ] [MAIN ] NPK: Loaded 8253 existing records. [2025-10-14T20:33:07.452504] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:33:07.452716] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-14T20:33:07.452770] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-14T20:33:07.452977] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-14T20:33:07.453033] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-14T20:33:07.809140] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:33:07.958050] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-14T20:33:08.758025] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-14T20:33:09.142872] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T20:33:09.558057] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-14T20:33:10.075494] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-14T20:33:10.358072] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-14T20:33:10.763618] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T20:33:10.855800] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:33:10.860706] [INFO ] [REMOTE ] NOW: Full fetch complete (70376 records). [2025-10-14T20:33:10.860812] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-14T20:33:10.861433] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:33:10.861513] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:33:10.861558] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:33:10.861619] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-14T20:33:10.861713] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-14T20:33:10.861760] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-14T20:33:10.861842] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-14T20:33:10.861903] [INFO ] [MAIN ] Update Progress: 1516/2369 symbols completed. NOW took 35.1s. Estimated remaining: 1h 59m 55s. Rate: 7.1 symbols/min [2025-10-14T20:33:11.028921] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:33:11.029047] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-14T20:33:11.029083] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-14T20:33:11.029190] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-14T20:33:11.029231] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-14T20:33:11.029271] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-14T20:33:11.029302] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-14T20:33:11.171419] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-14T20:33:11.384401] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:33:11.958111] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-14T20:33:12.363855] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T20:33:12.376131] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (3.62 seconds). [2025-10-14T20:33:12.589736] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-14T20:33:12.758111] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-14T20:33:13.558074] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-14T20:33:14.087447] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T20:33:14.358051] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-14T20:33:14.589920] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T20:33:15.158086] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-14T20:33:15.199280] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T20:33:15.958153] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-14T20:33:16.009046] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T20:33:16.758131] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-14T20:33:17.372548] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T20:33:17.558084] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-14T20:33:17.845716] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T20:33:18.302396] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T20:33:18.358041] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-14T20:33:19.163601] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-14T20:33:19.164625] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T20:33:19.958046] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-14T20:33:20.066525] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-14T20:33:20.758089] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-14T20:33:20.780154] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T20:33:21.558044] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-14T20:33:21.783009] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T20:33:22.201531] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-14T20:33:22.358079] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-14T20:33:23.158044] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-14T20:33:23.232097] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T20:33:23.958093] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-14T20:33:24.582806] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T20:33:24.585048] [INFO ] [REMOTE ] NPCT: Full fetch complete (24688 records). [2025-10-14T20:33:24.585245] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-14T20:33:24.586320] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:33:24.586480] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:33:24.586554] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:33:24.586672] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-14T20:33:24.586780] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-14T20:33:24.586882] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-14T20:33:24.586966] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-14T20:33:24.587070] [INFO ] [MAIN ] Update Progress: 1517/2369 symbols completed. NPCT took 35.3s. Estimated remaining: 1h 59m 49s. Rate: 7.1 symbols/min [2025-10-14T20:33:24.758045] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-14T20:33:24.790930] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T20:33:25.558047] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-14T20:33:25.630831] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T20:33:25.632771] [INFO ] [REMOTE ] NPFD: Full fetch complete (14704 records). [2025-10-14T20:33:25.632889] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-14T20:33:26.001426] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-14T20:33:26.001500] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-14T20:33:26.001825] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-14T20:33:26.001884] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-14T20:33:26.002341] [DEBUG] [LOCAL ] NPFD: Trimmed 14704 records to 10015 (keeping 200 days of data) [2025-10-14T20:33:26.067081] [DEBUG] [LOCAL ] NPFD: Primary data saved (10015 records). [2025-10-14T20:33:26.067213] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-14T20:33:26.067293] [INFO ] [MAIN ] Update Progress: 1518/2369 symbols completed. NPFD took 34.6s. Estimated remaining: 1h 59m 37s. Rate: 7.1 symbols/min [2025-10-14T20:33:26.358066] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-14T20:33:27.352876] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T20:33:27.375306] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-14T20:33:27.379828] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:33:27.958065] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-14T20:33:28.325845] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T20:33:28.758096] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-14T20:33:30.243374] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-14T20:33:30.252893] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-14T20:33:30.393505] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T20:33:30.398085] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-14T20:33:31.220732] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T20:33:31.223095] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-14T20:33:31.881151] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T20:33:31.958035] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-14T20:33:31.998788] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T20:33:32.758104] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-14T20:33:33.496830] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:33:33.498964] [INFO ] [REMOTE ] NPK: Full fetch complete (10989 records). [2025-10-14T20:33:33.499045] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-14T20:33:33.902280] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T20:33:33.902361] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-14T20:33:33.911079] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-14T20:33:33.911674] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-14T20:33:33.911843] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-14T20:33:33.912212] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-14T20:33:33.913426] [DEBUG] [LOCAL ] NPK: Trimmed 10989 records to 8333 (keeping 200 days of data) [2025-10-14T20:33:33.963074] [DEBUG] [LOCAL ] NPK: Primary data saved (8333 records). [2025-10-14T20:33:33.963184] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-14T20:33:33.963255] [INFO ] [MAIN ] Update Progress: 1519/2369 symbols completed. NPK took 26.9s. Estimated remaining: 1h 59m 28s. Rate: 7.1 symbols/min [2025-10-14T20:33:35.439353] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T20:33:35.449122] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-14T20:33:36.939448] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T20:33:36.946975] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-14T20:33:37.601282] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T20:33:37.605391] [INFO ] [REMOTE ] NPKI: Full fetch complete (55534 records). [2025-10-14T20:33:37.605468] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-14T20:33:37.606126] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:33:37.606209] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:33:37.606250] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:33:37.606285] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-14T20:33:37.606338] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-14T20:33:37.606371] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-14T20:33:37.606408] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-14T20:33:37.606466] [INFO ] [MAIN ] Update Progress: 1520/2369 symbols completed. NPKI took 26.7s. Estimated remaining: 1h 59m 17s. Rate: 7.1 symbols/min [2025-10-14T20:33:38.109504] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:33:38.190225] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-14T20:33:38.241405] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-14T20:33:38.272020] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-14T20:33:38.241335] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:33:38.304311] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-14T20:33:38.307894] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:33:38.308263] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-14T20:33:38.310972] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-14T20:33:38.310894] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-14T20:33:38.310375] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:33:38.311267] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-14T20:33:38.311322] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-14T20:33:38.311569] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-14T20:33:38.323959] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-14T20:33:38.347781] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-14T20:33:38.405079] [DEBUG] [LOCAL ] NPV: Loaded 5318 existing records from primary storage. [2025-10-14T20:33:38.424314] [INFO ] [MAIN ] NPV: Loaded 5318 existing records. [2025-10-14T20:33:38.508279] [DEBUG] [LOCAL ] NQP: Loaded 9236 existing records from primary storage. [2025-10-14T20:33:38.557817] [INFO ] [MAIN ] NQP: Loaded 9236 existing records. [2025-10-14T20:33:39.162421] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:33:39.262511] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:33:39.259265] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-14T20:33:39.290906] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-14T20:33:39.299411] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-14T20:33:39.304796] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-14T20:33:39.323074] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-14T20:33:39.310039] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-14T20:33:39.348749] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-14T20:33:39.343558] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-14T20:33:39.455833] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:33:39.550808] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-14T20:33:39.598769] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:33:39.612776] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-14T20:33:40.152587] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:33:40.165940] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-14T20:33:40.196431] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:33:40.196813] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-14T20:33:40.726423] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:33:40.729977] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-14T20:33:40.735046] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T20:33:40.736546] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-14T20:33:41.100930] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T20:33:41.104102] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-14T20:33:41.189628] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T20:33:41.542206] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T20:33:41.558014] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-14T20:33:41.698282] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T20:33:41.710411] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T20:33:42.206847] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T20:33:42.358054] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-14T20:33:43.085992] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T20:33:43.158076] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-14T20:33:43.958032] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-14T20:33:44.039186] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T20:33:44.758104] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-14T20:33:45.561490] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-14T20:33:45.564249] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T20:33:46.358083] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-14T20:33:46.485555] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T20:33:46.670096] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T20:33:47.158062] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-14T20:33:47.682996] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T20:33:47.958097] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-14T20:33:48.378320] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:33:48.678902] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T20:33:48.758070] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-14T20:33:49.558080] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-14T20:33:49.805791] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T20:33:50.358120] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-14T20:33:51.158041] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-14T20:33:51.208489] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T20:33:51.429489] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T20:33:51.821432] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T20:33:51.958091] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-14T20:33:52.758048] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-14T20:33:52.924703] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T20:33:53.558138] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-14T20:33:53.613311] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T20:33:54.358151] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-14T20:33:54.839532] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-14T20:33:55.108096] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T20:33:55.158143] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-14T20:33:55.843560] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T20:33:55.958117] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-14T20:33:56.758067] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-14T20:33:56.780435] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T20:33:57.558046] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-14T20:33:57.613139] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T20:33:58.358120] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-14T20:33:58.398332] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T20:33:58.856470] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T20:33:59.158119] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-14T20:33:59.939136] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:33:59.940481] [INFO ] [REMOTE ] NQP: Full fetch complete (13086 records). [2025-10-14T20:33:59.940548] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-14T20:33:59.963247] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-14T20:34:00.304083] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-14T20:34:00.304158] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-14T20:34:00.304449] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-14T20:34:00.304489] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-14T20:34:00.304950] [DEBUG] [LOCAL ] NQP: Trimmed 13086 records to 9239 (keeping 200 days of data) [2025-10-14T20:34:00.358848] [DEBUG] [LOCAL ] NQP: Primary data saved (9239 records). [2025-10-14T20:34:00.358952] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-14T20:34:00.359026] [INFO ] [MAIN ] Update Progress: 1521/2369 symbols completed. NQP took 22.7s. Estimated remaining: 1h 59m 17s. Rate: 7.1 symbols/min [2025-10-14T20:34:00.528218] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:00.563418] [DEBUG] [LOCAL ] NRDY: Loaded 32701 existing records from primary storage. [2025-10-14T20:34:00.563699] [INFO ] [MAIN ] NRDY: Loaded 32701 existing records. [2025-10-14T20:34:00.740222] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:34:00.740435] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-14T20:34:00.740492] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-14T20:34:00.741228] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-14T20:34:00.741298] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-14T20:34:00.763266] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-14T20:34:01.063849] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T20:34:01.107820] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:01.558064] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-14T20:34:02.029285] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T20:34:02.358120] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-14T20:34:03.158100] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-14T20:34:03.428020] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T20:34:03.958041] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-14T20:34:04.352776] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-14T20:34:04.758040] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-14T20:34:04.905946] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T20:34:05.041441] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T20:34:05.558102] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-14T20:34:06.298709] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T20:34:06.300081] [INFO ] [REMOTE ] NPV: Full fetch complete (7102 records). [2025-10-14T20:34:06.300150] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-14T20:34:06.367549] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-14T20:34:06.682543] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-14T20:34:06.682680] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-14T20:34:06.682941] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-14T20:34:06.683019] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-14T20:34:06.683515] [DEBUG] [LOCAL ] NPV: Trimmed 7102 records to 5319 (keeping 200 days of data) [2025-10-14T20:34:06.716071] [DEBUG] [LOCAL ] NPV: Primary data saved (5319 records). [2025-10-14T20:34:06.716160] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-14T20:34:06.716234] [INFO ] [MAIN ] Update Progress: 1522/2369 symbols completed. NPV took 29.1s. Estimated remaining: 1h 59m 7s. Rate: 7.1 symbols/min [2025-10-14T20:34:06.894094] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:06.930931] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T20:34:06.944977] [DEBUG] [LOCAL ] NREF: Loaded 8010 existing records from primary storage. [2025-10-14T20:34:06.945239] [INFO ] [MAIN ] NREF: Loaded 8010 existing records. [2025-10-14T20:34:07.150595] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:34:07.150856] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-14T20:34:07.150904] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-14T20:34:07.151119] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-14T20:34:07.151176] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-14T20:34:07.164113] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-14T20:34:07.510087] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:07.958108] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-14T20:34:08.057060] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T20:34:08.096999] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T20:34:08.758064] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-14T20:34:08.835668] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T20:34:09.452004] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T20:34:09.558068] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-14T20:34:10.358110] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-14T20:34:11.059375] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T20:34:11.109414] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T20:34:11.158075] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-14T20:34:11.747422] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T20:34:11.750060] [INFO ] [REMOTE ] NPO: Full fetch complete (18500 records). [2025-10-14T20:34:11.750148] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-14T20:34:11.750666] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:34:11.750763] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:34:11.750841] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:34:11.750938] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-14T20:34:11.751015] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-14T20:34:11.751053] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-14T20:34:11.751093] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-14T20:34:11.751148] [INFO ] [MAIN ] Update Progress: 1523/2369 symbols completed. NPO took 34.1s. Estimated remaining: 1h 58m 57s. Rate: 7.1 symbols/min [2025-10-14T20:34:11.932907] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:11.933057] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-14T20:34:11.933093] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-14T20:34:11.933199] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-14T20:34:11.933239] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-14T20:34:11.933279] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-14T20:34:11.933311] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-14T20:34:11.963157] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-14T20:34:12.297895] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:12.758097] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-14T20:34:13.419873] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T20:34:13.558049] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-14T20:34:13.722132] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T20:34:14.358078] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-14T20:34:15.157991] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T20:34:15.158039] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-14T20:34:15.320730] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T20:34:15.958119] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-14T20:34:16.758085] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-14T20:34:17.101011] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T20:34:17.394135] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T20:34:17.558068] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-14T20:34:18.358097] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-14T20:34:18.626392] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T20:34:18.901668] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-14T20:34:19.158062] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-14T20:34:19.878558] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T20:34:19.958099] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-14T20:34:20.026420] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T20:34:20.758033] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-14T20:34:20.856478] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T20:34:21.558066] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-14T20:34:22.358110] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-14T20:34:22.538712] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T20:34:22.539339] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T20:34:23.158094] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-14T20:34:23.868910] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:34:23.873888] [INFO ] [REMOTE ] NPWR: Full fetch complete (59922 records). [2025-10-14T20:34:23.873995] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-14T20:34:23.874587] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:34:23.874704] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:34:23.874782] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:34:23.874865] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-14T20:34:23.874940] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-14T20:34:23.874987] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-14T20:34:23.875041] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-14T20:34:23.875112] [INFO ] [MAIN ] Update Progress: 1524/2369 symbols completed. NPWR took 46.3s. Estimated remaining: 1h 58m 50s. Rate: 7.1 symbols/min [2025-10-14T20:34:23.963131] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-14T20:34:24.052553] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:24.084816] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T20:34:24.128530] [DEBUG] [LOCAL ] NRGV: Loaded 43608 existing records from primary storage. [2025-10-14T20:34:24.128847] [INFO ] [MAIN ] NRGV: Loaded 43608 existing records. [2025-10-14T20:34:24.309241] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:34:24.309488] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-14T20:34:24.309537] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-14T20:34:24.309961] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-14T20:34:24.310021] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-14T20:34:24.661946] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:24.758038] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-14T20:34:25.477669] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T20:34:25.558066] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-14T20:34:26.358131] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-14T20:34:26.501388] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T20:34:26.572906] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T20:34:27.158064] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-14T20:34:27.952267] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T20:34:27.958018] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-14T20:34:28.212434] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T20:34:28.449212] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T20:34:28.758099] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-14T20:34:29.558112] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-14T20:34:29.598149] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T20:34:29.599587] [INFO ] [REMOTE ] NREF: Full fetch complete (10982 records). [2025-10-14T20:34:29.599679] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-14T20:34:29.954539] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-14T20:34:29.954601] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-14T20:34:29.954868] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-14T20:34:29.954929] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-14T20:34:29.955336] [DEBUG] [LOCAL ] NREF: Trimmed 10982 records to 8027 (keeping 200 days of data) [2025-10-14T20:34:30.006998] [DEBUG] [LOCAL ] NREF: Primary data saved (8027 records). [2025-10-14T20:34:30.007113] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-14T20:34:30.007202] [INFO ] [MAIN ] Update Progress: 1525/2369 symbols completed. NREF took 23.3s. Estimated remaining: 1h 58m 41s. Rate: 7.1 symbols/min [2025-10-14T20:34:30.174117] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:30.174250] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-14T20:34:30.174288] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-14T20:34:30.174391] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-14T20:34:30.174431] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-14T20:34:30.174472] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-14T20:34:30.174503] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-14T20:34:30.367744] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-14T20:34:30.523091] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:31.127473] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T20:34:31.158048] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-14T20:34:31.958040] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-14T20:34:32.125628] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T20:34:32.758091] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-14T20:34:33.103664] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T20:34:33.142170] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T20:34:33.558105] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-14T20:34:34.206186] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T20:34:34.358123] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-14T20:34:35.158083] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-14T20:34:35.858599] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T20:34:35.967549] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-14T20:34:35.990056] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-14T20:34:36.348897] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:34:36.758053] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-14T20:34:37.500694] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T20:34:37.558037] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-14T20:34:38.358121] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-14T20:34:38.517123] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T20:34:38.966352] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T20:34:38.970464] [INFO ] [REMOTE ] NRDY: Full fetch complete (50807 records). [2025-10-14T20:34:38.970560] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-14T20:34:39.164189] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-14T20:34:39.390767] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-14T20:34:39.390846] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-14T20:34:39.391735] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-14T20:34:39.391796] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-14T20:34:39.392898] [DEBUG] [LOCAL ] NRDY: Trimmed 50807 records to 32673 (keeping 200 days of data) [2025-10-14T20:34:39.585918] [DEBUG] [LOCAL ] NRDY: Primary data saved (32673 records). [2025-10-14T20:34:39.586095] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-14T20:34:39.586189] [INFO ] [MAIN ] Update Progress: 1526/2369 symbols completed. NRDY took 39.2s. Estimated remaining: 1h 58m 33s. Rate: 7.1 symbols/min [2025-10-14T20:34:39.754976] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:39.761512] [DEBUG] [LOCAL ] NRP: Loaded 4115 existing records from primary storage. [2025-10-14T20:34:39.761710] [INFO ] [MAIN ] NRP: Loaded 4115 existing records. [2025-10-14T20:34:39.937079] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:34:39.937968] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-14T20:34:39.938045] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-14T20:34:39.938252] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-14T20:34:39.938309] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-14T20:34:39.980785] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-14T20:34:40.331281] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:40.333032] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T20:34:40.372350] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T20:34:40.758055] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-14T20:34:41.558076] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-14T20:34:41.712084] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T20:34:42.358044] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-14T20:34:42.545563] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T20:34:42.800822] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T20:34:43.158066] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-14T20:34:43.606103] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T20:34:43.958058] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-14T20:34:44.758081] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-14T20:34:45.225274] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-14T20:34:45.261787] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T20:34:45.558067] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-14T20:34:45.846296] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T20:34:46.358079] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-14T20:34:46.541812] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T20:34:47.158100] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-14T20:34:47.824373] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T20:34:47.857416] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T20:34:47.958068] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-14T20:34:48.758075] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-14T20:34:49.558054] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-14T20:34:50.030878] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-14T20:34:50.149512] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T20:34:50.358027] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-14T20:34:50.669413] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T20:34:51.158053] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-14T20:34:51.837769] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T20:34:51.958130] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-14T20:34:52.265544] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-14T20:34:52.758094] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-14T20:34:53.008201] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T20:34:53.558076] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-14T20:34:54.339238] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T20:34:54.344855] [INFO ] [REMOTE ] NRGV: Full fetch complete (62453 records). [2025-10-14T20:34:54.344972] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-14T20:34:54.366043] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-14T20:34:54.584606] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T20:34:54.755532] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-14T20:34:54.755614] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-14T20:34:54.756611] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-14T20:34:54.756696] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-14T20:34:54.757923] [DEBUG] [LOCAL ] NRGV: Trimmed 62453 records to 43667 (keeping 200 days of data) [2025-10-14T20:34:55.008603] [DEBUG] [LOCAL ] NRGV: Primary data saved (43667 records). [2025-10-14T20:34:55.008761] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-14T20:34:55.008848] [INFO ] [MAIN ] Update Progress: 1527/2369 symbols completed. NRGV took 31.1s. Estimated remaining: 1h 58m 28s. Rate: 7.1 symbols/min [2025-10-14T20:34:55.161623] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-14T20:34:55.182377] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:55.188355] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T20:34:55.195972] [DEBUG] [LOCAL ] NRT: Loaded 4894 existing records from primary storage. [2025-10-14T20:34:55.196182] [INFO ] [MAIN ] NRT: Loaded 4894 existing records. [2025-10-14T20:34:55.378510] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:34:55.378737] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-14T20:34:55.378805] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-14T20:34:55.378989] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-14T20:34:55.379046] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-14T20:34:55.735546] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:55.958064] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-14T20:34:56.504122] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T20:34:56.761781] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T20:34:56.761294] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-14T20:34:57.558092] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-14T20:34:57.896770] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T20:34:58.358091] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-14T20:34:58.487013] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T20:34:59.142306] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:34:59.147692] [INFO ] [REMOTE ] NRG: Full fetch complete (76386 records). [2025-10-14T20:34:59.147809] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-14T20:34:59.148436] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:34:59.148535] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:34:59.148582] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:34:59.148666] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-14T20:34:59.148745] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-14T20:34:59.149074] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-14T20:34:59.149351] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-14T20:34:59.149481] [INFO ] [MAIN ] Update Progress: 1528/2369 symbols completed. NRG took 47.4s. Estimated remaining: 1h 58m 18s. Rate: 7.1 symbols/min [2025-10-14T20:34:59.163247] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-14T20:34:59.340056] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:34:59.340297] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-14T20:34:59.340336] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-14T20:34:59.340464] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-14T20:34:59.340506] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-14T20:34:59.340547] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-14T20:34:59.340580] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-14T20:34:59.718088] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:34:59.951868] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T20:34:59.958028] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-14T20:35:00.758058] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-14T20:35:01.075543] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T20:35:01.275244] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T20:35:01.278755] [INFO ] [REMOTE ] NRK: Full fetch complete (27469 records). [2025-10-14T20:35:01.279033] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-14T20:35:01.280000] [FATAL] [VALIDATOR ] NRK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:35:01.280113] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:35:01.280158] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:35:01.280201] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-14T20:35:01.280261] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-14T20:35:01.280297] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-14T20:35:01.280338] [DEBUG] [LOCAL ] NRK: No derivative data file found to delete. [2025-10-14T20:35:01.280405] [INFO ] [MAIN ] Update Progress: 1529/2369 symbols completed. NRK took 31.3s. Estimated remaining: 1h 58m 6s. Rate: 7.1 symbols/min [2025-10-14T20:35:01.489366] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:01.489583] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-14T20:35:01.489662] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-14T20:35:01.489785] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-14T20:35:01.489827] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-14T20:35:01.489867] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-14T20:35:01.489897] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-14T20:35:01.563252] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-14T20:35:01.968145] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:02.358147] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-14T20:35:02.420128] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T20:35:03.158051] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-14T20:35:03.396373] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T20:35:03.958134] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-14T20:35:04.753599] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T20:35:04.758019] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-14T20:35:05.010236] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T20:35:05.531133] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T20:35:05.558055] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-14T20:35:06.257926] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T20:35:06.358085] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-14T20:35:07.049196] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T20:35:07.158068] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-14T20:35:07.725719] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-14T20:35:07.958074] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-14T20:35:08.608309] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T20:35:08.758110] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-14T20:35:09.359822] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:35:09.361057] [INFO ] [REMOTE ] NRP: Full fetch complete (6380 records). [2025-10-14T20:35:09.361128] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-14T20:35:09.563553] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-14T20:35:09.763046] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-14T20:35:09.763127] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-14T20:35:09.763364] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-14T20:35:09.763403] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-14T20:35:09.763818] [DEBUG] [LOCAL ] NRP: Trimmed 6380 records to 4200 (keeping 200 days of data) [2025-10-14T20:35:09.788852] [DEBUG] [LOCAL ] NRP: Primary data saved (4200 records). [2025-10-14T20:35:09.788924] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-14T20:35:09.788993] [INFO ] [MAIN ] Update Progress: 1530/2369 symbols completed. NRP took 30.2s. Estimated remaining: 1h 57m 57s. Rate: 7.1 symbols/min [2025-10-14T20:35:09.958578] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:09.958806] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-14T20:35:09.958864] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-14T20:35:09.958977] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-14T20:35:09.959019] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-14T20:35:09.959060] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-14T20:35:09.959095] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-14T20:35:10.307073] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:10.358054] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-14T20:35:10.462483] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T20:35:11.158086] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-14T20:35:11.958051] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-14T20:35:12.039553] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T20:35:12.655001] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T20:35:12.758081] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-14T20:35:12.997884] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T20:35:13.558069] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-14T20:35:14.199873] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T20:35:14.358086] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-14T20:35:14.449303] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T20:35:15.158075] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-14T20:35:15.958058] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-14T20:35:15.986474] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T20:35:16.656806] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T20:35:16.758048] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-14T20:35:17.006744] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T20:35:17.558070] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-14T20:35:18.333343] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T20:35:18.358030] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-14T20:35:18.497063] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T20:35:19.103539] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T20:35:19.158035] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-14T20:35:19.779021] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T20:35:19.780081] [INFO ] [REMOTE ] NRT: Full fetch complete (7941 records). [2025-10-14T20:35:19.780146] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-14T20:35:19.965588] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-14T20:35:20.133269] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-14T20:35:20.133329] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-14T20:35:20.133500] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-14T20:35:20.133536] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-14T20:35:20.133927] [DEBUG] [LOCAL ] NRT: Trimmed 7941 records to 4888 (keeping 200 days of data) [2025-10-14T20:35:20.161125] [DEBUG] [LOCAL ] NRT: Primary data saved (4888 records). [2025-10-14T20:35:20.161190] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-14T20:35:20.161255] [INFO ] [MAIN ] Update Progress: 1531/2369 symbols completed. NRT took 25.2s. Estimated remaining: 1h 57m 50s. Rate: 7.1 symbols/min [2025-10-14T20:35:20.325631] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:20.325769] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-14T20:35:20.325808] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-14T20:35:20.325920] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-14T20:35:20.325959] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-14T20:35:20.325998] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-14T20:35:20.326029] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-14T20:35:20.699592] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:20.721628] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:35:20.758024] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-14T20:35:21.558045] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-14T20:35:22.358050] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-14T20:35:22.464541] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T20:35:22.822237] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T20:35:22.835268] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T20:35:23.158061] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-14T20:35:23.958096] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-14T20:35:24.526465] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T20:35:24.593125] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T20:35:24.758118] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-14T20:35:25.558095] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-14T20:35:26.191156] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T20:35:26.358061] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-14T20:35:27.158056] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-14T20:35:27.313463] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:35:27.853134] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:35:27.958037] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-14T20:35:28.758133] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-14T20:35:28.842543] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T20:35:29.131847] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T20:35:29.558060] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-14T20:35:30.328242] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T20:35:30.358041] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-14T20:35:30.773342] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T20:35:31.158083] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-14T20:35:31.958082] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-14T20:35:32.282563] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T20:35:32.607912] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T20:35:32.657604] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T20:35:32.758076] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-14T20:35:33.558061] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-14T20:35:34.358105] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-14T20:35:34.491463] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T20:35:35.158111] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-14T20:35:35.469028] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T20:35:35.887270] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T20:35:35.958055] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-14T20:35:36.758073] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-14T20:35:36.794187] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T20:35:37.296674] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-14T20:35:37.443837] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T20:35:37.558071] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-14T20:35:38.358084] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-14T20:35:39.152033] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T20:35:39.159847] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-14T20:35:39.676529] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T20:35:39.738058] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T20:35:39.958077] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-14T20:35:40.575448] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T20:35:40.758063] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-14T20:35:41.492484] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:35:41.497798] [INFO ] [REMOTE ] NSA: Full fetch complete (62050 records). [2025-10-14T20:35:41.497923] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-14T20:35:41.498609] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:35:41.498720] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:35:41.498763] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:35:41.498807] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-14T20:35:41.498862] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-14T20:35:41.498898] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-14T20:35:41.498936] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-14T20:35:41.498991] [INFO ] [MAIN ] Update Progress: 1532/2369 symbols completed. NSA took 40.2s. Estimated remaining: 1h 57m 49s. Rate: 7.1 symbols/min [2025-10-14T20:35:41.563678] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-14T20:35:41.673606] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:41.673777] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-14T20:35:41.673819] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-14T20:35:41.673926] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-14T20:35:41.673965] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-14T20:35:41.674005] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-14T20:35:41.674035] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-14T20:35:42.018470] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:42.358069] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-14T20:35:43.158060] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-14T20:35:43.521739] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T20:35:43.775459] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T20:35:43.919619] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T20:35:43.958071] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-14T20:35:44.231238] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-14T20:35:44.232198] [INFO ] [REMOTE ] NRUC: Full fetch complete (5353 records). [2025-10-14T20:35:44.232301] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-14T20:35:44.232686] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:35:44.232780] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:35:44.232866] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:35:44.232956] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-14T20:35:44.233034] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-14T20:35:44.233071] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-14T20:35:44.233110] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-14T20:35:44.233160] [INFO ] [MAIN ] Update Progress: 1533/2369 symbols completed. NRUC took 45.1s. Estimated remaining: 1h 57m 37s. Rate: 7.1 symbols/min [2025-10-14T20:35:44.398359] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:44.398537] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-14T20:35:44.398574] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-14T20:35:44.398732] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-14T20:35:44.398796] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-14T20:35:44.398847] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-14T20:35:44.398879] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-14T20:35:44.756013] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:44.758024] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-14T20:35:45.468441] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:35:45.472550] [INFO ] [REMOTE ] NSP: Full fetch complete (49708 records). [2025-10-14T20:35:45.472711] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-14T20:35:45.473315] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:35:45.473401] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:35:45.473443] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:35:45.473507] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-14T20:35:45.473581] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-14T20:35:45.473634] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-14T20:35:45.473862] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-14T20:35:45.473925] [INFO ] [MAIN ] Update Progress: 1534/2369 symbols completed. NSP took 25.3s. Estimated remaining: 1h 57m 25s. Rate: 7.1 symbols/min [2025-10-14T20:35:45.563151] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-14T20:35:45.655615] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:45.655771] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-14T20:35:45.655832] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-14T20:35:45.655967] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-14T20:35:45.656022] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-14T20:35:45.656086] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-14T20:35:45.656134] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-14T20:35:46.014425] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:46.358104] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-14T20:35:46.821812] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T20:35:47.158065] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-14T20:35:47.958063] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-14T20:35:48.289392] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T20:35:48.338780] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:35:48.594075] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T20:35:48.758047] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-14T20:35:49.558067] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-14T20:35:50.358051] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-14T20:35:50.618522] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T20:35:50.663825] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T20:35:51.158067] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-14T20:35:51.958128] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-14T20:35:52.097088] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T20:35:52.274190] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T20:35:52.758103] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-14T20:35:53.404273] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-14T20:35:53.558066] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-14T20:35:53.749550] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T20:35:54.358124] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-14T20:35:55.043016] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:35:55.050913] [INFO ] [REMOTE ] NSC: Full fetch complete (70493 records). [2025-10-14T20:35:55.051129] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-14T20:35:55.052227] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:35:55.052363] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:35:55.052424] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:35:55.052524] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-14T20:35:55.052608] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-14T20:35:55.052698] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-14T20:35:55.052777] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-14T20:35:55.052868] [INFO ] [MAIN ] Update Progress: 1535/2369 symbols completed. NSC took 45.3s. Estimated remaining: 1h 57m 17s. Rate: 7.1 symbols/min [2025-10-14T20:35:55.167107] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-14T20:35:55.317052] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:35:55.317763] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-14T20:35:55.317816] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-14T20:35:55.317929] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-14T20:35:55.317971] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-14T20:35:55.318081] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-14T20:35:55.318130] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-14T20:35:55.679902] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-14T20:35:55.809047] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:35:55.958091] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-14T20:35:56.199007] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T20:35:56.758098] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-14T20:35:57.381341] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T20:35:57.558080] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-14T20:35:57.585632] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T20:35:58.057541] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T20:35:58.358064] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-14T20:35:58.872073] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T20:35:59.158123] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-14T20:35:59.958103] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-14T20:36:00.587595] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:36:00.758036] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-14T20:36:01.109592] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T20:36:01.558067] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-14T20:36:02.358135] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-14T20:36:02.382474] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T20:36:02.408172] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T20:36:03.158128] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-14T20:36:03.893599] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T20:36:03.958064] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-14T20:36:04.498542] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-14T20:36:04.758103] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-14T20:36:05.084568] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T20:36:05.558072] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-14T20:36:06.358098] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-14T20:36:06.546248] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T20:36:07.158136] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-14T20:36:07.260461] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T20:36:07.288359] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T20:36:07.958071] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-14T20:36:08.758082] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-14T20:36:08.973219] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-14T20:36:09.558057] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-14T20:36:09.641147] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T20:36:09.923357] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T20:36:10.140443] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T20:36:10.358104] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-14T20:36:10.660074] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-14T20:36:10.660711] [INFO ] [REMOTE ] NTEST: Full fetch complete (1960 records). [2025-10-14T20:36:10.660776] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-14T20:36:10.661120] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:36:10.661216] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:36:10.661263] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:36:10.661324] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-14T20:36:10.661383] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-14T20:36:10.661418] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-14T20:36:10.661455] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-14T20:36:10.661506] [INFO ] [MAIN ] Update Progress: 1536/2369 symbols completed. NTEST took 26.4s. Estimated remaining: 1h 57m 12s. Rate: 7.1 symbols/min [2025-10-14T20:36:10.839621] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:36:10.839826] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-14T20:36:10.839867] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-14T20:36:10.839978] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-14T20:36:10.840019] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-14T20:36:10.840058] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-14T20:36:10.840089] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-14T20:36:11.163219] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-14T20:36:11.217352] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:36:11.958087] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-14T20:36:12.369128] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T20:36:12.758080] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-14T20:36:13.558081] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-14T20:36:13.930664] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T20:36:14.358108] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-14T20:36:14.685830] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T20:36:14.899727] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-14T20:36:15.158121] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-14T20:36:15.928200] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T20:36:15.958048] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-14T20:36:16.758058] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-14T20:36:16.826489] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T20:36:17.017329] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T20:36:17.558086] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-14T20:36:18.358090] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-14T20:36:18.834866] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T20:36:19.158048] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-14T20:36:19.213793] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-14T20:36:19.796951] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:36:19.799464] [INFO ] [REMOTE ] NTB: Full fetch complete (30511 records). [2025-10-14T20:36:19.799536] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-14T20:36:19.800051] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:36:19.800131] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:36:19.800172] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:36:19.800215] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-14T20:36:19.800307] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-14T20:36:19.800357] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-14T20:36:19.800412] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-14T20:36:19.800484] [INFO ] [MAIN ] Update Progress: 1537/2369 symbols completed. NTB took 38.3s. Estimated remaining: 1h 57m 4s. Rate: 7.1 symbols/min [2025-10-14T20:36:19.972577] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:36:19.969208] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-14T20:36:19.973036] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-14T20:36:19.973134] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-14T20:36:19.974341] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-14T20:36:19.974435] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-14T20:36:19.974525] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-14T20:36:19.974575] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-14T20:36:20.174790] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T20:36:20.441775] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:36:20.758079] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-14T20:36:21.558050] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-14T20:36:21.687702] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T20:36:22.358070] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-14T20:36:22.829321] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T20:36:23.158055] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-14T20:36:23.476386] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T20:36:23.958067] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-14T20:36:24.520721] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-14T20:36:24.625494] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:36:24.631197] [INFO ] [REMOTE ] NTR: Full fetch complete (76080 records). [2025-10-14T20:36:24.631373] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-14T20:36:24.632290] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:36:24.632423] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:36:24.632464] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:36:24.632573] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-14T20:36:24.632691] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-14T20:36:24.632762] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-14T20:36:24.632834] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-14T20:36:24.632939] [INFO ] [MAIN ] Update Progress: 1538/2369 symbols completed. NTR took 39.2s. Estimated remaining: 1h 56m 54s. Rate: 7.1 symbols/min [2025-10-14T20:36:24.760319] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-14T20:36:24.807590] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:36:24.807894] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-14T20:36:24.807944] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-14T20:36:24.808070] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-14T20:36:24.808136] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-14T20:36:24.808225] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-14T20:36:24.808298] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-14T20:36:25.178169] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:36:25.208198] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-14T20:36:25.558069] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-14T20:36:26.358128] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-14T20:36:27.158058] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-14T20:36:27.267686] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T20:36:27.298633] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-14T20:36:27.344725] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T20:36:27.958045] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-14T20:36:28.758075] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-14T20:36:29.080949] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T20:36:29.509142] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T20:36:29.558025] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-14T20:36:30.296934] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:36:30.301803] [INFO ] [REMOTE ] NTST: Full fetch complete (61258 records). [2025-10-14T20:36:30.301933] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-14T20:36:30.302559] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:36:30.302679] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:36:30.302738] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:36:30.302781] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-14T20:36:30.302839] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-14T20:36:30.302876] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-14T20:36:30.302925] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-14T20:36:30.302980] [INFO ] [MAIN ] Update Progress: 1539/2369 symbols completed. NTST took 35.2s. Estimated remaining: 1h 56m 44s. Rate: 7.1 symbols/min [2025-10-14T20:36:30.367260] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-14T20:36:30.479368] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:36:30.501999] [DEBUG] [LOCAL ] NUV: Loaded 23505 existing records from primary storage. [2025-10-14T20:36:30.502227] [INFO ] [MAIN ] NUV: Loaded 23505 existing records. [2025-10-14T20:36:30.681186] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:36:30.681494] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-14T20:36:30.681621] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-14T20:36:30.682040] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-14T20:36:30.682112] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-14T20:36:30.901170] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-14T20:36:31.092479] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:36:31.158025] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-14T20:36:31.958066] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-14T20:36:32.502175] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-14T20:36:32.758029] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-14T20:36:32.838519] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T20:36:33.558139] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-14T20:36:34.358136] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-14T20:36:34.361261] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-14T20:36:34.886124] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-14T20:36:35.139547] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T20:36:35.163576] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-14T20:36:35.165812] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T20:36:35.958034] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-14T20:36:36.350697] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T20:36:36.758068] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-14T20:36:37.553384] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T20:36:37.560811] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-14T20:36:37.632534] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T20:36:38.358100] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-14T20:36:39.158108] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-14T20:36:39.594626] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-14T20:36:39.958064] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-14T20:36:40.024581] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T20:36:40.758088] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-14T20:36:41.225996] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-14T20:36:41.341916] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T20:36:41.558089] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-14T20:36:42.358109] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-14T20:36:42.699193] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T20:36:43.078696] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-14T20:36:43.158066] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-14T20:36:43.658953] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T20:36:43.958113] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-14T20:36:44.758055] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-14T20:36:45.206072] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-14T20:36:45.558087] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-14T20:36:45.970509] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T20:36:46.253684] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T20:36:46.358038] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-14T20:36:46.723362] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T20:36:47.158111] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-14T20:36:47.861404] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T20:36:47.931363] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T20:36:47.958058] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-14T20:36:48.758069] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-14T20:36:49.140070] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T20:36:49.558059] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-14T20:36:50.358118] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-14T20:36:50.808603] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T20:36:51.030927] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-14T20:36:51.158062] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-14T20:36:51.858256] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:36:51.864139] [INFO ] [REMOTE ] NU: Full fetch complete (77535 records). [2025-10-14T20:36:51.864259] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-14T20:36:51.864960] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:36:51.865044] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:36:51.865085] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:36:51.865151] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-14T20:36:51.865212] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-14T20:36:51.865247] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-14T20:36:51.865286] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-14T20:36:51.865340] [INFO ] [MAIN ] Update Progress: 1540/2369 symbols completed. NU took 41.2s. Estimated remaining: 1h 56m 42s. Rate: 7.1 symbols/min [2025-10-14T20:36:51.961955] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-14T20:36:52.073298] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:36:52.074910] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T20:36:52.131668] [DEBUG] [LOCAL ] NUVB: Loaded 51503 existing records from primary storage. [2025-10-14T20:36:52.131990] [INFO ] [MAIN ] NUVB: Loaded 51503 existing records. [2025-10-14T20:36:52.310393] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:36:52.310609] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-14T20:36:52.310683] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-14T20:36:52.311238] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-14T20:36:52.311295] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-14T20:36:52.663957] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:36:52.758025] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-14T20:36:53.558037] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-14T20:36:54.033289] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T20:36:54.358196] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-14T20:36:54.447004] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T20:36:54.591578] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T20:36:54.595308] [INFO ] [REMOTE ] NUV: Full fetch complete (34115 records). [2025-10-14T20:36:54.595392] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-14T20:36:54.989598] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-14T20:36:54.989711] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-14T20:36:54.990370] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-14T20:36:54.990412] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-14T20:36:54.991207] [DEBUG] [LOCAL ] NUV: Trimmed 34115 records to 23639 (keeping 200 days of data) [2025-10-14T20:36:55.128553] [DEBUG] [LOCAL ] NUV: Primary data saved (23639 records). [2025-10-14T20:36:55.128703] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-14T20:36:55.128790] [INFO ] [MAIN ] Update Progress: 1541/2369 symbols completed. NUV took 24.8s. Estimated remaining: 1h 56m 31s. Rate: 7.1 symbols/min [2025-10-14T20:36:55.160779] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-14T20:36:55.298748] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:36:55.308865] [DEBUG] [LOCAL ] NUW: Loaded 6833 existing records from primary storage. [2025-10-14T20:36:55.309067] [INFO ] [MAIN ] NUW: Loaded 6833 existing records. [2025-10-14T20:36:55.489216] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:36:55.489422] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-14T20:36:55.489470] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-14T20:36:55.489685] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-14T20:36:55.489744] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-14T20:36:55.865564] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:36:55.875698] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T20:36:55.958041] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-14T20:36:56.758132] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-14T20:36:57.131901] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T20:36:57.210693] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T20:36:57.558062] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-14T20:36:58.259447] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T20:36:58.358091] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-14T20:36:59.068705] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T20:36:59.158052] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-14T20:36:59.939185] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T20:36:59.958025] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-14T20:37:00.188209] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T20:37:00.586541] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:37:00.590274] [INFO ] [REMOTE ] NUS: Full fetch complete (53584 records). [2025-10-14T20:37:00.590361] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-14T20:37:00.590908] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:37:00.590993] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:37:00.591036] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:37:00.591097] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-14T20:37:00.591157] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-14T20:37:00.591192] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-14T20:37:00.591230] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-14T20:37:00.591280] [INFO ] [MAIN ] Update Progress: 1542/2369 symbols completed. NUS took 36.0s. Estimated remaining: 1h 56m 21s. Rate: 7.1 symbols/min [2025-10-14T20:37:00.758758] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-14T20:37:00.758688] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:00.759789] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-14T20:37:00.759845] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-14T20:37:00.759977] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-14T20:37:00.760033] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-14T20:37:00.760079] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-14T20:37:00.760113] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-14T20:37:01.118604] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:01.558044] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-14T20:37:01.621920] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T20:37:02.358112] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-14T20:37:03.113010] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:37:03.118873] [INFO ] [REMOTE ] NUE: Full fetch complete (74483 records). [2025-10-14T20:37:03.119042] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-14T20:37:03.119895] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:37:03.119999] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:37:03.120043] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:37:03.120083] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-14T20:37:03.120141] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-14T20:37:03.120176] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-14T20:37:03.120217] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-14T20:37:03.120275] [INFO ] [MAIN ] Update Progress: 1543/2369 symbols completed. NUE took 43.3s. Estimated remaining: 1h 56m 10s. Rate: 7.1 symbols/min [2025-10-14T20:37:03.165460] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-14T20:37:03.317091] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:03.317304] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-14T20:37:03.317549] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-14T20:37:03.317751] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-14T20:37:03.317816] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-14T20:37:03.317878] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-14T20:37:03.317931] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-14T20:37:03.454091] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T20:37:03.850799] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:03.958084] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-14T20:37:04.758140] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-14T20:37:04.871478] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T20:37:05.387426] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:37:05.558093] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-14T20:37:05.918844] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:37:06.358103] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-14T20:37:07.019014] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T20:37:07.158102] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-14T20:37:07.580483] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:37:07.958161] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-14T20:37:08.758071] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-14T20:37:08.957494] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T20:37:09.133994] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:37:09.558064] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-14T20:37:09.617783] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T20:37:10.358042] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-14T20:37:10.598288] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T20:37:10.861048] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-14T20:37:11.158083] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-14T20:37:11.915898] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T20:37:11.958102] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-14T20:37:12.758114] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-14T20:37:13.435783] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T20:37:13.558044] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-14T20:37:14.269134] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T20:37:14.358073] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-14T20:37:14.813677] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T20:37:15.049065] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T20:37:15.158037] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-14T20:37:15.958064] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-14T20:37:16.677192] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T20:37:16.758031] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-14T20:37:17.003305] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T20:37:17.558061] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-14T20:37:18.014494] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T20:37:18.358073] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-14T20:37:19.158040] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-14T20:37:19.446583] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T20:37:19.728430] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T20:37:19.958062] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-14T20:37:20.519562] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T20:37:20.758065] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-14T20:37:21.558052] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-14T20:37:22.047319] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-14T20:37:22.122512] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T20:37:22.358068] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-14T20:37:22.858835] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T20:37:23.158074] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-14T20:37:23.805913] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T20:37:23.958189] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-14T20:37:24.392942] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T20:37:24.758058] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-14T20:37:25.558060] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-14T20:37:25.956413] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T20:37:26.121428] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T20:37:26.140874] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:37:26.141924] [INFO ] [REMOTE ] NUW: Full fetch complete (11037 records). [2025-10-14T20:37:26.141992] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-14T20:37:26.363335] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-14T20:37:26.501227] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-14T20:37:26.501309] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-14T20:37:26.501595] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-14T20:37:26.501634] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-14T20:37:26.502155] [DEBUG] [LOCAL ] NUW: Trimmed 11037 records to 6802 (keeping 200 days of data) [2025-10-14T20:37:26.544472] [DEBUG] [LOCAL ] NUW: Primary data saved (6802 records). [2025-10-14T20:37:26.544609] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-14T20:37:26.544715] [INFO ] [MAIN ] Update Progress: 1544/2369 symbols completed. NUW took 31.4s. Estimated remaining: 1h 56m 9s. Rate: 7.1 symbols/min [2025-10-14T20:37:26.714051] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:26.714231] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-14T20:37:26.714311] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-14T20:37:26.714429] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-14T20:37:26.714469] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-14T20:37:26.714509] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-14T20:37:26.714540] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-14T20:37:27.065241] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:27.158109] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-14T20:37:27.732301] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T20:37:27.958070] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-14T20:37:28.758052] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-14T20:37:29.461221] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T20:37:29.558083] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-14T20:37:29.679776] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-14T20:37:30.232660] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:37:30.235935] [INFO ] [REMOTE ] NVG: Full fetch complete (39961 records). [2025-10-14T20:37:30.236047] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-14T20:37:30.236612] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:37:30.236714] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:37:30.236759] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:37:30.236824] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-14T20:37:30.236885] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-14T20:37:30.236920] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-14T20:37:30.236963] [DEBUG] [LOCAL ] NVG: No derivative data file found to delete. [2025-10-14T20:37:30.237017] [INFO ] [MAIN ] Update Progress: 1545/2369 symbols completed. NVG took 29.6s. Estimated remaining: 1h 55m 58s. Rate: 7.1 symbols/min [2025-10-14T20:37:30.363157] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-14T20:37:30.415184] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:30.435388] [DEBUG] [LOCAL ] NVR: Loaded 18521 existing records from primary storage. [2025-10-14T20:37:30.435659] [INFO ] [MAIN ] NVR: Loaded 18521 existing records. [2025-10-14T20:37:30.619715] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:37:30.619913] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-14T20:37:30.619961] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-14T20:37:30.620156] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-14T20:37:30.620194] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-14T20:37:30.983237] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:31.017547] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-14T20:37:31.158080] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-14T20:37:31.958076] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-14T20:37:32.758091] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-14T20:37:32.984576] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-14T20:37:33.041525] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T20:37:33.187271] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-14T20:37:33.193174] [INFO ] [REMOTE ] NUVB: Full fetch complete (73157 records). [2025-10-14T20:37:33.193275] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-14T20:37:33.584266] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-14T20:37:33.608350] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-14T20:37:33.608434] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-14T20:37:33.609593] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-14T20:37:33.609714] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-14T20:37:33.611234] [DEBUG] [LOCAL ] NUVB: Trimmed 73157 records to 51542 (keeping 200 days of data) [2025-10-14T20:37:33.904409] [DEBUG] [LOCAL ] NUVB: Primary data saved (51542 records). [2025-10-14T20:37:33.904545] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-14T20:37:33.904627] [INFO ] [MAIN ] Update Progress: 1546/2369 symbols completed. NUVB took 42.0s. Estimated remaining: 1h 55m 47s. Rate: 7.1 symbols/min [2025-10-14T20:37:34.073668] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:34.073977] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-14T20:37:34.074214] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-14T20:37:34.074337] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-14T20:37:34.074409] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-14T20:37:34.096453] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-14T20:37:34.096533] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-14T20:37:34.162285] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T20:37:34.363177] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-14T20:37:34.461133] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:35.158072] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-14T20:37:35.631555] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T20:37:35.958060] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-14T20:37:36.110142] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-14T20:37:36.169884] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T20:37:36.712919] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T20:37:36.758021] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-14T20:37:37.558048] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-14T20:37:38.062875] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T20:37:38.358098] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-14T20:37:39.158059] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-14T20:37:39.278195] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T20:37:39.612814] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-14T20:37:39.958084] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-14T20:37:40.758096] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-14T20:37:41.478008] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T20:37:41.558082] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-14T20:37:42.358065] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-14T20:37:42.718353] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-10-14T20:37:42.889558] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T20:37:43.158042] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-14T20:37:43.512453] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T20:37:43.763957] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-14T20:37:43.958062] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-14T20:37:44.758090] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-14T20:37:45.168066] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T20:37:45.407293] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T20:37:45.410867] [INFO ] [REMOTE ] NVGS: Full fetch complete (41738 records). [2025-10-14T20:37:45.410997] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-14T20:37:45.411633] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:37:45.411746] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:37:45.411789] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:37:45.411832] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-14T20:37:45.411893] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-14T20:37:45.411929] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-14T20:37:45.411968] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-14T20:37:45.412031] [INFO ] [MAIN ] Update Progress: 1547/2369 symbols completed. NVGS took 42.3s. Estimated remaining: 1h 55m 40s. Rate: 7.1 symbols/min [2025-10-14T20:37:45.564463] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-14T20:37:45.601204] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:45.602306] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-14T20:37:45.602382] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-14T20:37:45.602635] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-14T20:37:45.602724] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-14T20:37:45.602775] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-14T20:37:45.602811] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-14T20:37:45.925886] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-14T20:37:46.070107] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:46.358095] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-14T20:37:46.878983] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T20:37:47.158103] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-14T20:37:47.934623] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T20:37:47.958024] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-14T20:37:48.253218] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T20:37:48.758087] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-14T20:37:49.484880] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T20:37:49.558064] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-14T20:37:50.358075] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-14T20:37:50.609542] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T20:37:51.134037] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T20:37:51.158029] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-14T20:37:51.506281] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T20:37:51.958151] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-14T20:37:52.613578] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T20:37:52.758067] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-14T20:37:52.944253] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T20:37:52.946979] [INFO ] [REMOTE ] NVR: Full fetch complete (29108 records). [2025-10-14T20:37:52.947082] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-14T20:37:53.330545] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-14T20:37:53.330674] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-14T20:37:53.331728] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-14T20:37:53.331793] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-14T20:37:53.332717] [DEBUG] [LOCAL ] NVR: Trimmed 29108 records to 18538 (keeping 200 days of data) [2025-10-14T20:37:53.458263] [DEBUG] [LOCAL ] NVR: Primary data saved (18538 records). [2025-10-14T20:37:53.458477] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-14T20:37:53.458579] [INFO ] [MAIN ] Update Progress: 1548/2369 symbols completed. NVR took 23.2s. Estimated remaining: 1h 55m 32s. Rate: 7.1 symbols/min [2025-10-14T20:37:53.564728] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-14T20:37:53.640841] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:37:53.641073] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-14T20:37:53.641110] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-14T20:37:53.641233] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-14T20:37:53.641273] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-14T20:37:53.641313] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-14T20:37:53.641349] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-14T20:37:54.073955] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:37:54.076107] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T20:37:54.358135] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-14T20:37:55.158132] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-14T20:37:55.958126] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-14T20:37:56.094287] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T20:37:56.363327] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-14T20:37:56.758057] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-14T20:37:56.815128] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T20:37:57.320990] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T20:37:57.558085] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-14T20:37:58.358069] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-14T20:37:59.158080] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-14T20:37:59.227207] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T20:37:59.334593] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-14T20:37:59.958034] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-14T20:38:00.184492] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T20:38:00.763174] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-14T20:38:00.775484] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T20:38:01.558045] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-14T20:38:02.358084] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-14T20:38:02.520772] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:38:02.858993] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-14T20:38:03.071444] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:38:03.076154] [INFO ] [REMOTE ] NVRI: Full fetch complete (55632 records). [2025-10-14T20:38:03.076300] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-14T20:38:03.076927] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:38:03.077016] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:38:03.077074] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:38:03.077158] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-14T20:38:03.077264] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-14T20:38:03.077336] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-14T20:38:03.077428] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-14T20:38:03.077530] [INFO ] [MAIN ] Update Progress: 1549/2369 symbols completed. NVRI took 29.2s. Estimated remaining: 1h 55m 24s. Rate: 7.1 symbols/min [2025-10-14T20:38:03.168019] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-14T20:38:03.279985] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:03.280241] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-14T20:38:03.280300] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-14T20:38:03.280416] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-14T20:38:03.280484] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-14T20:38:03.280569] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-14T20:38:03.280666] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-14T20:38:03.643696] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:38:03.679049] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-14T20:38:03.958081] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-14T20:38:04.758109] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-14T20:38:05.558084] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-14T20:38:05.860845] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T20:38:06.358047] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-14T20:38:06.659303] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.49 seconds). [2025-10-14T20:38:06.923101] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T20:38:06.969925] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T20:38:07.158056] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-14T20:38:07.958037] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-14T20:38:08.130458] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T20:38:08.758113] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-14T20:38:09.558039] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-14T20:38:09.739711] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T20:38:09.834501] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-14T20:38:10.358120] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-14T20:38:10.544757] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T20:38:11.158112] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-14T20:38:11.488177] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T20:38:11.958047] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-14T20:38:12.152682] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T20:38:12.758074] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-14T20:38:12.998486] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T20:38:13.558071] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-14T20:38:13.561038] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T20:38:13.568454] [INFO ] [REMOTE ] NVO: Full fetch complete (77574 records). [2025-10-14T20:38:13.568733] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-14T20:38:13.569924] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:38:13.570187] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:38:13.570244] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:38:13.570291] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-14T20:38:13.570354] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-14T20:38:13.570390] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-14T20:38:13.570428] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-14T20:38:13.570490] [INFO ] [MAIN ] Update Progress: 1550/2369 symbols completed. NVO took 47.0s. Estimated remaining: 1h 55m 17s. Rate: 7.1 symbols/min [2025-10-14T20:38:13.803994] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T20:38:13.807447] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:13.817327] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-14T20:38:13.817767] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-14T20:38:13.817887] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-14T20:38:13.817937] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-14T20:38:13.817979] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-14T20:38:13.818296] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-14T20:38:14.185266] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:38:14.358068] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-14T20:38:15.158067] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-14T20:38:15.462361] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T20:38:15.958095] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-14T20:38:16.305020] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T20:38:16.758049] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-14T20:38:16.935231] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T20:38:17.558121] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-14T20:38:18.042993] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T20:38:18.358089] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-14T20:38:18.573217] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:38:19.133195] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T20:38:19.158027] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-14T20:38:19.848911] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T20:38:19.958089] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-14T20:38:20.758064] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-14T20:38:20.819689] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T20:38:21.558042] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-14T20:38:21.809030] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T20:38:22.358117] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-14T20:38:22.550482] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T20:38:23.158046] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-14T20:38:23.509351] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T20:38:23.958100] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-14T20:38:24.064086] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T20:38:24.651825] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T20:38:24.758064] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-14T20:38:25.558040] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-14T20:38:25.865511] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T20:38:26.358051] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-14T20:38:26.684907] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T20:38:27.158048] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-14T20:38:27.351132] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T20:38:27.958144] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-14T20:38:28.181545] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T20:38:28.187819] [INFO ] [REMOTE ] NVST: Full fetch complete (73948 records). [2025-10-14T20:38:28.188044] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-14T20:38:28.189050] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:38:28.189142] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:38:28.189184] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:38:28.189233] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-14T20:38:28.189300] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-14T20:38:28.189881] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-14T20:38:28.190091] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-14T20:38:28.190208] [INFO ] [MAIN ] Update Progress: 1551/2369 symbols completed. NVST took 34.7s. Estimated remaining: 1h 55m 11s. Rate: 7.1 symbols/min [2025-10-14T20:38:28.378891] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:28.379297] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-14T20:38:28.379483] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-14T20:38:28.379768] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-14T20:38:28.379871] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-14T20:38:28.380058] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-14T20:38:28.380121] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-14T20:38:28.738347] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-14T20:38:28.768478] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-14T20:38:28.821222] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:38:29.172217] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T20:38:29.177515] [INFO ] [REMOTE ] NVS: Full fetch complete (74653 records). [2025-10-14T20:38:29.177696] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-14T20:38:29.178412] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:38:29.178499] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:38:29.178541] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:38:29.178580] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-14T20:38:29.178634] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-14T20:38:29.178709] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-14T20:38:29.178759] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-14T20:38:29.178815] [INFO ] [MAIN ] Update Progress: 1552/2369 symbols completed. NVS took 43.8s. Estimated remaining: 1h 54m 59s. Rate: 7.1 symbols/min [2025-10-14T20:38:29.351129] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:29.351343] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-14T20:38:29.351386] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-14T20:38:29.351491] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-14T20:38:29.351531] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-14T20:38:29.351570] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-14T20:38:29.351601] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-14T20:38:29.564087] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-14T20:38:29.716101] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:38:30.358022] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-14T20:38:30.582691] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T20:38:31.149769] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T20:38:31.158013] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-14T20:38:31.467016] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:38:31.958114] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-14T20:38:32.453884] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T20:38:32.758063] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-14T20:38:33.228114] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T20:38:33.558091] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-14T20:38:33.973458] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:38:34.358083] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-14T20:38:35.158097] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-14T20:38:35.382904] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T20:38:35.842310] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T20:38:35.958090] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-14T20:38:36.627480] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T20:38:36.707854] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:38:36.713236] [INFO ] [REMOTE ] NVT: Full fetch complete (74416 records). [2025-10-14T20:38:36.713373] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-14T20:38:36.714077] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:38:36.714172] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:38:36.714215] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:38:36.714263] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-14T20:38:36.714317] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-14T20:38:36.714352] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-14T20:38:36.714391] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-14T20:38:36.714446] [INFO ] [MAIN ] Update Progress: 1553/2369 symbols completed. NVT took 33.6s. Estimated remaining: 1h 54m 50s. Rate: 7.1 symbols/min [2025-10-14T20:38:36.767687] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-14T20:38:36.885536] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:36.892462] [DEBUG] [LOCAL ] NXC: Loaded 4109 existing records from primary storage. [2025-10-14T20:38:36.892708] [INFO ] [MAIN ] NXC: Loaded 4109 existing records. [2025-10-14T20:38:37.071028] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:38:37.071295] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-14T20:38:37.071346] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-14T20:38:37.071525] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-14T20:38:37.071587] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-14T20:38:37.431579] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:38:37.558059] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-14T20:38:38.096885] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T20:38:38.248300] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T20:38:38.358098] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-14T20:38:38.916880] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T20:38:39.158083] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-14T20:38:39.958070] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-14T20:38:40.668369] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T20:38:40.758038] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-14T20:38:41.558064] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-14T20:38:41.940524] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T20:38:42.275958] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T20:38:42.358084] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-14T20:38:43.053368] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T20:38:43.158032] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-14T20:38:43.839163] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T20:38:43.958079] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-14T20:38:44.521289] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T20:38:44.758058] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-14T20:38:44.977133] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T20:38:45.558106] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-14T20:38:46.206705] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T20:38:46.358054] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-14T20:38:46.635960] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T20:38:47.006789] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T20:38:47.158062] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-14T20:38:47.824014] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T20:38:47.958045] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-14T20:38:48.758072] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-14T20:38:49.488116] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T20:38:49.558081] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-14T20:38:50.358036] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-14T20:38:50.579514] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T20:38:50.903991] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T20:38:51.158068] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-14T20:38:51.765686] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T20:38:51.935974] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:38:51.941776] [INFO ] [REMOTE ] NWG: Full fetch complete (73453 records). [2025-10-14T20:38:51.941950] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-14T20:38:51.942763] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:38:51.942856] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:38:51.942900] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:38:51.942945] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-14T20:38:51.943011] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-14T20:38:51.943048] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-14T20:38:51.943409] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-14T20:38:51.943632] [INFO ] [MAIN ] Update Progress: 1554/2369 symbols completed. NWG took 38.4s. Estimated remaining: 1h 54m 45s. Rate: 7.1 symbols/min [2025-10-14T20:38:51.964941] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-14T20:38:52.129832] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:52.130111] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-14T20:38:52.130150] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-14T20:38:52.130276] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-14T20:38:52.130320] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-14T20:38:52.130361] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-14T20:38:52.130394] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-14T20:38:52.498283] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:38:52.758073] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-14T20:38:53.408101] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T20:38:53.532148] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T20:38:53.558031] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-14T20:38:54.358101] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-14T20:38:54.841173] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T20:38:55.048322] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T20:38:55.158085] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-14T20:38:55.813786] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T20:38:55.958055] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-14T20:38:56.586018] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T20:38:56.758093] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-14T20:38:57.558066] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-14T20:38:57.895962] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T20:38:58.237179] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T20:38:58.358047] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-14T20:38:58.918055] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T20:38:58.919221] [INFO ] [REMOTE ] NXC: Full fetch complete (5725 records). [2025-10-14T20:38:58.919467] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-14T20:38:59.165246] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-14T20:38:59.303688] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-14T20:38:59.303807] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-14T20:38:59.304048] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-14T20:38:59.304096] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-14T20:38:59.304815] [DEBUG] [LOCAL ] NXC: Trimmed 5725 records to 4141 (keeping 200 days of data) [2025-10-14T20:38:59.333337] [DEBUG] [LOCAL ] NXC: Primary data saved (4141 records). [2025-10-14T20:38:59.333533] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-14T20:38:59.333638] [INFO ] [MAIN ] Update Progress: 1555/2369 symbols completed. NXC took 22.6s. Estimated remaining: 1h 54m 36s. Rate: 7.1 symbols/min [2025-10-14T20:38:59.514208] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:38:59.515719] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:59.516456] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-14T20:38:59.516557] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:38:59.516604] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-14T20:38:59.516637] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:38:59.516728] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-14T20:38:59.516789] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-14T20:38:59.516832] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-14T20:38:59.516871] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-14T20:38:59.516918] [INFO ] [MAIN ] Update Progress: 1556/2369 symbols completed. NXDR took 7.6s. Estimated remaining: 1h 54m 23s. Rate: 7.1 symbols/min [2025-10-14T20:38:59.649690] [DEBUG] [LOCAL ] NXDT: Loaded 15006 existing records from primary storage. [2025-10-14T20:38:59.673028] [INFO ] [MAIN ] NXDT: Loaded 15006 existing records. [2025-10-14T20:38:59.765453] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:38:59.883282] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:38:59.883702] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-14T20:38:59.883762] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-14T20:38:59.883987] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-14T20:38:59.884046] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-14T20:38:59.959735] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-14T20:39:00.200606] [DEBUG] [LOCAL ] NXE: Loaded 53013 existing records from primary storage. [2025-10-14T20:39:00.212687] [INFO ] [MAIN ] NXE: Loaded 53013 existing records. [2025-10-14T20:39:00.412954] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:00.519509] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:39:00.519834] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-14T20:39:00.519891] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-14T20:39:00.520392] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-14T20:39:00.520451] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-14T20:39:00.640803] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:39:00.692882] [INFO ] [REMOTE ] NWN: Full fetch complete (37141 records). [2025-10-14T20:39:00.764839] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-14T20:39:00.754687] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-14T20:39:00.786081] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:39:00.809195] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:39:00.829944] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:39:00.833970] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-14T20:39:00.834553] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-14T20:39:00.840141] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-14T20:39:00.860934] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-14T20:39:00.913209] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:00.913428] [INFO ] [MAIN ] Update Progress: 1557/2369 symbols completed. NWN took 32.7s. Estimated remaining: 1h 54m 11s. Rate: 7.1 symbols/min [2025-10-14T20:39:01.558091] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-14T20:39:02.152239] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T20:39:02.358114] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-14T20:39:03.158102] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-14T20:39:03.285693] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T20:39:03.958080] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-14T20:39:04.261000] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T20:39:04.356385] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T20:39:04.556137] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:39:04.560009] [INFO ] [REMOTE ] NX: Full fetch complete (47880 records). [2025-10-14T20:39:04.560095] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-14T20:39:04.560616] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:39:04.560731] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:39:04.560773] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:39:04.560811] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-14T20:39:04.560865] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-14T20:39:04.560908] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-14T20:39:04.560946] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-14T20:39:04.561000] [INFO ] [MAIN ] Update Progress: 1558/2369 symbols completed. NX took 35.4s. Estimated remaining: 1h 54m 0s. Rate: 7.1 symbols/min [2025-10-14T20:39:04.758114] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-14T20:39:05.558070] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-14T20:39:06.568117] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T20:39:06.573124] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-14T20:39:06.822912] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-14T20:39:07.158149] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-14T20:39:07.800035] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T20:39:07.958093] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-14T20:39:08.894880] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T20:39:08.906074] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-14T20:39:08.938571] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T20:39:09.558173] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-14T20:39:10.743767] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T20:39:10.752124] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-14T20:39:10.789378] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T20:39:11.158066] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-14T20:39:11.640916] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-14T20:39:11.958128] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-14T20:39:12.968132] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T20:39:12.971929] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-14T20:39:13.106446] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T20:39:13.558062] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-14T20:39:14.015500] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T20:39:14.358182] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-14T20:39:15.248391] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:39:15.251882] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-14T20:39:15.532316] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-14T20:39:15.958127] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-14T20:39:16.101416] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T20:39:16.104355] [INFO ] [REMOTE ] NXDT: Full fetch complete (24352 records). [2025-10-14T20:39:16.104457] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-14T20:39:16.476279] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-14T20:39:16.476358] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-14T20:39:16.476892] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-14T20:39:16.476953] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-14T20:39:16.477527] [DEBUG] [LOCAL ] NXDT: Trimmed 24352 records to 14998 (keeping 200 days of data) [2025-10-14T20:39:16.561270] [DEBUG] [LOCAL ] NXDT: Primary data saved (14998 records). [2025-10-14T20:39:16.561399] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-14T20:39:16.561474] [INFO ] [MAIN ] Update Progress: 1559/2369 symbols completed. NXDT took 17.2s. Estimated remaining: 1h 53m 54s. Rate: 7.1 symbols/min [2025-10-14T20:39:17.815826] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T20:39:17.826906] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-14T20:39:19.893796] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T20:39:19.905235] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-14T20:39:21.835770] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-14T20:39:21.846838] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-14T20:39:23.695375] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T20:39:23.706905] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-14T20:39:25.540101] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-14T20:39:25.546110] [INFO ] [REMOTE ] NXE: Full fetch complete (76901 records). [2025-10-14T20:39:25.546256] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-14T20:39:25.975855] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-14T20:39:25.975987] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-14T20:39:25.977120] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-14T20:39:25.977188] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-14T20:39:25.978783] [DEBUG] [LOCAL ] NXE: Trimmed 76901 records to 53032 (keeping 200 days of data) [2025-10-14T20:39:26.291907] [DEBUG] [LOCAL ] NXE: Primary data saved (53032 records). [2025-10-14T20:39:26.292056] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-14T20:39:26.292150] [INFO ] [MAIN ] Update Progress: 1560/2369 symbols completed. NXE took 26.8s. Estimated remaining: 1h 53m 46s. Rate: 7.1 symbols/min [2025-10-14T20:39:26.951002] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:27.030338] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:27.061524] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:27.090414] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:27.091527] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-14T20:39:27.091637] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-14T20:39:27.094929] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-14T20:39:27.095156] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-14T20:39:27.094741] [DEBUG] [LOCAL ] NXN: Loaded 2241 existing records from primary storage. [2025-10-14T20:39:27.095371] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-14T20:39:27.095465] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-14T20:39:27.095743] [INFO ] [MAIN ] NXN: Loaded 2241 existing records. [2025-10-14T20:39:27.229388] [DEBUG] [LOCAL ] NXP: Loaded 12302 existing records from primary storage. [2025-10-14T20:39:27.267401] [INFO ] [MAIN ] NXP: Loaded 12302 existing records. [2025-10-14T20:39:27.247302] [DEBUG] [LOCAL ] NXG: Loaded 10468 existing records from primary storage. [2025-10-14T20:39:27.373604] [INFO ] [MAIN ] NXG: Loaded 10468 existing records. [2025-10-14T20:39:27.739775] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:39:27.906700] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-14T20:39:27.929379] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-14T20:39:28.022628] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-14T20:39:28.031222] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-14T20:39:28.046237] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:39:28.022449] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:39:28.110223] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-14T20:39:28.110629] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-14T20:39:28.110470] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-14T20:39:28.135407] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-14T20:39:28.157795] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-14T20:39:28.157977] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-14T20:39:28.209773] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-14T20:39:28.248224] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-14T20:39:28.267805] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:28.361273] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-14T20:39:29.224586] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:29.251394] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:29.262412] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-14T20:39:29.273293] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-14T20:39:29.331725] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:29.332148] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-14T20:39:29.619493] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T20:39:29.623577] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-14T20:39:29.886225] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T20:39:29.889110] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-14T20:39:30.015030] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T20:39:30.016424] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-14T20:39:30.181701] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T20:39:30.184417] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-14T20:39:30.260723] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T20:39:30.264061] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-14T20:39:30.433932] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T20:39:30.436534] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-14T20:39:30.620454] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T20:39:30.621720] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-14T20:39:30.722058] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T20:39:30.724397] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-14T20:39:30.947479] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T20:39:30.950741] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-14T20:39:31.232567] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T20:39:31.234815] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-14T20:39:31.243375] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T20:39:31.247072] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-14T20:39:31.313278] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T20:39:31.520730] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T20:39:31.647218] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-14T20:39:31.958076] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-14T20:39:32.127629] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T20:39:32.758076] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-14T20:39:33.195404] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T20:39:33.558074] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-14T20:39:33.783200] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T20:39:34.363123] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-14T20:39:34.366174] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T20:39:35.158040] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-14T20:39:35.215799] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T20:39:35.958066] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-14T20:39:36.045160] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-14T20:39:36.641731] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T20:39:36.758078] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-14T20:39:37.558049] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-14T20:39:37.875230] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T20:39:38.103904] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-14T20:39:38.358073] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-14T20:39:38.915627] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-14T20:39:39.158079] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-14T20:39:39.958056] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-14T20:39:40.096586] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T20:39:40.758066] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-14T20:39:41.052297] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T20:39:41.520538] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T20:39:41.558073] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-14T20:39:42.358114] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-14T20:39:42.387531] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T20:39:43.158061] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-14T20:39:43.349220] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T20:39:43.726314] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-14T20:39:43.958054] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-14T20:39:44.758056] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-14T20:39:44.887591] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T20:39:45.463437] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T20:39:45.558072] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-14T20:39:46.358058] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-14T20:39:46.407841] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T20:39:46.870389] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T20:39:46.872213] [INFO ] [REMOTE ] NXJ: Full fetch complete (20460 records). [2025-10-14T20:39:46.872282] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-14T20:39:46.872851] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:39:46.872936] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:39:46.872978] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:39:46.873018] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-14T20:39:46.873077] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-14T20:39:46.873112] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-14T20:39:46.873151] [DEBUG] [LOCAL ] NXJ: No derivative data file found to delete. [2025-10-14T20:39:46.873206] [INFO ] [MAIN ] Update Progress: 1561/2369 symbols completed. NXJ took 20.6s. Estimated remaining: 1h 53m 44s. Rate: 7.1 symbols/min [2025-10-14T20:39:47.063926] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:47.064185] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-14T20:39:47.064239] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-14T20:39:47.064429] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-14T20:39:47.064485] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-14T20:39:47.064544] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-14T20:39:47.064589] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-14T20:39:47.163217] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-14T20:39:47.431061] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:47.727586] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-14T20:39:47.958073] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-14T20:39:48.510934] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T20:39:48.758122] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-14T20:39:49.558105] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-14T20:39:49.691345] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T20:39:49.979777] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T20:39:50.358072] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-14T20:39:50.800817] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T20:39:50.801583] [INFO ] [REMOTE ] NXN: Full fetch complete (3550 records). [2025-10-14T20:39:50.801670] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-14T20:39:51.168824] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-14T20:39:51.175895] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-14T20:39:51.175993] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-14T20:39:51.176157] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-14T20:39:51.176196] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-14T20:39:51.176575] [DEBUG] [LOCAL ] NXN: Trimmed 3550 records to 2256 (keeping 200 days of data) [2025-10-14T20:39:51.190784] [DEBUG] [LOCAL ] NXN: Primary data saved (2256 records). [2025-10-14T20:39:51.190845] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-14T20:39:51.190914] [INFO ] [MAIN ] Update Progress: 1562/2369 symbols completed. NXN took 24.9s. Estimated remaining: 1h 53m 33s. Rate: 7.1 symbols/min [2025-10-14T20:39:51.363377] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:51.363551] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-14T20:39:51.363587] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-14T20:39:51.363727] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-14T20:39:51.363772] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-14T20:39:51.363812] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-14T20:39:51.363842] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-14T20:39:51.725965] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:51.958069] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-14T20:39:52.123820] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T20:39:52.581032] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T20:39:52.758069] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-14T20:39:53.269261] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-14T20:39:53.558062] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-14T20:39:54.358098] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-14T20:39:54.480039] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T20:39:55.158040] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-14T20:39:55.326988] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T20:39:55.958093] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-14T20:39:56.062266] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T20:39:56.736494] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:39:56.738394] [INFO ] [REMOTE ] NXP: Full fetch complete (16795 records). [2025-10-14T20:39:56.738468] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-14T20:39:56.763289] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-14T20:39:57.100058] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-14T20:39:57.100136] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-14T20:39:57.100501] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-14T20:39:57.100540] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-14T20:39:57.101076] [DEBUG] [LOCAL ] NXP: Trimmed 16795 records to 12311 (keeping 200 days of data) [2025-10-14T20:39:57.176149] [DEBUG] [LOCAL ] NXP: Primary data saved (12311 records). [2025-10-14T20:39:57.176280] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-14T20:39:57.176356] [INFO ] [MAIN ] Update Progress: 1563/2369 symbols completed. NXP took 30.9s. Estimated remaining: 1h 53m 24s. Rate: 7.1 symbols/min [2025-10-14T20:39:57.342540] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:39:57.342718] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-14T20:39:57.342765] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-14T20:39:57.342901] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-14T20:39:57.342969] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-14T20:39:57.343022] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-14T20:39:57.343054] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-14T20:39:57.563173] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-14T20:39:57.699707] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:39:57.747900] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T20:39:58.358099] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-14T20:39:58.467936] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T20:39:58.931411] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T20:39:59.158099] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-14T20:39:59.935594] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:39:59.937627] [INFO ] [REMOTE ] NXG: Full fetch complete (14546 records). [2025-10-14T20:39:59.937729] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-14T20:39:59.963331] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-14T20:40:00.365157] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-14T20:40:00.365239] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-14T20:40:00.365681] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-14T20:40:00.365743] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-14T20:40:00.366501] [DEBUG] [LOCAL ] NXG: Trimmed 14546 records to 10498 (keeping 200 days of data) [2025-10-14T20:40:00.439986] [DEBUG] [LOCAL ] NXG: Primary data saved (10498 records). [2025-10-14T20:40:00.440142] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-14T20:40:00.440274] [INFO ] [MAIN ] Update Progress: 1564/2369 symbols completed. NXG took 34.1s. Estimated remaining: 1h 53m 12s. Rate: 7.1 symbols/min [2025-10-14T20:40:00.569284] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T20:40:00.649686] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:00.649884] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-14T20:40:00.649923] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-14T20:40:00.650048] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-14T20:40:00.650089] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-14T20:40:00.650129] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-14T20:40:00.650160] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-14T20:40:00.765749] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-14T20:40:01.053432] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:01.558090] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-14T20:40:02.057903] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T20:40:02.358098] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-14T20:40:03.158028] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-14T20:40:03.292086] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T20:40:03.553130] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T20:40:03.958103] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-14T20:40:04.758044] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-14T20:40:04.881548] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T20:40:05.114073] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T20:40:05.256675] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T20:40:05.558057] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-14T20:40:06.358090] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-14T20:40:07.158089] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-14T20:40:07.293525] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T20:40:07.734992] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T20:40:07.958077] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-14T20:40:08.241177] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T20:40:08.758141] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-14T20:40:09.243224] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-14T20:40:09.558051] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-14T20:40:09.874247] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T20:40:09.982809] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T20:40:10.358081] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-14T20:40:11.158079] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-14T20:40:11.429153] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T20:40:11.958060] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-14T20:40:12.389961] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T20:40:12.415019] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-14T20:40:12.758074] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-14T20:40:13.558061] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-14T20:40:14.208211] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T20:40:14.358086] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-14T20:40:14.720691] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T20:40:15.158085] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-14T20:40:15.918480] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T20:40:15.958075] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-14T20:40:16.368271] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T20:40:16.758093] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-14T20:40:17.141970] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T20:40:17.149734] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-14T20:40:17.558043] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-14T20:40:18.358071] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-14T20:40:18.876851] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T20:40:19.158083] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-14T20:40:19.779247] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T20:40:19.781734] [INFO ] [REMOTE ] NXRT: Full fetch complete (25615 records). [2025-10-14T20:40:19.781808] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-14T20:40:19.783538] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:40:19.783783] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:40:19.783853] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:40:19.783933] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-14T20:40:19.784006] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-14T20:40:19.784042] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-14T20:40:19.784082] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-14T20:40:19.784149] [INFO ] [MAIN ] Update Progress: 1565/2369 symbols completed. NXRT took 32.9s. Estimated remaining: 1h 53m 10s. Rate: 7.1 symbols/min [2025-10-14T20:40:19.963612] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-14T20:40:19.986907] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:19.987184] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-14T20:40:19.987236] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-14T20:40:19.987357] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-14T20:40:19.987400] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-14T20:40:19.987440] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-14T20:40:19.987473] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-14T20:40:20.379773] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:20.423472] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T20:40:20.758074] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-14T20:40:21.443780] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T20:40:21.558047] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-14T20:40:22.358066] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-14T20:40:22.912491] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T20:40:23.158059] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-14T20:40:23.586589] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-10-14T20:40:23.958057] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-14T20:40:24.223238] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T20:40:24.365009] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T20:40:24.512023] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T20:40:24.758102] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-14T20:40:25.220725] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T20:40:25.221402] [INFO ] [REMOTE ] NYC: Full fetch complete (1883 records). [2025-10-14T20:40:25.221466] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-14T20:40:25.394498] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-14T20:40:25.394729] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:40:25.394797] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:40:25.394867] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-14T20:40:25.394927] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-14T20:40:25.394962] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-14T20:40:25.394999] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-14T20:40:25.395054] [INFO ] [MAIN ] Update Progress: 1566/2369 symbols completed. NYC took 34.2s. Estimated remaining: 1h 52m 60s. Rate: 7.1 symbols/min [2025-10-14T20:40:25.560153] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:25.560316] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-14T20:40:25.558690] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-14T20:40:25.560413] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-14T20:40:25.561220] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-14T20:40:25.561264] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-14T20:40:25.561305] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-14T20:40:25.561336] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-14T20:40:25.917325] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:26.358070] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-14T20:40:27.158084] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-14T20:40:27.958060] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-14T20:40:28.084694] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T20:40:28.200308] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-14T20:40:28.556683] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:40:28.563299] [INFO ] [REMOTE ] NZF: Full fetch complete (42492 records). [2025-10-14T20:40:28.563506] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-14T20:40:28.564112] [FATAL] [VALIDATOR ] NZF: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:40:28.564206] [FATAL] [MAIN ] NZF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:40:28.564249] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:40:28.564288] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-14T20:40:28.564353] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-14T20:40:28.564409] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-14T20:40:28.564452] [DEBUG] [LOCAL ] NZF: No derivative data file found to delete. [2025-10-14T20:40:28.564519] [INFO ] [MAIN ] Update Progress: 1567/2369 symbols completed. NZF took 28.1s. Estimated remaining: 1h 52m 49s. Rate: 7.1 symbols/min [2025-10-14T20:40:28.736406] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:28.736622] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-14T20:40:28.736707] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-14T20:40:28.736900] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-14T20:40:28.736946] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-14T20:40:28.737050] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-14T20:40:28.737101] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-14T20:40:28.766369] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-14T20:40:29.126154] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-14T20:40:29.130890] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:29.558068] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-14T20:40:30.358061] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-14T20:40:31.158095] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-14T20:40:31.226633] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-14T20:40:31.383817] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T20:40:31.409457] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T20:40:31.958066] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-14T20:40:32.690336] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T20:40:32.758035] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-14T20:40:33.018981] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T20:40:33.558103] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-14T20:40:34.358148] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-14T20:40:34.431332] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T20:40:34.474593] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T20:40:35.158064] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-14T20:40:35.958068] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-14T20:40:36.758096] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-14T20:40:36.935540] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-14T20:40:36.992155] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T20:40:37.016924] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T20:40:37.558071] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-14T20:40:38.358078] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-14T20:40:38.516160] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T20:40:38.649936] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T20:40:39.158050] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-14T20:40:39.958113] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-14T20:40:40.758094] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-14T20:40:40.973170] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-14T20:40:41.015418] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T20:40:41.467865] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T20:40:41.558077] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-14T20:40:41.943227] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T20:40:42.358103] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-14T20:40:43.158088] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-14T20:40:43.375806] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T20:40:43.888695] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-14T20:40:43.958065] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-14T20:40:44.758138] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-14T20:40:45.104339] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T20:40:45.465944] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:40:45.471056] [INFO ] [REMOTE ] NYT: Full fetch complete (71826 records). [2025-10-14T20:40:45.471191] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-14T20:40:45.471868] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:40:45.471955] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:40:45.471997] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:40:45.472058] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-14T20:40:45.472142] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-14T20:40:45.472197] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-14T20:40:45.472240] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-14T20:40:45.472295] [INFO ] [MAIN ] Update Progress: 1568/2369 symbols completed. NYT took 48.3s. Estimated remaining: 1h 52m 44s. Rate: 7.1 symbols/min [2025-10-14T20:40:45.563551] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-14T20:40:45.644008] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:45.644145] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-14T20:40:45.644183] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-14T20:40:45.644292] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-14T20:40:45.644333] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-14T20:40:45.644374] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-14T20:40:45.644405] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-14T20:40:46.010921] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:46.177260] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-14T20:40:46.358066] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-14T20:40:47.158055] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-14T20:40:47.472520] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T20:40:47.958036] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-14T20:40:48.079119] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T20:40:48.232432] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T20:40:48.758099] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-14T20:40:49.558034] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-14T20:40:49.659240] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T20:40:50.358092] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-14T20:40:50.760921] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-14T20:40:51.158119] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-14T20:40:51.326458] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T20:40:51.945943] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-14T20:40:51.959013] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-14T20:40:52.758050] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-14T20:40:52.818436] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T20:40:53.518689] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T20:40:53.558026] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-14T20:40:53.782877] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T20:40:54.156876] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T20:40:54.159017] [INFO ] [REMOTE ] OBK: Full fetch complete (23680 records). [2025-10-14T20:40:54.159087] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-14T20:40:54.159474] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:40:54.159552] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:40:54.159594] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:40:54.159678] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-14T20:40:54.159763] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-14T20:40:54.159806] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-14T20:40:54.159849] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-14T20:40:54.159899] [INFO ] [MAIN ] Update Progress: 1569/2369 symbols completed. OBK took 25.6s. Estimated remaining: 1h 52m 36s. Rate: 7.1 symbols/min [2025-10-14T20:40:54.326765] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:54.336374] [DEBUG] [LOCAL ] OCFT: Loaded 7465 existing records from primary storage. [2025-10-14T20:40:54.336557] [INFO ] [MAIN ] OCFT: Loaded 7465 existing records. [2025-10-14T20:40:54.365374] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-14T20:40:54.515611] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:40:54.515856] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-14T20:40:54.515933] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-14T20:40:54.516102] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-14T20:40:54.516142] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-14T20:40:54.873173] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:55.158067] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-14T20:40:55.272253] [DEBUG] [REMOTE ] OC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-14T20:40:55.272482] [WARN ] [REMOTE ] OC: No data returned for month 2025-03 [2025-10-14T20:40:55.272565] [FATAL] [REMOTE ] OC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:40:55.272636] [FATAL] [MAIN ] OC: Failed to fetch primary data. [2025-10-14T20:40:55.272732] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:40:55.272793] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-14T20:40:55.272874] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-14T20:40:55.272937] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-14T20:40:55.272979] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-14T20:40:55.273022] [INFO ] [MAIN ] Update Progress: 1570/2369 symbols completed. OC took 9.8s. Estimated remaining: 1h 52m 24s. Rate: 7.1 symbols/min [2025-10-14T20:40:55.451327] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:40:55.462052] [DEBUG] [LOCAL ] ODC: Loaded 8484 existing records from primary storage. [2025-10-14T20:40:55.462291] [INFO ] [MAIN ] ODC: Loaded 8484 existing records. [2025-10-14T20:40:55.661008] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:40:55.661217] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-14T20:40:55.661263] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-14T20:40:55.661475] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-14T20:40:55.661532] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-14T20:40:55.963176] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-14T20:40:56.023136] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:40:56.304785] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-14T20:40:56.410200] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T20:40:56.758099] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-14T20:40:57.357888] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T20:40:57.558061] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-14T20:40:58.140563] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T20:40:58.358104] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-14T20:40:59.158065] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-14T20:40:59.472889] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T20:40:59.672174] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-14T20:40:59.958109] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-14T20:41:00.758107] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-14T20:41:00.788574] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T20:41:01.558111] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-14T20:41:02.358083] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-14T20:41:02.439782] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T20:41:02.736828] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T20:41:03.158100] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-14T20:41:03.958092] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-14T20:41:03.999693] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T20:41:04.758111] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-14T20:41:04.900032] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-14T20:41:04.928445] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T20:41:04.936911] [INFO ] [REMOTE ] OBDC: Full fetch complete (74887 records). [2025-10-14T20:41:04.937176] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-14T20:41:04.938216] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:41:04.938369] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:41:04.938450] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:41:04.938550] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-14T20:41:04.938665] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-14T20:41:04.938740] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-14T20:41:04.938829] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-14T20:41:04.938931] [INFO ] [MAIN ] Update Progress: 1571/2369 symbols completed. OBDC took 39.5s. Estimated remaining: 1h 52m 16s. Rate: 7.1 symbols/min [2025-10-14T20:41:05.115055] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:05.157488] [DEBUG] [LOCAL ] ODV: Loaded 28490 existing records from primary storage. [2025-10-14T20:41:05.157849] [INFO ] [MAIN ] ODV: Loaded 28490 existing records. [2025-10-14T20:41:05.344770] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:41:05.345043] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-14T20:41:05.345090] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-14T20:41:05.345627] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-14T20:41:05.345721] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-14T20:41:05.563267] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-14T20:41:05.723989] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:05.783409] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T20:41:06.358075] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-14T20:41:07.087772] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T20:41:07.158072] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-14T20:41:07.887061] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T20:41:07.972999] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-14T20:41:07.975732] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-14T20:41:08.758064] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-14T20:41:08.844807] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T20:41:09.500528] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:41:09.501430] [INFO ] [REMOTE ] OCFT: Full fetch complete (11659 records). [2025-10-14T20:41:09.501497] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-14T20:41:09.563431] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-14T20:41:09.867137] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-14T20:41:09.867215] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-14T20:41:09.867485] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-14T20:41:09.867543] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-14T20:41:09.868021] [DEBUG] [LOCAL ] OCFT: Trimmed 11659 records to 7476 (keeping 200 days of data) [2025-10-14T20:41:09.907664] [DEBUG] [LOCAL ] OCFT: Primary data saved (7476 records). [2025-10-14T20:41:09.907770] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-14T20:41:09.907844] [INFO ] [MAIN ] Update Progress: 1572/2369 symbols completed. OCFT took 15.7s. Estimated remaining: 1h 52m 6s. Rate: 7.1 symbols/min [2025-10-14T20:41:10.073616] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:10.073811] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-14T20:41:10.073853] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-14T20:41:10.074009] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-14T20:41:10.074078] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-14T20:41:10.074132] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-14T20:41:10.074165] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-14T20:41:10.363161] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-14T20:41:10.434042] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:10.659853] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T20:41:11.125996] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:41:11.131433] [INFO ] [REMOTE ] O: Full fetch complete (77181 records). [2025-10-14T20:41:11.131546] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-14T20:41:11.132340] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:41:11.132430] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:41:11.132472] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:41:11.132510] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-14T20:41:11.132563] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-14T20:41:11.132597] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-14T20:41:11.132664] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-14T20:41:11.132746] [INFO ] [MAIN ] Update Progress: 1573/2369 symbols completed. O took 51.3s. Estimated remaining: 1h 51m 54s. Rate: 7.1 symbols/min [2025-10-14T20:41:11.163909] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-14T20:41:11.310983] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:11.311110] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-14T20:41:11.311147] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-14T20:41:11.311257] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-14T20:41:11.311299] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-14T20:41:11.311360] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-14T20:41:11.311395] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-14T20:41:11.662555] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:11.958073] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-14T20:41:12.588589] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T20:41:12.665927] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T20:41:12.758116] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-14T20:41:13.558056] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-14T20:41:13.656385] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T20:41:14.358068] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-14T20:41:14.628861] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T20:41:15.158045] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-14T20:41:15.357104] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T20:41:15.958074] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-14T20:41:16.649748] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T20:41:16.758109] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-14T20:41:16.893628] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T20:41:17.558060] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-14T20:41:17.977052] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:41:18.358030] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-14T20:41:18.436890] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T20:41:19.158106] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-14T20:41:19.811822] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T20:41:19.958128] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-14T20:41:20.506294] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T20:41:20.758083] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-14T20:41:20.769183] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T20:41:21.558057] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-14T20:41:22.201071] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T20:41:22.358078] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-14T20:41:22.415425] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T20:41:23.158083] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-14T20:41:23.285906] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-14T20:41:23.958108] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-14T20:41:24.609355] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T20:41:24.758068] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-14T20:41:25.121929] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T20:41:25.558056] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-14T20:41:25.939006] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T20:41:26.358054] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-14T20:41:27.061251] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:41:27.158099] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-14T20:41:27.558189] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T20:41:27.698700] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T20:41:27.958070] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-14T20:41:28.758052] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-14T20:41:28.984098] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T20:41:29.558068] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-14T20:41:30.277377] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T20:41:30.358042] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-14T20:41:30.734024] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T20:41:31.158101] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-14T20:41:31.900011] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T20:41:31.958036] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-14T20:41:32.300760] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T20:41:32.758076] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-14T20:41:33.500535] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T20:41:33.558048] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-14T20:41:33.630841] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T20:41:34.358065] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-14T20:41:34.974172] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:41:35.158091] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-14T20:41:35.509680] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T20:41:35.958106] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-14T20:41:36.491185] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T20:41:36.758101] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-14T20:41:37.131754] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T20:41:37.558082] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-14T20:41:38.358901] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-14T20:41:38.358813] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T20:41:38.679195] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T20:41:39.158073] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-14T20:41:39.247539] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:41:39.730132] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T20:41:39.732890] [INFO ] [REMOTE ] OFG: Full fetch complete (33720 records). [2025-10-14T20:41:39.732965] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-14T20:41:39.733557] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:41:39.733665] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:41:39.733724] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:41:39.733766] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-14T20:41:39.733884] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-14T20:41:39.733942] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-14T20:41:39.733983] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-14T20:41:39.734083] [INFO ] [MAIN ] Update Progress: 1574/2369 symbols completed. OFG took 28.6s. Estimated remaining: 1h 51m 56s. Rate: 7.1 symbols/min [2025-10-14T20:41:39.903362] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:39.903560] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-14T20:41:39.903598] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-14T20:41:39.903733] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-14T20:41:39.903778] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-14T20:41:39.903821] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-14T20:41:39.903854] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-14T20:41:39.966433] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-14T20:41:40.266366] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:40.758119] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-14T20:41:41.543700] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T20:41:41.545205] [INFO ] [REMOTE ] ODC: Full fetch complete (11134 records). [2025-10-14T20:41:41.545273] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-14T20:41:41.566283] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-14T20:41:41.877244] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-14T20:41:41.950273] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-14T20:41:41.950347] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-14T20:41:41.950608] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-14T20:41:41.950667] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-14T20:41:41.951106] [DEBUG] [LOCAL ] ODC: Trimmed 11134 records to 8510 (keeping 200 days of data) [2025-10-14T20:41:42.001431] [DEBUG] [LOCAL ] ODC: Primary data saved (8510 records). [2025-10-14T20:41:42.001556] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-14T20:41:42.001630] [INFO ] [MAIN ] Update Progress: 1575/2369 symbols completed. ODC took 46.7s. Estimated remaining: 1h 51m 44s. Rate: 7.1 symbols/min [2025-10-14T20:41:42.167621] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:42.167823] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-14T20:41:42.167865] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-14T20:41:42.167978] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-14T20:41:42.168018] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-14T20:41:42.168057] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-14T20:41:42.168088] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-14T20:41:42.363295] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-14T20:41:42.523167] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:43.158080] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-14T20:41:43.251620] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T20:41:43.960710] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-14T20:41:43.963256] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T20:41:44.758110] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-14T20:41:45.016949] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T20:41:45.465616] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:41:45.470630] [INFO ] [REMOTE ] OEC: Full fetch complete (52730 records). [2025-10-14T20:41:45.470796] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-14T20:41:45.471532] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:41:45.471615] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:41:45.471689] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:41:45.471742] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-14T20:41:45.471797] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-14T20:41:45.471831] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-14T20:41:45.471868] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-14T20:41:45.471922] [INFO ] [MAIN ] Update Progress: 1576/2369 symbols completed. OEC took 35.6s. Estimated remaining: 1h 51m 33s. Rate: 7.1 symbols/min [2025-10-14T20:41:45.563228] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-14T20:41:45.654511] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:45.662377] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-14T20:41:45.662866] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T20:41:45.662945] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-14T20:41:45.668306] [INFO ] [REMOTE ] ODV: Full fetch complete (34724 records). [2025-10-14T20:41:45.668214] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-14T20:41:45.668490] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-14T20:41:45.668430] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-14T20:41:45.668748] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-14T20:41:45.668876] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-14T20:41:46.368249] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-14T20:41:46.453554] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:46.454102] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-14T20:41:46.454157] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-14T20:41:46.454949] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-14T20:41:46.455008] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-14T20:41:46.455815] [DEBUG] [LOCAL ] ODV: Trimmed 34724 records to 28719 (keeping 200 days of data) [2025-10-14T20:41:46.616898] [DEBUG] [LOCAL ] ODV: Primary data saved (28719 records). [2025-10-14T20:41:46.617039] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-14T20:41:46.617121] [INFO ] [MAIN ] Update Progress: 1577/2369 symbols completed. ODV took 41.7s. Estimated remaining: 1h 51m 21s. Rate: 7.1 symbols/min [2025-10-14T20:41:46.789850] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:41:46.790024] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-14T20:41:46.790078] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-14T20:41:46.790188] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-14T20:41:46.790228] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-14T20:41:46.790288] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-14T20:41:46.790320] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-14T20:41:47.147377] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:41:47.158026] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-14T20:41:47.561374] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-14T20:41:47.958065] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-14T20:41:48.120317] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T20:41:48.745587] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T20:41:48.758022] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-14T20:41:48.888425] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T20:41:49.558578] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-14T20:41:50.358212] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-14T20:41:50.358113] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T20:41:50.963701] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T20:41:51.158103] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-14T20:41:51.957996] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T20:41:51.958131] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-14T20:41:52.753575] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T20:41:52.763693] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-14T20:41:53.516557] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T20:41:53.558024] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-14T20:41:54.358104] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-14T20:41:54.662596] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-14T20:41:55.158062] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-14T20:41:55.304557] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T20:41:55.958089] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-14T20:41:56.631327] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-14T20:41:56.758080] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-14T20:41:57.008231] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T20:41:57.558080] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-14T20:41:57.836488] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T20:41:57.866948] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T20:41:58.358110] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-14T20:41:59.102789] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T20:41:59.158064] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-14T20:41:59.458601] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T20:41:59.958127] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-14T20:42:00.758075] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-14T20:42:00.924863] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T20:42:01.558042] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-14T20:42:01.608986] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T20:42:02.358066] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-14T20:42:02.437203] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T20:42:03.164094] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-14T20:42:03.184604] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T20:42:03.935314] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T20:42:03.958031] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-14T20:42:04.758067] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-14T20:42:05.011589] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T20:42:05.513552] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T20:42:05.558081] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-14T20:42:06.358100] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-14T20:42:06.582448] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T20:42:07.158078] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-14T20:42:07.455470] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T20:42:07.964363] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-14T20:42:07.966485] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T20:42:08.755957] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T20:42:08.766700] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-14T20:42:09.558074] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-14T20:42:09.686191] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T20:42:10.325056] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T20:42:10.358037] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-14T20:42:11.124021] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T20:42:11.158091] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-14T20:42:11.958083] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-14T20:42:12.416203] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-14T20:42:12.758070] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-14T20:42:13.469257] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T20:42:13.504485] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-14T20:42:13.558033] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-14T20:42:13.938384] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T20:42:13.943286] [INFO ] [REMOTE ] OGE: Full fetch complete (66478 records). [2025-10-14T20:42:13.943427] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-14T20:42:13.944229] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:42:13.944346] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:42:13.944399] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:42:13.944439] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-14T20:42:13.944494] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-14T20:42:13.944535] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-14T20:42:13.944596] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-14T20:42:13.944679] [INFO ] [MAIN ] Update Progress: 1578/2369 symbols completed. OGE took 34.2s. Estimated remaining: 1h 51m 22s. Rate: 7.1 symbols/min [2025-10-14T20:42:14.120447] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:14.120628] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-14T20:42:14.120700] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-14T20:42:14.120811] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-14T20:42:14.120851] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-14T20:42:14.120893] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-14T20:42:14.120924] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-14T20:42:14.364740] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-14T20:42:14.499954] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:14.735552] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T20:42:15.158108] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-14T20:42:15.194781] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:42:15.202855] [INFO ] [REMOTE ] OHI: Full fetch complete (74922 records). [2025-10-14T20:42:15.203048] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-14T20:42:15.203987] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:42:15.204095] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:42:15.204153] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:42:15.204213] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-14T20:42:15.204296] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-14T20:42:15.204352] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-14T20:42:15.204415] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-14T20:42:15.204496] [INFO ] [MAIN ] Update Progress: 1579/2369 symbols completed. OHI took 28.6s. Estimated remaining: 1h 51m 10s. Rate: 7.1 symbols/min [2025-10-14T20:42:15.379557] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:15.392623] [DEBUG] [LOCAL ] OIA: Loaded 13178 existing records from primary storage. [2025-10-14T20:42:15.392866] [INFO ] [MAIN ] OIA: Loaded 13178 existing records. [2025-10-14T20:42:15.571417] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:42:15.571616] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-14T20:42:15.571691] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-14T20:42:15.572072] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-14T20:42:15.572143] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-14T20:42:15.932492] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:15.958022] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-14T20:42:16.758046] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-14T20:42:16.904664] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T20:42:17.133807] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T20:42:17.558063] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-14T20:42:18.358039] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-14T20:42:18.638029] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T20:42:19.158067] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-14T20:42:19.332592] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T20:42:19.409082] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T20:42:19.958097] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-14T20:42:20.214722] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T20:42:20.758072] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-14T20:42:21.563262] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-14T20:42:21.577767] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T20:42:21.625544] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T20:42:22.358060] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-14T20:42:23.158045] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-14T20:42:23.347479] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T20:42:23.535018] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-14T20:42:23.958077] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-14T20:42:24.644172] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:42:24.649587] [INFO ] [REMOTE ] OGN: Full fetch complete (76567 records). [2025-10-14T20:42:24.649717] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-14T20:42:24.650353] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:42:24.650436] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:42:24.650478] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:42:24.650516] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-14T20:42:24.650570] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-14T20:42:24.650603] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-14T20:42:24.650665] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-14T20:42:24.650746] [INFO ] [MAIN ] Update Progress: 1580/2369 symbols completed. OGN took 42.6s. Estimated remaining: 1h 51m 2s. Rate: 7.1 symbols/min [2025-10-14T20:42:24.760333] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-14T20:42:24.843605] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:24.843744] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-14T20:42:24.843788] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-14T20:42:24.843959] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-14T20:42:24.844014] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-14T20:42:24.844057] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-14T20:42:24.844089] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-14T20:42:25.231516] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:25.234577] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-14T20:42:25.558092] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-14T20:42:25.829384] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T20:42:26.358085] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-14T20:42:26.944828] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T20:42:26.948085] [INFO ] [REMOTE ] OGS: Full fetch complete (47589 records). [2025-10-14T20:42:26.948196] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-14T20:42:26.948772] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:42:26.948869] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:42:26.948947] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:42:26.949037] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-14T20:42:26.949116] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-14T20:42:26.949152] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-14T20:42:26.949193] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-14T20:42:26.949306] [INFO ] [MAIN ] Update Progress: 1581/2369 symbols completed. OGS took 41.5s. Estimated remaining: 1h 50m 51s. Rate: 7.1 symbols/min [2025-10-14T20:42:27.125780] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:27.163232] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-14T20:42:27.165448] [DEBUG] [LOCAL ] OIS: Loaded 40057 existing records from primary storage. [2025-10-14T20:42:27.165696] [INFO ] [MAIN ] OIS: Loaded 40057 existing records. [2025-10-14T20:42:27.362568] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T20:42:27.384557] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:42:27.385237] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-14T20:42:27.385284] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-14T20:42:27.385924] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-14T20:42:27.385982] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-14T20:42:27.756172] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:27.958059] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-14T20:42:28.049582] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T20:42:28.758082] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-14T20:42:29.416178] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T20:42:29.558067] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-14T20:42:30.320206] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T20:42:30.358099] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-14T20:42:30.931376] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T20:42:31.158099] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-14T20:42:31.256466] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T20:42:31.958067] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-14T20:42:32.758055] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-14T20:42:32.828359] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T20:42:33.008752] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T20:42:33.558083] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-14T20:42:34.358072] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-14T20:42:34.475579] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T20:42:35.158058] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-14T20:42:35.291170] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T20:42:35.958050] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-14T20:42:36.116926] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T20:42:36.729282] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T20:42:36.758113] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-14T20:42:37.518181] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T20:42:37.558107] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-14T20:42:37.989674] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T20:42:38.358127] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-14T20:42:39.019959] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T20:42:39.110344] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T20:42:39.158108] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-14T20:42:39.958077] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-14T20:42:40.167505] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T20:42:40.758094] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-14T20:42:41.558146] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-14T20:42:41.726784] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T20:42:42.351389] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T20:42:42.352919] [INFO ] [REMOTE ] OIA: Full fetch complete (20569 records). [2025-10-14T20:42:42.352992] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-14T20:42:42.365103] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-14T20:42:42.549896] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T20:42:42.793272] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-14T20:42:42.793346] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-14T20:42:42.793862] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-14T20:42:42.793928] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-14T20:42:42.794469] [DEBUG] [LOCAL ] OIA: Trimmed 20569 records to 13151 (keeping 200 days of data) [2025-10-14T20:42:42.869597] [DEBUG] [LOCAL ] OIA: Primary data saved (13151 records). [2025-10-14T20:42:42.869759] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-14T20:42:42.869843] [INFO ] [MAIN ] Update Progress: 1582/2369 symbols completed. OIA took 27.7s. Estimated remaining: 1h 50m 46s. Rate: 7.1 symbols/min [2025-10-14T20:42:43.043086] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:43.043269] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-14T20:42:43.043308] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-14T20:42:43.043447] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-14T20:42:43.043522] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-14T20:42:43.043584] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-14T20:42:43.043621] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-14T20:42:43.163185] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-14T20:42:43.402379] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:43.958093] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-14T20:42:44.131624] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T20:42:44.758136] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-14T20:42:44.893209] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T20:42:45.558128] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-14T20:42:45.626439] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T20:42:46.146963] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T20:42:46.358115] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-14T20:42:47.150760] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T20:42:47.160381] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-14T20:42:47.958040] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-14T20:42:48.067553] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T20:42:48.758055] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-14T20:42:49.233276] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T20:42:49.265937] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T20:42:49.558060] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-14T20:42:50.358095] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-14T20:42:50.458193] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T20:42:51.102077] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T20:42:51.158049] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-14T20:42:51.958056] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-14T20:42:52.295744] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-14T20:42:52.518897] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T20:42:52.523971] [INFO ] [REMOTE ] OIS: Full fetch complete (57141 records). [2025-10-14T20:42:52.524145] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-14T20:42:52.766918] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-14T20:42:52.934520] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-14T20:42:52.934628] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-14T20:42:52.936209] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-14T20:42:52.936273] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-14T20:42:52.937952] [DEBUG] [LOCAL ] OIS: Trimmed 57141 records to 40014 (keeping 200 days of data) [2025-10-14T20:42:53.183982] [DEBUG] [LOCAL ] OIS: Primary data saved (40014 records). [2025-10-14T20:42:53.184313] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-14T20:42:53.184530] [INFO ] [MAIN ] Update Progress: 1583/2369 symbols completed. OIS took 26.2s. Estimated remaining: 1h 50m 38s. Rate: 7.1 symbols/min [2025-10-14T20:42:53.360904] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:53.361278] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-14T20:42:53.361388] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-14T20:42:53.361629] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-14T20:42:53.361773] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-14T20:42:53.362020] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-14T20:42:53.362076] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-14T20:42:53.489806] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T20:42:53.564568] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-14T20:42:53.813938] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:54.358050] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-14T20:42:54.714039] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T20:42:55.060536] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:42:55.069597] [INFO ] [REMOTE ] OI: Full fetch complete (67921 records). [2025-10-14T20:42:55.069925] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-14T20:42:55.071162] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:42:55.071287] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:42:55.071371] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:42:55.071469] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-14T20:42:55.071586] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-14T20:42:55.071684] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-14T20:42:55.071776] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-14T20:42:55.071890] [INFO ] [MAIN ] Update Progress: 1584/2369 symbols completed. OI took 41.1s. Estimated remaining: 1h 50m 27s. Rate: 7.1 symbols/min [2025-10-14T20:42:55.170508] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-14T20:42:55.298884] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:42:55.299193] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-14T20:42:55.299274] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-14T20:42:55.299637] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-14T20:42:55.299747] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-14T20:42:55.299816] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-14T20:42:55.299866] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-14T20:42:55.408423] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T20:42:55.744104] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:42:55.958101] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-14T20:42:56.758094] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-14T20:42:57.558105] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-14T20:42:57.713094] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T20:42:57.907904] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-14T20:42:58.283296] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T20:42:58.358147] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-14T20:42:58.738393] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T20:42:59.158094] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-14T20:42:59.958079] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-14T20:43:00.758050] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-14T20:43:00.929304] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-14T20:43:01.558175] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-14T20:43:01.577395] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T20:43:01.584150] [INFO ] [REMOTE ] OII: Full fetch complete (61569 records). [2025-10-14T20:43:01.584510] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-14T20:43:01.585605] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:43:01.585814] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:43:01.585916] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:43:01.586142] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-14T20:43:01.586255] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-14T20:43:01.586315] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-14T20:43:01.586377] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-14T20:43:01.586524] [INFO ] [MAIN ] Update Progress: 1585/2369 symbols completed. OII took 36.9s. Estimated remaining: 1h 50m 17s. Rate: 7.1 symbols/min [2025-10-14T20:43:01.799984] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-14T20:43:01.848416] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:01.883510] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T20:43:01.903812] [DEBUG] [LOCAL ] OLP: Loaded 10049 existing records from primary storage. [2025-10-14T20:43:01.904144] [INFO ] [MAIN ] OLP: Loaded 10049 existing records. [2025-10-14T20:43:02.091095] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:43:02.091384] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-14T20:43:02.091467] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-14T20:43:02.091872] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-14T20:43:02.091932] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-14T20:43:02.363294] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-14T20:43:02.472482] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:03.158119] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-14T20:43:03.958042] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-14T20:43:04.224427] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T20:43:04.433615] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-14T20:43:04.769487] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-14T20:43:04.800322] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T20:43:04.872875] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T20:43:05.558067] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-14T20:43:06.358127] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-14T20:43:07.158046] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-14T20:43:07.388098] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T20:43:07.728534] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-10-14T20:43:07.958030] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-14T20:43:08.072852] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T20:43:08.283175] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T20:43:08.758078] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-14T20:43:09.478837] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T20:43:09.558084] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-14T20:43:09.906058] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T20:43:10.116220] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-14T20:43:10.358051] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-14T20:43:11.158127] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-14T20:43:11.295756] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-14T20:43:11.958092] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-14T20:43:12.758075] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-14T20:43:13.558093] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-14T20:43:13.818020] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T20:43:13.919625] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-14T20:43:14.363191] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-14T20:43:14.385618] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T20:43:14.404428] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-14T20:43:15.158092] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-14T20:43:15.958132] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-14T20:43:16.758106] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-14T20:43:16.807952] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T20:43:17.259555] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-10-14T20:43:17.271599] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T20:43:17.558088] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-14T20:43:18.159208] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T20:43:18.358067] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-14T20:43:19.158077] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-14T20:43:19.529991] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-14T20:43:19.958087] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-14T20:43:20.051799] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T20:43:20.313836] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T20:43:20.640351] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:43:20.646567] [INFO ] [REMOTE ] OKE: Full fetch complete (77271 records). [2025-10-14T20:43:20.646780] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-14T20:43:20.647611] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:43:20.647723] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:43:20.647767] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:43:20.647810] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-14T20:43:20.647875] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-14T20:43:20.647977] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-14T20:43:20.648039] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-14T20:43:20.648170] [INFO ] [MAIN ] Update Progress: 1586/2369 symbols completed. OKE took 37.8s. Estimated remaining: 1h 50m 14s. Rate: 7.1 symbols/min [2025-10-14T20:43:20.763278] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-14T20:43:20.830137] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:20.830375] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-14T20:43:20.830413] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-14T20:43:20.830537] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-14T20:43:20.830582] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-14T20:43:20.830623] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-14T20:43:20.830699] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-14T20:43:21.206923] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:21.558132] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-14T20:43:22.358078] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-14T20:43:22.445902] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T20:43:22.709556] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T20:43:23.158113] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-14T20:43:23.958098] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-14T20:43:24.381181] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T20:43:24.405923] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T20:43:24.758101] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-14T20:43:25.558070] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-14T20:43:25.738330] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T20:43:25.740250] [INFO ] [REMOTE ] OLP: Full fetch complete (14229 records). [2025-10-14T20:43:25.740322] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-14T20:43:26.143498] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-14T20:43:26.143637] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-14T20:43:26.143993] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-14T20:43:26.144084] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-14T20:43:26.146325] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-14T20:43:26.157621] [DEBUG] [LOCAL ] OLP: Trimmed 14229 records to 10079 (keeping 200 days of data) [2025-10-14T20:43:26.224817] [DEBUG] [LOCAL ] OLP: Primary data saved (10079 records). [2025-10-14T20:43:26.224991] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-14T20:43:26.225104] [INFO ] [MAIN ] Update Progress: 1587/2369 symbols completed. OLP took 24.6s. Estimated remaining: 1h 50m 4s. Rate: 7.1 symbols/min [2025-10-14T20:43:26.363239] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-14T20:43:26.408157] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:26.408320] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-14T20:43:26.408358] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-14T20:43:26.408469] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-14T20:43:26.408509] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-14T20:43:26.408568] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-14T20:43:26.408600] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-14T20:43:26.756501] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:27.158064] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-14T20:43:27.846719] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:43:27.852333] [INFO ] [REMOTE ] OLN: Full fetch complete (74435 records). [2025-10-14T20:43:27.852490] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-14T20:43:27.853240] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:43:27.853329] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:43:27.853371] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:43:27.853411] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-14T20:43:27.853466] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-14T20:43:27.853500] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-14T20:43:27.853538] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-14T20:43:27.853594] [INFO ] [MAIN ] Update Progress: 1588/2369 symbols completed. OLN took 32.8s. Estimated remaining: 1h 49m 52s. Rate: 7.1 symbols/min [2025-10-14T20:43:27.960164] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-14T20:43:28.035289] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:28.035576] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-14T20:43:28.035676] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-14T20:43:28.035978] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-14T20:43:28.036049] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-14T20:43:28.036132] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-14T20:43:28.036190] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-14T20:43:28.436713] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:28.438936] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-14T20:43:28.488027] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-14T20:43:28.758103] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-14T20:43:29.558098] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-14T20:43:29.620347] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T20:43:30.358127] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-14T20:43:30.511014] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T20:43:31.158080] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-14T20:43:31.765889] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T20:43:31.958093] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-14T20:43:32.559290] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-14T20:43:32.758039] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-14T20:43:33.090877] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T20:43:33.494279] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T20:43:33.558023] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-14T20:43:34.358069] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-14T20:43:34.988855] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:43:35.158085] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-14T20:43:35.445562] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-14T20:43:35.967240] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-14T20:43:35.989515] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T20:43:36.550261] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T20:43:36.758134] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-14T20:43:37.558032] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-14T20:43:37.650750] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T20:43:38.358099] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-14T20:43:38.419073] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T20:43:39.158074] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-14T20:43:39.901905] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T20:43:39.958140] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-14T20:43:40.475861] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-10-14T20:43:40.758101] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-14T20:43:41.037130] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T20:43:41.481975] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:43:41.487424] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-14T20:43:41.487538] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-14T20:43:41.488226] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:43:41.488312] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:43:41.488356] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:43:41.488436] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-14T20:43:41.488512] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-14T20:43:41.488560] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-14T20:43:41.488613] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-14T20:43:41.488728] [INFO ] [MAIN ] Update Progress: 1589/2369 symbols completed. OKLO took 48.3s. Estimated remaining: 1h 49m 46s. Rate: 7.1 symbols/min [2025-10-14T20:43:41.560288] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-14T20:43:41.666046] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:41.674761] [DEBUG] [LOCAL ] ONIT: Loaded 7639 existing records from primary storage. [2025-10-14T20:43:41.674975] [INFO ] [MAIN ] ONIT: Loaded 7639 existing records. [2025-10-14T20:43:41.858512] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:43:41.858824] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-14T20:43:41.858911] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-14T20:43:41.859165] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-14T20:43:41.859281] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-14T20:43:42.190758] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-14T20:43:42.283556] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:42.358043] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-14T20:43:43.158121] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-14T20:43:43.228669] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T20:43:43.385493] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T20:43:43.958116] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-14T20:43:44.758075] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-14T20:43:44.997399] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T20:43:45.259233] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T20:43:45.558118] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-14T20:43:45.786543] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T20:43:46.358042] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-14T20:43:46.485670] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-14T20:43:47.158047] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-14T20:43:47.943940] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T20:43:47.958084] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-14T20:43:48.371668] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T20:43:48.758104] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-14T20:43:49.380314] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T20:43:49.524789] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T20:43:49.558024] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-14T20:43:50.358079] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-14T20:43:50.978244] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:43:51.158076] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-14T20:43:51.958053] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-14T20:43:51.986360] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T20:43:52.160753] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T20:43:52.758147] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-14T20:43:53.497480] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T20:43:53.558056] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-14T20:43:54.358060] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-14T20:43:54.698980] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-14T20:43:55.158096] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-14T20:43:55.188447] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T20:43:55.958089] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-14T20:43:56.003877] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T20:43:56.040305] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T20:43:56.703859] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:43:56.709213] [INFO ] [REMOTE ] OMF: Full fetch complete (67097 records). [2025-10-14T20:43:56.709422] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-14T20:43:56.710135] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:43:56.710236] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:43:56.710277] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:43:56.710315] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-14T20:43:56.710370] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-14T20:43:56.710403] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-14T20:43:56.710445] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-14T20:43:56.710500] [INFO ] [MAIN ] Update Progress: 1590/2369 symbols completed. OMF took 30.5s. Estimated remaining: 1h 49m 41s. Rate: 7.1 symbols/min [2025-10-14T20:43:56.766761] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-14T20:43:56.897001] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:56.926602] [DEBUG] [LOCAL ] ONL: Loaded 29682 existing records from primary storage. [2025-10-14T20:43:56.926961] [INFO ] [MAIN ] ONL: Loaded 29682 existing records. [2025-10-14T20:43:57.103277] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:43:57.103517] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-14T20:43:57.103565] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-14T20:43:57.104103] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-14T20:43:57.104162] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-14T20:43:57.491581] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:57.558034] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-14T20:43:57.616787] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T20:43:58.293488] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:43:58.299160] [INFO ] [REMOTE ] OMC: Full fetch complete (76783 records). [2025-10-14T20:43:58.299283] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-14T20:43:58.299977] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:43:58.300079] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:43:58.300148] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:43:58.300243] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-14T20:43:58.300323] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-14T20:43:58.300360] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-14T20:43:58.300400] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-14T20:43:58.300455] [INFO ] [MAIN ] Update Progress: 1591/2369 symbols completed. OMC took 37.7s. Estimated remaining: 1h 49m 30s. Rate: 7.1 symbols/min [2025-10-14T20:43:58.363287] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-14T20:43:58.482707] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:43:58.482861] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-14T20:43:58.482899] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-14T20:43:58.483082] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-14T20:43:58.483155] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-14T20:43:58.483208] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-14T20:43:58.483240] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-14T20:43:58.837152] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:43:59.158063] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-14T20:43:59.958088] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-14T20:44:00.018509] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T20:44:00.018299] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T20:44:00.758125] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-14T20:44:01.363473] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T20:44:01.558053] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-14T20:44:01.580485] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T20:44:02.358067] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-14T20:44:03.158085] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-14T20:44:03.718992] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-14T20:44:03.762383] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:44:03.826222] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:44:03.827512] [INFO ] [REMOTE ] ONIT: Full fetch complete (11093 records). [2025-10-14T20:44:03.827606] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-14T20:44:03.966263] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-14T20:44:04.184279] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-14T20:44:04.184353] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-14T20:44:04.184621] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-14T20:44:04.184687] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-14T20:44:04.185119] [DEBUG] [LOCAL ] ONIT: Trimmed 11093 records to 7643 (keeping 200 days of data) [2025-10-14T20:44:04.229531] [DEBUG] [LOCAL ] ONIT: Primary data saved (7643 records). [2025-10-14T20:44:04.229670] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-14T20:44:04.229770] [INFO ] [MAIN ] Update Progress: 1592/2369 symbols completed. ONIT took 22.7s. Estimated remaining: 1h 49m 20s. Rate: 7.1 symbols/min [2025-10-14T20:44:04.396389] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:44:04.415939] [DEBUG] [LOCAL ] ONTF: Loaded 22596 existing records from primary storage. [2025-10-14T20:44:04.416175] [INFO ] [MAIN ] ONTF: Loaded 22596 existing records. [2025-10-14T20:44:04.590972] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:44:04.591182] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-14T20:44:04.591238] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-14T20:44:04.591675] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-14T20:44:04.591732] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-14T20:44:04.763245] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-14T20:44:04.951244] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:44:05.558099] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-14T20:44:06.030596] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T20:44:06.119630] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-14T20:44:06.358089] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-14T20:44:06.871588] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T20:44:07.158106] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-14T20:44:07.958056] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-14T20:44:08.443437] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-14T20:44:08.758044] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-14T20:44:08.969368] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T20:44:09.067229] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:44:09.558068] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-14T20:44:10.358062] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-14T20:44:10.793830] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-14T20:44:11.158112] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-14T20:44:11.380201] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T20:44:11.421336] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T20:44:11.958069] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-14T20:44:12.758060] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-14T20:44:12.996440] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T20:44:13.327029] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-14T20:44:13.558046] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-14T20:44:14.358037] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-14T20:44:14.411062] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T20:44:14.455310] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T20:44:14.460385] [INFO ] [REMOTE ] OMI: Full fetch complete (64884 records). [2025-10-14T20:44:14.460518] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-14T20:44:14.461479] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:44:14.461589] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:44:14.461668] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:44:14.461769] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-14T20:44:14.461846] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-14T20:44:14.461910] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-14T20:44:14.462000] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-14T20:44:14.462074] [INFO ] [MAIN ] Update Progress: 1593/2369 symbols completed. OMI took 46.6s. Estimated remaining: 1h 49m 12s. Rate: 7.1 symbols/min [2025-10-14T20:44:14.653885] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:44:14.654076] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-14T20:44:14.654116] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-14T20:44:14.654227] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-14T20:44:14.654269] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-14T20:44:14.654332] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-14T20:44:14.654377] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-14T20:44:15.062025] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:44:15.158048] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-14T20:44:15.958047] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-14T20:44:16.524266] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-14T20:44:16.743087] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T20:44:16.758030] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-14T20:44:17.132973] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T20:44:17.558063] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-14T20:44:18.197816] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T20:44:18.358090] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-14T20:44:19.158037] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-14T20:44:19.507250] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T20:44:19.626494] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-14T20:44:19.958073] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-14T20:44:20.267090] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T20:44:20.758060] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-14T20:44:21.070957] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T20:44:21.558080] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-14T20:44:22.358107] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-14T20:44:22.528954] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T20:44:23.158046] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-14T20:44:23.214937] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T20:44:23.326489] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T20:44:23.958069] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-14T20:44:24.281507] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T20:44:24.758091] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-14T20:44:25.558122] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-14T20:44:25.938717] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T20:44:26.144950] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-14T20:44:26.358066] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-14T20:44:27.158073] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-14T20:44:27.314103] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:44:27.958105] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-14T20:44:28.321901] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T20:44:28.503139] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-14T20:44:28.758072] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-14T20:44:29.485255] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:44:29.491037] [INFO ] [REMOTE ] ONON: Full fetch complete (77366 records). [2025-10-14T20:44:29.491261] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-14T20:44:29.491993] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:44:29.492079] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:44:29.492122] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:44:29.492194] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-14T20:44:29.492274] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-14T20:44:29.492322] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-14T20:44:29.492378] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-14T20:44:29.492451] [INFO ] [MAIN ] Update Progress: 1594/2369 symbols completed. ONON took 31.2s. Estimated remaining: 1h 49m 7s. Rate: 7.1 symbols/min [2025-10-14T20:44:29.561313] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-14T20:44:29.677888] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:44:29.678112] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-14T20:44:29.678308] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-14T20:44:29.678500] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-14T20:44:29.678695] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-14T20:44:29.678780] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-14T20:44:29.678947] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-14T20:44:29.941965] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T20:44:30.103384] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:44:30.358092] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-14T20:44:30.856894] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T20:44:31.158041] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-14T20:44:31.300212] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-14T20:44:31.303252] [INFO ] [REMOTE ] ONL: Full fetch complete (42931 records). [2025-10-14T20:44:31.303340] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-14T20:44:31.679248] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-14T20:44:31.679369] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-14T20:44:31.680226] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-14T20:44:31.680286] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-14T20:44:31.681270] [DEBUG] [LOCAL ] ONL: Trimmed 42931 records to 29676 (keeping 200 days of data) [2025-10-14T20:44:31.854814] [DEBUG] [LOCAL ] ONL: Primary data saved (29676 records). [2025-10-14T20:44:31.854980] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-14T20:44:31.855083] [INFO ] [MAIN ] Update Progress: 1595/2369 symbols completed. ONL took 35.1s. Estimated remaining: 1h 48m 56s. Rate: 7.1 symbols/min [2025-10-14T20:44:31.963171] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-14T20:44:32.048013] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:44:32.077759] [DEBUG] [LOCAL ] OPAD: Loaded 24462 existing records from primary storage. [2025-10-14T20:44:32.078111] [INFO ] [MAIN ] OPAD: Loaded 24462 existing records. [2025-10-14T20:44:32.270464] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:44:32.270735] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-14T20:44:32.270815] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-14T20:44:32.271456] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-14T20:44:32.271514] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-14T20:44:32.581985] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:44:32.664960] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:44:32.758039] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-14T20:44:33.083425] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T20:44:33.544433] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T20:44:33.558088] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-14T20:44:34.223676] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T20:44:34.358092] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-14T20:44:35.158113] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-14T20:44:35.522567] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T20:44:35.958071] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-14T20:44:36.758121] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-14T20:44:36.950567] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T20:44:37.054600] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T20:44:37.187108] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T20:44:37.558103] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-14T20:44:38.277433] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T20:44:38.358083] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-14T20:44:39.158115] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-14T20:44:39.958345] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-14T20:44:40.075401] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-14T20:44:40.525055] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-14T20:44:40.711483] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T20:44:40.758093] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-14T20:44:41.558045] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-14T20:44:41.916018] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:44:42.358120] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-14T20:44:42.906605] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T20:44:43.165685] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-14T20:44:43.167434] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T20:44:43.958068] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-14T20:44:44.366078] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T20:44:44.758051] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-14T20:44:45.068835] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T20:44:45.558067] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-14T20:44:45.575306] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T20:44:46.358066] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-14T20:44:47.158107] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-14T20:44:47.387751] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T20:44:47.925924] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T20:44:47.958031] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-14T20:44:48.315280] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T20:44:48.758065] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-14T20:44:49.558042] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-14T20:44:49.823064] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T20:44:49.892601] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T20:44:50.358067] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-14T20:44:51.158056] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-14T20:44:51.310623] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:44:51.958092] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-14T20:44:52.149745] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T20:44:52.153772] [INFO ] [REMOTE ] ONTF: Full fetch complete (31436 records). [2025-10-14T20:44:52.153894] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-14T20:44:52.534865] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-14T20:44:52.534940] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-14T20:44:52.535593] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-14T20:44:52.535629] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-14T20:44:52.536373] [DEBUG] [LOCAL ] ONTF: Trimmed 31436 records to 22546 (keeping 200 days of data) [2025-10-14T20:44:52.661815] [DEBUG] [LOCAL ] ONTF: Primary data saved (22546 records). [2025-10-14T20:44:52.662004] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-14T20:44:52.662088] [INFO ] [MAIN ] Update Progress: 1596/2369 symbols completed. ONTF took 48.4s. Estimated remaining: 1h 48m 53s. Rate: 7.1 symbols/min [2025-10-14T20:44:52.763881] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-14T20:44:52.839793] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:44:52.840092] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-14T20:44:52.840193] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-14T20:44:52.840342] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-14T20:44:52.840472] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-14T20:44:52.840593] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-14T20:44:52.840714] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-14T20:44:53.049213] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-14T20:44:53.239755] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:44:53.558073] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-14T20:44:53.801741] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T20:44:53.825722] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T20:44:54.358099] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-14T20:44:55.158039] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-14T20:44:55.513563] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-14T20:44:55.519006] [INFO ] [REMOTE ] OPAD: Full fetch complete (27446 records). [2025-10-14T20:44:55.519082] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-14T20:44:55.695388] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T20:44:55.918301] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-14T20:44:55.918379] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-14T20:44:55.919085] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-14T20:44:55.919149] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-14T20:44:55.920124] [DEBUG] [LOCAL ] OPAD: Trimmed 27446 records to 24780 (keeping 200 days of data) [2025-10-14T20:44:55.964979] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-14T20:44:56.061155] [DEBUG] [LOCAL ] OPAD: Primary data saved (24780 records). [2025-10-14T20:44:56.061277] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-14T20:44:56.061350] [INFO ] [MAIN ] Update Progress: 1597/2369 symbols completed. OPAD took 24.2s. Estimated remaining: 1h 48m 42s. Rate: 7.1 symbols/min [2025-10-14T20:44:56.758033] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-14T20:44:56.888021] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T20:44:57.076832] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T20:44:57.541499] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:44:57.546560] [INFO ] [REMOTE ] ONTO: Full fetch complete (66479 records). [2025-10-14T20:44:57.546707] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-14T20:44:57.547360] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:44:57.547445] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:44:57.547487] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:44:57.547548] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-14T20:44:57.547665] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-14T20:44:57.547722] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-14T20:44:57.547769] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-14T20:44:57.547824] [INFO ] [MAIN ] Update Progress: 1598/2369 symbols completed. ONTO took 43.1s. Estimated remaining: 1h 48m 30s. Rate: 7.1 symbols/min [2025-10-14T20:44:57.558034] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-14T20:44:58.358076] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-14T20:44:58.943387] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T20:44:58.945972] [INFO ] [REMOTE ] OOMA: Full fetch complete (25704 records). [2025-10-14T20:44:58.946056] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-14T20:44:58.946722] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:44:58.946811] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:44:58.946854] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:44:58.946896] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-14T20:44:58.946957] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-14T20:44:58.946992] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-14T20:44:58.947034] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-14T20:44:58.947116] [INFO ] [MAIN ] Update Progress: 1599/2369 symbols completed. OOMA took 29.5s. Estimated remaining: 1h 48m 19s. Rate: 7.1 symbols/min [2025-10-14T20:44:59.618156] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-14T20:44:59.628096] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-14T20:45:01.782683] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-14T20:45:01.794475] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-14T20:45:03.774225] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T20:45:03.785896] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-14T20:45:05.576205] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T20:45:05.588677] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-14T20:45:07.524281] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T20:45:07.534318] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-14T20:45:09.344401] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T20:45:09.354600] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-14T20:45:11.169519] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T20:45:11.180038] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-14T20:45:12.934454] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:45:12.945072] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-14T20:45:14.752593] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T20:45:14.763085] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-14T20:45:15.622342] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T20:45:15.627064] [INFO ] [REMOTE ] OPFI: Full fetch complete (68287 records). [2025-10-14T20:45:15.627314] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-14T20:45:15.628108] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:45:15.628195] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:45:15.628238] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:45:15.628299] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-14T20:45:15.628361] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-14T20:45:15.628396] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-14T20:45:15.628435] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-14T20:45:15.628490] [INFO ] [MAIN ] Update Progress: 1600/2369 symbols completed. OPFI took 23.0s. Estimated remaining: 1h 48m 14s. Rate: 7.1 symbols/min [2025-10-14T20:45:16.246730] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:16.288713] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:16.314482] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-14T20:45:16.332546] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:16.336694] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-14T20:45:16.336858] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-14T20:45:16.336432] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:16.337224] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-14T20:45:16.337430] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-14T20:45:16.337539] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-14T20:45:16.332596] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-14T20:45:16.337836] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-14T20:45:16.338004] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-14T20:45:16.337943] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-14T20:45:16.338346] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-14T20:45:16.338270] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-14T20:45:16.338437] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-14T20:45:16.338575] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-14T20:45:16.338707] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-14T20:45:16.344180] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-14T20:45:16.338903] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-14T20:45:16.371448] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-14T20:45:16.592571] [DEBUG] [LOCAL ] OPP: Loaded 12202 existing records from primary storage. [2025-10-14T20:45:16.621710] [INFO ] [MAIN ] OPP: Loaded 12202 existing records. [2025-10-14T20:45:17.401871] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:45:17.457992] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-14T20:45:17.516788] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-14T20:45:17.577850] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-14T20:45:17.683106] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-14T20:45:17.700554] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:17.739913] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-14T20:45:17.770767] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:17.749450] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:17.786273] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-14T20:45:17.794083] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-14T20:45:18.156493] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:18.157033] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-14T20:45:18.599769] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T20:45:18.601860] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-14T20:45:18.945017] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T20:45:18.950564] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-14T20:45:19.032779] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T20:45:19.034750] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-14T20:45:19.430176] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T20:45:19.438902] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-14T20:45:19.526905] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T20:45:19.535289] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-14T20:45:19.792522] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T20:45:19.794445] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-14T20:45:19.895255] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T20:45:19.902241] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-14T20:45:20.467096] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T20:45:20.469161] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-14T20:45:20.740281] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T20:45:20.743869] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-14T20:45:20.833875] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-14T20:45:20.843190] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-14T20:45:20.885721] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T20:45:20.894871] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-14T20:45:21.135339] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T20:45:21.138079] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-14T20:45:21.611152] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T20:45:21.616241] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-14T20:45:21.924613] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T20:45:21.931560] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-14T20:45:21.964458] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T20:45:21.966830] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-14T20:45:22.102259] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T20:45:22.114034] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-14T20:45:22.477734] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T20:45:22.481269] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-14T20:45:22.596461] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-14T20:45:23.158072] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-14T20:45:23.372980] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T20:45:23.530951] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T20:45:23.558215] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T20:45:23.736401] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T20:45:23.958059] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-14T20:45:24.758082] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-14T20:45:25.478673] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T20:45:25.558051] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-14T20:45:25.614330] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T20:45:26.358068] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-14T20:45:27.158068] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-14T20:45:27.362352] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T20:45:27.826318] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T20:45:27.838510] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T20:45:27.958091] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-14T20:45:28.758103] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-14T20:45:28.844533] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:45:29.558065] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-14T20:45:30.159935] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T20:45:30.358032] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-14T20:45:30.445569] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T20:45:31.158114] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-14T20:45:31.958082] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-14T20:45:32.046670] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T20:45:32.129891] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T20:45:32.659363] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:45:32.662079] [INFO ] [REMOTE ] OPY: Full fetch complete (10178 records). [2025-10-14T20:45:32.662306] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-14T20:45:32.763243] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-14T20:45:32.950113] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T20:45:32.950592] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:45:32.950701] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:45:32.950797] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-14T20:45:32.950910] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-14T20:45:32.950985] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-14T20:45:32.951064] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-14T20:45:32.951182] [INFO ] [MAIN ] Update Progress: 1601/2369 symbols completed. OPY took 17.3s. Estimated remaining: 1h 48m 10s. Rate: 7.1 symbols/min [2025-10-14T20:45:33.199604] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:33.259011] [DEBUG] [LOCAL ] ORC: Loaded 52499 existing records from primary storage. [2025-10-14T20:45:33.259440] [INFO ] [MAIN ] ORC: Loaded 52499 existing records. [2025-10-14T20:45:33.555713] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:45:33.555970] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-14T20:45:33.556040] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-14T20:45:33.557224] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-14T20:45:33.557301] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-14T20:45:33.563175] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-14T20:45:34.024916] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:34.358038] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-14T20:45:34.511184] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T20:45:34.566677] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:45:35.158075] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-14T20:45:35.874975] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T20:45:35.891015] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:45:35.893662] [INFO ] [REMOTE ] OPP: Full fetch complete (17571 records). [2025-10-14T20:45:35.893747] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-14T20:45:35.963165] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-14T20:45:36.255576] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-14T20:45:36.255675] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-14T20:45:36.256054] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-14T20:45:36.256095] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-14T20:45:36.256611] [DEBUG] [LOCAL ] OPP: Trimmed 17571 records to 12246 (keeping 200 days of data) [2025-10-14T20:45:36.328963] [DEBUG] [LOCAL ] OPP: Primary data saved (12246 records). [2025-10-14T20:45:36.329102] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-14T20:45:36.329182] [INFO ] [MAIN ] Update Progress: 1602/2369 symbols completed. OPP took 20.7s. Estimated remaining: 1h 47m 59s. Rate: 7.1 symbols/min [2025-10-14T20:45:36.501870] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:36.502098] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-14T20:45:36.502148] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-14T20:45:36.502279] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-14T20:45:36.502330] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-14T20:45:36.502410] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-14T20:45:36.502454] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-14T20:45:36.763221] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-14T20:45:36.860682] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:37.558062] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-14T20:45:38.006004] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T20:45:38.332313] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T20:45:38.358067] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-14T20:45:39.158079] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-14T20:45:39.299966] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T20:45:39.958105] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-14T20:45:40.586923] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T20:45:40.758055] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-14T20:45:40.810592] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-14T20:45:41.222976] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T20:45:41.222453] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T20:45:41.237264] [INFO ] [REMOTE ] ORA: Full fetch complete (48733 records). [2025-10-14T20:45:41.237524] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-14T20:45:41.238608] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:45:41.238725] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:45:41.238791] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:45:41.238862] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-14T20:45:41.238926] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-14T20:45:41.238962] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-14T20:45:41.239041] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-14T20:45:41.239115] [INFO ] [MAIN ] Update Progress: 1603/2369 symbols completed. ORA took 25.6s. Estimated remaining: 1h 47m 49s. Rate: 7.1 symbols/min [2025-10-14T20:45:41.409054] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:41.409208] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-14T20:45:41.409244] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-14T20:45:41.409350] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-14T20:45:41.409398] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-14T20:45:41.409445] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-14T20:45:41.409482] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-14T20:45:41.583987] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-14T20:45:41.772879] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:42.358064] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-14T20:45:43.158047] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-14T20:45:43.437905] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T20:45:43.958074] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-14T20:45:44.066766] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T20:45:44.656037] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T20:45:44.661789] [INFO ] [REMOTE ] OR: Full fetch complete (65857 records). [2025-10-14T20:45:44.661956] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-14T20:45:44.662682] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:45:44.662782] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:45:44.662833] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:45:44.662914] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-14T20:45:44.662986] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-14T20:45:44.663022] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-14T20:45:44.663063] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-14T20:45:44.663123] [INFO ] [MAIN ] Update Progress: 1604/2369 symbols completed. OR took 29.0s. Estimated remaining: 1h 47m 38s. Rate: 7.1 symbols/min [2025-10-14T20:45:44.764789] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-14T20:45:44.844753] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:45:44.872838] [DEBUG] [LOCAL ] ORN: Loaded 30834 existing records from primary storage. [2025-10-14T20:45:44.873117] [INFO ] [MAIN ] ORN: Loaded 30834 existing records. [2025-10-14T20:45:45.048073] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:45:45.048296] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-14T20:45:45.048342] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-14T20:45:45.048885] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-14T20:45:45.048942] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-14T20:45:45.426717] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:45:45.558064] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-14T20:45:45.773753] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-14T20:45:46.358055] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-14T20:45:46.519160] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T20:45:46.911917] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T20:45:47.158049] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-14T20:45:47.819282] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T20:45:47.958062] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-14T20:45:48.763166] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-14T20:45:48.779215] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T20:45:49.558079] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-14T20:45:50.325530] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-14T20:45:50.360948] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-14T20:45:50.372732] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T20:45:51.158050] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-14T20:45:51.611771] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-14T20:45:51.955117] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T20:45:51.964099] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-14T20:45:52.019016] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T20:45:52.758124] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-14T20:45:53.558104] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-14T20:45:54.358089] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-14T20:45:54.571770] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-14T20:45:54.997277] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-14T20:45:55.072480] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T20:45:55.158152] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-14T20:45:55.835121] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T20:45:55.958130] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-14T20:45:56.758041] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-14T20:45:57.014776] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T20:45:57.558094] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-14T20:45:58.189367] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T20:45:58.358117] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-14T20:45:58.475068] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-14T20:45:59.029061] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T20:45:59.158108] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-14T20:45:59.468051] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T20:45:59.958085] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-14T20:46:00.758063] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-14T20:46:01.558062] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-14T20:46:01.896005] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-14T20:46:02.082193] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-14T20:46:02.225921] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T20:46:02.358078] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-14T20:46:02.811628] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T20:46:03.158079] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-14T20:46:03.958099] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-14T20:46:04.625849] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-14T20:46:04.758048] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-14T20:46:04.870806] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T20:46:05.558069] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-14T20:46:06.358072] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-14T20:46:06.396783] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-14T20:46:06.962754] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-14T20:46:07.158039] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-14T20:46:07.588911] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T20:46:07.783199] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T20:46:07.958055] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-14T20:46:08.758066] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-14T20:46:09.425309] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T20:46:09.468116] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-14T20:46:09.558032] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-14T20:46:10.064249] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T20:46:10.358072] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-14T20:46:11.007091] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T20:46:11.158076] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-14T20:46:11.958078] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-14T20:46:12.123846] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T20:46:12.758087] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-14T20:46:12.794551] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-14T20:46:12.800357] [INFO ] [REMOTE ] ORC: Full fetch complete (75535 records). [2025-10-14T20:46:12.800473] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-14T20:46:13.168667] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T20:46:13.254599] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-14T20:46:13.251026] [INFO ] [REMOTE ] ORN: Full fetch complete (45401 records). [2025-10-14T20:46:13.254736] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-14T20:46:13.256209] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-14T20:46:13.256306] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-14T20:46:13.254909] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-14T20:46:13.360510] [DEBUG] [LOCAL ] ORC: Trimmed 75535 records to 52516 (keeping 200 days of data) [2025-10-14T20:46:13.567460] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-14T20:46:13.744197] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-14T20:46:13.744597] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-14T20:46:13.746397] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-14T20:46:13.746794] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-14T20:46:13.753917] [DEBUG] [LOCAL ] ORN: Trimmed 45401 records to 30854 (keeping 200 days of data) [2025-10-14T20:46:14.055176] [DEBUG] [LOCAL ] ORN: Primary data saved (30854 records). [2025-10-14T20:46:14.056242] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-14T20:46:14.056604] [INFO ] [MAIN ] Update Progress: 1605/2369 symbols completed. ORN took 29.4s. Estimated remaining: 1h 47m 40s. Rate: 7.1 symbols/min [2025-10-14T20:46:14.274694] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:14.275026] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-14T20:46:14.275096] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-14T20:46:14.275263] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-14T20:46:14.281590] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-14T20:46:14.282016] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-14T20:46:14.282138] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-14T20:46:14.528848] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T20:46:14.572849] [INFO ] [REMOTE ] ORI: Full fetch complete (70002 records). [2025-10-14T20:46:14.609917] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-14T20:46:14.633828] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:46:14.634590] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:46:14.643247] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:46:14.650515] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-14T20:46:14.657088] [DEBUG] [LOCAL ] ORC: Primary data saved (52516 records). [2025-10-14T20:46:14.657326] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-14T20:46:14.657438] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-14T20:46:14.657707] [INFO ] [MAIN ] Update Progress: 1606/2369 symbols completed. ORC took 41.7s. Estimated remaining: 1h 47m 27s. Rate: 7.1 symbols/min [2025-10-14T20:46:14.658192] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-14T20:46:14.694912] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-14T20:46:14.783703] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:14.778583] [INFO ] [MAIN ] Update Progress: 1607/2369 symbols completed. ORI took 33.5s. Estimated remaining: 1h 47m 15s. Rate: 7.1 symbols/min [2025-10-14T20:46:14.784158] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-14T20:46:15.088637] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:15.107463] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-14T20:46:15.107548] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-14T20:46:15.107350] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:15.107804] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-14T20:46:15.107929] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-14T20:46:15.108071] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-14T20:46:15.108231] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-14T20:46:15.108182] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-14T20:46:15.108374] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-14T20:46:15.108520] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-14T20:46:15.151507] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-14T20:46:15.177881] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-14T20:46:15.183965] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-14T20:46:15.833384] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:15.854857] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:15.855479] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-14T20:46:15.892709] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-14T20:46:15.958029] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-14T20:46:16.535768] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T20:46:16.758077] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-14T20:46:17.558058] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-14T20:46:17.637886] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T20:46:17.836480] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:46:17.836828] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-14T20:46:17.836918] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:46:17.836967] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-14T20:46:17.837026] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:46:17.837097] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-14T20:46:17.837156] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-14T20:46:17.837191] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-14T20:46:17.837230] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-14T20:46:17.837274] [INFO ] [MAIN ] Update Progress: 1608/2369 symbols completed. OTF took 3.1s. Estimated remaining: 1h 47m 4s. Rate: 7.1 symbols/min [2025-10-14T20:46:18.006619] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:18.006806] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-14T20:46:18.006848] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-14T20:46:18.006959] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-14T20:46:18.006998] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-14T20:46:18.007038] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-14T20:46:18.007069] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-14T20:46:18.360966] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-14T20:46:18.364489] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:18.613146] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T20:46:18.732175] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-14T20:46:19.158113] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-14T20:46:19.958054] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-14T20:46:20.034424] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T20:46:20.758061] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-14T20:46:21.558057] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-14T20:46:21.723836] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-14T20:46:21.987759] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-14T20:46:22.099728] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T20:46:22.358064] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-14T20:46:23.138466] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T20:46:23.158031] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-14T20:46:23.958053] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-14T20:46:24.246743] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T20:46:24.748765] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T20:46:24.756171] [INFO ] [REMOTE ] ORCL: Full fetch complete (77212 records). [2025-10-14T20:46:24.787823] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-14T20:46:24.787516] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-14T20:46:24.795255] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T20:46:24.805195] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:46:24.806495] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:46:24.807011] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:46:24.807098] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-14T20:46:24.807196] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-14T20:46:24.807256] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-14T20:46:24.807303] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-14T20:46:24.807390] [INFO ] [MAIN ] Update Progress: 1609/2369 symbols completed. ORCL took 48.5s. Estimated remaining: 1h 46m 55s. Rate: 7.1 symbols/min [2025-10-14T20:46:25.011554] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:25.011881] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-14T20:46:25.011929] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-14T20:46:25.012068] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-14T20:46:25.012112] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-14T20:46:25.012155] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-14T20:46:25.012191] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-14T20:46:25.470179] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:25.558087] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-14T20:46:26.358062] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-14T20:46:26.601245] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T20:46:27.152254] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T20:46:27.162795] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-14T20:46:27.801363] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T20:46:27.958100] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-14T20:46:28.758146] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-14T20:46:28.928802] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T20:46:29.558056] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-14T20:46:29.687270] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T20:46:30.181970] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T20:46:30.358087] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-14T20:46:31.158083] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-14T20:46:31.958066] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-14T20:46:31.994063] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-14T20:46:32.030739] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T20:46:32.533712] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T20:46:32.758092] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-14T20:46:33.558041] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-14T20:46:33.951118] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T20:46:34.358131] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-14T20:46:34.583183] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T20:46:35.158163] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-14T20:46:35.855808] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-14T20:46:35.958036] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-14T20:46:36.333586] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T20:46:36.559468] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T20:46:36.758111] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-14T20:46:37.558067] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-14T20:46:38.358079] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-14T20:46:38.467306] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T20:46:38.589019] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-14T20:46:38.819997] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T20:46:39.158070] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-14T20:46:39.958040] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-14T20:46:40.230091] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T20:46:40.758136] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-14T20:46:41.471704] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T20:46:41.558070] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-14T20:46:41.762351] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-14T20:46:42.358075] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-14T20:46:42.500450] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T20:46:43.158067] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-14T20:46:43.199344] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T20:46:43.958131] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-14T20:46:44.758092] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-14T20:46:44.838938] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T20:46:44.953249] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-14T20:46:45.558056] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-14T20:46:45.926996] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T20:46:46.250959] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:46:46.256855] [INFO ] [REMOTE ] OSCR: Full fetch complete (77315 records). [2025-10-14T20:46:46.257038] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-14T20:46:46.257954] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:46:46.258086] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:46:46.258128] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:46:46.258194] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-14T20:46:46.258260] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-14T20:46:46.258296] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-14T20:46:46.258334] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-14T20:46:46.258393] [INFO ] [MAIN ] Update Progress: 1610/2369 symbols completed. OSCR took 32.2s. Estimated remaining: 1h 46m 53s. Rate: 7.1 symbols/min [2025-10-14T20:46:46.364395] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-14T20:46:46.470271] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:46.470913] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-14T20:46:46.471207] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-14T20:46:46.471590] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-14T20:46:46.473393] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T20:46:46.471698] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-14T20:46:46.483744] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-14T20:46:46.483931] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-14T20:46:46.871934] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:47.158065] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-14T20:46:47.958037] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-14T20:46:48.275625] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T20:46:48.758084] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-14T20:46:48.841017] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T20:46:48.915164] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T20:46:49.558060] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-14T20:46:50.358099] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-14T20:46:50.523366] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T20:46:50.598479] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T20:46:51.033415] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:46:51.038063] [INFO ] [REMOTE ] OSK: Full fetch complete (61024 records). [2025-10-14T20:46:51.038177] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-14T20:46:51.038805] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:46:51.038908] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:46:51.038950] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:46:51.038990] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-14T20:46:51.039043] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-14T20:46:51.039077] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-14T20:46:51.039119] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-14T20:46:51.039211] [INFO ] [MAIN ] Update Progress: 1611/2369 symbols completed. OSK took 36.4s. Estimated remaining: 1h 46m 42s. Rate: 7.1 symbols/min [2025-10-14T20:46:51.163268] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-14T20:46:51.209132] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:51.209466] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-14T20:46:51.209518] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-14T20:46:51.209624] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-14T20:46:51.209702] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-14T20:46:51.209756] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-14T20:46:51.209789] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-14T20:46:51.556936] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:51.903573] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:46:51.909042] [INFO ] [REMOTE ] OTIS: Full fetch complete (75800 records). [2025-10-14T20:46:51.909150] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-14T20:46:51.909830] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:46:51.909925] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:46:51.909999] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:46:51.910097] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-14T20:46:51.910175] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-14T20:46:51.910211] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-14T20:46:51.910250] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-14T20:46:51.910304] [INFO ] [MAIN ] Update Progress: 1612/2369 symbols completed. OTIS took 34.1s. Estimated remaining: 1h 46m 30s. Rate: 7.1 symbols/min [2025-10-14T20:46:51.967843] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-14T20:46:52.087172] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:46:52.096622] [DEBUG] [LOCAL ] OWLT: Loaded 9242 existing records from primary storage. [2025-10-14T20:46:52.096840] [INFO ] [MAIN ] OWLT: Loaded 9242 existing records. [2025-10-14T20:46:52.274976] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:46:52.275233] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-14T20:46:52.275287] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-14T20:46:52.275539] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-14T20:46:52.275596] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-14T20:46:52.628570] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:46:52.758031] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-14T20:46:53.556464] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T20:46:53.558296] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-14T20:46:53.875243] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T20:46:54.358108] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-14T20:46:55.093483] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T20:46:55.158030] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-14T20:46:55.958043] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-14T20:46:56.230580] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T20:46:56.400679] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T20:46:56.758046] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-14T20:46:56.962431] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T20:46:57.558087] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-14T20:46:58.230602] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T20:46:58.233441] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T20:46:58.358079] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-14T20:46:59.149778] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T20:46:59.159507] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-14T20:46:59.958054] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-14T20:47:00.063888] [DEBUG] [REMOTE ] OUT: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-14T20:47:00.064167] [WARN ] [REMOTE ] OUT: No data returned for month 2025-10 [2025-10-14T20:47:00.064261] [FATAL] [REMOTE ] OUT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:47:00.064362] [FATAL] [MAIN ] OUT: Failed to fetch primary data. [2025-10-14T20:47:00.064440] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:47:00.064524] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-14T20:47:00.064601] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-14T20:47:00.064680] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-14T20:47:00.064761] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-14T20:47:00.064848] [INFO ] [MAIN ] Update Progress: 1613/2369 symbols completed. OUT took 35.3s. Estimated remaining: 1h 46m 22s. Rate: 7.1 symbols/min [2025-10-14T20:47:00.233919] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:47:00.234088] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-14T20:47:00.234143] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-14T20:47:00.234248] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-14T20:47:00.234321] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-14T20:47:00.234387] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-14T20:47:00.234438] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-14T20:47:00.586979] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:47:00.758038] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-14T20:47:01.562895] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-14T20:47:01.568837] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-14T20:47:02.028408] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-14T20:47:02.355883] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T20:47:02.358090] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-14T20:47:03.038883] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T20:47:03.158054] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-14T20:47:03.958091] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-14T20:47:04.478431] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-14T20:47:04.758084] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-14T20:47:05.558057] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-14T20:47:05.939014] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T20:47:06.358072] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-14T20:47:06.415625] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T20:47:06.739274] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T20:47:06.868004] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-14T20:47:07.158074] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-14T20:47:07.958155] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-14T20:47:08.094165] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T20:47:08.758062] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-14T20:47:09.558094] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-14T20:47:09.879295] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T20:47:10.213756] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T20:47:10.358083] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-14T20:47:11.158101] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-14T20:47:11.547055] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-14T20:47:11.940765] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T20:47:11.958038] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-14T20:47:12.091010] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T20:47:12.758132] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-14T20:47:13.389457] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T20:47:13.558068] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-14T20:47:13.601070] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T20:47:14.358104] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-14T20:47:15.158116] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-14T20:47:15.522762] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T20:47:15.708532] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T20:47:15.958098] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-14T20:47:16.270288] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-14T20:47:16.758073] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-14T20:47:17.558080] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-14T20:47:17.925945] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T20:47:18.358136] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-14T20:47:18.440975] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T20:47:18.443873] [INFO ] [REMOTE ] OWLT: Full fetch complete (11976 records). [2025-10-14T20:47:18.443996] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-14T20:47:19.090979] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-14T20:47:19.131083] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-14T20:47:19.131371] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-14T20:47:19.131788] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-14T20:47:19.131865] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-14T20:47:19.133100] [DEBUG] [LOCAL ] OWLT: Trimmed 11976 records to 9291 (keeping 200 days of data) [2025-10-14T20:47:19.161607] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-14T20:47:19.194479] [DEBUG] [LOCAL ] OWLT: Primary data saved (9291 records). [2025-10-14T20:47:19.195105] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-14T20:47:19.195206] [INFO ] [MAIN ] Update Progress: 1614/2369 symbols completed. OWLT took 27.3s. Estimated remaining: 1h 46m 18s. Rate: 7.1 symbols/min [2025-10-14T20:47:19.367901] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:47:19.368069] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-14T20:47:19.368108] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-14T20:47:19.368252] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-14T20:47:19.368293] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-14T20:47:19.368336] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-14T20:47:19.368370] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-14T20:47:19.737162] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:47:19.958065] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-14T20:47:20.302989] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T20:47:20.682144] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T20:47:20.758050] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-14T20:47:21.558068] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-14T20:47:22.331501] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-14T20:47:22.358042] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-14T20:47:22.421329] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T20:47:23.042793] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T20:47:23.158040] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-14T20:47:23.958092] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-14T20:47:24.525137] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T20:47:24.758083] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-14T20:47:24.929662] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-14T20:47:25.525560] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T20:47:25.558041] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-14T20:47:26.322462] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T20:47:26.358066] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-14T20:47:27.158108] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-14T20:47:27.842911] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:47:27.846474] [INFO ] [REMOTE ] OXM: Full fetch complete (46064 records). [2025-10-14T20:47:27.846549] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-14T20:47:27.847160] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:47:27.847245] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:47:27.847287] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:47:27.847327] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-14T20:47:27.847395] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-14T20:47:27.847440] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-14T20:47:27.847499] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-14T20:47:27.847625] [INFO ] [MAIN ] Update Progress: 1615/2369 symbols completed. OXM took 27.8s. Estimated remaining: 1h 46m 10s. Rate: 7.1 symbols/min [2025-10-14T20:47:27.961414] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-14T20:47:28.030029] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:47:28.030392] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-14T20:47:28.030532] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-14T20:47:28.030920] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-14T20:47:28.031022] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-14T20:47:28.031112] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-14T20:47:28.031289] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-14T20:47:28.305224] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-14T20:47:28.456439] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:47:28.487242] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T20:47:28.758064] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-14T20:47:29.486403] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:47:29.492783] [INFO ] [REMOTE ] OWL: Full fetch complete (77301 records). [2025-10-14T20:47:29.492910] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-14T20:47:29.493824] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:47:29.493919] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:47:29.493966] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:47:29.494045] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-14T20:47:29.494108] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-14T20:47:29.494143] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-14T20:47:29.494180] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-14T20:47:29.494234] [INFO ] [MAIN ] Update Progress: 1616/2369 symbols completed. OWL took 38.5s. Estimated remaining: 1h 45m 58s. Rate: 7.1 symbols/min [2025-10-14T20:47:29.558834] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-14T20:47:29.669771] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:47:29.706033] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T20:47:29.721272] [DEBUG] [LOCAL ] PAC: Loaded 11639 existing records from primary storage. [2025-10-14T20:47:29.721870] [INFO ] [MAIN ] PAC: Loaded 11639 existing records. [2025-10-14T20:47:29.906376] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:47:29.906611] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-14T20:47:29.906686] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-14T20:47:29.907047] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-14T20:47:29.907105] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-14T20:47:30.269546] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:47:30.358049] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-14T20:47:31.158043] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-14T20:47:31.232666] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T20:47:31.958092] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-14T20:47:32.226118] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-14T20:47:32.758058] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-14T20:47:32.909951] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T20:47:33.163129] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-14T20:47:33.558088] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-14T20:47:34.335165] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:47:34.340484] [INFO ] [REMOTE ] OVV: Full fetch complete (77122 records). [2025-10-14T20:47:34.340593] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-14T20:47:34.341234] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:47:34.341318] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:47:34.341360] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:47:34.341397] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-14T20:47:34.341477] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-14T20:47:34.341529] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-14T20:47:34.341570] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-14T20:47:34.341623] [INFO ] [MAIN ] Update Progress: 1617/2369 symbols completed. OVV took 48.1s. Estimated remaining: 1h 45m 48s. Rate: 7.1 symbols/min [2025-10-14T20:47:34.363342] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-14T20:47:34.525574] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:47:34.555372] [DEBUG] [LOCAL ] PACK: Loaded 31890 existing records from primary storage. [2025-10-14T20:47:34.555674] [INFO ] [MAIN ] PACK: Loaded 31890 existing records. [2025-10-14T20:47:34.728108] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:47:34.728299] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-14T20:47:34.728347] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-14T20:47:34.729137] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-14T20:47:34.729209] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-14T20:47:35.085091] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:47:35.163146] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-14T20:47:35.182735] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-14T20:47:35.958030] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-14T20:47:36.361368] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T20:47:36.393283] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-14T20:47:36.530077] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T20:47:36.758044] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-14T20:47:37.558042] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-14T20:47:37.956379] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T20:47:38.358048] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-14T20:47:38.498954] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:47:39.158068] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-14T20:47:39.958093] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-14T20:47:40.288804] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-14T20:47:40.355097] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T20:47:40.758040] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-14T20:47:40.976933] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T20:47:41.558074] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-14T20:47:42.358140] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-14T20:47:42.890016] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-14T20:47:43.158093] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-14T20:47:43.313353] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T20:47:43.958088] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-14T20:47:44.225850] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-14T20:47:44.686963] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T20:47:44.758037] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-14T20:47:45.558106] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-14T20:47:46.046723] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-14T20:47:46.223209] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T20:47:46.358024] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-14T20:47:47.158094] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-14T20:47:47.732255] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T20:47:47.958046] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-14T20:47:48.176495] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-14T20:47:48.758044] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-14T20:47:49.229304] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-14T20:47:49.256338] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T20:47:49.558074] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-14T20:47:49.856258] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T20:47:50.358068] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-14T20:47:51.158038] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-14T20:47:51.509843] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-14T20:47:51.958075] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-14T20:47:52.514443] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T20:47:52.758062] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-14T20:47:53.023288] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-14T20:47:53.043158] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T20:47:53.558061] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-14T20:47:54.358036] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-14T20:47:54.648141] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T20:47:55.000474] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-14T20:47:55.158100] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-14T20:47:55.958148] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-14T20:47:56.045205] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-14T20:47:56.758053] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-14T20:47:57.153286] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T20:47:57.261628] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T20:47:57.558042] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-14T20:47:57.613003] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T20:47:58.358096] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-14T20:47:59.050093] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T20:47:59.158073] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-14T20:47:59.186013] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:47:59.188356] [INFO ] [REMOTE ] PAC: Full fetch complete (16732 records). [2025-10-14T20:47:59.188431] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-14T20:47:59.551602] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-14T20:47:59.551713] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-14T20:47:59.552172] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-14T20:47:59.552213] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-14T20:47:59.552814] [DEBUG] [LOCAL ] PAC: Trimmed 16732 records to 11692 (keeping 200 days of data) [2025-10-14T20:47:59.624891] [DEBUG] [LOCAL ] PAC: Primary data saved (11692 records). [2025-10-14T20:47:59.625028] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-14T20:47:59.625106] [INFO ] [MAIN ] Update Progress: 1618/2369 symbols completed. PAC took 30.1s. Estimated remaining: 1h 45m 48s. Rate: 7.1 symbols/min [2025-10-14T20:47:59.793500] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:47:59.793719] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-14T20:47:59.793770] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-14T20:47:59.793882] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-14T20:47:59.793925] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-14T20:47:59.793968] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-14T20:47:59.794022] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-14T20:47:59.963276] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-14T20:48:00.152832] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:00.499760] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T20:48:00.503723] [INFO ] [REMOTE ] PACK: Full fetch complete (44767 records). [2025-10-14T20:48:00.503833] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-14T20:48:00.767153] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-14T20:48:00.883441] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-14T20:48:00.883531] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-14T20:48:00.884428] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-14T20:48:00.884491] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-14T20:48:00.885548] [DEBUG] [LOCAL ] PACK: Trimmed 44767 records to 31902 (keeping 200 days of data) [2025-10-14T20:48:01.065556] [DEBUG] [LOCAL ] PACK: Primary data saved (31902 records). [2025-10-14T20:48:01.065725] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-14T20:48:01.065816] [INFO ] [MAIN ] Update Progress: 1619/2369 symbols completed. PACK took 26.7s. Estimated remaining: 1h 45m 36s. Rate: 7.1 symbols/min [2025-10-14T20:48:01.235322] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:01.235530] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-14T20:48:01.235572] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-14T20:48:01.235662] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-14T20:48:01.235718] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-14T20:48:01.235762] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-14T20:48:01.235795] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-14T20:48:01.566434] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-14T20:48:01.589943] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:02.358083] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-14T20:48:02.451531] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-14T20:48:02.907310] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T20:48:03.168404] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-14T20:48:03.202096] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-14T20:48:03.473914] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T20:48:03.958083] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-14T20:48:04.006397] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T20:48:04.011915] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-14T20:48:04.012028] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-14T20:48:04.012667] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:48:04.012753] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:48:04.012798] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:48:04.012835] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-14T20:48:04.012890] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-14T20:48:04.012974] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-14T20:48:04.013034] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-14T20:48:04.013091] [INFO ] [MAIN ] Update Progress: 1620/2369 symbols completed. OXY took 44.8s. Estimated remaining: 1h 45m 25s. Rate: 7.1 symbols/min [2025-10-14T20:48:04.199134] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:04.199344] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-14T20:48:04.199385] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-14T20:48:04.199493] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-14T20:48:04.199533] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-14T20:48:04.199573] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-14T20:48:04.199604] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-14T20:48:04.545244] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:04.758058] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-14T20:48:05.489568] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T20:48:05.558027] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-14T20:48:06.358094] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-14T20:48:06.707820] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-14T20:48:06.833788] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T20:48:06.877248] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T20:48:06.883000] [INFO ] [REMOTE ] PAAS: Full fetch complete (77186 records). [2025-10-14T20:48:06.883119] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-14T20:48:06.883834] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:48:06.883920] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:48:06.883964] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:48:06.884002] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-14T20:48:06.884057] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-14T20:48:06.884091] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-14T20:48:06.884129] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-14T20:48:06.884181] [INFO ] [MAIN ] Update Progress: 1621/2369 symbols completed. PAAS took 39.0s. Estimated remaining: 1h 45m 14s. Rate: 7.1 symbols/min [2025-10-14T20:48:07.074960] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:07.079921] [DEBUG] [LOCAL ] PAI: Loaded 2704 existing records from primary storage. [2025-10-14T20:48:07.080134] [INFO ] [MAIN ] PAI: Loaded 2704 existing records. [2025-10-14T20:48:07.163157] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-14T20:48:07.267426] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:48:07.267712] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-14T20:48:07.267772] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-14T20:48:07.267998] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-14T20:48:07.268056] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-14T20:48:07.639390] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:07.958096] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-14T20:48:08.236410] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T20:48:08.630242] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T20:48:08.758030] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-14T20:48:09.427450] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T20:48:09.558070] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-14T20:48:10.139838] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T20:48:10.358126] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-14T20:48:11.158072] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-14T20:48:11.699004] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T20:48:11.958075] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-14T20:48:12.656672] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T20:48:12.758041] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-14T20:48:12.920901] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T20:48:13.558084] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-14T20:48:14.072696] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T20:48:14.358073] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-14T20:48:15.158087] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-14T20:48:15.405884] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-14T20:48:15.958078] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-14T20:48:15.998372] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T20:48:16.389358] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T20:48:16.509802] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T20:48:16.758079] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-14T20:48:17.269582] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-14T20:48:17.558077] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-14T20:48:18.123519] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T20:48:18.358054] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-14T20:48:18.875244] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-14T20:48:19.158064] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-14T20:48:19.958060] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-14T20:48:20.533151] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T20:48:20.758098] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-14T20:48:21.467546] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T20:48:21.558075] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-14T20:48:22.358101] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-14T20:48:22.586333] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T20:48:22.757622] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T20:48:23.158079] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-14T20:48:23.817395] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T20:48:23.958068] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-14T20:48:24.320541] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T20:48:24.758049] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-14T20:48:25.376332] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:48:25.558064] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-14T20:48:26.358042] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-14T20:48:26.640244] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T20:48:26.896568] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-14T20:48:26.933370] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T20:48:27.158068] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-14T20:48:27.958135] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-14T20:48:28.758042] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-14T20:48:28.955087] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-14T20:48:29.161360] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T20:48:29.558065] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-14T20:48:30.211299] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T20:48:30.358037] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-14T20:48:30.633470] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T20:48:30.996813] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:48:31.000930] [INFO ] [REMOTE ] PACS: Full fetch complete (50479 records). [2025-10-14T20:48:31.001029] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-14T20:48:31.001578] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:48:31.001691] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:48:31.001745] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:48:31.001810] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-14T20:48:31.001873] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-14T20:48:31.001908] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-14T20:48:31.001983] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-14T20:48:31.002059] [INFO ] [MAIN ] Update Progress: 1622/2369 symbols completed. PACS took 31.4s. Estimated remaining: 1h 45m 13s. Rate: 7.1 symbols/min [2025-10-14T20:48:31.163184] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-14T20:48:31.187967] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:31.188809] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-14T20:48:31.188855] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-14T20:48:31.188964] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-14T20:48:31.189006] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-14T20:48:31.189047] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-14T20:48:31.189079] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-14T20:48:31.559245] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:31.958101] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-14T20:48:32.360517] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T20:48:32.436684] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T20:48:32.437526] [INFO ] [REMOTE ] PAI: Full fetch complete (4056 records). [2025-10-14T20:48:32.437628] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-14T20:48:32.766037] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-14T20:48:32.810251] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-14T20:48:32.810341] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-14T20:48:32.810474] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-14T20:48:32.810513] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-14T20:48:32.810877] [DEBUG] [LOCAL ] PAI: Trimmed 4056 records to 2701 (keeping 200 days of data) [2025-10-14T20:48:32.828018] [DEBUG] [LOCAL ] PAI: Primary data saved (2701 records). [2025-10-14T20:48:32.828102] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-14T20:48:32.828173] [INFO ] [MAIN ] Update Progress: 1623/2369 symbols completed. PAI took 25.9s. Estimated remaining: 1h 45m 1s. Rate: 7.1 symbols/min [2025-10-14T20:48:32.993169] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:32.993318] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-14T20:48:32.993355] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-14T20:48:32.993463] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-14T20:48:32.993503] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-14T20:48:32.993543] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-14T20:48:32.993574] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-14T20:48:33.342037] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:33.558047] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-14T20:48:33.874538] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T20:48:34.358124] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-14T20:48:34.996509] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T20:48:34.999096] [INFO ] [REMOTE ] PAG: Full fetch complete (30443 records). [2025-10-14T20:48:34.999169] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-14T20:48:34.999680] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:48:34.999780] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:48:34.999844] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:48:34.999917] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-14T20:48:34.999979] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-14T20:48:35.000012] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-14T20:48:35.000184] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-14T20:48:35.000254] [INFO ] [MAIN ] Update Progress: 1624/2369 symbols completed. PAG took 33.9s. Estimated remaining: 1h 44m 50s. Rate: 7.1 symbols/min [2025-10-14T20:48:35.160668] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-14T20:48:35.185172] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:35.185482] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-14T20:48:35.186275] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-14T20:48:35.186458] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-14T20:48:35.186573] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-14T20:48:35.186673] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-14T20:48:35.186817] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-14T20:48:35.575511] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-14T20:48:35.597455] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:35.958067] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-14T20:48:36.631735] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T20:48:36.758046] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-14T20:48:37.543773] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T20:48:37.558015] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-14T20:48:38.358095] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-14T20:48:38.389623] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T20:48:39.055856] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T20:48:39.158118] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-14T20:48:39.428756] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:48:39.429087] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-14T20:48:39.429172] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:48:39.429221] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-14T20:48:39.429280] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:48:39.429354] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-14T20:48:39.429414] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-14T20:48:39.429448] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-14T20:48:39.429487] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-14T20:48:39.429536] [INFO ] [MAIN ] Update Progress: 1625/2369 symbols completed. PAII took 8.4s. Estimated remaining: 1h 44m 40s. Rate: 7.1 symbols/min [2025-10-14T20:48:39.607441] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:39.607729] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-14T20:48:39.607827] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-14T20:48:39.608068] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-14T20:48:39.608133] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-14T20:48:39.608184] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-14T20:48:39.608219] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-14T20:48:39.916973] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T20:48:39.963151] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-14T20:48:40.004679] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:40.758099] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-14T20:48:41.558073] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-14T20:48:41.838125] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T20:48:42.277300] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T20:48:42.358054] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-14T20:48:42.651836] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T20:48:43.086998] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:48:43.092365] [INFO ] [REMOTE ] PAGS: Full fetch complete (76083 records). [2025-10-14T20:48:43.092471] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-14T20:48:43.093112] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:48:43.093195] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:48:43.093236] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:48:43.093274] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-14T20:48:43.093328] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-14T20:48:43.093362] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-14T20:48:43.093406] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-14T20:48:43.093464] [INFO ] [MAIN ] Update Progress: 1626/2369 symbols completed. PAGS took 39.1s. Estimated remaining: 1h 44m 29s. Rate: 7.1 symbols/min [2025-10-14T20:48:43.163221] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-14T20:48:43.266662] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:48:43.266843] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-14T20:48:43.266892] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-14T20:48:43.266998] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-14T20:48:43.267059] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-14T20:48:43.267140] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-14T20:48:43.267193] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-14T20:48:43.619261] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:48:43.958072] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-14T20:48:44.746629] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T20:48:44.758015] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-14T20:48:44.893684] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T20:48:45.558044] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-14T20:48:45.920116] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T20:48:46.358097] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-14T20:48:47.158086] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-14T20:48:47.205790] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T20:48:47.958110] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-14T20:48:48.579981] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T20:48:48.703080] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-14T20:48:48.758064] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-14T20:48:49.558059] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-14T20:48:49.620629] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T20:48:50.358098] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-14T20:48:50.999434] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T20:48:51.075555] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-14T20:48:51.158047] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-14T20:48:51.721161] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T20:48:51.958115] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-14T20:48:52.157144] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T20:48:52.758089] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-14T20:48:53.558119] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-14T20:48:54.077404] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-14T20:48:54.352816] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-14T20:48:54.362482] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-14T20:48:54.742143] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T20:48:55.158079] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-14T20:48:55.958037] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-14T20:48:56.123938] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:48:56.487010] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T20:48:56.758072] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-14T20:48:56.998591] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T20:48:57.558069] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-14T20:48:58.358074] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-14T20:48:59.157313] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-14T20:48:59.168903] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-14T20:48:59.265433] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T20:48:59.340458] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T20:48:59.958098] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-14T20:49:00.758106] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-14T20:49:00.805736] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T20:49:01.558049] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-14T20:49:01.845954] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T20:49:02.358133] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-14T20:49:02.407106] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T20:49:03.018511] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T20:49:03.158042] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-14T20:49:03.922298] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:49:03.928391] [INFO ] [REMOTE ] PAR: Full fetch complete (48403 records). [2025-10-14T20:49:03.928550] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-14T20:49:03.929201] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:03.929292] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:03.929335] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:03.929395] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-14T20:49:03.929451] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-14T20:49:03.929486] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-14T20:49:03.929533] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-14T20:49:03.929585] [INFO ] [MAIN ] Update Progress: 1627/2369 symbols completed. PAR took 28.9s. Estimated remaining: 1h 44m 26s. Rate: 7.1 symbols/min [2025-10-14T20:49:03.964826] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-14T20:49:04.117621] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:04.117919] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-14T20:49:04.117990] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-14T20:49:04.118187] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-14T20:49:04.118294] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-14T20:49:04.118372] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-14T20:49:04.118436] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-14T20:49:04.342230] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-14T20:49:04.503596] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T20:49:04.560685] [INFO ] [REMOTE ] PAM: Full fetch complete (41909 records). [2025-10-14T20:49:04.565290] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:04.565425] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-14T20:49:04.566905] [FATAL] [VALIDATOR ] PAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:04.567020] [FATAL] [MAIN ] PAM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:04.567075] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:04.567157] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-14T20:49:04.567257] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-14T20:49:04.567332] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-14T20:49:04.567426] [DEBUG] [LOCAL ] PAM: No derivative data file found to delete. [2025-10-14T20:49:04.567514] [INFO ] [MAIN ] Update Progress: 1628/2369 symbols completed. PAM took 31.7s. Estimated remaining: 1h 44m 14s. Rate: 7.1 symbols/min [2025-10-14T20:49:04.749706] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:04.749906] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-14T20:49:04.749944] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-14T20:49:04.750055] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-14T20:49:04.750096] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-14T20:49:04.750137] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-14T20:49:04.750168] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-14T20:49:04.763271] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-14T20:49:05.104793] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:05.558073] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-14T20:49:06.358108] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-14T20:49:06.968461] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T20:49:07.158085] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-14T20:49:07.196908] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-14T20:49:07.280437] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T20:49:07.958132] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-14T20:49:08.758033] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-14T20:49:08.849847] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T20:49:09.558071] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-14T20:49:09.703157] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T20:49:09.959007] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T20:49:10.358061] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-14T20:49:11.031751] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T20:49:11.158102] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-14T20:49:11.958056] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-14T20:49:12.366264] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T20:49:12.758036] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-14T20:49:12.837700] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T20:49:13.082625] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T20:49:13.558059] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-14T20:49:14.358071] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-14T20:49:15.009181] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-14T20:49:15.046940] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T20:49:15.158049] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-14T20:49:15.958081] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-14T20:49:16.035475] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T20:49:16.659428] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T20:49:16.758060] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-14T20:49:17.558080] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-14T20:49:18.232108] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-14T20:49:18.303618] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T20:49:18.358070] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-14T20:49:19.067513] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T20:49:19.158048] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-14T20:49:19.392946] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:49:19.873835] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:49:19.883307] [INFO ] [REMOTE ] PARR: Full fetch complete (68721 records). [2025-10-14T20:49:19.883506] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-14T20:49:19.884417] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:19.884550] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:19.884623] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:19.884779] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-14T20:49:19.884857] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-14T20:49:19.884895] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-14T20:49:19.884935] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-14T20:49:19.884992] [INFO ] [MAIN ] Update Progress: 1629/2369 symbols completed. PARR took 40.5s. Estimated remaining: 1h 44m 9s. Rate: 7.1 symbols/min [2025-10-14T20:49:19.963243] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-14T20:49:20.059637] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:20.059842] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-14T20:49:20.059880] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-14T20:49:20.059990] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-14T20:49:20.060031] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-14T20:49:20.060071] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-14T20:49:20.060102] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-14T20:49:20.446902] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:20.758073] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-14T20:49:21.100179] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T20:49:21.558046] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-14T20:49:22.360583] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-14T20:49:22.363135] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T20:49:23.077365] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T20:49:23.158041] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-14T20:49:23.199169] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T20:49:23.958053] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-14T20:49:24.681681] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T20:49:24.758116] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-14T20:49:25.195988] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T20:49:25.558143] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-14T20:49:26.358045] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-14T20:49:26.586508] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T20:49:27.158146] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-14T20:49:27.440405] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-14T20:49:27.958055] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-14T20:49:28.114416] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T20:49:28.564314] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T20:49:28.758084] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-14T20:49:29.301480] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T20:49:29.558102] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-14T20:49:30.358163] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-14T20:49:30.425148] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T20:49:31.119283] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T20:49:31.158118] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-14T20:49:31.528180] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T20:49:31.878343] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:49:31.883153] [INFO ] [REMOTE ] PAY: Full fetch complete (53491 records). [2025-10-14T20:49:31.883347] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-14T20:49:31.884309] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:31.884404] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:31.884449] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:31.884494] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-14T20:49:31.884830] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-14T20:49:31.885039] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-14T20:49:31.885089] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-14T20:49:31.885196] [INFO ] [MAIN ] Update Progress: 1630/2369 symbols completed. PAY took 27.3s. Estimated remaining: 1h 44m 2s. Rate: 7.1 symbols/min [2025-10-14T20:49:31.963186] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-14T20:49:32.057333] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:32.057534] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-14T20:49:32.057613] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-14T20:49:32.057769] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-14T20:49:32.057815] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-14T20:49:32.057855] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-14T20:49:32.057887] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-14T20:49:32.403841] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:32.758070] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-14T20:49:33.496636] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:49:33.502179] [INFO ] [REMOTE ] PATH: Full fetch complete (77461 records). [2025-10-14T20:49:33.502298] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-14T20:49:33.502957] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:33.503040] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:33.503081] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:33.503145] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-14T20:49:33.503206] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-14T20:49:33.503240] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-14T20:49:33.503279] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-14T20:49:33.503331] [INFO ] [MAIN ] Update Progress: 1631/2369 symbols completed. PATH took 50.4s. Estimated remaining: 1h 43m 51s. Rate: 7.1 symbols/min [2025-10-14T20:49:33.567420] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-14T20:49:33.680504] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:33.680879] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-14T20:49:33.680979] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-14T20:49:33.681188] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-14T20:49:33.681251] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-14T20:49:33.681422] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-14T20:49:33.681526] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-14T20:49:33.920946] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T20:49:34.077011] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:34.358038] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-14T20:49:34.697812] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T20:49:35.158104] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-14T20:49:35.944291] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T20:49:35.946390] [INFO ] [REMOTE ] PAXS: Full fetch complete (30055 records). [2025-10-14T20:49:35.946471] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-14T20:49:35.946974] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:35.947052] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:35.947094] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:35.947159] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-14T20:49:35.947219] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-14T20:49:35.947253] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-14T20:49:35.947290] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-14T20:49:35.947342] [INFO ] [MAIN ] Update Progress: 1632/2369 symbols completed. PAXS took 32.0s. Estimated remaining: 1h 43m 39s. Rate: 7.1 symbols/min [2025-10-14T20:49:35.968289] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-14T20:49:36.157785] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T20:49:36.156041] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:36.165489] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-14T20:49:36.166201] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-14T20:49:36.166756] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-14T20:49:36.166803] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-14T20:49:36.166846] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-14T20:49:36.166878] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-14T20:49:36.540118] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:36.758111] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-14T20:49:37.517411] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T20:49:37.558045] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-14T20:49:37.962621] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T20:49:38.358092] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-14T20:49:39.158044] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-14T20:49:39.232766] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T20:49:39.958058] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-14T20:49:40.653987] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-14T20:49:40.758026] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-14T20:49:40.919617] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T20:49:41.558088] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-14T20:49:41.736992] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T20:49:42.358054] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-14T20:49:42.571273] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T20:49:43.158068] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-14T20:49:43.633884] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-14T20:49:43.706384] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T20:49:43.958100] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-14T20:49:44.640635] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T20:49:44.758045] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-14T20:49:45.558056] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-14T20:49:45.875165] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T20:49:46.358088] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-14T20:49:46.438291] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T20:49:47.104796] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T20:49:47.158032] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-14T20:49:47.958060] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-14T20:49:48.048739] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T20:49:48.144463] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T20:49:48.758096] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-14T20:49:49.558045] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-14T20:49:49.666572] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T20:49:50.358076] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-14T20:49:51.008948] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-14T20:49:51.149552] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T20:49:51.158119] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-14T20:49:51.958064] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-14T20:49:52.063946] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T20:49:52.665215] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T20:49:52.714603] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:49:52.719474] [INFO ] [REMOTE ] PAYC: Full fetch complete (52727 records). [2025-10-14T20:49:52.719665] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-14T20:49:52.720392] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:49:52.720483] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:49:52.720528] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:49:52.720634] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-14T20:49:52.720765] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-14T20:49:52.720808] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-14T20:49:52.720850] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-14T20:49:52.720913] [INFO ] [MAIN ] Update Progress: 1633/2369 symbols completed. PAYC took 32.8s. Estimated remaining: 1h 43m 35s. Rate: 7.1 symbols/min [2025-10-14T20:49:52.763160] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-14T20:49:52.912669] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:49:52.913106] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-14T20:49:52.913160] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-14T20:49:52.913322] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-14T20:49:52.913364] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-14T20:49:52.913410] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-14T20:49:52.913467] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-14T20:49:53.277748] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:49:53.558094] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-14T20:49:54.358107] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-14T20:49:54.616564] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T20:49:55.158035] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-14T20:49:55.402304] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T20:49:55.494052] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T20:49:55.958040] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-14T20:49:56.758091] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-14T20:49:57.065929] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T20:49:57.106900] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T20:49:57.558105] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-14T20:49:58.358042] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-14T20:49:58.519894] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T20:49:59.158119] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-14T20:49:59.200320] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T20:49:59.958096] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-14T20:50:00.088581] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T20:50:00.549179] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T20:50:00.758056] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-14T20:50:01.492831] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T20:50:01.558069] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-14T20:50:02.176745] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:50:02.358189] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-14T20:50:03.158097] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-14T20:50:03.828584] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-14T20:50:03.958060] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-14T20:50:04.154468] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T20:50:04.188199] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T20:50:04.758080] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-14T20:50:05.558075] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-14T20:50:05.603970] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T20:50:06.166038] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T20:50:06.358070] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-14T20:50:07.158041] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-14T20:50:07.250226] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T20:50:07.299498] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T20:50:07.958068] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-14T20:50:08.620825] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T20:50:08.625911] [INFO ] [REMOTE ] PBA: Full fetch complete (71190 records). [2025-10-14T20:50:08.626009] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-14T20:50:08.626734] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:08.626820] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:08.626861] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:08.626899] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-14T20:50:08.626952] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-14T20:50:08.626986] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-14T20:50:08.627023] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-14T20:50:08.627076] [INFO ] [MAIN ] Update Progress: 1634/2369 symbols completed. PBA took 35.1s. Estimated remaining: 1h 43m 30s. Rate: 7.1 symbols/min [2025-10-14T20:50:08.770179] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-14T20:50:08.801306] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:08.801421] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-14T20:50:08.801457] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-14T20:50:08.801558] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-14T20:50:08.801598] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-14T20:50:08.801637] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-14T20:50:08.801715] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-14T20:50:09.185615] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:09.182719] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-14T20:50:09.558069] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-14T20:50:10.260120] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T20:50:10.358066] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-14T20:50:10.970362] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T20:50:11.158050] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-14T20:50:11.352039] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T20:50:11.819403] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T20:50:11.824454] [INFO ] [REMOTE ] PB: Full fetch complete (58848 records). [2025-10-14T20:50:11.824600] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-14T20:50:11.825284] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:11.825373] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:11.825415] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:11.825453] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-14T20:50:11.825508] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-14T20:50:11.825541] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-14T20:50:11.825579] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-14T20:50:11.825632] [INFO ] [MAIN ] Update Progress: 1635/2369 symbols completed. PB took 39.9s. Estimated remaining: 1h 43m 19s. Rate: 7.1 symbols/min [2025-10-14T20:50:11.964507] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-14T20:50:11.996240] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:11.996441] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-14T20:50:11.996484] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-14T20:50:11.996604] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-14T20:50:11.996675] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-14T20:50:11.996748] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-14T20:50:11.996790] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-14T20:50:12.360119] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:12.758088] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-14T20:50:13.135193] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T20:50:13.558113] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-14T20:50:14.358052] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-14T20:50:14.536701] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T20:50:14.588017] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T20:50:14.595331] [INFO ] [REMOTE ] PBF: Full fetch complete (76370 records). [2025-10-14T20:50:14.595556] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-14T20:50:14.596996] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:14.597160] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:14.597226] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:14.597300] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-14T20:50:14.597383] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-14T20:50:14.597442] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-14T20:50:14.597484] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-14T20:50:14.597596] [INFO ] [MAIN ] Update Progress: 1636/2369 symbols completed. PBF took 38.7s. Estimated remaining: 1h 43m 8s. Rate: 7.1 symbols/min [2025-10-14T20:50:14.762767] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:14.762932] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-14T20:50:14.762990] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-14T20:50:14.763099] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-14T20:50:14.763138] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-14T20:50:14.763176] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-14T20:50:14.763206] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-14T20:50:15.113832] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:15.158041] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-14T20:50:15.958066] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-14T20:50:16.276523] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T20:50:16.758048] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-14T20:50:16.795611] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T20:50:17.558080] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-14T20:50:17.747832] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T20:50:18.358077] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-14T20:50:18.819841] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T20:50:19.107783] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-14T20:50:19.158030] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-14T20:50:19.548804] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:50:19.608920] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T20:50:19.958014] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-14T20:50:20.758128] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-14T20:50:21.558131] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-14T20:50:21.846455] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T20:50:21.922296] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T20:50:22.281295] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:50:22.285423] [INFO ] [REMOTE ] PBH: Full fetch complete (44020 records). [2025-10-14T20:50:22.285583] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-14T20:50:22.286275] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:22.286377] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:22.286424] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:22.286496] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-14T20:50:22.286569] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-14T20:50:22.286606] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-14T20:50:22.286675] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-14T20:50:22.286760] [INFO ] [MAIN ] Update Progress: 1637/2369 symbols completed. PBH took 29.6s. Estimated remaining: 1h 42m 59s. Rate: 7.1 symbols/min [2025-10-14T20:50:22.358126] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-14T20:50:23.158046] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-14T20:50:23.432577] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T20:50:23.958066] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-14T20:50:24.758060] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-14T20:50:25.064349] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T20:50:25.256554] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-14T20:50:25.558072] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-14T20:50:26.366587] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-14T20:50:26.369630] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T20:50:26.639914] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T20:50:27.158061] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-14T20:50:27.958038] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-14T20:50:28.340712] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T20:50:28.469476] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-14T20:50:28.758046] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-14T20:50:29.558047] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-14T20:50:29.716532] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T20:50:29.855541] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T20:50:30.358106] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-14T20:50:31.158077] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-14T20:50:31.512892] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T20:50:31.680355] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-14T20:50:31.958098] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-14T20:50:32.758094] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-14T20:50:32.813141] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T20:50:33.305250] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T20:50:33.558137] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-14T20:50:34.358068] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-14T20:50:34.923491] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T20:50:34.925533] [INFO ] [REMOTE ] PBT: Full fetch complete (24801 records). [2025-10-14T20:50:34.925605] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-14T20:50:34.926026] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:34.926107] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:34.926149] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:34.926186] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-14T20:50:34.926239] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-14T20:50:34.926272] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-14T20:50:34.926311] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-14T20:50:34.926360] [INFO ] [MAIN ] Update Progress: 1638/2369 symbols completed. PBT took 20.3s. Estimated remaining: 1h 42m 53s. Rate: 7.1 symbols/min [2025-10-14T20:50:35.280915] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-14T20:50:35.293846] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-14T20:50:35.633637] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T20:50:35.958119] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-14T20:50:37.732004] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-14T20:50:37.743242] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-14T20:50:37.918793] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-14T20:50:37.929706] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-14T20:50:38.896266] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T20:50:38.906987] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-14T20:50:39.620936] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T20:50:39.625954] [INFO ] [REMOTE ] PBI: Full fetch complete (71923 records). [2025-10-14T20:50:39.626088] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-14T20:50:39.626773] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:39.626859] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:39.626903] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:39.626942] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-14T20:50:39.627057] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-14T20:50:39.627251] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-14T20:50:39.627423] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-14T20:50:39.627519] [INFO ] [MAIN ] Update Progress: 1639/2369 symbols completed. PBI took 31.0s. Estimated remaining: 1h 42m 42s. Rate: 7.1 symbols/min [2025-10-14T20:50:40.045408] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-14T20:50:40.056992] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-14T20:50:42.564617] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-14T20:50:42.576350] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-14T20:50:44.789466] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-14T20:50:44.801018] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-14T20:50:47.006538] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-14T20:50:47.018045] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-14T20:50:47.770425] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:50:47.776149] [INFO ] [REMOTE ] PBR: Full fetch complete (77491 records). [2025-10-14T20:50:47.776278] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-14T20:50:47.776978] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:50:47.777074] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:50:47.777147] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:50:47.777237] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-14T20:50:47.777318] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-14T20:50:47.777355] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-14T20:50:47.777395] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-14T20:50:47.777449] [INFO ] [MAIN ] Update Progress: 1640/2369 symbols completed. PBR took 36.0s. Estimated remaining: 1h 42m 34s. Rate: 7.1 symbols/min [2025-10-14T20:50:48.389202] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:48.422587] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:48.424708] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-14T20:50:48.464839] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:48.465142] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-14T20:50:48.485247] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-14T20:50:48.521543] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-14T20:50:48.519277] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:50:48.521853] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-14T20:50:48.521914] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-14T20:50:48.522081] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-14T20:50:48.522333] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-14T20:50:48.522378] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-14T20:50:48.522464] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-14T20:50:48.522419] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-14T20:50:48.522639] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-14T20:50:48.545808] [DEBUG] [LOCAL ] PCF: Loaded 9089 existing records from primary storage. [2025-10-14T20:50:48.545604] [DEBUG] [LOCAL ] PCM: Loaded 6785 existing records from primary storage. [2025-10-14T20:50:48.631289] [INFO ] [MAIN ] PCM: Loaded 6785 existing records. [2025-10-14T20:50:48.612208] [INFO ] [MAIN ] PCF: Loaded 9089 existing records. [2025-10-14T20:50:49.502960] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:50:49.479592] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:50:49.512507] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-14T20:50:49.528454] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-14T20:50:49.544239] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-14T20:50:49.584225] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-14T20:50:49.584172] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-14T20:50:49.615504] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-14T20:50:49.631730] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-14T20:50:49.628638] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-14T20:50:49.631638] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:49.761498] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-14T20:50:49.753664] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:49.831375] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-14T20:50:50.416192] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:50.433309] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-14T20:50:50.456595] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:50:50.457055] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-14T20:50:51.094124] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T20:50:51.099113] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-14T20:50:51.273053] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T20:50:51.275044] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-14T20:50:51.655505] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T20:50:51.659935] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-14T20:50:51.899827] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-14T20:50:51.911066] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-14T20:50:52.139551] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-14T20:50:52.143902] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-14T20:50:52.338841] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T20:50:52.343560] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-14T20:50:52.431262] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T20:50:52.434066] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-14T20:50:52.735205] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T20:50:52.738331] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-14T20:50:53.001316] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T20:50:53.004344] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-14T20:50:53.227456] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-14T20:50:53.229483] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-14T20:50:53.533366] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T20:50:53.535379] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T20:50:53.558075] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-14T20:50:53.557744] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T20:50:54.023394] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T20:50:54.358070] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-14T20:50:55.029073] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T20:50:55.158080] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-14T20:50:55.350126] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T20:50:55.935500] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T20:50:55.958026] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-14T20:50:56.653460] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T20:50:56.758080] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-14T20:50:57.558081] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-14T20:50:57.590192] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T20:50:58.358049] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-14T20:50:58.411080] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T20:50:59.158058] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-14T20:50:59.510820] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T20:50:59.687287] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-14T20:50:59.958092] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-14T20:51:00.676679] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:51:00.678214] [INFO ] [REMOTE ] PCM: Full fetch complete (10422 records). [2025-10-14T20:51:00.678284] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-14T20:51:00.763211] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-14T20:51:01.041588] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-14T20:51:01.041701] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-14T20:51:01.041985] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-14T20:51:01.042027] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-14T20:51:01.042517] [DEBUG] [LOCAL ] PCM: Trimmed 10422 records to 6804 (keeping 200 days of data) [2025-10-14T20:51:01.082597] [DEBUG] [LOCAL ] PCM: Primary data saved (6804 records). [2025-10-14T20:51:01.082757] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-14T20:51:01.082844] [INFO ] [MAIN ] Update Progress: 1641/2369 symbols completed. PCM took 13.3s. Estimated remaining: 1h 42m 28s. Rate: 7.1 symbols/min [2025-10-14T20:51:01.252169] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:51:01.252327] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-14T20:51:01.252364] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-14T20:51:01.252496] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-14T20:51:01.252536] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-14T20:51:01.252574] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-14T20:51:01.252605] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-14T20:51:01.563116] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-14T20:51:01.630417] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:51:02.112325] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T20:51:02.358111] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-14T20:51:02.482900] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T20:51:03.158072] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-14T20:51:03.958085] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-14T20:51:03.990934] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T20:51:04.009753] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T20:51:04.758077] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-14T20:51:05.558072] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-14T20:51:06.075082] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-14T20:51:06.358122] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-14T20:51:06.482290] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T20:51:06.994482] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T20:51:07.052813] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T20:51:07.158064] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-14T20:51:07.958073] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-14T20:51:08.102589] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T20:51:08.758116] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-14T20:51:09.323422] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T20:51:09.558102] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-14T20:51:10.358087] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-14T20:51:10.446578] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T20:51:10.486916] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T20:51:11.158037] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-14T20:51:11.294929] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T20:51:11.958061] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-14T20:51:12.758098] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-14T20:51:12.967405] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T20:51:13.553713] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T20:51:13.555202] [INFO ] [REMOTE ] PCF: Full fetch complete (13755 records). [2025-10-14T20:51:13.555268] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-14T20:51:13.566923] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-14T20:51:13.922380] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-14T20:51:13.922476] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-14T20:51:13.922816] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-14T20:51:13.922895] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-14T20:51:13.923473] [DEBUG] [LOCAL ] PCF: Trimmed 13755 records to 9078 (keeping 200 days of data) [2025-10-14T20:51:13.977614] [DEBUG] [LOCAL ] PCF: Primary data saved (9078 records). [2025-10-14T20:51:13.977909] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-14T20:51:13.978005] [INFO ] [MAIN ] Update Progress: 1642/2369 symbols completed. PCF took 26.2s. Estimated remaining: 1h 42m 21s. Rate: 7.1 symbols/min [2025-10-14T20:51:14.118370] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T20:51:14.203095] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:51:14.214990] [DEBUG] [LOCAL ] PCQ: Loaded 12156 existing records from primary storage. [2025-10-14T20:51:14.215217] [INFO ] [MAIN ] PCQ: Loaded 12156 existing records. [2025-10-14T20:51:14.363281] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-14T20:51:14.391761] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:51:14.391899] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-14T20:51:14.391945] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-14T20:51:14.392356] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-14T20:51:14.392413] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-14T20:51:14.735901] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:51:15.158057] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-14T20:51:15.493815] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T20:51:15.958037] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-14T20:51:16.469785] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T20:51:16.508271] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-14T20:51:16.758062] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-14T20:51:17.558053] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-14T20:51:17.713177] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T20:51:17.753531] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T20:51:18.358069] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-14T20:51:19.158111] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-14T20:51:19.187165] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T20:51:19.604515] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-14T20:51:19.958071] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-14T20:51:20.384113] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T20:51:20.758129] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-14T20:51:21.558041] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-14T20:51:21.591929] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T20:51:21.664872] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T20:51:22.358086] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-14T20:51:23.158066] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-14T20:51:23.727370] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T20:51:23.730335] [INFO ] [REMOTE ] PCN: Full fetch complete (34151 records). [2025-10-14T20:51:23.730421] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-14T20:51:23.730934] [FATAL] [VALIDATOR ] PCN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:51:23.731014] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:51:23.731055] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:51:23.731092] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-14T20:51:23.731143] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-14T20:51:23.731178] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-14T20:51:23.731216] [DEBUG] [LOCAL ] PCN: No derivative data file found to delete. [2025-10-14T20:51:23.731266] [INFO ] [MAIN ] Update Progress: 1643/2369 symbols completed. PCN took 35.9s. Estimated remaining: 1h 42m 13s. Rate: 7.1 symbols/min [2025-10-14T20:51:23.905174] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:51:23.905331] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-14T20:51:23.905367] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-14T20:51:23.905478] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-14T20:51:23.905520] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-14T20:51:23.905560] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-14T20:51:23.905592] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-14T20:51:23.969744] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-14T20:51:24.278636] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:51:24.337280] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T20:51:24.416164] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-14T20:51:24.758085] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-14T20:51:24.935619] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T20:51:25.558044] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-14T20:51:26.358074] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-14T20:51:26.508590] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:51:27.035146] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T20:51:27.158045] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-14T20:51:27.437379] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T20:51:27.958107] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-14T20:51:28.758057] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-14T20:51:28.860412] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T20:51:28.942452] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T20:51:29.558061] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-14T20:51:30.303786] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:51:30.308476] [INFO ] [REMOTE ] PCOR: Full fetch complete (69157 records). [2025-10-14T20:51:30.308585] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-14T20:51:30.309330] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:51:30.309414] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:51:30.309457] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:51:30.309522] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-14T20:51:30.309586] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-14T20:51:30.309622] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-14T20:51:30.309697] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-14T20:51:30.309767] [INFO ] [MAIN ] Update Progress: 1644/2369 symbols completed. PCOR took 29.2s. Estimated remaining: 1h 42m 4s. Rate: 7.1 symbols/min [2025-10-14T20:51:30.368876] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-14T20:51:30.488633] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:51:30.488923] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-14T20:51:30.489000] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-14T20:51:30.489283] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-14T20:51:30.489386] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-14T20:51:30.489632] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-14T20:51:30.489840] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-14T20:51:30.696346] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T20:51:30.902796] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:51:31.158051] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-14T20:51:31.237779] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T20:51:31.956039] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T20:51:31.958392] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-14T20:51:32.537897] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:51:32.547142] [INFO ] [REMOTE ] PCG: Full fetch complete (77506 records). [2025-10-14T20:51:32.547396] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-14T20:51:32.548495] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:51:32.548610] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:51:32.548732] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:51:32.548831] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-14T20:51:32.548919] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-14T20:51:32.548964] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-14T20:51:32.549012] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-14T20:51:32.549090] [INFO ] [MAIN ] Update Progress: 1645/2369 symbols completed. PCG took 44.7s. Estimated remaining: 1h 41m 53s. Rate: 7.1 symbols/min [2025-10-14T20:51:32.742025] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:51:32.742275] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-14T20:51:32.742314] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-14T20:51:32.742449] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-14T20:51:32.742490] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-14T20:51:32.742531] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-14T20:51:32.742564] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-14T20:51:32.764514] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-14T20:51:33.129031] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:51:33.132000] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-14T20:51:33.558096] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-14T20:51:34.358081] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-14T20:51:34.397289] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T20:51:35.158118] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-14T20:51:35.958089] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-14T20:51:36.025978] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T20:51:36.758047] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-14T20:51:36.986091] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T20:51:37.028677] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T20:51:37.050184] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-14T20:51:37.558068] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-14T20:51:38.076520] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T20:51:38.358059] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-14T20:51:39.158098] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-14T20:51:39.905085] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T20:51:39.958045] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-14T20:51:40.231978] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T20:51:40.758057] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-14T20:51:41.558031] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-14T20:51:41.675529] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T20:51:41.876200] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-14T20:51:42.345622] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T20:51:42.358015] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-14T20:51:43.158129] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-14T20:51:43.958045] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-14T20:51:43.985135] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:51:43.986601] [INFO ] [REMOTE ] PCQ: Full fetch complete (16936 records). [2025-10-14T20:51:43.986691] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-14T20:51:44.323863] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-14T20:51:44.404603] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-14T20:51:44.404705] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-14T20:51:44.405075] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-14T20:51:44.405114] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-14T20:51:44.405600] [DEBUG] [LOCAL ] PCQ: Trimmed 16936 records to 12132 (keeping 200 days of data) [2025-10-14T20:51:44.476266] [DEBUG] [LOCAL ] PCQ: Primary data saved (12132 records). [2025-10-14T20:51:44.476401] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-14T20:51:44.476480] [INFO ] [MAIN ] Update Progress: 1646/2369 symbols completed. PCQ took 30.5s. Estimated remaining: 1h 41m 46s. Rate: 7.1 symbols/min [2025-10-14T20:51:44.643904] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:51:44.644089] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-14T20:51:44.644128] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-14T20:51:44.644239] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-14T20:51:44.644282] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-14T20:51:44.644323] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-14T20:51:44.644355] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-14T20:51:44.763206] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-14T20:51:45.004500] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:51:45.558080] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-14T20:51:45.601776] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T20:51:45.635389] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T20:51:46.358068] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-14T20:51:47.126188] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T20:51:47.158053] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-14T20:51:47.926820] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T20:51:47.958043] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-14T20:51:48.679704] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T20:51:48.758074] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-14T20:51:49.558046] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-14T20:51:49.613639] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T20:51:50.293714] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T20:51:50.315730] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T20:51:50.358049] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-14T20:51:51.158096] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-14T20:51:51.927108] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T20:51:51.958029] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-14T20:51:52.758053] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-14T20:51:53.110069] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T20:51:53.156130] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-14T20:51:53.558040] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-14T20:51:53.596397] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T20:51:53.891841] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-14T20:51:54.358072] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-14T20:51:55.158123] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-14T20:51:55.625963] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-14T20:51:55.958062] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-14T20:51:56.053603] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T20:51:56.758124] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-14T20:51:57.558045] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-14T20:51:58.049400] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-14T20:51:58.331877] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T20:51:58.358022] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-14T20:51:59.163236] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-14T20:51:59.178629] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T20:51:59.443846] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T20:51:59.958032] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-14T20:52:00.758061] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-14T20:52:01.361463] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-14T20:52:01.413037] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T20:52:01.558061] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-14T20:52:02.358107] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-14T20:52:02.651589] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T20:52:02.719881] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T20:52:02.781382] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T20:52:03.158125] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-14T20:52:03.483676] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-14T20:52:03.484456] [INFO ] [REMOTE ] PDCC: Full fetch complete (1348 records). [2025-10-14T20:52:03.484528] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-14T20:52:03.661197] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-14T20:52:03.661401] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:52:03.661472] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:52:03.661540] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-14T20:52:03.661603] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-14T20:52:03.661671] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-14T20:52:03.661736] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-14T20:52:03.661799] [INFO ] [MAIN ] Update Progress: 1647/2369 symbols completed. PDCC took 33.4s. Estimated remaining: 1h 41m 42s. Rate: 7.1 symbols/min [2025-10-14T20:52:03.826997] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:03.827182] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-14T20:52:03.827220] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-14T20:52:03.827328] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-14T20:52:03.827368] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-14T20:52:03.827409] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-14T20:52:03.827439] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-14T20:52:03.967270] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-14T20:52:04.181231] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:04.758052] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-14T20:52:05.429474] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:52:05.434894] [INFO ] [REMOTE ] PD: Full fetch complete (67828 records). [2025-10-14T20:52:05.435042] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-14T20:52:05.435733] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:52:05.435817] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:52:05.435858] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:52:05.435919] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-14T20:52:05.435980] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-14T20:52:05.436017] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-14T20:52:05.436056] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-14T20:52:05.436109] [INFO ] [MAIN ] Update Progress: 1648/2369 symbols completed. PD took 41.7s. Estimated remaining: 1h 41m 31s. Rate: 7.1 symbols/min [2025-10-14T20:52:05.563128] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-14T20:52:05.616140] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:05.647894] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T20:52:05.669550] [DEBUG] [LOCAL ] PDS: Loaded 17330 existing records from primary storage. [2025-10-14T20:52:05.669816] [INFO ] [MAIN ] PDS: Loaded 17330 existing records. [2025-10-14T20:52:05.847748] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:52:05.847965] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-14T20:52:05.848011] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-14T20:52:05.848490] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-14T20:52:05.848582] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-14T20:52:06.202566] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:06.358055] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-14T20:52:07.158084] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-14T20:52:07.231242] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T20:52:07.306080] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T20:52:07.958057] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-14T20:52:08.467170] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T20:52:08.758086] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-14T20:52:09.032836] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T20:52:09.146291] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T20:52:09.150358] [INFO ] [REMOTE ] PDM: Full fetch complete (56943 records). [2025-10-14T20:52:09.150465] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-14T20:52:09.151110] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:52:09.151211] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:52:09.151266] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:52:09.151339] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-14T20:52:09.151403] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-14T20:52:09.151438] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-14T20:52:09.151476] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-14T20:52:09.151530] [INFO ] [MAIN ] Update Progress: 1649/2369 symbols completed. PDM took 24.7s. Estimated remaining: 1h 41m 20s. Rate: 7.1 symbols/min [2025-10-14T20:52:09.318054] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:09.334912] [DEBUG] [LOCAL ] PDT: Loaded 17559 existing records from primary storage. [2025-10-14T20:52:09.335146] [INFO ] [MAIN ] PDT: Loaded 17559 existing records. [2025-10-14T20:52:09.510072] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:52:09.510299] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-14T20:52:09.510344] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-14T20:52:09.510801] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-14T20:52:09.510858] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-14T20:52:09.563231] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-14T20:52:09.863853] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:10.358074] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-14T20:52:11.158042] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-14T20:52:11.477346] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-14T20:52:11.568025] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-14T20:52:11.958038] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-14T20:52:12.294787] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T20:52:12.758063] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-14T20:52:13.392324] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T20:52:13.558061] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-14T20:52:13.977530] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T20:52:14.358045] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-14T20:52:14.548751] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T20:52:15.158113] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-14T20:52:15.932868] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T20:52:15.958034] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-14T20:52:16.758063] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-14T20:52:17.059126] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T20:52:17.300638] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T20:52:17.558054] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-14T20:52:17.858082] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T20:52:18.358041] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-14T20:52:18.579215] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T20:52:19.152623] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T20:52:19.159233] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-14T20:52:19.958065] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-14T20:52:20.758080] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-14T20:52:20.934964] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T20:52:21.146787] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T20:52:21.558139] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-14T20:52:22.255829] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T20:52:22.358063] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-14T20:52:22.636880] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T20:52:23.152857] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T20:52:23.158017] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-14T20:52:23.958109] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-14T20:52:24.212468] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T20:52:24.758130] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-14T20:52:25.453085] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T20:52:25.480308] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:52:25.486939] [INFO ] [REMOTE ] PDI: Full fetch complete (72729 records). [2025-10-14T20:52:25.487212] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-14T20:52:25.488449] [FATAL] [VALIDATOR ] PDI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:52:25.488554] [FATAL] [MAIN ] PDI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:52:25.488597] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:52:25.488709] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-14T20:52:25.488793] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-14T20:52:25.488832] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-14T20:52:25.488872] [DEBUG] [LOCAL ] PDI: No derivative data file found to delete. [2025-10-14T20:52:25.488940] [INFO ] [MAIN ] Update Progress: 1650/2369 symbols completed. PDI took 52.9s. Estimated remaining: 1h 41m 15s. Rate: 7.1 symbols/min [2025-10-14T20:52:25.563318] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-14T20:52:25.672755] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:25.673047] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-14T20:52:25.673092] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-14T20:52:25.673179] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-14T20:52:25.673308] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-14T20:52:25.673372] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-14T20:52:25.673406] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-14T20:52:26.043241] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:26.358051] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-14T20:52:26.685918] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T20:52:27.158110] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-14T20:52:27.646179] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T20:52:27.883162] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T20:52:27.958045] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-14T20:52:28.758081] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-14T20:52:29.286000] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T20:52:29.361629] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T20:52:29.558060] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-14T20:52:30.358120] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-14T20:52:30.801336] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T20:52:31.069002] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T20:52:31.158102] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-14T20:52:31.958047] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-14T20:52:32.261111] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T20:52:32.758055] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-14T20:52:33.373472] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:52:33.558079] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-14T20:52:33.912516] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T20:52:34.358130] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-14T20:52:34.953006] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T20:52:35.158173] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-14T20:52:35.358023] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:52:35.958082] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-14T20:52:36.241528] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T20:52:36.758120] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-14T20:52:36.831698] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T20:52:36.833895] [INFO ] [REMOTE ] PDS: Full fetch complete (25601 records). [2025-10-14T20:52:36.833965] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-14T20:52:37.219778] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-14T20:52:37.219856] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-14T20:52:37.220378] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-14T20:52:37.220440] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-14T20:52:37.221132] [DEBUG] [LOCAL ] PDS: Trimmed 25601 records to 17289 (keeping 200 days of data) [2025-10-14T20:52:37.321771] [DEBUG] [LOCAL ] PDS: Primary data saved (17289 records). [2025-10-14T20:52:37.321913] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-14T20:52:37.321988] [INFO ] [MAIN ] Update Progress: 1651/2369 symbols completed. PDS took 31.9s. Estimated remaining: 1h 41m 8s. Rate: 7.1 symbols/min [2025-10-14T20:52:37.489729] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:37.489887] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-14T20:52:37.489932] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-14T20:52:37.490038] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-14T20:52:37.490078] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-14T20:52:37.490118] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-14T20:52:37.490149] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-14T20:52:37.563218] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-14T20:52:37.847739] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:38.120089] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T20:52:38.358028] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-14T20:52:38.678567] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T20:52:39.158098] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-14T20:52:39.965870] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-14T20:52:39.983818] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T20:52:40.326213] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T20:52:40.758160] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-14T20:52:40.999615] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T20:52:41.002256] [INFO ] [REMOTE ] PDT: Full fetch complete (25304 records). [2025-10-14T20:52:41.002340] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-14T20:52:41.371427] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-14T20:52:41.371528] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-14T20:52:41.372107] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-14T20:52:41.372169] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-14T20:52:41.373003] [DEBUG] [LOCAL ] PDT: Trimmed 25304 records to 17577 (keeping 200 days of data) [2025-10-14T20:52:41.479336] [DEBUG] [LOCAL ] PDT: Primary data saved (17577 records). [2025-10-14T20:52:41.479463] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-14T20:52:41.479537] [INFO ] [MAIN ] Update Progress: 1652/2369 symbols completed. PDT took 32.3s. Estimated remaining: 1h 40m 58s. Rate: 7.1 symbols/min [2025-10-14T20:52:41.563259] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-14T20:52:41.650235] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:41.650380] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-14T20:52:41.650418] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-14T20:52:41.650544] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-14T20:52:41.650606] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-14T20:52:41.650720] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-14T20:52:41.650765] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-14T20:52:42.000053] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:42.358045] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-14T20:52:42.523580] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T20:52:42.593736] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-14T20:52:43.158086] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-14T20:52:43.829553] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:52:43.833272] [INFO ] [REMOTE ] PDO: Full fetch complete (46947 records). [2025-10-14T20:52:43.833387] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-14T20:52:43.834025] [FATAL] [VALIDATOR ] PDO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:52:43.834109] [FATAL] [MAIN ] PDO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:52:43.834152] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:52:43.834204] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-14T20:52:43.834281] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-14T20:52:43.834317] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-14T20:52:43.834358] [DEBUG] [LOCAL ] PDO: No derivative data file found to delete. [2025-10-14T20:52:43.834412] [INFO ] [MAIN ] Update Progress: 1653/2369 symbols completed. PDO took 40.2s. Estimated remaining: 1h 40m 47s. Rate: 7.1 symbols/min [2025-10-14T20:52:43.963216] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-14T20:52:44.018992] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:44.019367] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-14T20:52:44.019477] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-14T20:52:44.019702] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-14T20:52:44.019772] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-14T20:52:44.019830] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-14T20:52:44.019862] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-14T20:52:44.380513] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:44.411306] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-14T20:52:44.758071] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-14T20:52:45.042701] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T20:52:45.558091] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-14T20:52:46.110160] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T20:52:46.358145] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-14T20:52:47.158038] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-14T20:52:47.317449] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:52:47.465526] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T20:52:47.958062] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-14T20:52:48.758065] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-14T20:52:49.015593] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T20:52:49.558107] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-14T20:52:49.613943] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T20:52:49.718782] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T20:52:50.358049] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-14T20:52:51.158046] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-14T20:52:51.341932] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T20:52:51.958094] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-14T20:52:52.135586] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T20:52:52.196542] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T20:52:52.758095] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-14T20:52:53.558058] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-14T20:52:53.595488] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T20:52:54.110285] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T20:52:54.112242] [INFO ] [REMOTE ] PDX: Full fetch complete (23786 records). [2025-10-14T20:52:54.112330] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-14T20:52:54.112827] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:52:54.112914] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:52:54.112961] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:52:54.113001] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-14T20:52:54.113057] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-14T20:52:54.113094] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-14T20:52:54.113139] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-14T20:52:54.113194] [INFO ] [MAIN ] Update Progress: 1654/2369 symbols completed. PDX took 28.6s. Estimated remaining: 1h 40m 39s. Rate: 7.1 symbols/min [2025-10-14T20:52:54.298511] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:52:54.310724] [DEBUG] [LOCAL ] PEO: Loaded 11174 existing records from primary storage. [2025-10-14T20:52:54.310991] [INFO ] [MAIN ] PEO: Loaded 11174 existing records. [2025-10-14T20:52:54.367106] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-14T20:52:54.499733] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:52:54.500369] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-14T20:52:54.525591] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-14T20:52:54.529358] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-14T20:52:54.529439] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-14T20:52:54.531095] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T20:52:54.888851] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:52:55.158075] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-14T20:52:55.936543] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T20:52:55.958033] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-14T20:52:56.758052] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-14T20:52:56.957392] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T20:52:57.399961] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T20:52:57.558045] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-14T20:52:58.358112] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-14T20:52:58.671307] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T20:52:59.034627] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T20:52:59.158085] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-14T20:52:59.958093] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-14T20:53:00.051404] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T20:53:00.219869] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T20:53:00.758083] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-14T20:53:01.558113] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-14T20:53:01.809949] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T20:53:02.361466] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-14T20:53:02.365161] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T20:53:02.983822] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T20:53:03.158100] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-14T20:53:03.390842] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T20:53:03.958266] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-14T20:53:04.708969] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T20:53:04.758031] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-14T20:53:04.881266] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T20:53:05.558070] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-14T20:53:06.010012] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T20:53:06.358121] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-14T20:53:07.158109] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-14T20:53:07.394136] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T20:53:07.468725] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T20:53:07.958146] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-14T20:53:08.079272] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T20:53:08.518006] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-14T20:53:08.758121] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-14T20:53:09.558066] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-14T20:53:09.657209] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T20:53:09.662353] [INFO ] [REMOTE ] PEB: Full fetch complete (72730 records). [2025-10-14T20:53:09.662462] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-14T20:53:09.663098] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:53:09.663182] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:53:09.663225] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:53:09.663290] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-14T20:53:09.663352] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-14T20:53:09.663387] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-14T20:53:09.663426] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-14T20:53:09.663481] [INFO ] [MAIN ] Update Progress: 1655/2369 symbols completed. PEB took 32.3s. Estimated remaining: 1h 40m 34s. Rate: 7.1 symbols/min [2025-10-14T20:53:09.844257] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:09.858731] [DEBUG] [LOCAL ] PERF: Loaded 14341 existing records from primary storage. [2025-10-14T20:53:09.858958] [INFO ] [MAIN ] PERF: Loaded 14341 existing records. [2025-10-14T20:53:10.038237] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:53:10.038480] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-14T20:53:10.038541] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-14T20:53:10.038943] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-14T20:53:10.039000] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-14T20:53:10.367671] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-14T20:53:10.412550] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:10.865262] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T20:53:11.158046] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-14T20:53:11.300356] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T20:53:11.897908] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T20:53:11.958005] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-14T20:53:12.758082] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-14T20:53:12.797495] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T20:53:13.558070] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-14T20:53:13.853435] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T20:53:14.189392] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:53:14.192521] [INFO ] [REMOTE ] PEN: Full fetch complete (43975 records). [2025-10-14T20:53:14.192619] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-14T20:53:14.193159] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:53:14.193241] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:53:14.193284] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:53:14.193347] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-14T20:53:14.193408] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-14T20:53:14.193442] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-14T20:53:14.193480] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-14T20:53:14.193534] [INFO ] [MAIN ] Update Progress: 1656/2369 symbols completed. PEN took 30.4s. Estimated remaining: 1h 40m 24s. Rate: 7.1 symbols/min [2025-10-14T20:53:14.366498] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-14T20:53:14.369442] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:14.371304] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-14T20:53:14.371365] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-14T20:53:14.371485] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-14T20:53:14.371529] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-14T20:53:14.371572] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-14T20:53:14.371605] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-14T20:53:14.729586] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:15.158067] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-14T20:53:15.555850] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:53:15.958098] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-14T20:53:16.758114] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-14T20:53:17.123149] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T20:53:17.123372] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:53:17.127521] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-14T20:53:17.128671] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:53:17.128777] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-14T20:53:17.128955] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:53:17.129031] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-14T20:53:17.129105] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-14T20:53:17.129168] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-14T20:53:17.129306] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-14T20:53:17.129391] [INFO ] [MAIN ] Update Progress: 1657/2369 symbols completed. PEW took 2.9s. Estimated remaining: 1h 40m 13s. Rate: 7.1 symbols/min [2025-10-14T20:53:17.335425] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:17.337795] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T20:53:17.354165] [DEBUG] [LOCAL ] PFD: Loaded 5416 existing records from primary storage. [2025-10-14T20:53:17.354388] [INFO ] [MAIN ] PFD: Loaded 5416 existing records. [2025-10-14T20:53:17.541751] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:53:17.541974] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-14T20:53:17.542023] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-14T20:53:17.542269] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-14T20:53:17.542332] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-14T20:53:17.563943] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-14T20:53:17.919512] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:18.358094] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-14T20:53:18.532749] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T20:53:19.048063] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T20:53:19.158079] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-14T20:53:19.958058] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-14T20:53:20.233739] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T20:53:20.758114] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-14T20:53:20.832233] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T20:53:21.558048] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-14T20:53:21.691533] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T20:53:22.358120] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-14T20:53:22.483050] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T20:53:23.023900] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T20:53:23.158047] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-14T20:53:23.958127] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-14T20:53:24.758056] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-14T20:53:25.005498] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T20:53:25.028963] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T20:53:25.558063] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-14T20:53:25.604345] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T20:53:26.202216] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-14T20:53:26.358073] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-14T20:53:27.045203] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T20:53:27.158113] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-14T20:53:27.958034] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-14T20:53:28.275342] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T20:53:28.717625] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:53:28.719320] [INFO ] [REMOTE ] PEO: Full fetch complete (16264 records). [2025-10-14T20:53:28.719388] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-14T20:53:28.763751] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-14T20:53:29.097472] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-14T20:53:29.097578] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-14T20:53:29.097962] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-14T20:53:29.098022] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-14T20:53:29.098499] [DEBUG] [LOCAL ] PEO: Trimmed 16264 records to 11141 (keeping 200 days of data) [2025-10-14T20:53:29.165583] [DEBUG] [LOCAL ] PEO: Primary data saved (11141 records). [2025-10-14T20:53:29.165748] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-14T20:53:29.165834] [INFO ] [MAIN ] Update Progress: 1658/2369 symbols completed. PEO took 35.1s. Estimated remaining: 1h 40m 6s. Rate: 7.1 symbols/min [2025-10-14T20:53:29.337113] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:29.337308] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-14T20:53:29.337347] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-14T20:53:29.337459] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-14T20:53:29.337500] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-14T20:53:29.337574] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-14T20:53:29.337631] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-14T20:53:29.568744] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-14T20:53:29.693666] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:30.048133] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T20:53:30.358051] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-14T20:53:30.479754] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T20:53:31.072068] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T20:53:31.158048] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-14T20:53:31.824903] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:53:31.831319] [INFO ] [REMOTE ] PEG: Full fetch complete (76539 records). [2025-10-14T20:53:31.831599] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-14T20:53:31.833047] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:53:31.833177] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:53:31.833281] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:53:31.833332] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-14T20:53:31.833402] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-14T20:53:31.833495] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-14T20:53:31.833548] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-14T20:53:31.833619] [INFO ] [MAIN ] Update Progress: 1659/2369 symbols completed. PEG took 50.4s. Estimated remaining: 1h 39m 55s. Rate: 7.1 symbols/min [2025-10-14T20:53:31.963300] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-14T20:53:32.013321] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:32.013754] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-14T20:53:32.013807] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-14T20:53:32.013927] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-14T20:53:32.013971] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-14T20:53:32.014013] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-14T20:53:32.014047] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-14T20:53:32.379975] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:32.650048] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T20:53:32.758069] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-14T20:53:33.404206] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T20:53:33.558061] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-14T20:53:34.358089] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-14T20:53:35.158125] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-14T20:53:35.176060] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T20:53:35.958093] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-14T20:53:36.328037] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-14T20:53:36.433340] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T20:53:36.724926] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T20:53:36.758035] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-14T20:53:37.300498] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T20:53:37.558083] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-14T20:53:38.358066] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-14T20:53:39.158100] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-14T20:53:39.433194] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T20:53:39.873583] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:53:39.875420] [INFO ] [REMOTE ] PFD: Full fetch complete (7497 records). [2025-10-14T20:53:39.875561] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-14T20:53:39.963261] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-14T20:53:40.298214] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-14T20:53:40.298337] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-14T20:53:40.298804] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-14T20:53:40.298905] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-14T20:53:40.299733] [DEBUG] [LOCAL ] PFD: Trimmed 7497 records to 5425 (keeping 200 days of data) [2025-10-14T20:53:40.356532] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-14T20:53:40.376532] [DEBUG] [LOCAL ] PFD: Primary data saved (5425 records). [2025-10-14T20:53:40.376683] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-14T20:53:40.376828] [INFO ] [MAIN ] Update Progress: 1660/2369 symbols completed. PFD took 23.2s. Estimated remaining: 1h 39m 47s. Rate: 7.1 symbols/min [2025-10-14T20:53:40.542172] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:40.550491] [DEBUG] [LOCAL ] PFH: Loaded 6756 existing records from primary storage. [2025-10-14T20:53:40.550730] [INFO ] [MAIN ] PFH: Loaded 6756 existing records. [2025-10-14T20:53:40.725858] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:53:40.726094] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-14T20:53:40.726151] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-14T20:53:40.726382] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-14T20:53:40.726439] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-14T20:53:40.763197] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-14T20:53:41.045163] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T20:53:41.099091] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:41.558068] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-14T20:53:42.358061] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-14T20:53:42.434284] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T20:53:42.490180] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T20:53:42.492949] [INFO ] [REMOTE ] PERF: Full fetch complete (22176 records). [2025-10-14T20:53:42.493099] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-14T20:53:42.876052] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-14T20:53:42.876145] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-14T20:53:42.876772] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-14T20:53:42.876852] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-14T20:53:42.877742] [DEBUG] [LOCAL ] PERF: Trimmed 22176 records to 14374 (keeping 200 days of data) [2025-10-14T20:53:42.958048] [DEBUG] [LOCAL ] PERF: Primary data saved (14374 records). [2025-10-14T20:53:42.958173] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-14T20:53:42.958249] [INFO ] [MAIN ] Update Progress: 1661/2369 symbols completed. PERF took 33.3s. Estimated remaining: 1h 39m 36s. Rate: 7.1 symbols/min [2025-10-14T20:53:43.131108] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:53:43.145512] [DEBUG] [LOCAL ] PFL: Loaded 14271 existing records from primary storage. [2025-10-14T20:53:43.145762] [INFO ] [MAIN ] PFL: Loaded 14271 existing records. [2025-10-14T20:53:43.166122] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-14T20:53:43.325344] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:53:43.325543] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-14T20:53:43.325592] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-14T20:53:43.325977] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-14T20:53:43.326034] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-14T20:53:43.674330] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:53:43.958071] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-14T20:53:44.128081] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T20:53:44.717492] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T20:53:44.758024] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-14T20:53:44.835469] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-14T20:53:45.558058] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-14T20:53:45.778718] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T20:53:46.358073] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-14T20:53:47.107411] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T20:53:47.158087] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-14T20:53:47.931159] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T20:53:47.958032] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-14T20:53:48.665956] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T20:53:48.758087] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-14T20:53:49.059454] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-14T20:53:49.558054] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-14T20:53:49.661897] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T20:53:50.362680] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-14T20:53:50.365552] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T20:53:51.158063] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-14T20:53:51.373262] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T20:53:51.958063] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-14T20:53:52.727498] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-14T20:53:52.758026] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-14T20:53:53.563708] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-14T20:53:53.565035] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T20:53:53.865763] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-14T20:53:54.358069] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-14T20:53:54.923072] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T20:53:55.055205] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T20:53:55.158041] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-14T20:53:55.958044] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-14T20:53:56.051467] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T20:53:56.758078] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-14T20:53:57.558098] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-14T20:53:57.740572] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T20:53:58.315382] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T20:53:58.358066] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-14T20:53:59.158037] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-14T20:53:59.405057] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-14T20:53:59.907212] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T20:53:59.958084] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-14T20:54:00.139114] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T20:54:00.453343] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-14T20:54:00.758125] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-14T20:54:01.558076] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-14T20:54:02.358111] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-14T20:54:03.140342] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T20:54:03.141343] [INFO ] [REMOTE ] PFH: Full fetch complete (9993 records). [2025-10-14T20:54:03.141409] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-14T20:54:03.163316] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-14T20:54:03.319539] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T20:54:03.562199] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-14T20:54:03.562320] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-14T20:54:03.562774] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-14T20:54:03.562854] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-14T20:54:03.563872] [DEBUG] [LOCAL ] PFH: Trimmed 9993 records to 6751 (keeping 200 days of data) [2025-10-14T20:54:03.638046] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-14T20:54:03.657462] [DEBUG] [LOCAL ] PFH: Primary data saved (6751 records). [2025-10-14T20:54:03.658231] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-14T20:54:03.658331] [INFO ] [MAIN ] Update Progress: 1662/2369 symbols completed. PFH took 23.3s. Estimated remaining: 1h 39m 32s. Rate: 7.1 symbols/min [2025-10-14T20:54:03.857168] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:03.864211] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-14T20:54:03.864351] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-14T20:54:03.865376] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T20:54:03.865517] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-14T20:54:03.868525] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-14T20:54:03.868968] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-14T20:54:03.869035] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-14T20:54:03.963308] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-14T20:54:04.238701] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:04.758063] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-14T20:54:05.558036] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-14T20:54:05.716282] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T20:54:05.786269] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T20:54:06.358066] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-14T20:54:07.158083] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-14T20:54:07.334639] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T20:54:07.958071] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-14T20:54:08.429835] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-14T20:54:08.758098] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-14T20:54:08.880574] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T20:54:09.378099] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T20:54:09.558047] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-14T20:54:09.804283] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T20:54:10.358100] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-14T20:54:11.039811] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T20:54:11.158073] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-14T20:54:11.958034] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-14T20:54:12.758044] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-14T20:54:12.823229] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T20:54:12.893574] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T20:54:13.091314] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-14T20:54:13.131432] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-14T20:54:13.558046] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-14T20:54:14.136897] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:54:14.141833] [INFO ] [REMOTE ] PFGC: Full fetch complete (67377 records). [2025-10-14T20:54:14.141971] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-14T20:54:14.142737] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:54:14.142825] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:54:14.142866] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:54:14.142904] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-14T20:54:14.142957] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-14T20:54:14.142990] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-14T20:54:14.143026] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-14T20:54:14.143080] [INFO ] [MAIN ] Update Progress: 1663/2369 symbols completed. PFGC took 42.3s. Estimated remaining: 1h 39m 25s. Rate: 7.1 symbols/min [2025-10-14T20:54:14.325463] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:14.345068] [DEBUG] [LOCAL ] PFN: Loaded 22306 existing records from primary storage. [2025-10-14T20:54:14.345302] [INFO ] [MAIN ] PFN: Loaded 22306 existing records. [2025-10-14T20:54:14.365290] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-14T20:54:14.521703] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:54:14.521957] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-14T20:54:14.522061] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-14T20:54:14.522486] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-14T20:54:14.522541] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-14T20:54:14.865526] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:15.158163] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-14T20:54:15.365135] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T20:54:15.958042] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-14T20:54:16.040583] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T20:54:16.758100] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-14T20:54:17.558034] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-14T20:54:17.784559] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T20:54:17.934063] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:54:18.286439] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:54:18.292369] [INFO ] [REMOTE ] PFE: Full fetch complete (77603 records). [2025-10-14T20:54:18.292501] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-14T20:54:18.293186] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:54:18.293278] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:54:18.293321] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:54:18.293369] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-14T20:54:18.293424] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-14T20:54:18.293463] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-14T20:54:18.293511] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-14T20:54:18.293576] [INFO ] [MAIN ] Update Progress: 1664/2369 symbols completed. PFE took 49.1s. Estimated remaining: 1h 39m 15s. Rate: 7.1 symbols/min [2025-10-14T20:54:18.363137] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-14T20:54:18.496822] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:18.503990] [DEBUG] [LOCAL ] PFO: Loaded 6093 existing records from primary storage. [2025-10-14T20:54:18.504193] [INFO ] [MAIN ] PFO: Loaded 6093 existing records. [2025-10-14T20:54:18.679550] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:54:18.679838] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-14T20:54:18.679901] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-14T20:54:18.680166] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-14T20:54:18.680224] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-14T20:54:19.028358] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:19.158040] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-14T20:54:19.958070] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-14T20:54:20.170491] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T20:54:20.203432] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T20:54:20.758078] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-14T20:54:20.950798] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T20:54:20.953291] [INFO ] [REMOTE ] PFL: Full fetch complete (20503 records). [2025-10-14T20:54:20.953357] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-14T20:54:21.329089] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-14T20:54:21.329162] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-14T20:54:21.329597] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-14T20:54:21.329667] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-14T20:54:21.330215] [DEBUG] [LOCAL ] PFL: Trimmed 20503 records to 14241 (keeping 200 days of data) [2025-10-14T20:54:21.413926] [DEBUG] [LOCAL ] PFL: Primary data saved (14241 records). [2025-10-14T20:54:21.414094] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-14T20:54:21.414176] [INFO ] [MAIN ] Update Progress: 1665/2369 symbols completed. PFL took 38.5s. Estimated remaining: 1h 39m 4s. Rate: 7.1 symbols/min [2025-10-14T20:54:21.563159] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-14T20:54:21.587477] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:21.588576] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-14T20:54:21.588635] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-14T20:54:21.588766] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-14T20:54:21.588807] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-14T20:54:21.588847] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-14T20:54:21.588879] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-14T20:54:21.949884] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:22.326607] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-14T20:54:22.358063] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-14T20:54:22.481877] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T20:54:23.158111] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-14T20:54:23.234934] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T20:54:23.958069] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-14T20:54:24.416107] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T20:54:24.758029] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-14T20:54:25.159157] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T20:54:25.558069] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-14T20:54:26.021826] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T20:54:26.358054] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-14T20:54:26.626402] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T20:54:26.763877] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T20:54:27.158070] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-14T20:54:27.958090] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-14T20:54:28.585372] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T20:54:28.758053] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-14T20:54:29.558108] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-14T20:54:29.640712] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T20:54:29.971760] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T20:54:30.348731] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T20:54:30.358045] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-14T20:54:31.050513] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T20:54:31.158084] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-14T20:54:31.958108] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-14T20:54:32.758068] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-14T20:54:32.857697] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T20:54:33.093222] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T20:54:33.262882] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T20:54:33.558093] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-14T20:54:34.221267] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T20:54:34.358093] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-14T20:54:35.111028] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T20:54:35.158091] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-14T20:54:35.958092] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-14T20:54:36.758075] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-14T20:54:36.972464] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T20:54:37.529433] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T20:54:37.557832] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T20:54:37.566237] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-14T20:54:38.358061] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-14T20:54:39.158038] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-14T20:54:39.366195] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-14T20:54:39.772179] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T20:54:39.958062] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-14T20:54:40.008120] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T20:54:40.758116] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-14T20:54:41.257383] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T20:54:41.557974] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T20:54:41.558037] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-14T20:54:41.564193] [INFO ] [REMOTE ] PFLT: Full fetch complete (63781 records). [2025-10-14T20:54:41.564282] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-14T20:54:41.565054] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:54:41.565137] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:54:41.565205] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:54:41.565279] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-14T20:54:41.565343] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-14T20:54:41.565380] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-14T20:54:41.565420] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-14T20:54:41.565477] [INFO ] [MAIN ] Update Progress: 1666/2369 symbols completed. PFLT took 37.9s. Estimated remaining: 1h 39m 0s. Rate: 7.1 symbols/min [2025-10-14T20:54:41.752399] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:41.752617] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-14T20:54:41.752706] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-14T20:54:41.752847] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-14T20:54:41.752903] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-14T20:54:41.752961] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-14T20:54:41.753014] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-14T20:54:42.119607] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:42.358039] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-14T20:54:42.750401] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T20:54:43.132404] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T20:54:43.158029] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-14T20:54:43.786100] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T20:54:43.787171] [INFO ] [REMOTE ] PFO: Full fetch complete (7880 records). [2025-10-14T20:54:43.787239] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-14T20:54:43.961678] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-14T20:54:44.179028] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-14T20:54:44.179127] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-14T20:54:44.179388] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-14T20:54:44.179448] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-14T20:54:44.179928] [DEBUG] [LOCAL ] PFO: Trimmed 7880 records to 6095 (keeping 200 days of data) [2025-10-14T20:54:44.215418] [DEBUG] [LOCAL ] PFO: Primary data saved (6095 records). [2025-10-14T20:54:44.215500] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-14T20:54:44.215573] [INFO ] [MAIN ] Update Progress: 1667/2369 symbols completed. PFO took 25.9s. Estimated remaining: 1h 38m 50s. Rate: 7.1 symbols/min [2025-10-14T20:54:44.384676] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:44.384886] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-14T20:54:44.384940] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-14T20:54:44.385053] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-14T20:54:44.385094] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-14T20:54:44.385134] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-14T20:54:44.385165] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-14T20:54:44.735367] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:44.758025] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-14T20:54:45.251937] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T20:54:45.558062] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-14T20:54:46.358083] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-14T20:54:46.664589] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T20:54:46.667861] [INFO ] [REMOTE ] PFN: Full fetch complete (31191 records). [2025-10-14T20:54:46.667949] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-14T20:54:47.065304] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-14T20:54:47.065455] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-14T20:54:47.066248] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-14T20:54:47.066326] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-14T20:54:47.067395] [DEBUG] [LOCAL ] PFN: Trimmed 31191 records to 22353 (keeping 200 days of data) [2025-10-14T20:54:47.175574] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-14T20:54:47.178532] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-14T20:54:47.235947] [DEBUG] [LOCAL ] PFN: Primary data saved (22353 records). [2025-10-14T20:54:47.236079] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-14T20:54:47.236157] [INFO ] [MAIN ] Update Progress: 1668/2369 symbols completed. PFN took 33.1s. Estimated remaining: 1h 38m 39s. Rate: 7.1 symbols/min [2025-10-14T20:54:47.408438] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:54:47.415441] [DEBUG] [LOCAL ] PGP: Loaded 5713 existing records from primary storage. [2025-10-14T20:54:47.415666] [INFO ] [MAIN ] PGP: Loaded 5713 existing records. [2025-10-14T20:54:47.607292] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:54:47.607568] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-14T20:54:47.607638] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-14T20:54:47.607948] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-14T20:54:47.608005] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-14T20:54:47.870554] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T20:54:47.963198] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-14T20:54:48.016136] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:54:48.353064] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T20:54:48.758064] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-14T20:54:49.465855] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T20:54:49.558088] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-14T20:54:50.145550] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-14T20:54:50.262622] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T20:54:50.358095] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-14T20:54:51.158110] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-14T20:54:51.958099] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-14T20:54:52.367460] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-14T20:54:52.711694] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T20:54:52.758056] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-14T20:54:52.874823] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T20:54:53.433603] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T20:54:53.558129] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-14T20:54:54.358188] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-14T20:54:55.029333] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T20:54:55.158108] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-14T20:54:55.839352] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T20:54:55.958107] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-14T20:54:56.567961] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-14T20:54:56.626744] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T20:54:56.758092] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-14T20:54:57.557670] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T20:54:57.559534] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-14T20:54:58.358081] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-14T20:54:58.838274] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T20:54:59.023561] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T20:54:59.158053] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-14T20:54:59.823253] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T20:54:59.958078] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-14T20:55:00.658882] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T20:55:00.758116] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-14T20:55:01.339193] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T20:55:01.343746] [INFO ] [REMOTE ] PFS: Full fetch complete (51640 records). [2025-10-14T20:55:01.343845] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-14T20:55:01.344475] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:55:01.344562] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:55:01.344605] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:55:01.344699] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-14T20:55:01.344783] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-14T20:55:01.344838] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-14T20:55:01.344907] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-14T20:55:01.345004] [INFO ] [MAIN ] Update Progress: 1669/2369 symbols completed. PFS took 39.9s. Estimated remaining: 1h 38m 33s. Rate: 7.1 symbols/min [2025-10-14T20:55:01.568140] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-14T20:55:01.573343] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:01.574341] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-14T20:55:01.574399] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-14T20:55:01.574517] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-14T20:55:01.574559] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-14T20:55:01.574601] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-14T20:55:01.574634] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-14T20:55:01.956469] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:02.358112] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-14T20:55:03.158130] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-14T20:55:03.958094] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-14T20:55:04.659040] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (3.09 seconds). [2025-10-14T20:55:04.758303] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-14T20:55:04.758506] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-14T20:55:05.492485] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-14T20:55:05.536722] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T20:55:05.558057] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-14T20:55:05.903583] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T20:55:06.300613] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T20:55:06.358031] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-14T20:55:07.158103] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-14T20:55:07.958110] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-14T20:55:08.758081] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-14T20:55:08.803020] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-14T20:55:08.882327] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T20:55:09.145502] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T20:55:09.433058] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:55:09.434997] [INFO ] [REMOTE ] PGP: Full fetch complete (7895 records). [2025-10-14T20:55:09.435065] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-14T20:55:09.563272] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-14T20:55:09.797070] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-14T20:55:09.797148] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-14T20:55:09.797367] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-14T20:55:09.797407] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-14T20:55:09.797858] [DEBUG] [LOCAL ] PGP: Trimmed 7895 records to 5720 (keeping 200 days of data) [2025-10-14T20:55:09.832306] [DEBUG] [LOCAL ] PGP: Primary data saved (5720 records). [2025-10-14T20:55:09.832456] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-14T20:55:09.832550] [INFO ] [MAIN ] Update Progress: 1670/2369 symbols completed. PGP took 22.6s. Estimated remaining: 1h 38m 24s. Rate: 7.1 symbols/min [2025-10-14T20:55:09.998322] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:10.036752] [DEBUG] [LOCAL ] PGRE: Loaded 46921 existing records from primary storage. [2025-10-14T20:55:10.037070] [INFO ] [MAIN ] PGRE: Loaded 46921 existing records. [2025-10-14T20:55:10.214260] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:55:10.214483] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-14T20:55:10.214529] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-14T20:55:10.215484] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-14T20:55:10.215545] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-14T20:55:10.365514] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-14T20:55:10.594957] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:10.959578] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T20:55:11.158054] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-14T20:55:11.958045] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-14T20:55:12.380955] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-14T20:55:12.758267] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-14T20:55:12.760353] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T20:55:13.558068] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-14T20:55:13.891944] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T20:55:14.358052] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-14T20:55:14.819026] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T20:55:15.016800] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T20:55:15.158082] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-14T20:55:15.756125] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:55:15.958053] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-14T20:55:16.758067] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-14T20:55:17.330246] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T20:55:17.459587] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-14T20:55:17.558037] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-14T20:55:18.358067] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-14T20:55:18.846834] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-14T20:55:19.158061] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-14T20:55:19.488107] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T20:55:19.528854] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T20:55:19.958051] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-14T20:55:20.758089] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-14T20:55:21.218133] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T20:55:21.406561] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T20:55:21.558058] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-14T20:55:22.358087] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-14T20:55:22.402453] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T20:55:23.049200] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:55:23.052790] [INFO ] [REMOTE ] PFSI: Full fetch complete (41240 records). [2025-10-14T20:55:23.052880] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-14T20:55:23.053385] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:55:23.053468] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:55:23.053509] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:55:23.053546] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-14T20:55:23.053611] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-14T20:55:23.053706] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-14T20:55:23.053774] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-14T20:55:23.053844] [INFO ] [MAIN ] Update Progress: 1671/2369 symbols completed. PFSI took 41.5s. Estimated remaining: 1h 38m 18s. Rate: 7.1 symbols/min [2025-10-14T20:55:23.158957] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-14T20:55:23.233577] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:23.244055] [DEBUG] [LOCAL ] PGZ: Loaded 5497 existing records from primary storage. [2025-10-14T20:55:23.244310] [INFO ] [MAIN ] PGZ: Loaded 5497 existing records. [2025-10-14T20:55:23.424693] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:55:23.424951] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-14T20:55:23.425101] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-14T20:55:23.425718] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-14T20:55:23.425782] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-14T20:55:23.547943] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-14T20:55:23.850834] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:23.958046] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-14T20:55:23.992140] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T20:55:24.758089] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-14T20:55:25.558095] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-14T20:55:25.679794] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T20:55:26.173982] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-14T20:55:26.358082] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-14T20:55:27.026955] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T20:55:27.159275] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T20:55:27.158457] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-14T20:55:27.729636] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T20:55:27.734983] [INFO ] [REMOTE ] PG: Full fetch complete (77537 records). [2025-10-14T20:55:27.735095] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-14T20:55:27.735738] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:55:27.735822] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:55:27.735863] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:55:27.735900] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-14T20:55:27.735953] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-14T20:55:27.735987] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-14T20:55:27.736025] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-14T20:55:27.736081] [INFO ] [MAIN ] Update Progress: 1672/2369 symbols completed. PG took 43.5s. Estimated remaining: 1h 38m 8s. Rate: 7.1 symbols/min [2025-10-14T20:55:27.904145] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:27.904331] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-14T20:55:27.904369] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-14T20:55:27.904478] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-14T20:55:27.904517] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-14T20:55:27.904557] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-14T20:55:27.904589] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-14T20:55:27.964995] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-14T20:55:28.259792] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:28.758096] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-14T20:55:29.558070] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-14T20:55:29.791743] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T20:55:30.358140] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-14T20:55:30.871282] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-14T20:55:31.138816] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T20:55:31.158032] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-14T20:55:31.958059] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-14T20:55:32.195620] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T20:55:32.456979] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-14T20:55:32.758068] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-14T20:55:33.558048] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-14T20:55:33.778142] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T20:55:33.897083] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T20:55:34.358147] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-14T20:55:35.158085] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-14T20:55:35.402123] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T20:55:35.844050] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T20:55:35.966530] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-14T20:55:35.969848] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T20:55:36.758078] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-14T20:55:36.813227] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T20:55:36.820315] [INFO ] [REMOTE ] PGR: Full fetch complete (76280 records). [2025-10-14T20:55:36.820583] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-14T20:55:36.821581] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:55:36.821735] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:55:36.821815] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:55:36.821900] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-14T20:55:36.821979] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-14T20:55:36.822020] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-14T20:55:36.822063] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-14T20:55:36.822133] [INFO ] [MAIN ] Update Progress: 1673/2369 symbols completed. PGR took 35.5s. Estimated remaining: 1h 37m 60s. Rate: 7.1 symbols/min [2025-10-14T20:55:37.030486] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:37.030765] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-14T20:55:37.030831] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-14T20:55:37.030980] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-14T20:55:37.031039] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-14T20:55:37.031102] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-14T20:55:37.031152] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-14T20:55:37.465626] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:37.475520] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T20:55:37.558112] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-14T20:55:38.358071] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-14T20:55:38.990731] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-14T20:55:39.147213] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T20:55:39.158024] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-14T20:55:39.958066] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-14T20:55:40.758036] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-14T20:55:40.790751] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T20:55:41.558065] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-14T20:55:41.689878] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T20:55:42.298963] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T20:55:42.358062] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-14T20:55:42.844536] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T20:55:43.158067] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-14T20:55:43.958104] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-14T20:55:44.239059] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T20:55:44.758076] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-14T20:55:44.809454] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T20:55:44.840809] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T20:55:45.558054] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-14T20:55:46.300439] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T20:55:46.358065] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-14T20:55:46.508903] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:55:47.158072] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-14T20:55:47.892662] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T20:55:47.958029] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-14T20:55:48.118709] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T20:55:48.686450] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:55:48.687528] [INFO ] [REMOTE ] PGZ: Full fetch complete (8730 records). [2025-10-14T20:55:48.687664] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-14T20:55:48.763258] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-14T20:55:49.049919] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-14T20:55:49.049996] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-14T20:55:49.050240] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-14T20:55:49.050280] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-14T20:55:49.050740] [DEBUG] [LOCAL ] PGZ: Trimmed 8730 records to 5516 (keeping 200 days of data) [2025-10-14T20:55:49.082963] [DEBUG] [LOCAL ] PGZ: Primary data saved (5516 records). [2025-10-14T20:55:49.083048] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-14T20:55:49.083120] [INFO ] [MAIN ] Update Progress: 1674/2369 symbols completed. PGZ took 26.0s. Estimated remaining: 1h 37m 53s. Rate: 7.1 symbols/min [2025-10-14T20:55:49.251518] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:49.266257] [DEBUG] [LOCAL ] PHI: Loaded 15150 existing records from primary storage. [2025-10-14T20:55:49.266483] [INFO ] [MAIN ] PHI: Loaded 15150 existing records. [2025-10-14T20:55:49.446209] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:55:49.446457] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-14T20:55:49.446505] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-14T20:55:49.446891] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-14T20:55:49.446948] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-14T20:55:49.563213] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-14T20:55:49.804675] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:50.358075] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-14T20:55:50.530592] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T20:55:50.810788] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T20:55:51.158043] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-14T20:55:51.958050] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-14T20:55:52.144751] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T20:55:52.710823] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T20:55:52.758040] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-14T20:55:52.936690] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T20:55:53.558092] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-14T20:55:54.368360] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-14T20:55:54.370567] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T20:55:54.959970] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T20:55:55.158131] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-14T20:55:55.291386] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T20:55:55.958107] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-14T20:55:56.533454] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T20:55:56.539604] [INFO ] [REMOTE ] PGRE: Full fetch complete (64361 records). [2025-10-14T20:55:56.539756] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-14T20:55:56.769800] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-14T20:55:56.898797] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T20:55:56.982800] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-14T20:55:56.982886] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-14T20:55:56.983949] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-14T20:55:56.984009] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-14T20:55:56.985404] [DEBUG] [LOCAL ] PGRE: Trimmed 64361 records to 46956 (keeping 200 days of data) [2025-10-14T20:55:57.239170] [DEBUG] [LOCAL ] PGRE: Primary data saved (46956 records). [2025-10-14T20:55:57.239297] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-14T20:55:57.239373] [INFO ] [MAIN ] Update Progress: 1675/2369 symbols completed. PGRE took 47.4s. Estimated remaining: 1h 37m 44s. Rate: 7.1 symbols/min [2025-10-14T20:55:57.405440] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:55:57.405626] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-14T20:55:57.405697] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-14T20:55:57.405811] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-14T20:55:57.405852] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-14T20:55:57.405894] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-14T20:55:57.405927] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-14T20:55:57.562661] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-14T20:55:57.779724] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T20:55:57.783957] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:55:58.358102] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-14T20:55:58.594375] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T20:55:59.158096] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-14T20:55:59.947826] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T20:55:59.958029] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-14T20:56:00.000107] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T20:56:00.758042] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-14T20:56:01.504350] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T20:56:01.558054] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-14T20:56:02.358085] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-14T20:56:02.621560] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T20:56:02.982689] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T20:56:03.102047] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T20:56:03.106082] [INFO ] [REMOTE ] PH: Full fetch complete (55558 records). [2025-10-14T20:56:03.106245] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-14T20:56:03.107146] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:56:03.107250] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:56:03.107294] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:56:03.107338] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-14T20:56:03.107403] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-14T20:56:03.107440] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-14T20:56:03.107485] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-14T20:56:03.107577] [INFO ] [MAIN ] Update Progress: 1676/2369 symbols completed. PH took 35.4s. Estimated remaining: 1h 37m 35s. Rate: 7.1 symbols/min [2025-10-14T20:56:03.163291] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-14T20:56:03.348567] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:03.374914] [DEBUG] [LOCAL ] PHK: Loaded 26688 existing records from primary storage. [2025-10-14T20:56:03.375191] [INFO ] [MAIN ] PHK: Loaded 26688 existing records. [2025-10-14T20:56:03.556032] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:56:03.556234] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-14T20:56:03.556302] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-14T20:56:03.556827] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-14T20:56:03.556883] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-14T20:56:03.906829] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:03.958026] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-14T20:56:04.758054] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-14T20:56:04.931768] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T20:56:05.558054] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-14T20:56:05.652867] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T20:56:05.667123] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T20:56:06.358076] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-14T20:56:07.158086] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-14T20:56:07.318295] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T20:56:07.958078] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-14T20:56:08.095846] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T20:56:08.555682] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T20:56:08.758057] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-14T20:56:09.558222] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-14T20:56:09.558967] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T20:56:10.358046] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-14T20:56:10.523205] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T20:56:10.779758] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T20:56:11.158018] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-14T20:56:11.536870] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T20:56:11.838594] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T20:56:11.843049] [INFO ] [REMOTE ] PHG: Full fetch complete (65301 records). [2025-10-14T20:56:11.843191] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-14T20:56:11.843866] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:56:11.843954] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:56:11.843996] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:56:11.844034] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-14T20:56:11.844092] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-14T20:56:11.844136] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-14T20:56:11.844184] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-14T20:56:11.844248] [INFO ] [MAIN ] Update Progress: 1677/2369 symbols completed. PHG took 35.0s. Estimated remaining: 1h 37m 26s. Rate: 7.1 symbols/min [2025-10-14T20:56:11.958040] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-14T20:56:12.621861] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T20:56:12.758046] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-14T20:56:13.558097] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-14T20:56:13.770412] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T20:56:14.358069] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-14T20:56:14.811313] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T20:56:15.158050] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-14T20:56:15.436022] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T20:56:15.958046] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-14T20:56:16.475739] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T20:56:16.758093] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-14T20:56:17.159130] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T20:56:17.558066] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-14T20:56:18.124478] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T20:56:18.358051] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-14T20:56:18.549130] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T20:56:18.551409] [INFO ] [REMOTE ] PHI: Full fetch complete (20973 records). [2025-10-14T20:56:18.551589] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-14T20:56:18.919536] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-14T20:56:18.919620] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-14T20:56:18.920145] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-14T20:56:18.920206] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-14T20:56:18.920982] [DEBUG] [LOCAL ] PHI: Trimmed 20973 records to 15149 (keeping 200 days of data) [2025-10-14T20:56:19.013159] [DEBUG] [LOCAL ] PHI: Primary data saved (15149 records). [2025-10-14T20:56:19.013298] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-14T20:56:19.013376] [INFO ] [MAIN ] Update Progress: 1678/2369 symbols completed. PHI took 29.9s. Estimated remaining: 1h 37m 17s. Rate: 7.1 symbols/min [2025-10-14T20:56:19.158068] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-14T20:56:19.757330] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T20:56:19.958038] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-14T20:56:20.384747] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T20:56:20.758097] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-14T20:56:21.015380] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T20:56:21.558108] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-14T20:56:22.143241] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T20:56:22.358047] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-14T20:56:22.398179] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T20:56:23.158094] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-14T20:56:23.629632] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T20:56:23.655431] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:56:23.658674] [INFO ] [REMOTE ] PHIN: Full fetch complete (47347 records). [2025-10-14T20:56:23.658784] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-14T20:56:23.659305] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:56:23.659401] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:56:23.659479] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:56:23.659612] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-14T20:56:23.659715] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-14T20:56:23.659761] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-14T20:56:23.659802] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-14T20:56:23.659858] [INFO ] [MAIN ] Update Progress: 1679/2369 symbols completed. PHIN took 26.4s. Estimated remaining: 1h 37m 7s. Rate: 7.1 symbols/min [2025-10-14T20:56:23.958081] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-14T20:56:25.212941] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T20:56:25.218975] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-14T20:56:26.646927] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T20:56:26.653226] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-14T20:56:27.878546] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T20:56:27.882311] [INFO ] [REMOTE ] PHK: Full fetch complete (39410 records). [2025-10-14T20:56:27.882400] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-14T20:56:28.290094] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-14T20:56:28.290185] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-14T20:56:28.291030] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-14T20:56:28.291130] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-14T20:56:28.292143] [DEBUG] [LOCAL ] PHK: Trimmed 39410 records to 26724 (keeping 200 days of data) [2025-10-14T20:56:28.444909] [DEBUG] [LOCAL ] PHK: Primary data saved (26724 records). [2025-10-14T20:56:28.445043] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-14T20:56:28.445122] [INFO ] [MAIN ] Update Progress: 1680/2369 symbols completed. PHK took 25.3s. Estimated remaining: 1h 36m 57s. Rate: 7.1 symbols/min [2025-10-14T20:56:29.091371] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:29.193103] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:29.197437] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:29.214381] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-14T20:56:29.214547] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-14T20:56:29.220150] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:29.220288] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-14T20:56:29.218342] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-14T20:56:29.220804] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-14T20:56:29.220976] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-14T20:56:29.221328] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-14T20:56:29.221400] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-14T20:56:29.222033] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-14T20:56:29.221628] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-14T20:56:29.221865] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-14T20:56:29.225268] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-14T20:56:29.225452] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-14T20:56:29.225938] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-14T20:56:29.247639] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-14T20:56:29.225702] [DEBUG] [LOCAL ] PIM: Loaded 4811 existing records from primary storage. [2025-10-14T20:56:29.262499] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-14T20:56:29.262189] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-14T20:56:29.308468] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-14T20:56:29.273324] [INFO ] [MAIN ] PIM: Loaded 4811 existing records. [2025-10-14T20:56:30.069086] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:56:30.146062] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-14T20:56:30.164140] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-14T20:56:30.202600] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-14T20:56:30.207924] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-14T20:56:30.432335] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:30.525024] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-14T20:56:30.615983] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:30.719285] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-14T20:56:30.729580] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:30.729978] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-14T20:56:30.960771] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:30.961063] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-14T20:56:31.652931] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T20:56:31.654683] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-14T20:56:32.160443] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T20:56:32.167767] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-14T20:56:32.278984] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T20:56:32.289378] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-14T20:56:32.296501] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T20:56:32.297972] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-14T20:56:32.343543] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T20:56:32.758030] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-14T20:56:32.964222] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T20:56:33.370105] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T20:56:33.558090] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-14T20:56:34.179705] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T20:56:34.200269] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T20:56:34.358054] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-14T20:56:34.463289] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T20:56:35.158109] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-14T20:56:35.662752] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-14T20:56:35.958090] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-14T20:56:36.103923] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T20:56:36.387197] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T20:56:36.758077] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-14T20:56:37.558111] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-14T20:56:38.358060] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-14T20:56:38.709762] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T20:56:38.884844] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-14T20:56:38.885947] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T20:56:39.158092] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-14T20:56:39.958055] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-14T20:56:40.716954] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T20:56:40.758039] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-14T20:56:41.464310] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T20:56:41.558061] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-14T20:56:41.965501] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T20:56:42.358124] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-14T20:56:43.158047] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-14T20:56:43.238592] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T20:56:43.439543] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T20:56:43.920598] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T20:56:43.958080] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-14T20:56:44.758079] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-14T20:56:45.558057] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-14T20:56:45.874662] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T20:56:46.245667] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T20:56:46.358037] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-14T20:56:46.579502] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T20:56:47.158113] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-14T20:56:47.271372] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T20:56:47.958069] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-14T20:56:48.455928] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:56:48.456922] [INFO ] [REMOTE ] PIM: Full fetch complete (6459 records). [2025-10-14T20:56:48.456991] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-14T20:56:48.763232] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-14T20:56:48.819579] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-14T20:56:48.819696] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-14T20:56:48.819910] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-14T20:56:48.819951] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-14T20:56:48.820354] [DEBUG] [LOCAL ] PIM: Trimmed 6459 records to 4836 (keeping 200 days of data) [2025-10-14T20:56:48.849111] [DEBUG] [LOCAL ] PIM: Primary data saved (4836 records). [2025-10-14T20:56:48.849242] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-14T20:56:48.849326] [INFO ] [MAIN ] Update Progress: 1681/2369 symbols completed. PIM took 20.4s. Estimated remaining: 1h 36m 54s. Rate: 7.1 symbols/min [2025-10-14T20:56:49.021557] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:49.037273] [DEBUG] [LOCAL ] PINE: Loaded 14333 existing records from primary storage. [2025-10-14T20:56:49.037517] [INFO ] [MAIN ] PINE: Loaded 14333 existing records. [2025-10-14T20:56:49.221952] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:56:49.222299] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-14T20:56:49.222360] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-14T20:56:49.222809] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-14T20:56:49.222916] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-14T20:56:49.432399] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-14T20:56:49.563252] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-14T20:56:49.643973] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:50.259705] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T20:56:50.358089] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-14T20:56:51.163566] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-14T20:56:51.188330] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T20:56:51.212299] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T20:56:51.958101] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-14T20:56:52.581582] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T20:56:52.758092] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-14T20:56:53.558071] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-14T20:56:53.774838] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T20:56:54.319426] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T20:56:54.358104] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-14T20:56:54.603947] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T20:56:55.158124] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-14T20:56:55.958134] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-14T20:56:56.087721] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T20:56:56.758082] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-14T20:56:57.228380] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T20:56:57.475041] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T20:56:57.479548] [INFO ] [REMOTE ] PHR: Full fetch complete (52890 records). [2025-10-14T20:56:57.479678] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-14T20:56:57.480234] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:56:57.480316] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:56:57.480359] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:56:57.480400] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-14T20:56:57.480456] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-14T20:56:57.480491] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-14T20:56:57.480549] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-14T20:56:57.480604] [INFO ] [MAIN ] Update Progress: 1682/2369 symbols completed. PHR took 29.0s. Estimated remaining: 1h 36m 46s. Rate: 7.1 symbols/min [2025-10-14T20:56:57.558100] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-14T20:56:57.658689] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:56:57.659004] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-14T20:56:57.659075] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-14T20:56:57.659239] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-14T20:56:57.659330] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-14T20:56:57.659430] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-14T20:56:57.659585] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-14T20:56:58.044095] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:56:58.057485] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-14T20:56:58.358038] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-14T20:56:58.583125] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T20:56:59.158099] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-14T20:56:59.958100] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-14T20:57:00.239258] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T20:57:00.758097] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-14T20:57:01.159032] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T20:57:01.558083] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-14T20:57:02.027629] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T20:57:02.358085] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-14T20:57:02.505136] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-14T20:57:02.507699] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T20:57:03.158142] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-14T20:57:03.958101] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-14T20:57:04.268731] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T20:57:04.367849] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-14T20:57:04.758036] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-14T20:57:04.779525] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T20:57:05.558060] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-14T20:57:06.358051] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-14T20:57:06.461496] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T20:57:06.731826] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T20:57:06.736849] [INFO ] [REMOTE ] PII: Full fetch complete (70945 records). [2025-10-14T20:57:06.736986] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-14T20:57:06.737832] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:57:06.737920] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:57:06.737985] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:57:06.738025] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-14T20:57:06.738080] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-14T20:57:06.738113] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-14T20:57:06.738152] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-14T20:57:06.738206] [INFO ] [MAIN ] Update Progress: 1683/2369 symbols completed. PII took 38.3s. Estimated remaining: 1h 36m 37s. Rate: 7.1 symbols/min [2025-10-14T20:57:06.956249] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:57:06.956451] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-14T20:57:06.956541] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-14T20:57:06.957015] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-14T20:57:06.957085] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-14T20:57:06.957443] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-14T20:57:06.957496] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-14T20:57:06.959875] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-14T20:57:07.160173] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-14T20:57:07.351233] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:57:07.931028] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T20:57:07.936235] [INFO ] [REMOTE ] PHM: Full fetch complete (74729 records). [2025-10-14T20:57:07.936354] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-14T20:57:07.937024] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:57:07.937113] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:57:07.937155] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:57:07.937191] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-14T20:57:07.937245] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-14T20:57:07.937278] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-14T20:57:07.937317] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-14T20:57:07.937369] [INFO ] [MAIN ] Update Progress: 1684/2369 symbols completed. PHM took 39.5s. Estimated remaining: 1h 36m 26s. Rate: 7.1 symbols/min [2025-10-14T20:57:07.963324] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-14T20:57:08.116202] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:57:08.116386] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-14T20:57:08.116441] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-14T20:57:08.116558] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-14T20:57:08.116598] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-14T20:57:08.116638] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-14T20:57:08.116724] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-14T20:57:08.474260] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:57:08.758063] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-14T20:57:09.007118] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T20:57:09.558068] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-14T20:57:10.358059] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-14T20:57:10.646865] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T20:57:10.826840] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T20:57:11.158055] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-14T20:57:11.281962] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T20:57:11.958036] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-14T20:57:12.348576] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T20:57:12.758046] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-14T20:57:12.961208] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T20:57:13.558071] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-14T20:57:14.358069] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-14T20:57:14.816770] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T20:57:14.998108] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T20:57:15.158112] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-14T20:57:15.217035] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T20:57:15.958109] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-14T20:57:16.519945] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T20:57:16.758113] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-14T20:57:17.558063] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-14T20:57:17.860990] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T20:57:18.120011] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-14T20:57:18.358087] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-14T20:57:18.415828] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T20:57:19.158126] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-14T20:57:19.958060] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-14T20:57:20.446484] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T20:57:20.591830] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T20:57:20.606633] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T20:57:20.758035] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-14T20:57:21.558072] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-14T20:57:21.983248] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T20:57:22.358043] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-14T20:57:23.158051] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-14T20:57:23.281351] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T20:57:23.781220] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-14T20:57:23.958081] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-14T20:57:24.189051] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T20:57:24.758047] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-14T20:57:24.990920] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T20:57:25.558063] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-14T20:57:26.358040] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-14T20:57:26.761730] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T20:57:27.017322] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T20:57:27.163449] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-14T20:57:27.172613] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T20:57:27.958084] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-14T20:57:28.270707] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T20:57:28.758133] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-14T20:57:29.558049] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-14T20:57:29.925827] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T20:57:30.063998] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T20:57:30.358047] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-14T20:57:30.444231] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T20:57:30.446393] [INFO ] [REMOTE ] PINE: Full fetch complete (21148 records). [2025-10-14T20:57:30.446462] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-14T20:57:30.810575] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-14T20:57:30.810710] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-14T20:57:30.811389] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-14T20:57:30.811444] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-14T20:57:30.812163] [DEBUG] [LOCAL ] PINE: Trimmed 21148 records to 14382 (keeping 200 days of data) [2025-10-14T20:57:30.907447] [DEBUG] [LOCAL ] PINE: Primary data saved (14382 records). [2025-10-14T20:57:30.907616] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-14T20:57:30.907740] [INFO ] [MAIN ] Update Progress: 1685/2369 symbols completed. PINE took 42.1s. Estimated remaining: 1h 36m 23s. Rate: 7.1 symbols/min [2025-10-14T20:57:31.109772] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:57:31.109958] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-14T20:57:31.110020] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-14T20:57:31.110137] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-14T20:57:31.110179] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-14T20:57:31.110220] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-14T20:57:31.110252] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-14T20:57:31.163757] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-14T20:57:31.466028] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:57:31.655159] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T20:57:31.754278] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T20:57:31.958083] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-14T20:57:32.758105] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-14T20:57:33.485253] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T20:57:33.490622] [INFO ] [REMOTE ] PINS: Full fetch complete (77480 records). [2025-10-14T20:57:33.490763] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-14T20:57:33.491387] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:57:33.491507] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:57:33.491559] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:57:33.491599] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-14T20:57:33.491678] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-14T20:57:33.491731] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-14T20:57:33.491774] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-14T20:57:33.491828] [INFO ] [MAIN ] Update Progress: 1686/2369 symbols completed. PINS took 36.0s. Estimated remaining: 1h 36m 13s. Rate: 7.1 symbols/min [2025-10-14T20:57:33.566559] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-14T20:57:33.661070] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:57:33.675199] [DEBUG] [LOCAL ] PKE: Loaded 13869 existing records from primary storage. [2025-10-14T20:57:33.675404] [INFO ] [MAIN ] PKE: Loaded 13869 existing records. [2025-10-14T20:57:33.856530] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:57:33.857272] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-14T20:57:33.857359] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-14T20:57:33.857965] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-14T20:57:33.858025] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-14T20:57:34.169970] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-14T20:57:34.262724] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:57:34.316362] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T20:57:34.319062] [INFO ] [REMOTE ] PJT: Full fetch complete (32076 records). [2025-10-14T20:57:34.319135] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-14T20:57:34.319597] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:57:34.319697] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:57:34.319762] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:57:34.319830] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-14T20:57:34.319891] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-14T20:57:34.319925] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-14T20:57:34.319963] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-14T20:57:34.320014] [INFO ] [MAIN ] Update Progress: 1687/2369 symbols completed. PJT took 26.4s. Estimated remaining: 1h 36m 1s. Rate: 7.1 symbols/min [2025-10-14T20:57:34.363253] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-14T20:57:34.500119] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:57:34.500284] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-14T20:57:34.500364] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-14T20:57:34.500471] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-14T20:57:34.500512] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-14T20:57:34.500552] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-14T20:57:34.500601] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-14T20:57:34.846859] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:57:35.158102] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-14T20:57:35.640975] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-14T20:57:35.958112] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-14T20:57:36.758087] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-14T20:57:36.846359] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T20:57:36.995498] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-14T20:57:37.394702] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-14T20:57:37.558048] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-14T20:57:38.358117] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-14T20:57:38.571799] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T20:57:39.158071] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-14T20:57:39.958037] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-14T20:57:39.989392] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T20:57:40.147498] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T20:57:40.558516] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T20:57:40.758101] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-14T20:57:41.099725] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T20:57:41.101620] [INFO ] [REMOTE ] PIPR: Full fetch complete (20651 records). [2025-10-14T20:57:41.101719] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-14T20:57:41.102159] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:57:41.102245] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:57:41.102289] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:57:41.102373] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-14T20:57:41.102447] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-14T20:57:41.102484] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-14T20:57:41.102524] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-14T20:57:41.102726] [INFO ] [MAIN ] Update Progress: 1688/2369 symbols completed. PIPR took 34.4s. Estimated remaining: 1h 35m 52s. Rate: 7.1 symbols/min [2025-10-14T20:57:41.283381] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:57:41.283542] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-14T20:57:41.283582] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-14T20:57:41.283719] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-14T20:57:41.283768] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-14T20:57:41.283811] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-14T20:57:41.283845] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-14T20:57:41.563319] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-14T20:57:41.661700] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:57:42.358030] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-14T20:57:42.433219] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T20:57:43.158096] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-14T20:57:43.961933] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-14T20:57:43.965040] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T20:57:44.022312] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T20:57:44.758105] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-14T20:57:45.558061] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-14T20:57:45.833799] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T20:57:46.040938] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T20:57:46.358077] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-14T20:57:46.791496] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T20:57:47.158068] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-14T20:57:47.958093] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-14T20:57:48.022068] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T20:57:48.341421] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T20:57:48.758152] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-14T20:57:48.981031] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T20:57:49.558082] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-14T20:57:50.358109] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-14T20:57:50.999442] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-14T20:57:51.158083] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-14T20:57:51.311618] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T20:57:51.538403] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T20:57:51.958112] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-14T20:57:52.758107] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-14T20:57:53.052208] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T20:57:53.558061] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-14T20:57:53.856256] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T20:57:54.050620] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T20:57:54.358072] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-14T20:57:55.098116] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T20:57:55.158060] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-14T20:57:55.266022] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T20:57:55.958108] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-14T20:57:56.758127] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-14T20:57:57.062754] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T20:57:57.202063] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T20:57:57.558071] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-14T20:57:57.983162] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T20:57:58.358054] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-14T20:57:58.409857] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T20:57:59.158045] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-14T20:57:59.474329] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T20:57:59.958096] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-14T20:58:00.508178] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T20:58:00.758103] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-14T20:58:01.166193] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T20:58:01.558029] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-14T20:58:02.325044] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T20:58:02.341722] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T20:58:02.358014] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-14T20:58:03.158059] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-14T20:58:03.958056] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-14T20:58:04.181876] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T20:58:04.758095] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-14T20:58:04.990602] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T20:58:05.445985] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T20:58:05.449119] [INFO ] [REMOTE ] PKE: Full fetch complete (18113 records). [2025-10-14T20:58:05.449207] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-14T20:58:05.563370] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-14T20:58:05.836206] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-14T20:58:05.836293] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-14T20:58:05.836934] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-14T20:58:05.836997] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-14T20:58:05.837539] [DEBUG] [LOCAL ] PKE: Trimmed 18113 records to 14005 (keeping 200 days of data) [2025-10-14T20:58:05.928231] [DEBUG] [LOCAL ] PKE: Primary data saved (14005 records). [2025-10-14T20:58:05.928384] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-14T20:58:05.928469] [INFO ] [MAIN ] Update Progress: 1689/2369 symbols completed. PKE took 32.4s. Estimated remaining: 1h 35m 50s. Rate: 7.1 symbols/min [2025-10-14T20:58:06.103370] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:06.103568] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-14T20:58:06.103606] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-14T20:58:06.103742] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-14T20:58:06.103785] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-14T20:58:06.103826] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-14T20:58:06.103858] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-14T20:58:06.359708] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-14T20:58:06.461018] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:06.483374] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T20:58:06.890727] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T20:58:07.158093] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-14T20:58:07.501515] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T20:58:07.958126] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-14T20:58:08.593714] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T20:58:08.665424] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T20:58:08.758075] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-14T20:58:09.558073] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-14T20:58:10.054440] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:58:10.059872] [INFO ] [REMOTE ] PK: Full fetch complete (76190 records). [2025-10-14T20:58:10.059999] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-14T20:58:10.060704] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:10.060793] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:10.060838] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:10.060880] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-14T20:58:10.060938] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-14T20:58:10.060978] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-14T20:58:10.061020] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-14T20:58:10.061077] [INFO ] [MAIN ] Update Progress: 1690/2369 symbols completed. PK took 39.2s. Estimated remaining: 1h 35m 40s. Rate: 7.1 symbols/min [2025-10-14T20:58:10.207621] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T20:58:10.256957] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:10.257146] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-14T20:58:10.257185] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-14T20:58:10.257298] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-14T20:58:10.257341] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-14T20:58:10.257382] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-14T20:58:10.257415] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-14T20:58:10.359571] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-14T20:58:10.624186] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:11.158046] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-14T20:58:11.472073] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T20:58:11.958062] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-14T20:58:12.463229] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T20:58:12.467055] [INFO ] [REMOTE ] PKG: Full fetch complete (57376 records). [2025-10-14T20:58:12.467175] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-14T20:58:12.467918] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:12.468003] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:12.468054] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:12.468119] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-14T20:58:12.468182] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-14T20:58:12.468218] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-14T20:58:12.468305] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-14T20:58:12.468378] [INFO ] [MAIN ] Update Progress: 1691/2369 symbols completed. PKG took 38.1s. Estimated remaining: 1h 35m 29s. Rate: 7.1 symbols/min [2025-10-14T20:58:12.634624] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:12.634827] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-14T20:58:12.634867] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-14T20:58:12.634976] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-14T20:58:12.635015] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-14T20:58:12.635055] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-14T20:58:12.635086] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-14T20:58:12.763167] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-14T20:58:13.000639] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:13.508018] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-14T20:58:13.558090] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-14T20:58:14.040967] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T20:58:14.358080] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-14T20:58:15.158101] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-14T20:58:15.544414] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T20:58:15.963245] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-14T20:58:15.976416] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T20:58:16.321673] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T20:58:16.758098] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-14T20:58:17.424485] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:58:17.427306] [INFO ] [REMOTE ] PKST: Full fetch complete (28974 records). [2025-10-14T20:58:17.427612] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-14T20:58:17.428237] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:17.428327] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:17.428374] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:17.428449] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-14T20:58:17.428517] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-14T20:58:17.428553] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-14T20:58:17.428594] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-14T20:58:17.428673] [INFO ] [MAIN ] Update Progress: 1692/2369 symbols completed. PKST took 36.3s. Estimated remaining: 1h 35m 19s. Rate: 7.1 symbols/min [2025-10-14T20:58:17.563252] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-14T20:58:17.632310] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:17.632629] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-14T20:58:17.632727] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-14T20:58:17.632857] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-14T20:58:17.632910] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-14T20:58:17.633033] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-14T20:58:17.633101] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-14T20:58:17.994429] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:18.048879] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T20:58:18.358075] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-14T20:58:19.158071] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-14T20:58:19.584331] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T20:58:19.958099] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-14T20:58:20.505775] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-14T20:58:20.585769] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T20:58:20.758086] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-14T20:58:20.996626] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T20:58:21.558068] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-14T20:58:22.358075] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-14T20:58:22.966954] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-14T20:58:23.158063] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-14T20:58:23.342895] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T20:58:23.958103] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-14T20:58:24.164532] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T20:58:24.758097] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-14T20:58:25.039871] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T20:58:25.558104] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-14T20:58:25.951295] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T20:58:26.190983] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T20:58:26.358145] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-14T20:58:27.158119] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-14T20:58:27.604792] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T20:58:27.958162] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-14T20:58:28.189606] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T20:58:28.497280] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T20:58:28.758043] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-14T20:58:29.558110] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-14T20:58:30.245075] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-14T20:58:30.358614] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-14T20:58:30.755822] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T20:58:30.796502] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T20:58:31.158114] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-14T20:58:31.958051] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-14T20:58:32.758063] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-14T20:58:32.893380] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-14T20:58:33.266255] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-14T20:58:33.291315] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T20:58:33.558069] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-14T20:58:34.236214] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T20:58:34.358106] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-14T20:58:35.158044] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-14T20:58:35.486299] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T20:58:35.692891] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-14T20:58:35.958166] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-14T20:58:36.758094] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-14T20:58:37.139132] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T20:58:37.411625] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-14T20:58:37.558075] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-14T20:58:38.358063] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-14T20:58:38.801245] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T20:58:39.158067] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-14T20:58:39.454208] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T20:58:39.737398] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T20:58:39.958116] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-14T20:58:40.646906] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T20:58:40.650228] [INFO ] [REMOTE ] PKX: Full fetch complete (36319 records). [2025-10-14T20:58:40.650401] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-14T20:58:40.651312] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:40.651407] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:40.651452] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:40.651501] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-14T20:58:40.651569] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-14T20:58:40.651608] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-14T20:58:40.651679] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-14T20:58:40.651815] [INFO ] [MAIN ] Update Progress: 1693/2369 symbols completed. PKX took 34.7s. Estimated remaining: 1h 35m 17s. Rate: 7.1 symbols/min [2025-10-14T20:58:40.768034] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-14T20:58:40.856977] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:40.857240] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-14T20:58:40.857289] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-14T20:58:40.857423] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-14T20:58:40.857497] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-14T20:58:40.857604] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-14T20:58:40.857694] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-14T20:58:41.251545] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-14T20:58:41.366352] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:41.558105] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-14T20:58:41.595004] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T20:58:41.603790] [INFO ] [REMOTE ] PLD: Full fetch complete (77125 records). [2025-10-14T20:58:41.603997] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-14T20:58:41.605020] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:41.605144] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:41.605208] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:41.605272] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-14T20:58:41.605357] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-14T20:58:41.605415] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-14T20:58:41.605481] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-14T20:58:41.605577] [INFO ] [MAIN ] Update Progress: 1694/2369 symbols completed. PLD took 29.1s. Estimated remaining: 1h 35m 5s. Rate: 7.1 symbols/min [2025-10-14T20:58:41.834816] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:41.835004] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-14T20:58:41.835041] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-14T20:58:41.835182] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-14T20:58:41.835253] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-14T20:58:41.835316] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-14T20:58:41.835350] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-14T20:58:42.286332] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:42.358140] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-14T20:58:43.158083] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-14T20:58:43.197279] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T20:58:43.202824] [INFO ] [REMOTE ] PL: Full fetch complete (76701 records). [2025-10-14T20:58:43.202954] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-14T20:58:43.203598] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:43.203703] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:43.203748] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:43.203787] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-14T20:58:43.203843] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-14T20:58:43.203876] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-14T20:58:43.203913] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-14T20:58:43.203966] [INFO ] [MAIN ] Update Progress: 1695/2369 symbols completed. PL took 33.1s. Estimated remaining: 1h 34m 54s. Rate: 7.1 symbols/min [2025-10-14T20:58:43.387779] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:43.387965] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-14T20:58:43.388107] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-14T20:58:43.388226] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-14T20:58:43.388395] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-14T20:58:43.388466] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-14T20:58:43.388503] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-14T20:58:43.608473] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T20:58:43.795986] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:43.958048] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-14T20:58:44.515110] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T20:58:44.758064] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-14T20:58:45.067930] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T20:58:45.558126] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-14T20:58:46.358096] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-14T20:58:46.834740] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-14T20:58:47.158079] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-14T20:58:47.293357] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T20:58:47.464347] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T20:58:47.958106] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-14T20:58:48.758040] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-14T20:58:49.064675] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T20:58:49.098867] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T20:58:49.558067] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-14T20:58:50.051908] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T20:58:50.358088] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-14T20:58:50.550556] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T20:58:51.158064] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-14T20:58:51.710284] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T20:58:51.958060] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-14T20:58:52.626930] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T20:58:52.758038] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-14T20:58:53.558035] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-14T20:58:53.906354] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T20:58:54.358046] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-14T20:58:54.565372] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T20:58:54.990948] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T20:58:55.158072] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-14T20:58:55.958054] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-14T20:58:56.460222] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T20:58:56.586087] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-14T20:58:56.758050] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-14T20:58:56.914903] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T20:58:57.558030] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-14T20:58:57.954757] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T20:58:58.367231] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T20:58:58.366173] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-14T20:58:58.373036] [INFO ] [REMOTE ] PLNT: Full fetch complete (70292 records). [2025-10-14T20:58:58.373152] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-14T20:58:58.374036] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:58:58.374122] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:58:58.374164] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:58:58.374229] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-14T20:58:58.374289] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-14T20:58:58.374323] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-14T20:58:58.374360] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-14T20:58:58.374417] [INFO ] [MAIN ] Update Progress: 1696/2369 symbols completed. PLNT took 40.9s. Estimated remaining: 1h 34m 48s. Rate: 7.1 symbols/min [2025-10-14T20:58:58.559674] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:58:58.578798] [DEBUG] [LOCAL ] PML: Loaded 21647 existing records from primary storage. [2025-10-14T20:58:58.579031] [INFO ] [MAIN ] PML: Loaded 21647 existing records. [2025-10-14T20:58:58.763360] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:58:58.763571] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-14T20:58:58.763618] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-14T20:58:58.764101] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-14T20:58:58.764158] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-14T20:58:59.136779] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:58:59.158028] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-14T20:58:59.763123] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T20:58:59.958038] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-14T20:59:00.361949] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T20:59:00.758069] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-14T20:59:01.558039] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-14T20:59:01.883987] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T20:59:02.077137] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-14T20:59:02.358052] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-14T20:59:02.524836] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T20:59:03.158100] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-14T20:59:03.958091] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-14T20:59:04.503176] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-14T20:59:04.532157] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T20:59:04.758350] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-14T20:59:04.759096] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T20:59:05.558140] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-14T20:59:06.358048] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-14T20:59:06.630093] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T20:59:06.750071] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-14T20:59:07.158047] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-14T20:59:07.794681] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T20:59:07.958043] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-14T20:59:08.350432] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T20:59:08.696544] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T20:59:08.758041] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-14T20:59:09.558071] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-14T20:59:10.089562] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T20:59:10.358064] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-14T20:59:10.929266] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T20:59:11.158034] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-14T20:59:11.377571] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-14T20:59:11.958109] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-14T20:59:12.758069] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-14T20:59:13.041614] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T20:59:13.451923] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-14T20:59:13.558026] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-14T20:59:14.334552] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T20:59:14.358044] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-14T20:59:15.027391] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T20:59:15.031981] [INFO ] [REMOTE ] PLYM: Full fetch complete (47297 records). [2025-10-14T20:59:15.032081] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-14T20:59:15.032918] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:59:15.033024] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:59:15.033071] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:59:15.033148] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-14T20:59:15.033223] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-14T20:59:15.033259] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-14T20:59:15.033299] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-14T20:59:15.033452] [INFO ] [MAIN ] Update Progress: 1697/2369 symbols completed. PLYM took 33.4s. Estimated remaining: 1h 34m 43s. Rate: 7.1 symbols/min [2025-10-14T20:59:15.162419] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-14T20:59:15.217417] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:15.260913] [DEBUG] [LOCAL ] PMM: Loaded 10253 existing records from primary storage. [2025-10-14T20:59:15.263597] [INFO ] [MAIN ] PMM: Loaded 10253 existing records. [2025-10-14T20:59:15.263424] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T20:59:15.454074] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:59:15.454319] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-14T20:59:15.454380] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-14T20:59:15.454767] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-14T20:59:15.454827] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-14T20:59:15.820761] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:15.958061] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-14T20:59:16.417701] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T20:59:16.669222] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T20:59:16.758033] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-14T20:59:17.558083] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-14T20:59:17.804580] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T20:59:18.358060] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-14T20:59:18.563786] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T20:59:19.158064] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-14T20:59:19.270676] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T20:59:19.882781] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T20:59:19.958041] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-14T20:59:20.758112] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-14T20:59:21.059076] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T20:59:21.558057] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-14T20:59:21.696870] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T20:59:22.358065] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-14T20:59:22.530927] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T20:59:22.905135] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T20:59:22.907107] [INFO ] [REMOTE ] PLOW: Full fetch complete (28382 records). [2025-10-14T20:59:22.907180] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-14T20:59:22.907689] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:59:22.907790] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:59:22.907831] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:59:22.907868] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-14T20:59:22.907920] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-14T20:59:22.907956] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-14T20:59:22.907993] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-14T20:59:22.908046] [INFO ] [MAIN ] Update Progress: 1698/2369 symbols completed. PLOW took 42.3s. Estimated remaining: 1h 34m 34s. Rate: 7.1 symbols/min [2025-10-14T20:59:23.078856] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:23.089208] [DEBUG] [LOCAL ] PMO: Loaded 9938 existing records from primary storage. [2025-10-14T20:59:23.089409] [INFO ] [MAIN ] PMO: Loaded 9938 existing records. [2025-10-14T20:59:23.163160] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-14T20:59:23.271211] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:59:23.271518] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-14T20:59:23.271580] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-14T20:59:23.272013] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-14T20:59:23.272106] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-14T20:59:23.628824] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:23.919576] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:59:23.925483] [INFO ] [REMOTE ] PM: Full fetch complete (77440 records). [2025-10-14T20:59:23.925610] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-14T20:59:23.926351] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T20:59:23.926445] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T20:59:23.926490] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T20:59:23.926552] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-14T20:59:23.926636] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-14T20:59:23.926718] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-14T20:59:23.926765] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-14T20:59:23.926822] [INFO ] [MAIN ] Update Progress: 1699/2369 symbols completed. PM took 40.7s. Estimated remaining: 1h 34m 23s. Rate: 7.1 symbols/min [2025-10-14T20:59:23.963160] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-14T20:59:24.104072] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:24.104256] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-14T20:59:24.104293] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-14T20:59:24.104400] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-14T20:59:24.104440] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-14T20:59:24.104478] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-14T20:59:24.104508] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-14T20:59:24.449107] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:24.758051] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-14T20:59:25.016570] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T20:59:25.505835] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T20:59:25.558045] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-14T20:59:26.358063] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-14T20:59:26.624207] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T20:59:27.158097] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-14T20:59:27.193100] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T20:59:27.958109] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-14T20:59:28.051912] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T20:59:28.763596] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-14T20:59:28.764843] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T20:59:29.558088] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-14T20:59:30.354451] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T20:59:30.358026] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-14T20:59:30.426363] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T20:59:31.158111] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-14T20:59:31.198832] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T20:59:31.958164] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-14T20:59:32.516075] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T20:59:32.758096] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-14T20:59:32.828435] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T20:59:33.558093] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-14T20:59:33.820244] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T20:59:33.823293] [INFO ] [REMOTE ] PML: Full fetch complete (29678 records). [2025-10-14T20:59:33.823423] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-14T20:59:34.196546] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-14T20:59:34.196759] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-14T20:59:34.197579] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-14T20:59:34.197674] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-14T20:59:34.198525] [DEBUG] [LOCAL ] PML: Trimmed 29678 records to 21722 (keeping 200 days of data) [2025-10-14T20:59:34.290525] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T20:59:34.338071] [DEBUG] [LOCAL ] PML: Primary data saved (21722 records). [2025-10-14T20:59:34.338223] [INFO ] [MAIN ] PML: Full history saved. [2025-10-14T20:59:34.338305] [INFO ] [MAIN ] Update Progress: 1700/2369 symbols completed. PML took 36.0s. Estimated remaining: 1h 34m 15s. Rate: 7.1 symbols/min [2025-10-14T20:59:34.367490] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-14T20:59:34.507372] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:34.507588] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-14T20:59:34.507663] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-14T20:59:34.507779] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-14T20:59:34.507819] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-14T20:59:34.507859] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-14T20:59:34.507889] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-14T20:59:34.859264] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:35.158067] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-14T20:59:35.564372] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T20:59:35.920357] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T20:59:35.922201] [INFO ] [REMOTE ] PMM: Full fetch complete (17877 records). [2025-10-14T20:59:35.922273] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-14T20:59:35.963216] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-14T20:59:36.351122] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-14T20:59:36.351232] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-14T20:59:36.351741] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-14T20:59:36.351803] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-14T20:59:36.352351] [DEBUG] [LOCAL ] PMM: Trimmed 17877 records to 10205 (keeping 200 days of data) [2025-10-14T20:59:36.417452] [DEBUG] [LOCAL ] PMM: Primary data saved (10205 records). [2025-10-14T20:59:36.417619] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-14T20:59:36.417748] [INFO ] [MAIN ] Update Progress: 1701/2369 symbols completed. PMM took 21.4s. Estimated remaining: 1h 34m 4s. Rate: 7.1 symbols/min [2025-10-14T20:59:36.599022] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:36.599245] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-14T20:59:36.599288] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-14T20:59:36.599401] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-14T20:59:36.599440] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-14T20:59:36.599480] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-14T20:59:36.599511] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-14T20:59:36.758080] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-14T20:59:36.956114] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:37.558084] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-14T20:59:37.626799] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T20:59:37.655229] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T20:59:37.810016] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:59:37.810348] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-14T20:59:37.810438] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:59:37.810483] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-14T20:59:37.810515] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:59:37.810551] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-14T20:59:37.810609] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-14T20:59:37.810675] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-14T20:59:37.810740] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-14T20:59:37.810793] [INFO ] [MAIN ] Update Progress: 1702/2369 symbols completed. PMTV took 1.4s. Estimated remaining: 1h 33m 53s. Rate: 7.1 symbols/min [2025-10-14T20:59:37.976721] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:37.976881] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-14T20:59:37.976918] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-14T20:59:37.977027] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-14T20:59:37.977067] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-14T20:59:37.977106] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-14T20:59:37.977137] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-14T20:59:38.327051] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:38.358035] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-14T20:59:38.622534] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T20:59:38.622857] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-14T20:59:38.622944] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T20:59:38.622989] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-14T20:59:38.623047] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T20:59:38.623117] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-14T20:59:38.623185] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-14T20:59:38.623262] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-14T20:59:38.623346] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-14T20:59:38.623432] [INFO ] [MAIN ] Update Progress: 1703/2369 symbols completed. PMTW took 0.8s. Estimated remaining: 1h 33m 42s. Rate: 7.1 symbols/min [2025-10-14T20:59:38.801232] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:38.801388] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-14T20:59:38.801425] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-14T20:59:38.801563] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-14T20:59:38.801632] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-14T20:59:38.801730] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-14T20:59:38.801772] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-14T20:59:39.161007] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-14T20:59:39.164533] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:39.958066] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-14T20:59:39.969862] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T20:59:40.381034] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-14T20:59:40.758102] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-14T20:59:41.558064] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-14T20:59:42.366775] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-14T20:59:42.372345] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T20:59:42.389853] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T20:59:42.836297] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-14T20:59:43.158085] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-14T20:59:43.958083] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-14T20:59:44.758067] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-14T20:59:45.063532] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T20:59:45.098529] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T20:59:45.521979] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T20:59:45.558045] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-14T20:59:46.358104] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-14T20:59:47.158057] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-14T20:59:47.210401] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T20:59:47.253526] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T20:59:47.958149] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-14T20:59:48.695692] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T20:59:48.758107] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-14T20:59:48.891285] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T20:59:49.261953] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T20:59:49.263141] [INFO ] [REMOTE ] PMO: Full fetch complete (16441 records). [2025-10-14T20:59:49.263207] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-14T20:59:49.563201] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-14T20:59:49.624767] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-14T20:59:49.624852] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-14T20:59:49.625231] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-14T20:59:49.625268] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-14T20:59:49.626043] [DEBUG] [LOCAL ] PMO: Trimmed 16441 records to 9904 (keeping 200 days of data) [2025-10-14T20:59:49.689177] [DEBUG] [LOCAL ] PMO: Primary data saved (9904 records). [2025-10-14T20:59:49.689333] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-14T20:59:49.689414] [INFO ] [MAIN ] Update Progress: 1704/2369 symbols completed. PMO took 26.8s. Estimated remaining: 1h 33m 34s. Rate: 7.1 symbols/min [2025-10-14T20:59:49.868713] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T20:59:49.877226] [DEBUG] [LOCAL ] PNI: Loaded 6765 existing records from primary storage. [2025-10-14T20:59:49.877470] [INFO ] [MAIN ] PNI: Loaded 6765 existing records. [2025-10-14T20:59:50.099496] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T20:59:50.099809] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-14T20:59:50.099867] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-14T20:59:50.100132] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-14T20:59:50.100196] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-14T20:59:50.363481] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-14T20:59:50.540607] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T20:59:50.862636] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T20:59:51.158078] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-14T20:59:51.324775] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T20:59:51.958120] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-14T20:59:52.750602] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T20:59:52.758639] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-14T20:59:53.247819] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-14T20:59:53.558056] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-14T20:59:53.997842] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-14T20:59:54.358078] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-14T20:59:54.388068] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T20:59:55.158086] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-14T20:59:55.874533] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T20:59:55.958025] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-14T20:59:56.385798] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-14T20:59:56.448149] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T20:59:56.758063] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-14T20:59:57.469453] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T20:59:57.558045] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-14T20:59:58.358059] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-14T20:59:58.428940] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-14T20:59:59.158058] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-14T20:59:59.818270] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T20:59:59.958023] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-14T21:00:00.758063] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-14T21:00:01.129274] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-14T21:00:01.558083] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-14T21:00:01.583212] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T21:00:01.808413] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T21:00:01.948186] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-14T21:00:02.358093] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-14T21:00:03.158135] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-14T21:00:03.282164] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T21:00:03.958115] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-14T21:00:04.758088] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-14T21:00:04.896570] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T21:00:05.017842] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T21:00:05.558078] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-14T21:00:06.214791] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T21:00:06.358086] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-14T21:00:06.463156] [DEBUG] [REMOTE ] PNC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-14T21:00:06.463424] [WARN ] [REMOTE ] PNC: No data returned for month 2025-06 [2025-10-14T21:00:06.463514] [FATAL] [REMOTE ] PNC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:00:06.463588] [FATAL] [MAIN ] PNC: Failed to fetch primary data. [2025-10-14T21:00:06.463691] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:00:06.463762] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-14T21:00:06.463822] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-14T21:00:06.463855] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-14T21:00:06.463893] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-14T21:00:06.463936] [INFO ] [MAIN ] Update Progress: 1705/2369 symbols completed. PNC took 27.8s. Estimated remaining: 1h 33m 29s. Rate: 7.1 symbols/min [2025-10-14T21:00:06.634982] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:06.665844] [DEBUG] [LOCAL ] PNNT: Loaded 33433 existing records from primary storage. [2025-10-14T21:00:06.666127] [INFO ] [MAIN ] PNNT: Loaded 33433 existing records. [2025-10-14T21:00:06.849050] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:00:06.849306] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-14T21:00:06.849362] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-14T21:00:06.849989] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-14T21:00:06.850061] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-14T21:00:07.163265] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-14T21:00:07.228711] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:07.286718] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T21:00:07.958153] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-14T21:00:08.124601] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T21:00:08.478629] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-14T21:00:08.758061] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-14T21:00:09.258866] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T21:00:09.558058] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-14T21:00:10.358113] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-14T21:00:11.081632] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T21:00:11.086776] [INFO ] [REMOTE ] PMT: Full fetch complete (58413 records). [2025-10-14T21:00:11.086885] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-14T21:00:11.087448] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:00:11.087533] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:00:11.087618] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:00:11.087717] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-14T21:00:11.087788] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-14T21:00:11.087827] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-14T21:00:11.087867] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-14T21:00:11.087921] [INFO ] [MAIN ] Update Progress: 1706/2369 symbols completed. PMT took 47.2s. Estimated remaining: 1h 33m 19s. Rate: 7.1 symbols/min [2025-10-14T21:00:11.160339] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-14T21:00:11.221066] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T21:00:11.292760] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:11.292931] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-14T21:00:11.292968] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-14T21:00:11.293082] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-14T21:00:11.293124] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-14T21:00:11.293165] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-14T21:00:11.293197] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-14T21:00:11.667474] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:11.667764] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T21:00:11.958057] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-14T21:00:12.369236] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T21:00:12.369972] [INFO ] [REMOTE ] PMTU: Full fetch complete (1201 records). [2025-10-14T21:00:12.370041] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-14T21:00:12.545510] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-14T21:00:12.545701] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:00:12.545769] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:00:12.545836] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-14T21:00:12.545896] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-14T21:00:12.545931] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-14T21:00:12.545968] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-14T21:00:12.546021] [INFO ] [MAIN ] Update Progress: 1707/2369 symbols completed. PMTU took 38.2s. Estimated remaining: 1h 33m 8s. Rate: 7.1 symbols/min [2025-10-14T21:00:12.711775] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:12.711917] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-14T21:00:12.711953] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-14T21:00:12.712061] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-14T21:00:12.712101] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-14T21:00:12.712140] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-14T21:00:12.712170] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-14T21:00:12.765003] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-14T21:00:13.067381] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:13.558029] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-14T21:00:13.669053] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T21:00:14.358069] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-14T21:00:14.957236] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T21:00:14.958282] [INFO ] [REMOTE ] PNI: Full fetch complete (9680 records). [2025-10-14T21:00:14.958353] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-14T21:00:15.163194] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-14T21:00:15.369560] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-14T21:00:15.369676] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-14T21:00:15.369933] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-14T21:00:15.370004] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-14T21:00:15.370677] [DEBUG] [LOCAL ] PNI: Trimmed 9680 records to 6758 (keeping 200 days of data) [2025-10-14T21:00:15.425563] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T21:00:15.443599] [DEBUG] [LOCAL ] PNI: Primary data saved (6758 records). [2025-10-14T21:00:15.443705] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-14T21:00:15.443787] [INFO ] [MAIN ] Update Progress: 1708/2369 symbols completed. PNI took 25.8s. Estimated remaining: 1h 32m 57s. Rate: 7.1 symbols/min [2025-10-14T21:00:15.608820] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:15.608965] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-14T21:00:15.609007] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-14T21:00:15.609152] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-14T21:00:15.609199] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-14T21:00:15.609239] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-14T21:00:15.609270] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-14T21:00:15.958412] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-14T21:00:15.961998] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:16.758079] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-14T21:00:16.784371] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T21:00:17.558043] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-14T21:00:17.737146] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T21:00:18.358078] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-14T21:00:18.481891] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T21:00:18.969240] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T21:00:19.158041] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-14T21:00:19.958099] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-14T21:00:20.124203] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T21:00:20.642130] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T21:00:20.758042] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-14T21:00:21.380770] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T21:00:21.558078] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-14T21:00:22.318714] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T21:00:22.358057] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-14T21:00:23.158115] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-14T21:00:23.273875] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T21:00:23.958067] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-14T21:00:24.256385] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-14T21:00:24.432998] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T21:00:24.758083] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-14T21:00:25.446980] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T21:00:25.558075] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-14T21:00:26.358079] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-14T21:00:26.472596] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:00:26.911872] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T21:00:27.158168] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-14T21:00:27.868146] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T21:00:27.958041] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-14T21:00:28.758086] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-14T21:00:29.136910] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-14T21:00:29.558042] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-14T21:00:29.702872] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T21:00:29.943540] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T21:00:30.358087] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-14T21:00:31.158075] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-14T21:00:31.328380] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T21:00:31.958079] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-14T21:00:32.101891] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T21:00:32.629465] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T21:00:32.758035] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-14T21:00:33.519682] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T21:00:33.558024] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-14T21:00:34.358089] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-14T21:00:34.651463] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T21:00:34.867745] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T21:00:35.158065] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-14T21:00:35.958055] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-14T21:00:36.023713] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T21:00:36.584856] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T21:00:36.758069] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-14T21:00:37.558071] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-14T21:00:37.628215] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T21:00:38.358054] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-14T21:00:38.552187] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T21:00:38.765723] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T21:00:38.770168] [INFO ] [REMOTE ] PNNT: Full fetch complete (47943 records). [2025-10-14T21:00:38.770335] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-14T21:00:39.163203] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-14T21:00:39.258947] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-14T21:00:39.259063] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-14T21:00:39.260398] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-14T21:00:39.260477] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-14T21:00:39.261906] [DEBUG] [LOCAL ] PNNT: Trimmed 47943 records to 33436 (keeping 200 days of data) [2025-10-14T21:00:39.454302] [DEBUG] [LOCAL ] PNNT: Primary data saved (33436 records). [2025-10-14T21:00:39.454444] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-14T21:00:39.454553] [INFO ] [MAIN ] Update Progress: 1709/2369 symbols completed. PNNT took 33.0s. Estimated remaining: 1h 32m 55s. Rate: 7.1 symbols/min [2025-10-14T21:00:39.639869] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:39.640100] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-14T21:00:39.640208] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-14T21:00:39.640381] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-14T21:00:39.640498] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-14T21:00:39.640584] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-14T21:00:39.640635] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-14T21:00:39.963822] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-14T21:00:40.028829] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:40.030438] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T21:00:40.758079] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-14T21:00:40.924772] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T21:00:41.558056] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-14T21:00:42.023889] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-14T21:00:42.091172] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T21:00:42.358134] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-14T21:00:42.615975] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:00:43.158167] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-14T21:00:43.816210] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T21:00:43.821002] [INFO ] [REMOTE ] PNW: Full fetch complete (65755 records). [2025-10-14T21:00:43.821137] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-14T21:00:43.822039] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:00:43.822123] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:00:43.822192] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:00:43.822266] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-14T21:00:43.822332] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-14T21:00:43.822371] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-14T21:00:43.822413] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-14T21:00:43.822470] [INFO ] [MAIN ] Update Progress: 1710/2369 symbols completed. PNW took 31.3s. Estimated remaining: 1h 32m 45s. Rate: 7.1 symbols/min [2025-10-14T21:00:43.967442] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-14T21:00:43.999135] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:44.000022] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-14T21:00:44.000070] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-14T21:00:44.000178] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-14T21:00:44.000220] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-14T21:00:44.000261] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-14T21:00:44.000293] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-14T21:00:44.375564] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:44.415718] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T21:00:44.758062] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-14T21:00:45.558115] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-14T21:00:46.018786] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-14T21:00:46.358079] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-14T21:00:46.480205] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T21:00:46.685417] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T21:00:47.158046] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-14T21:00:47.968579] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T21:00:47.964572] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-14T21:00:48.758055] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-14T21:00:49.153074] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-14T21:00:49.558032] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-14T21:00:49.748344] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T21:00:49.824303] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-14T21:00:50.105925] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T21:00:50.110711] [INFO ] [REMOTE ] PNR: Full fetch complete (69048 records). [2025-10-14T21:00:50.110815] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-14T21:00:50.111389] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:00:50.111474] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:00:50.111515] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:00:50.111552] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-14T21:00:50.111605] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-14T21:00:50.111639] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-14T21:00:50.111730] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-14T21:00:50.111792] [INFO ] [MAIN ] Update Progress: 1711/2369 symbols completed. PNR took 39.0s. Estimated remaining: 1h 32m 36s. Rate: 7.1 symbols/min [2025-10-14T21:00:50.277761] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:50.277930] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-14T21:00:50.277968] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-14T21:00:50.278073] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-14T21:00:50.278112] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-14T21:00:50.278151] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-14T21:00:50.278181] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-14T21:00:50.363339] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-14T21:00:50.636875] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:51.158079] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-14T21:00:51.931773] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T21:00:51.958030] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-14T21:00:52.758043] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-14T21:00:53.018456] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T21:00:53.077595] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T21:00:53.558057] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-14T21:00:54.358049] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-14T21:00:54.543111] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T21:00:54.581367] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T21:00:55.158065] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-14T21:00:55.801120] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T21:00:55.805821] [INFO ] [REMOTE ] POR: Full fetch complete (68087 records). [2025-10-14T21:00:55.805942] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-14T21:00:55.806703] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:00:55.806788] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:00:55.806829] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:00:55.806896] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-14T21:00:55.806972] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-14T21:00:55.807017] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-14T21:00:55.807060] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-14T21:00:55.807121] [INFO ] [MAIN ] Update Progress: 1712/2369 symbols completed. POR took 40.4s. Estimated remaining: 1h 32m 26s. Rate: 7.1 symbols/min [2025-10-14T21:00:55.963686] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-14T21:00:55.981526] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:00:56.008812] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T21:00:56.029661] [DEBUG] [LOCAL ] PPT: Loaded 19957 existing records from primary storage. [2025-10-14T21:00:56.029898] [INFO ] [MAIN ] PPT: Loaded 19957 existing records. [2025-10-14T21:00:56.207565] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:00:56.207821] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-14T21:00:56.207879] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-14T21:00:56.208356] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-14T21:00:56.208413] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-14T21:00:56.552211] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:00:56.758070] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-14T21:00:57.558110] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-14T21:00:57.799767] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T21:00:57.924476] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T21:00:58.358077] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-14T21:00:59.158049] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-14T21:00:59.194182] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T21:00:59.958050] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-14T21:01:00.239309] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T21:01:00.283339] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T21:01:00.758064] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-14T21:01:01.558060] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-14T21:01:01.785520] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T21:01:01.969799] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-14T21:01:02.358094] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-14T21:01:03.163213] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-14T21:01:03.175357] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T21:01:03.627785] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T21:01:03.958068] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-14T21:01:04.758117] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-14T21:01:05.190378] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T21:01:05.558056] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-14T21:01:05.822361] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T21:01:05.894462] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T21:01:06.358058] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-14T21:01:06.938832] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T21:01:07.158038] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-14T21:01:07.506830] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T21:01:07.958108] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-14T21:01:08.758035] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-14T21:01:08.901008] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T21:01:09.100277] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T21:01:09.558061] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-14T21:01:10.358041] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-14T21:01:10.773189] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T21:01:11.158046] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-14T21:01:11.302749] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T21:01:11.407237] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T21:01:11.958087] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-14T21:01:12.758085] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-14T21:01:12.991412] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T21:01:13.455684] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T21:01:13.558044] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-14T21:01:13.958466] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T21:01:14.358123] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-14T21:01:15.158037] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-14T21:01:15.529467] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T21:01:15.869603] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T21:01:15.874422] [INFO ] [REMOTE ] POST: Full fetch complete (55206 records). [2025-10-14T21:01:15.874700] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-14T21:01:15.875718] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:01:15.875805] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:01:15.875849] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:01:15.875889] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-14T21:01:15.875950] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-14T21:01:15.875988] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-14T21:01:15.876026] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-14T21:01:15.876114] [INFO ] [MAIN ] Update Progress: 1713/2369 symbols completed. POST took 36.4s. Estimated remaining: 1h 32m 22s. Rate: 7.1 symbols/min [2025-10-14T21:01:15.962024] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-14T21:01:16.065274] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:16.065590] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-14T21:01:16.065698] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-14T21:01:16.065853] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-14T21:01:16.065917] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-14T21:01:16.066140] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-14T21:01:16.066192] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-14T21:01:16.200282] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T21:01:16.466844] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:01:16.758073] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-14T21:01:17.476757] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T21:01:17.558033] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-14T21:01:18.097037] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T21:01:18.261277] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T21:01:18.358063] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-14T21:01:19.046814] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T21:01:19.053022] [INFO ] [REMOTE ] PPG: Full fetch complete (73576 records). [2025-10-14T21:01:19.053194] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-14T21:01:19.054318] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:01:19.054421] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:01:19.054480] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:01:19.054526] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-14T21:01:19.054597] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-14T21:01:19.054718] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-14T21:01:19.054796] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-14T21:01:19.054882] [INFO ] [MAIN ] Update Progress: 1714/2369 symbols completed. PPG took 35.2s. Estimated remaining: 1h 32m 12s. Rate: 7.1 symbols/min [2025-10-14T21:01:19.165635] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-14T21:01:19.246409] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:19.246744] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-14T21:01:19.246796] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-14T21:01:19.246929] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-14T21:01:19.246971] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-14T21:01:19.247013] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-14T21:01:19.247046] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-14T21:01:19.622806] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:01:19.958060] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-14T21:01:20.237052] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T21:01:20.758089] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-14T21:01:21.558036] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-14T21:01:21.599446] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:01:21.647362] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T21:01:22.358068] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-14T21:01:23.158084] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-14T21:01:23.216194] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:01:23.284974] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T21:01:23.287200] [INFO ] [REMOTE ] PPT: Full fetch complete (28583 records). [2025-10-14T21:01:23.287275] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-14T21:01:23.650239] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-14T21:01:23.650311] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-14T21:01:23.650884] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-14T21:01:23.650944] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-14T21:01:23.651593] [DEBUG] [LOCAL ] PPT: Trimmed 28583 records to 19920 (keeping 200 days of data) [2025-10-14T21:01:23.766220] [DEBUG] [LOCAL ] PPT: Primary data saved (19920 records). [2025-10-14T21:01:23.766355] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-14T21:01:23.766430] [INFO ] [MAIN ] Update Progress: 1715/2369 symbols completed. PPT took 28.0s. Estimated remaining: 1h 32m 2s. Rate: 7.1 symbols/min [2025-10-14T21:01:23.936288] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:23.940706] [DEBUG] [LOCAL ] PRCS: Loaded 2774 existing records from primary storage. [2025-10-14T21:01:23.940866] [INFO ] [MAIN ] PRCS: Loaded 2774 existing records. [2025-10-14T21:01:23.963233] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-14T21:01:24.122967] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:01:24.123236] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-14T21:01:24.123290] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-14T21:01:24.123470] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-14T21:01:24.123528] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-14T21:01:24.467814] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:01:24.758064] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-14T21:01:25.150703] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T21:01:25.184528] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-14T21:01:25.292120] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-14T21:01:25.558071] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-14T21:01:26.358086] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-14T21:01:26.886424] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-14T21:01:27.158103] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-14T21:01:27.339236] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T21:01:27.958057] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-14T21:01:28.168145] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T21:01:28.758046] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-14T21:01:29.095976] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T21:01:29.342939] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T21:01:29.558041] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-14T21:01:30.358101] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-14T21:01:30.629450] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T21:01:31.158061] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-14T21:01:31.214718] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:01:31.220630] [INFO ] [REMOTE ] PPL: Full fetch complete (77191 records). [2025-10-14T21:01:31.220820] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-14T21:01:31.221579] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:01:31.221711] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:01:31.221775] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:01:31.221861] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-14T21:01:31.221949] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-14T21:01:31.222005] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-14T21:01:31.222080] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-14T21:01:31.222163] [INFO ] [MAIN ] Update Progress: 1716/2369 symbols completed. PPL took 41.1s. Estimated remaining: 1h 31m 53s. Rate: 7.1 symbols/min [2025-10-14T21:01:31.412914] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:31.413130] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-14T21:01:31.413193] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-14T21:01:31.413325] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-14T21:01:31.413401] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-14T21:01:31.413485] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-14T21:01:31.413554] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-14T21:01:31.817885] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:01:31.958082] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-14T21:01:32.533998] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T21:01:32.554462] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T21:01:32.758111] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-14T21:01:33.420079] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:01:33.558084] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-14T21:01:34.358126] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-14T21:01:35.158140] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-14T21:01:35.549867] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T21:01:35.793558] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T21:01:35.958161] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-14T21:01:36.509438] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T21:01:36.554742] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T21:01:36.758191] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-14T21:01:37.558064] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-14T21:01:38.358070] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-14T21:01:38.702740] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T21:01:38.783134] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T21:01:38.915480] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T21:01:39.158070] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-14T21:01:39.958134] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-14T21:01:40.758035] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-14T21:01:41.189148] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T21:01:41.558072] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-14T21:01:41.611767] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T21:01:42.203488] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T21:01:42.358050] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-14T21:01:43.158062] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-14T21:01:43.438312] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T21:01:43.511997] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T21:01:43.743914] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T21:01:43.958101] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-14T21:01:44.758079] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-14T21:01:45.558051] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-14T21:01:45.969298] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T21:01:46.194579] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T21:01:46.358059] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-14T21:01:46.591043] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T21:01:47.158066] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-14T21:01:47.939935] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T21:01:47.958029] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-14T21:01:48.538244] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T21:01:48.758047] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-14T21:01:48.933846] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T21:01:49.558058] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-14T21:01:50.194411] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T21:01:50.269453] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T21:01:50.274886] [INFO ] [REMOTE ] PR: Full fetch complete (77373 records). [2025-10-14T21:01:50.274995] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-14T21:01:50.275624] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:01:50.275730] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:01:50.275773] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:01:50.275866] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-14T21:01:50.275929] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-14T21:01:50.275964] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-14T21:01:50.276002] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-14T21:01:50.276055] [INFO ] [MAIN ] Update Progress: 1717/2369 symbols completed. PR took 34.4s. Estimated remaining: 1h 31m 49s. Rate: 7.1 symbols/min [2025-10-14T21:01:50.358038] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-14T21:01:50.973388] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T21:01:51.158063] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-14T21:01:51.958090] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-14T21:01:52.693606] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T21:01:52.720764] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T21:01:52.758067] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-14T21:01:53.558063] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-14T21:01:54.066741] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T21:01:54.067616] [INFO ] [REMOTE ] PRCS: Full fetch complete (3862 records). [2025-10-14T21:01:54.067713] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-14T21:01:54.364837] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-14T21:01:54.456940] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T21:01:54.484793] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-14T21:01:54.485071] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-14T21:01:54.485284] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-14T21:01:54.485326] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-14T21:01:54.485882] [DEBUG] [LOCAL ] PRCS: Trimmed 3862 records to 2770 (keeping 200 days of data) [2025-10-14T21:01:54.503067] [DEBUG] [LOCAL ] PRCS: Primary data saved (2770 records). [2025-10-14T21:01:54.503229] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-14T21:01:54.503328] [INFO ] [MAIN ] Update Progress: 1718/2369 symbols completed. PRCS took 30.7s. Estimated remaining: 1h 31m 39s. Rate: 7.1 symbols/min [2025-10-14T21:01:55.158103] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-14T21:01:55.912705] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T21:01:55.958027] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-14T21:01:55.989541] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T21:01:56.758060] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-14T21:01:57.229581] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T21:01:57.232061] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T21:01:57.244316] [INFO ] [REMOTE ] PRA: Full fetch complete (44408 records). [2025-10-14T21:01:57.244951] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-14T21:01:57.246286] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:01:57.246408] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:01:57.246454] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:01:57.246521] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-14T21:01:57.246586] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-14T21:01:57.246706] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-14T21:01:57.246769] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-14T21:01:57.246838] [INFO ] [MAIN ] Update Progress: 1719/2369 symbols completed. PRA took 38.2s. Estimated remaining: 1h 31m 28s. Rate: 7.1 symbols/min [2025-10-14T21:01:57.558097] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-14T21:01:58.400914] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:01:58.406966] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-14T21:01:59.000575] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T21:01:59.004083] [INFO ] [REMOTE ] PRG: Full fetch complete (44074 records). [2025-10-14T21:01:59.004194] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-14T21:01:59.004820] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:01:59.004919] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:01:59.004993] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:01:59.005090] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-14T21:01:59.005169] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-14T21:01:59.005207] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-14T21:01:59.005254] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-14T21:01:59.005309] [INFO ] [MAIN ] Update Progress: 1720/2369 symbols completed. PRG took 27.8s. Estimated remaining: 1h 31m 17s. Rate: 7.1 symbols/min [2025-10-14T21:01:59.639046] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:59.697109] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-14T21:01:59.697281] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-14T21:01:59.713740] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:59.733439] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-14T21:01:59.740561] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:59.759805] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:01:59.760081] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-14T21:01:59.760450] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-14T21:01:59.760233] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-14T21:01:59.761381] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-14T21:01:59.761502] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-14T21:01:59.761703] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-14T21:01:59.761150] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-14T21:01:59.762109] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-14T21:01:59.762012] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-14T21:01:59.775345] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-14T21:01:59.775491] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-14T21:01:59.818640] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-14T21:01:59.860894] [DEBUG] [LOCAL ] PRH: Loaded 4777 existing records from primary storage. [2025-10-14T21:01:59.871688] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-14T21:01:59.871586] [INFO ] [MAIN ] PRH: Loaded 4777 existing records. [2025-10-14T21:01:59.934703] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-14T21:02:00.014535] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-14T21:02:00.490625] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:02:00.544132] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-14T21:02:00.549678] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-14T21:02:00.621458] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-14T21:02:00.647931] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-14T21:02:01.045005] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:01.108888] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-14T21:02:01.159315] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:01.207237] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-14T21:02:01.290701] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:01.318797] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-14T21:02:01.469156] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:01.558081] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-14T21:02:02.354463] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T21:02:02.358016] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-14T21:02:02.467124] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T21:02:03.058323] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T21:02:03.060337] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T21:02:03.134976] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T21:02:03.158032] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-14T21:02:03.958104] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-14T21:02:04.758127] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-14T21:02:04.903446] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T21:02:05.169877] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T21:02:05.243671] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T21:02:05.558055] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-14T21:02:06.358052] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-14T21:02:06.642268] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T21:02:07.158079] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-14T21:02:07.818780] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T21:02:07.958050] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-14T21:02:08.312456] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T21:02:08.758164] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-14T21:02:09.558042] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-14T21:02:09.743408] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T21:02:09.969242] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T21:02:10.358062] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-14T21:02:11.158063] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-14T21:02:11.221426] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:02:11.487001] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T21:02:11.958065] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-14T21:02:12.758081] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-14T21:02:12.798844] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T21:02:13.070956] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T21:02:13.558062] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-14T21:02:14.282221] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T21:02:14.358095] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-14T21:02:15.158045] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-14T21:02:15.430594] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T21:02:15.958076] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-14T21:02:16.166792] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T21:02:16.208557] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T21:02:16.758085] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-14T21:02:17.314629] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T21:02:17.558079] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-14T21:02:17.837770] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T21:02:18.358119] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-14T21:02:19.069441] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T21:02:19.158064] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-14T21:02:19.372231] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T21:02:19.874401] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T21:02:19.876501] [INFO ] [REMOTE ] PRI: Full fetch complete (25400 records). [2025-10-14T21:02:19.876590] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-14T21:02:19.877087] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:02:19.877174] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:02:19.877217] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:02:19.877256] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-14T21:02:19.877310] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-14T21:02:19.877345] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-14T21:02:19.877384] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-14T21:02:19.877437] [INFO ] [MAIN ] Update Progress: 1721/2369 symbols completed. PRI took 20.9s. Estimated remaining: 1h 31m 13s. Rate: 7.1 symbols/min [2025-10-14T21:02:19.963263] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-14T21:02:20.050225] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:20.050392] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-14T21:02:20.050457] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-14T21:02:20.050597] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-14T21:02:20.050639] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-14T21:02:20.050728] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-14T21:02:20.050764] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-14T21:02:20.425447] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:20.758058] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-14T21:02:21.558181] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-14T21:02:21.737068] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T21:02:22.207033] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-14T21:02:22.358044] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-14T21:02:22.552195] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T21:02:22.952179] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T21:02:23.158081] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-14T21:02:23.944687] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-14T21:02:23.958040] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-14T21:02:24.633662] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T21:02:24.758098] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-14T21:02:25.418701] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T21:02:25.558092] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-14T21:02:26.358107] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-14T21:02:27.158102] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-14T21:02:27.270265] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T21:02:27.842222] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T21:02:27.958097] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-14T21:02:28.651436] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T21:02:28.656584] [INFO ] [REMOTE ] PRIM: Full fetch complete (63357 records). [2025-10-14T21:02:28.656807] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-14T21:02:28.657686] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:02:28.657850] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:02:28.657911] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:02:28.657964] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-14T21:02:28.658052] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-14T21:02:28.658118] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-14T21:02:28.658175] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-14T21:02:28.658252] [INFO ] [MAIN ] Update Progress: 1722/2369 symbols completed. PRIM took 29.6s. Estimated remaining: 1h 31m 5s. Rate: 7.1 symbols/min [2025-10-14T21:02:28.759405] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-14T21:02:28.935871] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:28.936448] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-14T21:02:28.936731] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-14T21:02:28.936986] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-14T21:02:28.937221] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-14T21:02:28.937451] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-14T21:02:28.937695] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-14T21:02:29.115057] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T21:02:29.430883] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T21:02:29.559421] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-14T21:02:29.559274] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:30.358110] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-14T21:02:30.950968] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T21:02:31.065627] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:02:31.158119] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-14T21:02:31.958091] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-14T21:02:32.401011] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T21:02:32.493698] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T21:02:32.494687] [INFO ] [REMOTE ] PRH: Full fetch complete (7496 records). [2025-10-14T21:02:32.494753] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-14T21:02:32.763195] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-14T21:02:32.872300] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-14T21:02:32.872379] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-14T21:02:32.872591] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-14T21:02:32.872630] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-14T21:02:32.873046] [DEBUG] [LOCAL ] PRH: Trimmed 7496 records to 4765 (keeping 200 days of data) [2025-10-14T21:02:32.902266] [DEBUG] [LOCAL ] PRH: Primary data saved (4765 records). [2025-10-14T21:02:32.902354] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-14T21:02:32.902428] [INFO ] [MAIN ] Update Progress: 1723/2369 symbols completed. PRH took 33.9s. Estimated remaining: 1h 30m 55s. Rate: 7.1 symbols/min [2025-10-14T21:02:33.078949] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:33.079184] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-14T21:02:33.079226] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-14T21:02:33.079352] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-14T21:02:33.079392] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-14T21:02:33.079431] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-14T21:02:33.079463] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-14T21:02:33.438119] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:33.558028] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-14T21:02:33.951038] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T21:02:34.358078] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-14T21:02:35.158063] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-14T21:02:35.195785] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T21:02:35.958036] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-14T21:02:35.994592] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:02:36.355485] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T21:02:36.758044] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-14T21:02:37.358498] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T21:02:37.558068] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-14T21:02:38.358115] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-14T21:02:38.505175] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T21:02:39.158064] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-14T21:02:39.256526] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T21:02:39.540037] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T21:02:39.958111] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-14T21:02:40.758042] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-14T21:02:41.007988] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T21:02:41.558087] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-14T21:02:41.653851] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T21:02:41.728372] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T21:02:42.358087] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-14T21:02:42.439842] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T21:02:43.158115] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-14T21:02:43.954431] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T21:02:43.959116] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-14T21:02:43.961868] [INFO ] [REMOTE ] PRGO: Full fetch complete (68446 records). [2025-10-14T21:02:43.962106] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-14T21:02:43.963765] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:02:43.990132] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:02:43.990317] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:02:43.990570] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-14T21:02:43.991107] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-14T21:02:43.992064] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T21:02:43.992159] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-14T21:02:44.001546] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-14T21:02:44.002019] [INFO ] [MAIN ] Update Progress: 1724/2369 symbols completed. PRGO took 45.0s. Estimated remaining: 1h 30m 47s. Rate: 7.1 symbols/min [2025-10-14T21:02:44.191077] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:44.191252] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-14T21:02:44.191291] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-14T21:02:44.191418] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-14T21:02:44.191492] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-14T21:02:44.191585] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-14T21:02:44.191711] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-14T21:02:44.559442] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:44.758112] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-14T21:02:45.522576] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T21:02:45.558123] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-14T21:02:46.358122] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-14T21:02:46.482620] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T21:02:46.539875] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T21:02:47.158100] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-14T21:02:47.916353] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T21:02:47.958032] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-14T21:02:48.277963] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T21:02:48.758060] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-14T21:02:49.337046] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T21:02:49.558112] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-14T21:02:49.967826] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T21:02:50.358068] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-14T21:02:51.158114] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-14T21:02:51.253689] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T21:02:51.887221] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:02:51.959190] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-14T21:02:51.963094] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T21:02:52.758068] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-14T21:02:53.558056] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-14T21:02:53.692887] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T21:02:54.358074] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-14T21:02:54.403993] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T21:02:55.157063] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T21:02:55.166032] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-14T21:02:55.837331] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-14T21:02:55.958057] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-14T21:02:56.089308] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T21:02:56.532586] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:02:56.534596] [INFO ] [REMOTE ] PRLB: Full fetch complete (30106 records). [2025-10-14T21:02:56.534705] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-14T21:02:56.535171] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:02:56.535258] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:02:56.535301] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:02:56.535339] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-14T21:02:56.535417] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-14T21:02:56.535451] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-14T21:02:56.535490] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-14T21:02:56.535541] [INFO ] [MAIN ] Update Progress: 1725/2369 symbols completed. PRLB took 27.9s. Estimated remaining: 1h 30m 41s. Rate: 7.1 symbols/min [2025-10-14T21:02:56.700216] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:56.700398] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-14T21:02:56.700435] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-14T21:02:56.700543] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-14T21:02:56.700582] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-14T21:02:56.700622] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-14T21:02:56.700681] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-14T21:02:56.763272] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-14T21:02:57.052357] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:57.535840] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T21:02:57.540409] [INFO ] [REMOTE ] PRKS: Full fetch complete (61396 records). [2025-10-14T21:02:57.540518] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-14T21:02:57.541135] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:02:57.541218] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:02:57.541259] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:02:57.541328] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-14T21:02:57.541389] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-14T21:02:57.541423] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-14T21:02:57.541464] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-14T21:02:57.541517] [INFO ] [MAIN ] Update Progress: 1726/2369 symbols completed. PRKS took 37.7s. Estimated remaining: 1h 30m 29s. Rate: 7.1 symbols/min [2025-10-14T21:02:57.563126] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-14T21:02:57.713261] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:57.713443] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-14T21:02:57.713480] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-14T21:02:57.713589] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-14T21:02:57.713629] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-14T21:02:57.713731] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-14T21:02:57.713783] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-14T21:02:58.066691] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:02:58.358066] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-14T21:02:59.158049] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-14T21:02:59.241968] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T21:02:59.443218] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:02:59.443561] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-14T21:02:59.443691] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:02:59.443760] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-14T21:02:59.443819] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:02:59.443887] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-14T21:02:59.443947] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-14T21:02:59.443981] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-14T21:02:59.444019] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-14T21:02:59.444104] [INFO ] [MAIN ] Update Progress: 1727/2369 symbols completed. PRSU took 1.9s. Estimated remaining: 1h 30m 18s. Rate: 7.1 symbols/min [2025-10-14T21:02:59.612781] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:02:59.619036] [DEBUG] [LOCAL ] PRT: Loaded 5172 existing records from primary storage. [2025-10-14T21:02:59.619219] [INFO ] [MAIN ] PRT: Loaded 5172 existing records. [2025-10-14T21:02:59.798148] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:02:59.798562] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-14T21:02:59.798640] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-14T21:02:59.798929] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-14T21:02:59.798988] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-14T21:02:59.918015] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T21:02:59.966917] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-14T21:03:00.185038] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:03:00.758049] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-14T21:03:01.137512] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T21:03:01.558115] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-14T21:03:02.358140] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-14T21:03:02.414325] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T21:03:02.648042] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T21:03:03.158109] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-14T21:03:03.506560] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T21:03:03.958321] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-14T21:03:04.758042] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-14T21:03:04.836603] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-14T21:03:05.047303] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T21:03:05.558082] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-14T21:03:06.013016] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T21:03:06.358043] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-14T21:03:06.436877] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T21:03:07.158108] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-14T21:03:07.958105] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-14T21:03:08.120684] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T21:03:08.758056] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-14T21:03:08.797999] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T21:03:08.803359] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T21:03:09.558086] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-14T21:03:10.232971] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T21:03:10.358055] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-14T21:03:10.917262] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:03:11.158108] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-14T21:03:11.958879] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-14T21:03:11.963494] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T21:03:12.758100] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-14T21:03:12.974271] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-14T21:03:13.505897] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T21:03:13.558066] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-14T21:03:13.714158] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T21:03:14.358072] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-14T21:03:15.158138] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-14T21:03:15.478324] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-14T21:03:15.775989] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T21:03:15.790066] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T21:03:15.958053] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-14T21:03:16.758073] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-14T21:03:17.476452] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T21:03:17.558056] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-14T21:03:18.065019] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-14T21:03:18.358041] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-14T21:03:18.450008] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T21:03:19.158058] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-14T21:03:19.644551] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T21:03:19.943294] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T21:03:19.958019] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-14T21:03:20.619017] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T21:03:20.758082] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-14T21:03:21.408172] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T21:03:21.558062] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-14T21:03:22.131221] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:03:22.132321] [INFO ] [REMOTE ] PRT: Full fetch complete (8814 records). [2025-10-14T21:03:22.132390] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-14T21:03:22.363232] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-14T21:03:22.489127] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-14T21:03:22.489207] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-14T21:03:22.489479] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-14T21:03:22.489518] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-14T21:03:22.489940] [DEBUG] [LOCAL ] PRT: Trimmed 8814 records to 5180 (keeping 200 days of data) [2025-10-14T21:03:22.520567] [DEBUG] [LOCAL ] PRT: Primary data saved (5180 records). [2025-10-14T21:03:22.520737] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-14T21:03:22.520822] [INFO ] [MAIN ] Update Progress: 1728/2369 symbols completed. PRT took 23.1s. Estimated remaining: 1h 30m 15s. Rate: 7.1 symbols/min [2025-10-14T21:03:22.689753] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:03:22.689945] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-14T21:03:22.689996] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-14T21:03:22.690105] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-14T21:03:22.690146] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-14T21:03:22.690185] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-14T21:03:22.690216] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-14T21:03:23.059885] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:03:23.158034] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-14T21:03:23.958143] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-14T21:03:24.392304] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-14T21:03:24.601330] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T21:03:24.605923] [INFO ] [REMOTE ] PRM: Full fetch complete (64225 records). [2025-10-14T21:03:24.606026] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-14T21:03:24.606779] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:03:24.606872] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:03:24.606915] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:03:24.606982] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-14T21:03:24.607046] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-14T21:03:24.607082] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-14T21:03:24.607121] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-14T21:03:24.607175] [INFO ] [MAIN ] Update Progress: 1729/2369 symbols completed. PRM took 51.7s. Estimated remaining: 1h 30m 5s. Rate: 7.1 symbols/min [2025-10-14T21:03:24.773622] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-14T21:03:24.786126] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:03:24.787072] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-14T21:03:24.787118] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-14T21:03:24.787229] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-14T21:03:24.787271] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-14T21:03:24.787314] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-14T21:03:24.787345] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-14T21:03:25.180252] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:03:25.207831] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-14T21:03:25.558079] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-14T21:03:26.090310] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-14T21:03:26.358077] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-14T21:03:26.470941] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T21:03:27.158083] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-14T21:03:27.958038] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-14T21:03:28.152783] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T21:03:28.318905] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T21:03:28.758124] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-14T21:03:28.803266] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T21:03:29.558056] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-14T21:03:29.966314] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T21:03:30.358027] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-14T21:03:30.476135] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T21:03:30.759624] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-14T21:03:31.158064] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-14T21:03:31.958094] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-14T21:03:31.997565] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T21:03:32.003175] [INFO ] [REMOTE ] PRMB: Full fetch complete (75860 records). [2025-10-14T21:03:32.003289] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-14T21:03:32.003962] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:03:32.004050] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:03:32.004092] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:03:32.004133] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-14T21:03:32.004190] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-14T21:03:32.004224] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-14T21:03:32.004264] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-14T21:03:32.004320] [INFO ] [MAIN ] Update Progress: 1730/2369 symbols completed. PRMB took 48.0s. Estimated remaining: 1h 29m 56s. Rate: 7.1 symbols/min [2025-10-14T21:03:32.178776] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:03:32.178934] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-14T21:03:32.178972] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-14T21:03:32.179082] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-14T21:03:32.179123] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-14T21:03:32.179165] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-14T21:03:32.179198] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-14T21:03:32.543248] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:03:32.758032] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-14T21:03:32.782718] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T21:03:32.787524] [INFO ] [REMOTE ] PRO: Full fetch complete (52829 records). [2025-10-14T21:03:32.787639] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-14T21:03:32.788320] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:03:32.788411] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:03:32.788465] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:03:32.788546] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-14T21:03:32.788619] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-14T21:03:32.788691] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-14T21:03:32.788747] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-14T21:03:32.788803] [INFO ] [MAIN ] Update Progress: 1731/2369 symbols completed. PRO took 36.3s. Estimated remaining: 1h 29m 45s. Rate: 7.1 symbols/min [2025-10-14T21:03:32.964681] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:03:32.973860] [DEBUG] [LOCAL ] PSBD: Loaded 7776 existing records from primary storage. [2025-10-14T21:03:32.974038] [INFO ] [MAIN ] PSBD: Loaded 7776 existing records. [2025-10-14T21:03:33.154098] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:03:33.154320] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-14T21:03:33.154371] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-14T21:03:33.154777] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-14T21:03:33.154836] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-14T21:03:33.532420] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:03:33.558026] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-14T21:03:34.226865] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T21:03:34.365228] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-14T21:03:34.386522] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T21:03:35.158114] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-14T21:03:35.958098] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-14T21:03:36.279094] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-14T21:03:36.758072] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-14T21:03:36.769696] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T21:03:36.855847] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T21:03:37.558097] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-14T21:03:38.231299] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T21:03:38.358061] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-14T21:03:38.681112] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T21:03:38.846634] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-14T21:03:39.158125] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-14T21:03:39.640735] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-14T21:03:39.958115] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-14T21:03:40.758067] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-14T21:03:41.498055] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T21:03:41.558030] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-14T21:03:42.358078] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-14T21:03:42.617837] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T21:03:42.747338] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-14T21:03:43.158074] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-14T21:03:43.315420] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:03:43.534307] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-14T21:03:43.958069] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-14T21:03:44.387369] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T21:03:44.758154] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-14T21:03:45.558052] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-14T21:03:45.622570] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T21:03:45.946972] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-14T21:03:46.358062] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-14T21:03:47.158057] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-14T21:03:47.562556] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-14T21:03:47.958036] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-14T21:03:48.197471] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T21:03:48.758122] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-14T21:03:49.558129] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-14T21:03:49.820424] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T21:03:50.287057] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T21:03:50.358075] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-14T21:03:50.374104] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T21:03:50.671722] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-14T21:03:50.672480] [INFO ] [REMOTE ] PRVS: Full fetch complete (1249 records). [2025-10-14T21:03:50.672549] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-14T21:03:50.865527] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-14T21:03:50.865768] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:03:50.865842] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:03:50.865925] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-14T21:03:50.865996] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-14T21:03:50.866035] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-14T21:03:50.866075] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-14T21:03:50.866133] [INFO ] [MAIN ] Update Progress: 1732/2369 symbols completed. PRVS took 26.3s. Estimated remaining: 1h 29m 40s. Rate: 7.1 symbols/min [2025-10-14T21:03:51.045878] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:03:51.054188] [DEBUG] [LOCAL ] PSF: Loaded 6960 existing records from primary storage. [2025-10-14T21:03:51.054388] [INFO ] [MAIN ] PSF: Loaded 6960 existing records. [2025-10-14T21:03:51.161739] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-14T21:03:51.241976] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:03:51.242868] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-14T21:03:51.242928] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-14T21:03:51.243151] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-14T21:03:51.243192] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-14T21:03:51.593891] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:03:51.958066] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-14T21:03:52.758065] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-14T21:03:52.840167] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T21:03:53.558097] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-14T21:03:53.674905] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T21:03:53.891515] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T21:03:54.358132] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-14T21:03:55.158106] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-14T21:03:55.198676] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T21:03:55.297805] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T21:03:55.952304] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T21:03:55.958034] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-14T21:03:56.758073] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-14T21:03:57.558047] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-14T21:03:57.763049] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T21:03:58.021791] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T21:03:58.358094] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-14T21:03:58.628460] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T21:03:58.899037] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T21:03:59.158136] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-14T21:03:59.958070] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-14T21:03:59.977513] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T21:04:00.646527] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T21:04:00.758055] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-14T21:04:01.558035] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-14T21:04:01.626233] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T21:04:02.315726] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T21:04:02.358052] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-14T21:04:03.106293] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T21:04:03.111455] [INFO ] [REMOTE ] PRU: Full fetch complete (73975 records). [2025-10-14T21:04:03.111571] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-14T21:04:03.112299] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:04:03.112390] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:04:03.112451] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:04:03.112491] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-14T21:04:03.112544] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-14T21:04:03.112578] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-14T21:04:03.112616] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-14T21:04:03.112710] [INFO ] [MAIN ] Update Progress: 1733/2369 symbols completed. PRU took 40.6s. Estimated remaining: 1h 29m 33s. Rate: 7.1 symbols/min [2025-10-14T21:04:03.167016] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-14T21:04:03.289933] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:03.290125] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-14T21:04:03.290164] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-14T21:04:03.290288] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-14T21:04:03.290329] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-14T21:04:03.290389] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-14T21:04:03.290441] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-14T21:04:03.653497] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:03.958062] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-14T21:04:04.758062] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-14T21:04:04.780364] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T21:04:04.893172] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T21:04:05.353280] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T21:04:05.355530] [INFO ] [REMOTE ] PSBD: Full fetch complete (10412 records). [2025-10-14T21:04:05.355598] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-14T21:04:05.563395] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-14T21:04:05.713077] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-14T21:04:05.713154] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-14T21:04:05.713401] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-14T21:04:05.713440] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-14T21:04:05.713920] [DEBUG] [LOCAL ] PSBD: Trimmed 10412 records to 7909 (keeping 200 days of data) [2025-10-14T21:04:05.761723] [DEBUG] [LOCAL ] PSBD: Primary data saved (7909 records). [2025-10-14T21:04:05.761849] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-14T21:04:05.761926] [INFO ] [MAIN ] Update Progress: 1734/2369 symbols completed. PSBD took 33.0s. Estimated remaining: 1h 29m 22s. Rate: 7.1 symbols/min [2025-10-14T21:04:05.928762] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:05.928926] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-14T21:04:05.928961] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-14T21:04:05.929087] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-14T21:04:05.929132] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-14T21:04:05.929172] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-14T21:04:05.929203] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-14T21:04:06.281022] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:06.358030] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-14T21:04:06.438457] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T21:04:07.158120] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-14T21:04:07.947070] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T21:04:07.958022] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-14T21:04:08.079783] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T21:04:08.758065] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-14T21:04:09.300941] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T21:04:09.463969] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T21:04:09.558090] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-14T21:04:10.358079] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-14T21:04:11.169787] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-14T21:04:11.177406] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T21:04:11.335469] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T21:04:11.958148] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-14T21:04:12.308074] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T21:04:12.661306] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T21:04:12.758113] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-14T21:04:13.558109] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-14T21:04:13.612287] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T21:04:14.358119] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-14T21:04:15.042169] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:04:15.046916] [INFO ] [REMOTE ] PSA: Full fetch complete (59005 records). [2025-10-14T21:04:15.047061] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-14T21:04:15.048034] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:04:15.048127] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:04:15.048172] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:04:15.048215] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-14T21:04:15.048281] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-14T21:04:15.048320] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-14T21:04:15.048362] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-14T21:04:15.048425] [INFO ] [MAIN ] Update Progress: 1735/2369 symbols completed. PSA took 43.0s. Estimated remaining: 1h 29m 14s. Rate: 7.1 symbols/min [2025-10-14T21:04:15.161315] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-14T21:04:15.237533] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:15.237880] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-14T21:04:15.237926] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-14T21:04:15.238036] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-14T21:04:15.238076] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-14T21:04:15.238117] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-14T21:04:15.238148] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-14T21:04:15.605311] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:15.634830] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-14T21:04:15.958071] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-14T21:04:16.547437] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T21:04:16.758074] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-14T21:04:17.558037] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-14T21:04:17.628191] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T21:04:17.736352] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T21:04:18.358078] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-14T21:04:18.919739] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T21:04:18.920983] [INFO ] [REMOTE ] PSF: Full fetch complete (9792 records). [2025-10-14T21:04:18.921048] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-14T21:04:19.163231] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-14T21:04:19.239730] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T21:04:19.321018] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-14T21:04:19.321089] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-14T21:04:19.321309] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-14T21:04:19.321346] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-14T21:04:19.321775] [DEBUG] [LOCAL ] PSF: Trimmed 9792 records to 7000 (keeping 200 days of data) [2025-10-14T21:04:19.363192] [DEBUG] [LOCAL ] PSF: Primary data saved (7000 records). [2025-10-14T21:04:19.363302] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-14T21:04:19.363375] [INFO ] [MAIN ] Update Progress: 1736/2369 symbols completed. PSF took 28.5s. Estimated remaining: 1h 29m 4s. Rate: 7.1 symbols/min [2025-10-14T21:04:19.533156] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:19.565898] [DEBUG] [LOCAL ] PSQH: Loaded 35345 existing records from primary storage. [2025-10-14T21:04:19.566157] [INFO ] [MAIN ] PSQH: Loaded 35345 existing records. [2025-10-14T21:04:19.742033] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:04:19.742228] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-14T21:04:19.742275] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-14T21:04:19.742914] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-14T21:04:19.742971] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-14T21:04:19.963180] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-14T21:04:20.111768] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:20.684277] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T21:04:20.758105] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-14T21:04:21.369328] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T21:04:21.558062] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-14T21:04:22.358075] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-14T21:04:22.899729] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-14T21:04:23.121341] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T21:04:23.158051] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-14T21:04:23.958084] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-14T21:04:24.229833] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T21:04:24.612044] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T21:04:24.758057] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-14T21:04:25.558101] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-14T21:04:25.832037] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T21:04:25.930460] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T21:04:26.358099] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-14T21:04:27.029417] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T21:04:27.158133] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-14T21:04:27.958112] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-14T21:04:28.063486] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T21:04:28.618510] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:04:28.758048] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-14T21:04:28.878407] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T21:04:29.558055] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-14T21:04:29.970093] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T21:04:30.358123] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-14T21:04:31.015177] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T21:04:31.030362] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T21:04:31.033546] [INFO ] [REMOTE ] PSFE: Full fetch complete (42927 records). [2025-10-14T21:04:31.033680] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-14T21:04:31.034198] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:04:31.034282] [FATAL] [MAIN ] PSFE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:04:31.034326] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:04:31.034395] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-14T21:04:31.034460] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-14T21:04:31.034497] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-14T21:04:31.034537] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-14T21:04:31.034591] [INFO ] [MAIN ] Update Progress: 1737/2369 symbols completed. PSFE took 27.9s. Estimated remaining: 1h 28m 57s. Rate: 7.1 symbols/min [2025-10-14T21:04:31.163238] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-14T21:04:31.218409] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:31.218580] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-14T21:04:31.218619] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-14T21:04:31.218752] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-14T21:04:31.218798] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-14T21:04:31.218849] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-14T21:04:31.218889] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-14T21:04:31.573329] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:31.958327] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-14T21:04:32.758147] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-14T21:04:32.958771] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T21:04:33.558064] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-14T21:04:33.970027] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-14T21:04:34.358087] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-14T21:04:34.415975] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T21:04:34.819565] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T21:04:35.158126] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-14T21:04:35.958548] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T21:04:35.958618] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-14T21:04:36.758066] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-14T21:04:36.872405] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T21:04:36.908824] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T21:04:37.558061] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-14T21:04:38.358083] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-14T21:04:38.749527] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-14T21:04:39.118870] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T21:04:39.124072] [INFO ] [REMOTE ] PSN: Full fetch complete (66752 records). [2025-10-14T21:04:39.124342] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-14T21:04:39.139388] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:04:39.146950] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:04:39.147253] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:04:39.148563] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T21:04:39.147776] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-14T21:04:39.156581] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-14T21:04:39.156969] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-14T21:04:39.157035] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-14T21:04:39.157100] [INFO ] [MAIN ] Update Progress: 1738/2369 symbols completed. PSN took 33.4s. Estimated remaining: 1h 28m 48s. Rate: 7.1 symbols/min [2025-10-14T21:04:39.162519] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-14T21:04:39.345738] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:39.345914] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-14T21:04:39.345953] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-14T21:04:39.346063] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-14T21:04:39.346104] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-14T21:04:39.346146] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-14T21:04:39.346178] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-14T21:04:39.722486] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:39.958072] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-14T21:04:40.758036] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-14T21:04:41.128439] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-14T21:04:41.151984] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T21:04:41.558075] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-14T21:04:42.260548] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T21:04:42.358069] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-14T21:04:43.158075] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-14T21:04:43.584932] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T21:04:43.627372] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T21:04:43.958094] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-14T21:04:44.735075] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T21:04:44.758039] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-14T21:04:45.558117] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-14T21:04:46.079492] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-14T21:04:46.358083] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-14T21:04:46.442660] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T21:04:46.499349] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T21:04:47.158069] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-14T21:04:47.958045] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-14T21:04:48.476501] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-14T21:04:48.667774] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T21:04:48.758027] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-14T21:04:49.218427] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T21:04:49.558071] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-14T21:04:49.891032] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-14T21:04:50.358103] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-14T21:04:51.060487] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T21:04:51.158061] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-14T21:04:51.887035] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T21:04:51.958087] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-14T21:04:52.392606] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T21:04:52.658959] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:04:52.662894] [INFO ] [REMOTE ] PSO: Full fetch complete (52105 records). [2025-10-14T21:04:52.662993] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-14T21:04:52.663601] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:04:52.663705] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:04:52.663750] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:04:52.663788] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-14T21:04:52.663939] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-14T21:04:52.663990] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-14T21:04:52.664032] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-14T21:04:52.664084] [INFO ] [MAIN ] Update Progress: 1739/2369 symbols completed. PSO took 37.6s. Estimated remaining: 1h 28m 41s. Rate: 7.1 symbols/min [2025-10-14T21:04:52.763239] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-14T21:04:52.866421] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:04:52.866603] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-14T21:04:52.866661] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-14T21:04:52.866785] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-14T21:04:52.866826] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-14T21:04:52.866866] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-14T21:04:52.866898] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-14T21:04:53.216919] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:04:53.558065] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-14T21:04:54.358049] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-14T21:04:54.584537] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T21:04:55.158078] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-14T21:04:55.675252] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-14T21:04:55.706446] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T21:04:55.958050] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-14T21:04:56.758088] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-14T21:04:56.841632] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T21:04:57.152364] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T21:04:57.558069] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-14T21:04:58.358058] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-14T21:04:58.668523] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T21:04:59.158033] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-14T21:04:59.308813] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T21:04:59.599150] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T21:04:59.958110] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-14T21:05:00.758066] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-14T21:05:00.925077] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T21:05:01.029105] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T21:05:01.558085] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-14T21:05:02.117610] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T21:05:02.358073] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-14T21:05:03.158065] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-14T21:05:03.945001] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-14T21:05:03.958040] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-14T21:05:03.983806] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:05:03.989114] [INFO ] [REMOTE ] PSTG: Full fetch complete (76304 records). [2025-10-14T21:05:03.989217] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-14T21:05:03.990005] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:05:03.990092] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:05:03.990134] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:05:03.990197] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-14T21:05:03.990258] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-14T21:05:03.990293] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-14T21:05:03.990331] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-14T21:05:03.990388] [INFO ] [MAIN ] Update Progress: 1740/2369 symbols completed. PSTG took 33.0s. Estimated remaining: 1h 28m 34s. Rate: 7.1 symbols/min [2025-10-14T21:05:04.161555] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:04.161774] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-14T21:05:04.161874] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-14T21:05:04.162109] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-14T21:05:04.162171] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-14T21:05:04.162240] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-14T21:05:04.162275] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-14T21:05:04.542929] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:04.555682] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-14T21:05:04.758062] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-14T21:05:05.495203] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T21:05:05.499952] [INFO ] [REMOTE ] PSQH: Full fetch complete (53625 records). [2025-10-14T21:05:05.500050] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-14T21:05:05.563250] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-14T21:05:05.888847] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-14T21:05:05.888929] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-14T21:05:05.889848] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-14T21:05:05.889908] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-14T21:05:05.890984] [DEBUG] [LOCAL ] PSQH: Trimmed 53625 records to 35507 (keeping 200 days of data) [2025-10-14T21:05:06.087148] [DEBUG] [LOCAL ] PSQH: Primary data saved (35507 records). [2025-10-14T21:05:06.087269] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-14T21:05:06.087343] [INFO ] [MAIN ] Update Progress: 1741/2369 symbols completed. PSQH took 46.7s. Estimated remaining: 1h 28m 23s. Rate: 7.1 symbols/min [2025-10-14T21:05:06.256172] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:06.256329] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-14T21:05:06.256366] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-14T21:05:06.256501] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-14T21:05:06.256579] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-14T21:05:06.256673] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-14T21:05:06.256794] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-14T21:05:06.363150] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-14T21:05:06.633720] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:06.744952] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T21:05:06.881108] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-14T21:05:07.158102] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-14T21:05:07.526235] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T21:05:07.958043] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-14T21:05:08.387205] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-14T21:05:08.758106] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-14T21:05:09.558067] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-14T21:05:09.993356] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-14T21:05:10.358044] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-14T21:05:10.387731] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T21:05:10.593019] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T21:05:11.158059] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-14T21:05:11.958036] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-14T21:05:12.034389] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T21:05:12.217194] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T21:05:12.758057] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-14T21:05:13.419682] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T21:05:13.558059] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-14T21:05:13.814046] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-14T21:05:14.358108] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-14T21:05:15.148148] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T21:05:15.163173] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-14T21:05:15.170797] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T21:05:15.958078] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-14T21:05:16.369834] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T21:05:16.758072] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-14T21:05:17.558074] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-14T21:05:17.914446] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T21:05:17.968304] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T21:05:18.358082] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-14T21:05:19.158068] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-14T21:05:19.219080] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T21:05:19.431235] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T21:05:19.636501] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-14T21:05:19.639172] [INFO ] [REMOTE ] PSTL: Full fetch complete (29513 records). [2025-10-14T21:05:19.639256] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-14T21:05:19.639710] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:05:19.639880] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:05:19.639970] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:05:19.640063] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-14T21:05:19.640147] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-14T21:05:19.640183] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-14T21:05:19.640221] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-14T21:05:19.640274] [INFO ] [MAIN ] Update Progress: 1742/2369 symbols completed. PSTL took 40.5s. Estimated remaining: 1h 28m 17s. Rate: 7.1 symbols/min [2025-10-14T21:05:19.805313] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:19.805488] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-14T21:05:19.805524] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-14T21:05:19.805687] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-14T21:05:19.805751] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-14T21:05:19.805803] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-14T21:05:19.805837] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-14T21:05:19.959152] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-14T21:05:20.162275] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:20.758109] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-14T21:05:21.124077] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T21:05:21.558078] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-14T21:05:22.358086] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-14T21:05:22.586639] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T21:05:23.158045] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-14T21:05:23.518168] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-14T21:05:23.895830] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T21:05:23.958024] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-14T21:05:24.758049] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-14T21:05:24.952133] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T21:05:25.432577] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T21:05:25.558510] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-14T21:05:25.568701] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T21:05:26.358070] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-14T21:05:26.908255] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T21:05:26.913666] [INFO ] [REMOTE ] PSX: Full fetch complete (76780 records). [2025-10-14T21:05:26.913808] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-14T21:05:26.914479] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:05:26.914572] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:05:26.914614] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:05:26.914700] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-14T21:05:26.914774] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-14T21:05:26.914809] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-14T21:05:26.914846] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-14T21:05:26.914900] [INFO ] [MAIN ] Update Progress: 1743/2369 symbols completed. PSX took 34.3s. Estimated remaining: 1h 28m 8s. Rate: 7.1 symbols/min [2025-10-14T21:05:27.089137] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:27.089439] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-14T21:05:27.089514] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-14T21:05:27.089681] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-14T21:05:27.089740] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-14T21:05:27.089821] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-14T21:05:27.090051] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-14T21:05:27.159683] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-14T21:05:27.216668] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T21:05:27.478263] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:27.958100] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-14T21:05:28.758141] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-14T21:05:28.868875] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:05:29.558057] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-14T21:05:29.746058] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T21:05:29.796556] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T21:05:30.358061] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-14T21:05:31.126416] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T21:05:31.158069] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-14T21:05:31.663955] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T21:05:31.815423] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T21:05:31.958075] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-14T21:05:32.758061] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-14T21:05:33.124768] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T21:05:33.558114] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-14T21:05:34.358094] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-14T21:05:34.498707] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T21:05:34.808940] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T21:05:34.811161] [INFO ] [REMOTE ] PTA: Full fetch complete (22638 records). [2025-10-14T21:05:34.811231] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-14T21:05:34.811674] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:05:34.811755] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:05:34.811797] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:05:34.811833] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-14T21:05:34.811932] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-14T21:05:34.811982] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-14T21:05:34.812023] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-14T21:05:34.812075] [INFO ] [MAIN ] Update Progress: 1744/2369 symbols completed. PTA took 30.8s. Estimated remaining: 1h 27m 59s. Rate: 7.1 symbols/min [2025-10-14T21:05:34.986110] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:34.986296] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-14T21:05:34.986349] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-14T21:05:34.986482] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-14T21:05:34.986550] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-14T21:05:34.986603] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-14T21:05:34.986638] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-14T21:05:35.173476] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-14T21:05:35.351715] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T21:05:35.402089] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:35.958118] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-14T21:05:36.758060] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-14T21:05:37.132887] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T21:05:37.558095] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-14T21:05:38.004801] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-14T21:05:38.337875] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T21:05:38.342183] [INFO ] [REMOTE ] PTY: Full fetch complete (53786 records). [2025-10-14T21:05:38.342270] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-14T21:05:38.342932] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:05:38.343016] [FATAL] [MAIN ] PTY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:05:38.343057] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:05:38.343094] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-14T21:05:38.343147] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-14T21:05:38.343180] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-14T21:05:38.343225] [DEBUG] [LOCAL ] PTY: No derivative data file found to delete. [2025-10-14T21:05:38.343277] [INFO ] [MAIN ] Update Progress: 1745/2369 symbols completed. PTY took 32.3s. Estimated remaining: 1h 27m 49s. Rate: 7.1 symbols/min [2025-10-14T21:05:38.365090] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-14T21:05:38.516112] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:38.521896] [DEBUG] [LOCAL ] PVL: Loaded 4696 existing records from primary storage. [2025-10-14T21:05:38.522116] [INFO ] [MAIN ] PVL: Loaded 4696 existing records. [2025-10-14T21:05:38.699123] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:05:38.699350] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-14T21:05:38.699417] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-14T21:05:38.699673] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-14T21:05:38.699750] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-14T21:05:39.086479] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:39.082179] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-14T21:05:39.158028] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-14T21:05:39.958080] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-14T21:05:39.965356] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T21:05:40.144705] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T21:05:40.758066] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-14T21:05:41.571880] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-14T21:05:41.599106] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:05:42.358044] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-14T21:05:42.529459] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T21:05:42.930842] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T21:05:43.158061] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-14T21:05:43.958083] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-14T21:05:44.248813] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-14T21:05:44.452939] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T21:05:44.666881] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-14T21:05:44.758057] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-14T21:05:45.558065] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-14T21:05:46.358092] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-14T21:05:46.654164] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T21:05:46.841843] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T21:05:47.158042] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-14T21:05:47.288972] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T21:05:47.865421] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T21:05:47.958088] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-14T21:05:48.758062] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-14T21:05:49.385075] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T21:05:49.557979] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-14T21:05:49.628372] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T21:05:50.057888] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-14T21:05:50.358043] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-14T21:05:51.158050] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-14T21:05:51.958034] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-14T21:05:52.141126] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T21:05:52.656149] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-14T21:05:52.758027] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-14T21:05:52.986553] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T21:05:53.392942] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-14T21:05:53.558047] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-14T21:05:54.358088] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-14T21:05:55.161761] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-14T21:05:55.168780] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T21:05:55.927168] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T21:05:55.958022] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-14T21:05:56.758083] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-14T21:05:57.207070] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-14T21:05:57.558069] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-14T21:05:57.616792] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T21:05:58.262902] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T21:05:58.358056] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-14T21:05:58.403738] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T21:05:59.081505] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T21:05:59.086241] [INFO ] [REMOTE ] PUK: Full fetch complete (64975 records). [2025-10-14T21:05:59.086356] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-14T21:05:59.087024] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:05:59.087112] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:05:59.087163] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:05:59.087249] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-14T21:05:59.087327] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-14T21:05:59.087376] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-14T21:05:59.087434] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-14T21:05:59.087513] [INFO ] [MAIN ] Update Progress: 1746/2369 symbols completed. PUK took 39.4s. Estimated remaining: 1h 27m 45s. Rate: 7.1 symbols/min [2025-10-14T21:05:59.166976] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-14T21:05:59.280804] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:05:59.280986] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-14T21:05:59.281030] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-14T21:05:59.281161] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-14T21:05:59.281203] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-14T21:05:59.281246] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-14T21:05:59.281279] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-14T21:05:59.650556] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:05:59.958084] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-14T21:06:00.620431] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T21:06:00.758046] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-14T21:06:01.469444] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T21:06:01.470574] [INFO ] [REMOTE ] PVL: Full fetch complete (7205 records). [2025-10-14T21:06:01.470684] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-14T21:06:01.568409] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-14T21:06:01.683848] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-14T21:06:01.943630] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-14T21:06:01.943743] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-14T21:06:01.943960] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-14T21:06:01.943999] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-14T21:06:01.944512] [DEBUG] [LOCAL ] PVL: Trimmed 7205 records to 4715 (keeping 200 days of data) [2025-10-14T21:06:01.975949] [DEBUG] [LOCAL ] PVL: Primary data saved (4715 records). [2025-10-14T21:06:01.976100] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-14T21:06:01.976185] [INFO ] [MAIN ] Update Progress: 1747/2369 symbols completed. PVL took 23.6s. Estimated remaining: 1h 27m 35s. Rate: 7.1 symbols/min [2025-10-14T21:06:02.184698] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:02.184908] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-14T21:06:02.184961] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-14T21:06:02.185074] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-14T21:06:02.185116] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-14T21:06:02.185158] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-14T21:06:02.185190] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-14T21:06:02.363784] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-14T21:06:02.601502] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:03.158071] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-14T21:06:03.731889] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-14T21:06:03.958068] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-14T21:06:04.208604] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T21:06:04.655899] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T21:06:04.758053] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-14T21:06:05.558051] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-14T21:06:05.948771] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-14T21:06:06.358068] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-14T21:06:06.481173] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T21:06:06.571802] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T21:06:07.158070] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-14T21:06:07.958051] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-14T21:06:08.232151] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T21:06:08.625524] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T21:06:08.631235] [INFO ] [REMOTE ] PUMP: Full fetch complete (71391 records). [2025-10-14T21:06:08.631356] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-14T21:06:08.632022] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:06:08.632115] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:06:08.632191] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:06:08.632300] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-14T21:06:08.632406] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-14T21:06:08.632462] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-14T21:06:08.632506] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-14T21:06:08.632562] [INFO ] [MAIN ] Update Progress: 1748/2369 symbols completed. PUMP took 41.7s. Estimated remaining: 1h 27m 25s. Rate: 7.1 symbols/min [2025-10-14T21:06:08.762191] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-14T21:06:08.817068] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:06:08.860905] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:08.861578] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-14T21:06:08.861624] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-14T21:06:08.861765] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-14T21:06:08.861807] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-14T21:06:08.861849] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-14T21:06:08.861880] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-14T21:06:09.274972] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:09.558067] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-14T21:06:10.358087] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-14T21:06:10.799563] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-14T21:06:11.105917] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T21:06:11.158078] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-14T21:06:11.323595] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T21:06:11.958113] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-14T21:06:12.756148] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T21:06:12.760568] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-14T21:06:12.762926] [INFO ] [REMOTE ] PVH: Full fetch complete (70726 records). [2025-10-14T21:06:12.763141] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-14T21:06:12.764175] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:06:12.764400] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:06:12.764468] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:06:12.764545] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-14T21:06:12.764631] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-14T21:06:12.764712] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-14T21:06:12.764763] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-14T21:06:12.764828] [INFO ] [MAIN ] Update Progress: 1749/2369 symbols completed. PVH took 38.0s. Estimated remaining: 1h 27m 15s. Rate: 7.1 symbols/min [2025-10-14T21:06:12.959742] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:12.959982] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-14T21:06:12.960134] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-14T21:06:12.960271] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-14T21:06:12.960413] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-14T21:06:12.960513] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-14T21:06:12.960693] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-14T21:06:13.349426] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T21:06:13.353729] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:13.558071] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-14T21:06:14.285733] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T21:06:14.358038] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-14T21:06:15.158109] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-14T21:06:15.420909] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T21:06:15.605522] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:06:15.605756] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-14T21:06:15.605841] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:06:15.605886] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-14T21:06:15.605917] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:06:15.605954] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-14T21:06:15.606000] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-14T21:06:15.606033] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-14T21:06:15.606078] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-14T21:06:15.606120] [INFO ] [MAIN ] Update Progress: 1750/2369 symbols completed. PXED took 7.0s. Estimated remaining: 1h 27m 5s. Rate: 7.1 symbols/min [2025-10-14T21:06:15.777089] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:15.799503] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T21:06:15.827024] [DEBUG] [LOCAL ] QD: Loaded 27616 existing records from primary storage. [2025-10-14T21:06:15.827263] [INFO ] [MAIN ] QD: Loaded 27616 existing records. [2025-10-14T21:06:15.965699] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-14T21:06:16.005535] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:06:16.005821] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-14T21:06:16.005876] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-14T21:06:16.006467] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-14T21:06:16.006525] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-14T21:06:16.356875] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:16.758099] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-14T21:06:17.558162] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-14T21:06:17.795924] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T21:06:18.358142] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-14T21:06:19.158118] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-14T21:06:19.224473] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T21:06:19.704005] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-10-14T21:06:19.826973] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T21:06:19.958092] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-14T21:06:20.741293] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T21:06:20.758032] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-14T21:06:21.558068] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-14T21:06:22.358081] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-14T21:06:22.665936] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T21:06:22.709156] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-14T21:06:22.960323] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T21:06:23.150998] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T21:06:23.158019] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-14T21:06:23.958110] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-14T21:06:24.463233] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T21:06:24.758064] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-14T21:06:24.951620] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T21:06:25.558069] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-14T21:06:25.798742] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T21:06:26.358086] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-14T21:06:27.158078] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-14T21:06:27.559712] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T21:06:27.958080] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-14T21:06:28.061513] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-14T21:06:28.497274] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T21:06:28.758113] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-14T21:06:29.558090] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-14T21:06:29.751454] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T21:06:29.883379] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T21:06:30.358109] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-14T21:06:31.158111] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-14T21:06:31.248300] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T21:06:31.251437] [INFO ] [REMOTE ] PX: Full fetch complete (50127 records). [2025-10-14T21:06:31.251542] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-14T21:06:31.252121] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:06:31.252207] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:06:31.252250] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:06:31.252316] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-14T21:06:31.252381] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-14T21:06:31.252416] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-14T21:06:31.252456] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-14T21:06:31.252509] [INFO ] [MAIN ] Update Progress: 1751/2369 symbols completed. PX took 29.3s. Estimated remaining: 1h 26m 59s. Rate: 7.1 symbols/min [2025-10-14T21:06:31.420726] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:31.420908] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-14T21:06:31.420946] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-14T21:06:31.421054] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-14T21:06:31.421094] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-14T21:06:31.421135] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-14T21:06:31.421207] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-14T21:06:31.774115] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:31.958035] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-14T21:06:32.399354] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T21:06:32.487366] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-14T21:06:32.758103] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-14T21:06:33.558048] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-14T21:06:33.709181] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T21:06:34.358127] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-14T21:06:34.692675] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T21:06:35.022128] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-14T21:06:35.158068] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-14T21:06:35.966823] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-14T21:06:35.975162] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T21:06:36.460611] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T21:06:36.758098] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-14T21:06:37.558114] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-14T21:06:38.358057] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-14T21:06:38.430577] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T21:06:38.771861] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-14T21:06:38.914607] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:06:39.070175] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T21:06:39.074877] [INFO ] [REMOTE ] PWR: Full fetch complete (68743 records). [2025-10-14T21:06:39.074999] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-14T21:06:39.075627] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:06:39.075736] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:06:39.075777] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:06:39.075818] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-14T21:06:39.075873] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-14T21:06:39.075909] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-14T21:06:39.075948] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-14T21:06:39.076003] [INFO ] [MAIN ] Update Progress: 1752/2369 symbols completed. PWR took 40.0s. Estimated remaining: 1h 26m 50s. Rate: 7.1 symbols/min [2025-10-14T21:06:39.163225] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-14T21:06:39.275631] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:39.275774] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-14T21:06:39.275813] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-14T21:06:39.275921] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-14T21:06:39.275960] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-14T21:06:39.276000] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-14T21:06:39.276031] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-14T21:06:39.630968] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:39.958060] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-14T21:06:40.437115] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T21:06:40.758068] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-14T21:06:41.558069] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-14T21:06:41.788797] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T21:06:41.792717] [INFO ] [REMOTE ] QD: Full fetch complete (40034 records). [2025-10-14T21:06:41.792849] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-14T21:06:42.176116] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-14T21:06:42.176217] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-14T21:06:42.177037] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-14T21:06:42.177101] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-14T21:06:42.178298] [DEBUG] [LOCAL ] QD: Trimmed 40034 records to 27589 (keeping 200 days of data) [2025-10-14T21:06:42.335739] [DEBUG] [LOCAL ] QD: Primary data saved (27589 records). [2025-10-14T21:06:42.335882] [INFO ] [MAIN ] QD: Full history saved. [2025-10-14T21:06:42.335965] [INFO ] [MAIN ] Update Progress: 1753/2369 symbols completed. QD took 26.7s. Estimated remaining: 1h 26m 40s. Rate: 7.1 symbols/min [2025-10-14T21:06:42.366995] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-14T21:06:42.509633] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:42.509828] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-14T21:06:42.509867] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-14T21:06:42.509983] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-14T21:06:42.510025] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-14T21:06:42.510066] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-14T21:06:42.510099] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-14T21:06:42.883325] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:42.913481] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-10-14T21:06:43.158087] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-14T21:06:43.255361] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T21:06:43.958092] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-14T21:06:44.758087] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-14T21:06:44.973990] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-14T21:06:45.558037] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-14T21:06:45.838578] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T21:06:46.098784] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-14T21:06:46.358057] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-14T21:06:46.453396] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T21:06:47.158063] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-14T21:06:47.958037] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-14T21:06:48.114887] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-14T21:06:48.258346] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T21:06:48.758039] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-14T21:06:49.094673] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-14T21:06:49.558060] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-14T21:06:50.358080] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-14T21:06:50.545197] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T21:06:50.746307] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-14T21:06:51.158120] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-14T21:06:51.897792] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-14T21:06:51.958039] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-14T21:06:52.110830] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T21:06:52.758136] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-14T21:06:53.558074] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-14T21:06:53.793453] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-14T21:06:54.187262] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-14T21:06:54.364489] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-14T21:06:54.384423] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T21:06:55.158084] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-14T21:06:55.243701] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T21:06:55.958076] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-14T21:06:56.449042] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-14T21:06:56.758036] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-14T21:06:57.034008] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T21:06:57.168814] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T21:06:57.174612] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-14T21:06:57.174781] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-14T21:06:57.175568] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:06:57.175695] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:06:57.175779] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:06:57.175864] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-14T21:06:57.175938] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-14T21:06:57.175977] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-14T21:06:57.176016] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-14T21:06:57.176122] [INFO ] [MAIN ] Update Progress: 1754/2369 symbols completed. QBTS took 44.4s. Estimated remaining: 1h 26m 34s. Rate: 7.1 symbols/min [2025-10-14T21:06:57.355807] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:06:57.356026] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-14T21:06:57.356091] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-14T21:06:57.356364] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-14T21:06:57.356500] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-14T21:06:57.356615] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-14T21:06:57.356788] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-14T21:06:57.564700] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-14T21:06:57.576164] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:06:57.767845] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:06:58.358099] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-14T21:06:59.158112] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-14T21:06:59.479012] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T21:06:59.958027] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-14T21:07:00.453108] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-14T21:07:00.758154] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-14T21:07:00.936312] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T21:07:01.370008] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T21:07:01.558089] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-14T21:07:02.358068] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-14T21:07:02.631606] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T21:07:03.158050] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-14T21:07:03.479355] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T21:07:03.898248] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:07:03.903350] [INFO ] [REMOTE ] QGEN: Full fetch complete (70075 records). [2025-10-14T21:07:03.903471] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-14T21:07:03.904213] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:07:03.904299] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:07:03.904342] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:07:03.904380] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-14T21:07:03.904439] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-14T21:07:03.904474] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-14T21:07:03.904512] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-14T21:07:03.904566] [INFO ] [MAIN ] Update Progress: 1755/2369 symbols completed. QGEN took 32.7s. Estimated remaining: 1h 26m 25s. Rate: 7.1 symbols/min [2025-10-14T21:07:03.966774] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-14T21:07:04.086710] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:07:04.119873] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T21:07:04.145838] [DEBUG] [LOCAL ] QUAD: Loaded 23402 existing records from primary storage. [2025-10-14T21:07:04.146110] [INFO ] [MAIN ] QUAD: Loaded 23402 existing records. [2025-10-14T21:07:04.321771] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:07:04.322009] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-14T21:07:04.322059] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-14T21:07:04.322554] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-14T21:07:04.322614] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-14T21:07:04.675132] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:07:04.758030] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-14T21:07:05.558116] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-14T21:07:05.721596] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T21:07:05.769445] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:07:06.358086] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-14T21:07:07.158123] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-14T21:07:07.958158] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-14T21:07:08.200623] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T21:07:08.443001] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T21:07:08.683950] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-14T21:07:08.758108] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-14T21:07:09.097503] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T21:07:09.545548] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T21:07:09.550935] [INFO ] [REMOTE ] QSR: Full fetch complete (75614 records). [2025-10-14T21:07:09.551055] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-14T21:07:09.551793] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:07:09.551883] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:07:09.551925] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:07:09.551996] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-14T21:07:09.552059] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-14T21:07:09.552095] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-14T21:07:09.552135] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-14T21:07:09.552191] [INFO ] [MAIN ] Update Progress: 1756/2369 symbols completed. QSR took 27.2s. Estimated remaining: 1h 26m 16s. Rate: 7.1 symbols/min [2025-10-14T21:07:09.564084] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-14T21:07:09.728460] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:07:09.728666] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-14T21:07:09.728723] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-14T21:07:09.728832] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-14T21:07:09.728873] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-14T21:07:09.728914] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-14T21:07:09.728966] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-14T21:07:10.090962] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:07:10.358060] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-14T21:07:10.985461] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T21:07:11.158051] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-14T21:07:11.237108] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T21:07:11.266844] [DEBUG] [REMOTE ] QS: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-14T21:07:11.267192] [WARN ] [REMOTE ] QS: No data returned for month 2025-08 [2025-10-14T21:07:11.267283] [FATAL] [REMOTE ] QS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:07:11.267364] [FATAL] [MAIN ] QS: Failed to fetch primary data. [2025-10-14T21:07:11.267425] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:07:11.267497] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-14T21:07:11.267559] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-14T21:07:11.267670] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-14T21:07:11.267749] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-14T21:07:11.267801] [INFO ] [MAIN ] Update Progress: 1757/2369 symbols completed. QS took 32.2s. Estimated remaining: 1h 26m 5s. Rate: 7.1 symbols/min [2025-10-14T21:07:11.958074] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-14T21:07:12.758089] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-14T21:07:13.073848] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T21:07:13.411933] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-14T21:07:13.558062] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-14T21:07:14.171063] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T21:07:14.358113] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-14T21:07:15.158064] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-14T21:07:15.891994] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:07:15.958027] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-14T21:07:16.062710] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T21:07:16.758067] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-14T21:07:17.564713] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-14T21:07:17.580880] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T21:07:17.688274] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T21:07:18.361057] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-14T21:07:18.362807] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T21:07:19.158063] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-14T21:07:19.741618] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T21:07:19.958123] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-14T21:07:20.096123] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T21:07:20.758035] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-14T21:07:21.528132] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T21:07:21.558035] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-14T21:07:21.671566] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T21:07:22.358068] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-14T21:07:22.970175] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T21:07:22.997228] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T21:07:23.158083] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-14T21:07:23.947371] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T21:07:23.958020] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-14T21:07:24.725268] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T21:07:24.758049] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-14T21:07:25.295057] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T21:07:25.296742] [INFO ] [REMOTE ] QVCC: Full fetch complete (12072 records). [2025-10-14T21:07:25.296814] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-14T21:07:25.297199] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:07:25.297296] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:07:25.297352] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:07:25.297392] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-14T21:07:25.297445] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-14T21:07:25.297478] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-14T21:07:25.297593] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-14T21:07:25.297708] [INFO ] [MAIN ] Update Progress: 1758/2369 symbols completed. QVCC took 15.7s. Estimated remaining: 1h 25m 58s. Rate: 7.1 symbols/min [2025-10-14T21:07:25.558083] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-14T21:07:26.358094] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-14T21:07:26.746983] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T21:07:27.158154] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-14T21:07:27.788713] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T21:07:27.935294] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T21:07:27.958083] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-14T21:07:28.758097] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-14T21:07:29.266814] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T21:07:29.558102] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-14T21:07:29.895407] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T21:07:30.358124] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-14T21:07:30.630621] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T21:07:31.158090] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-14T21:07:31.667903] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T21:07:31.958144] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-14T21:07:32.157757] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T21:07:32.161062] [INFO ] [REMOTE ] QUAD: Full fetch complete (34293 records). [2025-10-14T21:07:32.161239] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-14T21:07:32.565259] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-14T21:07:32.565354] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-14T21:07:32.566067] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-14T21:07:32.566128] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-14T21:07:32.566951] [DEBUG] [LOCAL ] QUAD: Trimmed 34293 records to 23359 (keeping 200 days of data) [2025-10-14T21:07:32.703593] [DEBUG] [LOCAL ] QUAD: Primary data saved (23359 records). [2025-10-14T21:07:32.703757] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-14T21:07:32.703843] [INFO ] [MAIN ] Update Progress: 1759/2369 symbols completed. QUAD took 28.8s. Estimated remaining: 1h 25m 49s. Rate: 7.1 symbols/min [2025-10-14T21:07:33.637968] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T21:07:33.649319] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-14T21:07:34.347156] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:07:34.352260] [INFO ] [REMOTE ] QTWO: Full fetch complete (57551 records). [2025-10-14T21:07:34.352436] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-14T21:07:34.353459] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:07:34.353590] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:07:34.353635] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:07:34.353735] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-14T21:07:34.353807] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-14T21:07:34.353842] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-14T21:07:34.353881] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-14T21:07:34.353945] [INFO ] [MAIN ] Update Progress: 1760/2369 symbols completed. QTWO took 37.2s. Estimated remaining: 1h 25m 39s. Rate: 7.1 symbols/min [2025-10-14T21:07:34.948998] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:07:34.991769] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-14T21:07:35.046699] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-14T21:07:35.106281] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:07:35.102316] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-14T21:07:35.087379] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:07:35.106677] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-14T21:07:35.125902] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:07:35.124329] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-14T21:07:35.122183] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-14T21:07:35.126322] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-14T21:07:35.126380] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-14T21:07:35.126977] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-14T21:07:35.132407] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-14T21:07:35.160940] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-14T21:07:35.160774] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-14T21:07:35.220845] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-14T21:07:35.215373] [DEBUG] [LOCAL ] QVCD: Loaded 4711 existing records from primary storage. [2025-10-14T21:07:35.226171] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-14T21:07:35.226340] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-14T21:07:35.237416] [INFO ] [MAIN ] QVCD: Loaded 4711 existing records. [2025-10-14T21:07:35.232047] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-14T21:07:35.298941] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-14T21:07:35.345721] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-14T21:07:35.992695] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:07:36.015506] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-14T21:07:36.205831] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-14T21:07:36.242597] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:07:36.281093] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-14T21:07:36.285688] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-14T21:07:36.258429] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-14T21:07:36.557295] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:07:36.610895] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-14T21:07:36.622174] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:07:36.644678] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-14T21:07:36.859474] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:07:36.859809] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-14T21:07:37.555755] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T21:07:37.557703] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-14T21:07:37.596263] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T21:07:37.602127] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-14T21:07:38.010134] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T21:07:38.132442] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T21:07:38.169590] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T21:07:38.358073] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-14T21:07:38.547228] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T21:07:39.158060] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-14T21:07:39.958051] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-14T21:07:40.131517] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T21:07:40.200922] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T21:07:40.758068] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-14T21:07:41.209077] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T21:07:41.298275] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-14T21:07:41.558120] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-14T21:07:42.358095] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-14T21:07:43.063672] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T21:07:43.117476] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T21:07:43.158025] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-14T21:07:43.958071] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-14T21:07:44.758104] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-14T21:07:44.880924] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:07:44.930244] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T21:07:45.413987] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:07:45.558057] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-14T21:07:46.358063] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-14T21:07:46.752517] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T21:07:47.158066] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-14T21:07:47.496225] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T21:07:47.958043] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-14T21:07:48.758095] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-14T21:07:48.931031] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T21:07:49.141148] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T21:07:49.558100] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-14T21:07:50.002628] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T21:07:50.358067] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-14T21:07:51.098261] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:07:51.158042] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-14T21:07:51.958081] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-14T21:07:52.252367] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T21:07:52.309575] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T21:07:52.721615] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T21:07:52.758077] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-14T21:07:53.558084] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-14T21:07:53.979844] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T21:07:54.194467] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-14T21:07:54.358084] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-14T21:07:55.100414] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T21:07:55.158091] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-14T21:07:55.958135] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-14T21:07:56.654463] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T21:07:56.758050] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-14T21:07:56.997140] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T21:07:57.386601] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T21:07:57.558058] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-14T21:07:58.197978] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T21:07:58.358072] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-14T21:07:59.158063] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-14T21:07:59.958041] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-14T21:08:00.294531] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T21:08:00.325298] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T21:08:00.582065] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T21:08:00.585817] [INFO ] [REMOTE ] R: Full fetch complete (42115 records). [2025-10-14T21:08:00.585961] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-14T21:08:00.586629] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:08:00.586769] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:08:00.586814] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:08:00.586858] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-14T21:08:00.586956] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-14T21:08:00.587017] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-14T21:08:00.587065] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-14T21:08:00.587132] [INFO ] [MAIN ] Update Progress: 1761/2369 symbols completed. R took 26.2s. Estimated remaining: 1h 25m 36s. Rate: 7.1 symbols/min [2025-10-14T21:08:00.770391] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-14T21:08:00.775193] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:00.776991] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-14T21:08:00.777044] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-14T21:08:00.777179] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-14T21:08:00.777226] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-14T21:08:00.777270] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-14T21:08:00.777365] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-14T21:08:01.200795] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:01.558113] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-14T21:08:02.358115] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-14T21:08:02.884004] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T21:08:02.922272] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-14T21:08:03.158067] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-14T21:08:03.941396] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T21:08:03.958032] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-14T21:08:04.270546] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T21:08:04.606191] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T21:08:04.607719] [INFO ] [REMOTE ] QVCD: Full fetch complete (6309 records). [2025-10-14T21:08:04.607801] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-14T21:08:04.758733] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-14T21:08:04.995830] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-14T21:08:04.995955] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-14T21:08:04.996247] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-14T21:08:04.996291] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-14T21:08:04.996734] [DEBUG] [LOCAL ] QVCD: Trimmed 6309 records to 4713 (keeping 200 days of data) [2025-10-14T21:08:05.025973] [DEBUG] [LOCAL ] QVCD: Primary data saved (4713 records). [2025-10-14T21:08:05.026090] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-14T21:08:05.026185] [INFO ] [MAIN ] Update Progress: 1762/2369 symbols completed. QVCD took 30.7s. Estimated remaining: 1h 25m 27s. Rate: 7.1 symbols/min [2025-10-14T21:08:05.201983] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:05.202220] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-14T21:08:05.202258] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-14T21:08:05.202380] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-14T21:08:05.202423] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-14T21:08:05.202464] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-14T21:08:05.202497] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-14T21:08:05.578564] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-14T21:08:05.584963] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:06.033572] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T21:08:06.358066] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-14T21:08:07.158086] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-14T21:08:07.447170] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-14T21:08:07.488045] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T21:08:07.885434] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T21:08:07.889361] [INFO ] [REMOTE ] RA: Full fetch complete (31667 records). [2025-10-14T21:08:07.889620] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-14T21:08:07.890518] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:08:07.890615] [FATAL] [MAIN ] RA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:08:07.890699] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:08:07.890778] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-14T21:08:07.890852] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-14T21:08:07.890890] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-14T21:08:07.890930] [DEBUG] [LOCAL ] RA: No derivative data file found to delete. [2025-10-14T21:08:07.890996] [INFO ] [MAIN ] Update Progress: 1763/2369 symbols completed. RA took 33.5s. Estimated remaining: 1h 25m 16s. Rate: 7.1 symbols/min [2025-10-14T21:08:07.963230] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-14T21:08:08.079013] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:08.079330] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-14T21:08:08.079379] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-14T21:08:08.079510] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-14T21:08:08.079552] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-14T21:08:08.079592] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-14T21:08:08.079624] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-14T21:08:08.457752] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:08.758130] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-14T21:08:09.558065] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-14T21:08:10.223404] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T21:08:10.294604] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T21:08:10.358029] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-14T21:08:11.158058] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-14T21:08:11.191039] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T21:08:11.589819] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T21:08:11.958074] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-14T21:08:12.066897] [DEBUG] [REMOTE ] RBA: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-14T21:08:12.067116] [WARN ] [REMOTE ] RBA: No data returned for month 2025-01 [2025-10-14T21:08:12.067199] [FATAL] [REMOTE ] RBA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:08:12.067272] [FATAL] [MAIN ] RBA: Failed to fetch primary data. [2025-10-14T21:08:12.067305] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:08:12.067367] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-14T21:08:12.067424] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-14T21:08:12.067458] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-14T21:08:12.067499] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-14T21:08:12.067544] [INFO ] [MAIN ] Update Progress: 1764/2369 symbols completed. RBA took 4.2s. Estimated remaining: 1h 25m 6s. Rate: 7.1 symbols/min [2025-10-14T21:08:12.238868] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:12.239079] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-14T21:08:12.239124] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-14T21:08:12.239230] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-14T21:08:12.239270] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-14T21:08:12.239310] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-14T21:08:12.239340] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-14T21:08:12.619255] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:12.624097] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T21:08:12.758096] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-14T21:08:13.558070] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-14T21:08:14.184595] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T21:08:14.358097] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-14T21:08:14.378274] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T21:08:15.158052] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-14T21:08:15.959579] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-14T21:08:15.968337] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T21:08:16.201761] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T21:08:16.758093] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-14T21:08:17.558051] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-14T21:08:17.881820] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T21:08:17.885694] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T21:08:18.358043] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-14T21:08:19.121336] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T21:08:19.158095] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-14T21:08:19.765685] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T21:08:19.958052] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-14T21:08:20.259395] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T21:08:20.758151] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-14T21:08:21.558054] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-14T21:08:22.072781] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-14T21:08:22.108776] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T21:08:22.358081] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-14T21:08:23.158100] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-14T21:08:23.197507] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T21:08:23.731113] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T21:08:23.958044] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-14T21:08:24.273828] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T21:08:24.758060] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-14T21:08:25.151165] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T21:08:25.558044] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-14T21:08:25.843545] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T21:08:26.358067] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-14T21:08:27.158077] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-14T21:08:27.190134] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:08:27.453717] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T21:08:27.958085] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-14T21:08:28.680691] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T21:08:28.704351] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T21:08:28.710311] [INFO ] [REMOTE ] QXO: Full fetch complete (75665 records). [2025-10-14T21:08:28.710462] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-14T21:08:28.711286] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:08:28.711380] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:08:28.711424] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:08:28.711499] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-14T21:08:28.711572] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-14T21:08:28.711609] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-14T21:08:28.711682] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-14T21:08:28.711764] [INFO ] [MAIN ] Update Progress: 1765/2369 symbols completed. QXO took 54.4s. Estimated remaining: 1h 25m 1s. Rate: 7.1 symbols/min [2025-10-14T21:08:28.765982] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-14T21:08:28.890440] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:28.890665] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-14T21:08:28.890722] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-14T21:08:28.890830] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-14T21:08:28.890871] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-14T21:08:28.890910] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-14T21:08:28.890941] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-14T21:08:29.240551] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:29.558066] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-14T21:08:29.691999] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T21:08:30.358051] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-14T21:08:30.387003] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T21:08:31.158125] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-14T21:08:31.700606] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T21:08:31.705209] [INFO ] [REMOTE ] RAMP: Full fetch complete (53954 records). [2025-10-14T21:08:31.705323] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-14T21:08:31.706042] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:08:31.706138] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:08:31.706213] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:08:31.706303] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-14T21:08:31.706379] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-14T21:08:31.706416] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-14T21:08:31.706456] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-14T21:08:31.706513] [INFO ] [MAIN ] Update Progress: 1766/2369 symbols completed. RAMP took 26.7s. Estimated remaining: 1h 24m 50s. Rate: 7.1 symbols/min [2025-10-14T21:08:31.886872] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:31.894440] [DEBUG] [LOCAL ] RBOT: Loaded 5922 existing records from primary storage. [2025-10-14T21:08:31.894687] [INFO ] [MAIN ] RBOT: Loaded 5922 existing records. [2025-10-14T21:08:31.963145] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-14T21:08:32.098991] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T21:08:32.104967] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:08:32.111787] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-14T21:08:32.111867] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-14T21:08:32.112396] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-14T21:08:32.112458] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-14T21:08:32.464800] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:32.758120] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-14T21:08:33.558062] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-14T21:08:33.744147] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T21:08:34.358044] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-14T21:08:34.402080] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-14T21:08:34.443816] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:08:35.123298] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T21:08:35.158091] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-14T21:08:35.713946] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T21:08:35.716105] [INFO ] [REMOTE ] RBC: Full fetch complete (21474 records). [2025-10-14T21:08:35.716182] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-14T21:08:35.716614] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:08:35.716731] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:08:35.716802] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:08:35.716872] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-14T21:08:35.716934] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-14T21:08:35.716969] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-14T21:08:35.717008] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-14T21:08:35.717059] [INFO ] [MAIN ] Update Progress: 1767/2369 symbols completed. RBC took 23.6s. Estimated remaining: 1h 24m 40s. Rate: 7.1 symbols/min [2025-10-14T21:08:35.886346] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:35.886473] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-14T21:08:35.886508] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-14T21:08:35.886616] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-14T21:08:35.886685] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-14T21:08:35.886759] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-14T21:08:35.886804] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-14T21:08:35.963187] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-14T21:08:36.249425] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:36.750805] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T21:08:36.758022] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-14T21:08:37.527494] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T21:08:37.558029] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-14T21:08:38.358041] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-14T21:08:39.158102] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-14T21:08:39.682353] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-14T21:08:39.949791] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T21:08:39.958015] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-14T21:08:40.758091] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-14T21:08:41.092507] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T21:08:41.151753] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T21:08:41.535067] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-14T21:08:41.558076] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-14T21:08:42.213238] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:08:42.358040] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-14T21:08:42.952440] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T21:08:43.158037] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-14T21:08:43.958102] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-14T21:08:44.539420] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T21:08:44.758063] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-14T21:08:45.353828] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-14T21:08:45.558062] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-14T21:08:45.881920] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-14T21:08:45.886403] [INFO ] [REMOTE ] RACE: Full fetch complete (48103 records). [2025-10-14T21:08:45.886545] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-14T21:08:45.887142] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:08:45.887227] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:08:45.887268] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:08:45.887305] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-14T21:08:45.887360] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-14T21:08:45.887394] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-14T21:08:45.887432] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-14T21:08:45.887485] [INFO ] [MAIN ] Update Progress: 1768/2369 symbols completed. RACE took 45.3s. Estimated remaining: 1h 24m 33s. Rate: 7.1 symbols/min [2025-10-14T21:08:46.071065] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:46.112452] [DEBUG] [LOCAL ] RC: Loaded 48895 existing records from primary storage. [2025-10-14T21:08:46.112917] [INFO ] [MAIN ] RC: Loaded 48895 existing records. [2025-10-14T21:08:46.295359] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:08:46.295712] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-14T21:08:46.295850] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-14T21:08:46.296856] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-14T21:08:46.296963] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-14T21:08:46.366089] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-14T21:08:46.486211] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T21:08:46.695030] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:08:47.158028] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-14T21:08:47.958067] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-14T21:08:48.569137] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-14T21:08:48.758026] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-14T21:08:48.840949] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T21:08:49.372345] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T21:08:49.558045] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-14T21:08:50.358082] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-14T21:08:50.527277] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T21:08:51.061130] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T21:08:51.149123] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T21:08:51.160242] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-14T21:08:51.958086] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-14T21:08:51.975542] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T21:08:52.758127] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-14T21:08:53.558121] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-14T21:08:53.939978] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T21:08:54.333795] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T21:08:54.358047] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-14T21:08:55.158074] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-14T21:08:55.217059] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-14T21:08:55.958077] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-14T21:08:56.473146] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-14T21:08:56.758107] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-14T21:08:56.879882] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T21:08:57.558087] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-14T21:08:57.936508] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-14T21:08:58.358094] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-14T21:08:58.894978] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-14T21:08:58.974428] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T21:08:59.158036] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-14T21:08:59.287256] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T21:08:59.290830] [INFO ] [REMOTE ] RBOT: Full fetch complete (9217 records). [2025-10-14T21:08:59.290919] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-14T21:08:59.657635] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-14T21:08:59.657742] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-14T21:08:59.657979] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-14T21:08:59.658016] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-14T21:08:59.658412] [DEBUG] [LOCAL ] RBOT: Trimmed 9217 records to 6003 (keeping 200 days of data) [2025-10-14T21:08:59.691149] [DEBUG] [LOCAL ] RBOT: Primary data saved (6003 records). [2025-10-14T21:08:59.691236] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-14T21:08:59.691308] [INFO ] [MAIN ] Update Progress: 1769/2369 symbols completed. RBOT took 28.0s. Estimated remaining: 1h 24m 26s. Rate: 7.1 symbols/min [2025-10-14T21:08:59.861248] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:08:59.862514] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-14T21:08:59.862566] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-14T21:08:59.862827] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-14T21:08:59.862881] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-14T21:08:59.863091] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-14T21:08:59.863139] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-14T21:08:59.962148] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-14T21:09:00.215006] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:00.758052] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-14T21:09:01.538102] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-14T21:09:01.558047] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-14T21:09:02.358098] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-14T21:09:02.525665] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-14T21:09:02.666404] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-14T21:09:02.919577] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T21:09:03.158061] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-14T21:09:03.671364] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T21:09:03.958138] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-14T21:09:04.526980] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T21:09:04.758089] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-14T21:09:05.558121] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-14T21:09:05.791709] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-14T21:09:06.358121] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-14T21:09:06.708023] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T21:09:07.043075] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T21:09:07.158039] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-14T21:09:07.490472] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T21:09:07.872537] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T21:09:07.958037] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-14T21:09:08.648908] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T21:09:08.758067] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-14T21:09:09.558086] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-14T21:09:10.254717] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:09:10.260165] [INFO ] [REMOTE ] RBRK: Full fetch complete (76291 records). [2025-10-14T21:09:10.260310] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-14T21:09:10.261077] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:09:10.261171] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:09:10.261213] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:09:10.261280] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-14T21:09:10.261345] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-14T21:09:10.261421] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-14T21:09:10.261472] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-14T21:09:10.261528] [INFO ] [MAIN ] Update Progress: 1770/2369 symbols completed. RBRK took 34.5s. Estimated remaining: 1h 24m 18s. Rate: 7.1 symbols/min [2025-10-14T21:09:10.361267] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-14T21:09:10.433276] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:10.433419] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-14T21:09:10.433456] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-14T21:09:10.433560] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-14T21:09:10.433600] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-14T21:09:10.433660] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-14T21:09:10.433716] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-14T21:09:10.792873] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:10.822424] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-14T21:09:11.048065] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T21:09:11.158104] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-14T21:09:11.958039] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-14T21:09:12.019629] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:09:12.025020] [INFO ] [REMOTE ] RBLX: Full fetch complete (77495 records). [2025-10-14T21:09:12.025131] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-14T21:09:12.025795] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:09:12.025882] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:09:12.025925] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:09:12.025964] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-14T21:09:12.026018] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-14T21:09:12.026051] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-14T21:09:12.026089] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-14T21:09:12.026145] [INFO ] [MAIN ] Update Progress: 1771/2369 symbols completed. RBLX took 43.3s. Estimated remaining: 1h 24m 7s. Rate: 7.1 symbols/min [2025-10-14T21:09:12.193821] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:12.194066] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-14T21:09:12.194835] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-14T21:09:12.194951] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-14T21:09:12.194994] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-14T21:09:12.195036] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-14T21:09:12.195079] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-14T21:09:12.552577] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:12.758066] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-14T21:09:12.868799] [DEBUG] [REMOTE ] RCD: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-14T21:09:12.869111] [WARN ] [REMOTE ] RCD: No data returned for month 2024-12 [2025-10-14T21:09:12.869215] [FATAL] [REMOTE ] RCD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:09:12.869270] [FATAL] [MAIN ] RCD: Failed to fetch primary data. [2025-10-14T21:09:12.869303] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:09:12.869384] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-14T21:09:12.869445] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-14T21:09:12.869480] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-14T21:09:12.869518] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-14T21:09:12.869561] [INFO ] [MAIN ] Update Progress: 1772/2369 symbols completed. RCD took 2.6s. Estimated remaining: 1h 23m 56s. Rate: 7.1 symbols/min [2025-10-14T21:09:13.036287] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:13.036423] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-14T21:09:13.036460] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-14T21:09:13.036565] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-14T21:09:13.036605] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-14T21:09:13.036669] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-14T21:09:13.036722] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-14T21:09:13.423620] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:13.558112] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-14T21:09:13.891090] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T21:09:14.358133] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-14T21:09:15.158087] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-14T21:09:15.597844] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T21:09:15.799544] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T21:09:15.958042] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-14T21:09:16.758095] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-14T21:09:16.892804] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T21:09:17.249880] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T21:09:17.558063] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-14T21:09:17.828604] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T21:09:18.358075] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-14T21:09:19.040509] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T21:09:19.158050] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-14T21:09:19.958102] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-14T21:09:20.189506] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T21:09:20.334923] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-14T21:09:20.767226] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-14T21:09:20.772190] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T21:09:21.558057] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-14T21:09:22.358086] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-14T21:09:22.744400] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-14T21:09:22.949366] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T21:09:23.158052] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-14T21:09:23.958039] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-14T21:09:24.194960] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T21:09:24.758136] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-14T21:09:25.179270] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-14T21:09:25.457960] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T21:09:25.508413] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-14T21:09:25.558027] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-14T21:09:26.358065] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-14T21:09:27.158036] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-14T21:09:27.256458] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T21:09:27.524318] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T21:09:27.958145] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-14T21:09:28.709391] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T21:09:28.715073] [INFO ] [REMOTE ] RC: Full fetch complete (71066 records). [2025-10-14T21:09:28.715181] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-14T21:09:28.769037] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-14T21:09:28.987481] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T21:09:29.152811] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-14T21:09:29.152888] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-14T21:09:29.153968] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-14T21:09:29.154029] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-14T21:09:29.155370] [DEBUG] [LOCAL ] RC: Trimmed 71066 records to 48924 (keeping 200 days of data) [2025-10-14T21:09:29.329364] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T21:09:29.438741] [DEBUG] [LOCAL ] RC: Primary data saved (48924 records). [2025-10-14T21:09:29.438880] [INFO ] [MAIN ] RC: Full history saved. [2025-10-14T21:09:29.438978] [INFO ] [MAIN ] Update Progress: 1773/2369 symbols completed. RC took 43.6s. Estimated remaining: 1h 23m 51s. Rate: 7.1 symbols/min [2025-10-14T21:09:29.563139] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-14T21:09:29.612587] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:29.624912] [DEBUG] [LOCAL ] RCS: Loaded 12146 existing records from primary storage. [2025-10-14T21:09:29.625127] [INFO ] [MAIN ] RCS: Loaded 12146 existing records. [2025-10-14T21:09:29.799103] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:09:29.799342] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-14T21:09:29.799394] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-14T21:09:29.799967] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-14T21:09:29.800026] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-14T21:09:29.954093] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T21:09:29.965293] [INFO ] [REMOTE ] RCB: Full fetch complete (3724 records). [2025-10-14T21:09:29.965886] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-14T21:09:29.991976] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:09:30.052574] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:09:30.069711] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:09:30.091447] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-14T21:09:30.091639] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-14T21:09:30.091731] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-14T21:09:30.102701] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-14T21:09:30.113052] [INFO ] [MAIN ] Update Progress: 1774/2369 symbols completed. RCB took 30.4s. Estimated remaining: 1h 23m 40s. Rate: 7.1 symbols/min [2025-10-14T21:09:30.269321] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:30.337748] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:30.337891] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-14T21:09:30.337928] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-14T21:09:30.338032] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-14T21:09:30.338071] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-14T21:09:30.338112] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-14T21:09:30.338142] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-14T21:09:30.366754] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-14T21:09:30.715486] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:31.158038] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-14T21:09:31.510938] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T21:09:31.958063] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-14T21:09:32.623060] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T21:09:32.758049] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-14T21:09:33.347548] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T21:09:33.558066] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-14T21:09:33.840150] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:09:34.358105] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-14T21:09:35.158041] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-14T21:09:35.343555] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T21:09:35.784087] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T21:09:35.958092] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-14T21:09:36.758075] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-14T21:09:37.178818] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T21:09:37.446954] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T21:09:37.558023] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-14T21:09:38.076386] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T21:09:38.358074] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-14T21:09:39.139078] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T21:09:39.158029] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-14T21:09:39.958030] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-14T21:09:40.446470] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T21:09:40.529538] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T21:09:40.758038] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-14T21:09:41.057711] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T21:09:41.558056] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-14T21:09:42.282841] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T21:09:42.358027] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-14T21:09:43.158051] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-14T21:09:43.835550] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-14T21:09:43.880198] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T21:09:43.882088] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T21:09:43.958027] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-14T21:09:44.758074] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-14T21:09:45.346417] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T21:09:45.558051] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-14T21:09:45.659411] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T21:09:46.358125] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-14T21:09:47.011582] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T21:09:47.158035] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-14T21:09:47.243003] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T21:09:47.885577] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T21:09:47.958032] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-14T21:09:48.763152] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-14T21:09:48.770031] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T21:09:48.774792] [INFO ] [REMOTE ] RCUS: Full fetch complete (60191 records). [2025-10-14T21:09:48.774873] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-14T21:09:48.775481] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:09:48.775568] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:09:48.775609] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:09:48.775694] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-14T21:09:48.775758] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-14T21:09:48.775793] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-14T21:09:48.775831] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-14T21:09:48.775883] [INFO ] [MAIN ] Update Progress: 1775/2369 symbols completed. RCUS took 18.6s. Estimated remaining: 1h 23m 35s. Rate: 7.1 symbols/min [2025-10-14T21:09:48.945238] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:48.945406] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-14T21:09:48.945442] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-14T21:09:48.945550] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-14T21:09:48.945590] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-14T21:09:48.945629] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-14T21:09:48.945695] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-14T21:09:49.296933] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:49.558029] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-14T21:09:49.692828] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T21:09:50.358056] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-14T21:09:51.158072] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-14T21:09:51.958144] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-14T21:09:52.006595] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-14T21:09:52.050689] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T21:09:52.532707] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-14T21:09:52.758092] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-14T21:09:53.558081] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-14T21:09:53.703188] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T21:09:53.704582] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T21:09:54.358076] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-14T21:09:54.523530] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T21:09:55.158082] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-14T21:09:55.843481] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T21:09:55.849400] [INFO ] [REMOTE ] RCI: Full fetch complete (70260 records). [2025-10-14T21:09:55.849635] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-14T21:09:55.850519] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:09:55.850676] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:09:55.850747] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:09:55.850801] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-14T21:09:55.850869] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-14T21:09:55.850906] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-14T21:09:55.850945] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-14T21:09:55.851016] [INFO ] [MAIN ] Update Progress: 1776/2369 symbols completed. RCI took 43.8s. Estimated remaining: 1h 23m 26s. Rate: 7.1 symbols/min [2025-10-14T21:09:55.963266] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-14T21:09:56.033487] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:09:56.033900] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-14T21:09:56.033948] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-14T21:09:56.034080] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-14T21:09:56.034123] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-14T21:09:56.034163] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-14T21:09:56.034195] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-14T21:09:56.404152] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:09:56.758091] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-14T21:09:56.818336] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-14T21:09:57.046325] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T21:09:57.558101] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-14T21:09:58.292138] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T21:09:58.358046] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-14T21:09:59.158110] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-14T21:09:59.950117] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T21:09:59.959178] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-14T21:10:00.162503] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T21:10:00.165320] [INFO ] [REMOTE ] RCS: Full fetch complete (19221 records). [2025-10-14T21:10:00.165484] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-14T21:10:00.444502] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-10-14T21:10:00.598394] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-14T21:10:00.598526] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-14T21:10:00.599092] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-14T21:10:00.599211] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-14T21:10:00.612639] [DEBUG] [LOCAL ] RCS: Trimmed 19221 records to 12206 (keeping 200 days of data) [2025-10-14T21:10:00.613184] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T21:10:00.619202] [INFO ] [REMOTE ] RCL: Full fetch complete (75065 records). [2025-10-14T21:10:00.646450] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-14T21:10:00.653104] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:10:00.676675] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:10:00.677349] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:10:00.678275] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-14T21:10:00.679041] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-14T21:10:00.680826] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-14T21:10:00.684376] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-14T21:10:00.685051] [INFO ] [MAIN ] Update Progress: 1777/2369 symbols completed. RCL took 47.8s. Estimated remaining: 1h 23m 16s. Rate: 7.1 symbols/min [2025-10-14T21:10:00.763964] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-14T21:10:00.763873] [DEBUG] [LOCAL ] RCS: Primary data saved (12206 records). [2025-10-14T21:10:00.769457] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-14T21:10:00.774812] [INFO ] [MAIN ] Update Progress: 1778/2369 symbols completed. RCS took 31.3s. Estimated remaining: 1h 23m 5s. Rate: 7.1 symbols/min [2025-10-14T21:10:01.034999] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:01.056902] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-14T21:10:01.056975] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-14T21:10:01.057109] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-14T21:10:01.057155] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-14T21:10:01.057196] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-14T21:10:01.057226] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-14T21:10:01.105719] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:01.155692] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-14T21:10:01.171847] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-14T21:10:01.177702] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-14T21:10:01.198208] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-14T21:10:01.216219] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-14T21:10:01.224310] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-14T21:10:01.636179] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:01.572674] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-14T21:10:01.844276] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:02.358101] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-14T21:10:02.398131] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T21:10:03.158080] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-14T21:10:03.901268] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-14T21:10:03.958062] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-14T21:10:04.418984] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-14T21:10:04.758080] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-14T21:10:04.935228] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T21:10:05.558067] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-14T21:10:06.354744] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-14T21:10:06.367717] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-14T21:10:06.560497] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T21:10:07.158075] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-14T21:10:07.427900] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T21:10:07.958068] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-14T21:10:08.137543] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T21:10:08.758040] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-14T21:10:08.957031] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T21:10:09.558062] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-14T21:10:10.363180] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-14T21:10:10.375807] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T21:10:10.509411] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-14T21:10:11.158099] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-14T21:10:11.759577] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T21:10:11.821303] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-14T21:10:11.958063] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-14T21:10:12.758065] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-14T21:10:12.787964] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T21:10:13.558102] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-14T21:10:14.157380] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-14T21:10:14.358039] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-14T21:10:14.542361] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T21:10:15.158132] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-14T21:10:15.312926] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T21:10:15.958050] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-14T21:10:16.174765] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T21:10:16.758065] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-14T21:10:17.558044] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-14T21:10:17.666583] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-14T21:10:17.705003] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T21:10:18.358082] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-14T21:10:18.859152] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T21:10:18.910193] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-14T21:10:19.158192] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-14T21:10:19.958061] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-14T21:10:20.042287] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T21:10:20.758043] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-14T21:10:20.896556] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T21:10:21.284255] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-14T21:10:21.558065] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-14T21:10:22.154810] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T21:10:22.356917] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T21:10:22.360807] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-14T21:10:22.362367] [INFO ] [REMOTE ] RDN: Full fetch complete (65699 records). [2025-10-14T21:10:22.362440] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-14T21:10:22.363142] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:10:22.363305] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:10:22.363377] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:10:22.363445] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-14T21:10:22.363503] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-14T21:10:22.363536] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-14T21:10:22.363573] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-14T21:10:22.363627] [INFO ] [MAIN ] Update Progress: 1779/2369 symbols completed. RDN took 26.5s. Estimated remaining: 1h 23m 1s. Rate: 7.1 symbols/min [2025-10-14T21:10:22.536518] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:22.536785] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-14T21:10:22.536840] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-14T21:10:22.536946] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-14T21:10:22.536987] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-14T21:10:22.537027] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-14T21:10:22.537058] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-14T21:10:22.900462] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:23.158045] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-14T21:10:23.958065] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-14T21:10:24.280951] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T21:10:24.716298] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T21:10:24.758029] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-14T21:10:25.558071] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-14T21:10:26.239260] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T21:10:26.293300] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-14T21:10:26.358043] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-14T21:10:27.158067] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-14T21:10:27.958080] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-14T21:10:28.166772] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-14T21:10:28.763159] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-14T21:10:28.780246] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-14T21:10:28.846855] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T21:10:29.551528] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T21:10:29.559380] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-14T21:10:30.358064] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-14T21:10:31.131177] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T21:10:31.158040] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-14T21:10:31.485531] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-14T21:10:31.678314] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T21:10:31.830444] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T21:10:31.835302] [INFO ] [REMOTE ] RDY: Full fetch complete (68551 records). [2025-10-14T21:10:31.835405] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-14T21:10:31.836165] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:10:31.836253] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:10:31.836294] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:10:31.836331] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-14T21:10:31.836384] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-14T21:10:31.836418] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-14T21:10:31.836466] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-14T21:10:31.836519] [INFO ] [MAIN ] Update Progress: 1780/2369 symbols completed. RDY took 31.1s. Estimated remaining: 1h 22m 53s. Rate: 7.1 symbols/min [2025-10-14T21:10:31.963229] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-14T21:10:32.010020] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:32.051011] [DEBUG] [LOCAL ] RERE: Loaded 41410 existing records from primary storage. [2025-10-14T21:10:32.051287] [INFO ] [MAIN ] RERE: Loaded 41410 existing records. [2025-10-14T21:10:32.230030] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:10:32.230312] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-14T21:10:32.230366] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-14T21:10:32.230725] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-14T21:10:32.230782] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-14T21:10:32.588320] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:32.758047] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-14T21:10:33.558077] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-14T21:10:34.358038] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-14T21:10:34.389393] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-14T21:10:34.657004] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T21:10:35.158059] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-14T21:10:35.958044] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-14T21:10:36.133782] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T21:10:36.169913] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-14T21:10:36.347118] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T21:10:36.353272] [INFO ] [REMOTE ] RDDT: Full fetch complete (77537 records). [2025-10-14T21:10:36.353408] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-14T21:10:36.354116] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:10:36.354200] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:10:36.354244] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:10:36.354312] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-14T21:10:36.354375] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-14T21:10:36.354412] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-14T21:10:36.354456] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-14T21:10:36.354512] [INFO ] [MAIN ] Update Progress: 1781/2369 symbols completed. RDDT took 47.6s. Estimated remaining: 1h 22m 43s. Rate: 7.1 symbols/min [2025-10-14T21:10:36.547380] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:36.590224] [DEBUG] [LOCAL ] RES: Loaded 46986 existing records from primary storage. [2025-10-14T21:10:36.590507] [INFO ] [MAIN ] RES: Loaded 46986 existing records. [2025-10-14T21:10:36.763167] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-14T21:10:36.767976] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:10:36.768928] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-14T21:10:36.769072] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-14T21:10:36.769495] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-14T21:10:36.769574] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-14T21:10:37.135240] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:37.160020] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T21:10:37.558085] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-14T21:10:38.188959] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T21:10:38.358064] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-14T21:10:39.158059] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-14T21:10:39.206626] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T21:10:39.958055] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-14T21:10:40.060248] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T21:10:40.616198] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T21:10:40.642837] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:10:40.648295] [INFO ] [REMOTE ] RDW: Full fetch complete (75012 records). [2025-10-14T21:10:40.648403] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-14T21:10:40.649156] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:10:40.649261] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:10:40.649333] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:10:40.649420] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-14T21:10:40.649504] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-14T21:10:40.649561] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-14T21:10:40.649606] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-14T21:10:40.649693] [INFO ] [MAIN ] Update Progress: 1782/2369 symbols completed. RDW took 40.0s. Estimated remaining: 1h 22m 33s. Rate: 7.1 symbols/min [2025-10-14T21:10:40.763171] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-14T21:10:40.822500] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:40.822609] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-14T21:10:40.822676] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-14T21:10:40.822811] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-14T21:10:40.822866] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-14T21:10:40.822909] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-14T21:10:40.822942] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-14T21:10:41.172077] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:41.558059] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-14T21:10:42.358055] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-14T21:10:42.526401] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:10:42.919226] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:10:43.158063] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-14T21:10:43.958115] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-14T21:10:44.382062] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T21:10:44.758091] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-14T21:10:44.874635] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T21:10:44.977144] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T21:10:45.558086] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-14T21:10:46.322303] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T21:10:46.358021] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-14T21:10:47.069769] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T21:10:47.158059] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-14T21:10:47.284055] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T21:10:47.958062] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-14T21:10:48.758132] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-14T21:10:48.927219] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T21:10:49.385779] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T21:10:49.558073] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-14T21:10:49.895787] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T21:10:50.358075] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-14T21:10:51.056285] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T21:10:51.106869] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T21:10:51.112063] [INFO ] [REMOTE ] RELX: Full fetch complete (67674 records). [2025-10-14T21:10:51.112184] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-14T21:10:51.112843] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:10:51.112929] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:10:51.112970] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:10:51.113035] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-14T21:10:51.113096] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-14T21:10:51.113130] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-14T21:10:51.113168] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-14T21:10:51.113221] [INFO ] [MAIN ] Update Progress: 1783/2369 symbols completed. RELX took 28.7s. Estimated remaining: 1h 22m 25s. Rate: 7.1 symbols/min [2025-10-14T21:10:51.163135] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-14T21:10:51.292972] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:10:51.293130] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-14T21:10:51.293166] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-14T21:10:51.293273] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-14T21:10:51.293313] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-14T21:10:51.293352] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-14T21:10:51.293384] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-14T21:10:51.635860] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:10:51.958065] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-14T21:10:52.590337] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T21:10:52.758123] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-14T21:10:53.421983] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T21:10:53.558187] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-14T21:10:54.358108] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-14T21:10:54.391488] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T21:10:55.090154] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T21:10:55.158037] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-14T21:10:55.563981] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T21:10:55.958057] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-14T21:10:56.758111] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-14T21:10:56.866379] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T21:10:57.034754] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:10:57.558083] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-14T21:10:58.276313] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T21:10:58.294707] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T21:10:58.358084] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-14T21:10:59.158129] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-14T21:10:59.352129] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T21:10:59.958087] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-14T21:11:00.758109] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-14T21:11:00.850502] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T21:11:01.313805] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T21:11:01.543028] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T21:11:01.558025] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-14T21:11:02.358084] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-14T21:11:03.169897] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-14T21:11:03.172695] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T21:11:03.958054] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-14T21:11:04.195502] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T21:11:04.244700] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T21:11:04.758110] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-14T21:11:05.538581] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:11:05.558023] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-14T21:11:06.358084] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-14T21:11:06.418077] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T21:11:07.090326] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T21:11:07.158091] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-14T21:11:07.366278] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:11:07.958120] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-14T21:11:08.760135] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-14T21:11:08.765152] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T21:11:09.432987] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T21:11:09.438159] [INFO ] [REMOTE ] RERE: Full fetch complete (57852 records). [2025-10-14T21:11:09.438294] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-14T21:11:09.559527] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-14T21:11:09.822120] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:11:09.875668] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-14T21:11:09.875754] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-14T21:11:09.876741] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-14T21:11:09.876800] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-14T21:11:09.877994] [DEBUG] [LOCAL ] RERE: Trimmed 57852 records to 41504 (keeping 200 days of data) [2025-10-14T21:11:10.102018] [DEBUG] [LOCAL ] RERE: Primary data saved (41504 records). [2025-10-14T21:11:10.102134] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-14T21:11:10.102203] [INFO ] [MAIN ] Update Progress: 1784/2369 symbols completed. RERE took 38.3s. Estimated remaining: 1h 22m 21s. Rate: 7.1 symbols/min [2025-10-14T21:11:10.269449] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:10.269660] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-14T21:11:10.269718] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-14T21:11:10.269852] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-14T21:11:10.269892] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-14T21:11:10.269932] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-14T21:11:10.269963] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-14T21:11:10.367905] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-14T21:11:10.644171] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:11.149515] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T21:11:11.158158] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-14T21:11:11.214758] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T21:11:11.219806] [INFO ] [REMOTE ] RES: Full fetch complete (68741 records). [2025-10-14T21:11:11.219909] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-14T21:11:11.643981] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-14T21:11:11.644063] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-14T21:11:11.645247] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-14T21:11:11.645319] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-14T21:11:11.646781] [DEBUG] [LOCAL ] RES: Trimmed 68741 records to 46978 (keeping 200 days of data) [2025-10-14T21:11:11.917523] [DEBUG] [LOCAL ] RES: Primary data saved (46978 records). [2025-10-14T21:11:11.917711] [INFO ] [MAIN ] RES: Full history saved. [2025-10-14T21:11:11.917801] [INFO ] [MAIN ] Update Progress: 1785/2369 symbols completed. RES took 35.6s. Estimated remaining: 1h 22m 10s. Rate: 7.1 symbols/min [2025-10-14T21:11:11.963189] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-14T21:11:12.099978] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:12.100143] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-14T21:11:12.100182] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-14T21:11:12.100299] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-14T21:11:12.100340] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-14T21:11:12.100382] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-14T21:11:12.100417] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-14T21:11:12.477724] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:12.758107] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-14T21:11:12.798405] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T21:11:13.558068] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-14T21:11:13.724524] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T21:11:13.797676] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T21:11:14.358101] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-14T21:11:14.928003] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:11:14.932202] [INFO ] [REMOTE ] REVG: Full fetch complete (57871 records). [2025-10-14T21:11:14.932333] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-14T21:11:14.933049] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:11:14.933137] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:11:14.933178] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:11:14.933246] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-14T21:11:14.933308] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-14T21:11:14.933343] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-14T21:11:14.933382] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-14T21:11:14.933438] [INFO ] [MAIN ] Update Progress: 1786/2369 symbols completed. REVG took 34.3s. Estimated remaining: 1h 21m 60s. Rate: 7.1 symbols/min [2025-10-14T21:11:15.120296] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:15.120610] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-14T21:11:15.120816] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-14T21:11:15.121042] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-14T21:11:15.121123] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-14T21:11:15.121281] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-14T21:11:15.121429] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-14T21:11:15.163169] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-14T21:11:15.366850] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T21:11:15.621089] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:15.958189] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-14T21:11:16.758079] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-14T21:11:17.023571] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T21:11:17.504202] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T21:11:17.558051] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-14T21:11:18.336939] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T21:11:18.358029] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-14T21:11:19.052667] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T21:11:19.158100] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-14T21:11:19.958063] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-14T21:11:20.164799] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T21:11:20.758074] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-14T21:11:21.083812] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T21:11:21.558058] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-14T21:11:21.603803] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T21:11:21.643326] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T21:11:22.358065] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-14T21:11:23.045584] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T21:11:23.126596] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T21:11:23.158019] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-14T21:11:23.958073] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-14T21:11:24.758062] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-14T21:11:25.053576] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T21:11:25.558083] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-14T21:11:25.749589] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T21:11:26.358074] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-14T21:11:26.580419] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T21:11:26.924782] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:11:26.927388] [INFO ] [REMOTE ] REX: Full fetch complete (20917 records). [2025-10-14T21:11:26.927502] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-14T21:11:26.928047] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:11:26.928134] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:11:26.928177] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:11:26.928246] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-14T21:11:26.928309] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-14T21:11:26.928344] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-14T21:11:26.928384] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-14T21:11:26.928481] [INFO ] [MAIN ] Update Progress: 1787/2369 symbols completed. REX took 35.8s. Estimated remaining: 1h 21m 52s. Rate: 7.1 symbols/min [2025-10-14T21:11:27.108256] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:27.121344] [DEBUG] [LOCAL ] RFI: Loaded 10454 existing records from primary storage. [2025-10-14T21:11:27.121620] [INFO ] [MAIN ] RFI: Loaded 10454 existing records. [2025-10-14T21:11:27.163681] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-14T21:11:27.316263] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:11:27.316519] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-14T21:11:27.316576] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-14T21:11:27.316762] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-14T21:11:27.316819] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-14T21:11:27.614405] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T21:11:27.736372] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:27.958087] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-14T21:11:28.696859] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T21:11:28.758064] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-14T21:11:29.558090] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-14T21:11:29.821401] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T21:11:30.358047] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-14T21:11:30.396992] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T21:11:30.798593] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T21:11:31.158074] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-14T21:11:31.958070] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-14T21:11:32.272572] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-14T21:11:32.758056] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-14T21:11:32.837269] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T21:11:33.332574] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T21:11:33.558076] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-14T21:11:34.358065] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-14T21:11:34.787873] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T21:11:34.931959] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T21:11:35.158021] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-14T21:11:35.379888] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T21:11:35.958051] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-14T21:11:36.758086] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-14T21:11:37.075418] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T21:11:37.503590] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T21:11:37.558054] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-14T21:11:37.716529] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T21:11:38.358042] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-14T21:11:38.500313] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T21:11:39.158046] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-14T21:11:39.305056] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T21:11:39.958060] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-14T21:11:40.758032] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-14T21:11:40.918550] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T21:11:40.920151] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T21:11:41.195689] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T21:11:41.201140] [INFO ] [REMOTE ] RF: Full fetch complete (77406 records). [2025-10-14T21:11:41.201250] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-14T21:11:41.201954] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:11:41.202039] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:11:41.202107] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:11:41.202178] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-14T21:11:41.202240] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-14T21:11:41.202292] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-14T21:11:41.202332] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-14T21:11:41.202384] [INFO ] [MAIN ] Update Progress: 1788/2369 symbols completed. RF took 26.3s. Estimated remaining: 1h 21m 46s. Rate: 7.1 symbols/min [2025-10-14T21:11:41.370727] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:41.383456] [DEBUG] [LOCAL ] RFL: Loaded 11381 existing records from primary storage. [2025-10-14T21:11:41.383680] [INFO ] [MAIN ] RFL: Loaded 11381 existing records. [2025-10-14T21:11:41.558513] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:11:41.558917] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-14T21:11:41.558691] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-14T21:11:41.559041] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-14T21:11:41.559952] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-14T21:11:41.560007] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-14T21:11:41.917369] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:42.358051] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-14T21:11:42.565790] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T21:11:43.158092] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-14T21:11:43.958054] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-14T21:11:44.078841] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T21:11:44.106139] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T21:11:44.349682] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T21:11:44.354484] [INFO ] [REMOTE ] REZI: Full fetch complete (65775 records). [2025-10-14T21:11:44.354611] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-14T21:11:44.355250] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:11:44.355332] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:11:44.355378] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:11:44.355459] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-14T21:11:44.355534] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-14T21:11:44.355581] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-14T21:11:44.355722] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-14T21:11:44.355803] [INFO ] [MAIN ] Update Progress: 1789/2369 symbols completed. REZI took 32.4s. Estimated remaining: 1h 21m 36s. Rate: 7.1 symbols/min [2025-10-14T21:11:44.523895] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:44.531334] [DEBUG] [LOCAL ] RFM: Loaded 4122 existing records from primary storage. [2025-10-14T21:11:44.531621] [INFO ] [MAIN ] RFM: Loaded 4122 existing records. [2025-10-14T21:11:44.718206] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:11:44.718436] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-14T21:11:44.718483] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-14T21:11:44.718689] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-14T21:11:44.718747] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-14T21:11:44.763291] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-14T21:11:45.084825] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:45.558047] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-14T21:11:45.790114] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T21:11:45.993045] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T21:11:46.358101] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-14T21:11:47.158084] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-14T21:11:47.254348] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T21:11:47.612857] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-14T21:11:47.958065] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-14T21:11:48.709388] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T21:11:48.758081] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-14T21:11:49.444096] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T21:11:49.558068] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-14T21:11:50.296783] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:11:50.301930] [INFO ] [REMOTE ] REXR: Full fetch complete (74929 records). [2025-10-14T21:11:50.302033] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-14T21:11:50.302698] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:11:50.302780] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:11:50.302821] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:11:50.302858] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-14T21:11:50.302930] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-14T21:11:50.302999] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-14T21:11:50.303055] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-14T21:11:50.303125] [INFO ] [MAIN ] Update Progress: 1790/2369 symbols completed. REXR took 40.2s. Estimated remaining: 1h 21m 26s. Rate: 7.1 symbols/min [2025-10-14T21:11:50.364578] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-14T21:11:50.474587] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:11:50.486758] [DEBUG] [LOCAL ] RFMZ: Loaded 8651 existing records from primary storage. [2025-10-14T21:11:50.486973] [INFO ] [MAIN ] RFMZ: Loaded 8651 existing records. [2025-10-14T21:11:50.665826] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:11:50.666232] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-14T21:11:50.666294] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-14T21:11:50.666623] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-14T21:11:50.666763] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-14T21:11:50.949173] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T21:11:51.024675] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:11:51.158037] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-14T21:11:51.958084] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-14T21:11:52.160513] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T21:11:52.758225] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-14T21:11:52.759332] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T21:11:53.419133] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T21:11:53.558063] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-14T21:11:54.310753] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T21:11:54.358066] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-14T21:11:55.158046] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-14T21:11:55.229110] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-14T21:11:55.786725] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T21:11:55.958066] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-14T21:11:56.758078] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-14T21:11:56.836962] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T21:11:57.254037] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-14T21:11:57.558063] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-14T21:11:58.358060] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-14T21:11:58.476744] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T21:11:59.129395] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T21:11:59.158025] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-14T21:11:59.958088] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-14T21:12:00.024682] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-14T21:12:00.713738] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T21:12:00.758026] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-14T21:12:01.558121] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-14T21:12:01.749828] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T21:12:02.318465] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T21:12:02.358099] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-14T21:12:03.158040] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-14T21:12:03.248600] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-14T21:12:03.958135] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-14T21:12:04.082157] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T21:12:04.758052] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-14T21:12:04.786153] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:12:04.787729] [INFO ] [REMOTE ] RFI: Full fetch complete (15481 records). [2025-10-14T21:12:04.787797] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-14T21:12:05.160972] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-14T21:12:05.161051] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-14T21:12:05.161402] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-14T21:12:05.161441] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-14T21:12:05.162001] [DEBUG] [LOCAL ] RFI: Trimmed 15481 records to 10475 (keeping 200 days of data) [2025-10-14T21:12:05.228272] [DEBUG] [LOCAL ] RFI: Primary data saved (10475 records). [2025-10-14T21:12:05.228411] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-14T21:12:05.228491] [INFO ] [MAIN ] Update Progress: 1791/2369 symbols completed. RFI took 38.3s. Estimated remaining: 1h 21m 20s. Rate: 7.1 symbols/min [2025-10-14T21:12:05.412143] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:12:05.413073] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-14T21:12:05.416520] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-14T21:12:05.417077] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-14T21:12:05.417213] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-14T21:12:05.417259] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-14T21:12:05.417302] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-14T21:12:05.417336] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-14T21:12:05.566979] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-14T21:12:05.771739] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:12:06.358109] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-14T21:12:06.485939] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-14T21:12:07.048512] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T21:12:07.158099] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-14T21:12:07.824152] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T21:12:07.958080] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-14T21:12:08.758147] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-14T21:12:09.002183] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T21:12:09.557933] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T21:12:09.558105] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-14T21:12:10.358157] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-14T21:12:11.147822] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T21:12:11.160105] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-14T21:12:11.163219] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T21:12:11.886487] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T21:12:11.958065] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-14T21:12:12.514139] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T21:12:12.515267] [INFO ] [REMOTE ] RFM: Full fetch complete (5836 records). [2025-10-14T21:12:12.515344] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-14T21:12:12.763199] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-14T21:12:12.874769] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-14T21:12:12.874846] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-14T21:12:12.875034] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-14T21:12:12.875073] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-14T21:12:12.875432] [DEBUG] [LOCAL ] RFM: Trimmed 5836 records to 4131 (keeping 200 days of data) [2025-10-14T21:12:12.900820] [DEBUG] [LOCAL ] RFM: Primary data saved (4131 records). [2025-10-14T21:12:12.900949] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-14T21:12:12.901028] [INFO ] [MAIN ] Update Progress: 1792/2369 symbols completed. RFM took 28.5s. Estimated remaining: 1h 21m 11s. Rate: 7.1 symbols/min [2025-10-14T21:12:13.068208] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:12:13.068373] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-14T21:12:13.068409] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-14T21:12:13.068522] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-14T21:12:13.068576] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-14T21:12:13.068677] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-14T21:12:13.068739] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-14T21:12:13.441594] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:12:13.449104] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T21:12:13.558078] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-14T21:12:14.358066] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-14T21:12:15.099104] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:12:15.100495] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12254 records). [2025-10-14T21:12:15.100562] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-14T21:12:15.168394] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-14T21:12:15.220952] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:12:15.486039] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-14T21:12:15.486114] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-14T21:12:15.486396] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-14T21:12:15.486434] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-14T21:12:15.486904] [DEBUG] [LOCAL ] RFMZ: Trimmed 12254 records to 8668 (keeping 200 days of data) [2025-10-14T21:12:15.538209] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8668 records). [2025-10-14T21:12:15.538331] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-14T21:12:15.538406] [INFO ] [MAIN ] Update Progress: 1793/2369 symbols completed. RFMZ took 25.2s. Estimated remaining: 1h 21m 1s. Rate: 7.1 symbols/min [2025-10-14T21:12:15.702668] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:12:15.707580] [DEBUG] [LOCAL ] RGT: Loaded 2702 existing records from primary storage. [2025-10-14T21:12:15.707788] [INFO ] [MAIN ] RGT: Loaded 2702 existing records. [2025-10-14T21:12:15.880244] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:12:15.880472] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-14T21:12:15.880519] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-14T21:12:15.880805] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-14T21:12:15.880865] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-14T21:12:15.963277] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-14T21:12:16.233937] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:12:16.765598] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-14T21:12:16.769121] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T21:12:17.273369] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-14T21:12:17.419873] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-14T21:12:17.558065] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-14T21:12:18.358092] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-14T21:12:19.146500] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T21:12:19.158022] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-14T21:12:19.436451] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:12:19.958057] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-14T21:12:20.758123] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-14T21:12:20.799911] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:12:20.815419] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T21:12:21.559232] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-14T21:12:21.561135] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-14T21:12:22.276327] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T21:12:22.358085] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-14T21:12:23.158048] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-14T21:12:23.511271] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T21:12:23.958074] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-14T21:12:24.758095] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-14T21:12:24.899232] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T21:12:24.922602] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T21:12:25.558046] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-14T21:12:25.801436] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T21:12:26.358037] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-14T21:12:26.666845] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T21:12:27.158058] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-14T21:12:27.307208] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T21:12:27.309374] [INFO ] [REMOTE ] RFL: Full fetch complete (13218 records). [2025-10-14T21:12:27.309470] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-14T21:12:27.677794] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-14T21:12:27.677873] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-14T21:12:27.678166] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-14T21:12:27.678205] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-14T21:12:27.678724] [DEBUG] [LOCAL ] RFL: Trimmed 13218 records to 11412 (keeping 200 days of data) [2025-10-14T21:12:27.741888] [DEBUG] [LOCAL ] RFL: Primary data saved (11412 records). [2025-10-14T21:12:27.742011] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-14T21:12:27.742089] [INFO ] [MAIN ] Update Progress: 1794/2369 symbols completed. RFL took 46.5s. Estimated remaining: 1h 20m 54s. Rate: 7.1 symbols/min [2025-10-14T21:12:27.912996] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:12:27.913173] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-14T21:12:27.913210] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-14T21:12:27.913316] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-14T21:12:27.913356] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-14T21:12:27.913394] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-14T21:12:27.913443] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-14T21:12:27.967319] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-14T21:12:28.270267] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:12:28.588521] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T21:12:28.758058] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-14T21:12:29.330680] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T21:12:29.462425] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T21:12:29.558036] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-14T21:12:30.358122] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-14T21:12:30.763967] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T21:12:31.158057] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-14T21:12:31.446605] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T21:12:31.958062] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-14T21:12:32.758120] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-14T21:12:32.821266] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T21:12:33.536228] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T21:12:33.558030] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-14T21:12:33.684298] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T21:12:34.358113] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-14T21:12:35.025235] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T21:12:35.158030] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-14T21:12:35.258153] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T21:12:35.821351] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:12:35.958058] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-14T21:12:36.758045] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-14T21:12:37.040417] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T21:12:37.558093] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-14T21:12:38.173227] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T21:12:38.310959] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T21:12:38.358034] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-14T21:12:39.158081] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-14T21:12:39.888935] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:12:39.958021] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-14T21:12:40.062724] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T21:12:40.758062] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-14T21:12:41.391221] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-14T21:12:41.558039] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-14T21:12:41.726620] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T21:12:42.177052] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T21:12:42.358057] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-14T21:12:42.712628] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-14T21:12:42.716266] [INFO ] [REMOTE ] RGA: Full fetch complete (45070 records). [2025-10-14T21:12:42.716351] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-14T21:12:42.716965] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:12:42.717055] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:12:42.717096] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:12:42.717169] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-14T21:12:42.717229] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-14T21:12:42.717263] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-14T21:12:42.717301] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-14T21:12:42.717352] [INFO ] [MAIN ] Update Progress: 1795/2369 symbols completed. RGA took 37.5s. Estimated remaining: 1h 20m 48s. Rate: 7.1 symbols/min [2025-10-14T21:12:42.885344] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:12:42.885548] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-14T21:12:42.885588] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-14T21:12:42.885722] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-14T21:12:42.885768] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-14T21:12:42.885808] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-14T21:12:42.885839] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-14T21:12:43.163166] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-14T21:12:43.232565] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:12:43.958082] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-14T21:12:44.004902] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:12:44.758079] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-14T21:12:45.558070] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-14T21:12:46.146285] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-14T21:12:46.164451] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T21:12:46.167033] [INFO ] [REMOTE ] RGR: Full fetch complete (28779 records). [2025-10-14T21:12:46.167115] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-14T21:12:46.167562] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:12:46.167716] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:12:46.167798] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:12:46.167889] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-14T21:12:46.167966] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-14T21:12:46.168004] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-14T21:12:46.168045] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-14T21:12:46.168099] [INFO ] [MAIN ] Update Progress: 1796/2369 symbols completed. RGR took 33.3s. Estimated remaining: 1h 20m 37s. Rate: 7.1 symbols/min [2025-10-14T21:12:46.339205] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:12:46.339351] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-14T21:12:46.339411] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-14T21:12:46.339545] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-14T21:12:46.339610] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-14T21:12:46.339689] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-14T21:12:46.339738] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-14T21:12:46.363225] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-14T21:12:46.748989] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T21:12:46.745561] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:12:46.943863] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-14T21:12:47.158041] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-14T21:12:47.522167] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:12:47.522474] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-14T21:12:47.522566] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:12:47.522628] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-14T21:12:47.522739] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:12:47.522827] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-14T21:12:47.522901] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-14T21:12:47.522949] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-14T21:12:47.523003] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-14T21:12:47.523064] [INFO ] [MAIN ] Update Progress: 1797/2369 symbols completed. RHLD took 1.4s. Estimated remaining: 1h 20m 27s. Rate: 7.1 symbols/min [2025-10-14T21:12:47.958071] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-14T21:12:48.758068] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-14T21:12:49.558075] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-14T21:12:50.175779] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-14T21:12:50.189517] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-14T21:12:50.358033] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-14T21:12:50.427801] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T21:12:50.846318] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T21:12:50.847164] [INFO ] [REMOTE ] RGT: Full fetch complete (4036 records). [2025-10-14T21:12:50.847233] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-14T21:12:51.163248] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-14T21:12:51.202761] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-14T21:12:51.202879] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-14T21:12:51.203031] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-14T21:12:51.203069] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-14T21:12:51.203419] [DEBUG] [LOCAL ] RGT: Trimmed 4036 records to 2710 (keeping 200 days of data) [2025-10-14T21:12:51.220459] [DEBUG] [LOCAL ] RGT: Primary data saved (2710 records). [2025-10-14T21:12:51.220533] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-14T21:12:51.220605] [INFO ] [MAIN ] Update Progress: 1798/2369 symbols completed. RGT took 35.7s. Estimated remaining: 1h 20m 17s. Rate: 7.1 symbols/min [2025-10-14T21:12:51.958140] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-14T21:12:53.184150] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-14T21:12:53.194333] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-14T21:12:53.934626] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-14T21:12:53.943873] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-14T21:12:55.162347] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T21:12:55.172566] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-14T21:12:55.685836] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T21:12:55.695974] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-14T21:12:56.673444] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T21:12:56.683224] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-14T21:12:57.415441] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:12:57.425958] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-14T21:12:57.518403] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:12:57.558047] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-14T21:12:58.204989] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T21:12:58.209836] [INFO ] [REMOTE ] RH: Full fetch complete (65558 records). [2025-10-14T21:12:58.209971] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-14T21:12:58.210754] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:12:58.210852] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:12:58.210904] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:12:58.210984] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-14T21:12:58.211066] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-14T21:12:58.211105] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-14T21:12:58.211146] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-14T21:12:58.211205] [INFO ] [MAIN ] Update Progress: 1799/2369 symbols completed. RH took 30.5s. Estimated remaining: 1h 20m 8s. Rate: 7.1 symbols/min [2025-10-14T21:12:58.664317] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T21:12:58.674396] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-14T21:13:00.454593] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T21:13:00.464794] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-14T21:13:02.501589] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T21:13:02.514193] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-14T21:13:04.141284] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:13:04.152547] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-14T21:13:05.400628] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T21:13:05.413939] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-14T21:13:06.195373] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T21:13:06.200396] [INFO ] [REMOTE ] RHI: Full fetch complete (70097 records). [2025-10-14T21:13:06.200500] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-14T21:13:06.201118] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:13:06.201224] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:13:06.201266] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:13:06.201302] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-14T21:13:06.201354] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-14T21:13:06.201386] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-14T21:13:06.201425] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-14T21:13:06.201477] [INFO ] [MAIN ] Update Progress: 1800/2369 symbols completed. RHI took 23.5s. Estimated remaining: 1h 19m 59s. Rate: 7.1 symbols/min [2025-10-14T21:13:06.865830] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:06.880684] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:06.907545] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-14T21:13:06.912810] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-14T21:13:06.912701] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:06.912944] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-14T21:13:06.919982] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-14T21:13:06.929014] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-14T21:13:06.934322] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-14T21:13:06.937729] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-14T21:13:06.939000] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-14T21:13:06.939104] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-14T21:13:06.938755] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-14T21:13:06.938569] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:06.938810] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-14T21:13:06.939510] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-14T21:13:06.951394] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-14T21:13:06.951323] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-14T21:13:06.970090] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-14T21:13:06.975958] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-14T21:13:06.976060] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-14T21:13:06.976121] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-14T21:13:07.686915] [DEBUG] [LOCAL ] RIG: Loaded 53673 existing records from primary storage. [2025-10-14T21:13:07.742100] [INFO ] [MAIN ] RIG: Loaded 53673 existing records. [2025-10-14T21:13:08.156006] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:08.188444] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:08.199638] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-14T21:13:08.199230] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-14T21:13:08.260063] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:08.265616] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-14T21:13:08.353304] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:13:08.353625] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-14T21:13:08.353714] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-14T21:13:08.354127] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-14T21:13:08.354186] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-14T21:13:08.724137] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:08.724556] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-14T21:13:09.615360] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:13:09.627529] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-14T21:13:09.741158] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T21:13:09.748973] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-14T21:13:10.145552] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-14T21:13:10.156766] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-14T21:13:10.267682] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-14T21:13:10.278373] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-14T21:13:10.435676] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-14T21:13:10.446260] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-14T21:13:10.846117] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T21:13:10.856222] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-14T21:13:11.104218] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-14T21:13:11.114427] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-14T21:13:12.065950] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-14T21:13:12.077071] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-14T21:13:12.206711] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T21:13:12.217198] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-14T21:13:12.443298] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T21:13:12.559122] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-14T21:13:12.758079] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-14T21:13:13.033037] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T21:13:13.558075] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-14T21:13:13.759955] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T21:13:14.358039] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-14T21:13:14.491247] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T21:13:14.540247] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-14T21:13:15.158087] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-14T21:13:15.958087] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-14T21:13:16.459882] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-14T21:13:16.758079] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-14T21:13:16.971008] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:13:17.117307] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-14T21:13:17.558059] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-14T21:13:18.358103] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-14T21:13:18.946988] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-14T21:13:19.158047] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-14T21:13:19.352937] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T21:13:19.958069] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-14T21:13:20.182553] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T21:13:20.758170] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-14T21:13:21.510602] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-14T21:13:21.558039] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-14T21:13:21.893101] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T21:13:22.358084] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-14T21:13:22.813084] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T21:13:23.158122] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-14T21:13:23.429491] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T21:13:23.798604] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-14T21:13:23.958078] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-14T21:13:24.758147] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-14T21:13:25.373030] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-14T21:13:25.558094] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-14T21:13:25.885948] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-14T21:13:25.977466] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T21:13:26.358163] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-14T21:13:27.158085] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-14T21:13:27.494313] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-14T21:13:27.958073] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-14T21:13:28.479307] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T21:13:28.770082] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-14T21:13:28.776515] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T21:13:29.558049] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-14T21:13:29.819164] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T21:13:30.358041] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-14T21:13:30.426045] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T21:13:31.155946] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T21:13:31.163796] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-14T21:13:31.958111] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-14T21:13:32.153560] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-14T21:13:32.159986] [INFO ] [REMOTE ] RIG: Full fetch complete (77845 records). [2025-10-14T21:13:32.160173] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-14T21:13:32.563983] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-14T21:13:32.564081] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-14T21:13:32.565334] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-14T21:13:32.565402] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-14T21:13:32.566892] [DEBUG] [LOCAL ] RIG: Trimmed 77845 records to 53674 (keeping 200 days of data) [2025-10-14T21:13:32.765372] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-14T21:13:32.885126] [DEBUG] [LOCAL ] RIG: Primary data saved (53674 records). [2025-10-14T21:13:32.885288] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-14T21:13:32.885375] [INFO ] [MAIN ] Update Progress: 1801/2369 symbols completed. RIG took 26.7s. Estimated remaining: 1h 19m 57s. Rate: 7.1 symbols/min [2025-10-14T21:13:33.059362] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:33.059591] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-14T21:13:33.059681] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-14T21:13:33.059826] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-14T21:13:33.059870] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-14T21:13:33.059912] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-14T21:13:33.059946] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-14T21:13:33.429141] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:33.468749] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-14T21:13:33.512836] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T21:13:33.558037] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-14T21:13:34.271685] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T21:13:34.359907] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-14T21:13:34.362115] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T21:13:34.369234] [INFO ] [REMOTE ] RITM: Full fetch complete (76342 records). [2025-10-14T21:13:34.369343] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-14T21:13:34.369992] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:13:34.370074] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:13:34.370137] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:13:34.370206] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-14T21:13:34.370268] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-14T21:13:34.370302] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-14T21:13:34.370341] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-14T21:13:34.370394] [INFO ] [MAIN ] Update Progress: 1802/2369 symbols completed. RITM took 28.2s. Estimated remaining: 1h 19m 46s. Rate: 7.1 symbols/min [2025-10-14T21:13:34.539574] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:34.539763] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-14T21:13:34.539806] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-14T21:13:34.539911] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-14T21:13:34.539951] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-14T21:13:34.539990] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-14T21:13:34.540022] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-14T21:13:34.883934] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:35.158051] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-14T21:13:35.410494] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T21:13:35.958061] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-14T21:13:36.758064] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-14T21:13:36.892523] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T21:13:36.985905] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T21:13:37.558093] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-14T21:13:38.342042] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T21:13:38.346857] [INFO ] [REMOTE ] RHP: Full fetch complete (58243 records). [2025-10-14T21:13:38.347011] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-14T21:13:38.363187] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-14T21:13:38.769060] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-14T21:13:38.769146] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-14T21:13:38.770119] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-14T21:13:38.770181] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-14T21:13:38.771365] [DEBUG] [LOCAL ] RHP: Trimmed 58243 records to 40733 (keeping 200 days of data) [2025-10-14T21:13:39.039793] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-14T21:13:39.070781] [DEBUG] [LOCAL ] RHP: Primary data saved (40733 records). [2025-10-14T21:13:39.070902] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-14T21:13:39.070969] [INFO ] [MAIN ] Update Progress: 1803/2369 symbols completed. RHP took 32.9s. Estimated remaining: 1h 19m 36s. Rate: 7.1 symbols/min [2025-10-14T21:13:39.164724] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-14T21:13:39.248410] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:39.248734] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-14T21:13:39.248791] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-14T21:13:39.248912] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-14T21:13:39.248973] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-14T21:13:39.249070] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-14T21:13:39.249147] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-14T21:13:39.597012] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:39.958093] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-14T21:13:40.370953] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T21:13:40.758047] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-14T21:13:40.793070] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:13:40.800350] [INFO ] [REMOTE ] RIO: Full fetch complete (77116 records). [2025-10-14T21:13:40.800531] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-14T21:13:40.801575] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:13:40.801711] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:13:40.801766] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:13:40.801884] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-14T21:13:40.802004] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-14T21:13:40.802067] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-14T21:13:40.802113] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-14T21:13:40.802171] [INFO ] [MAIN ] Update Progress: 1804/2369 symbols completed. RIO took 34.6s. Estimated remaining: 1h 19m 26s. Rate: 7.1 symbols/min [2025-10-14T21:13:40.978184] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:13:40.978425] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-14T21:13:40.978545] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-14T21:13:40.978787] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-14T21:13:40.978898] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-14T21:13:40.978980] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-14T21:13:40.979067] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-14T21:13:41.313852] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-10-14T21:13:41.380935] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:13:41.558055] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-14T21:13:42.358069] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-14T21:13:42.835735] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-14T21:13:43.158090] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-14T21:13:43.493337] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-14T21:13:43.895359] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T21:13:43.958028] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-14T21:13:44.026299] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T21:13:44.758043] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-14T21:13:45.558080] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-14T21:13:45.614137] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:13:45.664943] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T21:13:46.358134] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-14T21:13:47.158073] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-14T21:13:47.334796] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T21:13:47.958070] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-14T21:13:48.262230] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T21:13:48.758089] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-14T21:13:48.804931] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T21:13:49.558043] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-14T21:13:49.637442] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T21:13:49.673529] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-14T21:13:50.358101] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-14T21:13:50.964185] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-14T21:13:51.158017] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-14T21:13:51.436610] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T21:13:51.958058] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-14T21:13:52.597890] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T21:13:52.758098] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-14T21:13:53.558037] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-14T21:13:53.674907] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T21:13:53.963148] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-14T21:13:54.358144] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-14T21:13:55.158092] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-14T21:13:55.375966] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T21:13:55.503893] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T21:13:55.958081] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-14T21:13:56.758038] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-14T21:13:56.954237] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T21:13:57.324279] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-14T21:13:57.558075] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-14T21:13:58.358042] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-14T21:13:58.678715] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-14T21:13:59.158041] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-14T21:13:59.488554] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T21:13:59.728317] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-14T21:13:59.958065] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-14T21:14:00.654831] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:14:00.656911] [INFO ] [REMOTE ] RIV: Full fetch complete (17725 records). [2025-10-14T21:14:00.656980] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-14T21:14:00.657374] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:14:00.657456] [FATAL] [MAIN ] RIV: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:14:00.657497] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:14:00.657566] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-14T21:14:00.657672] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-14T21:14:00.657733] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-14T21:14:00.657776] [DEBUG] [LOCAL ] RIV: No derivative data file found to delete. [2025-10-14T21:14:00.657828] [INFO ] [MAIN ] Update Progress: 1805/2369 symbols completed. RIV took 27.8s. Estimated remaining: 1h 19m 21s. Rate: 7.1 symbols/min [2025-10-14T21:14:00.758312] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-14T21:14:00.829848] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:00.830440] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-14T21:14:00.830584] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-14T21:14:00.830742] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-14T21:14:00.830795] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-14T21:14:00.830965] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-14T21:14:00.831058] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-14T21:14:01.188318] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:01.215504] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-14T21:14:01.558054] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-14T21:14:02.358165] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-14T21:14:02.662139] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T21:14:02.695746] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T21:14:03.158049] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-14T21:14:03.958072] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-14T21:14:04.317073] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-14T21:14:04.758059] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-14T21:14:04.908492] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T21:14:04.983679] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T21:14:05.558062] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-14T21:14:06.358069] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-14T21:14:06.603385] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T21:14:07.008276] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T21:14:07.158062] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-14T21:14:07.958111] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-14T21:14:08.392161] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T21:14:08.758039] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-14T21:14:08.928975] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T21:14:09.391710] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T21:14:09.558100] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-14T21:14:10.358104] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-14T21:14:11.065702] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-14T21:14:11.102260] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T21:14:11.158068] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-14T21:14:11.958063] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-14T21:14:12.200140] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T21:14:12.758103] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-14T21:14:13.283552] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T21:14:13.558044] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-14T21:14:13.813758] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-14T21:14:13.882446] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T21:14:14.358084] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-14T21:14:15.062351] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:14:15.068540] [INFO ] [REMOTE ] RJF: Full fetch complete (68127 records). [2025-10-14T21:14:15.068772] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-14T21:14:15.069601] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:14:15.069792] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:14:15.069848] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:14:15.069914] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-14T21:14:15.069979] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-14T21:14:15.070015] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-14T21:14:15.070055] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-14T21:14:15.070112] [INFO ] [MAIN ] Update Progress: 1806/2369 symbols completed. RJF took 40.7s. Estimated remaining: 1h 19m 14s. Rate: 7.1 symbols/min [2025-10-14T21:14:15.163244] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-14T21:14:15.279092] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:15.279292] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-14T21:14:15.279365] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-14T21:14:15.279610] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-14T21:14:15.279703] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-14T21:14:15.279821] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-14T21:14:15.279905] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-14T21:14:15.563719] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-14T21:14:15.735027] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:15.958038] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-14T21:14:16.037861] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T21:14:16.043167] [INFO ] [REMOTE ] RKT: Full fetch complete (77182 records). [2025-10-14T21:14:16.043273] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-14T21:14:16.044079] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:14:16.044166] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:14:16.044208] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:14:16.044247] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-14T21:14:16.044303] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-14T21:14:16.044338] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-14T21:14:16.044386] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-14T21:14:16.044440] [INFO ] [MAIN ] Update Progress: 1807/2369 symbols completed. RKT took 37.0s. Estimated remaining: 1h 19m 4s. Rate: 7.1 symbols/min [2025-10-14T21:14:16.213204] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:16.226973] [DEBUG] [LOCAL ] RLTY: Loaded 11147 existing records from primary storage. [2025-10-14T21:14:16.227193] [INFO ] [MAIN ] RLTY: Loaded 11147 existing records. [2025-10-14T21:14:16.405615] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:14:16.405871] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-14T21:14:16.405936] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-14T21:14:16.406124] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-14T21:14:16.406182] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-14T21:14:16.767045] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:16.762598] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-14T21:14:17.558108] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-14T21:14:17.673988] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T21:14:17.765854] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T21:14:18.303296] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T21:14:18.358067] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-14T21:14:19.158061] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-14T21:14:19.778628] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T21:14:19.794068] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T21:14:19.958096] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-14T21:14:20.758054] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-14T21:14:21.055683] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T21:14:21.558061] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-14T21:14:22.249291] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T21:14:22.358003] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-14T21:14:22.973757] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T21:14:22.977766] [INFO ] [REMOTE ] RL: Full fetch complete (59551 records). [2025-10-14T21:14:22.977868] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-14T21:14:22.978443] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:14:22.978532] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:14:22.978573] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:14:22.978610] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-14T21:14:22.978687] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-14T21:14:22.978749] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-14T21:14:22.978799] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-14T21:14:22.978856] [INFO ] [MAIN ] Update Progress: 1808/2369 symbols completed. RL took 42.2s. Estimated remaining: 1h 18m 55s. Rate: 7.1 symbols/min [2025-10-14T21:14:23.151543] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:23.162100] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-14T21:14:23.184134] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T21:14:23.231816] [DEBUG] [LOCAL ] RLX: Loaded 48124 existing records from primary storage. [2025-10-14T21:14:23.232124] [INFO ] [MAIN ] RLX: Loaded 48124 existing records. [2025-10-14T21:14:23.405904] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:14:23.406127] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-14T21:14:23.406173] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-14T21:14:23.406580] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-14T21:14:23.406618] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-14T21:14:23.746722] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:23.958050] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-14T21:14:24.603374] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T21:14:24.758080] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-14T21:14:25.535826] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T21:14:25.558017] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-14T21:14:25.622536] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T21:14:26.358115] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-14T21:14:27.141777] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T21:14:27.158018] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-14T21:14:27.958125] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-14T21:14:28.280366] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T21:14:28.758107] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-14T21:14:28.867927] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T21:14:29.016233] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T21:14:29.236962] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-14T21:14:29.558066] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-14T21:14:30.358059] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-14T21:14:31.158073] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-14T21:14:31.272983] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T21:14:31.528310] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T21:14:31.958054] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-14T21:14:31.995435] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T21:14:32.636248] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:14:32.640423] [INFO ] [REMOTE ] RLI: Full fetch complete (47991 records). [2025-10-14T21:14:32.640534] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-14T21:14:32.641132] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:14:32.641238] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:14:32.641282] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:14:32.641320] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-14T21:14:32.641373] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-14T21:14:32.641408] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-14T21:14:32.641446] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-14T21:14:32.641499] [INFO ] [MAIN ] Update Progress: 1809/2369 symbols completed. RLI took 32.0s. Estimated remaining: 1h 18m 47s. Rate: 7.1 symbols/min [2025-10-14T21:14:32.763158] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-14T21:14:32.813855] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:32.824196] [DEBUG] [LOCAL ] RM: Loaded 7540 existing records from primary storage. [2025-10-14T21:14:32.824501] [INFO ] [MAIN ] RM: Loaded 7540 existing records. [2025-10-14T21:14:33.003934] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:14:33.004101] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-14T21:14:33.004165] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-14T21:14:33.004324] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-14T21:14:33.004384] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-14T21:14:33.349953] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:33.558041] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-14T21:14:33.642297] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T21:14:34.358065] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-14T21:14:35.158065] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-14T21:14:35.195616] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:14:35.269269] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T21:14:35.813900] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T21:14:35.958060] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-14T21:14:36.758094] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-14T21:14:36.925486] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T21:14:37.558082] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-14T21:14:37.609724] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T21:14:38.358062] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-14T21:14:39.158039] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-14T21:14:39.315311] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:14:39.331678] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T21:14:39.958075] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-14T21:14:40.079433] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T21:14:40.758113] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-14T21:14:41.558061] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-14T21:14:41.574959] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T21:14:41.696450] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T21:14:42.358039] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-14T21:14:42.397346] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T21:14:42.399770] [INFO ] [REMOTE ] RLTY: Full fetch complete (17459 records). [2025-10-14T21:14:42.399858] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-14T21:14:42.767441] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-14T21:14:42.767515] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-14T21:14:42.767920] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-14T21:14:42.767980] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-14T21:14:42.768502] [DEBUG] [LOCAL ] RLTY: Trimmed 17459 records to 11158 (keeping 200 days of data) [2025-10-14T21:14:42.836013] [DEBUG] [LOCAL ] RLTY: Primary data saved (11158 records). [2025-10-14T21:14:42.836144] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-14T21:14:42.836224] [INFO ] [MAIN ] Update Progress: 1810/2369 symbols completed. RLTY took 26.8s. Estimated remaining: 1h 18m 39s. Rate: 7.1 symbols/min [2025-10-14T21:14:43.002165] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:43.002335] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-14T21:14:43.002371] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-14T21:14:43.002532] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-14T21:14:43.002601] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-14T21:14:43.002683] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-14T21:14:43.002748] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-14T21:14:43.163420] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-14T21:14:43.363245] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:43.958052] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-14T21:14:44.012239] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T21:14:44.052008] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T21:14:44.758038] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-14T21:14:44.834053] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T21:14:45.558065] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-14T21:14:46.358038] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-14T21:14:46.460471] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T21:14:47.075363] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T21:14:47.158037] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-14T21:14:47.442692] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:14:47.958042] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-14T21:14:48.758085] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-14T21:14:48.891623] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T21:14:49.508793] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T21:14:49.558039] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-14T21:14:49.645246] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T21:14:50.358065] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-14T21:14:51.024189] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T21:14:51.029395] [INFO ] [REMOTE ] RLJ: Full fetch complete (69006 records). [2025-10-14T21:14:51.029511] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-14T21:14:51.030173] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:14:51.030284] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:14:51.030364] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:14:51.030471] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-14T21:14:51.030540] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-14T21:14:51.030595] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-14T21:14:51.030682] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-14T21:14:51.030772] [INFO ] [MAIN ] Update Progress: 1811/2369 symbols completed. RLJ took 36.0s. Estimated remaining: 1h 18m 30s. Rate: 7.1 symbols/min [2025-10-14T21:14:51.234592] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:14:51.168034] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-14T21:14:51.249551] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-14T21:14:51.252033] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T21:14:51.252188] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-14T21:14:51.263767] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-14T21:14:51.263874] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-14T21:14:51.264134] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-14T21:14:51.264192] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-14T21:14:51.657717] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:14:51.958129] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-14T21:14:52.283983] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T21:14:52.758072] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-14T21:14:53.558073] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-14T21:14:53.779121] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T21:14:54.357335] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T21:14:54.364677] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-14T21:14:54.646315] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T21:14:55.158053] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-14T21:14:55.910144] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T21:14:55.958053] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-14T21:14:56.125902] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T21:14:56.758102] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-14T21:14:56.922670] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-14T21:14:57.558064] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-14T21:14:58.358031] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-14T21:14:58.382981] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T21:14:58.836786] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T21:14:59.158049] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-14T21:14:59.426808] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T21:14:59.958082] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-14T21:15:00.758085] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-14T21:15:00.848597] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T21:15:01.073338] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T21:15:01.558062] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-14T21:15:01.686013] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T21:15:02.358067] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-14T21:15:02.817367] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T21:15:03.158047] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-14T21:15:03.958147] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-14T21:15:04.415990] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T21:15:04.460741] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T21:15:04.644626] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T21:15:04.758189] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-14T21:15:05.558098] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-14T21:15:06.316284] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T21:15:06.321933] [INFO ] [REMOTE ] RLX: Full fetch complete (70286 records). [2025-10-14T21:15:06.322055] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-14T21:15:06.363152] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-14T21:15:06.752289] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-14T21:15:06.752621] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-14T21:15:06.753994] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-14T21:15:06.754133] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-14T21:15:06.755925] [DEBUG] [LOCAL ] RLX: Trimmed 70286 records to 48143 (keeping 200 days of data) [2025-10-14T21:15:06.991705] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T21:15:07.089140] [DEBUG] [LOCAL ] RLX: Primary data saved (48143 records). [2025-10-14T21:15:07.089266] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-14T21:15:07.089344] [INFO ] [MAIN ] Update Progress: 1812/2369 symbols completed. RLX took 44.1s. Estimated remaining: 1h 18m 24s. Rate: 7.1 symbols/min [2025-10-14T21:15:07.159173] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-14T21:15:07.178880] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T21:15:07.198575] [INFO ] [REMOTE ] RM: Full fetch complete (11561 records). [2025-10-14T21:15:07.214367] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-14T21:15:07.368237] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:07.389993] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-14T21:15:07.398037] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-14T21:15:07.400394] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-14T21:15:07.400701] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-14T21:15:07.411196] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-14T21:15:07.411277] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-14T21:15:07.952523] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-14T21:15:07.958101] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-14T21:15:07.968597] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-14T21:15:07.979362] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-14T21:15:07.991956] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-14T21:15:08.034599] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:08.034790] [DEBUG] [LOCAL ] RM: Trimmed 11561 records to 7559 (keeping 200 days of data) [2025-10-14T21:15:08.088916] [DEBUG] [LOCAL ] RM: Primary data saved (7559 records). [2025-10-14T21:15:08.089080] [INFO ] [MAIN ] RM: Full history saved. [2025-10-14T21:15:08.089176] [INFO ] [MAIN ] Update Progress: 1813/2369 symbols completed. RM took 35.4s. Estimated remaining: 1h 18m 13s. Rate: 7.1 symbols/min [2025-10-14T21:15:08.287861] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:08.288061] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-14T21:15:08.288102] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-14T21:15:08.288215] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-14T21:15:08.288256] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-14T21:15:08.288295] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-14T21:15:08.288346] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-14T21:15:08.643000] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:08.758085] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-14T21:15:09.111873] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T21:15:09.218026] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-14T21:15:09.322874] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T21:15:09.558106] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-14T21:15:10.237666] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:15:10.240036] [INFO ] [REMOTE ] RMAX: Full fetch complete (29749 records). [2025-10-14T21:15:10.240105] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-14T21:15:10.240619] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:15:10.240714] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:15:10.240791] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:15:10.240877] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-14T21:15:10.240946] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-14T21:15:10.240980] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-14T21:15:10.241041] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-14T21:15:10.241114] [INFO ] [MAIN ] Update Progress: 1814/2369 symbols completed. RMAX took 27.4s. Estimated remaining: 1h 18m 3s. Rate: 7.1 symbols/min [2025-10-14T21:15:10.363204] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-14T21:15:10.410603] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:10.418681] [DEBUG] [LOCAL ] RMMZ: Loaded 4799 existing records from primary storage. [2025-10-14T21:15:10.418885] [INFO ] [MAIN ] RMMZ: Loaded 4799 existing records. [2025-10-14T21:15:10.591679] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:15:10.591920] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-14T21:15:10.591968] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-14T21:15:10.592278] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-14T21:15:10.592336] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-14T21:15:10.944092] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:11.158046] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-14T21:15:11.236661] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T21:15:11.958043] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-14T21:15:11.980670] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T21:15:12.758076] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-14T21:15:12.824305] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T21:15:13.443834] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T21:15:13.558099] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-14T21:15:14.358040] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-14T21:15:14.436291] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-14T21:15:15.158049] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-14T21:15:15.777768] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T21:15:15.958090] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-14T21:15:15.993625] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T21:15:16.677028] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T21:15:16.758064] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-14T21:15:17.558078] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-14T21:15:18.270891] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T21:15:18.309622] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T21:15:18.358030] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-14T21:15:19.158102] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-14T21:15:19.865306] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T21:15:19.958071] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-14T21:15:20.147928] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T21:15:20.345412] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-14T21:15:20.758119] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-14T21:15:21.447231] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T21:15:21.558077] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-14T21:15:22.163359] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T21:15:22.358058] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-14T21:15:23.039316] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T21:15:23.158088] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-14T21:15:23.958064] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-14T21:15:24.647937] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T21:15:24.758088] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-14T21:15:24.919395] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T21:15:25.169675] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-14T21:15:25.558059] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-14T21:15:26.358118] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-14T21:15:26.469746] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T21:15:27.007480] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-14T21:15:27.158081] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-14T21:15:27.968428] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-14T21:15:27.990567] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T21:15:28.647847] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-14T21:15:28.758066] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-14T21:15:29.565110] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-14T21:15:29.569941] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-14T21:15:29.574716] [INFO ] [REMOTE ] RMD: Full fetch complete (60912 records). [2025-10-14T21:15:29.574803] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-14T21:15:29.575442] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:15:29.575523] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:15:29.575565] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:15:29.575629] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-14T21:15:29.575732] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-14T21:15:29.575774] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-14T21:15:29.575813] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-14T21:15:29.575865] [INFO ] [MAIN ] Update Progress: 1815/2369 symbols completed. RMD took 38.5s. Estimated remaining: 1h 17m 58s. Rate: 7.1 symbols/min [2025-10-14T21:15:29.747246] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:29.765819] [DEBUG] [LOCAL ] RMT: Loaded 17360 existing records from primary storage. [2025-10-14T21:15:29.766050] [INFO ] [MAIN ] RMT: Loaded 17360 existing records. [2025-10-14T21:15:29.940704] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:15:29.940913] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-14T21:15:29.940996] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-14T21:15:29.941269] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-14T21:15:29.941309] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-14T21:15:30.303944] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:30.358053] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-14T21:15:30.367739] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T21:15:31.158085] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-14T21:15:31.503984] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T21:15:31.945031] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T21:15:31.958027] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-14T21:15:32.668092] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T21:15:32.758052] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-14T21:15:33.439262] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-14T21:15:33.558075] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-14T21:15:34.358059] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-14T21:15:34.653581] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T21:15:35.158097] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-14T21:15:35.323678] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T21:15:35.827264] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-14T21:15:35.958068] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-14T21:15:36.661121] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T21:15:36.758059] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-14T21:15:37.558065] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-14T21:15:37.755946] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T21:15:38.156863] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T21:15:38.158342] [INFO ] [REMOTE ] RMI: Full fetch complete (6051 records). [2025-10-14T21:15:38.158463] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-14T21:15:38.159037] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:15:38.159133] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:15:38.159194] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:15:38.159271] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-14T21:15:38.159346] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-14T21:15:38.159400] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-14T21:15:38.159480] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-14T21:15:38.159551] [INFO ] [MAIN ] Update Progress: 1816/2369 symbols completed. RMI took 31.1s. Estimated remaining: 1h 17m 50s. Rate: 7.1 symbols/min [2025-10-14T21:15:38.361171] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-14T21:15:38.361103] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:38.362160] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-14T21:15:38.362204] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-14T21:15:38.362312] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-14T21:15:38.362352] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-14T21:15:38.362392] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-14T21:15:38.362425] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-14T21:15:38.726512] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:39.158099] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-14T21:15:39.332626] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-14T21:15:39.958159] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-14T21:15:40.063322] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-14T21:15:40.421475] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T21:15:40.758115] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-14T21:15:41.558072] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-14T21:15:41.576401] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T21:15:42.114189] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T21:15:42.115248] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6888 records). [2025-10-14T21:15:42.115314] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-14T21:15:42.366168] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-14T21:15:42.491734] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-14T21:15:42.491811] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-14T21:15:42.491990] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-14T21:15:42.492026] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-14T21:15:42.492397] [DEBUG] [LOCAL ] RMMZ: Trimmed 6888 records to 4801 (keeping 200 days of data) [2025-10-14T21:15:42.522520] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4801 records). [2025-10-14T21:15:42.522669] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-14T21:15:42.522765] [INFO ] [MAIN ] Update Progress: 1817/2369 symbols completed. RMMZ took 32.3s. Estimated remaining: 1h 17m 40s. Rate: 7.1 symbols/min [2025-10-14T21:15:42.697183] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:42.697371] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-14T21:15:42.697409] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-14T21:15:42.697543] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-14T21:15:42.697584] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-14T21:15:42.697665] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-14T21:15:42.697722] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-14T21:15:43.055703] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:43.158092] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-14T21:15:43.958075] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-14T21:15:44.158780] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T21:15:44.218305] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T21:15:44.758069] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-14T21:15:44.946861] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T21:15:45.558077] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-14T21:15:46.265142] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:15:46.358038] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-14T21:15:46.612000] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T21:15:47.158090] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-14T21:15:47.704148] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T21:15:47.872759] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T21:15:47.958092] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-14T21:15:48.758094] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-14T21:15:48.956897] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T21:15:49.558051] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-14T21:15:49.784388] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T21:15:50.358076] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-14T21:15:50.866560] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T21:15:50.868023] [INFO ] [REMOTE ] RMM: Full fetch complete (14794 records). [2025-10-14T21:15:50.868091] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-14T21:15:50.868474] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:15:50.868557] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:15:50.868599] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:15:50.868694] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-14T21:15:50.868763] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-14T21:15:50.868802] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-14T21:15:50.868845] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-14T21:15:50.868896] [INFO ] [MAIN ] Update Progress: 1818/2369 symbols completed. RMM took 42.8s. Estimated remaining: 1h 17m 31s. Rate: 7.1 symbols/min [2025-10-14T21:15:51.036402] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:15:51.053402] [DEBUG] [LOCAL ] RNP: Loaded 16180 existing records from primary storage. [2025-10-14T21:15:51.053621] [INFO ] [MAIN ] RNP: Loaded 16180 existing records. [2025-10-14T21:15:51.163154] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-14T21:15:51.238732] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:15:51.239019] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-14T21:15:51.239085] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-14T21:15:51.239380] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-14T21:15:51.239496] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-14T21:15:51.490900] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T21:15:51.658055] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:15:51.958112] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-14T21:15:52.130529] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T21:15:52.758057] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-14T21:15:53.480760] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T21:15:53.558069] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-14T21:15:54.031412] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T21:15:54.358086] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-14T21:15:55.158049] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-14T21:15:55.271229] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T21:15:55.321171] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T21:15:55.958069] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-14T21:15:56.264713] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T21:15:56.758138] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-14T21:15:57.514329] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T21:15:57.558083] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-14T21:15:58.043025] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T21:15:58.358106] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-14T21:15:59.166721] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-14T21:15:59.172293] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T21:15:59.261587] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T21:15:59.958094] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-14T21:16:00.253297] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T21:16:00.758117] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-14T21:16:01.114349] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T21:16:01.558053] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-14T21:16:02.358069] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-14T21:16:02.552105] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T21:16:02.577275] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T21:16:03.158098] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-14T21:16:03.422275] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:16:03.958044] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-14T21:16:04.309086] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T21:16:04.758135] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-14T21:16:05.558048] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-14T21:16:05.649697] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T21:16:05.978488] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T21:16:06.358156] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-14T21:16:06.975733] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T21:16:07.158026] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-14T21:16:07.435837] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T21:16:07.958076] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-14T21:16:08.354216] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T21:16:08.662732] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:16:08.667921] [INFO ] [REMOTE ] RNG: Full fetch complete (69305 records). [2025-10-14T21:16:08.668077] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-14T21:16:08.668949] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:16:08.669029] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:16:08.669093] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:16:08.669167] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-14T21:16:08.669234] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-14T21:16:08.669269] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-14T21:16:08.669307] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-14T21:16:08.669362] [INFO ] [MAIN ] Update Progress: 1819/2369 symbols completed. RNG took 30.5s. Estimated remaining: 1h 17m 26s. Rate: 7.1 symbols/min [2025-10-14T21:16:08.767150] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-14T21:16:08.842466] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:08.842674] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-14T21:16:08.842727] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-14T21:16:08.842858] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-14T21:16:08.842919] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-14T21:16:08.842965] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-14T21:16:08.842997] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-14T21:16:09.212031] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:09.558060] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-14T21:16:09.737381] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T21:16:09.740230] [INFO ] [REMOTE ] RMT: Full fetch complete (25541 records). [2025-10-14T21:16:09.740350] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-14T21:16:10.128558] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-14T21:16:10.128848] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-14T21:16:10.129670] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-14T21:16:10.129770] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-14T21:16:10.130838] [DEBUG] [LOCAL ] RMT: Trimmed 25541 records to 17399 (keeping 200 days of data) [2025-10-14T21:16:10.239669] [DEBUG] [LOCAL ] RMT: Primary data saved (17399 records). [2025-10-14T21:16:10.239805] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-14T21:16:10.239882] [INFO ] [MAIN ] Update Progress: 1820/2369 symbols completed. RMT took 40.7s. Estimated remaining: 1h 17m 15s. Rate: 7.1 symbols/min [2025-10-14T21:16:10.363158] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-14T21:16:10.419221] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:10.419521] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-14T21:16:10.419571] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-14T21:16:10.419704] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-14T21:16:10.419755] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-14T21:16:10.419799] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-14T21:16:10.419831] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-14T21:16:10.719320] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T21:16:10.814742] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:11.158108] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-14T21:16:11.928514] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T21:16:11.958063] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-14T21:16:12.269347] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T21:16:12.758073] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-14T21:16:13.043713] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T21:16:13.558098] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-14T21:16:14.360809] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-14T21:16:14.365587] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T21:16:14.840879] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T21:16:15.121008] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T21:16:15.158029] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-14T21:16:15.870444] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T21:16:15.872961] [INFO ] [REMOTE ] RNGR: Full fetch complete (28233 records). [2025-10-14T21:16:15.873032] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-14T21:16:15.873438] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:16:15.873518] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:16:15.873560] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:16:15.873597] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-14T21:16:15.873671] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-14T21:16:15.873736] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-14T21:16:15.873779] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-14T21:16:15.873832] [INFO ] [MAIN ] Update Progress: 1821/2369 symbols completed. RNGR took 33.4s. Estimated remaining: 1h 17m 6s. Rate: 7.1 symbols/min [2025-10-14T21:16:15.963275] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-14T21:16:16.051880] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:16.052123] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-14T21:16:16.052190] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-14T21:16:16.052309] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-14T21:16:16.052352] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-14T21:16:16.052396] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-14T21:16:16.052429] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-14T21:16:16.402522] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:16.758047] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-14T21:16:17.050029] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T21:16:17.558087] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-14T21:16:18.289113] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T21:16:18.358066] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-14T21:16:18.720237] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T21:16:19.158081] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-14T21:16:19.965589] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-14T21:16:19.967848] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T21:16:20.147025] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T21:16:20.758111] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-14T21:16:20.997882] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-14T21:16:21.558081] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-14T21:16:22.358187] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-14T21:16:22.417240] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T21:16:22.557382] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T21:16:23.158040] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-14T21:16:23.448115] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T21:16:23.958087] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-14T21:16:24.151787] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T21:16:24.154482] [INFO ] [REMOTE ] RNP: Full fetch complete (23803 records). [2025-10-14T21:16:24.154558] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-14T21:16:24.516863] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-14T21:16:24.516937] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-14T21:16:24.517416] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-14T21:16:24.517455] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-14T21:16:24.518070] [DEBUG] [LOCAL ] RNP: Trimmed 23803 records to 16228 (keeping 200 days of data) [2025-10-14T21:16:24.618304] [DEBUG] [LOCAL ] RNP: Primary data saved (16228 records). [2025-10-14T21:16:24.618411] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-14T21:16:24.618488] [INFO ] [MAIN ] Update Progress: 1822/2369 symbols completed. RNP took 33.7s. Estimated remaining: 1h 16m 58s. Rate: 7.1 symbols/min [2025-10-14T21:16:24.763136] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-14T21:16:24.788134] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:24.788293] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-14T21:16:24.788336] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-14T21:16:24.788442] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-14T21:16:24.788483] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-14T21:16:24.788523] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-14T21:16:24.788555] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-14T21:16:25.151125] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:25.558081] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-14T21:16:25.736285] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T21:16:26.098982] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T21:16:26.358070] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-14T21:16:27.118724] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T21:16:27.158087] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-14T21:16:27.886946] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T21:16:27.958054] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-14T21:16:28.758076] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-14T21:16:28.835069] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T21:16:29.006816] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T21:16:29.558067] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-14T21:16:30.199979] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T21:16:30.358063] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-14T21:16:30.554376] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T21:16:31.158061] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-14T21:16:31.958071] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-14T21:16:32.129678] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T21:16:32.211137] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T21:16:32.758109] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-14T21:16:33.456527] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T21:16:33.558058] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-14T21:16:33.908604] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T21:16:34.358059] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-14T21:16:34.748382] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T21:16:35.158080] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-14T21:16:35.958063] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-14T21:16:35.988491] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T21:16:36.128937] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T21:16:36.758100] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-14T21:16:37.436152] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T21:16:37.459104] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:16:37.462945] [INFO ] [REMOTE ] RNST: Full fetch complete (52713 records). [2025-10-14T21:16:37.463104] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-14T21:16:37.463822] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:16:37.463931] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:16:37.463997] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:16:37.464082] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-14T21:16:37.464158] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-14T21:16:37.464207] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-14T21:16:37.464262] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-14T21:16:37.464340] [INFO ] [MAIN ] Update Progress: 1823/2369 symbols completed. RNST took 27.2s. Estimated remaining: 1h 16m 51s. Rate: 7.1 symbols/min [2025-10-14T21:16:37.564131] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-14T21:16:37.638514] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:37.638698] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-14T21:16:37.638748] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-14T21:16:37.638859] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-14T21:16:37.638925] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-14T21:16:37.638990] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-14T21:16:37.639033] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-14T21:16:37.994926] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:38.358060] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-14T21:16:39.158093] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-14T21:16:39.383809] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T21:16:39.423325] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T21:16:39.958066] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-14T21:16:40.758122] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-14T21:16:41.016370] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T21:16:41.529879] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T21:16:41.558033] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-14T21:16:42.358114] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-14T21:16:42.689168] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T21:16:42.749501] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T21:16:43.158058] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-14T21:16:43.958108] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-14T21:16:44.095404] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T21:16:44.152628] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T21:16:44.441394] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-14T21:16:44.758074] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-14T21:16:45.558069] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-14T21:16:45.590828] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:16:45.594544] [INFO ] [REMOTE ] RNR: Full fetch complete (50771 records). [2025-10-14T21:16:45.594771] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-14T21:16:45.595360] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:16:45.595444] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:16:45.595486] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:16:45.595525] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-14T21:16:45.595580] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-14T21:16:45.595614] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-14T21:16:45.595689] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-14T21:16:45.595767] [INFO ] [MAIN ] Update Progress: 1824/2369 symbols completed. RNR took 36.9s. Estimated remaining: 1h 16m 42s. Rate: 7.1 symbols/min [2025-10-14T21:16:45.772856] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:45.773065] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-14T21:16:45.773103] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-14T21:16:45.773216] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-14T21:16:45.773256] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-14T21:16:45.773297] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-14T21:16:45.773329] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-14T21:16:46.130148] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:46.358080] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-14T21:16:46.745023] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T21:16:47.158066] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-14T21:16:47.892398] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T21:16:47.913594] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T21:16:47.958033] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-14T21:16:48.523298] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:16:48.525406] [INFO ] [REMOTE ] ROG: Full fetch complete (30822 records). [2025-10-14T21:16:48.525473] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-14T21:16:48.525916] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:16:48.525995] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:16:48.526037] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:16:48.526106] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-14T21:16:48.526199] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-14T21:16:48.526255] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-14T21:16:48.526311] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-14T21:16:48.526381] [INFO ] [MAIN ] Update Progress: 1825/2369 symbols completed. ROG took 32.7s. Estimated remaining: 1h 16m 32s. Rate: 7.1 symbols/min [2025-10-14T21:16:48.743381] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:16:48.758030] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-14T21:16:48.765753] [DEBUG] [LOCAL ] RPT: Loaded 19122 existing records from primary storage. [2025-10-14T21:16:48.765996] [INFO ] [MAIN ] RPT: Loaded 19122 existing records. [2025-10-14T21:16:48.972985] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:16:48.973193] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-14T21:16:48.973241] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-14T21:16:48.973504] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-14T21:16:48.973563] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-14T21:16:49.445016] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:16:49.558089] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-14T21:16:50.358130] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-14T21:16:50.644507] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T21:16:50.684563] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T21:16:51.158128] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-14T21:16:51.719805] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:16:51.958051] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-14T21:16:52.758080] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-14T21:16:52.830405] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T21:16:53.106022] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-14T21:16:53.558096] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-14T21:16:54.288564] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:16:54.358076] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-14T21:16:55.158103] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-14T21:16:55.392882] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T21:16:55.944301] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T21:16:55.958026] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-14T21:16:56.768089] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-14T21:16:56.796513] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:16:57.267963] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T21:16:57.558072] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-14T21:16:57.893986] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T21:16:58.358067] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-14T21:16:59.158042] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-14T21:16:59.266509] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T21:16:59.395026] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T21:16:59.958167] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-14T21:17:00.588455] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T21:17:00.758044] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-14T21:17:01.558076] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-14T21:17:02.174081] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-14T21:17:02.358126] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-14T21:17:02.650323] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T21:17:02.734011] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T21:17:03.158128] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-14T21:17:03.258107] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T21:17:03.958046] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-14T21:17:04.297115] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T21:17:04.758083] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-14T21:17:05.558056] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-14T21:17:05.649039] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T21:17:06.358058] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-14T21:17:06.515257] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T21:17:06.756796] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T21:17:06.831418] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T21:17:06.835506] [INFO ] [REMOTE ] ROK: Full fetch complete (62382 records). [2025-10-14T21:17:06.835620] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-14T21:17:06.836250] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:17:06.836339] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:17:06.836381] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:17:06.836418] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-14T21:17:06.836471] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-14T21:17:06.836505] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-14T21:17:06.836542] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-14T21:17:06.836599] [INFO ] [MAIN ] Update Progress: 1826/2369 symbols completed. ROK took 42.2s. Estimated remaining: 1h 16m 26s. Rate: 7.1 symbols/min [2025-10-14T21:17:07.002663] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:17:07.002864] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-14T21:17:07.002901] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-14T21:17:07.003014] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-14T21:17:07.003054] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-14T21:17:07.003093] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-14T21:17:07.003123] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-14T21:17:07.163238] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-14T21:17:07.382403] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:17:07.958080] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-14T21:17:08.758089] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-14T21:17:09.121203] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-14T21:17:09.322419] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T21:17:09.416884] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T21:17:09.558028] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-14T21:17:10.358065] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-14T21:17:11.158090] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-14T21:17:11.444368] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T21:17:11.515085] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T21:17:11.958052] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-14T21:17:12.241766] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T21:17:12.758066] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-14T21:17:13.549534] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T21:17:13.558346] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-14T21:17:13.783417] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T21:17:14.358058] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-14T21:17:15.159113] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-14T21:17:15.164536] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T21:17:15.316148] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T21:17:15.318517] [INFO ] [REMOTE ] RPT: Full fetch complete (28541 records). [2025-10-14T21:17:15.318587] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-14T21:17:15.682331] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-14T21:17:15.682411] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-14T21:17:15.683037] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-14T21:17:15.683098] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-14T21:17:15.683833] [DEBUG] [LOCAL ] RPT: Trimmed 28541 records to 19159 (keeping 200 days of data) [2025-10-14T21:17:15.791595] [DEBUG] [LOCAL ] RPT: Primary data saved (19159 records). [2025-10-14T21:17:15.791763] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-14T21:17:15.791848] [INFO ] [MAIN ] Update Progress: 1827/2369 symbols completed. RPT took 27.3s. Estimated remaining: 1h 16m 18s. Rate: 7.1 symbols/min [2025-10-14T21:17:15.957156] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:17:15.957338] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-14T21:17:15.957375] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-14T21:17:15.957481] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-14T21:17:15.957523] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-14T21:17:15.957608] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-14T21:17:15.957688] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-14T21:17:15.968589] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-14T21:17:16.309993] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:17:16.724598] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T21:17:16.758038] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-14T21:17:17.053384] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T21:17:17.558055] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-14T21:17:17.679965] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T21:17:18.358118] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-14T21:17:19.094576] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:17:19.100280] [INFO ] [REMOTE ] ROL: Full fetch complete (72741 records). [2025-10-14T21:17:19.100464] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-14T21:17:19.101333] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:17:19.101510] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:17:19.101599] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:17:19.101720] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-14T21:17:19.101818] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-14T21:17:19.101865] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-14T21:17:19.101906] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-14T21:17:19.101992] [INFO ] [MAIN ] Update Progress: 1828/2369 symbols completed. ROL took 41.6s. Estimated remaining: 1h 16m 8s. Rate: 7.1 symbols/min [2025-10-14T21:17:19.168614] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-14T21:17:19.286029] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:17:19.286295] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-14T21:17:19.286339] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-14T21:17:19.286446] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-14T21:17:19.286485] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-14T21:17:19.286524] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-14T21:17:19.286554] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-14T21:17:19.673238] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:17:19.675718] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-14T21:17:19.700490] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T21:17:19.705736] [INFO ] [REMOTE ] RPM: Full fetch complete (59223 records). [2025-10-14T21:17:19.705854] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-14T21:17:19.706603] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:17:19.706713] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:17:19.706775] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:17:19.706850] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-14T21:17:19.706915] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-14T21:17:19.706951] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-14T21:17:19.706989] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-14T21:17:19.707044] [INFO ] [MAIN ] Update Progress: 1829/2369 symbols completed. RPM took 34.1s. Estimated remaining: 1h 15m 57s. Rate: 7.1 symbols/min [2025-10-14T21:17:19.888799] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:17:19.889001] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-14T21:17:19.889039] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-14T21:17:19.889154] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-14T21:17:19.889196] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-14T21:17:19.889234] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-14T21:17:19.889265] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-14T21:17:19.963226] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-14T21:17:20.252756] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:17:20.758118] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-14T21:17:21.558048] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-14T21:17:21.855493] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T21:17:22.358044] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-14T21:17:22.404126] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T21:17:22.534076] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T21:17:23.158114] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-14T21:17:23.825062] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T21:17:23.958046] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-14T21:17:24.546178] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T21:17:24.758117] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-14T21:17:25.558093] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-14T21:17:25.778417] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T21:17:26.353802] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T21:17:26.360743] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-14T21:17:27.028458] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T21:17:27.158058] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-14T21:17:27.958053] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-14T21:17:28.293601] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T21:17:28.639000] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T21:17:28.758034] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-14T21:17:29.563190] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-14T21:17:29.575292] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T21:17:30.059036] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T21:17:30.358058] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-14T21:17:31.158043] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-14T21:17:31.437375] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T21:17:31.958050] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-14T21:17:32.111390] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T21:17:32.143485] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-14T21:17:32.758062] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-14T21:17:33.558072] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-14T21:17:33.865488] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-14T21:17:34.073744] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T21:17:34.358063] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-14T21:17:35.094411] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T21:17:35.158187] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-14T21:17:35.550038] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T21:17:35.958166] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-14T21:17:36.603915] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T21:17:36.758143] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-14T21:17:37.558070] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-14T21:17:37.682060] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:17:38.257605] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T21:17:38.358051] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-14T21:17:39.158104] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-14T21:17:39.183121] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:17:39.186472] [INFO ] [REMOTE ] RQI: Full fetch complete (42972 records). [2025-10-14T21:17:39.186554] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-14T21:17:39.187062] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:17:39.187159] [FATAL] [MAIN ] RQI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:17:39.187233] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:17:39.187329] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-14T21:17:39.187406] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-14T21:17:39.187443] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-14T21:17:39.187484] [DEBUG] [LOCAL ] RQI: No derivative data file found to delete. [2025-10-14T21:17:39.187539] [INFO ] [MAIN ] Update Progress: 1830/2369 symbols completed. RQI took 32.4s. Estimated remaining: 1h 15m 52s. Rate: 7.1 symbols/min [2025-10-14T21:17:39.358999] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:17:39.366079] [DEBUG] [LOCAL ] RSF: Loaded 4321 existing records from primary storage. [2025-10-14T21:17:39.366282] [INFO ] [MAIN ] RSF: Loaded 4321 existing records. [2025-10-14T21:17:39.552998] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:17:39.553260] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-14T21:17:39.553338] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-14T21:17:39.553628] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-14T21:17:39.553723] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-14T21:17:39.933203] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:17:39.958040] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-14T21:17:39.963467] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-14T21:17:40.580050] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T21:17:40.761146] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-14T21:17:40.767183] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T21:17:41.558082] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-14T21:17:42.225261] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-14T21:17:42.358172] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-14T21:17:42.683399] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-14T21:17:43.158139] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-14T21:17:43.866424] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T21:17:43.894583] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T21:17:43.958072] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-14T21:17:44.758074] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-14T21:17:45.279845] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T21:17:45.408056] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T21:17:45.558073] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-14T21:17:46.358063] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-14T21:17:46.466853] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T21:17:47.032057] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T21:17:47.158070] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-14T21:17:47.958115] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-14T21:17:48.585470] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T21:17:48.758096] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-14T21:17:49.388418] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T21:17:49.482423] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T21:17:49.488000] [INFO ] [REMOTE ] RRC: Full fetch complete (76290 records). [2025-10-14T21:17:49.488111] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-14T21:17:49.488759] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:17:49.488891] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:17:49.488958] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:17:49.489003] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-14T21:17:49.489081] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-14T21:17:49.489146] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-14T21:17:49.489197] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-14T21:17:49.489252] [INFO ] [MAIN ] Update Progress: 1831/2369 symbols completed. RRC took 33.7s. Estimated remaining: 1h 15m 44s. Rate: 7.1 symbols/min [2025-10-14T21:17:49.563294] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-14T21:17:49.662829] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:17:49.662995] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-14T21:17:49.663031] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-14T21:17:49.663137] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-14T21:17:49.663177] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-14T21:17:49.663215] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-14T21:17:49.663246] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-14T21:17:50.017926] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:17:50.248528] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T21:17:50.358075] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-14T21:17:51.158111] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-14T21:17:51.929933] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T21:17:51.958062] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-14T21:17:52.758085] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-14T21:17:52.983585] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T21:17:53.515753] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T21:17:53.558029] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-14T21:17:53.702728] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T21:17:54.358073] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-14T21:17:54.884420] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-14T21:17:55.134799] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-14T21:17:55.158054] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-14T21:17:55.958119] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-14T21:17:56.570684] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:17:56.758059] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-14T21:17:57.414019] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T21:17:57.558070] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-14T21:17:57.999849] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T21:17:58.303884] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T21:17:58.358030] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-14T21:17:59.021727] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T21:17:59.158073] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-14T21:17:59.782756] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T21:17:59.958072] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-14T21:18:00.527123] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:18:00.528205] [INFO ] [REMOTE ] RSF: Full fetch complete (5682 records). [2025-10-14T21:18:00.528273] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-14T21:18:00.763212] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-14T21:18:00.890389] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-14T21:18:00.890460] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-14T21:18:00.890612] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-14T21:18:00.890675] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-14T21:18:00.891043] [DEBUG] [LOCAL ] RSF: Trimmed 5682 records to 4325 (keeping 200 days of data) [2025-10-14T21:18:00.916871] [DEBUG] [LOCAL ] RSF: Primary data saved (4325 records). [2025-10-14T21:18:00.916951] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-14T21:18:00.917020] [INFO ] [MAIN ] Update Progress: 1832/2369 symbols completed. RSF took 21.7s. Estimated remaining: 1h 15m 37s. Rate: 7.1 symbols/min [2025-10-14T21:18:01.092671] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:01.092854] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-14T21:18:01.092895] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-14T21:18:01.093006] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-14T21:18:01.093048] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-14T21:18:01.093094] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-14T21:18:01.093128] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-14T21:18:01.454703] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:01.558037] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-14T21:18:01.601048] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:18:02.358112] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-14T21:18:03.046403] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T21:18:03.050874] [INFO ] [REMOTE ] RRX: Full fetch complete (58314 records). [2025-10-14T21:18:03.051025] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-14T21:18:03.051823] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:03.051916] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:03.051960] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:03.051998] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-14T21:18:03.052055] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-14T21:18:03.052091] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-14T21:18:03.052131] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-14T21:18:03.052185] [INFO ] [MAIN ] Update Progress: 1833/2369 symbols completed. RRX took 44.0s. Estimated remaining: 1h 15m 26s. Rate: 7.1 symbols/min [2025-10-14T21:18:03.163205] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-14T21:18:03.239776] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:03.268236] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:18:03.304476] [DEBUG] [LOCAL ] RSKD: Loaded 33455 existing records from primary storage. [2025-10-14T21:18:03.304787] [INFO ] [MAIN ] RSKD: Loaded 33455 existing records. [2025-10-14T21:18:03.478996] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:18:03.479183] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-14T21:18:03.479231] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-14T21:18:03.479523] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-14T21:18:03.479582] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-14T21:18:03.835848] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:03.958077] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-14T21:18:04.534763] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T21:18:04.537504] [INFO ] [REMOTE ] RS: Full fetch complete (38663 records). [2025-10-14T21:18:04.537595] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-14T21:18:04.538205] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:04.538297] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:04.538340] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:04.538379] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-14T21:18:04.538433] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-14T21:18:04.538469] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-14T21:18:04.538510] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-14T21:18:04.538563] [INFO ] [MAIN ] Update Progress: 1834/2369 symbols completed. RS took 44.8s. Estimated remaining: 1h 15m 16s. Rate: 7.1 symbols/min [2025-10-14T21:18:04.713540] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:04.713828] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-14T21:18:04.713909] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-14T21:18:04.713992] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-14T21:18:04.714030] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-14T21:18:04.714070] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-14T21:18:04.714101] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-14T21:18:04.766971] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-14T21:18:05.086336] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:05.114909] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-14T21:18:05.558069] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-14T21:18:06.358090] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-14T21:18:06.686160] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T21:18:07.053581] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T21:18:07.158070] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-14T21:18:07.918800] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T21:18:07.958039] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-14T21:18:08.758033] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-14T21:18:08.923379] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T21:18:09.558098] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-14T21:18:09.636084] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T21:18:10.179955] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T21:18:10.358099] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-14T21:18:11.054591] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T21:18:11.158074] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-14T21:18:11.472381] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T21:18:11.958070] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-14T21:18:12.758066] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-14T21:18:12.914717] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:18:13.331593] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T21:18:13.558058] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-14T21:18:14.324684] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T21:18:14.358074] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-14T21:18:14.935853] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T21:18:15.158091] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-14T21:18:15.674340] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T21:18:15.958076] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-14T21:18:16.758092] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-14T21:18:16.878190] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:18:17.558060] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-14T21:18:17.783262] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T21:18:17.984378] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T21:18:18.358147] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-14T21:18:19.109753] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T21:18:19.158035] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-14T21:18:19.958142] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-14T21:18:20.206073] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T21:18:20.655903] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-14T21:18:20.758024] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-14T21:18:21.310570] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T21:18:21.558049] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-14T21:18:22.254424] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T21:18:22.358119] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-14T21:18:22.929722] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T21:18:23.158091] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-14T21:18:23.707453] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T21:18:23.958065] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-14T21:18:24.357463] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T21:18:24.758074] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-14T21:18:25.558067] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-14T21:18:25.649970] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T21:18:26.358085] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-14T21:18:26.683880] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-14T21:18:27.137481] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T21:18:27.158039] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-14T21:18:27.272891] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T21:18:27.815079] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T21:18:27.819473] [INFO ] [REMOTE ] RTO: Full fetch complete (58392 records). [2025-10-14T21:18:27.819577] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-14T21:18:27.820240] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:27.820322] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:27.820365] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:27.820428] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-14T21:18:27.820490] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-14T21:18:27.820525] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-14T21:18:27.820564] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-14T21:18:27.820618] [INFO ] [MAIN ] Update Progress: 1835/2369 symbols completed. RTO took 23.3s. Estimated remaining: 1h 15m 12s. Rate: 7.1 symbols/min [2025-10-14T21:18:27.967832] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-14T21:18:27.993281] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:27.993447] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-14T21:18:27.993543] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-14T21:18:27.993691] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-14T21:18:27.993769] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-14T21:18:27.993820] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-14T21:18:27.993853] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-14T21:18:28.376441] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:28.758044] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-14T21:18:29.525688] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T21:18:29.558059] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-14T21:18:30.028479] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T21:18:30.358058] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-14T21:18:30.995857] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T21:18:31.158043] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-14T21:18:31.958042] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-14T21:18:32.409019] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T21:18:32.414249] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-14T21:18:32.425547] [INFO ] [REMOTE ] RSKD: Full fetch complete (48410 records). [2025-10-14T21:18:32.425632] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-14T21:18:32.763847] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-14T21:18:32.819820] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-14T21:18:32.819900] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-14T21:18:32.820889] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-14T21:18:32.820954] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-14T21:18:32.822249] [DEBUG] [LOCAL ] RSKD: Trimmed 48410 records to 33488 (keeping 200 days of data) [2025-10-14T21:18:33.002554] [DEBUG] [LOCAL ] RSKD: Primary data saved (33488 records). [2025-10-14T21:18:33.002705] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-14T21:18:33.002793] [INFO ] [MAIN ] Update Progress: 1836/2369 symbols completed. RSKD took 30.0s. Estimated remaining: 1h 15m 2s. Rate: 7.1 symbols/min [2025-10-14T21:18:33.172802] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:33.172967] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-14T21:18:33.173004] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-14T21:18:33.173144] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-14T21:18:33.173185] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-14T21:18:33.173225] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-14T21:18:33.173258] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-14T21:18:33.488051] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T21:18:33.560270] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-14T21:18:33.576355] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:34.358039] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-14T21:18:34.513904] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T21:18:34.840000] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-14T21:18:35.158061] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-14T21:18:35.775290] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T21:18:35.958091] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-14T21:18:36.631346] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T21:18:36.636181] [INFO ] [REMOTE ] RSG: Full fetch complete (67919 records). [2025-10-14T21:18:36.636282] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-14T21:18:36.636905] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:36.636988] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:36.637030] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:36.637095] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-14T21:18:36.637156] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-14T21:18:36.637193] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-14T21:18:36.637234] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-14T21:18:36.637289] [INFO ] [MAIN ] Update Progress: 1837/2369 symbols completed. RSG took 47.1s. Estimated remaining: 1h 14m 53s. Rate: 7.1 symbols/min [2025-10-14T21:18:36.758084] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-14T21:18:36.922290] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T21:18:37.558071] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-14T21:18:38.327345] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:18:38.358028] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-14T21:18:39.158056] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-14T21:18:39.516800] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-14T21:18:39.675142] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T21:18:39.958108] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-14T21:18:40.758123] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-14T21:18:40.825972] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:18:41.558124] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-14T21:18:42.231842] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-14T21:18:42.358070] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-14T21:18:42.499625] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T21:18:42.682286] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T21:18:43.158104] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-14T21:18:43.935800] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T21:18:43.940755] [INFO ] [REMOTE ] RSI: Full fetch complete (69303 records). [2025-10-14T21:18:43.940857] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-14T21:18:43.941546] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:43.941677] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:43.941754] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:43.941845] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-14T21:18:43.941923] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-14T21:18:43.941976] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-14T21:18:43.942016] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-14T21:18:43.942069] [INFO ] [MAIN ] Update Progress: 1838/2369 symbols completed. RSI took 43.0s. Estimated remaining: 1h 14m 44s. Rate: 7.1 symbols/min [2025-10-14T21:18:43.958029] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-14T21:18:44.631892] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-14T21:18:44.758070] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-14T21:18:45.430975] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T21:18:45.558091] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-14T21:18:46.702498] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-14T21:18:46.714193] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-14T21:18:47.352784] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T21:18:47.364763] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-14T21:18:49.073720] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-14T21:18:49.085600] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-14T21:18:49.532361] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-14T21:18:49.542135] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-14T21:18:51.132814] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T21:18:51.143800] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-14T21:18:51.474916] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-14T21:18:51.489806] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-14T21:18:52.813153] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:18:52.829973] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-14T21:18:53.660019] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-14T21:18:53.671600] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-14T21:18:54.552763] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T21:18:54.562629] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-14T21:18:54.605160] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T21:18:54.617021] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-14T21:18:55.238792] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:18:55.245797] [INFO ] [REMOTE ] RVLV: Full fetch complete (68674 records). [2025-10-14T21:18:55.246006] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-14T21:18:55.246816] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:55.246928] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:55.246975] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:55.247016] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-14T21:18:55.247077] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-14T21:18:55.247114] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-14T21:18:55.247155] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-14T21:18:55.247218] [INFO ] [MAIN ] Update Progress: 1839/2369 symbols completed. RVLV took 22.2s. Estimated remaining: 1h 14m 36s. Rate: 7.1 symbols/min [2025-10-14T21:18:55.316924] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:18:55.322673] [INFO ] [REMOTE ] RTX: Full fetch complete (77478 records). [2025-10-14T21:18:55.322826] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-14T21:18:55.323485] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:18:55.323582] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:18:55.323685] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:18:55.323758] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-14T21:18:55.323822] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-14T21:18:55.323856] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-14T21:18:55.323909] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-14T21:18:55.323987] [INFO ] [MAIN ] Update Progress: 1840/2369 symbols completed. RTX took 27.5s. Estimated remaining: 1h 14m 25s. Rate: 7.1 symbols/min [2025-10-14T21:18:55.952972] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:55.959044] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:56.011537] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-14T21:18:56.005124] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:56.014276] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-14T21:18:56.017920] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-14T21:18:56.018805] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-14T21:18:56.034855] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-14T21:18:56.038187] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-14T21:18:56.038248] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-14T21:18:56.039375] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-14T21:18:56.039542] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-14T21:18:56.039589] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-14T21:18:56.039158] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:18:56.039782] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-14T21:18:56.060730] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-14T21:18:56.080722] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-14T21:18:56.095346] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-14T21:18:56.114795] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-14T21:18:56.165668] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-14T21:18:56.232893] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-14T21:18:56.290386] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-14T21:18:56.536007] [DEBUG] [LOCAL ] RWT: Loaded 40818 existing records from primary storage. [2025-10-14T21:18:56.714228] [INFO ] [MAIN ] RWT: Loaded 40818 existing records. [2025-10-14T21:18:57.124513] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:57.121599] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:57.152876] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-14T21:18:57.163465] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-14T21:18:57.389771] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:57.386254] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:18:57.390171] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-14T21:18:57.390339] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-14T21:18:57.391174] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-14T21:18:57.391424] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-14T21:18:57.391483] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-14T21:18:57.737109] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:18:57.737415] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-14T21:18:58.005107] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T21:18:58.006290] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-14T21:18:58.572864] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T21:18:58.579192] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-14T21:18:58.631599] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T21:18:58.704399] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T21:18:59.035543] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T21:18:59.158054] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-14T21:18:59.649559] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-14T21:18:59.842382] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T21:18:59.958065] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-14T21:19:00.758068] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-14T21:19:01.558105] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-14T21:19:01.596524] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T21:19:02.150964] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T21:19:02.361629] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-14T21:19:02.366300] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T21:19:03.158067] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-14T21:19:03.576211] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T21:19:03.958067] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-14T21:19:04.758051] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-14T21:19:04.825087] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T21:19:05.267344] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-14T21:19:05.450929] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T21:19:05.558050] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-14T21:19:06.358081] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-14T21:19:06.994744] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T21:19:07.158088] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-14T21:19:07.889691] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:19:07.958041] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-14T21:19:08.478062] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-14T21:19:08.718687] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T21:19:08.758083] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-14T21:19:09.153014] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-14T21:19:09.558064] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-14T21:19:10.358099] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-14T21:19:11.158035] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-14T21:19:11.617987] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T21:19:11.620931] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T21:19:11.958048] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-14T21:19:11.990869] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T21:19:12.675864] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T21:19:12.758079] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-14T21:19:13.298718] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-14T21:19:13.558064] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-14T21:19:14.008636] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-14T21:19:14.009405] [INFO ] [REMOTE ] RWTN: Full fetch complete (3138 records). [2025-10-14T21:19:14.009491] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-14T21:19:14.194354] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-14T21:19:14.194522] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:19:14.194593] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:19:14.194686] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-14T21:19:14.194756] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-14T21:19:14.194794] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-14T21:19:14.194834] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-14T21:19:14.194889] [INFO ] [MAIN ] Update Progress: 1841/2369 symbols completed. RWTN took 18.8s. Estimated remaining: 1h 14m 20s. Rate: 7.1 symbols/min [2025-10-14T21:19:14.369968] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:14.370237] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-14T21:19:14.366459] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-14T21:19:14.370442] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-14T21:19:14.370632] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-14T21:19:14.370734] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-14T21:19:14.371945] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-14T21:19:14.372016] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-14T21:19:14.744430] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:15.158119] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-14T21:19:15.958080] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-14T21:19:16.170305] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T21:19:16.369534] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-14T21:19:16.758105] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-14T21:19:16.866362] [DEBUG] [REMOTE ] RWTO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-14T21:19:16.866729] [WARN ] [REMOTE ] RWTO: No data returned for month 2025-01 [2025-10-14T21:19:16.866816] [FATAL] [REMOTE ] RWTO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:19:16.866889] [FATAL] [MAIN ] RWTO: Failed to fetch primary data. [2025-10-14T21:19:16.866950] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:19:16.867039] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-14T21:19:16.867120] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-14T21:19:16.867159] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-14T21:19:16.867199] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-14T21:19:16.867245] [INFO ] [MAIN ] Update Progress: 1842/2369 symbols completed. RWTO took 2.7s. Estimated remaining: 1h 14m 10s. Rate: 7.1 symbols/min [2025-10-14T21:19:17.055922] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:17.056191] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-14T21:19:17.056510] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-14T21:19:17.056743] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-14T21:19:17.056958] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-14T21:19:17.057122] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-14T21:19:17.057210] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-14T21:19:17.190142] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T21:19:17.490390] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:17.558066] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-14T21:19:18.358057] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-14T21:19:19.158049] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-14T21:19:19.240694] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T21:19:19.958083] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-14T21:19:20.076428] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T21:19:20.490996] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T21:19:20.758131] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-14T21:19:21.211973] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T21:19:21.558106] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-14T21:19:21.850718] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:19:21.851023] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-14T21:19:21.851119] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:19:21.851167] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-14T21:19:21.851226] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:19:21.851296] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-14T21:19:21.851375] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-14T21:19:21.851410] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-14T21:19:21.851448] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-14T21:19:21.851493] [INFO ] [MAIN ] Update Progress: 1843/2369 symbols completed. RWTP took 5.0s. Estimated remaining: 1h 14m 0s. Rate: 7.1 symbols/min [2025-10-14T21:19:22.017771] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:22.017928] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-14T21:19:22.017964] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-14T21:19:22.018069] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-14T21:19:22.018109] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-14T21:19:22.018147] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-14T21:19:22.018177] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-14T21:19:22.376270] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:22.370473] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-14T21:19:22.422221] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T21:19:23.158053] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-14T21:19:23.918301] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T21:19:23.958064] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-14T21:19:24.609614] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T21:19:24.758075] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-14T21:19:25.131556] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T21:19:25.558096] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-14T21:19:26.221008] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:19:26.358078] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-14T21:19:26.898745] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T21:19:27.158076] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-14T21:19:27.958045] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-14T21:19:28.052588] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T21:19:28.432963] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T21:19:28.521835] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T21:19:28.758099] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-14T21:19:29.558037] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-14T21:19:29.960094] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T21:19:30.358071] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-14T21:19:30.895215] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T21:19:30.898116] [INFO ] [REMOTE ] RVT: Full fetch complete (39028 records). [2025-10-14T21:19:30.898191] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-14T21:19:30.898626] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:19:30.898741] [FATAL] [MAIN ] RVT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:19:30.898804] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:19:30.898905] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-14T21:19:30.898980] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-14T21:19:30.899016] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-14T21:19:30.899054] [DEBUG] [LOCAL ] RVT: No derivative data file found to delete. [2025-10-14T21:19:30.899105] [INFO ] [MAIN ] Update Progress: 1844/2369 symbols completed. RVT took 35.6s. Estimated remaining: 1h 13m 52s. Rate: 7.1 symbols/min [2025-10-14T21:19:31.069255] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:31.069480] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-14T21:19:31.069625] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-14T21:19:31.069884] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-14T21:19:31.069949] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-14T21:19:31.070034] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-14T21:19:31.070092] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-14T21:19:31.167305] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-14T21:19:31.373453] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T21:19:31.456781] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:31.914363] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T21:19:31.918692] [INFO ] [REMOTE ] RWT: Full fetch complete (58297 records). [2025-10-14T21:19:31.918772] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-14T21:19:31.963249] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-14T21:19:32.328966] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-14T21:19:32.329069] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-14T21:19:32.330133] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-14T21:19:32.330198] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-14T21:19:32.331365] [DEBUG] [LOCAL ] RWT: Trimmed 58297 records to 40829 (keeping 200 days of data) [2025-10-14T21:19:32.574356] [DEBUG] [LOCAL ] RWT: Primary data saved (40829 records). [2025-10-14T21:19:32.574491] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-14T21:19:32.574588] [INFO ] [MAIN ] Update Progress: 1845/2369 symbols completed. RWT took 37.2s. Estimated remaining: 1h 13m 42s. Rate: 7.1 symbols/min [2025-10-14T21:19:32.764360] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-14T21:19:32.769791] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:32.770092] [DEBUG] [LOCAL ] RYAM: No existing data file found in primary storage. [2025-10-14T21:19:32.770147] [WARN ] [MAIN ] RYAM: No existing data found, performing full refresh instead. [2025-10-14T21:19:32.770260] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-14T21:19:32.770303] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-14T21:19:32.770383] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-14T21:19:32.770436] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-14T21:19:33.144890] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:33.558037] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-14T21:19:33.775200] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T21:19:34.358029] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-14T21:19:34.396559] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T21:19:34.848634] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-14T21:19:35.158087] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-14T21:19:35.958040] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-14T21:19:36.005878] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T21:19:36.149088] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T21:19:36.758108] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-14T21:19:37.213113] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T21:19:37.486571] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T21:19:37.491700] [INFO ] [REMOTE ] RVTY: Full fetch complete (67003 records). [2025-10-14T21:19:37.491821] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-14T21:19:37.492421] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:19:37.492505] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:19:37.492546] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:19:37.492596] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-14T21:19:37.492715] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-14T21:19:37.492775] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-14T21:19:37.492837] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-14T21:19:37.492907] [INFO ] [MAIN ] Update Progress: 1846/2369 symbols completed. RVTY took 42.2s. Estimated remaining: 1h 13m 32s. Rate: 7.1 symbols/min [2025-10-14T21:19:37.563293] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-14T21:19:37.671662] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:37.671830] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-14T21:19:37.671867] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-14T21:19:37.671974] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-14T21:19:37.672014] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-14T21:19:37.672054] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-14T21:19:37.672084] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-14T21:19:38.023861] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:38.358087] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-14T21:19:38.989723] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T21:19:39.158076] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-14T21:19:39.958047] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-14T21:19:40.069959] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:19:40.758087] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-14T21:19:41.171258] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-14T21:19:41.345946] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T21:19:41.558037] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-14T21:19:42.177995] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T21:19:42.358086] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-14T21:19:43.158045] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-14T21:19:43.429425] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T21:19:43.958065] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-14T21:19:44.222723] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T21:19:44.559812] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T21:19:44.758140] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-14T21:19:45.154090] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T21:19:45.558093] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-14T21:19:46.339060] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T21:19:46.358057] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-14T21:19:47.158131] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-14T21:19:47.212711] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T21:19:47.645399] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T21:19:47.958087] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-14T21:19:48.208468] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T21:19:48.758116] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-14T21:19:49.558104] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-14T21:19:49.645370] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T21:19:50.175545] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T21:19:50.358040] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-14T21:19:51.158103] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-14T21:19:51.361575] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T21:19:51.749560] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T21:19:51.958078] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-14T21:19:52.758053] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-14T21:19:53.016395] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T21:19:53.542765] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:19:53.558023] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-14T21:19:53.747037] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T21:19:54.358051] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-14T21:19:55.108350] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-14T21:19:55.113455] [INFO ] [REMOTE ] RXO: Full fetch complete (68359 records). [2025-10-14T21:19:55.113584] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-14T21:19:55.114321] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:19:55.114411] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:19:55.114453] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:19:55.114517] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-14T21:19:55.114579] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-14T21:19:55.114613] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-14T21:19:55.114679] [DEBUG] [LOCAL ] RXO: No derivative data file found to delete. [2025-10-14T21:19:55.114813] [INFO ] [MAIN ] Update Progress: 1847/2369 symbols completed. RXO took 33.3s. Estimated remaining: 1h 13m 26s. Rate: 7.1 symbols/min [2025-10-14T21:19:55.158758] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-14T21:19:55.319179] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:19:55.321751] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T21:19:55.349149] [DEBUG] [LOCAL ] RYI: Loaded 21711 existing records from primary storage. [2025-10-14T21:19:55.349382] [INFO ] [MAIN ] RYI: Loaded 21711 existing records. [2025-10-14T21:19:55.527856] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:19:55.528081] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-14T21:19:55.528154] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-14T21:19:55.528425] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-14T21:19:55.528482] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-14T21:19:55.886161] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:19:55.958035] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-14T21:19:56.758064] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-14T21:19:56.924612] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T21:19:57.332336] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T21:19:57.558064] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-14T21:19:57.737387] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T21:19:58.358083] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-14T21:19:58.781192] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T21:19:59.158080] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-14T21:19:59.773290] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T21:19:59.958136] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-14T21:20:00.758029] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-14T21:20:01.186510] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T21:20:01.530548] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T21:20:01.558080] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-14T21:20:02.136543] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T21:20:02.358100] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-14T21:20:03.158089] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-14T21:20:03.301487] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T21:20:03.958103] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-14T21:20:04.113015] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T21:20:04.402567] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T21:20:04.758060] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-14T21:20:05.558030] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-14T21:20:05.716109] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T21:20:06.038673] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T21:20:06.358065] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-14T21:20:07.069610] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T21:20:07.099353] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T21:20:07.158030] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-14T21:20:07.958033] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-14T21:20:08.342209] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T21:20:08.636234] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:20:08.639986] [INFO ] [REMOTE ] RYAM: Full fetch complete (48930 records). [2025-10-14T21:20:08.640098] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-14T21:20:08.640828] [FATAL] [VALIDATOR ] RYAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:20:08.640917] [FATAL] [MAIN ] RYAM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:20:08.640985] [WARN ] [MAIN ] RYAM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:20:08.641071] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-14T21:20:08.641149] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-14T21:20:08.641198] [INFO ] [LOCAL ] RYAM: Starting deletion of derivative data. [2025-10-14T21:20:08.641256] [DEBUG] [LOCAL ] RYAM: No derivative data file found to delete. [2025-10-14T21:20:08.641330] [INFO ] [MAIN ] Update Progress: 1848/2369 symbols completed. RYAM took 36.1s. Estimated remaining: 1h 13m 19s. Rate: 7.1 symbols/min [2025-10-14T21:20:08.763190] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-14T21:20:08.817488] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:08.859790] [DEBUG] [LOCAL ] RYN: Loaded 45397 existing records from primary storage. [2025-10-14T21:20:08.860087] [INFO ] [MAIN ] RYN: Loaded 45397 existing records. [2025-10-14T21:20:09.043120] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:09.043338] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-14T21:20:09.043408] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-14T21:20:09.043762] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-14T21:20:09.043820] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-14T21:20:09.404158] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:09.558065] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-14T21:20:10.358107] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-14T21:20:10.614153] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T21:20:10.848104] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T21:20:11.158075] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-14T21:20:11.338207] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T21:20:11.958052] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-14T21:20:12.139931] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T21:20:12.758066] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-14T21:20:13.534839] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T21:20:13.539858] [INFO ] [REMOTE ] RYAN: Full fetch complete (64117 records). [2025-10-14T21:20:13.539967] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-14T21:20:13.540580] [FATAL] [VALIDATOR ] RYAN: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:20:13.540683] [FATAL] [MAIN ] RYAN: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:20:13.540764] [WARN ] [MAIN ] RYAN: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:20:13.540834] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-14T21:20:13.540896] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-14T21:20:13.540931] [INFO ] [LOCAL ] RYAN: Starting deletion of derivative data. [2025-10-14T21:20:13.540969] [DEBUG] [LOCAL ] RYAN: No derivative data file found to delete. [2025-10-14T21:20:13.541023] [INFO ] [MAIN ] Update Progress: 1849/2369 symbols completed. RYAN took 36.0s. Estimated remaining: 1h 13m 10s. Rate: 7.1 symbols/min [2025-10-14T21:20:13.563172] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-14T21:20:13.723223] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:13.731479] [DEBUG] [LOCAL ] RZB: Loaded 6002 existing records from primary storage. [2025-10-14T21:20:13.731727] [INFO ] [MAIN ] RZB: Loaded 6002 existing records. [2025-10-14T21:20:13.936543] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-14T21:20:13.941693] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:13.950371] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-14T21:20:13.950430] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-14T21:20:13.950634] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-14T21:20:13.950719] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-14T21:20:14.302300] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:14.358077] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-14T21:20:14.986847] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T21:20:15.048668] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T21:20:15.158073] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-14T21:20:15.612853] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-14T21:20:15.958070] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-14T21:20:16.426117] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T21:20:16.758082] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-14T21:20:17.495943] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T21:20:17.558064] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-14T21:20:18.358115] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-14T21:20:19.022917] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:20:19.158040] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-14T21:20:19.258080] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T21:20:19.893272] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T21:20:19.958065] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-14T21:20:20.644407] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T21:20:20.649697] [INFO ] [REMOTE ] RY: Full fetch complete (68725 records). [2025-10-14T21:20:20.649810] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-14T21:20:20.650477] [FATAL] [VALIDATOR ] RY: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:20:20.650566] [FATAL] [MAIN ] RY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:20:20.650608] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:20:20.650667] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-14T21:20:20.650745] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-14T21:20:20.650782] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-14T21:20:20.650854] [DEBUG] [LOCAL ] RY: No derivative data file found to delete. [2025-10-14T21:20:20.650920] [INFO ] [MAIN ] Update Progress: 1850/2369 symbols completed. RY took 49.8s. Estimated remaining: 1h 13m 1s. Rate: 7.1 symbols/min [2025-10-14T21:20:20.763244] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-14T21:20:20.856361] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:20.865818] [DEBUG] [LOCAL ] RZC: Loaded 6775 existing records from primary storage. [2025-10-14T21:20:20.866022] [INFO ] [MAIN ] RZC: Loaded 6775 existing records. [2025-10-14T21:20:21.064148] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:21.064340] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-14T21:20:21.064387] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-14T21:20:21.064585] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-14T21:20:21.064697] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-14T21:20:21.468115] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:21.558041] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-14T21:20:22.099038] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T21:20:22.119213] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T21:20:22.358051] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-14T21:20:23.158117] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-14T21:20:23.858276] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T21:20:23.938188] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T21:20:23.958034] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-14T21:20:24.655586] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:20:24.658029] [INFO ] [REMOTE ] RYI: Full fetch complete (31906 records). [2025-10-14T21:20:24.658099] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-14T21:20:24.658534] [FATAL] [VALIDATOR ] RYI: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:20:24.658614] [FATAL] [MAIN ] RYI: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:20:24.658687] [WARN ] [MAIN ] RYI: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:20:24.658757] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-14T21:20:24.658816] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-14T21:20:24.658850] [INFO ] [LOCAL ] RYI: Starting deletion of derivative data. [2025-10-14T21:20:24.659026] [DEBUG] [LOCAL ] RYI: Deleted derivative data file. [2025-10-14T21:20:24.659133] [INFO ] [MAIN ] Update Progress: 1851/2369 symbols completed. RYI took 29.5s. Estimated remaining: 1h 12m 52s. Rate: 7.1 symbols/min [2025-10-14T21:20:24.762586] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-14T21:20:24.831967] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:24.883492] [DEBUG] [LOCAL ] S: Loaded 53533 existing records from primary storage. [2025-10-14T21:20:24.883809] [INFO ] [MAIN ] S: Loaded 53533 existing records. [2025-10-14T21:20:25.057869] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:25.058054] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-14T21:20:25.058099] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-14T21:20:25.058376] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-14T21:20:25.058440] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-14T21:20:25.403359] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:25.558021] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-14T21:20:25.975326] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T21:20:26.358083] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-14T21:20:27.158051] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-14T21:20:27.211684] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T21:20:27.747964] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-14T21:20:27.958065] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-14T21:20:28.758099] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-14T21:20:29.032089] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T21:20:29.557597] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T21:20:29.559085] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-14T21:20:29.919325] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T21:20:30.358057] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-14T21:20:30.394631] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-14T21:20:31.158066] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-14T21:20:31.261117] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-14T21:20:31.958071] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-14T21:20:32.758060] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-14T21:20:32.776058] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T21:20:32.885361] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T21:20:33.351912] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T21:20:33.558041] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-14T21:20:33.970311] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-14T21:20:33.971244] [INFO ] [REMOTE ] RZB: Full fetch complete (8474 records). [2025-10-14T21:20:33.971312] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-14T21:20:33.971677] [FATAL] [VALIDATOR ] RZB: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-14). Symbol may be delisted or halted. [2025-10-14T21:20:33.971758] [FATAL] [MAIN ] RZB: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:20:33.971801] [WARN ] [MAIN ] RZB: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:20:33.971839] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-14T21:20:33.971939] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-14T21:20:33.971988] [INFO ] [LOCAL ] RZB: Starting deletion of derivative data. [2025-10-14T21:20:33.972313] [DEBUG] [LOCAL ] RZB: Deleted derivative data file. [2025-10-14T21:20:33.972400] [INFO ] [MAIN ] Update Progress: 1852/2369 symbols completed. RZB took 20.4s. Estimated remaining: 1h 12m 43s. Rate: 7.1 symbols/min [2025-10-14T21:20:34.140635] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:34.182561] [DEBUG] [LOCAL ] SA: Loaded 44307 existing records from primary storage. [2025-10-14T21:20:34.182875] [INFO ] [MAIN ] SA: Loaded 44307 existing records. [2025-10-14T21:20:34.355698] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:34.355923] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-14T21:20:34.355969] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-14T21:20:34.356184] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-14T21:20:34.356240] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-14T21:20:34.367061] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-14T21:20:34.706093] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:35.158073] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-14T21:20:35.958083] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-14T21:20:36.152408] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T21:20:36.662084] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T21:20:36.686147] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T21:20:36.758062] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-14T21:20:37.558079] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-14T21:20:38.363483] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-14T21:20:38.370061] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T21:20:39.097549] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-14T21:20:39.158088] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-14T21:20:39.528298] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-14T21:20:39.958097] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-14T21:20:40.758825] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-14T21:20:40.768180] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T21:20:40.770026] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T21:20:41.558060] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-14T21:20:42.358049] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-14T21:20:42.431115] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T21:20:43.158118] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-14T21:20:43.806745] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-14T21:20:43.958087] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-14T21:20:43.984695] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T21:20:44.706152] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T21:20:44.758083] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-14T21:20:45.270680] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T21:20:45.271859] [INFO ] [REMOTE ] RZC: Full fetch complete (9693 records). [2025-10-14T21:20:45.271929] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-14T21:20:45.563304] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-14T21:20:45.623082] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-14T21:20:45.623151] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-14T21:20:45.623376] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-14T21:20:45.623412] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-14T21:20:45.623867] [DEBUG] [LOCAL ] RZC: Trimmed 9693 records to 6756 (keeping 200 days of data) [2025-10-14T21:20:45.666725] [DEBUG] [LOCAL ] RZC: Primary data saved (6756 records). [2025-10-14T21:20:45.666824] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-14T21:20:45.666897] [INFO ] [MAIN ] Update Progress: 1853/2369 symbols completed. RZC took 25.0s. Estimated remaining: 1h 12m 36s. Rate: 7.1 symbols/min [2025-10-14T21:20:45.831624] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:45.842323] [DEBUG] [LOCAL ] SABA: Loaded 9326 existing records from primary storage. [2025-10-14T21:20:45.842520] [INFO ] [MAIN ] SABA: Loaded 9326 existing records. [2025-10-14T21:20:46.014837] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:46.015026] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-14T21:20:46.015071] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-14T21:20:46.015242] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-14T21:20:46.015281] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-14T21:20:46.368130] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:46.362485] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-14T21:20:46.677253] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (5.12 seconds). [2025-10-14T21:20:47.158067] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-14T21:20:47.379013] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-14T21:20:47.837072] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T21:20:47.958038] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-14T21:20:48.758078] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-14T21:20:49.558046] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-14T21:20:49.659298] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-14T21:20:49.778829] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T21:20:50.368210] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-14T21:20:50.371283] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-14T21:20:50.427835] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-14T21:20:51.158067] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-14T21:20:51.958116] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-14T21:20:52.104219] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T21:20:52.569393] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T21:20:52.758059] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-14T21:20:53.558042] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-14T21:20:53.691897] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T21:20:54.176815] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T21:20:54.181888] [INFO ] [REMOTE ] RYN: Full fetch complete (65286 records). [2025-10-14T21:20:54.181991] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-14T21:20:54.360934] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-14T21:20:54.589163] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-14T21:20:54.594921] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-14T21:20:54.596568] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-14T21:20:54.596681] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-14T21:20:54.597106] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T21:20:54.602715] [DEBUG] [LOCAL ] RYN: Trimmed 65286 records to 45455 (keeping 200 days of data) [2025-10-14T21:20:54.883725] [DEBUG] [LOCAL ] RYN: Primary data saved (45455 records). [2025-10-14T21:20:54.883852] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-14T21:20:54.883929] [INFO ] [MAIN ] Update Progress: 1854/2369 symbols completed. RYN took 46.2s. Estimated remaining: 1h 12m 28s. Rate: 7.1 symbols/min [2025-10-14T21:20:55.055688] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:20:55.086463] [DEBUG] [LOCAL ] SAFE: Loaded 30391 existing records from primary storage. [2025-10-14T21:20:55.086762] [INFO ] [MAIN ] SAFE: Loaded 30391 existing records. [2025-10-14T21:20:55.163300] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-14T21:20:55.273488] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:20:55.273745] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-14T21:20:55.273799] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-14T21:20:55.274012] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-14T21:20:55.274070] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-14T21:20:55.638854] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:20:55.819011] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T21:20:55.958055] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-14T21:20:56.058592] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T21:20:56.758055] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-14T21:20:57.507571] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T21:20:57.535398] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T21:20:57.558025] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-14T21:20:58.358123] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-14T21:20:59.158080] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-14T21:20:59.280054] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T21:20:59.958103] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-14T21:21:00.236438] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-14T21:21:00.578602] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T21:21:00.594337] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T21:21:00.758047] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-14T21:21:01.558076] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-14T21:21:02.358082] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-14T21:21:03.012584] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-14T21:21:03.158044] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-14T21:21:03.252775] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T21:21:03.258399] [INFO ] [REMOTE ] SA: Full fetch complete (63127 records). [2025-10-14T21:21:03.258533] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-14T21:21:03.651917] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-14T21:21:03.652117] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-14T21:21:03.653318] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-14T21:21:03.653399] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-14T21:21:03.654749] [DEBUG] [LOCAL ] SA: Trimmed 63127 records to 44313 (keeping 200 days of data) [2025-10-14T21:21:03.769579] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T21:21:03.942049] [DEBUG] [LOCAL ] SA: Primary data saved (44313 records). [2025-10-14T21:21:03.942214] [INFO ] [MAIN ] SA: Full history saved. [2025-10-14T21:21:03.942297] [INFO ] [MAIN ] Update Progress: 1855/2369 symbols completed. SA took 30.0s. Estimated remaining: 1h 12m 19s. Rate: 7.1 symbols/min [2025-10-14T21:21:03.963174] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-14T21:21:04.127184] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:21:04.151621] [DEBUG] [LOCAL ] SAH: Loaded 21515 existing records from primary storage. [2025-10-14T21:21:04.151956] [INFO ] [MAIN ] SAH: Loaded 21515 existing records. [2025-10-14T21:21:04.340092] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:21:04.340325] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-14T21:21:04.340373] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-14T21:21:04.340572] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-14T21:21:04.340629] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-14T21:21:04.703705] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:21:04.708470] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T21:21:04.758049] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-14T21:21:05.028347] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T21:21:05.558068] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-14T21:21:05.638183] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T21:21:06.358076] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-14T21:21:06.887629] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T21:21:07.038724] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-14T21:21:07.158067] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-14T21:21:07.958103] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-14T21:21:08.758116] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-14T21:21:09.200863] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T21:21:09.316544] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-14T21:21:09.558052] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-14T21:21:09.896364] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T21:21:10.308042] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T21:21:10.358095] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-14T21:21:11.099907] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T21:21:11.158041] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-14T21:21:11.958061] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-14T21:21:12.333124] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T21:21:12.758070] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-14T21:21:13.558106] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-14T21:21:14.047323] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-14T21:21:14.053779] [INFO ] [REMOTE ] S: Full fetch complete (77656 records). [2025-10-14T21:21:14.053910] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-14T21:21:14.176693] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T21:21:14.271312] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T21:21:14.366561] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-14T21:21:14.505139] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-14T21:21:14.505223] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-14T21:21:14.506386] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-14T21:21:14.506459] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-14T21:21:14.507973] [DEBUG] [LOCAL ] S: Trimmed 77656 records to 53536 (keeping 200 days of data) [2025-10-14T21:21:14.821743] [DEBUG] [LOCAL ] S: Primary data saved (53536 records). [2025-10-14T21:21:14.821871] [INFO ] [MAIN ] S: Full history saved. [2025-10-14T21:21:14.821948] [INFO ] [MAIN ] Update Progress: 1856/2369 symbols completed. S took 50.2s. Estimated remaining: 1h 12m 12s. Rate: 7.1 symbols/min [2025-10-14T21:21:14.996377] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:21:14.996564] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-14T21:21:14.996602] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-14T21:21:14.996732] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-14T21:21:14.996775] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-14T21:21:14.996815] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-14T21:21:14.996847] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-14T21:21:15.170637] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-14T21:21:15.360699] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:21:15.554476] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T21:21:15.958075] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-14T21:21:16.634478] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T21:21:16.758057] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-14T21:21:17.042639] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T21:21:17.074089] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-14T21:21:17.558112] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-14T21:21:18.358040] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-14T21:21:18.752080] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T21:21:19.158044] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-14T21:21:19.567590] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T21:21:19.578024] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-14T21:21:19.958101] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-14T21:21:20.312440] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-14T21:21:20.758079] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-14T21:21:21.558126] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-14T21:21:22.014494] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T21:21:22.358091] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-14T21:21:22.458022] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T21:21:22.682949] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-14T21:21:23.158097] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-14T21:21:23.465315] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-14T21:21:23.958035] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-14T21:21:24.278692] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-14T21:21:24.758097] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-14T21:21:25.120491] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T21:21:25.558079] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-14T21:21:26.358134] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-14T21:21:26.971789] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:21:26.995295] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T21:21:27.158078] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-14T21:21:27.516514] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-14T21:21:27.958067] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-14T21:21:28.279618] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-14T21:21:28.758065] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-14T21:21:29.558050] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-14T21:21:29.673237] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T21:21:29.675896] [INFO ] [REMOTE ] SAH: Full fetch complete (30787 records). [2025-10-14T21:21:29.675984] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-14T21:21:30.093328] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-14T21:21:30.093405] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-14T21:21:30.094062] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-14T21:21:30.094121] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-14T21:21:30.094864] [DEBUG] [LOCAL ] SAH: Trimmed 30787 records to 21418 (keeping 200 days of data) [2025-10-14T21:21:30.235551] [DEBUG] [LOCAL ] SAH: Primary data saved (21418 records). [2025-10-14T21:21:30.235707] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-14T21:21:30.235801] [INFO ] [MAIN ] Update Progress: 1857/2369 symbols completed. SAH took 26.3s. Estimated remaining: 1h 12m 5s. Rate: 7.1 symbols/min [2025-10-14T21:21:30.360054] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-14T21:21:30.454994] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:21:30.481024] [DEBUG] [LOCAL ] SAM: Loaded 21459 existing records from primary storage. [2025-10-14T21:21:30.481335] [INFO ] [MAIN ] SAM: Loaded 21459 existing records. [2025-10-14T21:21:30.725933] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:21:30.726354] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-14T21:21:30.726431] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-14T21:21:30.726845] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-14T21:21:30.726962] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-14T21:21:30.902309] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T21:21:31.161771] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-14T21:21:31.182230] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T21:21:31.379072] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:21:31.589007] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T21:21:31.958074] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-14T21:21:32.758049] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-14T21:21:33.001196] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-14T21:21:33.001851] [INFO ] [REMOTE ] SAJ: Full fetch complete (918 records). [2025-10-14T21:21:33.001917] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-14T21:21:33.188696] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-14T21:21:33.188964] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:21:33.189137] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:21:33.195380] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-14T21:21:33.205574] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-14T21:21:33.205696] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-14T21:21:33.205838] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-14T21:21:33.206502] [INFO ] [MAIN ] Update Progress: 1858/2369 symbols completed. SAJ took 18.4s. Estimated remaining: 1h 11m 55s. Rate: 7.1 symbols/min [2025-10-14T21:21:33.207140] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T21:21:33.394484] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:21:33.444405] [DEBUG] [LOCAL ] SAN: Loaded 52978 existing records from primary storage. [2025-10-14T21:21:33.444759] [INFO ] [MAIN ] SAN: Loaded 52978 existing records. [2025-10-14T21:21:33.563179] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-14T21:21:33.625894] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:21:33.626125] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-14T21:21:33.626182] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-14T21:21:33.626411] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-14T21:21:33.626452] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-14T21:21:33.994308] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:21:34.358093] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-14T21:21:34.586517] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T21:21:34.589967] [INFO ] [REMOTE ] SAFE: Full fetch complete (44577 records). [2025-10-14T21:21:34.590052] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-14T21:21:34.976389] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-14T21:21:34.976488] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-14T21:21:34.977393] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-14T21:21:34.977452] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-14T21:21:34.978384] [DEBUG] [LOCAL ] SAFE: Trimmed 44577 records to 30390 (keeping 200 days of data) [2025-10-14T21:21:35.160033] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-14T21:21:35.166093] [DEBUG] [LOCAL ] SAFE: Primary data saved (30390 records). [2025-10-14T21:21:35.166392] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-14T21:21:35.166619] [INFO ] [MAIN ] Update Progress: 1859/2369 symbols completed. SAFE took 40.3s. Estimated remaining: 1h 11m 45s. Rate: 7.1 symbols/min [2025-10-14T21:21:35.242382] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T21:21:35.282848] [INFO ] [REMOTE ] SABA: Full fetch complete (15269 records). [2025-10-14T21:21:35.283049] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-14T21:21:35.461042] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:21:35.749630] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-14T21:21:35.749821] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-14T21:21:35.750865] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-14T21:21:35.750949] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-14T21:21:35.766514] [DEBUG] [LOCAL ] SABA: Trimmed 15269 records to 9326 (keeping 200 days of data) [2025-10-14T21:21:35.767331] [DEBUG] [LOCAL ] SAND: Loaded 51843 existing records from primary storage. [2025-10-14T21:21:35.768217] [INFO ] [MAIN ] SAND: Loaded 51843 existing records. [2025-10-14T21:21:35.924897] [DEBUG] [LOCAL ] SABA: Primary data saved (9326 records). [2025-10-14T21:21:35.925218] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-14T21:21:35.931141] [INFO ] [MAIN ] Update Progress: 1860/2369 symbols completed. SABA took 50.3s. Estimated remaining: 1h 11m 34s. Rate: 7.1 symbols/min [2025-10-14T21:21:35.967174] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-14T21:21:36.125833] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:21:36.129587] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-14T21:21:36.130109] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-14T21:21:36.153993] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-14T21:21:36.165545] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-14T21:21:36.165438] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:21:36.271050] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:21:36.606415] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:21:36.609018] [DEBUG] [LOCAL ] SAP: Loaded 49885 existing records from primary storage. [2025-10-14T21:21:36.609353] [INFO ] [MAIN ] SAP: Loaded 49885 existing records. [2025-10-14T21:21:36.767375] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-14T21:21:36.792529] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:21:36.792782] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-14T21:21:36.792846] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-14T21:21:36.793183] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-14T21:21:36.793238] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-14T21:21:37.156446] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:21:37.558042] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-14T21:21:38.041475] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T21:21:38.358073] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-14T21:21:38.690342] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T21:21:39.158077] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-14T21:21:39.410872] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-14T21:21:39.462969] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T21:21:39.958115] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-14T21:21:40.682796] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T21:21:40.758043] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-14T21:21:41.558039] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-14T21:21:41.830767] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T21:21:42.358335] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-14T21:21:42.359501] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T21:21:43.094628] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T21:21:43.158036] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-14T21:21:43.958072] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-14T21:21:44.117242] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T21:21:44.758158] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-14T21:21:44.911905] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T21:21:45.039304] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T21:21:45.558063] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-14T21:21:46.358041] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-14T21:21:46.681219] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T21:21:47.158048] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-14T21:21:47.252451] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T21:21:47.958089] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-14T21:21:48.126618] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T21:21:48.758040] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-14T21:21:49.199627] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T21:21:49.558054] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-14T21:21:49.710444] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T21:21:50.358078] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-14T21:21:50.887525] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-14T21:21:51.158053] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-14T21:21:51.420188] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T21:21:51.443340] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T21:21:51.958115] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-14T21:21:52.758143] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-14T21:21:52.921496] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T21:21:53.558084] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-14T21:21:53.678946] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T21:21:53.899546] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T21:21:54.358109] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-14T21:21:55.158063] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-14T21:21:55.254561] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T21:21:55.958123] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-14T21:21:56.191818] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T21:21:56.237557] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T21:21:56.758090] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-14T21:21:57.558038] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-14T21:21:57.723011] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T21:21:58.358037] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-14T21:21:58.454186] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T21:21:58.659612] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T21:21:59.158096] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-14T21:21:59.958044] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-14T21:22:00.087106] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T21:22:00.758107] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-14T21:22:01.115552] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T21:22:01.479476] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T21:22:01.558067] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-14T21:22:02.358039] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-14T21:22:02.762670] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-14T21:22:02.941145] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T21:22:03.158077] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-14T21:22:03.612885] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T21:22:03.958068] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-14T21:22:04.762351] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-14T21:22:04.768697] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T21:22:05.558047] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-14T21:22:05.696499] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T21:22:06.231180] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T21:22:06.236608] [INFO ] [REMOTE ] SAP: Full fetch complete (72083 records). [2025-10-14T21:22:06.236765] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-14T21:22:06.373269] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-14T21:22:06.652407] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-14T21:22:06.652485] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-14T21:22:06.653576] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-14T21:22:06.653682] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-14T21:22:06.655042] [DEBUG] [LOCAL ] SAP: Trimmed 72083 records to 49909 (keeping 200 days of data) [2025-10-14T21:22:06.960079] [DEBUG] [LOCAL ] SAP: Primary data saved (49909 records). [2025-10-14T21:22:06.960243] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-14T21:22:06.960362] [INFO ] [MAIN ] Update Progress: 1861/2369 symbols completed. SAP took 31.0s. Estimated remaining: 1h 11m 32s. Rate: 7.1 symbols/min [2025-10-14T21:22:07.148796] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T21:22:07.173405] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:07.171195] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-14T21:22:07.180334] [INFO ] [REMOTE ] SAND: Full fetch complete (74668 records). [2025-10-14T21:22:07.180441] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-14T21:22:07.316430] [DEBUG] [LOCAL ] SAR: Loaded 17161 existing records from primary storage. [2025-10-14T21:22:07.342509] [INFO ] [MAIN ] SAR: Loaded 17161 existing records. [2025-10-14T21:22:07.751902] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:22:07.757466] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-14T21:22:07.791144] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-14T21:22:07.844526] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-14T21:22:07.844658] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-14T21:22:07.844879] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-14T21:22:07.850298] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-14T21:22:07.864984] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-14T21:22:07.896089] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-14T21:22:07.977936] [DEBUG] [LOCAL ] SAND: Trimmed 74668 records to 51857 (keeping 200 days of data) [2025-10-14T21:22:08.187714] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T21:22:08.309140] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-14T21:22:08.421262] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:08.425390] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T21:22:08.639194] [DEBUG] [LOCAL ] SAND: Primary data saved (51857 records). [2025-10-14T21:22:08.639327] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-14T21:22:08.639409] [INFO ] [MAIN ] Update Progress: 1862/2369 symbols completed. SAND took 33.5s. Estimated remaining: 1h 11m 22s. Rate: 7.1 symbols/min [2025-10-14T21:22:08.763290] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-14T21:22:08.817107] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:08.867148] [DEBUG] [LOCAL ] SARO: Loaded 48347 existing records from primary storage. [2025-10-14T21:22:08.867533] [INFO ] [MAIN ] SARO: Loaded 48347 existing records. [2025-10-14T21:22:09.059457] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:22:09.059714] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-14T21:22:09.059772] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-14T21:22:09.060031] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-14T21:22:09.060070] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-14T21:22:09.409748] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:09.558110] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-14T21:22:09.662458] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T21:22:09.821194] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T21:22:09.827132] [INFO ] [REMOTE ] SAN: Full fetch complete (76503 records). [2025-10-14T21:22:09.827277] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-14T21:22:10.222323] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-14T21:22:10.222417] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-14T21:22:10.223577] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-14T21:22:10.223663] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-14T21:22:10.225194] [DEBUG] [LOCAL ] SAN: Trimmed 76503 records to 52972 (keeping 200 days of data) [2025-10-14T21:22:10.397951] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-14T21:22:10.569011] [DEBUG] [LOCAL ] SAN: Primary data saved (52972 records). [2025-10-14T21:22:10.569146] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-14T21:22:10.569227] [INFO ] [MAIN ] Update Progress: 1863/2369 symbols completed. SAN took 37.4s. Estimated remaining: 1h 11m 12s. Rate: 7.1 symbols/min [2025-10-14T21:22:10.744565] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:10.744833] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-14T21:22:10.744925] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-14T21:22:10.745147] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-14T21:22:10.745269] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-14T21:22:10.758207] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-14T21:22:10.759346] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T21:22:10.758880] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-14T21:22:11.114390] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:11.158027] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-14T21:22:11.589544] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-14T21:22:11.830639] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T21:22:11.958064] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-14T21:22:12.361256] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T21:22:12.758084] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-14T21:22:13.102441] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T21:22:13.558075] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-14T21:22:14.358090] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-14T21:22:15.118075] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T21:22:15.152500] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T21:22:15.158016] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-14T21:22:15.958100] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-14T21:22:16.201245] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T21:22:16.432501] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-14T21:22:16.758082] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-14T21:22:17.558055] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-14T21:22:17.749490] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T21:22:18.350988] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T21:22:18.353826] [INFO ] [REMOTE ] SAM: Full fetch complete (31084 records). [2025-10-14T21:22:18.353933] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-14T21:22:18.365841] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-14T21:22:18.757039] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-14T21:22:18.757113] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-14T21:22:18.757784] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-14T21:22:18.757848] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-14T21:22:18.758593] [DEBUG] [LOCAL ] SAM: Trimmed 31084 records to 21426 (keeping 200 days of data) [2025-10-14T21:22:18.884267] [DEBUG] [LOCAL ] SAM: Primary data saved (21426 records). [2025-10-14T21:22:18.884398] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-14T21:22:18.884504] [INFO ] [MAIN ] Update Progress: 1864/2369 symbols completed. SAM took 48.6s. Estimated remaining: 1h 11m 3s. Rate: 7.1 symbols/min [2025-10-14T21:22:19.054385] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:19.054567] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-14T21:22:19.054605] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-14T21:22:19.054738] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-14T21:22:19.054781] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-14T21:22:19.054825] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-14T21:22:19.054858] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-14T21:22:19.158215] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-14T21:22:19.423051] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:19.616543] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-14T21:22:19.842156] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T21:22:19.958067] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-14T21:22:20.758096] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-14T21:22:21.558042] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-14T21:22:21.608907] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T21:22:21.738976] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T21:22:22.004158] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T21:22:22.358099] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-14T21:22:22.677580] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T21:22:23.158101] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-14T21:22:23.958060] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-14T21:22:24.154497] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T21:22:24.314202] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-14T21:22:24.758059] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-14T21:22:25.558103] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-14T21:22:25.883633] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-14T21:22:26.338529] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T21:22:26.358030] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-14T21:22:27.158059] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-14T21:22:27.477716] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-14T21:22:27.918793] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T21:22:27.958034] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-14T21:22:28.289547] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-14T21:22:28.758060] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-14T21:22:29.120376] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-14T21:22:29.558057] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-14T21:22:29.887300] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-14T21:22:30.358063] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-14T21:22:30.694902] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T21:22:31.158079] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-14T21:22:31.489179] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-14T21:22:31.489952] [INFO ] [REMOTE ] SAT: Full fetch complete (1512 records). [2025-10-14T21:22:31.490019] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-14T21:22:31.678766] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-14T21:22:31.679005] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:22:31.679053] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:22:31.679094] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-14T21:22:31.679155] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-14T21:22:31.679192] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-14T21:22:31.679232] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-14T21:22:31.679291] [INFO ] [MAIN ] Update Progress: 1865/2369 symbols completed. SAT took 21.1s. Estimated remaining: 1h 10m 56s. Rate: 7.1 symbols/min [2025-10-14T21:22:31.854534] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:31.854726] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-14T21:22:31.854774] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-14T21:22:31.854882] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-14T21:22:31.854922] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-14T21:22:31.854962] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-14T21:22:31.854993] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-14T21:22:31.963251] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-14T21:22:32.256612] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:32.758049] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-14T21:22:32.914875] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T21:22:33.558062] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-14T21:22:33.888599] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-14T21:22:34.358100] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-14T21:22:34.390823] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T21:22:34.787022] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T21:22:35.158094] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-14T21:22:35.958137] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-14T21:22:36.180188] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T21:22:36.463530] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-14T21:22:36.758050] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-14T21:22:37.148072] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-14T21:22:37.558056] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-14T21:22:37.948302] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-14T21:22:38.358093] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-14T21:22:39.158098] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-14T21:22:39.532414] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-14T21:22:39.958041] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-14T21:22:40.027797] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T21:22:40.758055] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-14T21:22:41.005525] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T21:22:41.558145] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-14T21:22:41.900833] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T21:22:42.339013] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T21:22:42.358034] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-14T21:22:42.692829] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-14T21:22:43.158117] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-14T21:22:43.958071] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-14T21:22:44.219007] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:22:44.276627] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-14T21:22:44.277705] [INFO ] [REMOTE ] SAY: Full fetch complete (1364 records). [2025-10-14T21:22:44.277795] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-14T21:22:44.469725] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-14T21:22:44.470811] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:22:44.470882] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:22:44.470951] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-14T21:22:44.471033] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-14T21:22:44.471113] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-14T21:22:44.471164] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-14T21:22:44.471221] [INFO ] [MAIN ] Update Progress: 1866/2369 symbols completed. SAY took 25.6s. Estimated remaining: 1h 10m 48s. Rate: 7.1 symbols/min [2025-10-14T21:22:44.647222] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:44.680004] [DEBUG] [LOCAL ] SB: Loaded 33010 existing records from primary storage. [2025-10-14T21:22:44.680296] [INFO ] [MAIN ] SB: Loaded 33010 existing records. [2025-10-14T21:22:44.763232] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-14T21:22:44.879704] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:22:44.879940] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-14T21:22:44.880042] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-14T21:22:44.880607] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-14T21:22:44.880712] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-14T21:22:45.272332] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:45.558042] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-14T21:22:45.797044] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T21:22:45.801198] [INFO ] [REMOTE ] SAR: Full fetch complete (23795 records). [2025-10-14T21:22:45.801274] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-14T21:22:45.908845] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-14T21:22:46.187608] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-14T21:22:46.187758] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-14T21:22:46.188368] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-14T21:22:46.188432] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-14T21:22:46.189250] [DEBUG] [LOCAL ] SAR: Trimmed 23795 records to 17198 (keeping 200 days of data) [2025-10-14T21:22:46.299926] [DEBUG] [LOCAL ] SAR: Primary data saved (17198 records). [2025-10-14T21:22:46.300063] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-14T21:22:46.300142] [INFO ] [MAIN ] Update Progress: 1867/2369 symbols completed. SAR took 39.3s. Estimated remaining: 1h 10m 38s. Rate: 7.1 symbols/min [2025-10-14T21:22:46.364589] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-14T21:22:46.478583] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:46.478757] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-14T21:22:46.478800] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-14T21:22:46.478911] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-14T21:22:46.478968] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-14T21:22:46.479039] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-14T21:22:46.479084] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-14T21:22:46.842568] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:46.845070] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-14T21:22:47.158055] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-14T21:22:47.802215] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T21:22:47.958062] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-14T21:22:48.143233] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:22:48.143544] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-14T21:22:48.143634] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:22:48.143737] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-14T21:22:48.143801] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:22:48.143868] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-14T21:22:48.143928] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-14T21:22:48.143963] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-14T21:22:48.144002] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-14T21:22:48.144061] [INFO ] [MAIN ] Update Progress: 1868/2369 symbols completed. SBDS took 1.8s. Estimated remaining: 1h 10m 28s. Rate: 7.1 symbols/min [2025-10-14T21:22:48.315695] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:22:48.360428] [DEBUG] [LOCAL ] SBH: Loaded 49842 existing records from primary storage. [2025-10-14T21:22:48.360758] [INFO ] [MAIN ] SBH: Loaded 49842 existing records. [2025-10-14T21:22:48.541130] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:22:48.541354] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-14T21:22:48.541401] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-14T21:22:48.541733] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-14T21:22:48.541792] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-14T21:22:48.765578] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-14T21:22:48.923057] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:22:49.254021] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-14T21:22:49.558071] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-14T21:22:50.358096] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-14T21:22:50.690862] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-14T21:22:51.158044] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-14T21:22:51.204426] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T21:22:51.958061] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-14T21:22:52.758088] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-14T21:22:53.558077] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-14T21:23:06.039511] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (13.28 seconds). [2025-10-14T21:23:06.040510] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-14T21:23:06.493286] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T21:23:06.494370] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-14T21:23:06.783827] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (13.23 seconds). [2025-10-14T21:23:06.792145] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-14T21:23:06.875519] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-14T21:23:06.876483] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-14T21:23:07.241151] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-14T21:23:07.241904] [INFO ] [REMOTE ] SAZ: Full fetch complete (1845 records). [2025-10-14T21:23:07.241969] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-14T21:23:07.427855] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T21:23:07.428039] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:23:07.428104] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:23:07.428152] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-14T21:23:07.428247] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-14T21:23:07.428313] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-14T21:23:07.428388] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-14T21:23:07.428448] [INFO ] [MAIN ] Update Progress: 1869/2369 symbols completed. SAZ took 35.7s. Estimated remaining: 1h 10m 23s. Rate: 7.1 symbols/min [2025-10-14T21:23:07.605017] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:07.615136] [DEBUG] [LOCAL ] SBI: Loaded 7413 existing records from primary storage. [2025-10-14T21:23:07.615536] [INFO ] [MAIN ] SBI: Loaded 7413 existing records. [2025-10-14T21:23:07.827811] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:23:07.828069] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-14T21:23:07.828237] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-14T21:23:07.828459] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-14T21:23:07.828523] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-14T21:23:08.100289] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (16.14 seconds). [2025-10-14T21:23:08.148489] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-14T21:23:08.245914] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:08.246247] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-14T21:23:08.272411] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T21:23:08.280260] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-14T21:23:08.654963] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (17.50 seconds). [2025-10-14T21:23:08.664973] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-14T21:23:09.023944] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T21:23:09.026072] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-14T21:23:09.635824] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T21:23:09.639058] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-14T21:23:09.750862] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T21:23:09.759754] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-14T21:23:10.005758] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T21:23:10.011309] [INFO ] [REMOTE ] SARO: Full fetch complete (68873 records). [2025-10-14T21:23:10.011460] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-14T21:23:10.204915] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-14T21:23:10.293446] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-14T21:23:10.321038] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-14T21:23:10.374068] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-14T21:23:10.471848] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-14T21:23:10.471936] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-14T21:23:10.473101] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-14T21:23:10.473164] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-14T21:23:10.474552] [DEBUG] [LOCAL ] SARO: Trimmed 68873 records to 48343 (keeping 200 days of data) [2025-10-14T21:23:10.766864] [DEBUG] [LOCAL ] SARO: Primary data saved (48343 records). [2025-10-14T21:23:10.766998] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-14T21:23:10.767078] [INFO ] [MAIN ] Update Progress: 1870/2369 symbols completed. SARO took 1m 2s. Estimated remaining: 1h 10m 13s. Rate: 7.1 symbols/min [2025-10-14T21:23:10.946623] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:10.957618] [DEBUG] [LOCAL ] SBR: Loaded 7759 existing records from primary storage. [2025-10-14T21:23:10.957942] [INFO ] [MAIN ] SBR: Loaded 7759 existing records. [2025-10-14T21:23:11.079071] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T21:23:11.081876] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-14T21:23:11.181399] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:23:11.184493] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-14T21:23:11.185861] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T21:23:11.184959] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-14T21:23:11.193806] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-14T21:23:11.194095] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-14T21:23:11.194231] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-14T21:23:11.614317] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:11.614732] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-14T21:23:11.722015] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T21:23:11.733296] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-14T21:23:11.981953] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T21:23:11.984928] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-14T21:23:12.406981] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T21:23:12.405030] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T21:23:12.406730] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T21:23:12.411855] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-14T21:23:12.412223] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-14T21:23:12.422593] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-14T21:23:13.105083] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T21:23:13.108012] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-14T21:23:13.165084] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T21:23:13.175896] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-14T21:23:13.185687] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T21:23:13.188240] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-14T21:23:13.827154] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T21:23:13.834570] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-14T21:23:13.926709] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T21:23:13.947574] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T21:23:14.358057] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-14T21:23:14.590914] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T21:23:14.688714] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T21:23:15.158095] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-14T21:23:15.166329] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T21:23:15.958042] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-14T21:23:16.074208] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T21:23:16.758065] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-14T21:23:17.558079] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-14T21:23:17.656579] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T21:23:17.685611] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T21:23:18.358076] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-14T21:23:18.938749] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-14T21:23:18.968776] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:23:19.158088] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-14T21:23:19.668715] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T21:23:19.670082] [INFO ] [REMOTE ] SBI: Full fetch complete (10460 records). [2025-10-14T21:23:19.670151] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-14T21:23:19.963230] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-14T21:23:20.054065] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-14T21:23:20.054145] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-14T21:23:20.054523] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-14T21:23:20.054570] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-14T21:23:20.055038] [DEBUG] [LOCAL ] SBI: Trimmed 10460 records to 7464 (keeping 200 days of data) [2025-10-14T21:23:20.097745] [DEBUG] [LOCAL ] SBI: Primary data saved (7464 records). [2025-10-14T21:23:20.097867] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-14T21:23:20.097945] [INFO ] [MAIN ] Update Progress: 1871/2369 symbols completed. SBI took 12.7s. Estimated remaining: 1h 10m 4s. Rate: 7.1 symbols/min [2025-10-14T21:23:20.265323] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:20.311623] [DEBUG] [LOCAL ] SBS: Loaded 49348 existing records from primary storage. [2025-10-14T21:23:20.311941] [INFO ] [MAIN ] SBS: Loaded 49348 existing records. [2025-10-14T21:23:20.494931] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:23:20.495164] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-14T21:23:20.495214] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-14T21:23:20.495541] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-14T21:23:20.495599] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-14T21:23:20.759373] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-14T21:23:20.791949] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T21:23:20.878243] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:21.558062] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-14T21:23:22.125665] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T21:23:22.358080] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-14T21:23:23.120081] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T21:23:23.158026] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-14T21:23:23.288390] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:23:23.864799] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T21:23:23.958039] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-14T21:23:24.716966] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T21:23:24.758056] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-14T21:23:25.558036] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-14T21:23:25.595637] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:23:26.358089] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-14T21:23:27.095167] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:23:27.158122] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-14T21:23:27.676792] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T21:23:27.958046] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-14T21:23:28.695057] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T21:23:28.751321] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T21:23:28.755255] [INFO ] [REMOTE ] SB: Full fetch complete (49816 records). [2025-10-14T21:23:28.755398] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-14T21:23:28.767567] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-14T21:23:29.165044] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-14T21:23:29.165166] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-14T21:23:29.166510] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-14T21:23:29.166576] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-14T21:23:29.168081] [DEBUG] [LOCAL ] SB: Trimmed 49816 records to 32929 (keeping 200 days of data) [2025-10-14T21:23:29.387418] [DEBUG] [LOCAL ] SB: Primary data saved (32929 records). [2025-10-14T21:23:29.387551] [INFO ] [MAIN ] SB: Full history saved. [2025-10-14T21:23:29.387635] [INFO ] [MAIN ] Update Progress: 1872/2369 symbols completed. SB took 44.9s. Estimated remaining: 1h 9m 56s. Rate: 7.1 symbols/min [2025-10-14T21:23:29.506573] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:23:29.524245] [INFO ] [REMOTE ] SBR: Full fetch complete (11313 records). [2025-10-14T21:23:29.524354] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-14T21:23:29.565852] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-14T21:23:29.643893] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:29.759217] [DEBUG] [LOCAL ] SBSI: Loaded 14868 existing records from primary storage. [2025-10-14T21:23:29.767818] [INFO ] [MAIN ] SBSI: Loaded 14868 existing records. [2025-10-14T21:23:30.159520] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:23:30.168157] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-14T21:23:30.168344] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-14T21:23:30.168266] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-14T21:23:30.168417] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-14T21:23:30.168867] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-14T21:23:30.168826] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-14T21:23:30.169013] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-14T21:23:30.168966] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-14T21:23:30.215054] [DEBUG] [LOCAL ] SBR: Trimmed 11313 records to 7790 (keeping 200 days of data) [2025-10-14T21:23:30.361958] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-14T21:23:30.517089] [DEBUG] [LOCAL ] SBR: Primary data saved (7790 records). [2025-10-14T21:23:30.523192] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-14T21:23:30.528460] [INFO ] [MAIN ] Update Progress: 1873/2369 symbols completed. SBR took 19.8s. Estimated remaining: 1h 9m 46s. Rate: 7.1 symbols/min [2025-10-14T21:23:30.717502] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:30.791050] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:30.843520] [DEBUG] [LOCAL ] SBSW: Loaded 53150 existing records from primary storage. [2025-10-14T21:23:30.843869] [INFO ] [MAIN ] SBSW: Loaded 53150 existing records. [2025-10-14T21:23:31.022245] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:23:31.022458] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-14T21:23:31.022505] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-14T21:23:31.022861] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-14T21:23:31.022918] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-14T21:23:31.163192] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-14T21:23:31.383449] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:31.423147] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T21:23:31.923793] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T21:23:31.958043] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-14T21:23:32.158836] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T21:23:32.758127] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-14T21:23:33.399279] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T21:23:33.558080] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-14T21:23:34.358148] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-14T21:23:34.444883] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T21:23:35.124877] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T21:23:35.148297] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T21:23:35.158021] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-14T21:23:35.958151] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-14T21:23:35.971537] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T21:23:36.758106] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-14T21:23:37.415246] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T21:23:37.421087] [INFO ] [REMOTE ] SBH: Full fetch complete (73082 records). [2025-10-14T21:23:37.421219] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-14T21:23:37.566990] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-14T21:23:37.806336] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T21:23:37.848615] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-14T21:23:37.848739] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-14T21:23:37.849970] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-14T21:23:37.850033] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-14T21:23:37.851463] [DEBUG] [LOCAL ] SBH: Trimmed 73082 records to 49865 (keeping 200 days of data) [2025-10-14T21:23:38.135114] [DEBUG] [LOCAL ] SBH: Primary data saved (49865 records). [2025-10-14T21:23:38.135242] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-14T21:23:38.135317] [INFO ] [MAIN ] Update Progress: 1874/2369 symbols completed. SBH took 50.0s. Estimated remaining: 1h 9m 37s. Rate: 7.1 symbols/min [2025-10-14T21:23:38.303676] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:38.303886] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-14T21:23:38.303935] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-14T21:23:38.304041] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-14T21:23:38.304082] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-14T21:23:38.304124] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-14T21:23:38.304154] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-14T21:23:38.368234] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-14T21:23:38.681987] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:39.158138] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-14T21:23:39.286740] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:23:39.429726] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-14T21:23:39.440844] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T21:23:39.958133] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-14T21:23:40.758070] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-14T21:23:41.558051] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-14T21:23:41.591735] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T21:23:41.805035] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-14T21:23:42.358074] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-14T21:23:43.163180] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-14T21:23:43.185733] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T21:23:43.290795] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T21:23:43.958091] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-14T21:23:44.594785] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T21:23:44.758097] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-14T21:23:44.887524] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-14T21:23:45.558056] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-14T21:23:45.789505] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-14T21:23:46.365441] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-14T21:23:46.384204] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T21:23:47.158063] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-14T21:23:47.958042] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-14T21:23:48.153057] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T21:23:48.153453] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T21:23:48.197204] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-14T21:23:48.758063] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-14T21:23:48.966618] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-14T21:23:49.558059] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-14T21:23:50.358181] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-14T21:23:51.158067] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-14T21:23:51.246568] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T21:23:51.381604] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-10-14T21:23:51.902445] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T21:23:51.958062] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-14T21:23:52.758112] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-14T21:23:53.558075] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-14T21:23:53.878082] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-14T21:23:53.978359] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T21:23:54.337435] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T21:23:54.358036] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-14T21:23:55.158098] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-14T21:23:55.818177] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T21:23:55.823879] [INFO ] [REMOTE ] SBS: Full fetch complete (70288 records). [2025-10-14T21:23:55.824012] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-14T21:23:55.963034] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T21:23:55.961987] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-14T21:23:56.232122] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-14T21:23:56.232201] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-14T21:23:56.233297] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-14T21:23:56.233359] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-14T21:23:56.234752] [DEBUG] [LOCAL ] SBS: Trimmed 70288 records to 49325 (keeping 200 days of data) [2025-10-14T21:23:56.528294] [DEBUG] [LOCAL ] SBS: Primary data saved (49325 records). [2025-10-14T21:23:56.528433] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-14T21:23:56.528512] [INFO ] [MAIN ] Update Progress: 1875/2369 symbols completed. SBS took 36.4s. Estimated remaining: 1h 9m 31s. Rate: 7.1 symbols/min [2025-10-14T21:23:56.703638] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:56.753572] [DEBUG] [LOCAL ] SCCO: Loaded 49604 existing records from primary storage. [2025-10-14T21:23:56.753936] [INFO ] [MAIN ] SCCO: Loaded 49604 existing records. [2025-10-14T21:23:56.768086] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-14T21:23:56.962185] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:23:56.962399] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-14T21:23:56.962446] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-14T21:23:56.963022] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-14T21:23:56.963079] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-14T21:23:57.077497] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T21:23:57.327960] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:23:57.407404] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T21:23:57.558047] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-14T21:23:58.017874] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-14T21:23:58.358080] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-14T21:23:58.681997] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-14T21:23:59.158067] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-14T21:23:59.482476] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-14T21:23:59.483170] [INFO ] [REMOTE ] SBXD: Full fetch complete (3115 records). [2025-10-14T21:23:59.483236] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-14T21:23:59.678966] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-14T21:23:59.679276] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:23:59.679323] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:23:59.679362] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-14T21:23:59.679454] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-14T21:23:59.679509] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-14T21:23:59.679553] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-14T21:23:59.679617] [INFO ] [MAIN ] Update Progress: 1876/2369 symbols completed. SBXD took 21.5s. Estimated remaining: 1h 9m 22s. Rate: 7.1 symbols/min [2025-10-14T21:23:59.843726] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:23:59.858886] [DEBUG] [LOCAL ] SCD: Loaded 13134 existing records from primary storage. [2025-10-14T21:23:59.859206] [INFO ] [MAIN ] SCD: Loaded 13134 existing records. [2025-10-14T21:23:59.962162] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-14T21:24:00.040852] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:00.041042] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-14T21:24:00.041089] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-14T21:24:00.041297] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-14T21:24:00.041356] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-14T21:24:00.396853] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:00.758084] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-14T21:24:01.558066] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-14T21:24:02.051094] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-14T21:24:02.358058] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-14T21:24:02.482967] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T21:24:02.487140] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T21:24:02.495522] [INFO ] [REMOTE ] SBSI: Full fetch complete (21138 records). [2025-10-14T21:24:02.495621] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-14T21:24:02.868245] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-14T21:24:02.868363] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-14T21:24:02.868864] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-14T21:24:02.868925] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-14T21:24:02.869693] [DEBUG] [LOCAL ] SBSI: Trimmed 21138 records to 14876 (keeping 200 days of data) [2025-10-14T21:24:02.961565] [DEBUG] [LOCAL ] SBSI: Primary data saved (14876 records). [2025-10-14T21:24:02.961737] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-14T21:24:02.961827] [INFO ] [MAIN ] Update Progress: 1877/2369 symbols completed. SBSI took 33.6s. Estimated remaining: 1h 9m 12s. Rate: 7.1 symbols/min [2025-10-14T21:24:03.158123] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-14T21:24:03.958040] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-14T21:24:04.136822] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T21:24:04.682302] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-14T21:24:04.758039] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-14T21:24:04.849251] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T21:24:05.558066] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-14T21:24:06.289962] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T21:24:06.358018] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-14T21:24:06.550401] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T21:24:07.137709] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T21:24:07.158085] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-14T21:24:07.958064] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-14T21:24:08.758106] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-14T21:24:09.047782] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T21:24:09.485093] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T21:24:09.558063] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-14T21:24:09.646932] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T21:24:10.321843] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T21:24:10.358055] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-14T21:24:11.078947] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T21:24:11.158076] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-14T21:24:11.958046] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-14T21:24:12.151576] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T21:24:12.758087] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-14T21:24:13.558041] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-14T21:24:13.718283] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:24:13.863336] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-14T21:24:14.358074] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-14T21:24:15.158042] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-14T21:24:15.447558] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T21:24:15.958043] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-14T21:24:16.163232] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T21:24:16.191260] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T21:24:16.758063] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-14T21:24:17.558063] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-14T21:24:17.594875] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:24:17.855816] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T21:24:17.861808] [INFO ] [REMOTE ] SBSW: Full fetch complete (76715 records). [2025-10-14T21:24:17.861962] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-14T21:24:18.261660] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-14T21:24:18.261748] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-14T21:24:18.262913] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-14T21:24:18.262975] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-14T21:24:18.264341] [DEBUG] [LOCAL ] SBSW: Trimmed 76715 records to 53165 (keeping 200 days of data) [2025-10-14T21:24:18.358596] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-14T21:24:18.566713] [DEBUG] [LOCAL ] SBSW: Primary data saved (53165 records). [2025-10-14T21:24:18.566840] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-14T21:24:18.566912] [INFO ] [MAIN ] Update Progress: 1878/2369 symbols completed. SBSW took 48.0s. Estimated remaining: 1h 9m 5s. Rate: 7.1 symbols/min [2025-10-14T21:24:19.067510] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T21:24:19.090028] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T21:24:19.091781] [INFO ] [REMOTE ] SCD: Full fetch complete (16670 records). [2025-10-14T21:24:19.091848] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-14T21:24:19.166242] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-14T21:24:19.451882] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-14T21:24:19.451954] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-14T21:24:19.452310] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-14T21:24:19.452347] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-14T21:24:19.452886] [DEBUG] [LOCAL ] SCD: Trimmed 16670 records to 13173 (keeping 200 days of data) [2025-10-14T21:24:19.532567] [DEBUG] [LOCAL ] SCD: Primary data saved (13173 records). [2025-10-14T21:24:19.532724] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-14T21:24:19.532808] [INFO ] [MAIN ] Update Progress: 1879/2369 symbols completed. SCD took 19.9s. Estimated remaining: 1h 8m 55s. Rate: 7.1 symbols/min [2025-10-14T21:24:20.711546] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T21:24:20.721543] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-14T21:24:22.597721] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T21:24:22.609339] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-14T21:24:24.325685] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T21:24:24.336208] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-14T21:24:26.233914] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T21:24:26.245404] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-14T21:24:27.952922] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-14T21:24:27.958697] [INFO ] [REMOTE ] SCCO: Full fetch complete (71630 records). [2025-10-14T21:24:27.958843] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-14T21:24:28.343841] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-14T21:24:28.343921] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-14T21:24:28.345015] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-14T21:24:28.345075] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-14T21:24:28.346398] [DEBUG] [LOCAL ] SCCO: Trimmed 71630 records to 49600 (keeping 200 days of data) [2025-10-14T21:24:28.650092] [DEBUG] [LOCAL ] SCCO: Primary data saved (49600 records). [2025-10-14T21:24:28.650190] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-14T21:24:28.650266] [INFO ] [MAIN ] Update Progress: 1880/2369 symbols completed. SCCO took 32.1s. Estimated remaining: 1h 8m 47s. Rate: 7.1 symbols/min [2025-10-14T21:24:29.212837] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:24:29.309199] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:24:29.364596] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:24:29.387914] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:24:29.403122] [DEBUG] [LOCAL ] SCL: Loaded 14767 existing records from primary storage. [2025-10-14T21:24:29.403346] [INFO ] [MAIN ] SCL: Loaded 14767 existing records. [2025-10-14T21:24:29.587892] [DEBUG] [LOCAL ] SCM: Loaded 20105 existing records from primary storage. [2025-10-14T21:24:29.621394] [INFO ] [MAIN ] SCM: Loaded 20105 existing records. [2025-10-14T21:24:29.626667] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:29.638274] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-14T21:24:29.662341] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-14T21:24:29.683539] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-14T21:24:29.698586] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-14T21:24:29.689840] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-14T21:24:29.822485] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-14T21:24:29.850535] [DEBUG] [LOCAL ] SCI: Loaded 46560 existing records from primary storage. [2025-10-14T21:24:29.912410] [INFO ] [MAIN ] SCI: Loaded 46560 existing records. [2025-10-14T21:24:30.179757] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:30.203289] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-14T21:24:30.326929] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-14T21:24:30.402755] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-14T21:24:30.427716] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-14T21:24:30.505552] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:30.585901] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-14T21:24:30.639821] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:30.655309] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-14T21:24:30.729234] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:30.729393] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-14T21:24:30.719455] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-14T21:24:30.730001] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-14T21:24:30.729916] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-14T21:24:30.729774] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-14T21:24:30.741150] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-14T21:24:30.822157] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-14T21:24:31.603138] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:31.639135] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-14T21:24:31.668554] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:31.685309] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-14T21:24:31.793031] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:31.794072] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T21:24:31.797382] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-14T21:24:31.794388] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-14T21:24:32.843849] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T21:24:32.847511] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-14T21:24:32.974991] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T21:24:32.979508] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-14T21:24:33.459892] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T21:24:33.468681] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-14T21:24:33.661282] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T21:24:33.672155] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-14T21:24:33.689901] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T21:24:33.692978] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-14T21:24:34.022839] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T21:24:34.026948] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-14T21:24:34.729938] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T21:24:34.734263] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-14T21:24:35.055270] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T21:24:35.062298] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-14T21:24:35.140436] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T21:24:35.152246] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-14T21:24:35.596415] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-14T21:24:35.607493] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-14T21:24:35.620873] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-14T21:24:35.625845] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-14T21:24:36.178041] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T21:24:36.183913] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-14T21:24:36.596447] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-14T21:24:36.697667] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T21:24:36.758089] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-14T21:24:37.045448] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T21:24:37.398502] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T21:24:37.558056] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-14T21:24:37.608118] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T21:24:38.358116] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-14T21:24:39.158108] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-14T21:24:39.463675] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-14T21:24:39.951498] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T21:24:39.960463] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-14T21:24:39.978201] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T21:24:40.758185] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-14T21:24:40.760319] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T21:24:41.558047] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-14T21:24:41.746517] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T21:24:42.358120] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-14T21:24:43.158049] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-14T21:24:43.594522] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-14T21:24:43.958054] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-14T21:24:44.016699] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T21:24:44.103563] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T21:24:44.758096] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-14T21:24:45.558083] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-14T21:24:45.751721] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T21:24:45.854568] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T21:24:46.358162] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-14T21:24:46.390421] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T21:24:47.158103] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-14T21:24:47.958086] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-14T21:24:48.033013] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-14T21:24:48.035548] [INFO ] [REMOTE ] SCL: Full fetch complete (21457 records). [2025-10-14T21:24:48.035690] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-14T21:24:48.403176] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-14T21:24:48.403289] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-14T21:24:48.403862] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-14T21:24:48.403943] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-14T21:24:48.415596] [DEBUG] [LOCAL ] SCL: Trimmed 21457 records to 14853 (keeping 200 days of data) [2025-10-14T21:24:48.436075] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-14T21:24:48.536398] [DEBUG] [LOCAL ] SCL: Primary data saved (14853 records). [2025-10-14T21:24:48.536544] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-14T21:24:48.536625] [INFO ] [MAIN ] Update Progress: 1881/2369 symbols completed. SCL took 19.9s. Estimated remaining: 1h 8m 41s. Rate: 7.1 symbols/min [2025-10-14T21:24:48.701248] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:24:48.741578] [DEBUG] [LOCAL ] SCS: Loaded 43552 existing records from primary storage. [2025-10-14T21:24:48.741933] [INFO ] [MAIN ] SCS: Loaded 43552 existing records. [2025-10-14T21:24:48.763264] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-14T21:24:48.918138] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:48.918352] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-14T21:24:48.918400] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-14T21:24:48.918730] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-14T21:24:48.918789] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-14T21:24:49.280444] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:49.333044] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T21:24:49.558071] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-14T21:24:50.358102] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-14T21:24:50.742712] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T21:24:51.105857] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T21:24:51.160358] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-14T21:24:51.164624] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T21:24:51.958073] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-14T21:24:52.758068] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-14T21:24:53.002700] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T21:24:53.090781] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-14T21:24:53.558097] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-14T21:24:54.358093] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-14T21:24:54.623711] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T21:24:54.627027] [INFO ] [REMOTE ] SCM: Full fetch complete (28951 records). [2025-10-14T21:24:54.627109] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-14T21:24:55.002797] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-14T21:24:55.002944] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-14T21:24:55.003590] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-14T21:24:55.003829] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-14T21:24:55.033303] [DEBUG] [LOCAL ] SCM: Trimmed 28951 records to 20160 (keeping 200 days of data) [2025-10-14T21:24:55.035474] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-14T21:24:55.158687] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-14T21:24:55.167354] [DEBUG] [LOCAL ] SCM: Primary data saved (20160 records). [2025-10-14T21:24:55.167478] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-14T21:24:55.167554] [INFO ] [MAIN ] Update Progress: 1882/2369 symbols completed. SCM took 26.5s. Estimated remaining: 1h 8m 32s. Rate: 7.1 symbols/min [2025-10-14T21:24:55.334142] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:24:55.365520] [DEBUG] [LOCAL ] SD: Loaded 28755 existing records from primary storage. [2025-10-14T21:24:55.365831] [INFO ] [MAIN ] SD: Loaded 28755 existing records. [2025-10-14T21:24:55.540100] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:24:55.540293] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-14T21:24:55.540338] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-14T21:24:55.540791] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-14T21:24:55.540848] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-14T21:24:55.896662] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:24:55.958033] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-14T21:24:56.038587] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T21:24:56.758103] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-14T21:24:57.134726] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T21:24:57.163374] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T21:24:57.558124] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-14T21:24:58.302454] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T21:24:58.358038] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-14T21:24:58.675568] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T21:24:59.158102] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-14T21:24:59.716926] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T21:24:59.958070] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-14T21:25:00.758064] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-14T21:25:01.014457] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-14T21:25:01.021016] [INFO ] [REMOTE ] SCHW: Full fetch complete (77863 records). [2025-10-14T21:25:01.021166] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-14T21:25:01.253123] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T21:25:01.503095] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-14T21:25:01.503408] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-14T21:25:01.504592] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-14T21:25:01.504686] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-14T21:25:01.506223] [DEBUG] [LOCAL ] SCHW: Trimmed 77863 records to 53685 (keeping 200 days of data) [2025-10-14T21:25:01.562166] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-14T21:25:01.843682] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-14T21:25:01.843826] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-14T21:25:01.843906] [INFO ] [MAIN ] Update Progress: 1883/2369 symbols completed. SCHW took 33.2s. Estimated remaining: 1h 8m 23s. Rate: 7.1 symbols/min [2025-10-14T21:25:02.036159] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:02.048698] [DEBUG] [LOCAL ] SDHC: Loaded 10329 existing records from primary storage. [2025-10-14T21:25:02.048964] [INFO ] [MAIN ] SDHC: Loaded 10329 existing records. [2025-10-14T21:25:02.230488] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:02.231030] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-14T21:25:02.231096] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-14T21:25:02.231493] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-14T21:25:02.231556] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-14T21:25:02.361791] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-14T21:25:02.375533] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T21:25:02.447781] [INFO ] [REMOTE ] SCI: Full fetch complete (67613 records). [2025-10-14T21:25:02.486484] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-14T21:25:02.752569] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:03.082879] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-14T21:25:03.083117] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-14T21:25:03.084402] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-14T21:25:03.084568] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-14T21:25:03.105977] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T21:25:03.106124] [DEBUG] [LOCAL ] SCI: Trimmed 67613 records to 46575 (keeping 200 days of data) [2025-10-14T21:25:03.178738] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-14T21:25:03.463406] [DEBUG] [LOCAL ] SCI: Primary data saved (46575 records). [2025-10-14T21:25:03.463586] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-14T21:25:03.463741] [INFO ] [MAIN ] Update Progress: 1884/2369 symbols completed. SCI took 34.8s. Estimated remaining: 1h 8m 13s. Rate: 7.1 symbols/min [2025-10-14T21:25:03.670915] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:03.684368] [DEBUG] [LOCAL ] SDHY: Loaded 11002 existing records from primary storage. [2025-10-14T21:25:03.684602] [INFO ] [MAIN ] SDHY: Loaded 11002 existing records. [2025-10-14T21:25:03.855480] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T21:25:03.900898] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:03.901973] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-14T21:25:03.902035] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-14T21:25:03.902199] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-14T21:25:03.902254] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-14T21:25:03.964486] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-14T21:25:04.267106] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:04.290686] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T21:25:04.758076] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-14T21:25:04.974115] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:25:05.558092] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-14T21:25:05.952271] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-14T21:25:06.358088] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-14T21:25:06.471013] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T21:25:07.158122] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-14T21:25:07.281265] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T21:25:07.958135] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-14T21:25:07.973590] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T21:25:08.758094] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-14T21:25:09.346837] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T21:25:09.558057] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-14T21:25:10.139437] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T21:25:10.320359] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T21:25:10.358031] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-14T21:25:10.902554] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-14T21:25:11.158083] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-14T21:25:11.958054] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-14T21:25:12.121265] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T21:25:12.758048] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-14T21:25:12.877995] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T21:25:13.558058] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-14T21:25:14.130271] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T21:25:14.358762] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-14T21:25:14.362057] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T21:25:15.158098] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-14T21:25:15.667574] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T21:25:15.958066] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-14T21:25:16.758219] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-14T21:25:16.767507] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T21:25:16.771634] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T21:25:17.558381] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-14T21:25:17.562851] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-14T21:25:18.358068] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-14T21:25:18.414526] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T21:25:19.005868] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-14T21:25:19.158073] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-14T21:25:19.958072] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-14T21:25:20.000549] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T21:25:20.758083] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-14T21:25:20.813756] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T21:25:21.558054] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-14T21:25:22.232991] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T21:25:22.358076] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-14T21:25:22.430340] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:25:23.158086] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-14T21:25:23.294777] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T21:25:23.958132] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-14T21:25:24.758095] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-14T21:25:24.805242] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T21:25:24.845932] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T21:25:25.558072] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-14T21:25:26.010221] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T21:25:26.358085] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-14T21:25:27.017397] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T21:25:27.022608] [INFO ] [REMOTE ] SCS: Full fetch complete (61021 records). [2025-10-14T21:25:27.022763] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-14T21:25:27.132626] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T21:25:27.163216] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-14T21:25:27.426360] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-14T21:25:27.426451] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-14T21:25:27.427558] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-14T21:25:27.427620] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-14T21:25:27.428897] [DEBUG] [LOCAL ] SCS: Trimmed 61021 records to 43528 (keeping 200 days of data) [2025-10-14T21:25:27.691452] [DEBUG] [LOCAL ] SCS: Primary data saved (43528 records). [2025-10-14T21:25:27.691580] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-14T21:25:27.691678] [INFO ] [MAIN ] Update Progress: 1885/2369 symbols completed. SCS took 39.2s. Estimated remaining: 1h 8m 9s. Rate: 7.1 symbols/min [2025-10-14T21:25:27.873370] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:27.914126] [DEBUG] [LOCAL ] SDRL: Loaded 41480 existing records from primary storage. [2025-10-14T21:25:27.914527] [INFO ] [MAIN ] SDRL: Loaded 41480 existing records. [2025-10-14T21:25:27.966891] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-14T21:25:28.129391] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:28.129692] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-14T21:25:28.129750] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-14T21:25:28.130104] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-14T21:25:28.130159] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-14T21:25:28.505038] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:28.521799] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:25:28.758132] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-14T21:25:28.784078] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T21:25:29.558088] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-14T21:25:30.363762] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-14T21:25:30.375624] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T21:25:30.409596] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T21:25:31.158072] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-14T21:25:31.168210] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-14T21:25:31.933359] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T21:25:31.935186] [INFO ] [REMOTE ] SDHC: Full fetch complete (17174 records). [2025-10-14T21:25:31.935255] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-14T21:25:31.964793] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-14T21:25:32.316676] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-14T21:25:32.316760] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-14T21:25:32.317131] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-14T21:25:32.317168] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-14T21:25:32.317701] [DEBUG] [LOCAL ] SDHC: Trimmed 17174 records to 10325 (keeping 200 days of data) [2025-10-14T21:25:32.375753] [DEBUG] [LOCAL ] SDHC: Primary data saved (10325 records). [2025-10-14T21:25:32.375868] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-14T21:25:32.375942] [INFO ] [MAIN ] Update Progress: 1886/2369 symbols completed. SDHC took 30.5s. Estimated remaining: 1h 7m 59s. Rate: 7.1 symbols/min [2025-10-14T21:25:32.542557] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:32.596095] [DEBUG] [LOCAL ] SE: Loaded 53312 existing records from primary storage. [2025-10-14T21:25:32.596389] [INFO ] [MAIN ] SE: Loaded 53312 existing records. [2025-10-14T21:25:32.762222] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-14T21:25:32.776272] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:32.777192] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-14T21:25:32.777267] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-14T21:25:32.778030] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-14T21:25:32.778089] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-14T21:25:33.138223] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:33.169258] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T21:25:33.558042] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-14T21:25:33.615877] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T21:25:33.618031] [INFO ] [REMOTE ] SDHY: Full fetch complete (15724 records). [2025-10-14T21:25:33.618103] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-14T21:25:33.977871] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-14T21:25:33.977948] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-14T21:25:33.978289] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-14T21:25:33.978327] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-14T21:25:33.978844] [DEBUG] [LOCAL ] SDHY: Trimmed 15724 records to 11019 (keeping 200 days of data) [2025-10-14T21:25:34.045314] [DEBUG] [LOCAL ] SDHY: Primary data saved (11019 records). [2025-10-14T21:25:34.045457] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-14T21:25:34.045535] [INFO ] [MAIN ] Update Progress: 1887/2369 symbols completed. SDHY took 30.6s. Estimated remaining: 1h 7m 49s. Rate: 7.1 symbols/min [2025-10-14T21:25:34.228366] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:34.273049] [DEBUG] [LOCAL ] SEE: Loaded 48210 existing records from primary storage. [2025-10-14T21:25:34.273353] [INFO ] [MAIN ] SEE: Loaded 48210 existing records. [2025-10-14T21:25:34.363155] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-14T21:25:34.454200] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:34.454460] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-14T21:25:34.454580] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-14T21:25:34.455252] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-14T21:25:34.455312] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-14T21:25:34.811821] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:34.837461] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T21:25:35.158047] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-14T21:25:35.635609] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T21:25:35.639139] [INFO ] [REMOTE ] SD: Full fetch complete (41063 records). [2025-10-14T21:25:35.639238] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-14T21:25:35.963178] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-14T21:25:36.035130] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-14T21:25:36.035209] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-14T21:25:36.036041] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-14T21:25:36.036100] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-14T21:25:36.036992] [DEBUG] [LOCAL ] SD: Trimmed 41063 records to 28747 (keeping 200 days of data) [2025-10-14T21:25:36.213135] [DEBUG] [LOCAL ] SD: Primary data saved (28747 records). [2025-10-14T21:25:36.213258] [INFO ] [MAIN ] SD: Full history saved. [2025-10-14T21:25:36.213349] [INFO ] [MAIN ] Update Progress: 1888/2369 symbols completed. SD took 41.0s. Estimated remaining: 1h 7m 39s. Rate: 7.1 symbols/min [2025-10-14T21:25:36.393313] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:36.408342] [DEBUG] [LOCAL ] SEG: Loaded 13059 existing records from primary storage. [2025-10-14T21:25:36.408551] [INFO ] [MAIN ] SEG: Loaded 13059 existing records. [2025-10-14T21:25:36.596846] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:36.597046] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-14T21:25:36.597179] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-14T21:25:36.597410] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-14T21:25:36.597519] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-14T21:25:36.799561] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-14T21:25:36.869347] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T21:25:37.027793] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:37.558038] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-14T21:25:37.608161] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:25:38.348772] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T21:25:38.358056] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-14T21:25:38.823805] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-14T21:25:39.158154] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-14T21:25:39.930987] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T21:25:39.958052] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-14T21:25:40.688079] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T21:25:40.758044] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-14T21:25:41.558051] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-14T21:25:41.817620] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T21:25:41.961058] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T21:25:42.339046] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T21:25:42.358033] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-14T21:25:43.158112] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-14T21:25:43.270759] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-14T21:25:43.958102] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-14T21:25:44.579737] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T21:25:44.758117] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-14T21:25:45.544297] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T21:25:45.558021] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-14T21:25:46.147326] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T21:25:46.358116] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-14T21:25:47.166250] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-14T21:25:47.189453] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T21:25:47.333689] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T21:25:47.958063] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-14T21:25:48.758102] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-14T21:25:48.985522] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T21:25:49.292897] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-14T21:25:49.482110] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T21:25:49.558059] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-14T21:25:50.358068] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-14T21:25:51.089763] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T21:25:51.158035] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-14T21:25:51.958072] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-14T21:25:52.253918] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T21:25:52.316522] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T21:25:52.758073] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-14T21:25:53.558043] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-14T21:25:53.635818] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T21:25:54.358041] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-14T21:25:54.892364] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T21:25:54.902779] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-14T21:25:54.900956] [INFO ] [REMOTE ] SDRL: Full fetch complete (61787 records). [2025-10-14T21:25:54.913744] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-14T21:25:55.166540] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-14T21:25:55.323032] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-14T21:25:55.323105] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-14T21:25:55.324225] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-14T21:25:55.324291] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-14T21:25:55.325556] [DEBUG] [LOCAL ] SDRL: Trimmed 61787 records to 41556 (keeping 200 days of data) [2025-10-14T21:25:55.581195] [DEBUG] [LOCAL ] SDRL: Primary data saved (41556 records). [2025-10-14T21:25:55.581335] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-14T21:25:55.581417] [INFO ] [MAIN ] Update Progress: 1889/2369 symbols completed. SDRL took 27.9s. Estimated remaining: 1h 7m 33s. Rate: 7.1 symbols/min [2025-10-14T21:25:55.762384] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:25:55.794315] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T21:25:55.845866] [DEBUG] [LOCAL ] SEI: Loaded 49889 existing records from primary storage. [2025-10-14T21:25:55.846200] [INFO ] [MAIN ] SEI: Loaded 49889 existing records. [2025-10-14T21:25:55.963210] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-14T21:25:56.023543] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:25:56.023769] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-14T21:25:56.023818] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-14T21:25:56.024344] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-14T21:25:56.024402] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-14T21:25:56.384064] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:25:56.758080] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-14T21:25:57.394168] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-14T21:25:57.551277] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T21:25:57.560011] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-14T21:25:58.036805] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T21:25:58.358067] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-14T21:25:59.158071] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-14T21:25:59.616438] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-14T21:25:59.958112] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-14T21:26:00.045411] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T21:26:00.758043] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-14T21:26:00.827018] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T21:26:01.558056] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-14T21:26:02.040125] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T21:26:02.358190] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-14T21:26:02.395877] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:26:02.730692] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T21:26:03.158050] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-14T21:26:03.226516] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T21:26:03.958102] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-14T21:26:04.728170] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T21:26:04.758040] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-14T21:26:05.558039] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-14T21:26:05.709631] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T21:26:06.047624] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T21:26:06.199379] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T21:26:06.204877] [INFO ] [REMOTE ] SEE: Full fetch complete (69988 records). [2025-10-14T21:26:06.204980] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-14T21:26:06.360907] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-14T21:26:06.594503] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-14T21:26:06.594580] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-14T21:26:06.595663] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-14T21:26:06.595723] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-14T21:26:06.597002] [DEBUG] [LOCAL ] SEE: Trimmed 69988 records to 48203 (keeping 200 days of data) [2025-10-14T21:26:06.880994] [DEBUG] [LOCAL ] SEE: Primary data saved (48203 records). [2025-10-14T21:26:06.881122] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-14T21:26:06.881199] [INFO ] [MAIN ] Update Progress: 1890/2369 symbols completed. SEE took 32.8s. Estimated remaining: 1h 7m 26s. Rate: 7.1 symbols/min [2025-10-14T21:26:07.076160] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:07.121521] [DEBUG] [LOCAL ] SEM: Loaded 43110 existing records from primary storage. [2025-10-14T21:26:07.121860] [INFO ] [MAIN ] SEM: Loaded 43110 existing records. [2025-10-14T21:26:07.163217] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-14T21:26:07.307874] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:07.308138] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-14T21:26:07.308282] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-14T21:26:07.308929] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-14T21:26:07.308985] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-14T21:26:07.419162] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T21:26:07.671189] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:07.958087] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-14T21:26:08.758037] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-14T21:26:08.929606] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T21:26:09.526235] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T21:26:09.558021] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-14T21:26:10.358067] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-14T21:26:10.791890] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T21:26:11.017366] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-14T21:26:11.158062] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-14T21:26:11.805139] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T21:26:11.958058] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-14T21:26:12.036634] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-14T21:26:12.758090] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-14T21:26:13.235037] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T21:26:13.558085] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-14T21:26:14.358143] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-14T21:26:14.612841] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-14T21:26:14.618748] [INFO ] [REMOTE ] SE: Full fetch complete (77219 records). [2025-10-14T21:26:14.618898] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-14T21:26:15.018682] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T21:26:15.086747] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-14T21:26:15.087353] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-14T21:26:15.088318] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T21:26:15.089500] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-14T21:26:15.089625] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-14T21:26:15.099758] [DEBUG] [LOCAL ] SE: Trimmed 77219 records to 53305 (keeping 200 days of data) [2025-10-14T21:26:15.163443] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-14T21:26:15.436615] [DEBUG] [LOCAL ] SE: Primary data saved (53305 records). [2025-10-14T21:26:15.436810] [INFO ] [MAIN ] SE: Full history saved. [2025-10-14T21:26:15.436897] [INFO ] [MAIN ] Update Progress: 1891/2369 symbols completed. SE took 43.1s. Estimated remaining: 1h 7m 17s. Rate: 7.1 symbols/min [2025-10-14T21:26:15.608367] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:15.647244] [DEBUG] [LOCAL ] SEMR: Loaded 41958 existing records from primary storage. [2025-10-14T21:26:15.647534] [INFO ] [MAIN ] SEMR: Loaded 41958 existing records. [2025-10-14T21:26:15.827422] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:15.827625] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-14T21:26:15.827721] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-14T21:26:15.828222] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-14T21:26:15.828280] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-14T21:26:15.968842] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-14T21:26:16.195198] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:16.719855] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T21:26:16.758025] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-14T21:26:17.407147] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T21:26:17.558056] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-14T21:26:18.326901] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T21:26:18.358069] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-14T21:26:19.054328] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-14T21:26:19.056058] [INFO ] [REMOTE ] SEG: Full fetch complete (19800 records). [2025-10-14T21:26:19.056126] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-14T21:26:19.158672] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-14T21:26:19.435074] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-14T21:26:19.435180] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-14T21:26:19.435783] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-14T21:26:19.435858] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-14T21:26:19.445814] [DEBUG] [LOCAL ] SEG: Trimmed 19800 records to 13042 (keeping 200 days of data) [2025-10-14T21:26:19.463474] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-14T21:26:19.548499] [DEBUG] [LOCAL ] SEG: Primary data saved (13042 records). [2025-10-14T21:26:19.548623] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-14T21:26:19.548732] [INFO ] [MAIN ] Update Progress: 1892/2369 symbols completed. SEG took 43.3s. Estimated remaining: 1h 7m 8s. Rate: 7.1 symbols/min [2025-10-14T21:26:19.729029] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:19.779524] [DEBUG] [LOCAL ] SES: Loaded 51577 existing records from primary storage. [2025-10-14T21:26:19.779859] [INFO ] [MAIN ] SES: Loaded 51577 existing records. [2025-10-14T21:26:19.959574] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:19.959898] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-14T21:26:19.959947] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-14T21:26:19.959635] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-14T21:26:19.960355] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-14T21:26:19.960995] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-14T21:26:20.334216] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:20.573893] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T21:26:20.758124] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-14T21:26:21.045912] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T21:26:21.558079] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-14T21:26:22.309269] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T21:26:22.358074] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-14T21:26:23.158056] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-14T21:26:23.326888] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T21:26:23.903588] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T21:26:23.958087] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-14T21:26:24.253961] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T21:26:24.758107] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-14T21:26:25.558075] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-14T21:26:25.602700] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T21:26:26.176305] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T21:26:26.358042] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-14T21:26:27.158044] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-14T21:26:27.488766] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T21:26:27.780081] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T21:26:27.785100] [INFO ] [REMOTE ] SEM: Full fetch complete (61690 records). [2025-10-14T21:26:27.785222] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-14T21:26:27.962790] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-14T21:26:28.184194] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-14T21:26:28.184340] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-14T21:26:28.185602] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-14T21:26:28.185765] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-14T21:26:28.196723] [DEBUG] [LOCAL ] SEM: Trimmed 61690 records to 43155 (keeping 200 days of data) [2025-10-14T21:26:28.213573] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T21:26:28.504033] [DEBUG] [LOCAL ] SEM: Primary data saved (43155 records). [2025-10-14T21:26:28.504190] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-14T21:26:28.504307] [INFO ] [MAIN ] Update Progress: 1893/2369 symbols completed. SEM took 21.6s. Estimated remaining: 1h 6m 59s. Rate: 7.1 symbols/min [2025-10-14T21:26:28.723990] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:28.767555] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-14T21:26:28.772015] [DEBUG] [LOCAL ] SF: Loaded 41716 existing records from primary storage. [2025-10-14T21:26:28.772525] [INFO ] [MAIN ] SF: Loaded 41716 existing records. [2025-10-14T21:26:29.054567] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:29.054886] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-14T21:26:29.054960] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-14T21:26:29.055630] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-14T21:26:29.055752] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-14T21:26:29.492186] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:29.558089] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-14T21:26:30.329341] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T21:26:30.358052] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-14T21:26:30.504059] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-14T21:26:31.158063] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-14T21:26:31.384168] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-14T21:26:31.865475] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T21:26:31.958097] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-14T21:26:32.587238] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T21:26:32.758090] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-14T21:26:33.558115] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-14T21:26:33.718095] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T21:26:33.724980] [INFO ] [REMOTE ] SEI: Full fetch complete (70766 records). [2025-10-14T21:26:33.725235] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-14T21:26:34.146471] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-14T21:26:34.146628] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-14T21:26:34.150942] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-14T21:26:34.151041] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-14T21:26:34.152916] [DEBUG] [LOCAL ] SEI: Trimmed 70766 records to 49923 (keeping 200 days of data) [2025-10-14T21:26:34.265131] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:26:34.359594] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-14T21:26:34.490359] [DEBUG] [LOCAL ] SEI: Primary data saved (49923 records). [2025-10-14T21:26:34.490511] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-14T21:26:34.490606] [INFO ] [MAIN ] Update Progress: 1894/2369 symbols completed. SEI took 38.9s. Estimated remaining: 1h 6m 50s. Rate: 7.1 symbols/min [2025-10-14T21:26:34.656797] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:34.663304] [DEBUG] [LOCAL ] SFB: Loaded 4134 existing records from primary storage. [2025-10-14T21:26:34.663494] [INFO ] [MAIN ] SFB: Loaded 4134 existing records. [2025-10-14T21:26:34.836622] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:34.836860] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-14T21:26:34.836907] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-14T21:26:34.837106] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-14T21:26:34.837163] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-14T21:26:35.166843] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-14T21:26:35.188722] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:35.836262] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-14T21:26:35.941922] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:26:35.958049] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-14T21:26:36.669397] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T21:26:36.758109] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-14T21:26:37.061451] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T21:26:37.330141] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-14T21:26:37.558091] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-14T21:26:37.961241] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T21:26:38.358075] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-14T21:26:39.158087] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-14T21:26:39.609237] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-14T21:26:39.863508] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T21:26:39.958091] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-14T21:26:40.758109] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-14T21:26:41.458108] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T21:26:41.558050] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-14T21:26:41.658551] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-14T21:26:42.139221] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-14T21:26:42.358053] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-14T21:26:43.158079] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-14T21:26:43.708544] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T21:26:43.958110] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-14T21:26:44.517442] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-14T21:26:44.758066] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-14T21:26:45.558096] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-14T21:26:45.593234] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:26:45.991253] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T21:26:46.358075] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-14T21:26:46.897581] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-14T21:26:46.934562] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T21:26:47.158083] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-14T21:26:47.612772] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T21:26:47.958156] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-14T21:26:48.490391] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-14T21:26:48.758111] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-14T21:26:49.248913] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T21:26:49.249891] [INFO ] [REMOTE ] SFB: Full fetch complete (5811 records). [2025-10-14T21:26:49.249962] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-14T21:26:49.563282] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-14T21:26:49.676561] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-14T21:26:49.676638] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-14T21:26:49.676858] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-14T21:26:49.676899] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-14T21:26:49.677286] [DEBUG] [LOCAL ] SFB: Trimmed 5811 records to 3900 (keeping 200 days of data) [2025-10-14T21:26:49.700880] [DEBUG] [LOCAL ] SFB: Primary data saved (3900 records). [2025-10-14T21:26:49.700967] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-14T21:26:49.701041] [INFO ] [MAIN ] Update Progress: 1895/2369 symbols completed. SFB took 15.2s. Estimated remaining: 1h 6m 44s. Rate: 7.1 symbols/min [2025-10-14T21:26:49.876100] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:49.897766] [DEBUG] [LOCAL ] SFBS: Loaded 21145 existing records from primary storage. [2025-10-14T21:26:49.898074] [INFO ] [MAIN ] SFBS: Loaded 21145 existing records. [2025-10-14T21:26:50.078323] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:50.078537] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-14T21:26:50.078583] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-14T21:26:50.078979] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-14T21:26:50.079036] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-14T21:26:50.363279] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-14T21:26:50.444322] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:50.968555] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T21:26:51.158109] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-14T21:26:51.958120] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-14T21:26:52.625611] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T21:26:52.756857] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T21:26:52.761496] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-14T21:26:52.762932] [INFO ] [REMOTE ] SEMR: Full fetch complete (60001 records). [2025-10-14T21:26:52.763007] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-14T21:26:53.146579] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-14T21:26:53.146675] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-14T21:26:53.147576] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-14T21:26:53.147615] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-14T21:26:53.148777] [DEBUG] [LOCAL ] SEMR: Trimmed 60001 records to 41977 (keeping 200 days of data) [2025-10-14T21:26:53.380463] [DEBUG] [LOCAL ] SEMR: Primary data saved (41977 records). [2025-10-14T21:26:53.380577] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-14T21:26:53.380668] [INFO ] [MAIN ] Update Progress: 1896/2369 symbols completed. SEMR took 37.9s. Estimated remaining: 1h 6m 34s. Rate: 7.1 symbols/min [2025-10-14T21:26:53.558289] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-14T21:26:53.558135] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:26:53.601383] [DEBUG] [LOCAL ] SFL: Loaded 45269 existing records from primary storage. [2025-10-14T21:26:53.601855] [INFO ] [MAIN ] SFL: Loaded 45269 existing records. [2025-10-14T21:26:53.783464] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:26:53.783758] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-14T21:26:53.783811] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-14T21:26:53.784424] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-14T21:26:53.784480] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-14T21:26:53.965711] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-14T21:26:54.115823] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T21:26:54.194283] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:26:54.358035] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-14T21:26:55.158101] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-14T21:26:55.770143] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-14T21:26:55.942147] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T21:26:55.958033] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-14T21:26:56.221517] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T21:26:56.758102] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-14T21:26:57.411727] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T21:26:57.558049] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-14T21:26:58.236915] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T21:26:58.358050] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-14T21:26:59.158119] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-14T21:26:59.831978] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-14T21:26:59.906245] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T21:26:59.958063] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-14T21:27:00.688106] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:27:00.758035] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-14T21:27:01.558040] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-14T21:27:02.001427] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T21:27:02.229545] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T21:27:02.265048] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-14T21:27:02.358090] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-14T21:27:03.158077] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-14T21:27:03.756395] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T21:27:03.958047] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-14T21:27:04.234497] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-14T21:27:04.758108] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-14T21:27:05.558082] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-14T21:27:06.171808] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-14T21:27:06.358090] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-14T21:27:06.484776] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T21:27:07.001145] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T21:27:07.158078] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-14T21:27:07.958079] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-14T21:27:08.095930] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-14T21:27:08.101877] [INFO ] [REMOTE ] SES: Full fetch complete (75635 records). [2025-10-14T21:27:08.101989] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-14T21:27:08.490159] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-14T21:27:08.490243] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-14T21:27:08.491466] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-14T21:27:08.491531] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-14T21:27:08.493031] [DEBUG] [LOCAL ] SES: Trimmed 75635 records to 51578 (keeping 200 days of data) [2025-10-14T21:27:08.777461] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-14T21:27:08.800945] [DEBUG] [LOCAL ] SES: Primary data saved (51578 records). [2025-10-14T21:27:08.801167] [INFO ] [MAIN ] SES: Full history saved. [2025-10-14T21:27:08.801350] [INFO ] [MAIN ] Update Progress: 1897/2369 symbols completed. SES took 49.3s. Estimated remaining: 1h 6m 27s. Rate: 7.1 symbols/min [2025-10-14T21:27:08.973577] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:09.002117] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T21:27:09.058492] [DEBUG] [LOCAL ] SG: Loaded 53486 existing records from primary storage. [2025-10-14T21:27:09.058840] [INFO ] [MAIN ] SG: Loaded 53486 existing records. [2025-10-14T21:27:09.238500] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:09.238812] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-14T21:27:09.238966] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-14T21:27:09.247177] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-14T21:27:09.255208] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-14T21:27:09.330393] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T21:27:09.563182] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-14T21:27:09.632229] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:10.203994] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T21:27:10.208856] [INFO ] [REMOTE ] SF: Full fetch complete (60184 records). [2025-10-14T21:27:10.208973] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-14T21:27:10.363264] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-14T21:27:10.599897] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-14T21:27:10.599963] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-14T21:27:10.600979] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-14T21:27:10.601040] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-14T21:27:10.602287] [DEBUG] [LOCAL ] SF: Trimmed 60184 records to 41638 (keeping 200 days of data) [2025-10-14T21:27:10.858812] [DEBUG] [LOCAL ] SF: Primary data saved (41638 records). [2025-10-14T21:27:10.858921] [INFO ] [MAIN ] SF: Full history saved. [2025-10-14T21:27:10.859006] [INFO ] [MAIN ] Update Progress: 1898/2369 symbols completed. SF took 42.4s. Estimated remaining: 1h 6m 17s. Rate: 7.1 symbols/min [2025-10-14T21:27:11.029270] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:11.072473] [DEBUG] [LOCAL ] SGHC: Loaded 46842 existing records from primary storage. [2025-10-14T21:27:11.072788] [INFO ] [MAIN ] SGHC: Loaded 46842 existing records. [2025-10-14T21:27:11.172018] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-14T21:27:11.281793] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:11.282866] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-14T21:27:11.284685] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-14T21:27:11.284877] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-14T21:27:11.299436] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-14T21:27:11.304396] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-14T21:27:11.305193] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T21:27:11.656683] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:11.958055] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-14T21:27:12.758061] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-14T21:27:13.008470] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T21:27:13.111506] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T21:27:13.558061] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-14T21:27:14.231461] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T21:27:14.293447] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T21:27:14.358099] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-14T21:27:15.158086] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-14T21:27:15.925060] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T21:27:15.958024] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-14T21:27:16.591945] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T21:27:16.758060] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-14T21:27:17.356567] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T21:27:17.558072] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-14T21:27:18.249873] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T21:27:18.358069] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-14T21:27:19.146916] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T21:27:19.158016] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-14T21:27:19.958078] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-14T21:27:20.215825] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T21:27:20.758082] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-14T21:27:20.805181] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T21:27:21.391351] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T21:27:21.558109] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-14T21:27:22.358131] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-14T21:27:22.479950] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:27:23.062595] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T21:27:23.158125] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-14T21:27:23.594221] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T21:27:23.958047] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-14T21:27:24.758106] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-14T21:27:24.802260] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T21:27:25.558053] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-14T21:27:25.593352] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T21:27:26.247296] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T21:27:26.252815] [INFO ] [REMOTE ] SFL: Full fetch complete (65855 records). [2025-10-14T21:27:26.252993] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-14T21:27:26.361693] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-14T21:27:26.557799] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T21:27:26.684296] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-14T21:27:26.684371] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-14T21:27:26.685418] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-14T21:27:26.685478] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-14T21:27:26.686700] [DEBUG] [LOCAL ] SFL: Trimmed 65855 records to 45328 (keeping 200 days of data) [2025-10-14T21:27:26.968286] [DEBUG] [LOCAL ] SFL: Primary data saved (45328 records). [2025-10-14T21:27:26.968377] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-14T21:27:26.968476] [INFO ] [MAIN ] Update Progress: 1899/2369 symbols completed. SFL took 33.6s. Estimated remaining: 1h 6m 11s. Rate: 7.1 symbols/min [2025-10-14T21:27:27.135382] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:27.135553] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-14T21:27:27.135591] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-14T21:27:27.135736] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-14T21:27:27.135798] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-14T21:27:27.135844] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-14T21:27:27.135877] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-14T21:27:27.166058] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-14T21:27:27.495060] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:27.958052] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-14T21:27:28.177796] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T21:27:28.223021] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:27:28.758112] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-14T21:27:29.558144] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-14T21:27:29.722837] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T21:27:30.358058] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-14T21:27:30.626243] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T21:27:30.629596] [INFO ] [REMOTE ] SFBS: Full fetch complete (30274 records). [2025-10-14T21:27:30.629710] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-14T21:27:31.028277] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-14T21:27:31.028405] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-14T21:27:31.029539] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-14T21:27:31.029622] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-14T21:27:31.042909] [DEBUG] [LOCAL ] SFBS: Trimmed 30274 records to 21185 (keeping 200 days of data) [2025-10-14T21:27:31.063342] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-14T21:27:31.167669] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-14T21:27:31.221121] [DEBUG] [LOCAL ] SFBS: Primary data saved (21185 records). [2025-10-14T21:27:31.221312] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-14T21:27:31.221427] [INFO ] [MAIN ] Update Progress: 1900/2369 symbols completed. SFBS took 41.5s. Estimated remaining: 1h 6m 1s. Rate: 7.1 symbols/min [2025-10-14T21:27:31.394235] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:27:31.395869] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:31.396449] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-14T21:27:31.397172] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:27:31.397288] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-14T21:27:31.397355] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:27:31.397431] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-14T21:27:31.397509] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-14T21:27:31.397549] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-14T21:27:31.397588] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-14T21:27:31.397670] [INFO ] [MAIN ] Update Progress: 1901/2369 symbols completed. SGI took 4.4s. Estimated remaining: 1h 5m 51s. Rate: 7.1 symbols/min [2025-10-14T21:27:31.531592] [DEBUG] [LOCAL ] SGU: Loaded 6595 existing records from primary storage. [2025-10-14T21:27:31.550272] [INFO ] [MAIN ] SGU: Loaded 6595 existing records. [2025-10-14T21:27:31.607275] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:31.758967] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:31.759548] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-14T21:27:31.759682] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-14T21:27:31.759972] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-14T21:27:31.760027] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-14T21:27:31.966623] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-14T21:27:32.042289] [DEBUG] [LOCAL ] SHAK: Loaded 48873 existing records from primary storage. [2025-10-14T21:27:32.091722] [INFO ] [MAIN ] SHAK: Loaded 48873 existing records. [2025-10-14T21:27:32.190005] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T21:27:32.300180] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:32.375283] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:32.375431] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-14T21:27:32.375477] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-14T21:27:32.375845] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-14T21:27:32.375903] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-14T21:27:32.718352] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:32.758028] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-14T21:27:33.558081] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-14T21:27:34.041450] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-14T21:27:34.233174] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T21:27:34.264292] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T21:27:34.358035] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-14T21:27:35.158114] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-14T21:27:35.958042] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-14T21:27:36.020595] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:27:36.434460] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T21:27:36.462750] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-14T21:27:36.758122] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-14T21:27:37.558113] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-14T21:27:38.358133] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-14T21:27:38.734985] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T21:27:38.952826] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T21:27:39.158048] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-14T21:27:39.214476] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T21:27:39.769917] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T21:27:39.958113] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-14T21:27:40.758070] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-14T21:27:41.558034] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-14T21:27:41.850224] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T21:27:41.856102] [INFO ] [REMOTE ] SG: Full fetch complete (77455 records). [2025-10-14T21:27:41.856205] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-14T21:27:42.240919] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-14T21:27:42.241072] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-14T21:27:42.242223] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-14T21:27:42.242283] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-14T21:27:42.243634] [DEBUG] [LOCAL ] SG: Trimmed 77455 records to 53488 (keeping 200 days of data) [2025-10-14T21:27:42.362567] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-14T21:27:42.363874] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T21:27:42.566144] [DEBUG] [LOCAL ] SG: Primary data saved (53488 records). [2025-10-14T21:27:42.566354] [INFO ] [MAIN ] SG: Full history saved. [2025-10-14T21:27:42.566452] [INFO ] [MAIN ] Update Progress: 1902/2369 symbols completed. SG took 33.8s. Estimated remaining: 1h 5m 43s. Rate: 7.1 symbols/min [2025-10-14T21:27:42.737472] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:42.767511] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-14T21:27:42.797172] [DEBUG] [LOCAL ] SHCO: Loaded 25352 existing records from primary storage. [2025-10-14T21:27:42.797425] [INFO ] [MAIN ] SHCO: Loaded 25352 existing records. [2025-10-14T21:27:42.970204] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:42.970450] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-14T21:27:42.970510] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-14T21:27:42.970871] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-14T21:27:42.970929] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-14T21:27:43.163510] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-14T21:27:43.326901] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:43.958079] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-14T21:27:44.091265] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T21:27:44.236256] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T21:27:44.758059] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-14T21:27:45.155882] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T21:27:45.558101] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-14T21:27:46.358047] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-14T21:27:46.637316] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T21:27:46.792286] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T21:27:46.803599] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T21:27:47.158058] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-14T21:27:47.958069] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-14T21:27:48.694333] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T21:27:48.700223] [INFO ] [REMOTE ] SGHC: Full fetch complete (64786 records). [2025-10-14T21:27:48.700361] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-14T21:27:48.758052] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-14T21:27:49.096740] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-14T21:27:49.096835] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-14T21:27:49.097886] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-14T21:27:49.098035] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-14T21:27:49.111748] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T21:27:49.116668] [DEBUG] [LOCAL ] SGHC: Trimmed 64786 records to 46928 (keeping 200 days of data) [2025-10-14T21:27:49.396307] [DEBUG] [LOCAL ] SGHC: Primary data saved (46928 records). [2025-10-14T21:27:49.396509] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-14T21:27:49.396625] [INFO ] [MAIN ] Update Progress: 1903/2369 symbols completed. SGHC took 38.5s. Estimated remaining: 1h 5m 34s. Rate: 7.1 symbols/min [2025-10-14T21:27:49.563393] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-14T21:27:49.563299] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:49.613927] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-10-14T21:27:49.614220] [INFO ] [MAIN ] SHEL: Loaded 53673 existing records. [2025-10-14T21:27:49.789936] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:49.790119] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-14T21:27:49.790166] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-14T21:27:49.790576] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-14T21:27:49.790635] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-14T21:27:50.144543] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:50.290870] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T21:27:50.358067] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-14T21:27:50.600423] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T21:27:51.158049] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-14T21:27:51.891247] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T21:27:51.958080] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-14T21:27:52.273624] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T21:27:52.758048] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-14T21:27:53.231753] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T21:27:53.558103] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-14T21:27:53.567302] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T21:27:54.358055] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-14T21:27:54.676846] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T21:27:54.900135] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T21:27:54.901215] [INFO ] [REMOTE ] SGU: Full fetch complete (9040 records). [2025-10-14T21:27:54.901280] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-14T21:27:55.163240] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-14T21:27:55.255457] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-14T21:27:55.255526] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-14T21:27:55.255788] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-14T21:27:55.255845] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-14T21:27:55.256236] [DEBUG] [LOCAL ] SGU: Trimmed 9040 records to 6580 (keeping 200 days of data) [2025-10-14T21:27:55.294156] [DEBUG] [LOCAL ] SGU: Primary data saved (6580 records). [2025-10-14T21:27:55.294230] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-14T21:27:55.294295] [INFO ] [MAIN ] Update Progress: 1904/2369 symbols completed. SGU took 24.1s. Estimated remaining: 1h 5m 25s. Rate: 7.1 symbols/min [2025-10-14T21:27:55.459462] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:27:55.485444] [DEBUG] [LOCAL ] SHG: Loaded 26434 existing records from primary storage. [2025-10-14T21:27:55.485705] [INFO ] [MAIN ] SHG: Loaded 26434 existing records. [2025-10-14T21:27:55.659876] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:27:55.660055] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-14T21:27:55.660100] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-14T21:27:55.660413] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-14T21:27:55.660469] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-14T21:27:55.963208] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-14T21:27:56.014032] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:27:56.758034] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-14T21:27:57.029595] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T21:27:57.254521] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T21:27:57.558096] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-14T21:27:57.769899] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:27:58.358083] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-14T21:27:59.158075] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-14T21:27:59.531773] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-14T21:27:59.958079] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-14T21:28:00.518241] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:28:00.723724] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-14T21:28:00.758024] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-14T21:28:00.952055] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T21:28:01.558056] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-14T21:28:02.358145] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-14T21:28:03.039534] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T21:28:03.158067] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-14T21:28:03.214590] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-14T21:28:03.699551] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T21:28:03.958043] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-14T21:28:04.617042] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T21:28:04.758067] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-14T21:28:05.558073] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-14T21:28:05.708283] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T21:28:06.358043] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-14T21:28:06.705945] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T21:28:06.906508] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-14T21:28:07.158076] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-14T21:28:07.958087] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-14T21:28:08.016934] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T21:28:08.540882] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T21:28:08.758092] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-14T21:28:09.558048] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-14T21:28:09.800226] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T21:28:09.929885] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T21:28:10.358066] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-14T21:28:11.158031] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-14T21:28:11.289606] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T21:28:11.396787] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T21:28:11.958081] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-14T21:28:12.259447] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T21:28:12.758091] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-14T21:28:13.558070] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-14T21:28:13.778184] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T21:28:13.948461] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-14T21:28:14.358074] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-14T21:28:14.939158] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T21:28:15.158125] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-14T21:28:15.640884] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T21:28:15.644170] [INFO ] [REMOTE ] SHCO: Full fetch complete (37589 records). [2025-10-14T21:28:15.644286] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-14T21:28:15.963187] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-14T21:28:16.071048] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-14T21:28:16.071120] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-14T21:28:16.071865] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-14T21:28:16.071926] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-14T21:28:16.072814] [DEBUG] [LOCAL ] SHCO: Trimmed 37589 records to 25511 (keeping 200 days of data) [2025-10-14T21:28:16.211690] [DEBUG] [LOCAL ] SHCO: Primary data saved (25511 records). [2025-10-14T21:28:16.211820] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-14T21:28:16.211898] [INFO ] [MAIN ] Update Progress: 1905/2369 symbols completed. SHCO took 33.6s. Estimated remaining: 1h 5m 20s. Rate: 7.1 symbols/min [2025-10-14T21:28:16.376884] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:16.419999] [DEBUG] [LOCAL ] SHO: Loaded 49497 existing records from primary storage. [2025-10-14T21:28:16.420305] [INFO ] [MAIN ] SHO: Loaded 49497 existing records. [2025-10-14T21:28:16.593731] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:28:16.593947] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-14T21:28:16.593993] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-14T21:28:16.594480] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-14T21:28:16.594536] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-14T21:28:16.763701] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-14T21:28:16.949919] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:17.431120] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-14T21:28:17.558022] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-14T21:28:18.031085] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-14T21:28:18.358053] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-14T21:28:18.461226] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-14T21:28:18.466676] [INFO ] [REMOTE ] SHAK: Full fetch complete (70960 records). [2025-10-14T21:28:18.466818] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-14T21:28:18.872157] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-14T21:28:18.872253] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-14T21:28:18.873409] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-14T21:28:18.873485] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-14T21:28:18.874972] [DEBUG] [LOCAL ] SHAK: Trimmed 70960 records to 48851 (keeping 200 days of data) [2025-10-14T21:28:19.160134] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-14T21:28:19.188187] [DEBUG] [LOCAL ] SHAK: Primary data saved (48851 records). [2025-10-14T21:28:19.188323] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-14T21:28:19.188402] [INFO ] [MAIN ] Update Progress: 1906/2369 symbols completed. SHAK took 47.8s. Estimated remaining: 1h 5m 10s. Rate: 7.1 symbols/min [2025-10-14T21:28:19.359897] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:19.365532] [DEBUG] [LOCAL ] SHOC: Loaded 3343 existing records from primary storage. [2025-10-14T21:28:19.365732] [INFO ] [MAIN ] SHOC: Loaded 3343 existing records. [2025-10-14T21:28:19.570848] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:28:19.571697] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-14T21:28:19.572014] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-14T21:28:19.577803] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-14T21:28:19.586738] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-14T21:28:19.592948] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T21:28:19.960137] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-14T21:28:19.981724] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:19.984966] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-14T21:28:20.766214] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-14T21:28:20.784600] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T21:28:21.257991] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T21:28:21.261464] [INFO ] [REMOTE ] SHG: Full fetch complete (41137 records). [2025-10-14T21:28:21.261544] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-14T21:28:21.563036] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-14T21:28:21.652212] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-14T21:28:21.652294] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-14T21:28:21.653101] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-14T21:28:21.653163] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-14T21:28:21.654338] [DEBUG] [LOCAL ] SHG: Trimmed 41137 records to 26502 (keeping 200 days of data) [2025-10-14T21:28:21.806524] [DEBUG] [LOCAL ] SHG: Primary data saved (26502 records). [2025-10-14T21:28:21.806669] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-14T21:28:21.806767] [INFO ] [MAIN ] Update Progress: 1907/2369 symbols completed. SHG took 26.5s. Estimated remaining: 1h 5m 0s. Rate: 7.1 symbols/min [2025-10-14T21:28:21.974114] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:22.017777] [DEBUG] [LOCAL ] SHW: Loaded 50346 existing records from primary storage. [2025-10-14T21:28:22.018081] [INFO ] [MAIN ] SHW: Loaded 50346 existing records. [2025-10-14T21:28:22.194067] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:28:22.194308] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-14T21:28:22.194358] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-14T21:28:22.195037] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-14T21:28:22.195093] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-14T21:28:22.364127] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-14T21:28:22.551245] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:22.941901] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-14T21:28:22.970715] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T21:28:23.158066] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-14T21:28:23.191364] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T21:28:23.843403] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T21:28:23.958055] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-14T21:28:24.536495] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T21:28:24.758065] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-14T21:28:25.477724] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T21:28:25.558053] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-14T21:28:26.219237] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:28:26.358043] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-14T21:28:27.158070] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-14T21:28:27.628273] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-14T21:28:27.958037] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-14T21:28:28.256121] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T21:28:28.261933] [INFO ] [REMOTE ] SHEL: Full fetch complete (77835 records). [2025-10-14T21:28:28.262039] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-14T21:28:28.369154] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T21:28:28.658956] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-14T21:28:28.659048] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-14T21:28:28.660278] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-14T21:28:28.660350] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-14T21:28:28.661896] [DEBUG] [LOCAL ] SHEL: Trimmed 77835 records to 53673 (keeping 200 days of data) [2025-10-14T21:28:28.763364] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-14T21:28:28.985116] [DEBUG] [LOCAL ] SHEL: Primary data saved (53673 records). [2025-10-14T21:28:28.985241] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-14T21:28:28.985314] [INFO ] [MAIN ] Update Progress: 1908/2369 symbols completed. SHEL took 39.6s. Estimated remaining: 1h 4m 51s. Rate: 7.1 symbols/min [2025-10-14T21:28:29.152179] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:29.152325] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-14T21:28:29.152361] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-14T21:28:29.152466] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-14T21:28:29.152506] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-14T21:28:29.152571] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-14T21:28:29.152636] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-14T21:28:29.257783] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-14T21:28:29.507868] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:29.558031] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-14T21:28:29.759182] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:28:29.759457] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-14T21:28:29.759558] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:28:29.759627] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-14T21:28:29.759710] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:28:29.759780] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-14T21:28:29.759841] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-14T21:28:29.759876] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-14T21:28:29.759920] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-14T21:28:29.759966] [INFO ] [MAIN ] Update Progress: 1909/2369 symbols completed. SI took 0.8s. Estimated remaining: 1h 4m 41s. Rate: 7.1 symbols/min [2025-10-14T21:28:29.924919] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:29.964047] [DEBUG] [LOCAL ] SID: Loaded 42599 existing records from primary storage. [2025-10-14T21:28:29.964341] [INFO ] [MAIN ] SID: Loaded 42599 existing records. [2025-10-14T21:28:30.138528] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:28:30.138743] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-14T21:28:30.138794] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-14T21:28:30.139388] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-14T21:28:30.139446] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-14T21:28:30.368518] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-14T21:28:30.494618] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:30.888769] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-14T21:28:31.158105] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-14T21:28:31.958068] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-14T21:28:32.598737] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T21:28:32.758086] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-14T21:28:33.558042] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-14T21:28:33.774717] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T21:28:34.111571] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-14T21:28:34.358103] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-14T21:28:34.533822] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T21:28:34.856045] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T21:28:34.856982] [INFO ] [REMOTE ] SHOC: Full fetch complete (7033 records). [2025-10-14T21:28:34.857047] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-14T21:28:35.163174] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-14T21:28:35.216259] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-14T21:28:35.216343] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-14T21:28:35.216579] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-14T21:28:35.216625] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-14T21:28:35.217133] [DEBUG] [LOCAL ] SHOC: Trimmed 7033 records to 3300 (keeping 200 days of data) [2025-10-14T21:28:35.237613] [DEBUG] [LOCAL ] SHOC: Primary data saved (3300 records). [2025-10-14T21:28:35.237758] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-14T21:28:35.237846] [INFO ] [MAIN ] Update Progress: 1910/2369 symbols completed. SHOC took 16.0s. Estimated remaining: 1h 4m 32s. Rate: 7.1 symbols/min [2025-10-14T21:28:35.405059] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:35.447416] [DEBUG] [LOCAL ] SIG: Loaded 45713 existing records from primary storage. [2025-10-14T21:28:35.447857] [INFO ] [MAIN ] SIG: Loaded 45713 existing records. [2025-10-14T21:28:35.625152] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:28:35.625325] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-14T21:28:35.625370] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-14T21:28:35.625724] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-14T21:28:35.625781] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-14T21:28:35.968085] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-14T21:28:35.972713] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:36.758114] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-14T21:28:36.976193] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T21:28:37.422158] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T21:28:37.558029] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-14T21:28:37.982544] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T21:28:38.358127] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-14T21:28:38.785800] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-14T21:28:39.158104] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-14T21:28:39.958040] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-14T21:28:40.152589] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T21:28:40.758125] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-14T21:28:40.831480] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T21:28:41.558084] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-14T21:28:41.608295] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T21:28:41.890603] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T21:28:42.358093] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-14T21:28:43.128411] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T21:28:43.158030] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-14T21:28:43.958103] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-14T21:28:44.110363] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T21:28:44.619484] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T21:28:44.758042] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-14T21:28:45.545100] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T21:28:45.558029] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-14T21:28:46.078499] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T21:28:46.358082] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-14T21:28:47.158120] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-14T21:28:47.213321] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T21:28:47.958100] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-14T21:28:48.087745] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T21:28:48.668097] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T21:28:48.758118] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-14T21:28:49.558037] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-14T21:28:49.653384] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T21:28:50.358056] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-14T21:28:51.091795] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-14T21:28:51.158063] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-14T21:28:51.226068] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:28:51.958095] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-14T21:28:52.004964] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T21:28:52.758056] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-14T21:28:52.805582] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T21:28:53.558050] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-14T21:28:53.884571] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-14T21:28:53.955321] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T21:28:54.358055] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-14T21:28:55.158087] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-14T21:28:55.270547] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T21:28:55.881262] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T21:28:55.958029] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-14T21:28:56.735215] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T21:28:56.758040] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-14T21:28:57.173625] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T21:28:57.558083] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-14T21:28:58.140318] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T21:28:58.145348] [INFO ] [REMOTE ] SHO: Full fetch complete (71000 records). [2025-10-14T21:28:58.145450] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-14T21:28:58.368143] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-14T21:28:58.528830] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-14T21:28:58.528906] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-14T21:28:58.529978] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-14T21:28:58.530039] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-14T21:28:58.531449] [DEBUG] [LOCAL ] SHO: Trimmed 71000 records to 49430 (keeping 200 days of data) [2025-10-14T21:28:58.818531] [DEBUG] [LOCAL ] SHO: Primary data saved (49430 records). [2025-10-14T21:28:58.818669] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-14T21:28:58.818763] [INFO ] [MAIN ] Update Progress: 1911/2369 symbols completed. SHO took 42.6s. Estimated remaining: 1h 4m 27s. Rate: 7.1 symbols/min [2025-10-14T21:28:58.984054] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:28:59.006472] [DEBUG] [LOCAL ] SII: Loaded 23960 existing records from primary storage. [2025-10-14T21:28:59.006743] [INFO ] [MAIN ] SII: Loaded 23960 existing records. [2025-10-14T21:28:59.159523] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-14T21:28:59.188127] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:28:59.188834] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-14T21:28:59.189438] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-14T21:28:59.190293] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-14T21:28:59.190363] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-14T21:28:59.575974] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:28:59.578438] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T21:28:59.748978] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T21:28:59.958052] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-14T21:29:00.758041] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-14T21:29:00.892246] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T21:29:01.558066] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-14T21:29:01.651243] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-14T21:29:01.656914] [INFO ] [REMOTE ] SHW: Full fetch complete (73216 records). [2025-10-14T21:29:01.657011] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-14T21:29:02.060606] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-14T21:29:02.060825] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-14T21:29:02.062075] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-14T21:29:02.062171] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-14T21:29:02.089388] [DEBUG] [LOCAL ] SHW: Trimmed 73216 records to 50357 (keeping 200 days of data) [2025-10-14T21:29:02.092509] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T21:29:02.372528] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-14T21:29:02.410277] [DEBUG] [LOCAL ] SHW: Primary data saved (50357 records). [2025-10-14T21:29:02.410371] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-14T21:29:02.411072] [INFO ] [MAIN ] Update Progress: 1912/2369 symbols completed. SHW took 40.6s. Estimated remaining: 1h 4m 17s. Rate: 7.1 symbols/min [2025-10-14T21:29:02.580146] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:29:02.612352] [DEBUG] [LOCAL ] SILA: Loaded 30545 existing records from primary storage. [2025-10-14T21:29:02.612665] [INFO ] [MAIN ] SILA: Loaded 30545 existing records. [2025-10-14T21:29:02.796222] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:29:02.796579] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-14T21:29:02.796672] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-14T21:29:02.797307] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-14T21:29:02.797363] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-14T21:29:02.978100] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T21:29:03.165166] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-14T21:29:03.188514] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:29:03.400878] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T21:29:03.958106] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-14T21:29:04.758109] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-14T21:29:04.876958] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T21:29:05.558090] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-14T21:29:05.650968] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T21:29:05.771864] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:29:06.358104] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-14T21:29:07.161216] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-14T21:29:07.167208] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T21:29:07.623673] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T21:29:07.958125] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-14T21:29:08.239525] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:29:08.758081] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-14T21:29:09.359383] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T21:29:09.364664] [INFO ] [REMOTE ] SID: Full fetch complete (60954 records). [2025-10-14T21:29:09.364788] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-14T21:29:09.563141] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-14T21:29:09.758872] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-14T21:29:09.758952] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-14T21:29:09.759985] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-14T21:29:09.760056] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-14T21:29:09.769452] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T21:29:09.773719] [DEBUG] [LOCAL ] SID: Trimmed 60954 records to 42651 (keeping 200 days of data) [2025-10-14T21:29:10.006248] [DEBUG] [LOCAL ] SID: Primary data saved (42651 records). [2025-10-14T21:29:10.006375] [INFO ] [MAIN ] SID: Full history saved. [2025-10-14T21:29:10.006452] [INFO ] [MAIN ] Update Progress: 1913/2369 symbols completed. SID took 40.2s. Estimated remaining: 1h 4m 9s. Rate: 7.1 symbols/min [2025-10-14T21:29:10.172984] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:29:10.208293] [DEBUG] [LOCAL ] SITC: Loaded 41665 existing records from primary storage. [2025-10-14T21:29:10.208603] [INFO ] [MAIN ] SITC: Loaded 41665 existing records. [2025-10-14T21:29:10.363235] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-14T21:29:10.392198] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:29:10.392382] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-14T21:29:10.392427] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-14T21:29:10.393126] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-14T21:29:10.393182] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-14T21:29:10.740708] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:29:11.089136] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T21:29:11.094072] [INFO ] [REMOTE ] SIG: Full fetch complete (67968 records). [2025-10-14T21:29:11.094167] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-14T21:29:11.163262] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-14T21:29:11.502919] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-14T21:29:11.503028] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-14T21:29:11.504391] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-14T21:29:11.504506] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-14T21:29:11.505986] [DEBUG] [LOCAL ] SIG: Trimmed 67968 records to 45688 (keeping 200 days of data) [2025-10-14T21:29:11.734922] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T21:29:11.805865] [DEBUG] [LOCAL ] SIG: Primary data saved (45688 records). [2025-10-14T21:29:11.805991] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-14T21:29:11.806067] [INFO ] [MAIN ] Update Progress: 1914/2369 symbols completed. SIG took 36.6s. Estimated remaining: 1h 3m 59s. Rate: 7.1 symbols/min [2025-10-14T21:29:11.959779] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-14T21:29:11.979036] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:29:12.014303] [DEBUG] [LOCAL ] SITE: Loaded 35421 existing records from primary storage. [2025-10-14T21:29:12.014601] [INFO ] [MAIN ] SITE: Loaded 35421 existing records. [2025-10-14T21:29:12.190259] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:29:12.190531] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-14T21:29:12.190593] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-14T21:29:12.191285] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-14T21:29:12.191345] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-14T21:29:12.571056] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:29:12.598543] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T21:29:12.758049] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-14T21:29:13.032774] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T21:29:13.558056] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-14T21:29:14.076556] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T21:29:14.358034] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-14T21:29:14.806547] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T21:29:15.158055] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-14T21:29:15.958070] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-14T21:29:16.002122] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T21:29:16.566858] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T21:29:16.758080] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-14T21:29:17.280183] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T21:29:17.558072] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-14T21:29:18.192915] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T21:29:18.358087] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-14T21:29:18.942111] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T21:29:19.158100] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-14T21:29:19.760041] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T21:29:19.958042] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-14T21:29:20.334264] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T21:29:20.758138] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-14T21:29:20.964837] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:29:21.558107] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-14T21:29:22.358053] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-14T21:29:22.387673] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T21:29:23.158039] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-14T21:29:23.252113] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T21:29:23.492876] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T21:29:23.958135] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-14T21:29:24.301700] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T21:29:24.758113] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-14T21:29:25.055387] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T21:29:25.558089] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-14T21:29:25.973217] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T21:29:26.358042] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-14T21:29:26.454064] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-14T21:29:27.158081] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-14T21:29:27.776594] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T21:29:27.958038] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-14T21:29:28.363919] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T21:29:28.758069] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-14T21:29:29.471805] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T21:29:29.532246] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T21:29:29.558030] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-14T21:29:30.358057] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-14T21:29:30.634142] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T21:29:31.158098] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-14T21:29:31.801320] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T21:29:31.958036] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-14T21:29:32.220710] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T21:29:32.225462] [INFO ] [REMOTE ] SII: Full fetch complete (30927 records). [2025-10-14T21:29:32.225574] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-14T21:29:32.612784] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-14T21:29:32.612875] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-14T21:29:32.613482] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-14T21:29:32.613525] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-14T21:29:32.614250] [DEBUG] [LOCAL ] SII: Trimmed 30927 records to 23971 (keeping 200 days of data) [2025-10-14T21:29:32.756071] [DEBUG] [LOCAL ] SII: Primary data saved (23971 records). [2025-10-14T21:29:32.756193] [INFO ] [MAIN ] SII: Full history saved. [2025-10-14T21:29:32.756267] [INFO ] [MAIN ] Update Progress: 1915/2369 symbols completed. SII took 33.9s. Estimated remaining: 1h 3m 53s. Rate: 7.1 symbols/min [2025-10-14T21:29:32.767693] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-14T21:29:32.928425] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:29:32.971972] [DEBUG] [LOCAL ] SJM: Loaded 50108 existing records from primary storage. [2025-10-14T21:29:32.972287] [INFO ] [MAIN ] SJM: Loaded 50108 existing records. [2025-10-14T21:29:33.158204] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:29:33.158494] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-14T21:29:33.158548] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-14T21:29:33.159445] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-14T21:29:33.159501] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-14T21:29:33.542808] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:29:33.544981] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T21:29:33.558022] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-14T21:29:34.021581] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T21:29:34.358061] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-14T21:29:35.158066] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-14T21:29:35.355203] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T21:29:35.441082] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T21:29:35.917596] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T21:29:35.921001] [INFO ] [REMOTE ] SILA: Full fetch complete (44550 records). [2025-10-14T21:29:35.921081] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-14T21:29:35.963362] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-14T21:29:36.304330] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-14T21:29:36.304419] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-14T21:29:36.305443] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-14T21:29:36.305504] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-14T21:29:36.306608] [DEBUG] [LOCAL ] SILA: Trimmed 44550 records to 30520 (keeping 200 days of data) [2025-10-14T21:29:36.491099] [DEBUG] [LOCAL ] SILA: Primary data saved (30520 records). [2025-10-14T21:29:36.491243] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-14T21:29:36.491325] [INFO ] [MAIN ] Update Progress: 1916/2369 symbols completed. SILA took 34.1s. Estimated remaining: 1h 3m 44s. Rate: 7.1 symbols/min [2025-10-14T21:29:36.660277] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:29:36.680368] [DEBUG] [LOCAL ] SJT: Loaded 22350 existing records from primary storage. [2025-10-14T21:29:36.680605] [INFO ] [MAIN ] SJT: Loaded 22350 existing records. [2025-10-14T21:29:36.763195] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-14T21:29:36.882099] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:29:36.882344] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-14T21:29:36.882399] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-14T21:29:36.882981] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-14T21:29:36.883057] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-14T21:29:37.236722] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:29:37.558083] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-14T21:29:37.657900] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T21:29:38.306095] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:29:38.358032] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-14T21:29:38.712763] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T21:29:39.158142] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-14T21:29:39.787061] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T21:29:39.958042] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-14T21:29:40.521826] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:29:40.708933] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-14T21:29:40.758037] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-14T21:29:41.558073] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-14T21:29:41.849404] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T21:29:42.358072] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-14T21:29:43.158081] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-14T21:29:43.210485] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T21:29:43.481578] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-14T21:29:43.958069] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-14T21:29:44.728848] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T21:29:44.758026] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-14T21:29:45.413051] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T21:29:45.558048] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-14T21:29:46.056107] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T21:29:46.060905] [INFO ] [REMOTE ] SITC: Full fetch complete (60672 records). [2025-10-14T21:29:46.060999] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-14T21:29:46.363272] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-14T21:29:46.446910] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-14T21:29:46.446995] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-14T21:29:46.448070] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-14T21:29:46.448134] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-14T21:29:46.449320] [DEBUG] [LOCAL ] SITC: Trimmed 60672 records to 41760 (keeping 200 days of data) [2025-10-14T21:29:46.697171] [DEBUG] [LOCAL ] SITC: Primary data saved (41760 records). [2025-10-14T21:29:46.697299] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-14T21:29:46.697378] [INFO ] [MAIN ] Update Progress: 1917/2369 symbols completed. SITC took 36.7s. Estimated remaining: 1h 3m 36s. Rate: 7.1 symbols/min [2025-10-14T21:29:46.823224] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-14T21:29:46.828202] [INFO ] [REMOTE ] SITE: Full fetch complete (50327 records). [2025-10-14T21:29:46.828307] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-14T21:29:47.163744] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-14T21:29:47.215309] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-14T21:29:47.215391] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-14T21:29:47.216297] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-14T21:29:47.216358] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-14T21:29:47.217503] [DEBUG] [LOCAL ] SITE: Trimmed 50327 records to 35503 (keeping 200 days of data) [2025-10-14T21:29:47.428533] [DEBUG] [LOCAL ] SITE: Primary data saved (35503 records). [2025-10-14T21:29:47.428692] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-14T21:29:47.428784] [INFO ] [MAIN ] Update Progress: 1918/2369 symbols completed. SITE took 35.6s. Estimated remaining: 1h 3m 25s. Rate: 7.1 symbols/min [2025-10-14T21:29:47.501734] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T21:29:47.958066] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-14T21:29:48.744455] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T21:29:48.758023] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-14T21:29:49.228141] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T21:29:49.558098] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-14T21:29:50.427108] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T21:29:50.438063] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-14T21:29:50.664470] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T21:29:51.158055] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-14T21:29:52.103601] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-14T21:29:52.107859] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-14T21:29:52.141730] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T21:29:52.758124] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-14T21:29:53.226749] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T21:29:53.558075] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-14T21:29:54.436973] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T21:29:54.447277] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-14T21:29:54.669158] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T21:29:55.158117] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-14T21:29:56.051408] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T21:29:56.054261] [INFO ] [REMOTE ] SJT: Full fetch complete (32008 records). [2025-10-14T21:29:56.054354] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-14T21:29:56.469825] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-14T21:29:56.513054] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-14T21:29:56.513318] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-14T21:29:56.514265] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-14T21:29:56.514961] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-14T21:29:56.515024] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-14T21:29:56.515923] [DEBUG] [LOCAL ] SJT: Trimmed 32008 records to 22467 (keeping 200 days of data) [2025-10-14T21:29:56.663838] [DEBUG] [LOCAL ] SJT: Primary data saved (22467 records). [2025-10-14T21:29:56.663972] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-14T21:29:56.664052] [INFO ] [MAIN ] Update Progress: 1919/2369 symbols completed. SJT took 20.2s. Estimated remaining: 1h 3m 17s. Rate: 7.1 symbols/min [2025-10-14T21:29:58.235935] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T21:29:58.247473] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-14T21:30:00.131427] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T21:30:00.143245] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-14T21:30:02.165072] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-14T21:30:02.177184] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-14T21:30:03.801497] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T21:30:03.807361] [INFO ] [REMOTE ] SJM: Full fetch complete (72202 records). [2025-10-14T21:30:03.807529] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-14T21:30:04.223606] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-14T21:30:04.223750] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-14T21:30:04.225955] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-14T21:30:04.226024] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-14T21:30:04.228108] [DEBUG] [LOCAL ] SJM: Trimmed 72202 records to 50116 (keeping 200 days of data) [2025-10-14T21:30:04.564134] [DEBUG] [LOCAL ] SJM: Primary data saved (50116 records). [2025-10-14T21:30:04.564330] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-14T21:30:04.564432] [INFO ] [MAIN ] Update Progress: 1920/2369 symbols completed. SJM took 31.8s. Estimated remaining: 1h 3m 9s. Rate: 7.1 symbols/min [2025-10-14T21:30:05.311755] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:05.307276] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:05.331362] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:05.295746] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:05.342748] [DEBUG] [LOCAL ] SKIL: Loaded 6538 existing records from primary storage. [2025-10-14T21:30:05.346876] [INFO ] [MAIN ] SKIL: Loaded 6538 existing records. [2025-10-14T21:30:05.424276] [DEBUG] [LOCAL ] SKLZ: Loaded 11564 existing records from primary storage. [2025-10-14T21:30:05.435680] [INFO ] [MAIN ] SKLZ: Loaded 11564 existing records. [2025-10-14T21:30:05.756277] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:05.778529] [DEBUG] [LOCAL ] SKE: Loaded 36639 existing records from primary storage. [2025-10-14T21:30:05.778797] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-14T21:30:05.792990] [INFO ] [MAIN ] SKE: Loaded 36639 existing records. [2025-10-14T21:30:05.766061] [DEBUG] [LOCAL ] SKM: Loaded 35143 existing records from primary storage. [2025-10-14T21:30:05.793376] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-14T21:30:05.792849] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:05.814132] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-14T21:30:05.828311] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-14T21:30:05.834931] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-14T21:30:05.840414] [INFO ] [MAIN ] SKM: Loaded 35143 existing records. [2025-10-14T21:30:05.857531] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-14T21:30:06.025152] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-14T21:30:06.025348] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-14T21:30:06.385223] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:06.463370] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-14T21:30:06.567616] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-14T21:30:06.567447] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:06.627314] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-14T21:30:06.649519] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-14T21:30:06.632587] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-14T21:30:06.717005] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-14T21:30:06.728882] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-14T21:30:06.749879] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-14T21:30:07.096466] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:07.138730] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-14T21:30:07.306292] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:07.393720] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-14T21:30:07.787672] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:07.809048] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-14T21:30:07.813417] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:07.814878] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-14T21:30:07.983880] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T21:30:07.986444] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-14T21:30:08.615049] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T21:30:08.620037] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-14T21:30:08.752973] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T21:30:08.755753] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-14T21:30:08.839293] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T21:30:08.845120] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-14T21:30:09.181999] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-14T21:30:09.184029] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-14T21:30:09.261186] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T21:30:09.267964] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-14T21:30:09.354083] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-14T21:30:09.358222] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-14T21:30:09.612027] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T21:30:09.618183] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-14T21:30:09.901218] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T21:30:09.903392] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-14T21:30:09.977221] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T21:30:09.980151] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-14T21:30:10.289391] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T21:30:10.321883] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-14T21:30:10.358038] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-14T21:30:10.486852] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T21:30:10.665715] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-14T21:30:11.158109] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-14T21:30:11.387328] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T21:30:11.958081] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-14T21:30:11.982835] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T21:30:12.542227] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T21:30:12.758076] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-14T21:30:13.558053] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-14T21:30:14.095210] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T21:30:14.358048] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-14T21:30:14.951004] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T21:30:15.158075] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-14T21:30:15.814078] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-14T21:30:15.863923] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T21:30:15.958101] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-14T21:30:16.758110] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-14T21:30:17.456396] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T21:30:17.558060] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-14T21:30:17.961089] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-14T21:30:18.262362] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T21:30:18.358059] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-14T21:30:19.158051] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-14T21:30:19.834786] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T21:30:19.958045] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-14T21:30:20.452984] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T21:30:20.709763] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T21:30:20.758026] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-14T21:30:21.558076] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-14T21:30:21.573370] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-14T21:30:22.358057] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-14T21:30:22.962025] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T21:30:22.973529] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-14T21:30:23.158059] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-14T21:30:23.958039] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-14T21:30:24.183828] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T21:30:24.400975] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T21:30:24.758132] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-14T21:30:25.558070] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-14T21:30:26.174090] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T21:30:26.274982] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T21:30:26.276678] [INFO ] [REMOTE ] SKIL: Full fetch complete (10237 records). [2025-10-14T21:30:26.276757] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-14T21:30:26.363334] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-14T21:30:26.640625] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-14T21:30:26.640749] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-14T21:30:26.641018] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-14T21:30:26.641058] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-14T21:30:26.641753] [DEBUG] [LOCAL ] SKIL: Trimmed 10237 records to 6572 (keeping 200 days of data) [2025-10-14T21:30:26.682113] [DEBUG] [LOCAL ] SKIL: Primary data saved (6572 records). [2025-10-14T21:30:26.682267] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-14T21:30:26.682351] [INFO ] [MAIN ] Update Progress: 1921/2369 symbols completed. SKIL took 22.1s. Estimated remaining: 1h 3m 3s. Rate: 7.1 symbols/min [2025-10-14T21:30:26.856977] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:26.897103] [DEBUG] [LOCAL ] SKT: Loaded 42491 existing records from primary storage. [2025-10-14T21:30:26.897398] [INFO ] [MAIN ] SKT: Loaded 42491 existing records. [2025-10-14T21:30:27.071065] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:27.071304] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-14T21:30:27.071351] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-14T21:30:27.072260] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-14T21:30:27.072321] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-14T21:30:27.164747] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-14T21:30:27.436016] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:27.821495] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:30:27.958041] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-14T21:30:28.133695] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T21:30:28.758073] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-14T21:30:29.425975] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T21:30:29.558064] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-14T21:30:29.760859] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T21:30:30.358135] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-14T21:30:30.737918] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T21:30:30.743255] [INFO ] [REMOTE ] SKM: Full fetch complete (48709 records). [2025-10-14T21:30:30.743423] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-14T21:30:31.140119] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-14T21:30:31.140201] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-14T21:30:31.141138] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-14T21:30:31.141200] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-14T21:30:31.142357] [DEBUG] [LOCAL ] SKM: Trimmed 48709 records to 35146 (keeping 200 days of data) [2025-10-14T21:30:31.193794] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-14T21:30:31.358113] [DEBUG] [LOCAL ] SKM: Primary data saved (35146 records). [2025-10-14T21:30:31.358258] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-14T21:30:31.358337] [INFO ] [MAIN ] Update Progress: 1922/2369 symbols completed. SKM took 26.8s. Estimated remaining: 1h 2m 54s. Rate: 7.1 symbols/min [2025-10-14T21:30:31.526659] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:31.561427] [DEBUG] [LOCAL ] SKY: Loaded 38298 existing records from primary storage. [2025-10-14T21:30:31.561761] [INFO ] [MAIN ] SKY: Loaded 38298 existing records. [2025-10-14T21:30:31.746995] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:31.747283] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-14T21:30:31.747507] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-14T21:30:31.748378] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-14T21:30:31.748442] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-14T21:30:31.960573] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-14T21:30:31.958735] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T21:30:32.169259] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:32.169759] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T21:30:32.758131] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-14T21:30:33.304321] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T21:30:33.558087] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-14T21:30:34.363149] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-14T21:30:34.378265] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T21:30:34.779680] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T21:30:34.917627] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T21:30:34.919267] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18299 records). [2025-10-14T21:30:34.919336] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-14T21:30:35.168449] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-14T21:30:35.289731] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-14T21:30:35.289812] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-14T21:30:35.290218] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-14T21:30:35.290255] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-14T21:30:35.290859] [DEBUG] [LOCAL ] SKLZ: Trimmed 18299 records to 11578 (keeping 200 days of data) [2025-10-14T21:30:35.355312] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11578 records). [2025-10-14T21:30:35.355441] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-14T21:30:35.355516] [INFO ] [MAIN ] Update Progress: 1923/2369 symbols completed. SKLZ took 30.8s. Estimated remaining: 1h 2m 45s. Rate: 7.1 symbols/min [2025-10-14T21:30:35.522009] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:35.538423] [DEBUG] [LOCAL ] SKYH: Loaded 16380 existing records from primary storage. [2025-10-14T21:30:35.538679] [INFO ] [MAIN ] SKYH: Loaded 16380 existing records. [2025-10-14T21:30:35.715851] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:35.716094] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-14T21:30:35.716148] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-14T21:30:35.716491] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-14T21:30:35.716546] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-14T21:30:35.969787] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-14T21:30:36.097326] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:36.734160] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T21:30:36.758059] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-14T21:30:37.417084] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T21:30:37.558024] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-14T21:30:37.932202] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T21:30:37.937488] [INFO ] [REMOTE ] SKE: Full fetch complete (51688 records). [2025-10-14T21:30:37.937574] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-14T21:30:38.308667] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-14T21:30:38.308747] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-14T21:30:38.309670] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-14T21:30:38.309730] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-14T21:30:38.310758] [DEBUG] [LOCAL ] SKE: Trimmed 51688 records to 36810 (keeping 200 days of data) [2025-10-14T21:30:38.365166] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-14T21:30:38.523381] [DEBUG] [LOCAL ] SKE: Primary data saved (36810 records). [2025-10-14T21:30:38.523592] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-14T21:30:38.523703] [INFO ] [MAIN ] Update Progress: 1924/2369 symbols completed. SKE took 34.0s. Estimated remaining: 1h 2m 35s. Rate: 7.1 symbols/min [2025-10-14T21:30:38.692981] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:38.740382] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-14T21:30:38.740735] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-14T21:30:38.918714] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:38.919182] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-14T21:30:38.919292] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-14T21:30:38.920537] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-14T21:30:38.920601] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-14T21:30:39.118386] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T21:30:39.191080] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-14T21:30:39.306905] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:30:39.793678] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T21:30:39.958045] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-14T21:30:40.205268] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:30:40.758138] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-14T21:30:41.410403] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T21:30:41.558065] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-14T21:30:42.087824] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T21:30:42.358110] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-14T21:30:43.104741] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T21:30:43.158046] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-14T21:30:43.599168] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T21:30:43.958095] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-14T21:30:44.644620] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T21:30:44.758072] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-14T21:30:45.558039] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-14T21:30:45.646760] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T21:30:46.043774] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-14T21:30:46.358049] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-14T21:30:46.999512] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T21:30:47.158111] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-14T21:30:47.964178] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-14T21:30:47.966815] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T21:30:48.141459] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T21:30:48.758084] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-14T21:30:49.490287] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T21:30:49.547630] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T21:30:49.558047] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-14T21:30:50.358054] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-14T21:30:50.866087] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T21:30:51.158072] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-14T21:30:51.718352] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:30:51.958091] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-14T21:30:52.157470] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T21:30:52.758157] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-14T21:30:53.558066] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-14T21:30:53.655737] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T21:30:54.331483] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T21:30:54.358022] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-14T21:30:54.505832] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T21:30:55.158097] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-14T21:30:55.572956] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-14T21:30:55.958093] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-14T21:30:56.758044] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-14T21:30:56.986723] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T21:30:57.503982] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T21:30:57.558061] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-14T21:30:57.769715] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:30:58.358074] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-14T21:30:58.664109] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T21:30:58.672719] [INFO ] [REMOTE ] SKT: Full fetch complete (60409 records). [2025-10-14T21:30:58.672923] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-14T21:30:59.068281] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-14T21:30:59.068375] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-14T21:30:59.069421] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-14T21:30:59.069486] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-14T21:30:59.070769] [DEBUG] [LOCAL ] SKT: Trimmed 60409 records to 42544 (keeping 200 days of data) [2025-10-14T21:30:59.169520] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-14T21:30:59.339151] [DEBUG] [LOCAL ] SKT: Primary data saved (42544 records). [2025-10-14T21:30:59.339275] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-14T21:30:59.339350] [INFO ] [MAIN ] Update Progress: 1925/2369 symbols completed. SKT took 32.7s. Estimated remaining: 1h 2m 29s. Rate: 7.1 symbols/min [2025-10-14T21:30:59.510463] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:30:59.546163] [DEBUG] [LOCAL ] SLF: Loaded 38799 existing records from primary storage. [2025-10-14T21:30:59.546431] [INFO ] [MAIN ] SLF: Loaded 38799 existing records. [2025-10-14T21:30:59.722268] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:30:59.722632] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-14T21:30:59.722723] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-14T21:30:59.724134] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-14T21:30:59.724195] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-14T21:30:59.963240] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-14T21:31:00.093858] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:00.506295] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-14T21:31:00.758083] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-14T21:31:01.081925] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T21:31:01.128266] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T21:31:01.558060] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-14T21:31:02.358073] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-14T21:31:02.665747] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T21:31:02.852550] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-14T21:31:03.107402] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T21:31:03.158071] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-14T21:31:03.958060] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-14T21:31:04.338460] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-14T21:31:04.343331] [INFO ] [REMOTE ] SKY: Full fetch complete (54196 records). [2025-10-14T21:31:04.343483] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-14T21:31:04.740776] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-14T21:31:04.740855] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-14T21:31:04.741834] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-14T21:31:04.741896] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-14T21:31:04.743144] [DEBUG] [LOCAL ] SKY: Trimmed 54196 records to 38409 (keeping 200 days of data) [2025-10-14T21:31:04.791503] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-14T21:31:04.968847] [DEBUG] [LOCAL ] SKY: Primary data saved (38409 records). [2025-10-14T21:31:04.968990] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-14T21:31:04.969068] [INFO ] [MAIN ] Update Progress: 1926/2369 symbols completed. SKY took 33.6s. Estimated remaining: 1h 2m 20s. Rate: 7.1 symbols/min [2025-10-14T21:31:05.140890] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:05.169876] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T21:31:05.211311] [DEBUG] [LOCAL ] SLG: Loaded 45377 existing records from primary storage. [2025-10-14T21:31:05.211624] [INFO ] [MAIN ] SLG: Loaded 45377 existing records. [2025-10-14T21:31:05.400289] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:31:05.400507] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-14T21:31:05.400557] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-14T21:31:05.401390] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-14T21:31:05.401449] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-14T21:31:05.563205] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-14T21:31:05.819066] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:06.358061] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-14T21:31:06.544530] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T21:31:06.779774] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-14T21:31:07.158098] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-14T21:31:07.713681] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:31:07.958083] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-14T21:31:08.758091] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-14T21:31:09.103154] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T21:31:09.331376] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T21:31:09.334929] [INFO ] [REMOTE ] SKYH: Full fetch complete (22463 records). [2025-10-14T21:31:09.335053] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-14T21:31:09.563419] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-14T21:31:09.791446] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T21:31:09.875076] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-14T21:31:09.875168] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-14T21:31:09.875773] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-14T21:31:09.875837] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-14T21:31:09.876695] [DEBUG] [LOCAL ] SKYH: Trimmed 22463 records to 16330 (keeping 200 days of data) [2025-10-14T21:31:09.977368] [DEBUG] [LOCAL ] SKYH: Primary data saved (16330 records). [2025-10-14T21:31:09.977513] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-14T21:31:09.977591] [INFO ] [MAIN ] Update Progress: 1927/2369 symbols completed. SKYH took 34.6s. Estimated remaining: 1h 2m 11s. Rate: 7.1 symbols/min [2025-10-14T21:31:10.169005] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:10.209191] [DEBUG] [LOCAL ] SLGN: Loaded 40749 existing records from primary storage. [2025-10-14T21:31:10.209518] [INFO ] [MAIN ] SLGN: Loaded 40749 existing records. [2025-10-14T21:31:10.363175] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-14T21:31:10.405458] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:31:10.406017] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-14T21:31:10.406073] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-14T21:31:10.406795] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-14T21:31:10.406853] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-14T21:31:10.763719] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:11.158057] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-14T21:31:11.254311] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T21:31:11.752238] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T21:31:11.958066] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-14T21:31:12.767861] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-14T21:31:12.773893] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:31:12.872509] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T21:31:13.558055] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-14T21:31:14.190116] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T21:31:14.358054] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-14T21:31:15.017026] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T21:31:15.158075] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-14T21:31:15.588674] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T21:31:15.958064] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-14T21:31:16.219860] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T21:31:16.758065] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-14T21:31:17.499574] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T21:31:17.558064] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-14T21:31:18.358043] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-14T21:31:18.751620] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T21:31:18.794951] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-14T21:31:19.158094] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-14T21:31:19.707930] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T21:31:19.958039] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-14T21:31:20.758092] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-14T21:31:20.998020] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-14T21:31:21.006671] [INFO ] [REMOTE ] SLB: Full fetch complete (77877 records). [2025-10-14T21:31:21.006836] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-14T21:31:21.420141] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-14T21:31:21.420344] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-14T21:31:21.421592] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-14T21:31:21.421724] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-14T21:31:21.444698] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T21:31:21.452497] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 53697 (keeping 200 days of data) [2025-10-14T21:31:21.573693] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-14T21:31:21.787881] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-14T21:31:21.788030] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-14T21:31:21.788121] [INFO ] [MAIN ] Update Progress: 1928/2369 symbols completed. SLB took 43.3s. Estimated remaining: 1h 2m 3s. Rate: 7.1 symbols/min [2025-10-14T21:31:21.964132] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:21.964502] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-14T21:31:21.964598] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-14T21:31:21.964756] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-14T21:31:21.964926] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-14T21:31:21.965066] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-14T21:31:21.965123] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-14T21:31:22.172323] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:31:22.363160] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-14T21:31:22.397215] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:23.158042] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-14T21:31:23.323976] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T21:31:23.498682] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-14T21:31:23.963169] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-14T21:31:23.979529] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T21:31:24.322553] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-14T21:31:24.758158] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-14T21:31:25.094576] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T21:31:25.558081] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-14T21:31:25.893313] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-14T21:31:26.358065] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-14T21:31:26.674827] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-14T21:31:27.158139] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-14T21:31:27.958099] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-14T21:31:28.308892] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T21:31:28.758039] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-14T21:31:28.798096] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T21:31:29.081588] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-14T21:31:29.558096] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-14T21:31:30.358069] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-14T21:31:31.112878] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T21:31:31.158041] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-14T21:31:31.886557] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T21:31:31.958065] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-14T21:31:32.522868] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T21:31:32.758098] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-14T21:31:33.240167] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-14T21:31:33.558095] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-14T21:31:33.880011] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-14T21:31:33.967499] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T21:31:33.972468] [INFO ] [REMOTE ] SLF: Full fetch complete (56314 records). [2025-10-14T21:31:33.972632] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-14T21:31:34.364688] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-14T21:31:34.365592] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-14T21:31:34.366915] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-14T21:31:34.368082] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-14T21:31:34.368283] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-14T21:31:34.369541] [DEBUG] [LOCAL ] SLF: Trimmed 56314 records to 38782 (keeping 200 days of data) [2025-10-14T21:31:34.603335] [DEBUG] [LOCAL ] SLF: Primary data saved (38782 records). [2025-10-14T21:31:34.603477] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-14T21:31:34.603553] [INFO ] [MAIN ] Update Progress: 1929/2369 symbols completed. SLF took 35.3s. Estimated remaining: 1h 1m 56s. Rate: 7.1 symbols/min [2025-10-14T21:31:34.775093] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:34.811809] [DEBUG] [LOCAL ] SLQT: Loaded 43529 existing records from primary storage. [2025-10-14T21:31:34.812104] [INFO ] [MAIN ] SLQT: Loaded 43529 existing records. [2025-10-14T21:31:34.990120] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:31:34.990366] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-14T21:31:34.990415] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-14T21:31:34.991082] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-14T21:31:34.991141] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-14T21:31:35.163374] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-14T21:31:35.346631] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:35.958122] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-14T21:31:36.117455] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T21:31:36.288863] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T21:31:36.315432] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-14T21:31:36.758093] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-14T21:31:37.558064] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-14T21:31:38.152049] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T21:31:38.358056] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-14T21:31:39.053604] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T21:31:39.158095] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-14T21:31:39.487516] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-14T21:31:39.871111] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:31:39.958082] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-14T21:31:40.197303] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-14T21:31:40.198040] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1037 records). [2025-10-14T21:31:40.198108] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-14T21:31:40.382427] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-14T21:31:40.382674] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:31:40.382737] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:31:40.382797] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-14T21:31:40.382853] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-14T21:31:40.382889] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-14T21:31:40.382929] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-14T21:31:40.382987] [INFO ] [MAIN ] Update Progress: 1930/2369 symbols completed. SLNZ took 18.6s. Estimated remaining: 1h 1m 47s. Rate: 7.1 symbols/min [2025-10-14T21:31:40.552021] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:40.579101] [DEBUG] [LOCAL ] SLVM: Loaded 27815 existing records from primary storage. [2025-10-14T21:31:40.579398] [INFO ] [MAIN ] SLVM: Loaded 27815 existing records. [2025-10-14T21:31:40.756921] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:31:40.757123] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-14T21:31:40.757171] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-14T21:31:40.757799] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-14T21:31:40.757872] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-14T21:31:40.763214] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-14T21:31:41.138349] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:41.558071] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-14T21:31:42.358111] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-14T21:31:42.448980] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T21:31:43.082623] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T21:31:43.158054] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-14T21:31:43.212092] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T21:31:43.958119] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-14T21:31:44.703443] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T21:31:44.764218] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-14T21:31:44.767518] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T21:31:45.558076] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-14T21:31:46.358068] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-14T21:31:46.405553] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T21:31:46.708735] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T21:31:47.158083] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-14T21:31:47.958112] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-14T21:31:48.033716] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T21:31:48.713109] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T21:31:48.758042] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-14T21:31:49.236778] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T21:31:49.242064] [INFO ] [REMOTE ] SLGN: Full fetch complete (59111 records). [2025-10-14T21:31:49.242215] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-14T21:31:49.563254] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-14T21:31:49.649807] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-14T21:31:49.649895] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-14T21:31:49.650934] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-14T21:31:49.650996] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-14T21:31:49.652234] [DEBUG] [LOCAL ] SLGN: Trimmed 59111 records to 40779 (keeping 200 days of data) [2025-10-14T21:31:49.899566] [DEBUG] [LOCAL ] SLGN: Primary data saved (40779 records). [2025-10-14T21:31:49.899721] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-14T21:31:49.899806] [INFO ] [MAIN ] Update Progress: 1931/2369 symbols completed. SLGN took 39.9s. Estimated remaining: 1h 1m 39s. Rate: 7.1 symbols/min [2025-10-14T21:31:50.084048] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:50.110703] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T21:31:50.162303] [DEBUG] [LOCAL ] SM: Loaded 52353 existing records from primary storage. [2025-10-14T21:31:50.162667] [INFO ] [MAIN ] SM: Loaded 52353 existing records. [2025-10-14T21:31:50.366669] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-14T21:31:50.371632] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:31:50.372777] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-14T21:31:50.372830] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-14T21:31:50.373847] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-14T21:31:50.373905] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-14T21:31:50.752995] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:51.046043] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T21:31:51.158049] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-14T21:31:51.958033] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-14T21:31:52.062400] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T21:31:52.397925] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T21:31:52.758058] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-14T21:31:53.538952] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T21:31:53.558093] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-14T21:31:54.363193] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-14T21:31:54.380736] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T21:31:55.158062] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-14T21:31:55.297871] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T21:31:55.962573] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-14T21:31:55.969469] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T21:31:55.975220] [INFO ] [REMOTE ] SLG: Full fetch complete (65047 records). [2025-10-14T21:31:55.975361] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-14T21:31:56.391634] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-14T21:31:56.391804] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-14T21:31:56.393389] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-14T21:31:56.393607] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-14T21:31:56.395180] [DEBUG] [LOCAL ] SLG: Trimmed 65047 records to 45469 (keeping 200 days of data) [2025-10-14T21:31:56.710089] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T21:31:56.736795] [DEBUG] [LOCAL ] SLG: Primary data saved (45469 records). [2025-10-14T21:31:56.737119] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-14T21:31:56.737212] [INFO ] [MAIN ] Update Progress: 1932/2369 symbols completed. SLG took 51.8s. Estimated remaining: 1h 1m 30s. Rate: 7.1 symbols/min [2025-10-14T21:31:56.769679] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-14T21:31:56.910169] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:31:56.910372] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-14T21:31:56.910410] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-14T21:31:56.910523] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-14T21:31:56.910563] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-14T21:31:56.910603] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-14T21:31:56.910635] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-14T21:31:57.271883] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:31:57.289142] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-14T21:31:57.558066] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-14T21:31:58.363171] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-14T21:31:58.381861] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T21:31:58.698367] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T21:31:59.158114] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-14T21:31:59.933496] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T21:31:59.958092] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-14T21:32:00.498447] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T21:32:00.758112] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-14T21:32:01.558080] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-14T21:32:01.596308] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T21:32:02.103775] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T21:32:02.358109] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-14T21:32:03.158089] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-14T21:32:03.316712] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:32:03.526133] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:32:03.526463] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-14T21:32:03.526550] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:32:03.526599] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-14T21:32:03.526681] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:32:03.526753] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-14T21:32:03.526837] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-14T21:32:03.526890] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-14T21:32:03.526946] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-14T21:32:03.527012] [INFO ] [MAIN ] Update Progress: 1933/2369 symbols completed. SMA took 6.8s. Estimated remaining: 1h 1m 21s. Rate: 7.1 symbols/min [2025-10-14T21:32:03.713679] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:03.711540] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T21:32:03.728129] [DEBUG] [LOCAL ] SMBK: Loaded 8199 existing records from primary storage. [2025-10-14T21:32:03.728330] [INFO ] [MAIN ] SMBK: Loaded 8199 existing records. [2025-10-14T21:32:03.902589] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:03.902777] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-14T21:32:03.902825] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-14T21:32:03.903083] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-14T21:32:03.903148] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-14T21:32:03.963916] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-14T21:32:04.261826] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:04.758096] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-14T21:32:05.474265] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T21:32:05.558048] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-14T21:32:06.358061] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-14T21:32:06.610630] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T21:32:06.854092] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T21:32:06.859470] [INFO ] [REMOTE ] SLQT: Full fetch complete (63890 records). [2025-10-14T21:32:06.859612] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-14T21:32:07.170425] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T21:32:07.169247] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-14T21:32:07.263824] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-14T21:32:07.263901] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-14T21:32:07.264972] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-14T21:32:07.265035] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-14T21:32:07.266202] [DEBUG] [LOCAL ] SLQT: Trimmed 63890 records to 43549 (keeping 200 days of data) [2025-10-14T21:32:07.499731] [DEBUG] [LOCAL ] SLQT: Primary data saved (43549 records). [2025-10-14T21:32:07.499853] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-14T21:32:07.499926] [INFO ] [MAIN ] Update Progress: 1934/2369 symbols completed. SLQT took 32.9s. Estimated remaining: 1h 1m 12s. Rate: 7.1 symbols/min [2025-10-14T21:32:07.703610] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:07.715879] [DEBUG] [LOCAL ] SMC: Loaded 11265 existing records from primary storage. [2025-10-14T21:32:07.716139] [INFO ] [MAIN ] SMC: Loaded 11265 existing records. [2025-10-14T21:32:07.892977] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:07.893195] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-14T21:32:07.893241] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-14T21:32:07.893509] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-14T21:32:07.893564] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-14T21:32:07.958837] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-14T21:32:08.252365] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:08.344232] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T21:32:08.347885] [INFO ] [REMOTE ] SLVM: Full fetch complete (40111 records). [2025-10-14T21:32:08.347990] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-14T21:32:08.726921] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-14T21:32:08.726995] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-14T21:32:08.727795] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-14T21:32:08.727856] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-14T21:32:08.728773] [DEBUG] [LOCAL ] SLVM: Trimmed 40111 records to 27784 (keeping 200 days of data) [2025-10-14T21:32:08.780841] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-14T21:32:08.900591] [DEBUG] [LOCAL ] SLVM: Primary data saved (27784 records). [2025-10-14T21:32:08.900758] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-14T21:32:08.900845] [INFO ] [MAIN ] Update Progress: 1935/2369 symbols completed. SLVM took 28.5s. Estimated remaining: 1h 1m 2s. Rate: 7.1 symbols/min [2025-10-14T21:32:09.075942] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:09.118934] [DEBUG] [LOCAL ] SMFG: Loaded 48271 existing records from primary storage. [2025-10-14T21:32:09.119244] [INFO ] [MAIN ] SMFG: Loaded 48271 existing records. [2025-10-14T21:32:09.306461] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:09.306726] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-14T21:32:09.306781] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-14T21:32:09.307672] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-14T21:32:09.307775] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-14T21:32:09.593569] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-14T21:32:09.654257] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T21:32:09.681619] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:09.833748] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T21:32:10.358088] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-14T21:32:10.440092] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T21:32:11.158089] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-14T21:32:11.958094] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-14T21:32:11.967477] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T21:32:12.139210] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T21:32:12.589853] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-14T21:32:12.758066] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-14T21:32:13.512210] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T21:32:13.558081] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-14T21:32:14.358145] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-14T21:32:15.158163] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-14T21:32:15.211280] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T21:32:15.958110] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-14T21:32:15.969220] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T21:32:16.135222] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T21:32:16.728169] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T21:32:16.758035] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-14T21:32:17.510505] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T21:32:17.558061] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-14T21:32:18.358132] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-14T21:32:19.101740] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T21:32:19.158088] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-14T21:32:19.308862] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T21:32:19.958054] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-14T21:32:20.722988] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T21:32:20.758058] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-14T21:32:20.767269] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T21:32:21.305151] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T21:32:21.558046] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-14T21:32:22.354166] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T21:32:22.358025] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-14T21:32:23.122149] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T21:32:23.158054] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-14T21:32:23.791273] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T21:32:23.792760] [INFO ] [REMOTE ] SMBK: Full fetch complete (11799 records). [2025-10-14T21:32:23.792826] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-14T21:32:23.966744] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-14T21:32:24.157925] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-14T21:32:24.158004] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-14T21:32:24.158267] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-14T21:32:24.158306] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-14T21:32:24.158764] [DEBUG] [LOCAL ] SMBK: Trimmed 11799 records to 8212 (keeping 200 days of data) [2025-10-14T21:32:24.208352] [DEBUG] [LOCAL ] SMBK: Primary data saved (8212 records). [2025-10-14T21:32:24.208477] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-14T21:32:24.208554] [INFO ] [MAIN ] Update Progress: 1936/2369 symbols completed. SMBK took 20.7s. Estimated remaining: 1h 0m 55s. Rate: 7.1 symbols/min [2025-10-14T21:32:24.384946] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:24.424232] [DEBUG] [LOCAL ] SMG: Loaded 43439 existing records from primary storage. [2025-10-14T21:32:24.424515] [INFO ] [MAIN ] SMG: Loaded 43439 existing records. [2025-10-14T21:32:24.599314] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:24.599502] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-14T21:32:24.599548] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-14T21:32:24.600299] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-14T21:32:24.600357] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-14T21:32:24.771585] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-14T21:32:24.956016] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:25.558083] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-14T21:32:25.815261] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T21:32:26.363150] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-14T21:32:26.376887] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T21:32:26.818032] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T21:32:27.158099] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-14T21:32:27.958074] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-14T21:32:28.026082] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-14T21:32:28.032248] [INFO ] [REMOTE ] SM: Full fetch complete (75785 records). [2025-10-14T21:32:28.032367] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-14T21:32:28.145580] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T21:32:28.436035] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-14T21:32:28.436111] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-14T21:32:28.437257] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-14T21:32:28.437322] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-14T21:32:28.438797] [DEBUG] [LOCAL ] SM: Trimmed 75785 records to 52369 (keeping 200 days of data) [2025-10-14T21:32:28.750715] [DEBUG] [LOCAL ] SM: Primary data saved (52369 records). [2025-10-14T21:32:28.750852] [INFO ] [MAIN ] SM: Full history saved. [2025-10-14T21:32:28.750934] [INFO ] [MAIN ] Update Progress: 1937/2369 symbols completed. SM took 38.9s. Estimated remaining: 1h 0m 45s. Rate: 7.1 symbols/min [2025-10-14T21:32:28.763377] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-14T21:32:28.922971] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:28.936136] [DEBUG] [LOCAL ] SMHI: Loaded 13126 existing records from primary storage. [2025-10-14T21:32:28.936518] [INFO ] [MAIN ] SMHI: Loaded 13126 existing records. [2025-10-14T21:32:29.115303] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:29.115680] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-14T21:32:29.115752] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-14T21:32:29.116041] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-14T21:32:29.116095] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-14T21:32:29.219841] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T21:32:29.500097] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:29.558029] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-14T21:32:30.358068] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-14T21:32:30.515048] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T21:32:30.576975] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-14T21:32:31.095585] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-14T21:32:31.158089] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-14T21:32:31.958057] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-14T21:32:32.168677] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T21:32:32.758118] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-14T21:32:33.558045] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-14T21:32:33.784484] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T21:32:33.803184] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T21:32:34.358072] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-14T21:32:35.036733] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T21:32:35.158100] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-14T21:32:35.958041] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-14T21:32:36.054347] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T21:32:36.544220] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T21:32:36.738071] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T21:32:36.758059] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-14T21:32:37.521528] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T21:32:37.558052] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-14T21:32:38.358077] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-14T21:32:38.540960] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T21:32:39.158105] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-14T21:32:39.958052] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-14T21:32:40.326159] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T21:32:40.353058] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-14T21:32:40.758097] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-14T21:32:41.562592] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-14T21:32:41.565678] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T21:32:41.582936] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-14T21:32:42.358057] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-14T21:32:43.158080] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-14T21:32:43.196188] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T21:32:43.299259] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-14T21:32:43.651076] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T21:32:43.958062] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-14T21:32:44.758065] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-14T21:32:45.558053] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-14T21:32:45.593152] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T21:32:46.302885] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:32:46.304582] [INFO ] [REMOTE ] SMC: Full fetch complete (16583 records). [2025-10-14T21:32:46.304687] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-14T21:32:46.368022] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-14T21:32:46.693350] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-14T21:32:46.708547] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-14T21:32:46.722719] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-14T21:32:46.724827] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-14T21:32:46.723456] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-14T21:32:46.736237] [DEBUG] [LOCAL ] SMC: Trimmed 16583 records to 11268 (keeping 200 days of data) [2025-10-14T21:32:46.800517] [DEBUG] [LOCAL ] SMC: Primary data saved (11268 records). [2025-10-14T21:32:46.800676] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-14T21:32:46.800782] [INFO ] [MAIN ] Update Progress: 1938/2369 symbols completed. SMC took 39.3s. Estimated remaining: 1h 0m 39s. Rate: 7.1 symbols/min [2025-10-14T21:32:46.966780] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:46.984203] [DEBUG] [LOCAL ] SMP: Loaded 18967 existing records from primary storage. [2025-10-14T21:32:46.984431] [INFO ] [MAIN ] SMP: Loaded 18967 existing records. [2025-10-14T21:32:47.163605] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-14T21:32:47.169020] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:47.169291] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-14T21:32:47.170101] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-14T21:32:47.170696] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-14T21:32:47.170768] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-14T21:32:47.537941] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:47.958035] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-14T21:32:48.047619] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T21:32:48.099718] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T21:32:48.758135] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-14T21:32:48.878450] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T21:32:49.558068] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-14T21:32:50.365083] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-14T21:32:50.380775] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:32:50.423035] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T21:32:50.962159] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T21:32:51.158064] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-14T21:32:51.958092] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-14T21:32:52.094894] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T21:32:52.758095] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-14T21:32:53.328536] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T21:32:53.558106] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-14T21:32:54.358042] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-14T21:32:54.367817] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T21:32:54.423425] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:32:55.158129] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-14T21:32:55.721199] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T21:32:55.726410] [INFO ] [REMOTE ] SMG: Full fetch complete (62925 records). [2025-10-14T21:32:55.726610] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-14T21:32:55.960903] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-14T21:32:56.054179] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T21:32:56.259671] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-14T21:32:56.259806] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-14T21:32:56.260982] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-14T21:32:56.261044] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-14T21:32:56.262342] [DEBUG] [LOCAL ] SMG: Trimmed 62925 records to 43417 (keeping 200 days of data) [2025-10-14T21:32:56.537183] [DEBUG] [LOCAL ] SMG: Primary data saved (43417 records). [2025-10-14T21:32:56.537308] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-14T21:32:56.537386] [INFO ] [MAIN ] Update Progress: 1939/2369 symbols completed. SMG took 32.3s. Estimated remaining: 1h 0m 31s. Rate: 7.1 symbols/min [2025-10-14T21:32:56.731134] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:56.758135] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-14T21:32:56.780100] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-14T21:32:56.780429] [INFO ] [MAIN ] SMR: Loaded 53799 existing records. [2025-10-14T21:32:56.962144] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:56.962371] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-14T21:32:56.962441] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-14T21:32:56.963335] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-14T21:32:56.963392] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-14T21:32:57.332980] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:57.558112] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-14T21:32:57.680586] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T21:32:57.682231] [INFO ] [REMOTE ] SMHI: Full fetch complete (21941 records). [2025-10-14T21:32:57.682302] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-14T21:32:57.886512] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T21:32:58.089028] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-14T21:32:58.089099] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-14T21:32:58.089525] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-14T21:32:58.089563] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-14T21:32:58.090149] [DEBUG] [LOCAL ] SMHI: Trimmed 21941 records to 13133 (keeping 200 days of data) [2025-10-14T21:32:58.161189] [DEBUG] [LOCAL ] SMHI: Primary data saved (13133 records). [2025-10-14T21:32:58.161315] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-14T21:32:58.161391] [INFO ] [MAIN ] Update Progress: 1940/2369 symbols completed. SMHI took 29.4s. Estimated remaining: 1h 0m 21s. Rate: 7.1 symbols/min [2025-10-14T21:32:58.330976] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:32:58.367115] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-14T21:32:58.369856] [DEBUG] [LOCAL ] SMRT: Loaded 43964 existing records from primary storage. [2025-10-14T21:32:58.370134] [INFO ] [MAIN ] SMRT: Loaded 43964 existing records. [2025-10-14T21:32:58.549129] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:32:58.549406] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-14T21:32:58.549459] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-14T21:32:58.550232] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-14T21:32:58.550289] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-14T21:32:58.843128] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T21:32:58.923192] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:32:59.158053] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-14T21:32:59.958112] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-14T21:33:00.674795] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T21:33:00.758026] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-14T21:33:01.063717] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-14T21:33:01.089011] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T21:33:01.558061] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-14T21:33:01.838291] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:33:02.358055] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-14T21:33:03.158055] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-14T21:33:03.645901] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T21:33:03.651327] [INFO ] [REMOTE ] SMFG: Full fetch complete (69304 records). [2025-10-14T21:33:03.651448] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-14T21:33:03.960249] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-14T21:33:04.072114] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-14T21:33:04.072219] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-14T21:33:04.073348] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-14T21:33:04.073531] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-14T21:33:04.075155] [DEBUG] [LOCAL ] SMFG: Trimmed 69304 records to 48339 (keeping 200 days of data) [2025-10-14T21:33:04.192543] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-14T21:33:04.260408] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T21:33:04.434312] [DEBUG] [LOCAL ] SMFG: Primary data saved (48339 records). [2025-10-14T21:33:04.434440] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-14T21:33:04.434519] [INFO ] [MAIN ] Update Progress: 1941/2369 symbols completed. SMFG took 55.5s. Estimated remaining: 1h 0m 12s. Rate: 7.1 symbols/min [2025-10-14T21:33:04.604243] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:04.632633] [DEBUG] [LOCAL ] SMWB: Loaded 32262 existing records from primary storage. [2025-10-14T21:33:04.632945] [INFO ] [MAIN ] SMWB: Loaded 32262 existing records. [2025-10-14T21:33:04.773732] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-14T21:33:04.816188] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:04.816706] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-14T21:33:04.816792] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-14T21:33:04.817396] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-14T21:33:04.817454] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-14T21:33:05.230440] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:05.217399] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T21:33:05.558063] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-14T21:33:06.344764] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T21:33:06.358029] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-14T21:33:06.822082] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T21:33:07.158081] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-14T21:33:07.833511] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T21:33:07.958065] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-14T21:33:08.758064] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-14T21:33:09.522352] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-14T21:33:09.558026] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-14T21:33:09.674459] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-14T21:33:10.122065] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:33:10.358090] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-14T21:33:10.737042] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T21:33:11.030961] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T21:33:11.158143] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-14T21:33:11.958121] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-14T21:33:12.570837] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T21:33:12.758043] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-14T21:33:12.832755] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T21:33:13.558093] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-14T21:33:14.112461] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T21:33:14.358058] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-14T21:33:15.158071] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-14T21:33:15.383061] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T21:33:15.958079] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-14T21:33:16.159859] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-14T21:33:16.251060] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T21:33:16.579963] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T21:33:16.758046] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-14T21:33:17.558046] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-14T21:33:18.358065] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-14T21:33:18.869862] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T21:33:19.158101] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-14T21:33:19.278108] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-14T21:33:19.277878] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-14T21:33:19.290945] [INFO ] [REMOTE ] SMP: Full fetch complete (26295 records). [2025-10-14T21:33:19.291297] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-14T21:33:19.659334] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-14T21:33:19.659416] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-14T21:33:19.660031] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-14T21:33:19.660093] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-14T21:33:19.660774] [DEBUG] [LOCAL ] SMP: Trimmed 26295 records to 18889 (keeping 200 days of data) [2025-10-14T21:33:19.771798] [DEBUG] [LOCAL ] SMP: Primary data saved (18889 records). [2025-10-14T21:33:19.771927] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-14T21:33:19.772004] [INFO ] [MAIN ] Update Progress: 1942/2369 symbols completed. SMP took 33.0s. Estimated remaining: 1h 0m 5s. Rate: 7.1 symbols/min [2025-10-14T21:33:19.946338] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:19.958130] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-14T21:33:19.990005] [DEBUG] [LOCAL ] SN: Loaded 50003 existing records from primary storage. [2025-10-14T21:33:19.990336] [INFO ] [MAIN ] SN: Loaded 50003 existing records. [2025-10-14T21:33:20.176722] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:20.176927] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-14T21:33:20.176973] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-14T21:33:20.177965] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-14T21:33:20.178026] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-14T21:33:20.544243] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:20.579138] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T21:33:20.758068] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-14T21:33:21.558110] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-14T21:33:22.216577] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T21:33:22.358109] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-14T21:33:22.406781] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-14T21:33:22.644186] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T21:33:23.158128] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-14T21:33:23.264851] [DEBUG] [REMOTE ] SMWB: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-14T21:33:23.265338] [WARN ] [REMOTE ] SMWB: No data returned for month 2025-07 [2025-10-14T21:33:23.265442] [FATAL] [REMOTE ] SMWB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:33:23.265543] [FATAL] [MAIN ] SMWB: Failed to fetch primary data. [2025-10-14T21:33:23.265611] [WARN ] [MAIN ] SMWB: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:33:23.265717] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-14T21:33:23.265790] [DEBUG] [LOCAL ] SMWB: No primary data file found to delete. [2025-10-14T21:33:23.265829] [INFO ] [LOCAL ] SMWB: Starting deletion of derivative data. [2025-10-14T21:33:23.266105] [DEBUG] [LOCAL ] SMWB: Deleted derivative data file. [2025-10-14T21:33:23.266202] [INFO ] [MAIN ] Update Progress: 1943/2369 symbols completed. SMWB took 18.8s. Estimated remaining: 59m 56s. Rate: 7.1 symbols/min [2025-10-14T21:33:23.442116] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:23.466462] [DEBUG] [LOCAL ] SNA: Loaded 25749 existing records from primary storage. [2025-10-14T21:33:23.466754] [INFO ] [MAIN ] SNA: Loaded 25749 existing records. [2025-10-14T21:33:23.650146] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:23.650452] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-14T21:33:23.650587] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-14T21:33:23.651283] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-14T21:33:23.651395] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-14T21:33:23.833515] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T21:33:23.963189] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-14T21:33:24.055053] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:24.758141] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-14T21:33:25.558102] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-14T21:33:26.193089] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-14T21:33:26.266021] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:33:26.358045] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-14T21:33:27.054159] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T21:33:27.158075] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-14T21:33:27.958076] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-14T21:33:28.377228] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T21:33:28.758071] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-14T21:33:29.281101] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-14T21:33:29.306738] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T21:33:29.311562] [INFO ] [REMOTE ] SMRT: Full fetch complete (62169 records). [2025-10-14T21:33:29.311724] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-14T21:33:29.563293] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-14T21:33:29.693885] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-14T21:33:29.693961] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-14T21:33:29.695012] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-14T21:33:29.695073] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-14T21:33:29.696227] [DEBUG] [LOCAL ] SMRT: Trimmed 62169 records to 43957 (keeping 200 days of data) [2025-10-14T21:33:29.943102] [DEBUG] [LOCAL ] SMRT: Primary data saved (43957 records). [2025-10-14T21:33:29.943228] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-14T21:33:29.943306] [INFO ] [MAIN ] Update Progress: 1944/2369 symbols completed. SMRT took 31.8s. Estimated remaining: 59m 47s. Rate: 7.1 symbols/min [2025-10-14T21:33:30.117981] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:30.165565] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-14T21:33:30.165951] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-14T21:33:30.317214] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T21:33:30.382435] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:30.377262] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-14T21:33:30.383594] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-14T21:33:30.384541] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-14T21:33:30.385443] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-14T21:33:30.385504] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-14T21:33:30.736260] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:31.163208] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-14T21:33:31.175859] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T21:33:31.958125] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-14T21:33:32.581409] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T21:33:32.758101] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-14T21:33:33.165454] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-14T21:33:33.169613] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T21:33:33.558078] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-14T21:33:34.358114] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-14T21:33:34.873413] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-14T21:33:35.158064] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-14T21:33:35.968009] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-14T21:33:35.988689] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-14T21:33:36.206425] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T21:33:36.388422] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T21:33:36.758063] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-14T21:33:37.558061] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-14T21:33:38.341260] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-14T21:33:38.358038] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-14T21:33:38.533624] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T21:33:38.652341] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-14T21:33:39.158088] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-14T21:33:39.958127] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-14T21:33:40.329167] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T21:33:40.553401] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-14T21:33:40.559874] [INFO ] [REMOTE ] SMR: Full fetch complete (77977 records). [2025-10-14T21:33:40.560062] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-14T21:33:40.766721] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-14T21:33:40.980930] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-14T21:33:40.981006] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-14T21:33:40.982291] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-14T21:33:40.982356] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-14T21:33:40.983942] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 53799 (keeping 200 days of data) [2025-10-14T21:33:41.321872] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T21:33:41.348189] [DEBUG] [LOCAL ] SMR: Primary data saved (53799 records). [2025-10-14T21:33:41.348331] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-14T21:33:41.348411] [INFO ] [MAIN ] Update Progress: 1945/2369 symbols completed. SMR took 44.8s. Estimated remaining: 59m 39s. Rate: 7.1 symbols/min [2025-10-14T21:33:41.521055] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:41.526560] [DEBUG] [LOCAL ] SNDA: Loaded 4448 existing records from primary storage. [2025-10-14T21:33:41.526746] [INFO ] [MAIN ] SNDA: Loaded 4448 existing records. [2025-10-14T21:33:41.563150] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-14T21:33:41.709828] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:41.710013] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-14T21:33:41.710060] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-14T21:33:41.710234] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-14T21:33:41.710273] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-14T21:33:42.072141] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:42.358031] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-14T21:33:42.727126] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T21:33:42.941766] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-14T21:33:43.158050] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-14T21:33:43.244106] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:33:43.958057] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-14T21:33:44.227061] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T21:33:44.758059] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-14T21:33:45.558067] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-14T21:33:45.810509] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-14T21:33:45.856929] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T21:33:46.315127] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T21:33:46.358031] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-14T21:33:47.158060] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-14T21:33:47.958056] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-14T21:33:48.119754] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T21:33:48.341440] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-14T21:33:48.397966] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-14T21:33:48.758114] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-14T21:33:49.381466] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T21:33:49.558085] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-14T21:33:50.358120] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-14T21:33:51.158048] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-14T21:33:51.392171] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T21:33:51.395238] [INFO ] [REMOTE ] SNA: Full fetch complete (38768 records). [2025-10-14T21:33:51.395323] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-14T21:33:51.774476] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-14T21:33:51.774670] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-14T21:33:51.775504] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-14T21:33:51.775582] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-14T21:33:51.803820] [DEBUG] [LOCAL ] SNA: Trimmed 38768 records to 25723 (keeping 200 days of data) [2025-10-14T21:33:51.806095] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-14T21:33:51.961815] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-14T21:33:51.972791] [DEBUG] [LOCAL ] SNA: Primary data saved (25723 records). [2025-10-14T21:33:51.972874] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-14T21:33:51.972945] [INFO ] [MAIN ] Update Progress: 1946/2369 symbols completed. SNA took 28.7s. Estimated remaining: 59m 31s. Rate: 7.1 symbols/min [2025-10-14T21:33:52.138805] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:52.174132] [DEBUG] [LOCAL ] SNDR: Loaded 41435 existing records from primary storage. [2025-10-14T21:33:52.174404] [INFO ] [MAIN ] SNDR: Loaded 41435 existing records. [2025-10-14T21:33:52.356764] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:52.357018] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-14T21:33:52.357072] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-14T21:33:52.357871] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-14T21:33:52.357927] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-14T21:33:52.713730] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:52.745430] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T21:33:52.758027] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-14T21:33:53.558058] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-14T21:33:54.180340] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-14T21:33:54.205459] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T21:33:54.214758] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-14T21:33:54.217443] [INFO ] [REMOTE ] SN: Full fetch complete (71430 records). [2025-10-14T21:33:54.217548] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-14T21:33:54.365678] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-14T21:33:54.604836] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-14T21:33:54.604921] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-14T21:33:54.606020] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-14T21:33:54.606081] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-14T21:33:54.607468] [DEBUG] [LOCAL ] SN: Trimmed 71430 records to 49980 (keeping 200 days of data) [2025-10-14T21:33:54.895661] [DEBUG] [LOCAL ] SN: Primary data saved (49980 records). [2025-10-14T21:33:54.895788] [INFO ] [MAIN ] SN: Full history saved. [2025-10-14T21:33:54.895862] [INFO ] [MAIN ] Update Progress: 1947/2369 symbols completed. SN took 35.1s. Estimated remaining: 59m 21s. Rate: 7.1 symbols/min [2025-10-14T21:33:55.061546] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:33:55.098792] [DEBUG] [LOCAL ] SNN: Loaded 44305 existing records from primary storage. [2025-10-14T21:33:55.099074] [INFO ] [MAIN ] SNN: Loaded 44305 existing records. [2025-10-14T21:33:55.163233] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-14T21:33:55.279059] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:33:55.279251] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-14T21:33:55.279304] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-14T21:33:55.280358] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-14T21:33:55.280416] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-14T21:33:55.628069] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:33:55.861307] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T21:33:55.958058] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-14T21:33:56.758042] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-14T21:33:57.308686] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-14T21:33:57.364369] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T21:33:57.520787] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T21:33:57.558021] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-14T21:33:58.126193] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T21:33:58.358056] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-14T21:33:58.944795] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T21:33:59.158067] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-14T21:33:59.958070] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-14T21:34:00.758129] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-14T21:34:01.196493] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-14T21:34:01.558124] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-14T21:34:01.580691] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T21:34:02.358068] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-14T21:34:03.158064] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-14T21:34:03.484575] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-14T21:34:03.607053] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-14T21:34:03.724883] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T21:34:03.801607] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-14T21:34:03.958080] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-14T21:34:04.675916] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-14T21:34:04.758108] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-14T21:34:05.558061] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-14T21:34:06.344298] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-14T21:34:06.358031] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-14T21:34:06.856983] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T21:34:06.858456] [INFO ] [REMOTE ] SNDA: Full fetch complete (7665 records). [2025-10-14T21:34:06.858541] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-14T21:34:07.163214] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-14T21:34:07.247299] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-14T21:34:07.247534] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-14T21:34:07.247818] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-14T21:34:07.247914] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-14T21:34:07.248803] [DEBUG] [LOCAL ] SNDA: Trimmed 7665 records to 4467 (keeping 200 days of data) [2025-10-14T21:34:07.299027] [DEBUG] [LOCAL ] SNDA: Primary data saved (4467 records). [2025-10-14T21:34:07.300460] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T21:34:07.299486] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-14T21:34:07.300607] [INFO ] [MAIN ] Update Progress: 1948/2369 symbols completed. SNDA took 26.0s. Estimated remaining: 59m 14s. Rate: 7.1 symbols/min [2025-10-14T21:34:07.478906] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:07.527572] [DEBUG] [LOCAL ] SNOW: Loaded 53594 existing records from primary storage. [2025-10-14T21:34:07.527911] [INFO ] [MAIN ] SNOW: Loaded 53594 existing records. [2025-10-14T21:34:07.701201] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:07.701367] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-14T21:34:07.701413] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-14T21:34:07.702486] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-14T21:34:07.702544] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-14T21:34:07.968109] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-14T21:34:08.061722] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:08.715123] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T21:34:08.758034] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-14T21:34:09.520440] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T21:34:09.558031] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-14T21:34:10.358083] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-14T21:34:11.100017] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T21:34:11.158023] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-14T21:34:11.238350] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-14T21:34:11.958138] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-14T21:34:12.499150] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-14T21:34:12.709766] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T21:34:12.758024] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-14T21:34:13.558084] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-14T21:34:13.606506] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T21:34:14.287340] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T21:34:14.358063] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-14T21:34:15.158088] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-14T21:34:15.958044] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-14T21:34:16.001431] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T21:34:16.127335] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-14T21:34:16.758109] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-14T21:34:17.309397] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T21:34:17.509735] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-14T21:34:17.558024] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-14T21:34:18.358037] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-14T21:34:18.778323] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-14T21:34:18.784569] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-14T21:34:18.784760] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-14T21:34:19.163189] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-14T21:34:19.217591] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-14T21:34:19.217763] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-14T21:34:19.218929] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-14T21:34:19.218990] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-14T21:34:19.220387] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 53796 (keeping 200 days of data) [2025-10-14T21:34:19.549140] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-14T21:34:19.549401] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-14T21:34:19.549516] [INFO ] [MAIN ] Update Progress: 1949/2369 symbols completed. SNAP took 49.6s. Estimated remaining: 59m 6s. Rate: 7.1 symbols/min [2025-10-14T21:34:19.735420] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:19.790718] [DEBUG] [LOCAL ] SNV: Loaded 48968 existing records from primary storage. [2025-10-14T21:34:19.791103] [INFO ] [MAIN ] SNV: Loaded 48968 existing records. [2025-10-14T21:34:19.984413] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T21:34:20.013772] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:20.014492] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-14T21:34:20.014552] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-14T21:34:20.014770] [INFO ] [REMOTE ] SNDR: Full fetch complete (59875 records). [2025-10-14T21:34:20.026762] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-14T21:34:20.045380] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-14T21:34:20.045728] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-14T21:34:20.095884] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-14T21:34:20.236985] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-14T21:34:20.883400] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:20.905979] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-14T21:34:20.923368] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-14T21:34:20.923478] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-14T21:34:20.924976] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-14T21:34:20.925056] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-14T21:34:20.926958] [DEBUG] [LOCAL ] SNDR: Trimmed 59875 records to 41514 (keeping 200 days of data) [2025-10-14T21:34:20.955885] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-14T21:34:21.235099] [DEBUG] [LOCAL ] SNDR: Primary data saved (41514 records). [2025-10-14T21:34:21.235369] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-14T21:34:21.235473] [INFO ] [MAIN ] Update Progress: 1950/2369 symbols completed. SNDR took 29.3s. Estimated remaining: 58m 56s. Rate: 7.1 symbols/min [2025-10-14T21:34:21.402313] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:21.439838] [DEBUG] [LOCAL ] SNX: Loaded 39704 existing records from primary storage. [2025-10-14T21:34:21.440137] [INFO ] [MAIN ] SNX: Loaded 39704 existing records. [2025-10-14T21:34:21.563369] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-14T21:34:21.631204] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:21.631508] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-14T21:34:21.631557] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-14T21:34:21.632513] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-14T21:34:21.632584] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-14T21:34:22.056254] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:22.094476] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T21:34:22.358146] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-14T21:34:22.748316] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T21:34:22.785372] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T21:34:23.158140] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-14T21:34:23.821010] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T21:34:23.958073] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-14T21:34:24.609986] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-14T21:34:24.758076] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-14T21:34:25.558047] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-14T21:34:25.717167] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T21:34:26.329282] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:34:26.358030] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-14T21:34:27.158054] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-14T21:34:27.779480] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T21:34:27.817324] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-14T21:34:27.958053] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-14T21:34:28.535999] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T21:34:28.758052] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-14T21:34:29.564093] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-14T21:34:29.580843] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:34:30.358088] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-14T21:34:30.401675] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:34:31.158063] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-14T21:34:31.919617] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-14T21:34:31.958027] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-14T21:34:32.003879] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T21:34:32.758104] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-14T21:34:32.862735] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T21:34:33.558058] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-14T21:34:34.149519] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-14T21:34:34.358054] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-14T21:34:34.393734] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T21:34:34.867387] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T21:34:35.158076] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-14T21:34:35.958055] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-14T21:34:36.478867] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T21:34:36.758064] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-14T21:34:36.884525] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T21:34:37.349251] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T21:34:37.354130] [INFO ] [REMOTE ] SNN: Full fetch complete (63189 records). [2025-10-14T21:34:37.354251] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-14T21:34:37.563180] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-14T21:34:37.733161] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-14T21:34:37.733237] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-14T21:34:37.734278] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-14T21:34:37.734338] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-14T21:34:37.735534] [DEBUG] [LOCAL ] SNN: Trimmed 63189 records to 44352 (keeping 200 days of data) [2025-10-14T21:34:38.004731] [DEBUG] [LOCAL ] SNN: Primary data saved (44352 records). [2025-10-14T21:34:38.005002] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-14T21:34:38.005125] [INFO ] [MAIN ] Update Progress: 1951/2369 symbols completed. SNN took 43.1s. Estimated remaining: 58m 50s. Rate: 7.1 symbols/min [2025-10-14T21:34:38.198713] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:38.201124] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T21:34:38.253863] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-14T21:34:38.254175] [INFO ] [MAIN ] SO: Loaded 53614 existing records. [2025-10-14T21:34:38.363153] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-14T21:34:38.432533] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:38.432764] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-14T21:34:38.432812] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-14T21:34:38.433714] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-14T21:34:38.433772] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-14T21:34:38.786226] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:39.065622] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T21:34:39.158024] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-14T21:34:39.958074] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-14T21:34:40.686317] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T21:34:40.763164] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-14T21:34:40.780560] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-14T21:34:41.558100] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-14T21:34:41.740214] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-14T21:34:42.365251] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-14T21:34:42.380086] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T21:34:43.158068] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-14T21:34:43.960092] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-14T21:34:43.965882] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-14T21:34:44.103697] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T21:34:44.382513] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T21:34:44.758156] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-14T21:34:45.139455] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T21:34:45.558055] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-14T21:34:46.358118] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-14T21:34:46.559125] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T21:34:47.158067] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-14T21:34:47.368983] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T21:34:47.374755] [INFO ] [REMOTE ] SNOW: Full fetch complete (77735 records). [2025-10-14T21:34:47.374860] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-14T21:34:47.763912] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-14T21:34:47.764064] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-14T21:34:47.765232] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-14T21:34:47.765319] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-14T21:34:47.766864] [DEBUG] [LOCAL ] SNOW: Trimmed 77735 records to 53595 (keeping 200 days of data) [2025-10-14T21:34:47.970707] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-14T21:34:48.008053] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T21:34:48.118806] [DEBUG] [LOCAL ] SNOW: Primary data saved (53595 records). [2025-10-14T21:34:48.118907] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-14T21:34:48.118980] [INFO ] [MAIN ] Update Progress: 1952/2369 symbols completed. SNOW took 40.8s. Estimated remaining: 58m 42s. Rate: 7.1 symbols/min [2025-10-14T21:34:48.284783] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:48.321421] [DEBUG] [LOCAL ] SOBO: Loaded 39413 existing records from primary storage. [2025-10-14T21:34:48.321746] [INFO ] [MAIN ] SOBO: Loaded 39413 existing records. [2025-10-14T21:34:48.500536] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:48.500846] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-14T21:34:48.500914] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-14T21:34:48.501562] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-14T21:34:48.501618] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-14T21:34:48.779920] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-14T21:34:48.868258] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:48.885534] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T21:34:49.558075] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-14T21:34:49.596944] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T21:34:49.860692] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T21:34:49.865048] [INFO ] [REMOTE ] SNX: Full fetch complete (57221 records). [2025-10-14T21:34:49.865133] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-14T21:34:50.241431] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-14T21:34:50.241505] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-14T21:34:50.242412] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-14T21:34:50.242470] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-14T21:34:50.243488] [DEBUG] [LOCAL ] SNX: Trimmed 57221 records to 39600 (keeping 200 days of data) [2025-10-14T21:34:50.361336] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-14T21:34:50.485358] [DEBUG] [LOCAL ] SNX: Primary data saved (39600 records). [2025-10-14T21:34:50.485496] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-14T21:34:50.486298] [INFO ] [MAIN ] Update Progress: 1953/2369 symbols completed. SNX took 29.3s. Estimated remaining: 58m 32s. Rate: 7.1 symbols/min [2025-10-14T21:34:50.657259] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:50.706974] [DEBUG] [LOCAL ] SOC: Loaded 50790 existing records from primary storage. [2025-10-14T21:34:50.707307] [INFO ] [MAIN ] SOC: Loaded 50790 existing records. [2025-10-14T21:34:50.885071] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:50.885270] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-14T21:34:50.885316] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-14T21:34:50.886107] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-14T21:34:50.886163] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-14T21:34:51.166889] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-14T21:34:51.250155] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:51.387548] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T21:34:51.910703] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T21:34:51.916400] [INFO ] [REMOTE ] SNV: Full fetch complete (71521 records). [2025-10-14T21:34:51.916507] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-14T21:34:51.963330] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-14T21:34:52.306531] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-14T21:34:52.306673] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-14T21:34:52.307781] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-14T21:34:52.307843] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-14T21:34:52.309225] [DEBUG] [LOCAL ] SNV: Trimmed 71521 records to 49028 (keeping 200 days of data) [2025-10-14T21:34:52.600726] [DEBUG] [LOCAL ] SNV: Primary data saved (49028 records). [2025-10-14T21:34:52.600852] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-14T21:34:52.600927] [INFO ] [MAIN ] Update Progress: 1954/2369 symbols completed. SNV took 33.1s. Estimated remaining: 58m 22s. Rate: 7.1 symbols/min [2025-10-14T21:34:52.762970] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-14T21:34:52.786440] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:34:52.799841] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T21:34:52.812980] [DEBUG] [LOCAL ] SOJC: Loaded 4926 existing records from primary storage. [2025-10-14T21:34:52.813131] [INFO ] [MAIN ] SOJC: Loaded 4926 existing records. [2025-10-14T21:34:52.987621] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:34:52.987915] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-14T21:34:52.987962] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-14T21:34:52.988229] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-14T21:34:52.988284] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-14T21:34:53.366181] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:34:53.558102] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-14T21:34:53.633070] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T21:34:54.038262] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T21:34:54.358109] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-14T21:34:54.722486] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T21:34:55.158041] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-14T21:34:55.167999] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T21:34:55.958061] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-14T21:34:56.553730] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T21:34:56.585264] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T21:34:56.758137] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-14T21:34:57.558078] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-14T21:34:58.105314] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T21:34:58.323797] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:34:58.358035] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-14T21:34:59.158082] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-14T21:34:59.908857] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T21:34:59.958020] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-14T21:35:00.763273] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-14T21:35:00.780434] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T21:35:01.558042] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-14T21:35:01.646623] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T21:35:02.358037] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-14T21:35:02.505272] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T21:35:03.164846] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-14T21:35:03.193386] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T21:35:03.655686] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T21:35:03.890503] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T21:35:03.958048] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-14T21:35:04.758066] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-14T21:35:05.477607] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T21:35:05.567573] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-14T21:35:05.573599] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T21:35:06.186133] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T21:35:06.358070] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-14T21:35:07.158058] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-14T21:35:07.748464] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T21:35:07.958035] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-14T21:35:08.062234] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T21:35:08.758118] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-14T21:35:09.558115] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-14T21:35:09.715021] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T21:35:09.932882] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-14T21:35:10.331199] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T21:35:10.358031] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-14T21:35:11.158137] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-14T21:35:11.839355] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T21:35:11.958098] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-14T21:35:12.758076] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-14T21:35:12.975709] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T21:35:13.099759] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-14T21:35:13.395730] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T21:35:13.558072] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-14T21:35:14.358097] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-14T21:35:15.009815] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-14T21:35:15.166687] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-14T21:35:15.173087] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:35:15.958087] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-14T21:35:16.601517] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T21:35:16.758121] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-14T21:35:17.558055] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-14T21:35:17.804175] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T21:35:18.358087] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-14T21:35:18.696142] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T21:35:18.846764] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T21:35:18.847834] [INFO ] [REMOTE ] SOJC: Full fetch complete (7511 records). [2025-10-14T21:35:18.847914] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-14T21:35:19.164243] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-14T21:35:19.201194] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T21:35:19.274389] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-14T21:35:19.274468] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-14T21:35:19.274691] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-14T21:35:19.274750] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-14T21:35:19.275156] [DEBUG] [LOCAL ] SOJC: Trimmed 7511 records to 4906 (keeping 200 days of data) [2025-10-14T21:35:19.304506] [DEBUG] [LOCAL ] SOJC: Primary data saved (4906 records). [2025-10-14T21:35:19.304598] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-14T21:35:19.304692] [INFO ] [MAIN ] Update Progress: 1955/2369 symbols completed. SOJC took 26.7s. Estimated remaining: 58m 17s. Rate: 7.1 symbols/min [2025-10-14T21:35:19.472619] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:19.486270] [DEBUG] [LOCAL ] SOJD: Loaded 12992 existing records from primary storage. [2025-10-14T21:35:19.486483] [INFO ] [MAIN ] SOJD: Loaded 12992 existing records. [2025-10-14T21:35:19.662549] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:35:19.662768] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-14T21:35:19.662815] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-14T21:35:19.663233] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-14T21:35:19.663300] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-14T21:35:19.963356] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-14T21:35:20.022789] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:20.758048] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-14T21:35:20.980822] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T21:35:21.267611] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T21:35:21.272307] [INFO ] [REMOTE ] SOBO: Full fetch complete (58309 records). [2025-10-14T21:35:21.272415] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-14T21:35:21.561295] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-14T21:35:21.673350] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-14T21:35:21.673424] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-14T21:35:21.674420] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-14T21:35:21.674481] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-14T21:35:21.675574] [DEBUG] [LOCAL ] SOBO: Trimmed 58309 records to 39409 (keeping 200 days of data) [2025-10-14T21:35:21.898045] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T21:35:21.933659] [DEBUG] [LOCAL ] SOBO: Primary data saved (39409 records). [2025-10-14T21:35:21.933791] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-14T21:35:21.933874] [INFO ] [MAIN ] Update Progress: 1956/2369 symbols completed. SOBO took 33.8s. Estimated remaining: 58m 8s. Rate: 7.1 symbols/min [2025-10-14T21:35:22.107935] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:22.117956] [DEBUG] [LOCAL ] SOJE: Loaded 8970 existing records from primary storage. [2025-10-14T21:35:22.118161] [INFO ] [MAIN ] SOJE: Loaded 8970 existing records. [2025-10-14T21:35:22.303081] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:35:22.303276] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-14T21:35:22.303322] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-14T21:35:22.303577] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-14T21:35:22.303632] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-14T21:35:22.370313] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-14T21:35:22.679217] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:23.158082] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-14T21:35:23.459897] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-14T21:35:23.958110] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-14T21:35:24.085792] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T21:35:24.121504] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T21:35:24.127428] [INFO ] [REMOTE ] SOC: Full fetch complete (71966 records). [2025-10-14T21:35:24.127533] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-14T21:35:24.517788] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-14T21:35:24.517952] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-14T21:35:24.519332] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-14T21:35:24.519405] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-14T21:35:24.521180] [DEBUG] [LOCAL ] SOC: Trimmed 71966 records to 50853 (keeping 200 days of data) [2025-10-14T21:35:24.630901] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-14T21:35:24.762715] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-14T21:35:24.843089] [DEBUG] [LOCAL ] SOC: Primary data saved (50853 records). [2025-10-14T21:35:24.843235] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-14T21:35:24.843319] [INFO ] [MAIN ] Update Progress: 1957/2369 symbols completed. SOC took 34.4s. Estimated remaining: 57m 58s. Rate: 7.1 symbols/min [2025-10-14T21:35:25.463299] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T21:35:25.558055] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-14T21:35:26.140215] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T21:35:26.146119] [INFO ] [REMOTE ] SO: Full fetch complete (77764 records). [2025-10-14T21:35:26.146244] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-14T21:35:26.363219] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-14T21:35:26.538328] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-14T21:35:26.538410] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-14T21:35:26.539845] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-14T21:35:26.539907] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-14T21:35:26.541296] [DEBUG] [LOCAL ] SO: Trimmed 77764 records to 53614 (keeping 200 days of data) [2025-10-14T21:35:26.862978] [DEBUG] [LOCAL ] SO: Primary data saved (53614 records). [2025-10-14T21:35:26.863729] [INFO ] [MAIN ] SO: Full history saved. [2025-10-14T21:35:26.863817] [INFO ] [MAIN ] Update Progress: 1958/2369 symbols completed. SO took 48.9s. Estimated remaining: 57m 48s. Rate: 7.1 symbols/min [2025-10-14T21:35:27.158041] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-14T21:35:27.173873] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T21:35:27.958065] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-14T21:35:28.029735] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T21:35:28.502451] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T21:35:28.758135] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-14T21:35:29.512867] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-14T21:35:29.558029] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-14T21:35:30.358070] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-14T21:35:30.376305] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T21:35:31.158091] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-14T21:35:31.170049] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T21:35:31.958098] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-14T21:35:31.970146] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T21:35:32.758075] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-14T21:35:32.862973] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T21:35:33.490297] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T21:35:33.558068] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-14T21:35:34.322288] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T21:35:34.358081] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-14T21:35:35.090772] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T21:35:35.158154] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-14T21:35:35.958116] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-14T21:35:36.248438] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T21:35:36.597018] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T21:35:36.598433] [INFO ] [REMOTE ] SOJE: Full fetch complete (13795 records). [2025-10-14T21:35:36.598504] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-14T21:35:36.758183] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-14T21:35:36.981412] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-14T21:35:36.981488] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-14T21:35:36.981827] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-14T21:35:36.981887] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-14T21:35:36.982357] [DEBUG] [LOCAL ] SOJE: Trimmed 13795 records to 8970 (keeping 200 days of data) [2025-10-14T21:35:37.038409] [DEBUG] [LOCAL ] SOJE: Primary data saved (8970 records). [2025-10-14T21:35:37.038547] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-14T21:35:37.038632] [INFO ] [MAIN ] Update Progress: 1959/2369 symbols completed. SOJE took 15.1s. Estimated remaining: 57m 40s. Rate: 7.1 symbols/min [2025-10-14T21:35:37.750455] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T21:35:37.753936] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-14T21:35:38.697924] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T21:35:38.701616] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-14T21:35:39.534368] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T21:35:39.537370] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-14T21:35:40.353885] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T21:35:40.357063] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-14T21:35:41.049872] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T21:35:41.051676] [INFO ] [REMOTE ] SOJD: Full fetch complete (19366 records). [2025-10-14T21:35:41.051756] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-14T21:35:41.418383] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-14T21:35:41.418477] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-14T21:35:41.418917] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-14T21:35:41.418977] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-14T21:35:41.419540] [DEBUG] [LOCAL ] SOJD: Trimmed 19366 records to 12989 (keeping 200 days of data) [2025-10-14T21:35:41.498165] [DEBUG] [LOCAL ] SOJD: Primary data saved (12989 records). [2025-10-14T21:35:41.498306] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-14T21:35:41.498386] [INFO ] [MAIN ] Update Progress: 1960/2369 symbols completed. SOJD took 22.2s. Estimated remaining: 57m 31s. Rate: 7.1 symbols/min [2025-10-14T21:35:42.191759] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:42.220936] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:42.245703] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-14T21:35:42.257269] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-14T21:35:42.278615] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-14T21:35:42.302021] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:42.308455] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-14T21:35:42.334230] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-14T21:35:42.338321] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-14T21:35:42.334119] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:42.417277] [DEBUG] [LOCAL ] SOL: Loaded 13166 existing records from primary storage. [2025-10-14T21:35:42.450410] [INFO ] [MAIN ] SOL: Loaded 13166 existing records. [2025-10-14T21:35:42.806147] [DEBUG] [LOCAL ] SOLV: Loaded 43863 existing records from primary storage. [2025-10-14T21:35:42.902502] [DEBUG] [LOCAL ] SON: Loaded 43217 existing records from primary storage. [2025-10-14T21:35:42.906877] [INFO ] [MAIN ] SON: Loaded 43217 existing records. [2025-10-14T21:35:42.906500] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:35:42.906617] [INFO ] [MAIN ] SOLV: Loaded 43863 existing records. [2025-10-14T21:35:42.912512] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-14T21:35:42.972042] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-14T21:35:43.062674] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-14T21:35:43.137699] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-14T21:35:43.137613] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:43.238312] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-14T21:35:43.482355] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:35:43.478227] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:35:43.482783] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-14T21:35:43.482711] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-14T21:35:43.493460] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-14T21:35:43.503882] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-14T21:35:43.498711] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-14T21:35:43.509716] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-14T21:35:43.504429] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:35:43.540331] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-14T21:35:43.540461] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-14T21:35:43.562306] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:35:43.551481] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-14T21:35:43.562464] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-14T21:35:43.612172] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:35:43.622696] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-14T21:35:43.655883] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-14T21:35:43.661155] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-14T21:35:43.763180] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-14T21:35:43.768447] [INFO ] [MAIN ] Update Progress: 1961/2369 symbols completed. SOJF took 2.3s. Estimated remaining: 57m 21s. Rate: 7.1 symbols/min [2025-10-14T21:35:44.152015] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:44.189415] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-14T21:35:44.409403] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:35:44.632080] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:44.687800] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:44.688246] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-14T21:35:44.688573] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-14T21:35:44.712459] [DEBUG] [LOCAL ] SONY: Loaded 53374 existing records from primary storage. [2025-10-14T21:35:44.712855] [INFO ] [MAIN ] SONY: Loaded 53374 existing records. [2025-10-14T21:35:44.890825] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:35:44.891044] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-14T21:35:44.891090] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-14T21:35:44.892111] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-14T21:35:44.892168] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-14T21:35:45.248178] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:35:45.248536] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-14T21:35:45.542138] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T21:35:45.547003] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-14T21:35:46.198627] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T21:35:46.207381] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-14T21:35:46.231544] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T21:35:46.267588] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-14T21:35:46.358049] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-14T21:35:46.816916] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T21:35:47.158082] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-14T21:35:47.679876] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T21:35:47.931829] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:35:47.958081] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-14T21:35:48.758060] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-14T21:35:49.032545] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T21:35:49.466072] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T21:35:49.558083] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-14T21:35:50.234304] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T21:35:50.358205] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-14T21:35:51.109746] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T21:35:51.158035] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-14T21:35:51.585792] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T21:35:51.958106] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-14T21:35:52.502606] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T21:35:52.758084] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-14T21:35:53.558029] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-14T21:35:53.779912] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T21:35:53.779235] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-14T21:35:54.358065] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-14T21:35:54.917491] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T21:35:55.158056] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-14T21:35:55.388541] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T21:35:55.958104] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-14T21:35:56.758042] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-14T21:35:56.820243] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T21:35:57.107351] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T21:35:57.558068] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-14T21:35:57.845466] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T21:35:58.358067] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-14T21:35:59.158046] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-14T21:35:59.528842] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T21:35:59.884579] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T21:35:59.958024] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-14T21:36:00.754583] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T21:36:00.763258] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-14T21:36:01.394958] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T21:36:01.558062] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-14T21:36:02.358081] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-14T21:36:02.823211] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-14T21:36:03.101380] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T21:36:03.141521] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-14T21:36:03.158032] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-14T21:36:03.958080] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-14T21:36:04.166381] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:36:04.758075] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-14T21:36:05.368155] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T21:36:05.373308] [INFO ] [REMOTE ] SOLV: Full fetch complete (63457 records). [2025-10-14T21:36:05.373447] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-14T21:36:05.563256] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-14T21:36:05.828568] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-14T21:36:05.828695] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-14T21:36:05.829932] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-14T21:36:05.830002] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-14T21:36:05.831477] [DEBUG] [LOCAL ] SOLV: Trimmed 63457 records to 43830 (keeping 200 days of data) [2025-10-14T21:36:06.110278] [DEBUG] [LOCAL ] SOLV: Primary data saved (43830 records). [2025-10-14T21:36:06.110416] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-14T21:36:06.110502] [INFO ] [MAIN ] Update Progress: 1962/2369 symbols completed. SOLV took 24.6s. Estimated remaining: 57m 16s. Rate: 7.1 symbols/min [2025-10-14T21:36:06.309081] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:06.338556] [DEBUG] [LOCAL ] SOR: Loaded 2898 existing records from primary storage. [2025-10-14T21:36:06.339999] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:36:06.340350] [INFO ] [MAIN ] SOR: Loaded 2898 existing records. [2025-10-14T21:36:06.363206] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-14T21:36:06.535517] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:06.535761] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-14T21:36:06.535813] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-14T21:36:06.536028] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-14T21:36:06.536086] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-14T21:36:06.651738] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T21:36:06.909492] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:07.158142] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-14T21:36:07.958048] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-14T21:36:08.262016] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T21:36:08.284122] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T21:36:08.758081] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-14T21:36:09.518995] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T21:36:09.558046] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-14T21:36:09.621045] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T21:36:10.358076] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-14T21:36:11.158051] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-14T21:36:11.360916] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T21:36:11.694252] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-14T21:36:11.958068] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-14T21:36:12.667103] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-14T21:36:12.758041] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-14T21:36:12.844996] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T21:36:12.847349] [INFO ] [REMOTE ] SOL: Full fetch complete (21320 records). [2025-10-14T21:36:12.847436] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-14T21:36:13.203187] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-14T21:36:13.203260] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-14T21:36:13.203695] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-14T21:36:13.203755] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-14T21:36:13.204306] [DEBUG] [LOCAL ] SOL: Trimmed 21320 records to 13206 (keeping 200 days of data) [2025-10-14T21:36:13.276957] [DEBUG] [LOCAL ] SOL: Primary data saved (13206 records). [2025-10-14T21:36:13.277085] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-14T21:36:13.277161] [INFO ] [MAIN ] Update Progress: 1963/2369 symbols completed. SOL took 31.8s. Estimated remaining: 57m 7s. Rate: 7.1 symbols/min [2025-10-14T21:36:13.446152] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:13.457525] [DEBUG] [LOCAL ] SOS: Loaded 9365 existing records from primary storage. [2025-10-14T21:36:13.457835] [INFO ] [MAIN ] SOS: Loaded 9365 existing records. [2025-10-14T21:36:13.563192] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-14T21:36:13.651505] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:13.651775] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-14T21:36:13.651828] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-14T21:36:13.652084] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-14T21:36:13.652140] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-14T21:36:14.012019] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:14.358121] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-14T21:36:14.876286] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-14T21:36:15.090888] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T21:36:15.158111] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-14T21:36:15.433941] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T21:36:15.958098] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-14T21:36:16.758116] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-14T21:36:17.147364] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-14T21:36:17.232423] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T21:36:17.247846] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-14T21:36:17.558062] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-14T21:36:18.159080] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T21:36:18.358047] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-14T21:36:19.158078] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-14T21:36:19.624461] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T21:36:19.948823] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T21:36:19.956847] [INFO ] [REMOTE ] SONY: Full fetch complete (77369 records). [2025-10-14T21:36:19.956986] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-14T21:36:19.963165] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-14T21:36:20.389426] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-14T21:36:20.389567] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-14T21:36:20.390805] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-14T21:36:20.390868] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-14T21:36:20.392409] [DEBUG] [LOCAL ] SONY: Trimmed 77369 records to 53379 (keeping 200 days of data) [2025-10-14T21:36:20.598156] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T21:36:20.711271] [DEBUG] [LOCAL ] SONY: Primary data saved (53379 records). [2025-10-14T21:36:20.711401] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-14T21:36:20.711477] [INFO ] [MAIN ] Update Progress: 1964/2369 symbols completed. SONY took 36.9s. Estimated remaining: 56m 58s. Rate: 7.1 symbols/min [2025-10-14T21:36:20.764167] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-14T21:36:20.880542] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:20.911309] [DEBUG] [LOCAL ] SPB: Loaded 34211 existing records from primary storage. [2025-10-14T21:36:20.911586] [INFO ] [MAIN ] SPB: Loaded 34211 existing records. [2025-10-14T21:36:21.090540] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:21.090886] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-14T21:36:21.090940] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-14T21:36:21.091615] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-14T21:36:21.091701] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-14T21:36:21.447500] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:21.558048] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-14T21:36:22.142983] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T21:36:22.358103] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-14T21:36:22.385347] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-14T21:36:22.391637] [INFO ] [REMOTE ] SON: Full fetch complete (62669 records). [2025-10-14T21:36:22.391786] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-14T21:36:22.798166] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-14T21:36:22.798240] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-14T21:36:22.799320] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-14T21:36:22.799382] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-14T21:36:22.800708] [DEBUG] [LOCAL ] SON: Trimmed 62669 records to 43266 (keeping 200 days of data) [2025-10-14T21:36:22.865164] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-14T21:36:23.059122] [DEBUG] [LOCAL ] SON: Primary data saved (43266 records). [2025-10-14T21:36:23.059244] [INFO ] [MAIN ] SON: Full history saved. [2025-10-14T21:36:23.060029] [INFO ] [MAIN ] Update Progress: 1965/2369 symbols completed. SON took 41.6s. Estimated remaining: 56m 49s. Rate: 7.1 symbols/min [2025-10-14T21:36:23.159889] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-14T21:36:23.230337] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:23.274247] [DEBUG] [LOCAL ] SPCE: Loaded 49958 existing records from primary storage. [2025-10-14T21:36:23.274625] [INFO ] [MAIN ] SPCE: Loaded 49958 existing records. [2025-10-14T21:36:23.450248] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:23.450461] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-14T21:36:23.450510] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-14T21:36:23.451221] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-14T21:36:23.451280] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-14T21:36:23.739249] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-14T21:36:23.816679] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:23.958077] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-14T21:36:24.758067] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-14T21:36:25.344943] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T21:36:25.558099] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-14T21:36:25.869768] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T21:36:26.358072] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-14T21:36:27.005994] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T21:36:27.158066] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-14T21:36:27.797781] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T21:36:27.958090] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-14T21:36:28.164780] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T21:36:28.423705] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T21:36:28.758078] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-14T21:36:29.558051] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-14T21:36:29.921261] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T21:36:30.358065] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-14T21:36:31.158079] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-14T21:36:31.394880] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T21:36:31.471711] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T21:36:31.958054] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-14T21:36:32.297678] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T21:36:32.758073] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-14T21:36:33.293031] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T21:36:33.387883] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-14T21:36:33.558047] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-14T21:36:34.358116] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-14T21:36:34.973915] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T21:36:35.158074] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-14T21:36:35.958063] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-14T21:36:36.673889] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-14T21:36:36.687475] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T21:36:36.758037] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-14T21:36:37.106311] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T21:36:37.558077] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-14T21:36:37.894785] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-14T21:36:38.171028] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T21:36:38.358030] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-14T21:36:38.805684] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T21:36:39.158071] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-14T21:36:39.958074] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-14T21:36:40.758113] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-14T21:36:41.186546] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T21:36:41.237701] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-14T21:36:41.558078] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-14T21:36:41.833987] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T21:36:42.004429] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T21:36:42.358096] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-14T21:36:43.158110] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-14T21:36:43.786138] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T21:36:43.958072] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-14T21:36:44.758047] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-14T21:36:44.848544] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T21:36:45.393848] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T21:36:45.436541] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:36:45.438493] [INFO ] [REMOTE ] SOS: Full fetch complete (11232 records). [2025-10-14T21:36:45.438563] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-14T21:36:45.563215] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-14T21:36:45.798229] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-14T21:36:45.798303] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-14T21:36:45.798551] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-14T21:36:45.798588] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-14T21:36:45.799040] [DEBUG] [LOCAL ] SOS: Trimmed 11232 records to 9409 (keeping 200 days of data) [2025-10-14T21:36:45.850296] [DEBUG] [LOCAL ] SOS: Primary data saved (9409 records). [2025-10-14T21:36:45.850424] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-14T21:36:45.850499] [INFO ] [MAIN ] Update Progress: 1966/2369 symbols completed. SOS took 32.6s. Estimated remaining: 56m 43s. Rate: 7.1 symbols/min [2025-10-14T21:36:46.025893] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:46.033330] [DEBUG] [LOCAL ] SPE: Loaded 6299 existing records from primary storage. [2025-10-14T21:36:46.033517] [INFO ] [MAIN ] SPE: Loaded 6299 existing records. [2025-10-14T21:36:46.122411] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-14T21:36:46.225529] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:46.225774] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-14T21:36:46.225826] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-14T21:36:46.226059] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-14T21:36:46.226116] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-14T21:36:46.366727] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-14T21:36:46.589238] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:46.908078] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T21:36:46.909341] [INFO ] [REMOTE ] SOR: Full fetch complete (4418 records). [2025-10-14T21:36:46.909418] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-14T21:36:47.168555] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-14T21:36:47.317812] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-14T21:36:47.317903] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-14T21:36:47.318128] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-14T21:36:47.318169] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-14T21:36:47.318540] [DEBUG] [LOCAL ] SOR: Trimmed 4418 records to 2904 (keeping 200 days of data) [2025-10-14T21:36:47.336665] [DEBUG] [LOCAL ] SOR: Primary data saved (2904 records). [2025-10-14T21:36:47.336750] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-14T21:36:47.336845] [INFO ] [MAIN ] Update Progress: 1967/2369 symbols completed. SOR took 41.2s. Estimated remaining: 56m 33s. Rate: 7.1 symbols/min [2025-10-14T21:36:47.508517] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:47.556924] [DEBUG] [LOCAL ] SPG: Loaded 50214 existing records from primary storage. [2025-10-14T21:36:47.557226] [INFO ] [MAIN ] SPG: Loaded 50214 existing records. [2025-10-14T21:36:47.731271] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:47.731468] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-14T21:36:47.731514] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-14T21:36:47.731976] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-14T21:36:47.732032] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-14T21:36:47.966090] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-14T21:36:48.080150] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:48.758050] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-14T21:36:48.804194] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T21:36:49.065360] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T21:36:49.558076] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-14T21:36:50.134578] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T21:36:50.358093] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-14T21:36:50.498712] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T21:36:51.158070] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-14T21:36:51.958083] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-14T21:36:52.269532] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T21:36:52.300676] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T21:36:52.304400] [INFO ] [REMOTE ] SPB: Full fetch complete (47688 records). [2025-10-14T21:36:52.304491] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-14T21:36:52.605375] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T21:36:52.695083] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-14T21:36:52.695153] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-14T21:36:52.696064] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-14T21:36:52.696124] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-14T21:36:52.697072] [DEBUG] [LOCAL ] SPB: Trimmed 47688 records to 34199 (keeping 200 days of data) [2025-10-14T21:36:52.784145] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-14T21:36:52.902507] [DEBUG] [LOCAL ] SPB: Primary data saved (34199 records). [2025-10-14T21:36:52.902632] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-14T21:36:52.902745] [INFO ] [MAIN ] Update Progress: 1968/2369 symbols completed. SPB took 32.2s. Estimated remaining: 56m 24s. Rate: 7.1 symbols/min [2025-10-14T21:36:53.070335] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:36:53.113052] [DEBUG] [LOCAL ] SPGI: Loaded 45858 existing records from primary storage. [2025-10-14T21:36:53.113357] [INFO ] [MAIN ] SPGI: Loaded 45858 existing records. [2025-10-14T21:36:53.295028] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:36:53.295484] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-14T21:36:53.295538] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-14T21:36:53.296127] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-14T21:36:53.296183] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-14T21:36:53.558234] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-14T21:36:53.569464] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T21:36:53.668071] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:36:54.358061] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-14T21:36:55.158043] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-14T21:36:55.481144] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T21:36:55.958060] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-14T21:36:56.758054] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-14T21:36:56.788966] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-14T21:36:56.889980] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T21:36:57.479720] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T21:36:57.558063] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-14T21:36:57.725727] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T21:36:58.358077] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-14T21:36:59.158054] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-14T21:36:59.388615] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T21:36:59.821801] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T21:36:59.958074] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-14T21:37:00.075988] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T21:37:00.083395] [INFO ] [REMOTE ] SPCE: Full fetch complete (72550 records). [2025-10-14T21:37:00.083566] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-14T21:37:00.497227] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-14T21:37:00.497319] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-14T21:37:00.498484] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-14T21:37:00.498549] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-14T21:37:00.499938] [DEBUG] [LOCAL ] SPCE: Trimmed 72550 records to 49963 (keeping 200 days of data) [2025-10-14T21:37:00.773536] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-14T21:37:00.803857] [DEBUG] [LOCAL ] SPCE: Primary data saved (49963 records). [2025-10-14T21:37:00.804028] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-14T21:37:00.804139] [INFO ] [MAIN ] Update Progress: 1969/2369 symbols completed. SPCE took 37.7s. Estimated remaining: 56m 16s. Rate: 7.1 symbols/min [2025-10-14T21:37:00.983885] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:01.002146] [DEBUG] [LOCAL ] SPH: Loaded 16823 existing records from primary storage. [2025-10-14T21:37:01.002424] [INFO ] [MAIN ] SPH: Loaded 16823 existing records. [2025-10-14T21:37:01.186809] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:01.187918] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-14T21:37:01.187980] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-14T21:37:01.188813] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-14T21:37:01.188876] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-14T21:37:01.555528] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:01.558028] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-14T21:37:01.661587] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T21:37:02.343903] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T21:37:02.358061] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-14T21:37:02.480390] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:37:03.130786] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T21:37:03.158071] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-14T21:37:03.958054] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-14T21:37:04.758124] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-14T21:37:05.014620] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T21:37:05.558104] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-14T21:37:05.841395] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:37:06.107682] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-14T21:37:06.358130] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-14T21:37:07.158037] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-14T21:37:07.197757] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T21:37:07.477946] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T21:37:07.751619] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T21:37:07.958059] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-14T21:37:08.758070] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-14T21:37:09.558100] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-14T21:37:10.369913] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-14T21:37:10.374876] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-14T21:37:10.508696] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T21:37:10.876826] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T21:37:11.035551] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T21:37:11.158023] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-14T21:37:11.958042] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-14T21:37:12.002002] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-14T21:37:12.758064] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-14T21:37:13.558096] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-14T21:37:13.620471] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T21:37:13.689389] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T21:37:14.358079] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-14T21:37:14.964418] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T21:37:14.965576] [INFO ] [REMOTE ] SPE: Full fetch complete (9882 records). [2025-10-14T21:37:14.965686] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-14T21:37:15.163432] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-14T21:37:15.335490] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-14T21:37:15.335592] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-14T21:37:15.335870] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-14T21:37:15.335946] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-14T21:37:15.336558] [DEBUG] [LOCAL ] SPE: Trimmed 9882 records to 6303 (keeping 200 days of data) [2025-10-14T21:37:15.392131] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-14T21:37:15.411516] [DEBUG] [LOCAL ] SPE: Primary data saved (6303 records). [2025-10-14T21:37:15.411620] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-14T21:37:15.411725] [INFO ] [MAIN ] Update Progress: 1970/2369 symbols completed. SPE took 29.6s. Estimated remaining: 56m 9s. Rate: 7.1 symbols/min [2025-10-14T21:37:15.580636] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:15.615952] [DEBUG] [LOCAL ] SPHR: Loaded 40430 existing records from primary storage. [2025-10-14T21:37:15.616218] [INFO ] [MAIN ] SPHR: Loaded 40430 existing records. [2025-10-14T21:37:15.789636] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:15.789839] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-14T21:37:15.789886] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-14T21:37:15.790549] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-14T21:37:15.790618] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-14T21:37:15.963496] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-14T21:37:16.148152] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:16.763236] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-14T21:37:16.773849] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T21:37:17.558053] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-14T21:37:17.818569] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T21:37:17.858164] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T21:37:18.358098] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-14T21:37:19.030361] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T21:37:19.158034] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-14T21:37:19.802055] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T21:37:19.958077] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-14T21:37:20.138050] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T21:37:20.758152] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-14T21:37:21.558079] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-14T21:37:21.630974] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:37:22.099765] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T21:37:22.141639] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T21:37:22.358069] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-14T21:37:23.158068] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-14T21:37:23.958097] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-14T21:37:24.251545] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T21:37:24.298895] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T21:37:24.758082] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-14T21:37:25.558078] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-14T21:37:25.660444] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-14T21:37:25.682675] [DEBUG] [REMOTE ] SPHR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-14T21:37:25.699356] [WARN ] [REMOTE ] SPHR: No data returned for month 2025-01 [2025-10-14T21:37:25.702296] [FATAL] [REMOTE ] SPHR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:37:25.705054] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T21:37:25.703014] [FATAL] [MAIN ] SPHR: Failed to fetch primary data. [2025-10-14T21:37:25.708984] [WARN ] [MAIN ] SPHR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:37:25.715266] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-14T21:37:25.715580] [DEBUG] [LOCAL ] SPHR: No primary data file found to delete. [2025-10-14T21:37:25.715763] [INFO ] [LOCAL ] SPHR: Starting deletion of derivative data. [2025-10-14T21:37:25.715988] [DEBUG] [LOCAL ] SPHR: Deleted derivative data file. [2025-10-14T21:37:25.716079] [INFO ] [MAIN ] Update Progress: 1971/2369 symbols completed. SPHR took 10.3s. Estimated remaining: 56m 0s. Rate: 7.1 symbols/min [2025-10-14T21:37:25.882687] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:25.917157] [DEBUG] [LOCAL ] SPIR: Loaded 37521 existing records from primary storage. [2025-10-14T21:37:25.917441] [INFO ] [MAIN ] SPIR: Loaded 37521 existing records. [2025-10-14T21:37:26.113196] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:26.113384] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-14T21:37:26.113429] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-14T21:37:26.113692] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-14T21:37:26.113776] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-14T21:37:26.363248] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-14T21:37:26.476090] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:27.150839] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T21:37:27.153087] [INFO ] [REMOTE ] SPH: Full fetch complete (27986 records). [2025-10-14T21:37:27.153227] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-14T21:37:27.165031] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-14T21:37:27.538826] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-14T21:37:27.538909] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-14T21:37:27.539471] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-14T21:37:27.539510] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-14T21:37:27.540326] [DEBUG] [LOCAL ] SPH: Trimmed 27986 records to 16691 (keeping 200 days of data) [2025-10-14T21:37:27.638119] [DEBUG] [LOCAL ] SPH: Primary data saved (16691 records). [2025-10-14T21:37:27.638244] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-14T21:37:27.638318] [INFO ] [MAIN ] Update Progress: 1972/2369 symbols completed. SPH took 26.8s. Estimated remaining: 55m 51s. Rate: 7.1 symbols/min [2025-10-14T21:37:27.808520] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:27.816281] [DEBUG] [LOCAL ] SPMC: Loaded 5287 existing records from primary storage. [2025-10-14T21:37:27.816472] [INFO ] [MAIN ] SPMC: Loaded 5287 existing records. [2025-10-14T21:37:27.964150] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-14T21:37:28.008219] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:28.008406] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-14T21:37:28.008462] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-14T21:37:28.008615] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-14T21:37:28.008697] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-14T21:37:28.384247] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:28.406896] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T21:37:28.495413] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T21:37:28.501443] [INFO ] [REMOTE ] SPG: Full fetch complete (72084 records). [2025-10-14T21:37:28.501586] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-14T21:37:28.765094] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-14T21:37:28.900426] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-14T21:37:28.900514] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-14T21:37:28.901770] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-14T21:37:28.901833] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-14T21:37:28.903254] [DEBUG] [LOCAL ] SPG: Trimmed 72084 records to 50221 (keeping 200 days of data) [2025-10-14T21:37:29.217109] [DEBUG] [LOCAL ] SPG: Primary data saved (50221 records). [2025-10-14T21:37:29.217246] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-14T21:37:29.217327] [INFO ] [MAIN ] Update Progress: 1973/2369 symbols completed. SPG took 41.9s. Estimated remaining: 55m 41s. Rate: 7.1 symbols/min [2025-10-14T21:37:29.398141] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:29.398327] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-14T21:37:29.398364] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-14T21:37:29.398484] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-14T21:37:29.398523] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-14T21:37:29.398563] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-14T21:37:29.398594] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-14T21:37:29.563615] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-14T21:37:29.627193] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:37:29.684615] [INFO ] [REMOTE ] SPGI: Full fetch complete (67413 records). [2025-10-14T21:37:29.705135] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-14T21:37:29.893553] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:30.185006] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-14T21:37:30.185084] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-14T21:37:30.186150] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-14T21:37:30.186210] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-14T21:37:30.187521] [DEBUG] [LOCAL ] SPGI: Trimmed 67413 records to 45881 (keeping 200 days of data) [2025-10-14T21:37:30.366280] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-14T21:37:30.473463] [DEBUG] [LOCAL ] SPGI: Primary data saved (45881 records). [2025-10-14T21:37:30.473614] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-14T21:37:30.474374] [INFO ] [MAIN ] Update Progress: 1974/2369 symbols completed. SPGI took 37.6s. Estimated remaining: 55m 31s. Rate: 7.1 symbols/min [2025-10-14T21:37:30.646103] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:30.682171] [DEBUG] [LOCAL ] SPNT: Loaded 34731 existing records from primary storage. [2025-10-14T21:37:30.682465] [INFO ] [MAIN ] SPNT: Loaded 34731 existing records. [2025-10-14T21:37:30.869339] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:30.869802] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-14T21:37:30.869873] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-14T21:37:30.870486] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-14T21:37:30.870548] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-14T21:37:31.010454] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T21:37:31.074752] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T21:37:31.168033] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-14T21:37:31.287090] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:31.958076] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-14T21:37:32.148111] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:37:32.148496] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-14T21:37:32.148611] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:37:32.148725] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-14T21:37:32.148809] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:37:32.148901] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-14T21:37:32.149000] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-14T21:37:32.149071] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-14T21:37:32.149159] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-14T21:37:32.149275] [INFO ] [MAIN ] Update Progress: 1975/2369 symbols completed. SPME took 2.9s. Estimated remaining: 55m 21s. Rate: 7.1 symbols/min [2025-10-14T21:37:32.347806] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:32.392145] [DEBUG] [LOCAL ] SPOT: Loaded 50402 existing records from primary storage. [2025-10-14T21:37:32.392472] [INFO ] [MAIN ] SPOT: Loaded 50402 existing records. [2025-10-14T21:37:32.572323] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:32.572532] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-14T21:37:32.572579] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-14T21:37:32.573884] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-14T21:37:32.573943] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-14T21:37:32.761671] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-14T21:37:32.962040] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:32.957780] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T21:37:33.393455] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T21:37:33.558063] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-14T21:37:34.358079] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-14T21:37:35.073246] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T21:37:35.158108] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-14T21:37:35.627336] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T21:37:35.958063] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-14T21:37:36.611729] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T21:37:36.758054] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-14T21:37:36.916236] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T21:37:37.558056] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-14T21:37:38.323039] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T21:37:38.358026] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-14T21:37:39.158097] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-14T21:37:39.510784] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-14T21:37:39.840612] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T21:37:39.958039] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-14T21:37:40.299124] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T21:37:40.758102] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-14T21:37:41.558088] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-14T21:37:41.602268] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T21:37:41.607629] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T21:37:42.358085] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-14T21:37:43.158129] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-14T21:37:43.834290] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-14T21:37:43.958037] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-14T21:37:44.053808] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T21:37:44.461493] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T21:37:44.758110] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-14T21:37:45.558082] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-14T21:37:46.223292] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-14T21:37:46.240871] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T21:37:46.311206] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T21:37:46.358047] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-14T21:37:47.158070] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-14T21:37:47.737584] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T21:37:47.958084] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-14T21:37:48.686244] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-14T21:37:48.758120] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-14T21:37:49.376845] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T21:37:49.377161] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T21:37:49.558078] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-14T21:37:50.358080] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-14T21:37:50.973224] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T21:37:51.158133] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-14T21:37:51.807998] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T21:37:51.814095] [INFO ] [REMOTE ] SPIR: Full fetch complete (53663 records). [2025-10-14T21:37:51.814260] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-14T21:37:51.963220] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-14T21:37:52.236996] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-14T21:37:52.237080] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-14T21:37:52.238060] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-14T21:37:52.238155] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-14T21:37:52.239285] [DEBUG] [LOCAL ] SPIR: Trimmed 53663 records to 37592 (keeping 200 days of data) [2025-10-14T21:37:52.459735] [DEBUG] [LOCAL ] SPIR: Primary data saved (37592 records). [2025-10-14T21:37:52.459894] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-14T21:37:52.459978] [INFO ] [MAIN ] Update Progress: 1976/2369 symbols completed. SPIR took 26.7s. Estimated remaining: 55m 15s. Rate: 7.1 symbols/min [2025-10-14T21:37:52.574961] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T21:37:52.649011] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:37:52.671318] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T21:37:52.710477] [DEBUG] [LOCAL ] SPR: Loaded 41105 existing records from primary storage. [2025-10-14T21:37:52.710797] [INFO ] [MAIN ] SPR: Loaded 41105 existing records. [2025-10-14T21:37:52.763300] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-14T21:37:52.886826] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:37:52.886993] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-14T21:37:52.887039] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-14T21:37:52.888144] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-14T21:37:52.888200] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-14T21:37:53.231900] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:37:53.558091] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-14T21:37:54.358112] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-14T21:37:54.941970] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T21:37:55.093246] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-14T21:37:55.158031] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-14T21:37:55.943722] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T21:37:55.958037] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-14T21:37:56.758080] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-14T21:37:57.270089] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-14T21:37:57.472699] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:37:57.558072] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-14T21:37:57.742482] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T21:37:58.358073] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-14T21:37:59.061613] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T21:37:59.158045] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-14T21:37:59.958092] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-14T21:38:00.594436] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-14T21:38:00.758815] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-14T21:38:00.761358] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T21:38:01.432256] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T21:38:01.558047] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-14T21:38:02.358034] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-14T21:38:02.865968] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-14T21:38:02.914558] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:38:03.158077] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-14T21:38:03.878427] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T21:38:03.958036] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-14T21:38:04.568611] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-14T21:38:04.758054] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-14T21:38:05.558030] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-14T21:38:05.652363] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T21:38:05.744517] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T21:38:06.358049] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-14T21:38:06.627965] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T21:38:06.632003] [INFO ] [REMOTE ] SPNT: Full fetch complete (48766 records). [2025-10-14T21:38:06.632131] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-14T21:38:07.012571] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-14T21:38:07.012675] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-14T21:38:07.013592] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-14T21:38:07.013634] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-14T21:38:07.014815] [DEBUG] [LOCAL ] SPNT: Trimmed 48766 records to 34701 (keeping 200 days of data) [2025-10-14T21:38:07.163120] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-14T21:38:07.217634] [DEBUG] [LOCAL ] SPNT: Primary data saved (34701 records). [2025-10-14T21:38:07.217834] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-14T21:38:07.217924] [INFO ] [MAIN ] Update Progress: 1977/2369 symbols completed. SPNT took 36.7s. Estimated remaining: 55m 8s. Rate: 7.1 symbols/min [2025-10-14T21:38:07.399953] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:07.410432] [DEBUG] [LOCAL ] SPRU: Loaded 9703 existing records from primary storage. [2025-10-14T21:38:07.410680] [INFO ] [MAIN ] SPRU: Loaded 9703 existing records. [2025-10-14T21:38:07.598014] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:07.598251] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-14T21:38:07.598302] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-14T21:38:07.598629] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-14T21:38:07.598719] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-14T21:38:07.962415] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-14T21:38:07.971850] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:08.338026] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-14T21:38:08.343968] [INFO ] [REMOTE ] SPOT: Full fetch complete (73754 records). [2025-10-14T21:38:08.344119] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-14T21:38:08.656708] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T21:38:08.767969] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-14T21:38:08.773339] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-14T21:38:08.785214] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-14T21:38:08.787956] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-14T21:38:08.789203] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T21:38:08.797661] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-14T21:38:08.799387] [DEBUG] [LOCAL ] SPOT: Trimmed 73754 records to 50374 (keeping 200 days of data) [2025-10-14T21:38:09.110534] [DEBUG] [LOCAL ] SPOT: Primary data saved (50374 records). [2025-10-14T21:38:09.110819] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-14T21:38:09.110921] [INFO ] [MAIN ] Update Progress: 1978/2369 symbols completed. SPOT took 37.0s. Estimated remaining: 54m 58s. Rate: 7.1 symbols/min [2025-10-14T21:38:09.277728] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:09.298832] [DEBUG] [LOCAL ] SPXC: Loaded 23394 existing records from primary storage. [2025-10-14T21:38:09.299273] [INFO ] [MAIN ] SPXC: Loaded 23394 existing records. [2025-10-14T21:38:09.498579] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:09.498871] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T21:38:09.499199] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-14T21:38:09.501095] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-14T21:38:09.502016] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-14T21:38:09.502075] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-14T21:38:09.563855] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-14T21:38:09.871860] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:10.358065] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-14T21:38:10.849664] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T21:38:10.850729] [INFO ] [REMOTE ] SPMC: Full fetch complete (8105 records). [2025-10-14T21:38:10.850798] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-14T21:38:11.162025] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-14T21:38:11.223255] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-14T21:38:11.223423] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-14T21:38:11.223768] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-14T21:38:11.223846] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-14T21:38:11.224602] [DEBUG] [LOCAL ] SPMC: Trimmed 8105 records to 5266 (keeping 200 days of data) [2025-10-14T21:38:11.272144] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T21:38:11.290128] [DEBUG] [LOCAL ] SPMC: Primary data saved (5266 records). [2025-10-14T21:38:11.290376] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-14T21:38:11.290482] [INFO ] [MAIN ] Update Progress: 1979/2369 symbols completed. SPMC took 43.7s. Estimated remaining: 54m 49s. Rate: 7.1 symbols/min [2025-10-14T21:38:11.459064] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:11.470007] [DEBUG] [LOCAL ] SPXX: Loaded 9471 existing records from primary storage. [2025-10-14T21:38:11.470210] [INFO ] [MAIN ] SPXX: Loaded 9471 existing records. [2025-10-14T21:38:11.648803] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:11.649031] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-14T21:38:11.649087] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-14T21:38:11.649289] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-14T21:38:11.649348] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-14T21:38:11.963180] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-14T21:38:12.006600] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:12.067906] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T21:38:12.758040] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-14T21:38:13.031211] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T21:38:13.435672] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-14T21:38:13.558058] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-14T21:38:14.116367] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T21:38:14.358100] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-14T21:38:15.158087] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-14T21:38:15.546136] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T21:38:15.958100] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-14T21:38:16.619047] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:38:16.758074] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-14T21:38:17.105594] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T21:38:17.558064] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-14T21:38:18.241167] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T21:38:18.257264] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T21:38:18.358124] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-14T21:38:18.975842] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-14T21:38:19.158065] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-14T21:38:19.900940] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T21:38:19.958023] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-14T21:38:20.758051] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-14T21:38:20.815944] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T21:38:21.558113] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-14T21:38:22.107142] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T21:38:22.111945] [INFO ] [REMOTE ] SPR: Full fetch complete (60134 records). [2025-10-14T21:38:22.112048] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-14T21:38:22.216500] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T21:38:22.363249] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-14T21:38:22.513987] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-14T21:38:22.514065] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-14T21:38:22.515111] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-14T21:38:22.515172] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-14T21:38:22.516322] [DEBUG] [LOCAL ] SPR: Trimmed 60134 records to 41128 (keeping 200 days of data) [2025-10-14T21:38:22.754010] [DEBUG] [LOCAL ] SPR: Primary data saved (41128 records). [2025-10-14T21:38:22.754132] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-14T21:38:22.754207] [INFO ] [MAIN ] Update Progress: 1980/2369 symbols completed. SPR took 30.3s. Estimated remaining: 54m 41s. Rate: 7.1 symbols/min [2025-10-14T21:38:22.927286] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:22.969891] [DEBUG] [LOCAL ] SQM: Loaded 48733 existing records from primary storage. [2025-10-14T21:38:22.970205] [INFO ] [MAIN ] SQM: Loaded 48733 existing records. [2025-10-14T21:38:23.140174] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T21:38:23.159968] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-14T21:38:23.159871] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:23.163776] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-14T21:38:23.163837] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-14T21:38:23.164046] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-14T21:38:23.164090] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-14T21:38:23.551252] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:23.958041] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-14T21:38:24.103417] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T21:38:24.407046] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T21:38:24.758150] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-14T21:38:25.558074] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-14T21:38:25.981710] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T21:38:26.358086] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-14T21:38:26.945572] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T21:38:27.158059] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-14T21:38:27.482707] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T21:38:27.958077] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-14T21:38:28.758072] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-14T21:38:28.801183] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T21:38:28.985697] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T21:38:29.133482] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-14T21:38:29.558105] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-14T21:38:30.348444] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T21:38:30.358024] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-14T21:38:30.842024] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-14T21:38:31.158076] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-14T21:38:31.958052] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-14T21:38:32.685070] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:38:32.758027] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-14T21:38:33.083897] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T21:38:33.558100] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-14T21:38:34.358061] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-14T21:38:34.401608] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T21:38:34.405949] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T21:38:35.158555] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-14T21:38:35.159468] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T21:38:35.958064] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-14T21:38:36.458840] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T21:38:36.758071] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-14T21:38:36.976300] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-14T21:38:37.521475] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T21:38:37.558032] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-14T21:38:38.252198] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T21:38:38.358089] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-14T21:38:39.158086] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-14T21:38:39.215509] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-14T21:38:39.958062] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-14T21:38:40.254711] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T21:38:40.758043] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-14T21:38:41.558043] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-14T21:38:41.649499] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T21:38:41.698426] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-14T21:38:41.701143] [INFO ] [REMOTE ] SPXC: Full fetch complete (34013 records). [2025-10-14T21:38:41.701214] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-14T21:38:42.067506] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-14T21:38:42.067579] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-14T21:38:42.068265] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-14T21:38:42.068326] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-14T21:38:42.069061] [DEBUG] [LOCAL ] SPXC: Trimmed 34013 records to 23372 (keeping 200 days of data) [2025-10-14T21:38:42.211049] [DEBUG] [LOCAL ] SPXC: Primary data saved (23372 records). [2025-10-14T21:38:42.211171] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-14T21:38:42.211244] [INFO ] [MAIN ] Update Progress: 1981/2369 symbols completed. SPXC took 33.1s. Estimated remaining: 54m 35s. Rate: 7.1 symbols/min [2025-10-14T21:38:42.379121] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-14T21:38:42.385406] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:42.388446] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:38:42.391471] [INFO ] [REMOTE ] SPXX: Full fetch complete (13415 records). [2025-10-14T21:38:42.391549] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-14T21:38:42.638009] [DEBUG] [LOCAL ] SQNS: Loaded 27343 existing records from primary storage. [2025-10-14T21:38:42.665986] [INFO ] [MAIN ] SQNS: Loaded 27343 existing records. [2025-10-14T21:38:42.919844] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-14T21:38:42.950606] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-14T21:38:42.973329] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:42.973843] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-14T21:38:42.974074] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-14T21:38:42.974877] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-14T21:38:42.974968] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-14T21:38:42.975302] [DEBUG] [LOCAL ] SPXX: Trimmed 13415 records to 9392 (keeping 200 days of data) [2025-10-14T21:38:42.975413] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-14T21:38:42.975509] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-14T21:38:43.145012] [DEBUG] [LOCAL ] SPXX: Primary data saved (9392 records). [2025-10-14T21:38:43.160677] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-14T21:38:43.160764] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-14T21:38:43.180084] [INFO ] [MAIN ] Update Progress: 1982/2369 symbols completed. SPXX took 31.9s. Estimated remaining: 54m 25s. Rate: 7.1 symbols/min [2025-10-14T21:38:43.498371] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T21:38:43.613576] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:43.642466] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:43.673692] [DEBUG] [LOCAL ] SR: Loaded 32486 existing records from primary storage. [2025-10-14T21:38:43.673980] [INFO ] [MAIN ] SR: Loaded 32486 existing records. [2025-10-14T21:38:43.882524] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:43.882833] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-14T21:38:43.882906] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-14T21:38:43.883327] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-14T21:38:43.883401] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-14T21:38:43.958732] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-14T21:38:44.406153] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:44.736205] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:38:44.758069] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-14T21:38:44.943786] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T21:38:44.946198] [INFO ] [REMOTE ] SPRU: Full fetch complete (12048 records). [2025-10-14T21:38:44.946274] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-14T21:38:45.320451] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-14T21:38:45.320525] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-14T21:38:45.320886] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-14T21:38:45.320950] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-14T21:38:45.321377] [DEBUG] [LOCAL ] SPRU: Trimmed 12048 records to 9725 (keeping 200 days of data) [2025-10-14T21:38:45.375258] [DEBUG] [LOCAL ] SPRU: Primary data saved (9725 records). [2025-10-14T21:38:45.375369] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-14T21:38:45.375442] [INFO ] [MAIN ] Update Progress: 1983/2369 symbols completed. SPRU took 38.2s. Estimated remaining: 54m 15s. Rate: 7.1 symbols/min [2025-10-14T21:38:45.543349] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:45.568602] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-14T21:38:45.590424] [DEBUG] [LOCAL ] SRE: Loaded 53415 existing records from primary storage. [2025-10-14T21:38:45.590774] [INFO ] [MAIN ] SRE: Loaded 53415 existing records. [2025-10-14T21:38:45.774054] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:45.785442] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-14T21:38:45.785535] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-14T21:38:45.786996] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-14T21:38:45.786916] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T21:38:45.787132] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-14T21:38:46.152208] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:46.358052] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-14T21:38:47.082554] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T21:38:47.158081] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-14T21:38:47.896793] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T21:38:47.958039] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-14T21:38:48.672797] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T21:38:48.758035] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-14T21:38:49.558045] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-14T21:38:49.673102] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T21:38:50.119147] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:38:50.358034] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-14T21:38:50.393009] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-14T21:38:51.158066] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-14T21:38:51.958061] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-14T21:38:52.096614] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T21:38:52.168697] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T21:38:52.758059] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-14T21:38:52.897916] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T21:38:53.558068] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-14T21:38:54.358091] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-14T21:38:54.505490] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T21:38:54.881846] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T21:38:55.115983] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T21:38:55.158032] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-14T21:38:55.873063] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T21:38:55.958054] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-14T21:38:56.758074] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-14T21:38:57.470180] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T21:38:57.475930] [INFO ] [REMOTE ] SQM: Full fetch complete (69480 records). [2025-10-14T21:38:57.476063] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-14T21:38:57.560984] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-14T21:38:57.601716] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T21:38:57.893350] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-14T21:38:57.893442] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-14T21:38:57.894821] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-14T21:38:57.894904] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-14T21:38:57.896339] [DEBUG] [LOCAL ] SQM: Trimmed 69480 records to 48759 (keeping 200 days of data) [2025-10-14T21:38:58.220249] [DEBUG] [LOCAL ] SQM: Primary data saved (48759 records). [2025-10-14T21:38:58.220785] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-14T21:38:58.220879] [INFO ] [MAIN ] Update Progress: 1984/2369 symbols completed. SQM took 35.5s. Estimated remaining: 54m 7s. Rate: 7.1 symbols/min [2025-10-14T21:38:58.365181] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-14T21:38:58.389927] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:38:58.402117] [DEBUG] [LOCAL ] SREA: Loaded 10147 existing records from primary storage. [2025-10-14T21:38:58.402382] [INFO ] [MAIN ] SREA: Loaded 10147 existing records. [2025-10-14T21:38:58.582079] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:38:58.582305] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-14T21:38:58.582353] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-14T21:38:58.583022] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-14T21:38:58.583080] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-14T21:38:58.951009] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:38:58.970855] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T21:38:59.158055] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-14T21:38:59.184372] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T21:38:59.958093] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-14T21:39:00.497125] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-14T21:39:00.758054] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-14T21:39:01.558085] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-14T21:39:01.702340] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T21:39:02.195247] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-14T21:39:02.358075] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-14T21:39:02.528855] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T21:39:03.158071] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-14T21:39:03.958043] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-14T21:39:04.262354] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T21:39:04.433268] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T21:39:04.461750] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T21:39:04.758091] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-14T21:39:05.558043] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-14T21:39:05.684451] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T21:39:06.358094] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-14T21:39:07.158038] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-14T21:39:07.395749] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T21:39:07.625752] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T21:39:07.835264] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T21:39:07.958037] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-14T21:39:08.732495] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T21:39:08.758025] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-14T21:39:09.556037] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T21:39:09.558732] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-14T21:39:10.358126] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-14T21:39:10.881430] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T21:39:11.158067] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-14T21:39:11.958109] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-14T21:39:12.557348] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T21:39:12.666398] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-14T21:39:12.758117] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-14T21:39:12.960127] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T21:39:13.558042] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-14T21:39:14.358094] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-14T21:39:14.562624] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T21:39:15.095814] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-14T21:39:15.158047] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-14T21:39:15.315634] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T21:39:15.958067] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-14T21:39:16.758044] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-14T21:39:16.796628] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T21:39:16.813185] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:39:16.816456] [INFO ] [REMOTE ] SR: Full fetch complete (46142 records). [2025-10-14T21:39:16.816543] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-14T21:39:17.190861] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-14T21:39:17.190943] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-14T21:39:17.191855] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-14T21:39:17.191915] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-14T21:39:17.193010] [DEBUG] [LOCAL ] SR: Trimmed 46142 records to 32518 (keeping 200 days of data) [2025-10-14T21:39:17.395828] [DEBUG] [LOCAL ] SR: Primary data saved (32518 records). [2025-10-14T21:39:17.395964] [INFO ] [MAIN ] SR: Full history saved. [2025-10-14T21:39:17.396042] [INFO ] [MAIN ] Update Progress: 1985/2369 symbols completed. SR took 34.2s. Estimated remaining: 54m 1s. Rate: 7.1 symbols/min [2025-10-14T21:39:17.564090] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-14T21:39:17.568132] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:39:17.603881] [DEBUG] [LOCAL ] SRFM: Loaded 38550 existing records from primary storage. [2025-10-14T21:39:17.604177] [INFO ] [MAIN ] SRFM: Loaded 38550 existing records. [2025-10-14T21:39:17.805811] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:39:17.806022] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-14T21:39:17.806075] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-14T21:39:17.806706] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-14T21:39:17.806787] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-14T21:39:18.160497] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:39:18.300512] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T21:39:18.358042] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-14T21:39:18.562704] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T21:39:19.158103] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-14T21:39:19.958054] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-14T21:39:20.042942] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T21:39:20.691046] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T21:39:20.758029] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-14T21:39:20.959248] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-14T21:39:21.457459] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T21:39:21.558073] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-14T21:39:22.358074] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-14T21:39:22.951659] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T21:39:22.953086] [INFO ] [REMOTE ] SREA: Full fetch complete (15301 records). [2025-10-14T21:39:22.953155] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-14T21:39:23.163137] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-14T21:39:23.327153] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-14T21:39:23.337437] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-14T21:39:23.352450] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-14T21:39:23.355313] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-14T21:39:23.357574] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-14T21:39:23.368448] [DEBUG] [LOCAL ] SREA: Trimmed 15301 records to 10122 (keeping 200 days of data) [2025-10-14T21:39:23.428570] [DEBUG] [LOCAL ] SREA: Primary data saved (10122 records). [2025-10-14T21:39:23.428726] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-14T21:39:23.428815] [INFO ] [MAIN ] Update Progress: 1986/2369 symbols completed. SREA took 25.2s. Estimated remaining: 53m 52s. Rate: 7.1 symbols/min [2025-10-14T21:39:23.596888] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:39:23.611130] [DEBUG] [LOCAL ] SRG: Loaded 15360 existing records from primary storage. [2025-10-14T21:39:23.611344] [INFO ] [MAIN ] SRG: Loaded 15360 existing records. [2025-10-14T21:39:23.785428] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:39:23.785616] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-14T21:39:23.785689] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-14T21:39:23.786045] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-14T21:39:23.786102] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-14T21:39:23.962275] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-14T21:39:24.147371] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:39:24.203912] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T21:39:24.207199] [INFO ] [REMOTE ] SQNS: Full fetch complete (32955 records). [2025-10-14T21:39:24.207277] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-14T21:39:24.596583] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-14T21:39:24.596716] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-14T21:39:24.597850] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-14T21:39:24.597934] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-14T21:39:24.598890] [DEBUG] [LOCAL ] SQNS: Trimmed 32955 records to 27373 (keeping 200 days of data) [2025-10-14T21:39:24.721234] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T21:39:24.728224] [INFO ] [REMOTE ] SRE: Full fetch complete (77479 records). [2025-10-14T21:39:24.728934] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-14T21:39:24.766102] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-14T21:39:24.920582] [DEBUG] [LOCAL ] SQNS: Primary data saved (27373 records). [2025-10-14T21:39:24.931014] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-14T21:39:24.956514] [INFO ] [MAIN ] Update Progress: 1987/2369 symbols completed. SQNS took 42.7s. Estimated remaining: 53m 42s. Rate: 7.1 symbols/min [2025-10-14T21:39:25.354278] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:39:25.393138] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-14T21:39:25.393215] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-14T21:39:25.394372] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-14T21:39:25.394488] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-14T21:39:25.396082] [DEBUG] [LOCAL ] SRE: Trimmed 77479 records to 53419 (keeping 200 days of data) [2025-10-14T21:39:25.523543] [DEBUG] [LOCAL ] SRI: Loaded 26555 existing records from primary storage. [2025-10-14T21:39:25.532733] [INFO ] [MAIN ] SRI: Loaded 26555 existing records. [2025-10-14T21:39:25.599702] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-14T21:39:25.843687] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:39:25.845940] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-14T21:39:25.847536] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-14T21:39:25.848532] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-14T21:39:25.848940] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-14T21:39:26.153243] [DEBUG] [LOCAL ] SRE: Primary data saved (53419 records). [2025-10-14T21:39:26.175047] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-14T21:39:26.183272] [INFO ] [MAIN ] Update Progress: 1988/2369 symbols completed. SRE took 40.8s. Estimated remaining: 53m 33s. Rate: 7.1 symbols/min [2025-10-14T21:39:26.231574] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T21:39:26.359866] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-14T21:39:26.459843] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:39:26.524494] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:39:26.524711] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-14T21:39:26.524761] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-14T21:39:26.524892] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-14T21:39:26.524937] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-14T21:39:26.524978] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-14T21:39:26.525025] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-14T21:39:26.881703] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:39:26.966195] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T21:39:27.158102] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-14T21:39:27.516150] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T21:39:27.958055] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-14T21:39:28.169545] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T21:39:28.758053] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-14T21:39:29.130896] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T21:39:29.558063] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-14T21:39:29.673756] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T21:39:30.117035] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T21:39:30.358088] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-14T21:39:30.820811] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T21:39:31.158078] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-14T21:39:31.504032] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-14T21:39:31.958084] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-14T21:39:32.758106] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-14T21:39:33.258783] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T21:39:33.259954] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T21:39:33.558070] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-14T21:39:34.358036] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-14T21:39:34.763335] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-14T21:39:35.158038] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-14T21:39:35.329257] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T21:39:35.958116] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-14T21:39:36.137703] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T21:39:36.395862] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T21:39:36.758140] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-14T21:39:37.558089] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-14T21:39:37.859009] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T21:39:38.358120] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-14T21:39:38.753479] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T21:39:39.021096] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-14T21:39:39.158109] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-14T21:39:39.958063] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-14T21:39:40.431126] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T21:39:40.758050] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-14T21:39:41.213453] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T21:39:41.558068] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-14T21:39:41.694549] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T21:39:42.358127] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-14T21:39:42.521382] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T21:39:43.158062] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-14T21:39:43.924938] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-14T21:39:43.958048] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-14T21:39:44.758038] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-14T21:39:44.822377] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-14T21:39:44.848212] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-14T21:39:45.565155] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-14T21:39:45.567074] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T21:39:46.358124] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-14T21:39:47.158034] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-14T21:39:47.298877] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T21:39:47.503498] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T21:39:47.655607] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T21:39:47.958066] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-14T21:39:48.758049] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-14T21:39:48.891561] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-14T21:39:49.059960] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-14T21:39:49.558051] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-14T21:39:50.358059] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-14T21:39:50.741601] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T21:39:50.819456] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T21:39:50.821195] [INFO ] [REMOTE ] SRG: Full fetch complete (23464 records). [2025-10-14T21:39:50.821276] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-14T21:39:51.163680] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-14T21:39:51.184140] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-14T21:39:51.184210] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-14T21:39:51.184826] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-14T21:39:51.184887] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-14T21:39:51.185453] [DEBUG] [LOCAL ] SRG: Trimmed 23464 records to 15358 (keeping 200 days of data) [2025-10-14T21:39:51.270839] [DEBUG] [LOCAL ] SRG: Primary data saved (15358 records). [2025-10-14T21:39:51.270981] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-14T21:39:51.271062] [INFO ] [MAIN ] Update Progress: 1989/2369 symbols completed. SRG took 27.8s. Estimated remaining: 53m 27s. Rate: 7.1 symbols/min [2025-10-14T21:39:51.441408] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:39:51.450890] [DEBUG] [LOCAL ] SRV: Loaded 7381 existing records from primary storage. [2025-10-14T21:39:51.451101] [INFO ] [MAIN ] SRV: Loaded 7381 existing records. [2025-10-14T21:39:51.561497] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-14T21:39:51.634108] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:39:51.634270] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-14T21:39:51.634318] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-14T21:39:51.634477] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-14T21:39:51.634535] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-14T21:39:51.962273] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-14T21:39:51.991969] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:39:52.758090] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-14T21:39:53.165750] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T21:39:53.193498] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-14T21:39:53.558081] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-14T21:39:53.995814] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T21:39:53.996685] [INFO ] [REMOTE ] SRL: Full fetch complete (1959 records). [2025-10-14T21:39:53.996760] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-14T21:39:54.175709] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-14T21:39:54.175912] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:39:54.175979] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:39:54.176048] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-14T21:39:54.176108] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-14T21:39:54.176142] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-14T21:39:54.176180] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-14T21:39:54.176232] [INFO ] [MAIN ] Update Progress: 1990/2369 symbols completed. SRL took 28.0s. Estimated remaining: 53m 18s. Rate: 7.1 symbols/min [2025-10-14T21:39:54.364421] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:39:54.362711] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-14T21:39:54.408147] [DEBUG] [LOCAL ] SSB: Loaded 42741 existing records from primary storage. [2025-10-14T21:39:54.408430] [INFO ] [MAIN ] SSB: Loaded 42741 existing records. [2025-10-14T21:39:54.583217] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:39:54.583381] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-14T21:39:54.583426] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-14T21:39:54.583918] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-14T21:39:54.583975] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-14T21:39:54.935569] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:39:55.158057] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-14T21:39:55.958106] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-14T21:39:56.331134] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-14T21:39:56.717030] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T21:39:56.732539] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T21:39:56.758043] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-14T21:39:57.558089] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-14T21:39:57.584693] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T21:39:58.358075] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-14T21:39:59.158072] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-14T21:39:59.191855] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T21:39:59.565250] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T21:39:59.958070] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-14T21:39:59.991218] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T21:39:59.996933] [INFO ] [REMOTE ] SRFM: Full fetch complete (50791 records). [2025-10-14T21:39:59.997018] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-14T21:40:00.365420] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-14T21:40:00.365496] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-14T21:40:00.366453] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-14T21:40:00.366515] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-14T21:40:00.367589] [DEBUG] [LOCAL ] SRFM: Trimmed 50791 records to 38827 (keeping 200 days of data) [2025-10-14T21:40:00.584190] [DEBUG] [LOCAL ] SRFM: Primary data saved (38827 records). [2025-10-14T21:40:00.584314] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-14T21:40:00.584390] [INFO ] [MAIN ] Update Progress: 1991/2369 symbols completed. SRFM took 43.2s. Estimated remaining: 53m 9s. Rate: 7.1 symbols/min [2025-10-14T21:40:00.754180] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:40:00.758054] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-14T21:40:00.778319] [DEBUG] [LOCAL ] SSD: Loaded 22581 existing records from primary storage. [2025-10-14T21:40:00.778572] [INFO ] [MAIN ] SSD: Loaded 22581 existing records. [2025-10-14T21:40:00.897561] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T21:40:00.974001] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:40:00.974214] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-14T21:40:00.974262] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-14T21:40:00.974458] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-14T21:40:00.974515] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-14T21:40:01.335253] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:40:01.558064] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-14T21:40:02.169066] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:40:02.358065] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-14T21:40:02.372119] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T21:40:03.158125] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-14T21:40:03.261219] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T21:40:03.958109] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-14T21:40:04.605957] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T21:40:04.758066] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-14T21:40:05.111589] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-14T21:40:05.519069] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T21:40:05.558049] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-14T21:40:06.358111] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-14T21:40:07.158048] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-14T21:40:07.231543] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T21:40:07.413786] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:40:07.958035] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-14T21:40:08.018615] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T21:40:08.758098] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-14T21:40:09.181314] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T21:40:09.549894] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T21:40:09.558020] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-14T21:40:10.270020] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-14T21:40:10.358095] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-14T21:40:11.158101] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-14T21:40:11.271401] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T21:40:11.273945] [INFO ] [REMOTE ] SRI: Full fetch complete (40339 records). [2025-10-14T21:40:11.274070] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-14T21:40:11.658372] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-14T21:40:11.658438] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-14T21:40:11.659259] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-14T21:40:11.659318] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-14T21:40:11.660250] [DEBUG] [LOCAL ] SRI: Trimmed 40339 records to 26491 (keeping 200 days of data) [2025-10-14T21:40:11.804011] [DEBUG] [LOCAL ] SRI: Primary data saved (26491 records). [2025-10-14T21:40:11.804126] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-14T21:40:11.804201] [INFO ] [MAIN ] Update Progress: 1992/2369 symbols completed. SRI took 46.8s. Estimated remaining: 53m 1s. Rate: 7.1 symbols/min [2025-10-14T21:40:11.971209] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-14T21:40:11.975314] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:40:12.013928] [DEBUG] [LOCAL ] SSL: Loaded 41409 existing records from primary storage. [2025-10-14T21:40:12.014215] [INFO ] [MAIN ] SSL: Loaded 41409 existing records. [2025-10-14T21:40:12.191028] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:40:12.191248] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-14T21:40:12.191326] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-14T21:40:12.191719] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-14T21:40:12.191796] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-14T21:40:12.551470] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:40:12.701347] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T21:40:12.729035] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T21:40:12.758033] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-14T21:40:13.558099] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-14T21:40:14.358100] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-14T21:40:14.406180] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T21:40:14.976327] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T21:40:14.977606] [INFO ] [REMOTE ] SRV: Full fetch complete (11385 records). [2025-10-14T21:40:14.977702] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-14T21:40:15.170200] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-14T21:40:15.371232] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-14T21:40:15.372545] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T21:40:15.372638] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-14T21:40:15.381828] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-14T21:40:15.381890] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-14T21:40:15.382326] [DEBUG] [LOCAL ] SRV: Trimmed 11385 records to 7392 (keeping 200 days of data) [2025-10-14T21:40:15.425338] [DEBUG] [LOCAL ] SRV: Primary data saved (7392 records). [2025-10-14T21:40:15.425449] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-14T21:40:15.425532] [INFO ] [MAIN ] Update Progress: 1993/2369 symbols completed. SRV took 24.2s. Estimated remaining: 52m 52s. Rate: 7.1 symbols/min [2025-10-14T21:40:15.599601] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:40:15.611999] [DEBUG] [LOCAL ] SST: Loaded 11615 existing records from primary storage. [2025-10-14T21:40:15.612218] [INFO ] [MAIN ] SST: Loaded 11615 existing records. [2025-10-14T21:40:15.791625] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:40:15.791855] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-14T21:40:15.791900] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-14T21:40:15.792063] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-14T21:40:15.792119] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-14T21:40:15.965290] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-14T21:40:16.148988] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:40:16.766388] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-14T21:40:16.771194] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T21:40:17.282488] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T21:40:17.558098] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-14T21:40:17.586916] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T21:40:18.358112] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-14T21:40:19.158109] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-14T21:40:19.201825] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T21:40:19.459858] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T21:40:19.958082] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-14T21:40:20.758129] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-14T21:40:20.815059] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T21:40:21.052677] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-14T21:40:21.558073] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-14T21:40:21.844977] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-14T21:40:22.358132] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-14T21:40:22.800424] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T21:40:23.158065] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-14T21:40:23.579015] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T21:40:23.958117] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-14T21:40:24.038932] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T21:40:24.758096] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-14T21:40:25.328452] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T21:40:25.558046] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-14T21:40:26.233709] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T21:40:26.358125] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-14T21:40:26.827846] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T21:40:27.158076] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-14T21:40:27.770428] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T21:40:27.777332] [INFO ] [REMOTE ] SSB: Full fetch complete (61507 records). [2025-10-14T21:40:27.777447] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-14T21:40:27.969529] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-14T21:40:28.164841] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-14T21:40:28.164917] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-14T21:40:28.165988] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-14T21:40:28.166048] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-14T21:40:28.167232] [DEBUG] [LOCAL ] SSB: Trimmed 61507 records to 42733 (keeping 200 days of data) [2025-10-14T21:40:28.405770] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T21:40:28.441675] [DEBUG] [LOCAL ] SSB: Primary data saved (42733 records). [2025-10-14T21:40:28.441801] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-14T21:40:28.441874] [INFO ] [MAIN ] Update Progress: 1994/2369 symbols completed. SSB took 34.3s. Estimated remaining: 52m 44s. Rate: 7.1 symbols/min [2025-10-14T21:40:28.613505] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:40:28.638401] [DEBUG] [LOCAL ] SSTK: Loaded 25366 existing records from primary storage. [2025-10-14T21:40:28.638684] [INFO ] [MAIN ] SSTK: Loaded 25366 existing records. [2025-10-14T21:40:28.763225] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-14T21:40:28.828077] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:40:28.828354] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-14T21:40:28.828475] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-14T21:40:28.828746] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-14T21:40:28.828806] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-14T21:40:29.062247] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T21:40:29.306975] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:40:29.558177] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-14T21:40:30.358089] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-14T21:40:30.400834] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T21:40:30.480091] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T21:40:31.158099] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-14T21:40:31.460086] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T21:40:31.958094] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-14T21:40:32.758123] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-14T21:40:32.919148] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T21:40:33.107308] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T21:40:33.558094] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-14T21:40:34.333110] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T21:40:34.358079] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-14T21:40:34.415234] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-14T21:40:35.158085] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-14T21:40:35.958059] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-14T21:40:36.008857] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T21:40:36.297143] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T21:40:36.758111] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-14T21:40:37.564478] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-14T21:40:37.570050] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T21:40:37.903357] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T21:40:38.358035] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-14T21:40:38.382321] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T21:40:39.158051] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-14T21:40:39.315881] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T21:40:39.318733] [INFO ] [REMOTE ] SSD: Full fetch complete (32306 records). [2025-10-14T21:40:39.318847] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-14T21:40:39.708203] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-14T21:40:39.708277] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-14T21:40:39.708998] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-14T21:40:39.709059] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-14T21:40:39.709823] [DEBUG] [LOCAL ] SSD: Trimmed 32306 records to 22619 (keeping 200 days of data) [2025-10-14T21:40:39.847392] [DEBUG] [LOCAL ] SSD: Primary data saved (22619 records). [2025-10-14T21:40:39.847512] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-14T21:40:39.847586] [INFO ] [MAIN ] Update Progress: 1995/2369 symbols completed. SSD took 39.3s. Estimated remaining: 52m 36s. Rate: 7.1 symbols/min [2025-10-14T21:40:39.963237] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-14T21:40:40.030960] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:40:40.076706] [DEBUG] [LOCAL ] ST: Loaded 49924 existing records from primary storage. [2025-10-14T21:40:40.077013] [INFO ] [MAIN ] ST: Loaded 49924 existing records. [2025-10-14T21:40:40.264370] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:40:40.264608] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-14T21:40:40.264714] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-14T21:40:40.265329] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-14T21:40:40.265387] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-14T21:40:40.668327] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-14T21:40:40.673707] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:40:40.758068] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-14T21:40:40.855509] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T21:40:41.558047] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-14T21:40:41.879856] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T21:40:42.358062] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-14T21:40:43.158063] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-14T21:40:43.211408] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-14T21:40:43.272109] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T21:40:43.958072] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-14T21:40:44.758074] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-14T21:40:44.826797] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:40:45.043265] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T21:40:45.558059] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-14T21:40:46.358053] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-14T21:40:46.440552] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T21:40:47.070592] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T21:40:47.112500] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T21:40:47.158066] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-14T21:40:47.958059] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-14T21:40:48.590696] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T21:40:48.595717] [INFO ] [REMOTE ] SSL: Full fetch complete (60096 records). [2025-10-14T21:40:48.595834] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-14T21:40:48.741349] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T21:40:48.759735] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-14T21:40:49.033826] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-14T21:40:49.033917] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-14T21:40:49.035327] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-14T21:40:49.035397] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-14T21:40:49.036816] [DEBUG] [LOCAL ] SSL: Trimmed 60096 records to 41508 (keeping 200 days of data) [2025-10-14T21:40:49.295332] [DEBUG] [LOCAL ] SSL: Primary data saved (41508 records). [2025-10-14T21:40:49.295458] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-14T21:40:49.295536] [INFO ] [MAIN ] Update Progress: 1996/2369 symbols completed. SSL took 37.5s. Estimated remaining: 52m 28s. Rate: 7.1 symbols/min [2025-10-14T21:40:49.467018] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:40:49.510760] [DEBUG] [LOCAL ] STAG: Loaded 50096 existing records from primary storage. [2025-10-14T21:40:49.511094] [INFO ] [MAIN ] STAG: Loaded 50096 existing records. [2025-10-14T21:40:49.565394] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-14T21:40:49.699350] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:40:49.699723] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-14T21:40:49.699781] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-14T21:40:49.700285] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-14T21:40:49.700344] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-14T21:40:50.033206] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-14T21:40:50.132304] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:40:50.358078] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-14T21:40:51.163204] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-14T21:40:51.188270] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T21:40:51.186622] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T21:40:51.958081] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-14T21:40:52.758067] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-14T21:40:52.891702] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:40:52.951426] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T21:40:53.192173] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-14T21:40:53.193361] [INFO ] [REMOTE ] SST: Full fetch complete (18447 records). [2025-10-14T21:40:53.193435] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-14T21:40:53.568600] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-14T21:40:53.569989] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-14T21:40:53.570049] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-14T21:40:53.570497] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-14T21:40:53.570538] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-14T21:40:53.571270] [DEBUG] [LOCAL ] SST: Trimmed 18447 records to 11578 (keeping 200 days of data) [2025-10-14T21:40:53.641808] [DEBUG] [LOCAL ] SST: Primary data saved (11578 records). [2025-10-14T21:40:53.641923] [INFO ] [MAIN ] SST: Full history saved. [2025-10-14T21:40:53.642004] [INFO ] [MAIN ] Update Progress: 1997/2369 symbols completed. SST took 38.2s. Estimated remaining: 52m 19s. Rate: 7.1 symbols/min [2025-10-14T21:40:54.358068] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-14T21:40:55.158038] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-14T21:40:55.345029] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T21:40:55.425032] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T21:40:55.958063] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-14T21:40:56.758047] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-14T21:40:56.925539] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-14T21:40:57.558029] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-14T21:40:57.647545] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T21:40:57.728116] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T21:40:57.731054] [INFO ] [REMOTE ] SSTK: Full fetch complete (41504 records). [2025-10-14T21:40:57.731138] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-14T21:40:58.105816] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-14T21:40:58.105890] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-14T21:40:58.106698] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-14T21:40:58.106758] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-14T21:40:58.107543] [DEBUG] [LOCAL ] SSTK: Trimmed 41504 records to 25249 (keeping 200 days of data) [2025-10-14T21:40:58.262114] [DEBUG] [LOCAL ] SSTK: Primary data saved (25249 records). [2025-10-14T21:40:58.262244] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-14T21:40:58.262321] [INFO ] [MAIN ] Update Progress: 1998/2369 symbols completed. SSTK took 29.8s. Estimated remaining: 52m 10s. Rate: 7.1 symbols/min [2025-10-14T21:40:58.358144] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-14T21:40:59.242866] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T21:40:59.255837] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-14T21:40:59.566406] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T21:40:59.958149] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-14T21:41:01.422758] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-14T21:41:01.433502] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-14T21:41:01.655023] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T21:41:01.665131] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-14T21:41:03.227477] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T21:41:03.238437] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-14T21:41:03.488946] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T21:41:03.499969] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-14T21:41:04.933432] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T21:41:04.945104] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-14T21:41:05.220933] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T21:41:05.232204] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-14T21:41:06.764596] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-14T21:41:06.775347] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-14T21:41:06.865009] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T21:41:06.875384] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-14T21:41:08.002755] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T21:41:08.008404] [INFO ] [REMOTE ] ST: Full fetch complete (72085 records). [2025-10-14T21:41:08.008538] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-14T21:41:08.417215] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-14T21:41:08.417330] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-14T21:41:08.418511] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-14T21:41:08.418638] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-14T21:41:08.420024] [DEBUG] [LOCAL ] ST: Trimmed 72085 records to 49853 (keeping 200 days of data) [2025-10-14T21:41:08.667670] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T21:41:08.706253] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-14T21:41:08.764048] [DEBUG] [LOCAL ] ST: Primary data saved (49853 records). [2025-10-14T21:41:08.764161] [INFO ] [MAIN ] ST: Full history saved. [2025-10-14T21:41:08.764240] [INFO ] [MAIN ] Update Progress: 1999/2369 symbols completed. ST took 28.9s. Estimated remaining: 52m 2s. Rate: 7.1 symbols/min [2025-10-14T21:41:10.492061] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T21:41:10.502190] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-14T21:41:12.337471] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T21:41:12.348129] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-14T21:41:13.681341] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T21:41:13.688758] [INFO ] [REMOTE ] STAG: Full fetch complete (72383 records). [2025-10-14T21:41:13.688941] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-14T21:41:14.084556] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-14T21:41:14.084632] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-14T21:41:14.085782] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-14T21:41:14.085843] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-14T21:41:14.087143] [DEBUG] [LOCAL ] STAG: Trimmed 72383 records to 50116 (keeping 200 days of data) [2025-10-14T21:41:14.394751] [DEBUG] [LOCAL ] STAG: Primary data saved (50116 records). [2025-10-14T21:41:14.394865] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-14T21:41:14.394962] [INFO ] [MAIN ] Update Progress: 2000/2369 symbols completed. STAG took 25.1s. Estimated remaining: 51m 53s. Rate: 7.1 symbols/min [2025-10-14T21:41:15.061178] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:15.164665] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:15.127974] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:15.170526] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:15.188943] [DEBUG] [LOCAL ] STC: Loaded 17355 existing records from primary storage. [2025-10-14T21:41:15.189258] [INFO ] [MAIN ] STC: Loaded 17355 existing records. [2025-10-14T21:41:15.322850] [DEBUG] [LOCAL ] STEL: Loaded 22778 existing records from primary storage. [2025-10-14T21:41:15.326798] [INFO ] [MAIN ] STEL: Loaded 22778 existing records. [2025-10-14T21:41:15.546331] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:15.553879] [DEBUG] [LOCAL ] STE: Loaded 35419 existing records from primary storage. [2025-10-14T21:41:15.547318] [DEBUG] [LOCAL ] STEM: Loaded 38838 existing records from primary storage. [2025-10-14T21:41:15.554275] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-14T21:41:15.554631] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-14T21:41:15.555185] [INFO ] [MAIN ] STEM: Loaded 38838 existing records. [2025-10-14T21:41:15.561139] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-14T21:41:15.581735] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-14T21:41:15.554832] [INFO ] [MAIN ] STE: Loaded 35419 existing records. [2025-10-14T21:41:15.880277] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:15.949678] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-14T21:41:16.006434] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-14T21:41:16.112203] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-14T21:41:16.221891] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-14T21:41:16.207139] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:16.241789] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:16.260624] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-14T21:41:16.305000] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-14T21:41:16.314853] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-14T21:41:16.343269] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-14T21:41:16.353692] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-14T21:41:16.378155] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-14T21:41:16.464783] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-14T21:41:16.496078] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-14T21:41:16.709719] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:16.782631] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-14T21:41:17.359007] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:17.388722] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-14T21:41:17.461815] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:17.478924] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-14T21:41:17.555076] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:17.555326] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-14T21:41:17.974474] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T21:41:17.978622] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-14T21:41:18.523593] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T21:41:18.527874] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-14T21:41:18.746392] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T21:41:18.753794] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-14T21:41:18.815616] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T21:41:18.820031] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-14T21:41:19.119081] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T21:41:19.122995] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-14T21:41:19.429470] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T21:41:19.433455] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-14T21:41:19.591190] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-14T21:41:19.602064] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-14T21:41:20.225621] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T21:41:20.244066] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-14T21:41:20.244609] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-14T21:41:20.249057] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-14T21:41:20.267972] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T21:41:20.272204] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-14T21:41:21.332954] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T21:41:21.337165] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-14T21:41:21.390252] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T21:41:21.558034] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-14T21:41:21.642194] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T21:41:21.817065] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-14T21:41:21.988804] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-14T21:41:22.358107] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-14T21:41:22.442187] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T21:41:23.158088] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-14T21:41:23.872983] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T21:41:23.958033] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-14T21:41:24.196328] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T21:41:24.758065] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-14T21:41:25.504204] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T21:41:25.558036] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-14T21:41:26.294079] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T21:41:26.358025] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-14T21:41:27.123905] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T21:41:27.158061] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-14T21:41:27.958047] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-14T21:41:28.254274] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T21:41:28.588821] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T21:41:28.758031] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-14T21:41:29.003174] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T21:41:29.467125] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T21:41:29.558049] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-14T21:41:30.358079] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-14T21:41:30.583247] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T21:41:31.158053] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-14T21:41:31.328730] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T21:41:31.958079] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-14T21:41:32.758118] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-14T21:41:32.823250] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T21:41:33.522944] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T21:41:33.558038] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-14T21:41:34.009726] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T21:41:34.358062] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-14T21:41:35.158046] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-14T21:41:35.413476] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T21:41:35.745592] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T21:41:35.958083] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-14T21:41:36.107772] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-14T21:41:36.758088] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-14T21:41:37.066941] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T21:41:37.558114] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-14T21:41:37.875422] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T21:41:38.358081] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-14T21:41:38.564521] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T21:41:38.911583] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T21:41:38.915766] [INFO ] [REMOTE ] STE: Full fetch complete (50730 records). [2025-10-14T21:41:38.915881] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-14T21:41:39.168278] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-14T21:41:39.396377] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-14T21:41:39.396494] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-14T21:41:39.398516] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-14T21:41:39.398617] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-14T21:41:39.400330] [DEBUG] [LOCAL ] STE: Trimmed 50730 records to 35362 (keeping 200 days of data) [2025-10-14T21:41:39.725678] [DEBUG] [LOCAL ] STE: Primary data saved (35362 records). [2025-10-14T21:41:39.725891] [INFO ] [MAIN ] STE: Full history saved. [2025-10-14T21:41:39.726022] [INFO ] [MAIN ] Update Progress: 2001/2369 symbols completed. STE took 25.3s. Estimated remaining: 51m 47s. Rate: 7.1 symbols/min [2025-10-14T21:41:39.963883] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-14T21:41:40.015133] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:40.025486] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:41:40.028767] [INFO ] [REMOTE ] STC: Full fetch complete (25577 records). [2025-10-14T21:41:40.028934] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-14T21:41:40.154080] [DEBUG] [LOCAL ] STEW: Loaded 15943 existing records from primary storage. [2025-10-14T21:41:40.175616] [INFO ] [MAIN ] STEW: Loaded 15943 existing records. [2025-10-14T21:41:40.576451] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:40.606181] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-14T21:41:40.614376] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-14T21:41:40.618855] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-14T21:41:40.629548] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-14T21:41:40.798957] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-14T21:41:40.767463] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-14T21:41:40.818592] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-14T21:41:40.820888] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-14T21:41:40.842326] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-14T21:41:40.950308] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T21:41:40.944502] [DEBUG] [LOCAL ] STC: Trimmed 25577 records to 17320 (keeping 200 days of data) [2025-10-14T21:41:41.065982] [INFO ] [REMOTE ] STEL: Full fetch complete (31952 records). [2025-10-14T21:41:41.113497] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-14T21:41:41.268371] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:41.363146] [DEBUG] [LOCAL ] STC: Primary data saved (17320 records). [2025-10-14T21:41:41.375898] [INFO ] [MAIN ] STC: Full history saved. [2025-10-14T21:41:41.376040] [INFO ] [MAIN ] Update Progress: 2002/2369 symbols completed. STC took 27.0s. Estimated remaining: 51m 38s. Rate: 7.1 symbols/min [2025-10-14T21:41:41.562724] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-14T21:41:41.795945] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-14T21:41:41.795759] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:41.796150] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-14T21:41:41.796235] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-14T21:41:41.797019] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-14T21:41:41.797098] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-14T21:41:41.797166] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-14T21:41:41.797476] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-14T21:41:41.797536] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-14T21:41:41.797948] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-14T21:41:41.798146] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-14T21:41:41.830436] [DEBUG] [LOCAL ] STEL: Trimmed 31952 records to 22708 (keeping 200 days of data) [2025-10-14T21:41:42.283011] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:42.325466] [DEBUG] [LOCAL ] STEL: Primary data saved (22708 records). [2025-10-14T21:41:42.325611] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-14T21:41:42.325721] [INFO ] [MAIN ] Update Progress: 2003/2369 symbols completed. STEL took 27.9s. Estimated remaining: 51m 28s. Rate: 7.1 symbols/min [2025-10-14T21:41:42.368977] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-14T21:41:42.505608] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:42.532323] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-14T21:41:42.549179] [DEBUG] [LOCAL ] STK: Loaded 9696 existing records from primary storage. [2025-10-14T21:41:42.549441] [INFO ] [MAIN ] STK: Loaded 9696 existing records. [2025-10-14T21:41:42.713112] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T21:41:42.754934] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:42.755195] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-14T21:41:42.755246] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-14T21:41:42.755405] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-14T21:41:42.755445] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-14T21:41:42.826546] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-14T21:41:43.139976] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:43.158051] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-14T21:41:43.958082] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-14T21:41:44.044548] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:41:44.758071] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-14T21:41:44.803010] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T21:41:45.219620] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-14T21:41:45.558088] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-14T21:41:46.320728] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T21:41:46.358033] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-14T21:41:47.140770] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T21:41:47.158070] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-14T21:41:47.958087] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-14T21:41:48.709084] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T21:41:48.758032] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-14T21:41:48.854787] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T21:41:49.291823] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-14T21:41:49.558096] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-14T21:41:50.358073] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-14T21:41:50.898172] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T21:41:51.158068] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-14T21:41:51.423532] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-14T21:41:51.958103] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-14T21:41:52.575101] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T21:41:52.758059] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-14T21:41:52.948367] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T21:41:53.558071] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-14T21:41:53.572182] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T21:41:54.358074] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-14T21:41:55.014707] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T21:41:55.019367] [INFO ] [REMOTE ] STEM: Full fetch complete (61472 records). [2025-10-14T21:41:55.019511] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-14T21:41:55.127605] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T21:41:55.169030] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-14T21:41:55.414246] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-14T21:41:55.414340] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-14T21:41:55.415400] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-14T21:41:55.415463] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-14T21:41:55.416708] [DEBUG] [LOCAL ] STEM: Trimmed 61472 records to 38827 (keeping 200 days of data) [2025-10-14T21:41:55.641867] [DEBUG] [LOCAL ] STEM: Primary data saved (38827 records). [2025-10-14T21:41:55.642004] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-14T21:41:55.642081] [INFO ] [MAIN ] Update Progress: 2004/2369 symbols completed. STEM took 41.2s. Estimated remaining: 51m 20s. Rate: 7.1 symbols/min [2025-10-14T21:41:55.810974] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:41:55.861605] [DEBUG] [LOCAL ] STLA: Loaded 53555 existing records from primary storage. [2025-10-14T21:41:55.861938] [INFO ] [MAIN ] STLA: Loaded 53555 existing records. [2025-10-14T21:41:55.963293] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-14T21:41:56.040348] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:41:56.045804] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-14T21:41:56.046461] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T21:41:56.046271] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-14T21:41:56.049190] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-14T21:41:56.049245] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-14T21:41:56.330578] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-14T21:41:56.412527] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:41:56.758111] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-14T21:41:57.098498] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-14T21:41:57.558064] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-14T21:41:57.878230] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-14T21:41:58.358089] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-14T21:41:59.158140] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-14T21:41:59.504692] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T21:41:59.958197] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-14T21:42:00.521704] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-14T21:42:00.533933] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T21:42:00.758095] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-14T21:42:01.558061] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-14T21:42:01.761998] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-14T21:42:02.314756] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T21:42:02.358115] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-14T21:42:03.158050] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-14T21:42:03.406203] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T21:42:03.521874] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-14T21:42:03.958071] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-14T21:42:04.758080] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-14T21:42:04.788072] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-14T21:42:05.561514] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-14T21:42:05.562348] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T21:42:06.358037] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-14T21:42:06.576340] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T21:42:06.797369] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-14T21:42:07.158066] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-14T21:42:07.958103] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-14T21:42:08.414990] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T21:42:08.758045] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-14T21:42:08.999379] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T21:42:09.560488] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-14T21:42:09.563724] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T21:42:09.857858] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-14T21:42:09.858670] [INFO ] [REMOTE ] STG: Full fetch complete (2515 records). [2025-10-14T21:42:09.858748] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-14T21:42:10.059039] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-14T21:42:10.059262] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:42:10.059333] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:42:10.059385] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-14T21:42:10.059444] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-14T21:42:10.059480] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-14T21:42:10.059519] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-14T21:42:10.059576] [INFO ] [MAIN ] Update Progress: 2005/2369 symbols completed. STG took 28.7s. Estimated remaining: 51m 13s. Rate: 7.1 symbols/min [2025-10-14T21:42:10.241746] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:10.293610] [DEBUG] [LOCAL ] STM: Loaded 53574 existing records from primary storage. [2025-10-14T21:42:10.293955] [INFO ] [MAIN ] STM: Loaded 53574 existing records. [2025-10-14T21:42:10.363234] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-14T21:42:10.473761] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:10.473952] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-14T21:42:10.473999] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-14T21:42:10.474286] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-14T21:42:10.474344] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-14T21:42:10.828148] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:11.158106] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-14T21:42:11.183074] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T21:42:11.923147] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-14T21:42:11.924866] [INFO ] [REMOTE ] STK: Full fetch complete (14220 records). [2025-10-14T21:42:11.924934] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-14T21:42:11.963977] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-14T21:42:12.294701] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-14T21:42:12.294792] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-14T21:42:12.295125] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-14T21:42:12.295162] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-14T21:42:12.295618] [DEBUG] [LOCAL ] STK: Trimmed 14220 records to 9720 (keeping 200 days of data) [2025-10-14T21:42:12.353160] [DEBUG] [LOCAL ] STK: Primary data saved (9720 records). [2025-10-14T21:42:12.353288] [INFO ] [MAIN ] STK: Full history saved. [2025-10-14T21:42:12.353364] [INFO ] [MAIN ] Update Progress: 2006/2369 symbols completed. STK took 30.0s. Estimated remaining: 51m 3s. Rate: 7.1 symbols/min [2025-10-14T21:42:12.543358] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:12.567149] [DEBUG] [LOCAL ] STN: Loaded 22817 existing records from primary storage. [2025-10-14T21:42:12.567395] [INFO ] [MAIN ] STN: Loaded 22817 existing records. [2025-10-14T21:42:12.744265] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:12.744460] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-14T21:42:12.744506] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-14T21:42:12.744686] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-14T21:42:12.744743] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-14T21:42:12.759669] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-14T21:42:12.858820] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T21:42:12.882135] [INFO ] [REMOTE ] STEW: Full fetch complete (21705 records). [2025-10-14T21:42:12.900792] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-14T21:42:13.351066] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:13.507551] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-14T21:42:13.507624] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-14T21:42:13.508182] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-14T21:42:13.508244] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-14T21:42:13.508855] [DEBUG] [LOCAL ] STEW: Trimmed 21705 records to 15793 (keeping 200 days of data) [2025-10-14T21:42:13.575749] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-14T21:42:13.605769] [DEBUG] [LOCAL ] STEW: Primary data saved (15793 records). [2025-10-14T21:42:13.605873] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-14T21:42:13.605948] [INFO ] [MAIN ] Update Progress: 2007/2369 symbols completed. STEW took 33.9s. Estimated remaining: 50m 54s. Rate: 7.1 symbols/min [2025-10-14T21:42:13.783033] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:13.822979] [DEBUG] [LOCAL ] STNG: Loaded 43721 existing records from primary storage. [2025-10-14T21:42:13.823265] [INFO ] [MAIN ] STNG: Loaded 43721 existing records. [2025-10-14T21:42:13.997889] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:13.998068] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-14T21:42:13.998114] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-14T21:42:13.998430] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-14T21:42:13.998511] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-14T21:42:14.351078] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:14.358024] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-14T21:42:14.798522] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-14T21:42:15.158155] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-14T21:42:15.458455] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-14T21:42:15.920547] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T21:42:15.958036] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-14T21:42:16.117137] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T21:42:16.758084] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-14T21:42:17.558044] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-14T21:42:17.773490] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T21:42:17.895636] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-14T21:42:18.358125] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-14T21:42:19.158063] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-14T21:42:19.312141] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T21:42:19.408809] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T21:42:19.958135] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-14T21:42:20.400165] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T21:42:20.758061] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-14T21:42:21.072271] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-14T21:42:21.558065] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-14T21:42:22.140413] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T21:42:22.342674] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T21:42:22.358035] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-14T21:42:23.158073] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-14T21:42:23.483951] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T21:42:23.958105] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-14T21:42:24.758079] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-14T21:42:25.026247] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T21:42:25.203584] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-14T21:42:25.558062] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-14T21:42:26.358084] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-14T21:42:26.388115] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T21:42:26.433542] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T21:42:27.158077] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-14T21:42:27.958087] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-14T21:42:28.241954] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T21:42:28.674317] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-14T21:42:28.758118] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-14T21:42:29.510285] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T21:42:29.558050] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-14T21:42:30.358062] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-14T21:42:30.818600] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-14T21:42:31.142049] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:42:31.158029] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-14T21:42:31.210734] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-14T21:42:31.958123] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-14T21:42:32.698464] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T21:42:32.758123] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-14T21:42:33.558084] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-14T21:42:33.870890] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T21:42:33.873263] [INFO ] [REMOTE ] STN: Full fetch complete (32341 records). [2025-10-14T21:42:33.873355] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-14T21:42:34.260328] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-14T21:42:34.260407] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-14T21:42:34.261253] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-14T21:42:34.261332] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-14T21:42:34.289945] [DEBUG] [LOCAL ] STN: Trimmed 32341 records to 22823 (keeping 200 days of data) [2025-10-14T21:42:34.291940] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-14T21:42:34.365282] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-14T21:42:34.447064] [DEBUG] [LOCAL ] STN: Primary data saved (22823 records). [2025-10-14T21:42:34.447192] [INFO ] [MAIN ] STN: Full history saved. [2025-10-14T21:42:34.447270] [INFO ] [MAIN ] Update Progress: 2008/2369 symbols completed. STN took 22.1s. Estimated remaining: 50m 47s. Rate: 7.1 symbols/min [2025-10-14T21:42:34.614971] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:34.627542] [DEBUG] [LOCAL ] STRV: Loaded 11250 existing records from primary storage. [2025-10-14T21:42:34.627794] [INFO ] [MAIN ] STRV: Loaded 11250 existing records. [2025-10-14T21:42:34.808438] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:34.808750] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-14T21:42:34.808857] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-14T21:42:34.809042] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-14T21:42:34.809087] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-14T21:42:35.164867] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-14T21:42:35.193743] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T21:42:35.196673] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:35.958033] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-14T21:42:36.518734] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-14T21:42:36.758038] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-14T21:42:37.214412] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-14T21:42:37.321857] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:42:37.558098] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-14T21:42:38.358047] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-14T21:42:38.776122] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-14T21:42:39.098351] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T21:42:39.158029] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-14T21:42:39.958100] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-14T21:42:40.435098] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T21:42:40.458429] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T21:42:40.463164] [INFO ] [REMOTE ] STNG: Full fetch complete (64406 records). [2025-10-14T21:42:40.463262] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-14T21:42:40.761504] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-14T21:42:40.858216] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-14T21:42:40.858291] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-14T21:42:40.859417] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-14T21:42:40.859484] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-14T21:42:40.860713] [DEBUG] [LOCAL ] STNG: Trimmed 64406 records to 43645 (keeping 200 days of data) [2025-10-14T21:42:41.118376] [DEBUG] [LOCAL ] STNG: Primary data saved (43645 records). [2025-10-14T21:42:41.118506] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-14T21:42:41.118605] [INFO ] [MAIN ] Update Progress: 2009/2369 symbols completed. STNG took 27.5s. Estimated remaining: 50m 39s. Rate: 7.1 symbols/min [2025-10-14T21:42:41.287160] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:41.335346] [DEBUG] [LOCAL ] STT: Loaded 51043 existing records from primary storage. [2025-10-14T21:42:41.335680] [INFO ] [MAIN ] STT: Loaded 51043 existing records. [2025-10-14T21:42:41.515939] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:41.516168] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-14T21:42:41.516305] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-14T21:42:41.516732] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-14T21:42:41.516868] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-14T21:42:41.562256] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-14T21:42:41.857608] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T21:42:41.936843] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:42.358039] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-14T21:42:42.619608] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T21:42:42.895309] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-14T21:42:43.158067] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-14T21:42:43.958089] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-14T21:42:44.046143] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-14T21:42:44.758068] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-14T21:42:45.285218] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-14T21:42:45.558042] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-14T21:42:45.763390] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T21:42:46.028264] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-14T21:42:46.358090] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-14T21:42:47.125131] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:42:47.158029] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-14T21:42:47.958049] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-14T21:42:48.011501] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T21:42:48.758073] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-14T21:42:48.930287] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T21:42:49.318685] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-14T21:42:49.558063] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-14T21:42:50.025161] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-14T21:42:50.031059] [INFO ] [REMOTE ] STLA: Full fetch complete (77649 records). [2025-10-14T21:42:50.031168] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-14T21:42:50.363197] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-14T21:42:50.438045] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-14T21:42:50.438129] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-14T21:42:50.439521] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-14T21:42:50.439586] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-14T21:42:50.441297] [DEBUG] [LOCAL ] STLA: Trimmed 77649 records to 53555 (keeping 200 days of data) [2025-10-14T21:42:50.536281] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T21:42:50.773479] [DEBUG] [LOCAL ] STLA: Primary data saved (53555 records). [2025-10-14T21:42:50.773608] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-14T21:42:50.773714] [INFO ] [MAIN ] Update Progress: 2010/2369 symbols completed. STLA took 55.1s. Estimated remaining: 50m 30s. Rate: 7.1 symbols/min [2025-10-14T21:42:50.947243] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:50.947407] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-14T21:42:50.947444] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-14T21:42:50.947556] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-14T21:42:50.947596] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-14T21:42:50.947636] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-14T21:42:50.947755] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-14T21:42:51.163318] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-14T21:42:51.308333] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:51.958067] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-14T21:42:52.148719] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:42:52.149028] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-14T21:42:52.149115] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:42:52.149164] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-14T21:42:52.149222] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:42:52.149292] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-14T21:42:52.149353] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-14T21:42:52.149388] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-14T21:42:52.149426] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-14T21:42:52.149470] [INFO ] [MAIN ] Update Progress: 2011/2369 symbols completed. STUB took 1.4s. Estimated remaining: 50m 21s. Rate: 7.1 symbols/min [2025-10-14T21:42:52.322154] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:52.334397] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-14T21:42:52.360449] [DEBUG] [LOCAL ] STVN: Loaded 26679 existing records from primary storage. [2025-10-14T21:42:52.360752] [INFO ] [MAIN ] STVN: Loaded 26679 existing records. [2025-10-14T21:42:52.541128] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:52.541417] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-14T21:42:52.541604] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-14T21:42:52.541868] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-14T21:42:52.541993] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-14T21:42:52.675725] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-14T21:42:52.763384] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-14T21:42:52.948046] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:53.558106] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-14T21:42:54.358044] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-14T21:42:54.737512] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-14T21:42:54.743501] [INFO ] [REMOTE ] STM: Full fetch complete (77691 records). [2025-10-14T21:42:54.743630] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-14T21:42:55.136316] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-14T21:42:55.136446] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-14T21:42:55.137691] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-14T21:42:55.137791] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-14T21:42:55.139353] [DEBUG] [LOCAL ] STM: Trimmed 77691 records to 53573 (keeping 200 days of data) [2025-10-14T21:42:55.194108] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-14T21:42:55.243467] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T21:42:55.417350] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-14T21:42:55.534187] [DEBUG] [LOCAL ] STM: Primary data saved (53573 records). [2025-10-14T21:42:55.534331] [INFO ] [MAIN ] STM: Full history saved. [2025-10-14T21:42:55.534411] [INFO ] [MAIN ] Update Progress: 2012/2369 symbols completed. STM took 45.5s. Estimated remaining: 50m 11s. Rate: 7.1 symbols/min [2025-10-14T21:42:55.701805] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:42:55.749712] [DEBUG] [LOCAL ] STWD: Loaded 51981 existing records from primary storage. [2025-10-14T21:42:55.750019] [INFO ] [MAIN ] STWD: Loaded 51981 existing records. [2025-10-14T21:42:55.924224] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:42:55.924429] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-14T21:42:55.924475] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-14T21:42:55.924731] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-14T21:42:55.924787] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-14T21:42:55.967689] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-14T21:42:56.280953] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:42:56.544555] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T21:42:56.559252] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T21:42:56.758061] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-14T21:42:57.558042] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-14T21:42:58.358069] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-14T21:42:58.642519] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T21:42:58.733681] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T21:42:59.158066] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-14T21:42:59.958030] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-14T21:43:00.186311] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T21:43:00.241079] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T21:43:00.758080] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-14T21:43:00.896707] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T21:43:01.558099] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-14T21:43:02.358039] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-14T21:43:02.599486] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T21:43:02.757801] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T21:43:03.129683] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T21:43:03.158027] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-14T21:43:03.905051] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T21:43:03.958035] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-14T21:43:04.758089] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-14T21:43:05.435949] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T21:43:05.437522] [INFO ] [REMOTE ] STRV: Full fetch complete (17727 records). [2025-10-14T21:43:05.437589] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-14T21:43:05.561997] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-14T21:43:05.805496] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-14T21:43:05.805589] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-14T21:43:05.806131] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-14T21:43:05.806210] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-14T21:43:05.831710] [DEBUG] [LOCAL ] STRV: Trimmed 17727 records to 11234 (keeping 200 days of data) [2025-10-14T21:43:05.834355] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-14T21:43:05.911134] [DEBUG] [LOCAL ] STRV: Primary data saved (11234 records). [2025-10-14T21:43:05.911247] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-14T21:43:05.911316] [INFO ] [MAIN ] Update Progress: 2013/2369 symbols completed. STRV took 31.5s. Estimated remaining: 50m 3s. Rate: 7.1 symbols/min [2025-10-14T21:43:06.080031] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:06.083590] [DEBUG] [LOCAL ] STXD: Loaded 1210 existing records from primary storage. [2025-10-14T21:43:06.083753] [INFO ] [MAIN ] STXD: Loaded 1210 existing records. [2025-10-14T21:43:06.256481] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:43:06.256674] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-14T21:43:06.256730] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-14T21:43:06.256900] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-14T21:43:06.256954] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-14T21:43:06.363236] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-14T21:43:06.606531] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:07.158072] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-14T21:43:07.299774] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T21:43:07.324726] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-14T21:43:07.609069] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-14T21:43:07.958051] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-14T21:43:08.758070] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-14T21:43:09.045201] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T21:43:09.558073] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-14T21:43:10.316513] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T21:43:10.358034] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-14T21:43:11.064629] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T21:43:11.158034] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-14T21:43:11.958107] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-14T21:43:12.304814] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-14T21:43:12.758076] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-14T21:43:12.879558] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T21:43:13.126779] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T21:43:13.195348] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T21:43:13.558067] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-14T21:43:13.982444] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-14T21:43:14.358109] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-14T21:43:15.158069] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-14T21:43:15.627004] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-14T21:43:15.958049] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-14T21:43:16.042482] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T21:43:16.758059] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-14T21:43:17.351633] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T21:43:17.357360] [INFO ] [REMOTE ] STT: Full fetch complete (74391 records). [2025-10-14T21:43:17.357492] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-14T21:43:17.560468] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-14T21:43:17.761984] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-14T21:43:17.762128] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-14T21:43:17.763270] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-14T21:43:17.763331] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-14T21:43:17.764827] [DEBUG] [LOCAL ] STT: Trimmed 74391 records to 51051 (keeping 200 days of data) [2025-10-14T21:43:17.917971] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T21:43:18.111840] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T21:43:18.133767] [DEBUG] [LOCAL ] STT: Primary data saved (51051 records). [2025-10-14T21:43:18.133852] [INFO ] [MAIN ] STT: Full history saved. [2025-10-14T21:43:18.133917] [INFO ] [MAIN ] Update Progress: 2014/2369 symbols completed. STT took 37.0s. Estimated remaining: 49m 56s. Rate: 7.1 symbols/min [2025-10-14T21:43:18.300721] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:18.305184] [DEBUG] [LOCAL ] STXE: Loaded 2080 existing records from primary storage. [2025-10-14T21:43:18.305335] [INFO ] [MAIN ] STXE: Loaded 2080 existing records. [2025-10-14T21:43:18.367381] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-14T21:43:18.499459] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:43:18.499706] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-14T21:43:18.499762] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-14T21:43:18.499939] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-14T21:43:18.499996] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-14T21:43:18.856346] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:19.158056] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-14T21:43:19.563453] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-14T21:43:19.620051] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-14T21:43:19.958066] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-14T21:43:20.758155] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-14T21:43:21.177874] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T21:43:21.558029] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-14T21:43:21.663339] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T21:43:22.358101] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-14T21:43:22.806589] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T21:43:23.158104] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-14T21:43:23.963269] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-14T21:43:23.977576] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T21:43:24.316674] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T21:43:24.399578] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T21:43:24.758060] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-14T21:43:25.558078] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-14T21:43:26.256573] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T21:43:26.358048] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-14T21:43:26.678499] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-14T21:43:26.681975] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-14T21:43:27.158061] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-14T21:43:27.958093] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-14T21:43:28.230271] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T21:43:28.233562] [INFO ] [REMOTE ] STVN: Full fetch complete (39234 records). [2025-10-14T21:43:28.233671] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-14T21:43:28.360815] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-14T21:43:28.624075] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-14T21:43:28.624167] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-14T21:43:28.625084] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-14T21:43:28.625152] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-14T21:43:28.626242] [DEBUG] [LOCAL ] STVN: Trimmed 39234 records to 26710 (keeping 200 days of data) [2025-10-14T21:43:28.764842] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-14T21:43:28.790276] [DEBUG] [LOCAL ] STVN: Primary data saved (26710 records). [2025-10-14T21:43:28.790379] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-14T21:43:28.790459] [INFO ] [MAIN ] Update Progress: 2015/2369 symbols completed. STVN took 36.6s. Estimated remaining: 49m 47s. Rate: 7.1 symbols/min [2025-10-14T21:43:28.961778] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:28.966577] [DEBUG] [LOCAL ] STXG: Loaded 2438 existing records from primary storage. [2025-10-14T21:43:28.966766] [INFO ] [MAIN ] STXG: Loaded 2438 existing records. [2025-10-14T21:43:29.141042] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:43:29.141277] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-14T21:43:29.141324] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-14T21:43:29.141448] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-14T21:43:29.141484] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-14T21:43:29.352248] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T21:43:29.526933] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:29.558029] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-14T21:43:30.162570] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T21:43:30.358127] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-14T21:43:30.913111] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-14T21:43:31.158117] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-14T21:43:31.489257] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-14T21:43:31.958101] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-14T21:43:32.296501] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T21:43:32.758123] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-14T21:43:33.101716] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T21:43:33.102452] [INFO ] [REMOTE ] STXD: Full fetch complete (2048 records). [2025-10-14T21:43:33.102518] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-14T21:43:33.463943] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-14T21:43:33.464011] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-14T21:43:33.464110] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-14T21:43:33.464150] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-14T21:43:33.464489] [DEBUG] [LOCAL ] STXD: Trimmed 2048 records to 1241 (keeping 200 days of data) [2025-10-14T21:43:33.472579] [DEBUG] [LOCAL ] STXD: Primary data saved (1241 records). [2025-10-14T21:43:33.472674] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-14T21:43:33.472759] [INFO ] [MAIN ] Update Progress: 2016/2369 symbols completed. STXD took 27.6s. Estimated remaining: 49m 38s. Rate: 7.1 symbols/min [2025-10-14T21:43:33.563198] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-14T21:43:33.650082] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:33.653957] [DEBUG] [LOCAL ] STXK: Loaded 1524 existing records from primary storage. [2025-10-14T21:43:33.654111] [INFO ] [MAIN ] STXK: Loaded 1524 existing records. [2025-10-14T21:43:33.830120] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:43:33.830279] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-14T21:43:33.830326] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-14T21:43:33.830437] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-14T21:43:33.830473] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-14T21:43:34.188060] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:34.358072] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-14T21:43:34.790037] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-14T21:43:35.158085] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-14T21:43:35.194593] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:43:35.583168] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T21:43:35.958069] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-14T21:43:36.508986] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T21:43:36.758065] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-14T21:43:37.558100] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-14T21:43:38.108529] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-14T21:43:38.358047] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-14T21:43:38.535210] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T21:43:38.813666] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T21:43:39.158288] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-14T21:43:39.598931] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-14T21:43:39.958061] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-14T21:43:40.758075] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-14T21:43:41.203183] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T21:43:41.558059] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-14T21:43:41.587180] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T21:43:41.592961] [INFO ] [REMOTE ] STWD: Full fetch complete (75366 records). [2025-10-14T21:43:41.593073] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-14T21:43:41.978304] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-14T21:43:41.978381] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-14T21:43:41.979512] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-14T21:43:41.979575] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-14T21:43:41.980996] [DEBUG] [LOCAL ] STWD: Trimmed 75366 records to 51984 (keeping 200 days of data) [2025-10-14T21:43:42.174080] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T21:43:42.309852] [DEBUG] [LOCAL ] STWD: Primary data saved (51984 records). [2025-10-14T21:43:42.309987] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-14T21:43:42.310065] [INFO ] [MAIN ] Update Progress: 2017/2369 symbols completed. STWD took 46.8s. Estimated remaining: 49m 30s. Rate: 7.1 symbols/min [2025-10-14T21:43:42.363301] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-14T21:43:42.481325] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:42.481476] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-14T21:43:42.481514] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-14T21:43:42.481635] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-14T21:43:42.481720] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-14T21:43:42.481767] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-14T21:43:42.481800] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-14T21:43:42.846608] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:42.852062] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-14T21:43:43.158064] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-14T21:43:43.764447] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-14T21:43:43.958065] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-14T21:43:44.302762] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-14T21:43:44.758077] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-14T21:43:45.177966] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-14T21:43:45.558080] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-14T21:43:45.993688] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-14T21:43:46.358079] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-14T21:43:46.779198] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-14T21:43:47.158104] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-14T21:43:47.596780] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T21:43:47.958067] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-14T21:43:48.407741] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-14T21:43:48.758065] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-14T21:43:49.127116] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T21:43:49.127990] [INFO ] [REMOTE ] STXE: Full fetch complete (3500 records). [2025-10-14T21:43:49.128061] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-14T21:43:49.477683] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-14T21:43:49.477782] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-14T21:43:49.477914] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-14T21:43:49.477954] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-14T21:43:49.478280] [DEBUG] [LOCAL ] STXE: Trimmed 3500 records to 2085 (keeping 200 days of data) [2025-10-14T21:43:49.491067] [DEBUG] [LOCAL ] STXE: Primary data saved (2085 records). [2025-10-14T21:43:49.491124] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-14T21:43:49.491190] [INFO ] [MAIN ] Update Progress: 2018/2369 symbols completed. STXE took 31.4s. Estimated remaining: 49m 21s. Rate: 7.1 symbols/min [2025-10-14T21:43:49.563329] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-14T21:43:49.660620] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:49.665995] [DEBUG] [LOCAL ] STXT: Loaded 2489 existing records from primary storage. [2025-10-14T21:43:49.666141] [INFO ] [MAIN ] STXT: Loaded 2489 existing records. [2025-10-14T21:43:49.841925] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:43:49.842211] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-14T21:43:49.842277] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-14T21:43:49.842419] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-14T21:43:49.842474] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-14T21:43:50.063752] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-14T21:43:50.198777] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:50.358060] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-14T21:43:50.979706] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T21:43:51.158077] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-14T21:43:51.615158] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T21:43:51.958037] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-14T21:43:52.393676] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T21:43:52.758070] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-14T21:43:53.167183] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T21:43:53.558060] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-14T21:43:53.986614] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T21:43:54.358072] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-14T21:43:54.805316] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-14T21:43:55.158066] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-14T21:43:55.597150] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-14T21:43:55.958073] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-14T21:43:56.357594] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-14T21:43:56.758060] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-14T21:43:57.265801] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T21:43:57.558055] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-14T21:43:57.937120] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T21:43:57.937994] [INFO ] [REMOTE ] STXG: Full fetch complete (4076 records). [2025-10-14T21:43:57.938061] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-14T21:43:58.309172] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-14T21:43:58.309251] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-14T21:43:58.309377] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-14T21:43:58.309413] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-14T21:43:58.309782] [DEBUG] [LOCAL ] STXG: Trimmed 4076 records to 2428 (keeping 200 days of data) [2025-10-14T21:43:58.324982] [DEBUG] [LOCAL ] STXG: Primary data saved (2428 records). [2025-10-14T21:43:58.325042] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-14T21:43:58.325107] [INFO ] [MAIN ] Update Progress: 2019/2369 symbols completed. STXG took 29.5s. Estimated remaining: 49m 13s. Rate: 7.1 symbols/min [2025-10-14T21:43:58.363152] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-14T21:43:58.496096] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:43:58.499839] [DEBUG] [LOCAL ] STXV: Loaded 1532 existing records from primary storage. [2025-10-14T21:43:58.499973] [INFO ] [MAIN ] STXV: Loaded 1532 existing records. [2025-10-14T21:43:58.683319] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:43:58.683559] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-14T21:43:58.683609] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-14T21:43:58.683785] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-14T21:43:58.683842] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-14T21:43:59.055708] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:43:59.056541] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T21:43:59.158090] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-14T21:43:59.618857] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-14T21:43:59.958080] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-14T21:44:00.394824] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-14T21:44:00.758053] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-14T21:44:01.369404] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-14T21:44:01.558071] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-14T21:44:02.033515] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-14T21:44:02.358111] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-14T21:44:02.706408] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-14T21:44:03.158069] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-14T21:44:03.741717] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T21:44:03.958090] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-14T21:44:04.508501] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-14T21:44:04.758105] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-14T21:44:05.196345] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T21:44:05.558088] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-14T21:44:05.998430] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-14T21:44:06.358113] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-14T21:44:06.821260] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T21:44:07.158111] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-14T21:44:07.621532] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T21:44:07.958087] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-14T21:44:08.387833] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-14T21:44:08.758122] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-14T21:44:09.218133] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T21:44:09.558091] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-14T21:44:10.105451] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T21:44:10.358102] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-14T21:44:10.861354] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-14T21:44:11.158125] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-14T21:44:11.605296] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-14T21:44:11.958096] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-14T21:44:12.330087] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-14T21:44:12.330908] [INFO ] [REMOTE ] STXK: Full fetch complete (2428 records). [2025-10-14T21:44:12.330976] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-14T21:44:12.712531] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-14T21:44:12.712608] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-14T21:44:12.712742] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-14T21:44:12.712827] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-14T21:44:12.713145] [DEBUG] [LOCAL ] STXK: Trimmed 2428 records to 1522 (keeping 200 days of data) [2025-10-14T21:44:12.722797] [DEBUG] [LOCAL ] STXK: Primary data saved (1522 records). [2025-10-14T21:44:12.722857] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-14T21:44:12.722922] [INFO ] [MAIN ] Update Progress: 2020/2369 symbols completed. STXK took 39.3s. Estimated remaining: 49m 6s. Rate: 7.1 symbols/min [2025-10-14T21:44:12.764616] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-14T21:44:12.892922] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:12.947357] [DEBUG] [LOCAL ] STZ: Loaded 52386 existing records from primary storage. [2025-10-14T21:44:12.947683] [INFO ] [MAIN ] STZ: Loaded 52386 existing records. [2025-10-14T21:44:13.125258] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:13.125486] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-14T21:44:13.125596] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-14T21:44:13.126218] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-14T21:44:13.126278] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-14T21:44:13.404236] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-14T21:44:13.493032] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:13.558040] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-14T21:44:14.060013] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-14T21:44:14.358084] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-14T21:44:14.708101] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-14T21:44:15.158097] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-14T21:44:15.577701] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T21:44:15.578522] [INFO ] [REMOTE ] STXT: Full fetch complete (3896 records). [2025-10-14T21:44:15.578589] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-14T21:44:15.935397] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-14T21:44:15.935471] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-14T21:44:15.935597] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-14T21:44:15.935634] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-14T21:44:15.936022] [DEBUG] [LOCAL ] STXT: Trimmed 3896 records to 2493 (keeping 200 days of data) [2025-10-14T21:44:15.951406] [DEBUG] [LOCAL ] STXT: Primary data saved (2493 records). [2025-10-14T21:44:15.951522] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-14T21:44:15.951598] [INFO ] [MAIN ] Update Progress: 2021/2369 symbols completed. STXT took 26.5s. Estimated remaining: 48m 56s. Rate: 7.1 symbols/min [2025-10-14T21:44:15.963193] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-14T21:44:16.127920] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:16.179693] [DEBUG] [LOCAL ] SU: Loaded 53428 existing records from primary storage. [2025-10-14T21:44:16.180031] [INFO ] [MAIN ] SU: Loaded 53428 existing records. [2025-10-14T21:44:16.363711] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:16.363938] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-14T21:44:16.364004] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-14T21:44:16.364336] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-14T21:44:16.364393] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-14T21:44:16.448509] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T21:44:16.722532] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:16.758112] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-14T21:44:17.558074] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-14T21:44:18.358103] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-14T21:44:19.004278] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-14T21:44:19.024972] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-14T21:44:19.158049] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-14T21:44:19.434048] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T21:44:19.958134] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-14T21:44:20.758058] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-14T21:44:20.911528] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T21:44:21.011616] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-14T21:44:21.558065] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-14T21:44:21.781408] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T21:44:21.817334] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-14T21:44:22.358081] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-14T21:44:22.688765] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-14T21:44:22.689424] [INFO ] [REMOTE ] STXM: Full fetch complete (1402 records). [2025-10-14T21:44:22.689488] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-14T21:44:22.878396] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-14T21:44:22.878576] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:44:22.878666] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:44:22.878737] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-14T21:44:22.878798] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-14T21:44:22.878834] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-14T21:44:22.878873] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-14T21:44:22.878927] [INFO ] [MAIN ] Update Progress: 2022/2369 symbols completed. STXM took 40.6s. Estimated remaining: 48m 48s. Rate: 7.1 symbols/min [2025-10-14T21:44:23.048467] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:23.091615] [DEBUG] [LOCAL ] SUI: Loaded 41951 existing records from primary storage. [2025-10-14T21:44:23.091950] [INFO ] [MAIN ] SUI: Loaded 41951 existing records. [2025-10-14T21:44:23.163148] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-14T21:44:23.276313] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:23.276502] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-14T21:44:23.276548] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-14T21:44:23.276810] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-14T21:44:23.276867] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-14T21:44:23.636707] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:23.958093] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-14T21:44:24.407539] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T21:44:24.733408] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T21:44:24.758030] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-14T21:44:25.558096] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-14T21:44:26.053750] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-14T21:44:26.358096] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-14T21:44:26.591521] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-14T21:44:27.158076] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-14T21:44:27.956244] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T21:44:27.967688] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-14T21:44:28.319346] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-14T21:44:28.758033] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-14T21:44:29.104875] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T21:44:29.558058] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-14T21:44:30.358108] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-14T21:44:30.572618] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T21:44:31.158070] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-14T21:44:31.596428] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-14T21:44:31.630529] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T21:44:31.958088] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-14T21:44:32.757454] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T21:44:32.767566] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-14T21:44:33.558055] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-14T21:44:33.871185] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T21:44:34.332951] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T21:44:34.358047] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-14T21:44:35.158038] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-14T21:44:35.357822] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T21:44:35.958049] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-14T21:44:36.386990] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-14T21:44:36.411066] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-14T21:44:36.757855] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T21:44:36.766153] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-14T21:44:37.558098] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-14T21:44:38.358099] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-14T21:44:38.694716] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T21:44:38.695447] [INFO ] [REMOTE ] STXV: Full fetch complete (2533 records). [2025-10-14T21:44:38.695510] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-14T21:44:39.049397] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-14T21:44:39.127746] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-14T21:44:39.128270] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-14T21:44:39.128442] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-14T21:44:39.128526] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-14T21:44:39.129376] [DEBUG] [LOCAL ] STXV: Trimmed 2533 records to 1522 (keeping 200 days of data) [2025-10-14T21:44:39.139773] [DEBUG] [LOCAL ] STXV: Primary data saved (1522 records). [2025-10-14T21:44:39.139886] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-14T21:44:39.139974] [INFO ] [MAIN ] Update Progress: 2023/2369 symbols completed. STXV took 40.8s. Estimated remaining: 48m 40s. Rate: 7.1 symbols/min [2025-10-14T21:44:39.169596] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-14T21:44:39.286212] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T21:44:39.348772] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:39.385204] [DEBUG] [LOCAL ] SUN: Loaded 38142 existing records from primary storage. [2025-10-14T21:44:39.385478] [INFO ] [MAIN ] SUN: Loaded 38142 existing records. [2025-10-14T21:44:39.561917] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:39.562147] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-14T21:44:39.562236] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-14T21:44:39.562535] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-14T21:44:39.562592] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-14T21:44:39.930333] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:39.958020] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-14T21:44:40.758082] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-14T21:44:40.984523] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T21:44:41.374469] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T21:44:41.558080] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-14T21:44:41.931625] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T21:44:42.358064] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-14T21:44:43.035905] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T21:44:43.158032] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-14T21:44:43.960739] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-14T21:44:44.481745] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-14T21:44:44.548291] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T21:44:44.758100] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-14T21:44:45.558055] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-14T21:44:45.673269] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T21:44:45.907325] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T21:44:46.358089] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-14T21:44:47.158102] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-14T21:44:47.671901] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-14T21:44:47.958039] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-14T21:44:48.057530] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T21:44:48.720758] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T21:44:48.727237] [INFO ] [REMOTE ] SU: Full fetch complete (77544 records). [2025-10-14T21:44:48.727382] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-14T21:44:48.763185] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-14T21:44:49.139926] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-14T21:44:49.140009] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-14T21:44:49.141248] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-14T21:44:49.141313] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-14T21:44:49.142849] [DEBUG] [LOCAL ] SU: Trimmed 77544 records to 53426 (keeping 200 days of data) [2025-10-14T21:44:49.474446] [DEBUG] [LOCAL ] SU: Primary data saved (53426 records). [2025-10-14T21:44:49.474579] [INFO ] [MAIN ] SU: Full history saved. [2025-10-14T21:44:49.474685] [INFO ] [MAIN ] Update Progress: 2024/2369 symbols completed. SU took 33.5s. Estimated remaining: 48m 32s. Rate: 7.1 symbols/min [2025-10-14T21:44:49.567161] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-14T21:44:49.649860] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:49.696084] [DEBUG] [LOCAL ] SUPV: Loaded 47691 existing records from primary storage. [2025-10-14T21:44:49.696382] [INFO ] [MAIN ] SUPV: Loaded 47691 existing records. [2025-10-14T21:44:49.884156] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:49.884386] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-14T21:44:49.884441] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-14T21:44:49.884783] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-14T21:44:49.884844] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-14T21:44:50.233248] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-14T21:44:50.314769] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:50.358022] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-14T21:44:50.454840] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T21:44:50.972750] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T21:44:51.158067] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-14T21:44:51.958077] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-14T21:44:52.758089] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-14T21:44:52.809942] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-14T21:44:52.893394] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T21:44:53.558062] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-14T21:44:53.951488] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-14T21:44:54.038807] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T21:44:54.358070] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-14T21:44:55.163915] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-14T21:44:55.165919] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T21:44:55.171292] [INFO ] [REMOTE ] SUI: Full fetch complete (61037 records). [2025-10-14T21:44:55.171406] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-14T21:44:55.605567] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-14T21:44:55.605701] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-14T21:44:55.606860] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-14T21:44:55.606934] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-14T21:44:55.624566] [DEBUG] [LOCAL ] SUI: Trimmed 61037 records to 42002 (keeping 200 days of data) [2025-10-14T21:44:55.624427] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T21:44:55.631456] [INFO ] [REMOTE ] STZ: Full fetch complete (76109 records). [2025-10-14T21:44:55.631612] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-14T21:44:55.962552] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-14T21:44:56.168353] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-14T21:44:56.169376] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-14T21:44:56.171712] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-14T21:44:56.172187] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-14T21:44:56.188372] [DEBUG] [LOCAL ] STZ: Trimmed 76109 records to 52396 (keeping 200 days of data) [2025-10-14T21:44:56.261858] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-14T21:44:56.580688] [DEBUG] [LOCAL ] SUI: Primary data saved (42002 records). [2025-10-14T21:44:56.581889] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-14T21:44:56.582040] [INFO ] [MAIN ] Update Progress: 2025/2369 symbols completed. SUI took 33.7s. Estimated remaining: 48m 24s. Rate: 7.1 symbols/min [2025-10-14T21:44:56.770437] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:56.770859] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-14T21:44:56.869964] [DEBUG] [LOCAL ] SUZ: Loaded 45687 existing records from primary storage. [2025-10-14T21:44:56.887040] [INFO ] [MAIN ] SUZ: Loaded 45687 existing records. [2025-10-14T21:44:57.088741] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:57.093291] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-14T21:44:57.094767] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-14T21:44:57.095736] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-14T21:44:57.096049] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-14T21:44:57.259708] [DEBUG] [LOCAL ] STZ: Primary data saved (52396 records). [2025-10-14T21:44:57.291423] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-14T21:44:57.318574] [INFO ] [MAIN ] Update Progress: 2026/2369 symbols completed. STZ took 44.6s. Estimated remaining: 48m 14s. Rate: 7.1 symbols/min [2025-10-14T21:44:57.668311] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:44:57.641279] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:57.669332] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-14T21:44:57.694851] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T21:44:57.743412] [DEBUG] [LOCAL ] SVV: Loaded 40109 existing records from primary storage. [2025-10-14T21:44:57.743761] [INFO ] [MAIN ] SVV: Loaded 40109 existing records. [2025-10-14T21:44:57.941732] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:44:57.941970] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-14T21:44:57.942022] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-14T21:44:57.942267] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-14T21:44:57.942323] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-14T21:44:58.303034] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:44:58.340266] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T21:44:58.358037] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-14T21:44:59.158081] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-14T21:44:59.331147] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-14T21:44:59.412959] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T21:44:59.958084] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-14T21:45:00.758078] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-14T21:45:00.789058] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T21:45:01.541919] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T21:45:01.558022] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-14T21:45:02.197636] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T21:45:02.358061] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-14T21:45:03.133209] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-14T21:45:03.158034] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-14T21:45:03.795824] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T21:45:03.958072] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-14T21:45:04.758071] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-14T21:45:04.797106] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:45:05.495924] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:45:05.558040] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-14T21:45:05.811000] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T21:45:06.358122] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-14T21:45:07.067923] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T21:45:07.158065] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-14T21:45:07.958072] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-14T21:45:08.583526] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-14T21:45:08.635851] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T21:45:08.758080] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-14T21:45:09.558084] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-14T21:45:09.597362] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:45:10.205423] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T21:45:10.210402] [INFO ] [REMOTE ] SUN: Full fetch complete (55275 records). [2025-10-14T21:45:10.210549] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-14T21:45:10.363248] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-14T21:45:10.618315] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-14T21:45:10.618389] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-14T21:45:10.619418] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-14T21:45:10.619479] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-14T21:45:10.620573] [DEBUG] [LOCAL ] SUN: Trimmed 55275 records to 38233 (keeping 200 days of data) [2025-10-14T21:45:10.846170] [DEBUG] [LOCAL ] SUN: Primary data saved (38233 records). [2025-10-14T21:45:10.846287] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-14T21:45:10.846359] [INFO ] [MAIN ] Update Progress: 2027/2369 symbols completed. SUN took 31.7s. Estimated remaining: 48m 6s. Rate: 7.1 symbols/min [2025-10-14T21:45:11.017232] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:45:11.068002] [DEBUG] [LOCAL ] SW: Loaded 53184 existing records from primary storage. [2025-10-14T21:45:11.068341] [INFO ] [MAIN ] SW: Loaded 53184 existing records. [2025-10-14T21:45:11.169064] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-14T21:45:11.256848] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:45:11.257254] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-14T21:45:11.257321] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-14T21:45:11.257892] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-14T21:45:11.257949] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-14T21:45:11.592277] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-14T21:45:11.673708] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:45:11.958075] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-14T21:45:12.168359] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T21:45:12.758101] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-14T21:45:12.832455] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T21:45:13.391145] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T21:45:13.558076] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-14T21:45:14.352340] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T21:45:14.361230] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-14T21:45:15.147592] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-14T21:45:15.158019] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-14T21:45:15.554417] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T21:45:15.958051] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-14T21:45:16.008201] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-14T21:45:16.758121] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-14T21:45:17.558060] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-14T21:45:17.722509] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T21:45:18.292715] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T21:45:18.358029] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-14T21:45:19.138212] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T21:45:19.158031] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-14T21:45:19.696876] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T21:45:19.958117] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-14T21:45:20.758051] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-14T21:45:20.884610] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T21:45:21.327234] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T21:45:21.558063] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-14T21:45:22.358089] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-14T21:45:22.514885] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-14T21:45:23.100081] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T21:45:23.158036] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-14T21:45:23.917023] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T21:45:23.958076] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-14T21:45:24.679566] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T21:45:24.758071] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-14T21:45:25.416275] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T21:45:25.558053] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-14T21:45:26.310926] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T21:45:26.358162] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-14T21:45:27.158123] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-14T21:45:27.261784] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T21:45:27.267396] [INFO ] [REMOTE ] SUPV: Full fetch complete (68710 records). [2025-10-14T21:45:27.267513] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-14T21:45:27.668895] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-14T21:45:27.669508] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-14T21:45:27.670010] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T21:45:27.671205] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-14T21:45:27.675543] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-14T21:45:27.676552] [INFO ] [REMOTE ] SVV: Full fetch complete (57038 records). [2025-10-14T21:45:27.676868] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-14T21:45:27.677067] [DEBUG] [LOCAL ] SUPV: Trimmed 68710 records to 47754 (keeping 200 days of data) [2025-10-14T21:45:27.977566] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-14T21:45:28.200876] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-14T21:45:28.202610] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-14T21:45:28.204016] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-14T21:45:28.204624] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-14T21:45:28.213119] [DEBUG] [LOCAL ] SVV: Trimmed 57038 records to 40167 (keeping 200 days of data) [2025-10-14T21:45:28.534637] [DEBUG] [LOCAL ] SVV: Primary data saved (40167 records). [2025-10-14T21:45:28.535867] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-14T21:45:28.536554] [INFO ] [MAIN ] Update Progress: 2028/2369 symbols completed. SVV took 31.2s. Estimated remaining: 47m 59s. Rate: 7.1 symbols/min [2025-10-14T21:45:28.728744] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:45:28.777933] [DEBUG] [LOCAL ] SUPV: Primary data saved (47754 records). [2025-10-14T21:45:28.778077] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-14T21:45:28.778159] [INFO ] [MAIN ] Update Progress: 2029/2369 symbols completed. SUPV took 39.3s. Estimated remaining: 47m 50s. Rate: 7.1 symbols/min [2025-10-14T21:45:28.976435] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:45:28.992273] [DEBUG] [LOCAL ] SWK: Loaded 52484 existing records from primary storage. [2025-10-14T21:45:28.992670] [INFO ] [MAIN ] SWK: Loaded 52484 existing records. [2025-10-14T21:45:29.193308] [DEBUG] [LOCAL ] SWX: Loaded 31094 existing records from primary storage. [2025-10-14T21:45:29.197356] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:45:29.197932] [INFO ] [MAIN ] SWX: Loaded 31094 existing records. [2025-10-14T21:45:29.228790] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-14T21:45:29.241537] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-14T21:45:29.263485] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-14T21:45:29.268755] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-14T21:45:29.501129] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:45:29.521988] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-14T21:45:29.601077] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-14T21:45:29.634668] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-14T21:45:29.672784] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-14T21:45:29.707810] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-14T21:45:29.828929] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:45:29.815227] [INFO ] [REMOTE ] SUZ: Full fetch complete (66819 records). [2025-10-14T21:45:29.834382] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-14T21:45:29.834613] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-14T21:45:30.047202] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-14T21:45:30.128191] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-14T21:45:30.574918] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:45:30.594904] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-14T21:45:30.631679] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-14T21:45:30.631765] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-14T21:45:30.632882] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-14T21:45:30.632942] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-14T21:45:30.634180] [DEBUG] [LOCAL ] SUZ: Trimmed 66819 records to 45714 (keeping 200 days of data) [2025-10-14T21:45:30.896696] [DEBUG] [LOCAL ] SUZ: Primary data saved (45714 records). [2025-10-14T21:45:30.896839] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-14T21:45:30.896921] [INFO ] [MAIN ] Update Progress: 2030/2369 symbols completed. SUZ took 34.3s. Estimated remaining: 47m 40s. Rate: 7.1 symbols/min [2025-10-14T21:45:31.063612] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:45:31.071733] [DEBUG] [LOCAL ] SWZ: Loaded 6072 existing records from primary storage. [2025-10-14T21:45:31.071924] [INFO ] [MAIN ] SWZ: Loaded 6072 existing records. [2025-10-14T21:45:31.247471] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:45:31.247683] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-14T21:45:31.247739] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-14T21:45:31.247903] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-14T21:45:31.247955] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-14T21:45:31.608850] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:45:31.609218] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-14T21:45:31.711833] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T21:45:31.831262] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-14T21:45:31.958037] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-14T21:45:32.012672] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T21:45:32.162733] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T21:45:32.758059] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-14T21:45:33.142616] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-14T21:45:33.251103] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T21:45:33.558081] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-14T21:45:34.172987] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T21:45:34.358091] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-14T21:45:35.042942] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-14T21:45:35.158123] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-14T21:45:35.875454] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T21:45:35.958105] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-14T21:45:36.758065] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-14T21:45:37.558066] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-14T21:45:37.821902] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T21:45:38.199687] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T21:45:38.358067] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-14T21:45:38.776659] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T21:45:39.158090] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-14T21:45:39.965554] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-14T21:45:39.990462] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T21:45:40.524819] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T21:45:40.659276] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T21:45:40.758071] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-14T21:45:41.558060] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-14T21:45:42.092869] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T21:45:42.358076] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-14T21:45:43.158054] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-14T21:45:43.394803] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T21:45:43.958056] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-14T21:45:44.286161] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T21:45:44.387514] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-14T21:45:44.570044] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T21:45:44.758064] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-14T21:45:45.558052] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-14T21:45:46.259481] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T21:45:46.358044] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-14T21:45:46.960963] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-14T21:45:47.091075] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T21:45:47.158027] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-14T21:45:47.795769] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T21:45:47.958070] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-14T21:45:48.758079] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-14T21:45:49.558056] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-14T21:45:49.765486] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T21:45:50.074601] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T21:45:50.075758] [INFO ] [REMOTE ] SWZ: Full fetch complete (8207 records). [2025-10-14T21:45:50.075829] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-14T21:45:50.363196] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-14T21:45:50.438383] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-14T21:45:50.438461] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-14T21:45:50.438715] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-14T21:45:50.438778] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-14T21:45:50.439173] [DEBUG] [LOCAL ] SWZ: Trimmed 8207 records to 6078 (keeping 200 days of data) [2025-10-14T21:45:50.475014] [DEBUG] [LOCAL ] SWZ: Primary data saved (6078 records). [2025-10-14T21:45:50.475137] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-14T21:45:50.475222] [INFO ] [MAIN ] Update Progress: 2031/2369 symbols completed. SWZ took 19.6s. Estimated remaining: 47m 34s. Rate: 7.1 symbols/min [2025-10-14T21:45:50.649168] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:45:50.684723] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T21:45:50.725602] [DEBUG] [LOCAL ] SXC: Loaded 41622 existing records from primary storage. [2025-10-14T21:45:50.725900] [INFO ] [MAIN ] SXC: Loaded 41622 existing records. [2025-10-14T21:45:50.904223] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:45:50.904435] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-14T21:45:50.904482] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-14T21:45:50.904940] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-14T21:45:50.904999] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-14T21:45:51.166286] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-14T21:45:51.253775] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:45:51.478609] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T21:45:51.958093] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-14T21:45:52.758058] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-14T21:45:53.062974] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-14T21:45:53.106581] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T21:45:53.558062] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-14T21:45:54.161916] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T21:45:54.358093] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-14T21:45:55.158121] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-14T21:45:55.334845] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T21:45:55.866453] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:45:55.958052] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-14T21:45:56.415441] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T21:45:56.758072] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-14T21:45:57.558054] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-14T21:45:57.950151] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-14T21:45:57.987468] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T21:45:58.358099] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-14T21:45:59.155832] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T21:45:59.164294] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-14T21:45:59.958080] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-14T21:46:00.236596] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T21:46:00.410716] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-14T21:46:00.414193] [INFO ] [REMOTE ] SWX: Full fetch complete (43967 records). [2025-10-14T21:46:00.414313] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-14T21:46:00.766751] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-14T21:46:00.810372] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-14T21:46:00.810541] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-14T21:46:00.811553] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-14T21:46:00.811616] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-14T21:46:00.812769] [DEBUG] [LOCAL ] SWX: Trimmed 43967 records to 31078 (keeping 200 days of data) [2025-10-14T21:46:01.006907] [DEBUG] [LOCAL ] SWX: Primary data saved (31078 records). [2025-10-14T21:46:01.007049] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-14T21:46:01.007128] [INFO ] [MAIN ] Update Progress: 2032/2369 symbols completed. SWX took 32.2s. Estimated remaining: 47m 25s. Rate: 7.1 symbols/min [2025-10-14T21:46:01.179045] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:01.193222] [DEBUG] [LOCAL ] SXI: Loaded 11865 existing records from primary storage. [2025-10-14T21:46:01.193479] [INFO ] [MAIN ] SXI: Loaded 11865 existing records. [2025-10-14T21:46:01.384687] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:01.384925] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-14T21:46:01.384974] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-14T21:46:01.385152] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-14T21:46:01.385210] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-14T21:46:01.562889] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-14T21:46:01.771565] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:46:02.100162] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-14T21:46:02.323420] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-14T21:46:02.329512] [INFO ] [REMOTE ] SW: Full fetch complete (77008 records). [2025-10-14T21:46:02.329715] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-14T21:46:02.363155] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-14T21:46:02.765453] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-14T21:46:02.765667] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-14T21:46:02.766873] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-14T21:46:02.766981] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-14T21:46:02.799527] [DEBUG] [LOCAL ] SW: Trimmed 77008 records to 53187 (keeping 200 days of data) [2025-10-14T21:46:02.801321] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T21:46:03.133773] [DEBUG] [LOCAL ] SW: Primary data saved (53187 records). [2025-10-14T21:46:03.133915] [INFO ] [MAIN ] SW: Full history saved. [2025-10-14T21:46:03.133999] [INFO ] [MAIN ] Update Progress: 2033/2369 symbols completed. SW took 52.3s. Estimated remaining: 47m 16s. Rate: 7.1 symbols/min [2025-10-14T21:46:03.163353] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-14T21:46:03.305619] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:03.336901] [DEBUG] [LOCAL ] SXT: Loaded 29919 existing records from primary storage. [2025-10-14T21:46:03.337175] [INFO ] [MAIN ] SXT: Loaded 29919 existing records. [2025-10-14T21:46:03.513107] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:03.513301] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-14T21:46:03.513347] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-14T21:46:03.513757] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-14T21:46:03.513830] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-14T21:46:03.867044] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:46:03.958043] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-14T21:46:04.346065] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T21:46:04.758044] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-14T21:46:04.863856] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T21:46:04.991601] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T21:46:05.558084] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-14T21:46:06.358246] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-14T21:46:06.362346] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T21:46:06.403157] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T21:46:06.409716] [INFO ] [REMOTE ] SWK: Full fetch complete (75502 records). [2025-10-14T21:46:06.409847] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-14T21:46:06.804966] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-14T21:46:06.805047] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-14T21:46:06.806192] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-14T21:46:06.806253] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-14T21:46:06.807577] [DEBUG] [LOCAL ] SWK: Trimmed 75502 records to 52481 (keeping 200 days of data) [2025-10-14T21:46:07.133095] [DEBUG] [LOCAL ] SWK: Primary data saved (52481 records). [2025-10-14T21:46:07.133222] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-14T21:46:07.133300] [INFO ] [MAIN ] Update Progress: 2034/2369 symbols completed. SWK took 38.6s. Estimated remaining: 47m 7s. Rate: 7.1 symbols/min [2025-10-14T21:46:07.163450] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-14T21:46:07.332983] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:07.383183] [DEBUG] [LOCAL ] SYF: Loaded 53453 existing records from primary storage. [2025-10-14T21:46:07.383514] [INFO ] [MAIN ] SYF: Loaded 53453 existing records. [2025-10-14T21:46:07.583892] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:07.584158] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-14T21:46:07.584215] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-14T21:46:07.584751] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-14T21:46:07.584808] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-14T21:46:07.982153] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:46:07.976792] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-14T21:46:07.985266] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T21:46:08.343214] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T21:46:08.639814] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-14T21:46:08.758096] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-14T21:46:09.558098] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-14T21:46:09.567371] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-14T21:46:10.358080] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-14T21:46:10.785123] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T21:46:11.158077] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-14T21:46:11.359118] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-14T21:46:11.688678] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T21:46:11.958047] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-14T21:46:12.751846] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T21:46:12.758019] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-14T21:46:13.558051] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-14T21:46:13.576018] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T21:46:14.358081] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-14T21:46:14.821271] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-14T21:46:15.158091] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-14T21:46:15.958099] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-14T21:46:16.339716] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-14T21:46:16.414811] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T21:46:16.758060] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-14T21:46:16.909532] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T21:46:17.558122] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-14T21:46:18.358084] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-14T21:46:18.580716] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T21:46:18.851400] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-14T21:46:19.158124] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-14T21:46:19.878946] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T21:46:19.958145] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-14T21:46:20.639997] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T21:46:20.758033] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-14T21:46:20.773462] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T21:46:21.558076] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-14T21:46:22.074741] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T21:46:22.358112] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-14T21:46:23.166562] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-14T21:46:23.191020] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T21:46:23.712742] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T21:46:23.782189] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-14T21:46:23.958072] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-14T21:46:24.758077] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-14T21:46:25.558035] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-14T21:46:25.638284] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T21:46:25.852823] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T21:46:26.358051] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-14T21:46:26.594198] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T21:46:26.598040] [INFO ] [REMOTE ] SXT: Full fetch complete (39360 records). [2025-10-14T21:46:26.598144] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-14T21:46:26.968261] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-14T21:46:26.968358] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-14T21:46:26.969287] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-14T21:46:26.969349] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-14T21:46:26.970306] [DEBUG] [LOCAL ] SXT: Trimmed 39360 records to 29849 (keeping 200 days of data) [2025-10-14T21:46:27.158706] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-14T21:46:27.164092] [DEBUG] [LOCAL ] SXT: Primary data saved (29849 records). [2025-10-14T21:46:27.164245] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-14T21:46:27.164330] [INFO ] [MAIN ] Update Progress: 2035/2369 symbols completed. SXT took 24.0s. Estimated remaining: 47m 0s. Rate: 7.1 symbols/min [2025-10-14T21:46:27.330967] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:27.373961] [DEBUG] [LOCAL ] SYK: Loaded 46939 existing records from primary storage. [2025-10-14T21:46:27.374269] [INFO ] [MAIN ] SYK: Loaded 46939 existing records. [2025-10-14T21:46:27.553146] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:27.553361] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-14T21:46:27.553408] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-14T21:46:27.553884] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-14T21:46:27.553943] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-14T21:46:27.900845] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:46:27.958053] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-14T21:46:28.237099] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T21:46:28.647143] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T21:46:28.758065] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-14T21:46:29.558053] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-14T21:46:29.632397] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T21:46:30.085786] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T21:46:30.090683] [INFO ] [REMOTE ] SXC: Full fetch complete (60995 records). [2025-10-14T21:46:30.090778] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-14T21:46:30.363259] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-14T21:46:30.473606] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-14T21:46:30.473708] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-14T21:46:30.474733] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-14T21:46:30.474794] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-14T21:46:30.475961] [DEBUG] [LOCAL ] SXC: Trimmed 60995 records to 41631 (keeping 200 days of data) [2025-10-14T21:46:30.719345] [DEBUG] [LOCAL ] SXC: Primary data saved (41631 records). [2025-10-14T21:46:30.719483] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-14T21:46:30.719558] [INFO ] [MAIN ] Update Progress: 2036/2369 symbols completed. SXC took 40.2s. Estimated remaining: 46m 51s. Rate: 7.1 symbols/min [2025-10-14T21:46:30.885958] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:30.934362] [DEBUG] [LOCAL ] SYY: Loaded 53240 existing records from primary storage. [2025-10-14T21:46:30.934847] [INFO ] [MAIN ] SYY: Loaded 53240 existing records. [2025-10-14T21:46:31.113692] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:31.113980] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-14T21:46:31.114052] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-14T21:46:31.114561] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-14T21:46:31.114617] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-14T21:46:31.177066] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-14T21:46:31.496921] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-14T21:46:31.500733] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:46:31.561378] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-14T21:46:31.958064] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-14T21:46:32.701281] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T21:46:32.758043] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-14T21:46:32.853197] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T21:46:33.558095] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-14T21:46:33.580520] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T21:46:33.582571] [INFO ] [REMOTE ] SXI: Full fetch complete (15420 records). [2025-10-14T21:46:33.582666] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-14T21:46:33.948384] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-14T21:46:33.948460] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-14T21:46:33.948848] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-14T21:46:33.948908] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-14T21:46:33.949398] [DEBUG] [LOCAL ] SXI: Trimmed 15420 records to 11927 (keeping 200 days of data) [2025-10-14T21:46:34.023397] [DEBUG] [LOCAL ] SXI: Primary data saved (11927 records). [2025-10-14T21:46:34.023525] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-14T21:46:34.023599] [INFO ] [MAIN ] Update Progress: 2037/2369 symbols completed. SXI took 33.0s. Estimated remaining: 46m 42s. Rate: 7.1 symbols/min [2025-10-14T21:46:34.358068] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-14T21:46:35.158087] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-14T21:46:35.321320] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T21:46:35.740290] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T21:46:35.958077] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-14T21:46:36.758050] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-14T21:46:36.823388] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T21:46:37.558085] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-14T21:46:37.778162] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T21:46:38.358102] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-14T21:46:38.786212] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-14T21:46:39.158103] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-14T21:46:39.639592] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-14T21:46:39.958095] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-14T21:46:40.187101] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T21:46:40.758045] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-14T21:46:40.867909] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:46:41.498734] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T21:46:41.558061] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-14T21:46:42.358067] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-14T21:46:42.501152] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T21:46:43.158065] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-14T21:46:43.304605] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T21:46:43.958072] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-14T21:46:44.000233] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T21:46:44.508083] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T21:46:44.568184] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T21:46:44.574307] [INFO ] [REMOTE ] SYF: Full fetch complete (77513 records). [2025-10-14T21:46:44.574468] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-14T21:46:44.774702] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-14T21:46:44.971536] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-14T21:46:44.971701] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-14T21:46:44.972918] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-14T21:46:44.972981] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-14T21:46:44.974454] [DEBUG] [LOCAL ] SYF: Trimmed 77513 records to 53453 (keeping 200 days of data) [2025-10-14T21:46:45.292376] [DEBUG] [LOCAL ] SYF: Primary data saved (53453 records). [2025-10-14T21:46:45.292508] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-14T21:46:45.292586] [INFO ] [MAIN ] Update Progress: 2038/2369 symbols completed. SYF took 38.2s. Estimated remaining: 46m 34s. Rate: 7.1 symbols/min [2025-10-14T21:46:45.558060] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-14T21:46:46.703599] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-14T21:46:46.716216] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-14T21:46:47.365984] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T21:46:47.376265] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-14T21:46:48.593507] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-14T21:46:48.604631] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-14T21:46:49.001054] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:46:49.010756] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-14T21:46:50.418683] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-14T21:46:50.429410] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-14T21:46:50.517431] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T21:46:50.527438] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-14T21:46:51.106541] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T21:46:51.112236] [INFO ] [REMOTE ] SYK: Full fetch complete (69069 records). [2025-10-14T21:46:51.112384] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-14T21:46:51.505213] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-14T21:46:51.505309] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-14T21:46:51.506556] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-14T21:46:51.506697] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-14T21:46:51.508121] [DEBUG] [LOCAL ] SYK: Trimmed 69069 records to 46923 (keeping 200 days of data) [2025-10-14T21:46:51.820261] [DEBUG] [LOCAL ] SYK: Primary data saved (46923 records). [2025-10-14T21:46:51.820410] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-14T21:46:51.820497] [INFO ] [MAIN ] Update Progress: 2039/2369 symbols completed. SYK took 24.7s. Estimated remaining: 46m 25s. Rate: 7.1 symbols/min [2025-10-14T21:46:52.171909] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T21:46:52.183378] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-14T21:46:53.760668] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-14T21:46:53.772009] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-14T21:46:55.631283] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T21:46:55.642700] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-14T21:46:56.244217] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T21:46:56.250184] [INFO ] [REMOTE ] SYY: Full fetch complete (77165 records). [2025-10-14T21:46:56.250290] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-14T21:46:56.666467] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-14T21:46:56.666554] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-14T21:46:56.667733] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-14T21:46:56.667826] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-14T21:46:56.669304] [DEBUG] [LOCAL ] SYY: Trimmed 77165 records to 53229 (keeping 200 days of data) [2025-10-14T21:46:57.020877] [DEBUG] [LOCAL ] SYY: Primary data saved (53229 records). [2025-10-14T21:46:57.021052] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-14T21:46:57.021167] [INFO ] [MAIN ] Update Progress: 2040/2369 symbols completed. SYY took 26.3s. Estimated remaining: 46m 16s. Rate: 7.1 symbols/min [2025-10-14T21:46:57.641272] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:57.679433] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:57.753513] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:57.776689] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:46:57.876584] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-14T21:46:57.877670] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-14T21:46:57.878457] [DEBUG] [LOCAL ] TAK: Loaded 50073 existing records from primary storage. [2025-10-14T21:46:57.922125] [INFO ] [MAIN ] TAK: Loaded 50073 existing records. [2025-10-14T21:46:57.975437] [DEBUG] [LOCAL ] TAL: Loaded 51801 existing records from primary storage. [2025-10-14T21:46:57.987455] [DEBUG] [LOCAL ] TAC: Loaded 42894 existing records from primary storage. [2025-10-14T21:46:57.986472] [INFO ] [MAIN ] TAL: Loaded 51801 existing records. [2025-10-14T21:46:58.074512] [INFO ] [MAIN ] TAC: Loaded 42894 existing records. [2025-10-14T21:46:58.481545] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:58.576010] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-14T21:46:58.544609] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:58.630378] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-14T21:46:58.615620] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-14T21:46:58.652380] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-14T21:46:58.669396] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-14T21:46:58.691939] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:58.697325] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:46:58.697553] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-14T21:46:58.697862] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-14T21:46:58.685495] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-14T21:46:58.697922] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-14T21:46:58.698285] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-14T21:46:58.698176] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-14T21:46:58.703843] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-14T21:46:58.703742] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-14T21:46:58.800552] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-14T21:46:58.785514] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-14T21:46:58.806230] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-14T21:47:00.110421] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:00.059727] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:00.184929] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-14T21:47:00.238226] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-14T21:47:00.232291] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:00.237931] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:00.239385] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-14T21:47:00.240301] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-14T21:47:01.877088] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T21:47:01.887262] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-14T21:47:01.966021] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:47:01.975870] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-14T21:47:02.061238] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T21:47:02.071958] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-14T21:47:02.810327] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-14T21:47:02.822209] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-14T21:47:03.292562] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T21:47:03.302350] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-14T21:47:03.413961] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T21:47:03.425885] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-14T21:47:03.551244] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T21:47:03.562535] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-14T21:47:04.845399] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T21:47:04.855417] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-14T21:47:04.941032] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:47:04.951784] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-14T21:47:04.984632] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-14T21:47:04.995855] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-14T21:47:05.044600] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T21:47:05.054606] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-14T21:47:06.453027] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T21:47:06.463352] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-14T21:47:06.544156] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T21:47:06.554230] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-14T21:47:06.656811] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T21:47:07.158037] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-14T21:47:07.342470] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-14T21:47:07.791382] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T21:47:07.873812] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T21:47:07.958035] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-14T21:47:08.753528] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-14T21:47:08.763903] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-14T21:47:09.210972] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-14T21:47:09.558049] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-14T21:47:10.231691] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T21:47:10.358071] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-14T21:47:11.158043] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-14T21:47:11.249987] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T21:47:11.958137] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-14T21:47:12.700355] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T21:47:12.758125] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-14T21:47:12.867730] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-14T21:47:13.343959] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T21:47:13.558050] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-14T21:47:14.356906] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T21:47:14.366077] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-14T21:47:14.795528] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T21:47:15.158062] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-14T21:47:15.958103] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-14T21:47:16.758069] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-14T21:47:16.866819] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-14T21:47:16.949121] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T21:47:17.492673] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T21:47:17.558035] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-14T21:47:18.358064] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-14T21:47:18.666235] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T21:47:19.107445] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T21:47:19.158070] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-14T21:47:19.958054] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-14T21:47:20.622448] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T21:47:20.656950] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T21:47:20.758061] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-14T21:47:21.558096] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-14T21:47:22.043844] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T21:47:22.069190] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T21:47:22.074868] [INFO ] [REMOTE ] TAC: Full fetch complete (64219 records). [2025-10-14T21:47:22.074982] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-14T21:47:22.367157] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-14T21:47:22.464334] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-14T21:47:22.464424] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-14T21:47:22.465536] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-14T21:47:22.465599] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-14T21:47:22.466914] [DEBUG] [LOCAL ] TAC: Trimmed 64219 records to 43001 (keeping 200 days of data) [2025-10-14T21:47:22.732152] [DEBUG] [LOCAL ] TAC: Primary data saved (43001 records). [2025-10-14T21:47:22.732383] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-14T21:47:22.732471] [INFO ] [MAIN ] Update Progress: 2041/2369 symbols completed. TAC took 25.7s. Estimated remaining: 46m 10s. Rate: 7.1 symbols/min [2025-10-14T21:47:22.924277] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:47:22.972519] [DEBUG] [LOCAL ] TALO: Loaded 50947 existing records from primary storage. [2025-10-14T21:47:22.972871] [INFO ] [MAIN ] TALO: Loaded 50947 existing records. [2025-10-14T21:47:23.157777] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:47:23.158050] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-14T21:47:23.158200] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-14T21:47:23.158086] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-14T21:47:23.159439] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-14T21:47:23.159500] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-14T21:47:23.518378] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:23.747922] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-14T21:47:23.818956] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T21:47:23.958078] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-14T21:47:24.758059] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-14T21:47:24.831683] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T21:47:25.560506] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-14T21:47:25.565784] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T21:47:26.358076] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-14T21:47:26.690789] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T21:47:26.755770] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T21:47:26.761521] [INFO ] [REMOTE ] TAL: Full fetch complete (75681 records). [2025-10-14T21:47:26.761639] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-14T21:47:27.166560] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-14T21:47:27.208808] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-14T21:47:27.208873] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-14T21:47:27.210010] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-14T21:47:27.210155] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-14T21:47:27.211537] [DEBUG] [LOCAL ] TAL: Trimmed 75681 records to 51795 (keeping 200 days of data) [2025-10-14T21:47:27.511821] [DEBUG] [LOCAL ] TAL: Primary data saved (51795 records). [2025-10-14T21:47:27.511965] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-14T21:47:27.512058] [INFO ] [MAIN ] Update Progress: 2042/2369 symbols completed. TAL took 30.5s. Estimated remaining: 46m 1s. Rate: 7.1 symbols/min [2025-10-14T21:47:27.683766] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:47:27.732269] [DEBUG] [LOCAL ] TAP: Loaded 52947 existing records from primary storage. [2025-10-14T21:47:27.732601] [INFO ] [MAIN ] TAP: Loaded 52947 existing records. [2025-10-14T21:47:27.890559] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T21:47:27.935420] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:47:27.935512] [INFO ] [REMOTE ] TAK: Full fetch complete (71917 records). [2025-10-14T21:47:27.935827] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-14T21:47:27.935891] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-14T21:47:27.935719] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-14T21:47:27.936394] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-14T21:47:27.936460] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-14T21:47:27.967490] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-14T21:47:28.706229] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:28.710041] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-14T21:47:28.710398] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-14T21:47:28.711685] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-14T21:47:28.711747] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-14T21:47:28.713068] [DEBUG] [LOCAL ] TAK: Trimmed 71917 records to 50104 (keeping 200 days of data) [2025-10-14T21:47:28.764334] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-14T21:47:29.013928] [DEBUG] [LOCAL ] TAK: Primary data saved (50104 records). [2025-10-14T21:47:29.014053] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-14T21:47:29.014130] [INFO ] [MAIN ] Update Progress: 2043/2369 symbols completed. TAK took 32.0s. Estimated remaining: 45m 52s. Rate: 7.1 symbols/min [2025-10-14T21:47:29.185764] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:47:29.198404] [DEBUG] [LOCAL ] TBB: Loaded 11602 existing records from primary storage. [2025-10-14T21:47:29.198620] [INFO ] [MAIN ] TBB: Loaded 11602 existing records. [2025-10-14T21:47:29.380529] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:47:29.380758] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-14T21:47:29.380824] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-14T21:47:29.381114] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-14T21:47:29.381180] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-14T21:47:29.784129] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:29.784605] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-14T21:47:29.788170] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T21:47:29.834840] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-14T21:47:30.317609] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T21:47:30.358021] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-14T21:47:30.883131] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T21:47:31.158101] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-14T21:47:31.958089] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-14T21:47:32.015907] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T21:47:32.651615] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T21:47:32.758049] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-14T21:47:33.558075] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-14T21:47:33.698938] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T21:47:34.100683] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-14T21:47:34.358100] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-14T21:47:35.058111] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T21:47:35.158072] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-14T21:47:35.884358] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-14T21:47:35.947442] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T21:47:35.958195] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-14T21:47:36.758061] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-14T21:47:37.558057] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-14T21:47:37.617557] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T21:47:38.346051] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T21:47:38.358024] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-14T21:47:38.599906] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T21:47:39.158041] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-14T21:47:39.193867] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T21:47:39.958064] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-14T21:47:40.758043] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-14T21:47:40.939344] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T21:47:41.558030] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-14T21:47:41.665574] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T21:47:41.706742] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-14T21:47:42.358069] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-14T21:47:43.153036] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T21:47:43.163396] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-14T21:47:43.170895] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T21:47:43.958054] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-14T21:47:44.758799] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-14T21:47:44.760248] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-14T21:47:44.963450] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-14T21:47:45.558060] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-14T21:47:46.335515] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T21:47:46.358033] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-14T21:47:46.495729] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T21:47:47.118883] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T21:47:47.158036] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-14T21:47:47.812292] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T21:47:47.814578] [INFO ] [REMOTE ] TBB: Full fetch complete (16820 records). [2025-10-14T21:47:47.814712] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-14T21:47:47.963181] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-14T21:47:48.198338] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-14T21:47:48.198422] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-14T21:47:48.198823] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-14T21:47:48.198885] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-14T21:47:48.199406] [DEBUG] [LOCAL ] TBB: Trimmed 16820 records to 11578 (keeping 200 days of data) [2025-10-14T21:47:48.266450] [DEBUG] [LOCAL ] TBB: Primary data saved (11578 records). [2025-10-14T21:47:48.266573] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-14T21:47:48.266673] [INFO ] [MAIN ] Update Progress: 2044/2369 symbols completed. TBB took 19.3s. Estimated remaining: 45m 45s. Rate: 7.1 symbols/min [2025-10-14T21:47:48.434365] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:47:48.468610] [DEBUG] [LOCAL ] TBBB: Loaded 35826 existing records from primary storage. [2025-10-14T21:47:48.468915] [INFO ] [MAIN ] TBBB: Loaded 35826 existing records. [2025-10-14T21:47:48.647532] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:47:48.648019] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-14T21:47:48.648176] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-14T21:47:48.653930] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-14T21:47:48.664810] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-14T21:47:48.698787] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:47:48.771192] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-14T21:47:48.771358] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-14T21:47:48.774859] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-14T21:47:49.350309] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:49.449609] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-14T21:47:49.449727] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-14T21:47:49.450874] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-14T21:47:49.450941] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-14T21:47:49.452515] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 53798 (keeping 200 days of data) [2025-10-14T21:47:49.558474] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-14T21:47:49.782755] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-14T21:47:49.782893] [INFO ] [MAIN ] T: Full history saved. [2025-10-14T21:47:49.782972] [INFO ] [MAIN ] Update Progress: 2045/2369 symbols completed. T took 52.8s. Estimated remaining: 45m 36s. Rate: 7.1 symbols/min [2025-10-14T21:47:49.955209] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:47:49.976212] [DEBUG] [LOCAL ] TBI: Loaded 22509 existing records from primary storage. [2025-10-14T21:47:49.976452] [INFO ] [MAIN ] TBI: Loaded 22509 existing records. [2025-10-14T21:47:50.154865] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:47:50.155058] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-14T21:47:50.155112] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-14T21:47:50.155382] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-14T21:47:50.155439] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-14T21:47:50.378669] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-14T21:47:50.528354] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:50.696938] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T21:47:50.728705] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T21:47:51.158091] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-14T21:47:51.879544] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T21:47:51.958027] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-14T21:47:52.758036] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-14T21:47:52.869724] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T21:47:53.558036] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-14T21:47:53.587905] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:47:53.819614] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T21:47:54.080578] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T21:47:54.358062] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-14T21:47:55.010306] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T21:47:55.016196] [INFO ] [REMOTE ] TAP: Full fetch complete (76418 records). [2025-10-14T21:47:55.016307] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-14T21:47:55.159330] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-14T21:47:55.407302] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-14T21:47:55.407376] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-14T21:47:55.408517] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-14T21:47:55.408578] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-14T21:47:55.410102] [DEBUG] [LOCAL ] TAP: Trimmed 76418 records to 52960 (keeping 200 days of data) [2025-10-14T21:47:55.727400] [DEBUG] [LOCAL ] TAP: Primary data saved (52960 records). [2025-10-14T21:47:55.727531] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-14T21:47:55.727607] [INFO ] [MAIN ] Update Progress: 2046/2369 symbols completed. TAP took 28.2s. Estimated remaining: 45m 27s. Rate: 7.1 symbols/min [2025-10-14T21:47:55.902882] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:47:55.903087] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-14T21:47:55.903127] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-14T21:47:55.903237] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-14T21:47:55.903277] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-14T21:47:55.903319] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-14T21:47:55.903350] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-14T21:47:55.968415] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-14T21:47:56.266418] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:47:56.758047] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-14T21:47:56.861181] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T21:47:56.963984] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T21:47:57.558089] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-14T21:47:57.609095] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T21:47:57.900903] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-14T21:47:58.358118] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-14T21:47:58.711605] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-14T21:47:59.158064] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-14T21:47:59.958106] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-14T21:48:00.293016] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-14T21:48:00.667578] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T21:48:00.758065] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-14T21:48:01.103296] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-14T21:48:01.558059] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-14T21:48:01.905456] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-14T21:48:02.358082] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-14T21:48:03.158063] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-14T21:48:03.395959] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T21:48:03.958042] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-14T21:48:04.258896] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T21:48:04.758122] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-14T21:48:05.114197] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-14T21:48:05.493510] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T21:48:05.500489] [INFO ] [REMOTE ] TALO: Full fetch complete (73429 records). [2025-10-14T21:48:05.500686] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-14T21:48:05.563294] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-14T21:48:05.960948] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-14T21:48:05.961026] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-14T21:48:05.962142] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-14T21:48:05.962203] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-14T21:48:05.963616] [DEBUG] [LOCAL ] TALO: Trimmed 73429 records to 50962 (keeping 200 days of data) [2025-10-14T21:48:06.257247] [DEBUG] [LOCAL ] TALO: Primary data saved (50962 records). [2025-10-14T21:48:06.257385] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-14T21:48:06.257473] [INFO ] [MAIN ] Update Progress: 2047/2369 symbols completed. TALO took 43.5s. Estimated remaining: 45m 19s. Rate: 7.1 symbols/min [2025-10-14T21:48:06.360741] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-14T21:48:06.435030] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:06.441663] [DEBUG] [LOCAL ] TBN: Loaded 3906 existing records from primary storage. [2025-10-14T21:48:06.441853] [INFO ] [MAIN ] TBN: Loaded 3906 existing records. [2025-10-14T21:48:06.621968] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:48:06.622203] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-14T21:48:06.622257] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-14T21:48:06.622434] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-14T21:48:06.622476] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-14T21:48:06.813982] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-14T21:48:06.937485] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T21:48:07.014141] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:07.158142] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-14T21:48:07.958037] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-14T21:48:08.436936] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-14T21:48:08.439750] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T21:48:08.758068] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-14T21:48:09.558048] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-14T21:48:09.960083] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-14T21:48:10.127380] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T21:48:10.358074] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-14T21:48:10.961086] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-14T21:48:11.158097] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-14T21:48:11.512032] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-14T21:48:11.958081] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-14T21:48:12.758084] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-14T21:48:13.102664] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-14T21:48:13.533138] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T21:48:13.558047] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-14T21:48:14.358069] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-14T21:48:14.697459] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T21:48:14.963727] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T21:48:15.158104] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-14T21:48:15.735803] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-14T21:48:15.958074] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-14T21:48:16.758074] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-14T21:48:17.100874] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T21:48:17.101798] [INFO ] [REMOTE ] TBLU: Full fetch complete (1210 records). [2025-10-14T21:48:17.101949] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-14T21:48:17.289501] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-14T21:48:17.289715] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-14T21:48:17.289794] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-14T21:48:17.289878] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-14T21:48:17.290045] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-14T21:48:17.290114] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-14T21:48:17.290203] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-14T21:48:17.290324] [INFO ] [MAIN ] Update Progress: 2048/2369 symbols completed. TBLU took 21.6s. Estimated remaining: 45m 11s. Rate: 7.1 symbols/min [2025-10-14T21:48:17.420209] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T21:48:17.496049] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:17.496170] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-14T21:48:17.496210] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-14T21:48:17.496321] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-14T21:48:17.496361] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-14T21:48:17.496403] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-14T21:48:17.496436] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-14T21:48:17.563151] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-14T21:48:17.866562] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:18.043546] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-14T21:48:18.358070] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-14T21:48:18.778695] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-14T21:48:19.158092] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-14T21:48:19.958047] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-14T21:48:20.187149] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T21:48:20.758089] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-14T21:48:21.210285] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T21:48:21.478393] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T21:48:21.558056] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-14T21:48:22.105727] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-14T21:48:22.358070] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-14T21:48:22.558516] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:48:22.558815] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-14T21:48:22.558977] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:48:22.559066] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-14T21:48:22.559133] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:48:22.559224] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-14T21:48:22.559286] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-14T21:48:22.559320] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-14T21:48:22.559358] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-14T21:48:22.559404] [INFO ] [MAIN ] Update Progress: 2049/2369 symbols completed. TCAI took 5.3s. Estimated remaining: 45m 2s. Rate: 7.1 symbols/min [2025-10-14T21:48:22.729234] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:22.740377] [DEBUG] [LOCAL ] TCBX: Loaded 10156 existing records from primary storage. [2025-10-14T21:48:22.740666] [INFO ] [MAIN ] TCBX: Loaded 10156 existing records. [2025-10-14T21:48:22.941708] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:48:22.941944] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-14T21:48:22.941991] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-14T21:48:22.942149] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-14T21:48:22.942201] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-14T21:48:23.163283] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-14T21:48:23.296248] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:23.766601] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-14T21:48:23.958050] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-14T21:48:24.758111] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-14T21:48:25.020761] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T21:48:25.463440] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T21:48:25.558058] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-14T21:48:26.275446] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-14T21:48:26.277998] [INFO ] [REMOTE ] TBN: Full fetch complete (5841 records). [2025-10-14T21:48:26.278131] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-14T21:48:26.363178] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-14T21:48:26.670856] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-14T21:48:26.670937] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-14T21:48:26.671124] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-14T21:48:26.671164] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-14T21:48:26.671555] [DEBUG] [LOCAL ] TBN: Trimmed 5841 records to 3909 (keeping 200 days of data) [2025-10-14T21:48:26.694382] [DEBUG] [LOCAL ] TBN: Primary data saved (3909 records). [2025-10-14T21:48:26.694502] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-14T21:48:26.694577] [INFO ] [MAIN ] Update Progress: 2050/2369 symbols completed. TBN took 20.4s. Estimated remaining: 44m 53s. Rate: 7.1 symbols/min [2025-10-14T21:48:26.868993] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:26.917196] [DEBUG] [LOCAL ] TD: Loaded 52324 existing records from primary storage. [2025-10-14T21:48:26.917514] [INFO ] [MAIN ] TD: Loaded 52324 existing records. [2025-10-14T21:48:27.101496] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:48:27.101786] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-14T21:48:27.101913] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-14T21:48:27.102475] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-14T21:48:27.102533] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-14T21:48:27.167531] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-14T21:48:27.339192] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-14T21:48:27.487510] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:27.958069] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-14T21:48:28.579255] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T21:48:28.758101] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-14T21:48:29.016325] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T21:48:29.558062] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-14T21:48:30.358078] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-14T21:48:30.632298] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T21:48:30.654631] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-14T21:48:31.158075] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-14T21:48:31.640053] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T21:48:31.958067] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-14T21:48:32.758059] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-14T21:48:32.962960] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-14T21:48:33.019529] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T21:48:33.023797] [INFO ] [REMOTE ] TBBB: Full fetch complete (51799 records). [2025-10-14T21:48:33.023887] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-14T21:48:33.417467] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-14T21:48:33.417546] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-14T21:48:33.418501] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-14T21:48:33.418562] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-14T21:48:33.419590] [DEBUG] [LOCAL ] TBBB: Trimmed 51799 records to 35845 (keeping 200 days of data) [2025-10-14T21:48:33.577555] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-14T21:48:33.636143] [DEBUG] [LOCAL ] TBBB: Primary data saved (35845 records). [2025-10-14T21:48:33.636272] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-14T21:48:33.636349] [INFO ] [MAIN ] Update Progress: 2051/2369 symbols completed. TBBB took 45.4s. Estimated remaining: 44m 44s. Rate: 7.1 symbols/min [2025-10-14T21:48:33.823906] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:33.820424] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T21:48:33.868738] [DEBUG] [LOCAL ] TDC: Loaded 46559 existing records from primary storage. [2025-10-14T21:48:33.869041] [INFO ] [MAIN ] TDC: Loaded 46559 existing records. [2025-10-14T21:48:34.043109] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:48:34.043334] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-14T21:48:34.043414] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-14T21:48:34.043801] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-14T21:48:34.043874] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-14T21:48:34.364980] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-14T21:48:34.406391] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:35.158108] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-14T21:48:35.232744] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T21:48:35.276184] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T21:48:35.278933] [INFO ] [REMOTE ] TBI: Full fetch complete (31776 records). [2025-10-14T21:48:35.279006] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-14T21:48:35.654334] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-14T21:48:35.654464] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-14T21:48:35.655238] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-14T21:48:35.655301] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-14T21:48:35.656088] [DEBUG] [LOCAL ] TBI: Trimmed 31776 records to 22516 (keeping 200 days of data) [2025-10-14T21:48:35.775625] [DEBUG] [LOCAL ] TBI: Primary data saved (22516 records). [2025-10-14T21:48:35.775766] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-14T21:48:35.775843] [INFO ] [MAIN ] Update Progress: 2052/2369 symbols completed. TBI took 46.0s. Estimated remaining: 44m 34s. Rate: 7.1 symbols/min [2025-10-14T21:48:35.948420] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:35.957259] [DEBUG] [LOCAL ] TDF: Loaded 6364 existing records from primary storage. [2025-10-14T21:48:35.957598] [INFO ] [MAIN ] TDF: Loaded 6364 existing records. [2025-10-14T21:48:35.974084] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-14T21:48:36.013019] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T21:48:36.155496] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:48:36.155760] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-14T21:48:36.155815] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-14T21:48:36.155987] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-14T21:48:36.156029] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-14T21:48:36.516010] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:36.758084] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-14T21:48:37.558056] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-14T21:48:37.595952] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-14T21:48:37.737265] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-14T21:48:38.317817] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T21:48:38.358086] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-14T21:48:39.158059] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-14T21:48:39.903606] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T21:48:39.958047] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-14T21:48:40.017692] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T21:48:40.758091] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-14T21:48:41.468088] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T21:48:41.483695] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-14T21:48:41.558087] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-14T21:48:42.358066] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-14T21:48:43.011702] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T21:48:43.158069] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-14T21:48:43.958053] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-14T21:48:44.165082] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T21:48:44.402296] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T21:48:44.758035] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-14T21:48:44.849166] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T21:48:45.176154] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T21:48:45.558052] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-14T21:48:46.315305] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-14T21:48:46.358057] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-14T21:48:47.124305] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T21:48:47.158044] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-14T21:48:47.958043] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-14T21:48:47.966688] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-14T21:48:48.596378] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T21:48:48.758120] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-14T21:48:49.487454] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-14T21:48:49.558094] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-14T21:48:50.258579] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T21:48:50.358078] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-14T21:48:50.939631] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T21:48:51.158065] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-14T21:48:51.789715] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-14T21:48:51.958151] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-14T21:48:52.758109] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-14T21:48:53.558056] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-14T21:48:53.794972] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T21:48:53.969136] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-14T21:48:54.358049] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-14T21:48:54.413460] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T21:48:55.158112] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-14T21:48:55.958088] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-14T21:48:56.060719] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T21:48:56.429754] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T21:48:56.431781] [INFO ] [REMOTE ] TCBX: Full fetch complete (15893 records). [2025-10-14T21:48:56.431860] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-14T21:48:56.759286] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-14T21:48:56.833121] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-14T21:48:56.833590] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-14T21:48:56.834052] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-14T21:48:56.834216] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-14T21:48:56.847977] [DEBUG] [LOCAL ] TCBX: Trimmed 15893 records to 10162 (keeping 200 days of data) [2025-10-14T21:48:56.908486] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T21:48:56.937759] [DEBUG] [LOCAL ] TCBX: Primary data saved (10162 records). [2025-10-14T21:48:56.937946] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-14T21:48:56.938040] [INFO ] [MAIN ] Update Progress: 2053/2369 symbols completed. TCBX took 34.4s. Estimated remaining: 44m 28s. Rate: 7.1 symbols/min [2025-10-14T21:48:57.107046] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:48:57.130295] [DEBUG] [LOCAL ] TDG: Loaded 22020 existing records from primary storage. [2025-10-14T21:48:57.130551] [INFO ] [MAIN ] TDG: Loaded 22020 existing records. [2025-10-14T21:48:57.303939] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:48:57.304143] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-14T21:48:57.304188] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-14T21:48:57.304399] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-14T21:48:57.304454] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-14T21:48:57.563224] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-14T21:48:57.658068] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:48:58.261229] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T21:48:58.358101] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-14T21:48:58.648461] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T21:48:59.158059] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-14T21:48:59.824064] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T21:48:59.958046] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-14T21:49:00.758043] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-14T21:49:00.896594] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T21:49:01.364090] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:49:01.558058] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-14T21:49:01.884365] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T21:49:02.358102] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-14T21:49:02.957290] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-14T21:49:03.158047] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-14T21:49:03.197602] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T21:49:03.958066] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-14T21:49:04.758044] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-14T21:49:04.922172] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T21:49:04.966937] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T21:49:05.180285] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T21:49:05.181625] [INFO ] [REMOTE ] TDF: Full fetch complete (10485 records). [2025-10-14T21:49:05.181713] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-14T21:49:05.553471] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-14T21:49:05.553574] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-14T21:49:05.553929] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-14T21:49:05.553985] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-14T21:49:05.554395] [DEBUG] [LOCAL ] TDF: Trimmed 10485 records to 6356 (keeping 200 days of data) [2025-10-14T21:49:05.570877] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-14T21:49:05.593955] [DEBUG] [LOCAL ] TDF: Primary data saved (6356 records). [2025-10-14T21:49:05.594037] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-14T21:49:05.594107] [INFO ] [MAIN ] Update Progress: 2054/2369 symbols completed. TDF took 29.8s. Estimated remaining: 44m 20s. Rate: 7.1 symbols/min [2025-10-14T21:49:05.767585] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:05.821509] [DEBUG] [LOCAL ] TDOC: Loaded 53359 existing records from primary storage. [2025-10-14T21:49:05.821892] [INFO ] [MAIN ] TDOC: Loaded 53359 existing records. [2025-10-14T21:49:05.998202] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:49:05.998449] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-14T21:49:05.998497] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-14T21:49:05.999105] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-14T21:49:05.999163] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-14T21:49:06.364003] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-14T21:49:06.363938] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:07.095809] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T21:49:07.101481] [INFO ] [REMOTE ] TD: Full fetch complete (75913 records). [2025-10-14T21:49:07.101597] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-14T21:49:07.164484] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-14T21:49:07.494900] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-14T21:49:07.494985] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-14T21:49:07.496130] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-14T21:49:07.496191] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-14T21:49:07.497608] [DEBUG] [LOCAL ] TD: Trimmed 75913 records to 52344 (keeping 200 days of data) [2025-10-14T21:49:07.849530] [DEBUG] [LOCAL ] TD: Primary data saved (52344 records). [2025-10-14T21:49:07.849709] [INFO ] [MAIN ] TD: Full history saved. [2025-10-14T21:49:07.849828] [INFO ] [MAIN ] Update Progress: 2055/2369 symbols completed. TD took 41.2s. Estimated remaining: 44m 10s. Rate: 7.1 symbols/min [2025-10-14T21:49:07.963167] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-14T21:49:08.068927] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:08.071214] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T21:49:08.115997] [DEBUG] [LOCAL ] TDS: Loaded 42515 existing records from primary storage. [2025-10-14T21:49:08.116281] [INFO ] [MAIN ] TDS: Loaded 42515 existing records. [2025-10-14T21:49:08.292025] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:49:08.292214] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-14T21:49:08.292260] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-14T21:49:08.293065] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-14T21:49:08.293121] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-14T21:49:08.481966] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T21:49:08.666325] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:08.758032] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-14T21:49:09.558094] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-14T21:49:09.863100] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T21:49:10.248520] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T21:49:10.358027] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-14T21:49:10.802834] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T21:49:10.808364] [INFO ] [REMOTE ] TDC: Full fetch complete (67505 records). [2025-10-14T21:49:10.808504] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-14T21:49:11.175411] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-14T21:49:11.198325] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-14T21:49:11.198418] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-14T21:49:11.199565] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-14T21:49:11.199678] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-14T21:49:11.201191] [DEBUG] [LOCAL ] TDC: Trimmed 67505 records to 46557 (keeping 200 days of data) [2025-10-14T21:49:11.467614] [DEBUG] [LOCAL ] TDC: Primary data saved (46557 records). [2025-10-14T21:49:11.467759] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-14T21:49:11.467865] [INFO ] [MAIN ] Update Progress: 2056/2369 symbols completed. TDC took 37.8s. Estimated remaining: 44m 1s. Rate: 7.1 symbols/min [2025-10-14T21:49:11.643894] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:11.684278] [DEBUG] [LOCAL ] TDW: Loaded 45054 existing records from primary storage. [2025-10-14T21:49:11.684566] [INFO ] [MAIN ] TDW: Loaded 45054 existing records. [2025-10-14T21:49:11.871950] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:49:11.872343] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-14T21:49:11.872484] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-14T21:49:11.880095] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-14T21:49:11.892556] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-14T21:49:11.926127] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:49:11.970462] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-14T21:49:12.260943] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:12.347704] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T21:49:12.758103] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-14T21:49:13.558087] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-14T21:49:14.090489] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-14T21:49:14.134692] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T21:49:14.358122] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-14T21:49:14.941420] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T21:49:15.158060] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-14T21:49:15.958049] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-14T21:49:16.016979] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T21:49:16.758053] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-14T21:49:16.858300] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T21:49:17.175391] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T21:49:17.558052] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-14T21:49:18.150264] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T21:49:18.358063] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-14T21:49:18.846043] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T21:49:19.158136] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-14T21:49:19.958078] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-14T21:49:19.998440] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:49:20.670233] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T21:49:20.758027] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-14T21:49:21.558096] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-14T21:49:22.277145] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T21:49:22.278762] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-14T21:49:22.358029] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-14T21:49:22.634516] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T21:49:23.158076] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-14T21:49:23.958038] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-14T21:49:24.291583] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T21:49:24.430395] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-14T21:49:24.758077] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-14T21:49:25.568760] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-14T21:49:25.572587] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T21:49:25.629029] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T21:49:26.358116] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-14T21:49:27.158161] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-14T21:49:27.729539] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T21:49:27.958040] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-14T21:49:28.120859] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T21:49:28.406674] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T21:49:28.758073] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-14T21:49:29.558047] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-14T21:49:30.006030] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-14T21:49:30.307509] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T21:49:30.358041] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-14T21:49:31.158108] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-14T21:49:31.340394] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T21:49:31.682975] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T21:49:31.687577] [INFO ] [REMOTE ] TDS: Full fetch complete (61560 records). [2025-10-14T21:49:31.687742] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-14T21:49:31.963347] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-14T21:49:32.076342] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-14T21:49:32.076427] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-14T21:49:32.077531] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-14T21:49:32.077592] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-14T21:49:32.078839] [DEBUG] [LOCAL ] TDS: Trimmed 61560 records to 42481 (keeping 200 days of data) [2025-10-14T21:49:32.331886] [DEBUG] [LOCAL ] TDS: Primary data saved (42481 records). [2025-10-14T21:49:32.332023] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-14T21:49:32.332104] [INFO ] [MAIN ] Update Progress: 2057/2369 symbols completed. TDS took 24.5s. Estimated remaining: 43m 54s. Rate: 7.1 symbols/min [2025-10-14T21:49:32.497471] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:32.520121] [DEBUG] [LOCAL ] TDY: Loaded 22351 existing records from primary storage. [2025-10-14T21:49:32.520408] [INFO ] [MAIN ] TDY: Loaded 22351 existing records. [2025-10-14T21:49:32.699795] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:49:32.699996] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-14T21:49:32.700043] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-14T21:49:32.700451] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-14T21:49:32.700507] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-14T21:49:32.768639] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-14T21:49:33.062056] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:33.129095] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T21:49:33.563149] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-14T21:49:33.579012] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T21:49:34.015465] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-14T21:49:34.358117] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-14T21:49:35.158105] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-14T21:49:35.530867] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T21:49:35.719764] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-14T21:49:35.958081] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-14T21:49:36.126498] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.17 seconds). [2025-10-14T21:49:36.129533] [INFO ] [REMOTE ] TDG: Full fetch complete (31833 records). [2025-10-14T21:49:36.129608] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-14T21:49:36.508702] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-14T21:49:36.508789] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-14T21:49:36.509428] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-14T21:49:36.509469] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-14T21:49:36.510705] [DEBUG] [LOCAL ] TDG: Trimmed 31833 records to 22050 (keeping 200 days of data) [2025-10-14T21:49:36.655172] [DEBUG] [LOCAL ] TDG: Primary data saved (22050 records). [2025-10-14T21:49:36.655301] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-14T21:49:36.655380] [INFO ] [MAIN ] Update Progress: 2058/2369 symbols completed. TDG took 39.7s. Estimated remaining: 43m 45s. Rate: 7.1 symbols/min [2025-10-14T21:49:36.758891] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-14T21:49:36.836461] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:36.836844] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-14T21:49:36.836940] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-14T21:49:36.837215] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-14T21:49:36.837339] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-14T21:49:36.837584] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-14T21:49:36.837703] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-14T21:49:36.995536] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T21:49:37.233855] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:37.558087] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-14T21:49:37.937574] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T21:49:38.358061] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-14T21:49:39.158070] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-14T21:49:39.360544] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:49:39.360921] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-14T21:49:39.361043] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:49:39.361124] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-14T21:49:39.361189] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:49:39.361266] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-14T21:49:39.361328] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-14T21:49:39.361366] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-14T21:49:39.361406] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-14T21:49:39.361452] [INFO ] [MAIN ] Update Progress: 2059/2369 symbols completed. TE took 2.7s. Estimated remaining: 43m 36s. Rate: 7.1 symbols/min [2025-10-14T21:49:39.538464] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:39.551724] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-14T21:49:39.591546] [DEBUG] [LOCAL ] TEAF: Loaded 7378 existing records from primary storage. [2025-10-14T21:49:39.593845] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T21:49:39.594060] [INFO ] [MAIN ] TEAF: Loaded 7378 existing records. [2025-10-14T21:49:39.785949] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:49:39.786150] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-14T21:49:39.786197] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-14T21:49:39.786468] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-14T21:49:39.786524] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-14T21:49:39.958109] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-14T21:49:40.136703] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:40.758069] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-14T21:49:41.258420] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-14T21:49:41.558059] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-14T21:49:42.358037] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-14T21:49:42.787547] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T21:49:42.852780] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-14T21:49:43.155206] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T21:49:43.164232] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-14T21:49:43.958047] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-14T21:49:44.384049] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T21:49:44.394570] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-14T21:49:44.758056] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-14T21:49:45.558042] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-14T21:49:45.650517] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-14T21:49:46.133572] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T21:49:46.358069] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-14T21:49:47.095788] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T21:49:47.158049] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-14T21:49:47.958082] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-14T21:49:48.758115] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-14T21:49:49.100070] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-14T21:49:49.105852] [INFO ] [REMOTE ] TDOC: Full fetch complete (77431 records). [2025-10-14T21:49:49.105964] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-14T21:49:49.534534] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-14T21:49:49.534639] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-14T21:49:49.535947] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-14T21:49:49.536008] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-14T21:49:49.537559] [DEBUG] [LOCAL ] TDOC: Trimmed 77431 records to 53362 (keeping 200 days of data) [2025-10-14T21:49:49.582531] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-14T21:49:49.605195] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T21:49:49.687350] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-14T21:49:49.895563] [DEBUG] [LOCAL ] TDOC: Primary data saved (53362 records). [2025-10-14T21:49:49.895732] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-14T21:49:49.895822] [INFO ] [MAIN ] Update Progress: 2060/2369 symbols completed. TDOC took 44.3s. Estimated remaining: 43m 28s. Rate: 7.1 symbols/min [2025-10-14T21:49:50.068274] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:50.115200] [DEBUG] [LOCAL ] TECK: Loaded 53437 existing records from primary storage. [2025-10-14T21:49:50.115562] [INFO ] [MAIN ] TECK: Loaded 53437 existing records. [2025-10-14T21:49:50.294955] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:49:50.295210] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-14T21:49:50.295255] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-14T21:49:50.296297] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-14T21:49:50.296354] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-14T21:49:50.361666] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-14T21:49:50.671807] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:49:50.685895] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T21:49:51.158045] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-14T21:49:51.186694] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T21:49:51.958075] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-14T21:49:52.542113] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T21:49:52.758073] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-14T21:49:53.124348] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T21:49:53.175114] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T21:49:53.558068] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-14T21:49:54.358114] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-14T21:49:55.158089] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-14T21:49:55.337763] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-14T21:49:55.371729] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T21:49:55.895802] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T21:49:55.958024] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-14T21:49:56.656930] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T21:49:56.758097] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-14T21:49:57.558061] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-14T21:49:57.816600] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:49:58.358113] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-14T21:49:58.813577] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-14T21:49:58.815802] [INFO ] [REMOTE ] TDY: Full fetch complete (31924 records). [2025-10-14T21:49:58.815872] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-14T21:49:59.001206] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T21:49:59.088590] [INFO ] [REMOTE ] TDW: Full fetch complete (66969 records). [2025-10-14T21:49:59.100517] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-14T21:49:59.168407] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-14T21:49:59.323316] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-14T21:49:59.323762] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-14T21:49:59.350450] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-14T21:49:59.368961] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-14T21:49:59.473795] [DEBUG] [LOCAL ] TDY: Trimmed 31924 records to 22273 (keeping 200 days of data) [2025-10-14T21:49:59.731361] [DEBUG] [LOCAL ] TDY: Primary data saved (22273 records). [2025-10-14T21:49:59.748293] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-14T21:49:59.754597] [INFO ] [MAIN ] Update Progress: 2061/2369 symbols completed. TDY took 27.4s. Estimated remaining: 43m 20s. Rate: 7.1 symbols/min [2025-10-14T21:49:59.840639] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-14T21:49:59.846483] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-14T21:49:59.878505] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-14T21:49:59.884269] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-14T21:49:59.950427] [DEBUG] [LOCAL ] TDW: Trimmed 66969 records to 45073 (keeping 200 days of data) [2025-10-14T21:49:59.950322] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:49:59.997637] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-14T21:50:00.045949] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T21:50:00.184181] [DEBUG] [LOCAL ] TEF: Loaded 37026 existing records from primary storage. [2025-10-14T21:50:00.203223] [INFO ] [MAIN ] TEF: Loaded 37026 existing records. [2025-10-14T21:50:00.379573] [DEBUG] [LOCAL ] TDW: Primary data saved (45073 records). [2025-10-14T21:50:00.402964] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-14T21:50:00.413707] [INFO ] [MAIN ] Update Progress: 2062/2369 symbols completed. TDW took 48.9s. Estimated remaining: 43m 10s. Rate: 7.1 symbols/min [2025-10-14T21:50:00.444534] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:00.477212] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-14T21:50:00.504419] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-14T21:50:00.537448] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-14T21:50:00.537662] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-14T21:50:00.719724] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:50:00.758428] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-14T21:50:00.956941] [DEBUG] [LOCAL ] TEI: Loaded 21428 existing records from primary storage. [2025-10-14T21:50:00.985450] [INFO ] [MAIN ] TEI: Loaded 21428 existing records. [2025-10-14T21:50:00.985347] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:01.160487] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:01.160691] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-14T21:50:01.160748] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-14T21:50:01.161147] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-14T21:50:01.161203] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-14T21:50:01.517154] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:01.558111] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-14T21:50:01.579746] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T21:50:01.581082] [INFO ] [REMOTE ] TEAF: Full fetch complete (9972 records). [2025-10-14T21:50:01.581147] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-14T21:50:01.891353] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T21:50:01.997871] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-14T21:50:01.997956] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-14T21:50:01.998197] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-14T21:50:01.998235] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-14T21:50:01.998748] [DEBUG] [LOCAL ] TEAF: Trimmed 9972 records to 7317 (keeping 200 days of data) [2025-10-14T21:50:02.043405] [DEBUG] [LOCAL ] TEAF: Primary data saved (7317 records). [2025-10-14T21:50:02.043542] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-14T21:50:02.043621] [INFO ] [MAIN ] Update Progress: 2063/2369 symbols completed. TEAF took 22.7s. Estimated remaining: 43m 1s. Rate: 7.1 symbols/min [2025-10-14T21:50:02.212790] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:50:02.265009] [DEBUG] [LOCAL ] TEL: Loaded 51074 existing records from primary storage. [2025-10-14T21:50:02.266234] [INFO ] [MAIN ] TEL: Loaded 51074 existing records. [2025-10-14T21:50:02.364735] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-14T21:50:02.446408] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:02.446683] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-14T21:50:02.446739] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-14T21:50:02.448171] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-14T21:50:02.448230] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-14T21:50:02.735754] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T21:50:02.813584] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:03.158060] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-14T21:50:03.823034] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T21:50:03.958068] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-14T21:50:04.758065] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-14T21:50:04.889706] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:50:05.438189] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T21:50:05.558057] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-14T21:50:06.358135] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-14T21:50:06.467355] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T21:50:06.568828] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T21:50:07.158121] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-14T21:50:07.572327] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T21:50:07.958120] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-14T21:50:08.676314] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T21:50:08.758082] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-14T21:50:09.558041] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-14T21:50:09.693018] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-14T21:50:10.281767] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T21:50:10.358075] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-14T21:50:10.762892] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-14T21:50:11.158062] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-14T21:50:11.958038] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-14T21:50:12.152901] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T21:50:12.273454] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-14T21:50:12.758082] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-14T21:50:13.491720] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T21:50:13.513498] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T21:50:13.558037] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-14T21:50:14.358068] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-14T21:50:14.625824] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T21:50:15.158108] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-14T21:50:15.893170] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T21:50:15.958078] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-14T21:50:16.758079] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-14T21:50:17.004817] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T21:50:17.558059] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-14T21:50:17.801729] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T21:50:17.883386] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-14T21:50:18.358068] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-14T21:50:19.158051] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-14T21:50:19.422728] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T21:50:19.433378] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T21:50:19.958104] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-14T21:50:20.693559] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T21:50:20.758072] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-14T21:50:21.028117] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T21:50:21.558064] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-14T21:50:22.358034] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-14T21:50:22.462451] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T21:50:22.994828] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T21:50:23.158074] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-14T21:50:23.773058] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T21:50:23.958080] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-14T21:50:24.601831] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T21:50:24.758045] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-14T21:50:25.020359] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-14T21:50:25.558106] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-14T21:50:26.208378] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T21:50:26.358046] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-14T21:50:27.158142] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-14T21:50:27.534672] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T21:50:27.568142] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T21:50:27.958090] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-14T21:50:28.758058] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-14T21:50:28.800464] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T21:50:29.360956] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-14T21:50:29.365763] [INFO ] [REMOTE ] TEF: Full fetch complete (54873 records). [2025-10-14T21:50:29.365932] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-14T21:50:29.563425] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-14T21:50:29.785358] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-14T21:50:29.785435] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-14T21:50:29.786406] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-14T21:50:29.786488] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-14T21:50:29.787508] [DEBUG] [LOCAL ] TEF: Trimmed 54873 records to 36985 (keeping 200 days of data) [2025-10-14T21:50:30.001424] [DEBUG] [LOCAL ] TEF: Primary data saved (36985 records). [2025-10-14T21:50:30.001570] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-14T21:50:30.001672] [INFO ] [MAIN ] Update Progress: 2064/2369 symbols completed. TEF took 30.2s. Estimated remaining: 42m 55s. Rate: 7.1 symbols/min [2025-10-14T21:50:30.167930] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:50:30.196730] [DEBUG] [LOCAL ] TEN: Loaded 30551 existing records from primary storage. [2025-10-14T21:50:30.197128] [INFO ] [MAIN ] TEN: Loaded 30551 existing records. [2025-10-14T21:50:30.371814] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-14T21:50:30.379843] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:30.380148] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-14T21:50:30.380206] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-14T21:50:30.380902] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-14T21:50:30.380959] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-14T21:50:30.689815] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-14T21:50:30.714143] [INFO ] [REMOTE ] TEI: Full fetch complete (30842 records). [2025-10-14T21:50:30.739283] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-14T21:50:30.780662] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:30.906395] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-14T21:50:31.160787] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-14T21:50:31.190671] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-14T21:50:31.190745] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-14T21:50:31.191425] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-14T21:50:31.191588] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-14T21:50:31.192434] [DEBUG] [LOCAL ] TEI: Trimmed 30842 records to 21378 (keeping 200 days of data) [2025-10-14T21:50:31.312000] [DEBUG] [LOCAL ] TEI: Primary data saved (21378 records). [2025-10-14T21:50:31.312117] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-14T21:50:31.312191] [INFO ] [MAIN ] Update Progress: 2065/2369 symbols completed. TEI took 30.9s. Estimated remaining: 42m 46s. Rate: 7.1 symbols/min [2025-10-14T21:50:31.485688] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:50:31.505721] [DEBUG] [LOCAL ] TEO: Loaded 22429 existing records from primary storage. [2025-10-14T21:50:31.505955] [INFO ] [MAIN ] TEO: Loaded 22429 existing records. [2025-10-14T21:50:31.686735] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:31.686930] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-14T21:50:31.687011] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-14T21:50:31.687463] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-14T21:50:31.687520] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-14T21:50:31.965006] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-14T21:50:32.066217] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:32.273376] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T21:50:32.758092] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-14T21:50:33.092477] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T21:50:33.479060] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T21:50:33.558074] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-14T21:50:34.358074] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-14T21:50:34.548009] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T21:50:35.158075] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-14T21:50:35.316267] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-14T21:50:35.322188] [INFO ] [REMOTE ] TECK: Full fetch complete (77494 records). [2025-10-14T21:50:35.322310] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-14T21:50:35.722297] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-14T21:50:35.722406] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-14T21:50:35.729574] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-14T21:50:35.739672] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-14T21:50:35.741263] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T21:50:35.749170] [DEBUG] [LOCAL ] TECK: Trimmed 77494 records to 53437 (keeping 200 days of data) [2025-10-14T21:50:35.972221] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-14T21:50:36.069822] [DEBUG] [LOCAL ] TECK: Primary data saved (53437 records). [2025-10-14T21:50:36.069944] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-14T21:50:36.070017] [INFO ] [MAIN ] Update Progress: 2066/2369 symbols completed. TECK took 46.2s. Estimated remaining: 42m 37s. Rate: 7.1 symbols/min [2025-10-14T21:50:36.240026] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:50:36.289723] [DEBUG] [LOCAL ] TEVA: Loaded 53628 existing records from primary storage. [2025-10-14T21:50:36.290035] [INFO ] [MAIN ] TEVA: Loaded 53628 existing records. [2025-10-14T21:50:36.474674] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:36.474877] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-14T21:50:36.474923] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-14T21:50:36.475902] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-14T21:50:36.475960] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-14T21:50:36.758440] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-14T21:50:36.840394] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:36.861918] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:50:36.895058] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T21:50:37.558079] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-14T21:50:37.972929] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T21:50:38.139475] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T21:50:38.145013] [INFO ] [REMOTE ] TEL: Full fetch complete (73578 records). [2025-10-14T21:50:38.145128] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-14T21:50:38.363271] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-14T21:50:38.538856] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-14T21:50:38.538931] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-14T21:50:38.540065] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-14T21:50:38.540128] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-14T21:50:38.541465] [DEBUG] [LOCAL ] TEL: Trimmed 73578 records to 51073 (keeping 200 days of data) [2025-10-14T21:50:38.850932] [DEBUG] [LOCAL ] TEL: Primary data saved (51073 records). [2025-10-14T21:50:38.851055] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-14T21:50:38.851130] [INFO ] [MAIN ] Update Progress: 2067/2369 symbols completed. TEL took 36.8s. Estimated remaining: 42m 27s. Rate: 7.1 symbols/min [2025-10-14T21:50:39.022272] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:50:39.059177] [DEBUG] [LOCAL ] TEX: Loaded 43940 existing records from primary storage. [2025-10-14T21:50:39.059454] [INFO ] [MAIN ] TEX: Loaded 43940 existing records. [2025-10-14T21:50:39.158846] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-14T21:50:39.241185] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:50:39.241407] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-14T21:50:39.241455] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-14T21:50:39.242251] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-14T21:50:39.242308] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-14T21:50:39.620885] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:50:39.631338] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T21:50:39.958126] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-14T21:50:40.758056] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-14T21:50:40.887521] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:50:41.555636] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T21:50:41.564450] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-14T21:50:42.137072] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T21:50:42.358090] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-14T21:50:43.088905] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T21:50:43.142612] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T21:50:43.158025] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-14T21:50:43.958052] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-14T21:50:44.118805] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-14T21:50:44.758108] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-14T21:50:45.498291] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T21:50:45.558043] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-14T21:50:45.835682] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T21:50:46.358063] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-14T21:50:47.158090] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-14T21:50:47.452817] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T21:50:47.659085] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T21:50:47.958112] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-14T21:50:48.149397] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T21:50:48.758091] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-14T21:50:49.558116] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-14T21:50:49.789083] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-14T21:50:49.943833] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T21:50:50.358104] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-14T21:50:50.387447] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T21:50:51.158085] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-14T21:50:51.427200] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T21:50:51.958083] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-14T21:50:52.758127] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-14T21:50:53.055743] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-14T21:50:53.237256] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T21:50:53.558063] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-14T21:50:54.358067] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-14T21:50:54.461280] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T21:50:54.912697] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T21:50:55.158086] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-14T21:50:55.958127] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-14T21:50:56.172986] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T21:50:56.252202] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T21:50:56.758099] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-14T21:50:57.314296] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T21:50:57.558089] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-14T21:50:57.743754] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T21:50:58.358195] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-14T21:50:59.158148] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-14T21:50:59.191448] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T21:50:59.958135] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-14T21:51:00.501576] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-14T21:51:00.517152] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:51:00.758064] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-14T21:51:00.933949] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T21:51:00.938682] [INFO ] [REMOTE ] TEO: Full fetch complete (32693 records). [2025-10-14T21:51:00.938847] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-14T21:51:01.323177] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-14T21:51:01.323262] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-14T21:51:01.323936] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-14T21:51:01.323996] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-14T21:51:01.324752] [DEBUG] [LOCAL ] TEO: Trimmed 32693 records to 22464 (keeping 200 days of data) [2025-10-14T21:51:01.446619] [DEBUG] [LOCAL ] TEO: Primary data saved (22464 records). [2025-10-14T21:51:01.446765] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-14T21:51:01.446845] [INFO ] [MAIN ] Update Progress: 2068/2369 symbols completed. TEO took 30.1s. Estimated remaining: 42m 21s. Rate: 7.1 symbols/min [2025-10-14T21:51:01.563243] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-14T21:51:01.616445] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:01.665037] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-14T21:51:01.665340] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-14T21:51:01.841195] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:01.841575] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-14T21:51:01.841620] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-14T21:51:01.843249] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-14T21:51:01.843308] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-14T21:51:02.201731] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:02.230188] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T21:51:02.358083] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-14T21:51:02.967682] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T21:51:03.158078] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-14T21:51:03.958064] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-14T21:51:04.089789] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:51:04.758172] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-14T21:51:05.130295] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T21:51:05.523342] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T21:51:05.558028] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-14T21:51:06.321324] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T21:51:06.358024] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-14T21:51:06.867150] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T21:51:07.158070] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-14T21:51:07.655166] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T21:51:07.958119] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-14T21:51:08.281057] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T21:51:08.284415] [INFO ] [REMOTE ] TEN: Full fetch complete (44058 records). [2025-10-14T21:51:08.284501] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-14T21:51:08.656574] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-14T21:51:08.656676] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-14T21:51:08.657531] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-14T21:51:08.657571] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-14T21:51:08.658460] [DEBUG] [LOCAL ] TEN: Trimmed 44058 records to 30487 (keeping 200 days of data) [2025-10-14T21:51:08.763811] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-14T21:51:08.841117] [DEBUG] [LOCAL ] TEN: Primary data saved (30487 records). [2025-10-14T21:51:08.841241] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-14T21:51:08.841318] [INFO ] [MAIN ] Update Progress: 2069/2369 symbols completed. TEN took 38.8s. Estimated remaining: 42m 12s. Rate: 7.1 symbols/min [2025-10-14T21:51:09.019326] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:09.049466] [DEBUG] [LOCAL ] TFII: Loaded 33185 existing records from primary storage. [2025-10-14T21:51:09.049782] [INFO ] [MAIN ] TFII: Loaded 33185 existing records. [2025-10-14T21:51:09.234889] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:09.235123] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-14T21:51:09.235177] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-14T21:51:09.236110] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-14T21:51:09.236169] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-14T21:51:09.563170] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-14T21:51:09.593735] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:10.133323] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T21:51:10.358044] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-14T21:51:10.752320] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T21:51:10.786762] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-14T21:51:11.158075] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-14T21:51:11.958079] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-14T21:51:12.507500] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-14T21:51:12.564545] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T21:51:12.570027] [INFO ] [REMOTE ] TEX: Full fetch complete (64514 records). [2025-10-14T21:51:12.570201] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-14T21:51:12.758148] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-14T21:51:12.973965] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-14T21:51:12.974050] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-14T21:51:12.975136] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-14T21:51:12.975199] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-14T21:51:12.976524] [DEBUG] [LOCAL ] TEX: Trimmed 64514 records to 43886 (keeping 200 days of data) [2025-10-14T21:51:13.240510] [DEBUG] [LOCAL ] TEX: Primary data saved (43886 records). [2025-10-14T21:51:13.240853] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-14T21:51:13.240953] [INFO ] [MAIN ] Update Progress: 2070/2369 symbols completed. TEX took 34.4s. Estimated remaining: 42m 3s. Rate: 7.1 symbols/min [2025-10-14T21:51:13.414032] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:13.456392] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T21:51:13.475963] [DEBUG] [LOCAL ] TFIN: Loaded 23484 existing records from primary storage. [2025-10-14T21:51:13.476208] [INFO ] [MAIN ] TFIN: Loaded 23484 existing records. [2025-10-14T21:51:13.564345] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-14T21:51:13.652137] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:13.652328] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-14T21:51:13.652373] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-14T21:51:13.652877] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-14T21:51:13.652933] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-14T21:51:14.001971] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:14.358068] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-14T21:51:15.060243] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-14T21:51:15.158039] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-14T21:51:15.329049] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T21:51:15.441426] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T21:51:15.958033] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-14T21:51:16.045282] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:51:16.758060] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-14T21:51:17.072870] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T21:51:17.558042] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-14T21:51:17.695889] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-14T21:51:18.358072] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-14T21:51:18.946742] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-14T21:51:19.158040] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-14T21:51:19.406074] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T21:51:19.958076] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-14T21:51:20.682423] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T21:51:20.758040] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-14T21:51:21.558080] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-14T21:51:21.740984] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T21:51:22.358037] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-14T21:51:22.649673] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-14T21:51:22.655605] [INFO ] [REMOTE ] TEVA: Full fetch complete (77791 records). [2025-10-14T21:51:22.655755] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-14T21:51:22.785586] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T21:51:23.100613] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-14T21:51:23.100748] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-14T21:51:23.102117] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-14T21:51:23.102194] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-14T21:51:23.104245] [DEBUG] [LOCAL ] TEVA: Trimmed 77791 records to 53627 (keeping 200 days of data) [2025-10-14T21:51:23.163902] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-14T21:51:23.432378] [DEBUG] [LOCAL ] TEVA: Primary data saved (53627 records). [2025-10-14T21:51:23.432548] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-14T21:51:23.432684] [INFO ] [MAIN ] Update Progress: 2071/2369 symbols completed. TEVA took 47.4s. Estimated remaining: 41m 55s. Rate: 7.1 symbols/min [2025-10-14T21:51:23.607170] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:23.642213] [DEBUG] [LOCAL ] TFPM: Loaded 39066 existing records from primary storage. [2025-10-14T21:51:23.642486] [INFO ] [MAIN ] TFPM: Loaded 39066 existing records. [2025-10-14T21:51:23.843853] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:23.844060] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-14T21:51:23.844108] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-14T21:51:23.844898] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-14T21:51:23.844966] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-14T21:51:23.963126] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-14T21:51:24.215558] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:24.253770] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T21:51:24.522357] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T21:51:24.758077] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-14T21:51:25.558058] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-14T21:51:25.626015] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T21:51:25.890004] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T21:51:26.358077] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-14T21:51:27.158071] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-14T21:51:27.426209] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T21:51:27.450388] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T21:51:27.958037] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-14T21:51:28.342617] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-14T21:51:28.758037] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-14T21:51:29.212187] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T21:51:29.558066] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-14T21:51:30.285324] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T21:51:30.358043] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-14T21:51:30.673224] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T21:51:30.944846] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T21:51:30.950965] [INFO ] [REMOTE ] TFC: Full fetch complete (77840 records). [2025-10-14T21:51:30.951124] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-14T21:51:31.167232] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-14T21:51:31.359529] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-14T21:51:31.359613] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-14T21:51:31.360821] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-14T21:51:31.360888] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-14T21:51:31.362332] [DEBUG] [LOCAL ] TFC: Trimmed 77840 records to 53667 (keeping 200 days of data) [2025-10-14T21:51:31.688481] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-14T21:51:31.688615] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-14T21:51:31.688721] [INFO ] [MAIN ] Update Progress: 2072/2369 symbols completed. TFC took 30.2s. Estimated remaining: 41m 47s. Rate: 7.1 symbols/min [2025-10-14T21:51:31.862430] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:31.896263] [DEBUG] [LOCAL ] TFX: Loaded 36470 existing records from primary storage. [2025-10-14T21:51:31.896534] [INFO ] [MAIN ] TFX: Loaded 36470 existing records. [2025-10-14T21:51:31.963403] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-14T21:51:32.084428] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:32.084666] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-14T21:51:32.084769] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-14T21:51:32.085588] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-14T21:51:32.085675] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-14T21:51:32.402415] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T21:51:32.464740] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:32.758034] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-14T21:51:32.796694] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T21:51:33.558068] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-14T21:51:34.143553] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T21:51:34.358106] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-14T21:51:34.782685] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T21:51:35.158083] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-14T21:51:35.633039] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-14T21:51:35.866925] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T21:51:35.958101] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-14T21:51:36.758077] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-14T21:51:36.971509] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T21:51:36.974398] [INFO ] [REMOTE ] TFIN: Full fetch complete (31868 records). [2025-10-14T21:51:36.974473] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-14T21:51:37.356206] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-14T21:51:37.356277] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-14T21:51:37.356906] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-14T21:51:37.356967] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-14T21:51:37.357632] [DEBUG] [LOCAL ] TFIN: Trimmed 31868 records to 23531 (keeping 200 days of data) [2025-10-14T21:51:37.490540] [DEBUG] [LOCAL ] TFIN: Primary data saved (23531 records). [2025-10-14T21:51:37.490690] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-14T21:51:37.490779] [INFO ] [MAIN ] Update Progress: 2073/2369 symbols completed. TFIN took 24.2s. Estimated remaining: 41m 38s. Rate: 7.1 symbols/min [2025-10-14T21:51:37.563248] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-14T21:51:37.665477] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:37.675536] [DEBUG] [LOCAL ] TG: Loaded 10393 existing records from primary storage. [2025-10-14T21:51:37.675760] [INFO ] [MAIN ] TG: Loaded 10393 existing records. [2025-10-14T21:51:37.854206] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:37.854481] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-14T21:51:37.854545] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-14T21:51:37.854942] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-14T21:51:37.854998] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-14T21:51:38.157778] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T21:51:38.242232] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:38.358039] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-14T21:51:39.046207] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T21:51:39.158075] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-14T21:51:39.179670] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T21:51:39.958046] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-14T21:51:40.545631] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T21:51:40.758109] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-14T21:51:41.011907] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T21:51:41.558038] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-14T21:51:41.591088] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T21:51:42.358076] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-14T21:51:43.158064] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-14T21:51:43.222308] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T21:51:43.223118] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-14T21:51:43.958100] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-14T21:51:44.347593] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T21:51:44.726217] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T21:51:44.758058] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-14T21:51:45.558052] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-14T21:51:46.282086] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T21:51:46.358053] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-14T21:51:46.990477] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T21:51:47.158070] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-14T21:51:47.958037] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-14T21:51:48.137942] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T21:51:48.654348] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T21:51:48.758038] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-14T21:51:48.872414] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T21:51:49.558060] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-14T21:51:50.343257] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T21:51:50.358034] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-14T21:51:50.909136] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-14T21:51:51.158066] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-14T21:51:51.958171] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-14T21:51:52.035381] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T21:51:52.482269] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-14T21:51:52.557189] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T21:51:52.758148] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-14T21:51:53.558071] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-14T21:51:53.789589] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T21:51:54.358120] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-14T21:51:54.991064] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T21:51:54.996718] [INFO ] [REMOTE ] TFPM: Full fetch complete (52250 records). [2025-10-14T21:51:54.996859] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-14T21:51:55.109480] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T21:51:55.167781] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-14T21:51:55.439900] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-14T21:51:55.439979] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-14T21:51:55.441288] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-14T21:51:55.441354] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-14T21:51:55.442458] [DEBUG] [LOCAL ] TFPM: Trimmed 52250 records to 39273 (keeping 200 days of data) [2025-10-14T21:51:55.709131] [DEBUG] [LOCAL ] TFPM: Primary data saved (39273 records). [2025-10-14T21:51:55.709292] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-14T21:51:55.709407] [INFO ] [MAIN ] Update Progress: 2074/2369 symbols completed. TFPM took 32.3s. Estimated remaining: 41m 31s. Rate: 7.1 symbols/min [2025-10-14T21:51:55.895686] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:55.895839] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-14T21:51:55.895876] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-14T21:51:55.895982] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-14T21:51:55.896029] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-14T21:51:55.896069] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-14T21:51:55.896100] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-14T21:51:55.959548] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-14T21:51:56.007328] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-14T21:51:56.258213] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:56.758061] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-14T21:51:56.955843] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:51:56.956140] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-14T21:51:56.956225] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:51:56.956275] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-14T21:51:56.956333] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:51:56.956402] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-14T21:51:56.956461] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-14T21:51:56.956496] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-14T21:51:56.956534] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-14T21:51:56.956578] [INFO ] [MAIN ] Update Progress: 2075/2369 symbols completed. TGE took 1.2s. Estimated remaining: 41m 21s. Rate: 7.1 symbols/min [2025-10-14T21:51:57.131011] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:51:57.159923] [DEBUG] [LOCAL ] TGLS: Loaded 27631 existing records from primary storage. [2025-10-14T21:51:57.160207] [INFO ] [MAIN ] TGLS: Loaded 27631 existing records. [2025-10-14T21:51:57.337787] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:51:57.338176] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-14T21:51:57.338273] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-14T21:51:57.338577] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-14T21:51:57.338633] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-14T21:51:57.560830] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-14T21:51:57.645360] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T21:51:57.723046] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:51:58.228775] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T21:51:58.358055] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-14T21:51:59.158115] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-14T21:51:59.854052] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T21:51:59.958024] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-14T21:52:00.351184] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T21:52:00.758087] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-14T21:52:01.558065] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-14T21:52:01.786113] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T21:52:01.823705] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-14T21:52:02.358062] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-14T21:52:02.552389] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-14T21:52:03.090217] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T21:52:03.091990] [INFO ] [REMOTE ] TG: Full fetch complete (15065 records). [2025-10-14T21:52:03.092060] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-14T21:52:03.163300] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-14T21:52:03.464096] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-14T21:52:03.464196] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-14T21:52:03.464585] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-14T21:52:03.464627] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-14T21:52:03.465272] [DEBUG] [LOCAL ] TG: Trimmed 15065 records to 10473 (keeping 200 days of data) [2025-10-14T21:52:03.525077] [DEBUG] [LOCAL ] TG: Primary data saved (10473 records). [2025-10-14T21:52:03.525210] [INFO ] [MAIN ] TG: Full history saved. [2025-10-14T21:52:03.525312] [INFO ] [MAIN ] Update Progress: 2076/2369 symbols completed. TG took 26.0s. Estimated remaining: 41m 13s. Rate: 7.1 symbols/min [2025-10-14T21:52:03.692387] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:03.736225] [DEBUG] [LOCAL ] TGNA: Loaded 48635 existing records from primary storage. [2025-10-14T21:52:03.736533] [INFO ] [MAIN ] TGNA: Loaded 48635 existing records. [2025-10-14T21:52:03.914230] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:03.914429] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-14T21:52:03.914508] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-14T21:52:03.914860] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-14T21:52:03.914937] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-14T21:52:03.969700] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-14T21:52:04.272068] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:52:04.758051] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-14T21:52:04.911340] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T21:52:05.272703] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-14T21:52:05.558104] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-14T21:52:06.358095] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-14T21:52:06.663206] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T21:52:06.934102] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-14T21:52:07.085667] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T21:52:07.089161] [INFO ] [REMOTE ] TFII: Full fetch complete (47954 records). [2025-10-14T21:52:07.089238] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-14T21:52:07.163311] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-14T21:52:07.465515] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-14T21:52:07.465581] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-14T21:52:07.466565] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-14T21:52:07.466625] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-14T21:52:07.467755] [DEBUG] [LOCAL ] TFII: Trimmed 47954 records to 33006 (keeping 200 days of data) [2025-10-14T21:52:07.667296] [DEBUG] [LOCAL ] TFII: Primary data saved (33006 records). [2025-10-14T21:52:07.667420] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-14T21:52:07.667494] [INFO ] [MAIN ] Update Progress: 2077/2369 symbols completed. TFII took 58.8s. Estimated remaining: 41m 4s. Rate: 7.1 symbols/min [2025-10-14T21:52:07.958132] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-14T21:52:08.541129] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T21:52:08.758097] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-14T21:52:09.245776] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T21:52:09.250108] [INFO ] [REMOTE ] TFX: Full fetch complete (54694 records). [2025-10-14T21:52:09.250229] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-14T21:52:09.563252] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-14T21:52:09.636440] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-14T21:52:09.636531] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-14T21:52:09.637556] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-14T21:52:09.637621] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-14T21:52:09.639034] [DEBUG] [LOCAL ] TFX: Trimmed 54694 records to 36356 (keeping 200 days of data) [2025-10-14T21:52:09.869328] [DEBUG] [LOCAL ] TFX: Primary data saved (36356 records). [2025-10-14T21:52:09.869446] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-14T21:52:09.869518] [INFO ] [MAIN ] Update Progress: 2078/2369 symbols completed. TFX took 38.2s. Estimated remaining: 40m 54s. Rate: 7.1 symbols/min [2025-10-14T21:52:10.332610] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:52:10.358023] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-14T21:52:10.924692] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T21:52:11.158117] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-14T21:52:11.571151] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T21:52:11.958080] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-14T21:52:12.321206] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-14T21:52:12.758070] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-14T21:52:13.674378] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T21:52:13.684837] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-14T21:52:13.951613] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T21:52:14.358092] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-14T21:52:15.219372] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-14T21:52:15.230194] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-14T21:52:15.906351] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T21:52:15.958033] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-14T21:52:17.087711] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-14T21:52:17.098863] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-14T21:52:17.256877] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T21:52:17.558067] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-14T21:52:18.456341] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T21:52:18.460229] [INFO ] [REMOTE ] TGLS: Full fetch complete (40569 records). [2025-10-14T21:52:18.460398] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-14T21:52:18.871757] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T21:52:18.893181] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-14T21:52:18.893442] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-14T21:52:18.894447] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-14T21:52:18.894529] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-14T21:52:18.895202] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-14T21:52:18.897283] [DEBUG] [LOCAL ] TGLS: Trimmed 40569 records to 27617 (keeping 200 days of data) [2025-10-14T21:52:19.067102] [DEBUG] [LOCAL ] TGLS: Primary data saved (27617 records). [2025-10-14T21:52:19.067242] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-14T21:52:19.067324] [INFO ] [MAIN ] Update Progress: 2079/2369 symbols completed. TGLS took 22.1s. Estimated remaining: 40m 46s. Rate: 7.1 symbols/min [2025-10-14T21:52:21.395841] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-14T21:52:21.409401] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-14T21:52:23.161904] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T21:52:23.173281] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-14T21:52:24.734450] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T21:52:24.745327] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-14T21:52:26.222416] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T21:52:26.228161] [INFO ] [REMOTE ] TGNA: Full fetch complete (70010 records). [2025-10-14T21:52:26.228311] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-14T21:52:26.616207] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-14T21:52:26.616292] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-14T21:52:26.617399] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-14T21:52:26.617462] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-14T21:52:26.618852] [DEBUG] [LOCAL ] TGNA: Trimmed 70010 records to 48637 (keeping 200 days of data) [2025-10-14T21:52:26.912463] [DEBUG] [LOCAL ] TGNA: Primary data saved (48637 records). [2025-10-14T21:52:26.912605] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-14T21:52:26.912725] [INFO ] [MAIN ] Update Progress: 2080/2369 symbols completed. TGNA took 23.4s. Estimated remaining: 40m 37s. Rate: 7.1 symbols/min [2025-10-14T21:52:27.495109] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:27.554429] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:27.603873] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:27.646258] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:27.663939] [DEBUG] [LOCAL ] THG: Loaded 21621 existing records from primary storage. [2025-10-14T21:52:27.664636] [INFO ] [MAIN ] THG: Loaded 21621 existing records. [2025-10-14T21:52:27.891501] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:27.905239] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-14T21:52:27.905820] [DEBUG] [LOCAL ] TGS: Loaded 33260 existing records from primary storage. [2025-10-14T21:52:27.906482] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-14T21:52:27.907676] [DEBUG] [LOCAL ] THC: Loaded 47182 existing records from primary storage. [2025-10-14T21:52:27.908141] [INFO ] [MAIN ] TGS: Loaded 33260 existing records. [2025-10-14T21:52:27.921065] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-14T21:52:27.922129] [INFO ] [MAIN ] THC: Loaded 47182 existing records. [2025-10-14T21:52:27.933251] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-14T21:52:27.948985] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-14T21:52:28.018441] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-14T21:52:28.574666] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:28.634636] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-14T21:52:28.659311] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:28.643438] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:28.677090] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-14T21:52:28.687061] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-14T21:52:28.702347] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-14T21:52:28.707581] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-14T21:52:28.734015] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-14T21:52:28.733953] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-14T21:52:28.763560] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-14T21:52:28.819508] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-14T21:52:28.836527] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-14T21:52:28.866169] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-14T21:52:28.857198] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-14T21:52:29.064343] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:52:29.143233] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-14T21:52:29.788028] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:52:29.822067] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-14T21:52:29.978384] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:52:29.984784] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-14T21:52:30.062847] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:52:30.063151] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-14T21:52:30.347757] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T21:52:30.351986] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-14T21:52:31.270982] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T21:52:31.277427] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-14T21:52:31.377415] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T21:52:31.387509] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-14T21:52:31.411791] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-14T21:52:31.416170] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-14T21:52:31.883852] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-14T21:52:31.894715] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-14T21:52:32.571171] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T21:52:32.576748] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-14T21:52:32.742966] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T21:52:32.750625] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-14T21:52:33.090023] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T21:52:33.099286] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-14T21:52:33.717177] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-14T21:52:33.722285] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-14T21:52:33.913393] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T21:52:33.924027] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-14T21:52:33.968916] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T21:52:33.975356] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-14T21:52:34.814421] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T21:52:34.824086] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-14T21:52:34.885476] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T21:52:34.892044] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-14T21:52:34.953565] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T21:52:35.158124] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-14T21:52:35.854327] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-14T21:52:35.958043] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-14T21:52:36.052560] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-14T21:52:36.073702] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T21:52:36.648612] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T21:52:36.758065] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-14T21:52:37.558104] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-14T21:52:38.286286] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-14T21:52:38.358028] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-14T21:52:38.615093] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T21:52:38.657074] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T21:52:39.158108] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-14T21:52:39.958085] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-14T21:52:40.422424] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-14T21:52:40.565198] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T21:52:40.758042] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-14T21:52:41.311100] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-14T21:52:41.558071] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-14T21:52:42.358059] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-14T21:52:43.138312] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-14T21:52:43.158025] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-14T21:52:43.224346] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T21:52:43.485246] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T21:52:43.958060] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-14T21:52:44.758069] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-14T21:52:44.987025] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-14T21:52:45.247526] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T21:52:45.558082] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-14T21:52:46.197985] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T21:52:46.358050] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-14T21:52:47.158084] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-14T21:52:47.911814] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-14T21:52:47.958043] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-14T21:52:48.049012] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T21:52:48.411449] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T21:52:48.758066] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-14T21:52:49.558078] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-14T21:52:50.284632] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T21:52:50.313277] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-14T21:52:50.358037] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-14T21:52:50.643832] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T21:52:51.158099] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-14T21:52:51.958121] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-14T21:52:52.758042] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-14T21:52:52.919175] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T21:52:53.566053] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-14T21:52:53.594991] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (3.24 seconds). [2025-10-14T21:52:54.358111] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-14T21:52:55.313998] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-14T21:52:55.318666] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-14T21:52:55.388363] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T21:52:55.394293] [INFO ] [REMOTE ] TGT: Full fetch complete (77956 records). [2025-10-14T21:52:55.394406] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-14T21:52:55.728494] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (3.77 seconds). [2025-10-14T21:52:55.809998] [INFO ] [REMOTE ] THC: Full fetch complete (68881 records). [2025-10-14T21:52:55.836432] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-14T21:52:55.836736] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-14T21:52:55.836865] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-14T21:52:55.839914] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-14T21:52:55.877005] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-14T21:52:55.963159] [DEBUG] [LOCAL ] TGT: Trimmed 77956 records to 53778 (keeping 200 days of data) [2025-10-14T21:52:56.136202] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-14T21:52:56.256845] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-14T21:52:56.268734] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T21:52:56.295597] [INFO ] [REMOTE ] THG: Full fetch complete (31084 records). [2025-10-14T21:52:56.296078] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-14T21:52:56.514014] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-14T21:52:56.519313] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-14T21:52:56.521530] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-14T21:52:56.526955] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-14T21:52:56.591781] [DEBUG] [LOCAL ] THC: Trimmed 68881 records to 47104 (keeping 200 days of data) [2025-10-14T21:52:56.924499] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-14T21:52:56.977407] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-14T21:52:56.978747] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-14T21:52:56.989149] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-14T21:52:57.024314] [DEBUG] [LOCAL ] THG: Trimmed 31084 records to 21676 (keeping 200 days of data) [2025-10-14T21:52:57.456777] [DEBUG] [LOCAL ] THG: Primary data saved (21676 records). [2025-10-14T21:52:57.461433] [INFO ] [MAIN ] THG: Full history saved. [2025-10-14T21:52:57.462250] [INFO ] [MAIN ] Update Progress: 2081/2369 symbols completed. THG took 30.5s. Estimated remaining: 40m 32s. Rate: 7.1 symbols/min [2025-10-14T21:52:57.549385] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-14T21:52:57.549548] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-14T21:52:57.549705] [INFO ] [MAIN ] Update Progress: 2082/2369 symbols completed. TGT took 30.6s. Estimated remaining: 40m 23s. Rate: 7.1 symbols/min [2025-10-14T21:52:57.549283] [DEBUG] [LOCAL ] THC: Primary data saved (47104 records). [2025-10-14T21:52:57.593914] [INFO ] [MAIN ] THC: Full history saved. [2025-10-14T21:52:57.629192] [INFO ] [MAIN ] Update Progress: 2083/2369 symbols completed. THC took 30.7s. Estimated remaining: 40m 13s. Rate: 7.1 symbols/min [2025-10-14T21:52:57.851702] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:57.972285] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T21:52:57.991000] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:58.032577] [INFO ] [REMOTE ] TGS: Full fetch complete (48439 records). [2025-10-14T21:52:58.049328] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-14T21:52:58.032464] [DEBUG] [LOCAL ] THIR: Loaded 2351 existing records from primary storage. [2025-10-14T21:52:58.051355] [INFO ] [MAIN ] THIR: Loaded 2351 existing records. [2025-10-14T21:52:58.050945] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:52:58.064686] [DEBUG] [LOCAL ] THLV: Loaded 1518 existing records from primary storage. [2025-10-14T21:52:58.065260] [INFO ] [MAIN ] THLV: Loaded 1518 existing records. [2025-10-14T21:52:58.575344] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:58.601929] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:58.669935] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-14T21:52:58.669801] [DEBUG] [LOCAL ] THO: Loaded 41659 existing records from primary storage. [2025-10-14T21:52:58.670056] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-14T21:52:58.684564] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-14T21:52:58.704073] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-14T21:52:58.704523] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-14T21:52:58.704425] [INFO ] [MAIN ] THO: Loaded 41659 existing records. [2025-10-14T21:52:58.704763] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-14T21:52:58.758622] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-14T21:52:58.855894] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-14T21:52:59.218694] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-14T21:52:59.237247] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-14T21:52:59.238534] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-14T21:52:59.242225] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:52:59.312012] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-14T21:52:59.268338] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-14T21:52:59.344854] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-14T21:52:59.380742] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-14T21:52:59.405900] [DEBUG] [LOCAL ] TGS: Trimmed 48439 records to 33400 (keeping 200 days of data) [2025-10-14T21:52:59.425261] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-14T21:53:00.015442] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:00.027196] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-14T21:53:00.091215] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:00.136823] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-14T21:53:00.275195] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:00.276480] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-14T21:53:00.371139] [DEBUG] [LOCAL ] TGS: Primary data saved (33400 records). [2025-10-14T21:53:00.371288] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-14T21:53:00.371374] [INFO ] [MAIN ] Update Progress: 2084/2369 symbols completed. TGS took 33.5s. Estimated remaining: 40m 4s. Rate: 7.1 symbols/min [2025-10-14T21:53:00.502194] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-14T21:53:00.549141] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-14T21:53:00.550735] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:00.579375] [DEBUG] [LOCAL ] THQ: Loaded 25308 existing records from primary storage. [2025-10-14T21:53:00.579662] [INFO ] [MAIN ] THQ: Loaded 25308 existing records. [2025-10-14T21:53:00.735809] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T21:53:00.761220] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-14T21:53:00.769041] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:53:00.770202] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-14T21:53:00.770263] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-14T21:53:00.771000] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-14T21:53:00.771297] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-14T21:53:00.914916] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-14T21:53:00.925829] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-14T21:53:01.256736] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:01.260720] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-14T21:53:01.297316] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T21:53:01.558106] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-14T21:53:01.845244] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-14T21:53:01.849941] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T21:53:02.358148] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-14T21:53:03.158073] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-14T21:53:03.454784] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-14T21:53:03.470015] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T21:53:03.958091] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-14T21:53:04.758104] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-14T21:53:05.147595] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T21:53:05.558058] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-14T21:53:06.358130] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-14T21:53:07.158071] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-14T21:53:07.318594] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T21:53:07.356129] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-14T21:53:07.410552] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T21:53:07.770274] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T21:53:07.958052] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-14T21:53:08.387225] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-14T21:53:08.758099] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-14T21:53:09.232045] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T21:53:09.558067] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-14T21:53:09.995541] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T21:53:10.358132] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-14T21:53:10.782637] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-14T21:53:11.158093] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-14T21:53:11.958075] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-14T21:53:12.434023] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-14T21:53:12.664204] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T21:53:12.758029] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-14T21:53:13.558056] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-14T21:53:14.358094] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-14T21:53:14.644106] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T21:53:14.655188] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T21:53:14.830827] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-14T21:53:15.158098] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-14T21:53:15.958070] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-14T21:53:16.606768] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T21:53:16.758071] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-14T21:53:17.558108] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-14T21:53:17.950614] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-14T21:53:18.206373] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-14T21:53:18.230963] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T21:53:18.358059] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-14T21:53:19.158079] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-14T21:53:19.370459] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:53:19.599401] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-14T21:53:19.958046] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-14T21:53:20.501296] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-14T21:53:20.758077] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-14T21:53:21.272327] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-14T21:53:21.558078] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-14T21:53:21.974832] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T21:53:22.358070] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-14T21:53:23.158103] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-14T21:53:23.752572] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T21:53:23.754903] [INFO ] [REMOTE ] THIR: Full fetch complete (2842 records). [2025-10-14T21:53:23.755143] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-14T21:53:23.897214] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:53:23.963271] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-14T21:53:24.201166] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-14T21:53:24.201271] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-14T21:53:24.201414] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-14T21:53:24.201453] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-14T21:53:24.201851] [DEBUG] [LOCAL ] THIR: Trimmed 2842 records to 2355 (keeping 200 days of data) [2025-10-14T21:53:24.216012] [DEBUG] [LOCAL ] THIR: Primary data saved (2355 records). [2025-10-14T21:53:24.216124] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-14T21:53:24.216212] [INFO ] [MAIN ] Update Progress: 2085/2369 symbols completed. THIR took 26.8s. Estimated remaining: 39m 57s. Rate: 7.1 symbols/min [2025-10-14T21:53:24.390598] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:24.413044] [DEBUG] [LOCAL ] THR: Loaded 19704 existing records from primary storage. [2025-10-14T21:53:24.413364] [INFO ] [MAIN ] THR: Loaded 19704 existing records. [2025-10-14T21:53:24.603051] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:53:24.603357] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-14T21:53:24.603408] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-14T21:53:24.603722] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-14T21:53:24.603784] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-14T21:53:24.763262] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-14T21:53:25.002269] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:25.296114] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T21:53:25.296907] [INFO ] [REMOTE ] THLV: Full fetch complete (2553 records). [2025-10-14T21:53:25.296973] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-14T21:53:25.426442] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:53:25.563143] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-14T21:53:25.707204] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-14T21:53:25.707284] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-14T21:53:25.707405] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-14T21:53:25.707442] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-14T21:53:25.707797] [DEBUG] [LOCAL ] THLV: Trimmed 2553 records to 1508 (keeping 200 days of data) [2025-10-14T21:53:25.717094] [DEBUG] [LOCAL ] THLV: Primary data saved (1508 records). [2025-10-14T21:53:25.717152] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-14T21:53:25.717227] [INFO ] [MAIN ] Update Progress: 2086/2369 symbols completed. THLV took 28.2s. Estimated remaining: 39m 48s. Rate: 7.1 symbols/min [2025-10-14T21:53:25.884207] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:25.923529] [DEBUG] [LOCAL ] THS: Loaded 38578 existing records from primary storage. [2025-10-14T21:53:25.923840] [INFO ] [MAIN ] THS: Loaded 38578 existing records. [2025-10-14T21:53:26.105249] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:53:26.105480] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-14T21:53:26.105527] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-14T21:53:26.105791] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-14T21:53:26.105848] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-14T21:53:26.363163] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-14T21:53:26.469897] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:27.116057] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T21:53:27.158095] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-14T21:53:27.438037] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T21:53:27.958093] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-14T21:53:28.508132] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T21:53:28.758071] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-14T21:53:29.527209] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T21:53:29.558031] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-14T21:53:30.091104] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T21:53:30.358092] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-14T21:53:30.874464] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T21:53:31.118709] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-14T21:53:31.158082] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-14T21:53:31.958114] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-14T21:53:32.282377] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T21:53:32.285431] [INFO ] [REMOTE ] THQ: Full fetch complete (34959 records). [2025-10-14T21:53:32.285531] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-14T21:53:32.657897] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-14T21:53:32.657976] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-14T21:53:32.658800] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-14T21:53:32.658861] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-14T21:53:32.659637] [DEBUG] [LOCAL ] THQ: Trimmed 34959 records to 25366 (keeping 200 days of data) [2025-10-14T21:53:32.758056] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-14T21:53:32.818632] [DEBUG] [LOCAL ] THQ: Primary data saved (25366 records). [2025-10-14T21:53:32.818788] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-14T21:53:32.818868] [INFO ] [MAIN ] Update Progress: 2087/2369 symbols completed. THQ took 32.4s. Estimated remaining: 39m 39s. Rate: 7.1 symbols/min [2025-10-14T21:53:32.990846] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:33.011535] [DEBUG] [LOCAL ] THW: Loaded 19722 existing records from primary storage. [2025-10-14T21:53:33.011806] [INFO ] [MAIN ] THW: Loaded 19722 existing records. [2025-10-14T21:53:33.126200] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T21:53:33.208954] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:53:33.209166] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-14T21:53:33.209213] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-14T21:53:33.209400] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-14T21:53:33.209455] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-14T21:53:33.559807] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:33.559907] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-14T21:53:34.363212] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-14T21:53:34.379701] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T21:53:34.973874] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T21:53:35.158078] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-14T21:53:35.464705] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T21:53:35.958074] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-14T21:53:36.678735] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T21:53:36.758033] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-14T21:53:37.067065] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-14T21:53:37.558070] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-14T21:53:38.129043] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T21:53:38.133855] [INFO ] [REMOTE ] THO: Full fetch complete (60264 records). [2025-10-14T21:53:38.133962] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-14T21:53:38.363151] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-14T21:53:38.524499] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-14T21:53:38.529828] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-14T21:53:38.536441] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-14T21:53:38.537075] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-14T21:53:38.537497] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T21:53:38.543036] [DEBUG] [LOCAL ] THO: Trimmed 60264 records to 41591 (keeping 200 days of data) [2025-10-14T21:53:38.791105] [DEBUG] [LOCAL ] THO: Primary data saved (41591 records). [2025-10-14T21:53:38.791230] [INFO ] [MAIN ] THO: Full history saved. [2025-10-14T21:53:38.791303] [INFO ] [MAIN ] Update Progress: 2088/2369 symbols completed. THO took 41.2s. Estimated remaining: 39m 31s. Rate: 7.1 symbols/min [2025-10-14T21:53:38.958379] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:38.958534] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-14T21:53:38.958570] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-14T21:53:38.958698] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-14T21:53:38.958749] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-14T21:53:38.958797] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-14T21:53:38.958834] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-14T21:53:39.168228] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-14T21:53:39.315905] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:39.728945] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T21:53:39.958041] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-14T21:53:40.193360] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T21:53:40.758045] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-14T21:53:41.385107] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T21:53:41.558040] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-14T21:53:41.753607] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T21:53:41.758939] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:53:41.759165] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-14T21:53:41.759267] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:53:41.759337] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-14T21:53:41.759400] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:53:41.759468] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-14T21:53:41.759529] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-14T21:53:41.759598] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-14T21:53:41.759685] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-14T21:53:41.759745] [INFO ] [MAIN ] Update Progress: 2089/2369 symbols completed. TIC took 3.0s. Estimated remaining: 39m 21s. Rate: 7.1 symbols/min [2025-10-14T21:53:41.932597] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:41.967723] [DEBUG] [LOCAL ] TIMB: Loaded 35399 existing records from primary storage. [2025-10-14T21:53:41.968020] [INFO ] [MAIN ] TIMB: Loaded 35399 existing records. [2025-10-14T21:53:42.140011] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:53:42.140237] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-14T21:53:42.140283] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-14T21:53:42.140690] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-14T21:53:42.140746] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-14T21:53:42.366967] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-14T21:53:42.494076] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:43.158067] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-14T21:53:43.499486] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T21:53:43.958053] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-14T21:53:44.612343] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T21:53:44.758086] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-14T21:53:45.406538] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T21:53:45.558079] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-14T21:53:46.095807] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T21:53:46.358107] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-14T21:53:46.728188] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T21:53:47.158065] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-14T21:53:47.929385] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T21:53:47.958032] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-14T21:53:48.226611] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T21:53:48.758073] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-14T21:53:49.558060] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-14T21:53:49.586803] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:53:49.830322] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T21:53:50.358110] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-14T21:53:51.065079] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T21:53:51.136207] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-14T21:53:51.158042] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-14T21:53:51.958072] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-14T21:53:52.199781] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T21:53:52.758060] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-14T21:53:53.501371] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T21:53:53.558073] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-14T21:53:54.283720] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T21:53:54.358129] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-14T21:53:54.738527] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-14T21:53:55.158085] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-14T21:53:55.683302] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T21:53:55.687908] [INFO ] [REMOTE ] THS: Full fetch complete (54472 records). [2025-10-14T21:53:55.688007] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-14T21:53:55.963144] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-14T21:53:56.076281] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-14T21:53:56.076362] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-14T21:53:56.077346] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-14T21:53:56.077407] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-14T21:53:56.078564] [DEBUG] [LOCAL ] THS: Trimmed 54472 records to 38604 (keeping 200 days of data) [2025-10-14T21:53:56.301445] [DEBUG] [LOCAL ] THS: Primary data saved (38604 records). [2025-10-14T21:53:56.301581] [INFO ] [MAIN ] THS: Full history saved. [2025-10-14T21:53:56.301689] [INFO ] [MAIN ] Update Progress: 2090/2369 symbols completed. THS took 30.6s. Estimated remaining: 39m 14s. Rate: 7.1 symbols/min [2025-10-14T21:53:56.473692] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:53:56.479435] [DEBUG] [LOCAL ] TISI: Loaded 3349 existing records from primary storage. [2025-10-14T21:53:56.479573] [INFO ] [MAIN ] TISI: Loaded 3349 existing records. [2025-10-14T21:53:56.660229] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:53:56.660480] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-14T21:53:56.660622] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-14T21:53:56.660871] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-14T21:53:56.660934] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-14T21:53:56.759740] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-14T21:53:56.778276] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-14T21:53:57.068339] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:53:57.149561] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T21:53:57.427160] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T21:53:57.558072] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-14T21:53:58.358073] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-14T21:53:58.967979] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T21:53:59.158099] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-14T21:53:59.372425] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T21:53:59.721334] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-14T21:53:59.958076] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-14T21:54:00.438675] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T21:54:00.758057] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-14T21:54:01.558071] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-14T21:54:02.308050] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T21:54:02.358123] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-14T21:54:02.554671] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T21:54:03.158105] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-14T21:54:03.412005] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T21:54:03.958111] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-14T21:54:04.267061] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T21:54:04.758067] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-14T21:54:05.184575] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T21:54:05.551914] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T21:54:05.558017] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-14T21:54:06.358063] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-14T21:54:06.552495] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T21:54:06.554800] [INFO ] [REMOTE ] THR: Full fetch complete (28710 records). [2025-10-14T21:54:06.554899] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-14T21:54:06.926806] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T21:54:06.926610] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-14T21:54:06.928602] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-14T21:54:06.929327] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-14T21:54:06.929394] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-14T21:54:06.930163] [DEBUG] [LOCAL ] THR: Trimmed 28710 records to 19733 (keeping 200 days of data) [2025-10-14T21:54:07.046218] [DEBUG] [LOCAL ] THR: Primary data saved (19733 records). [2025-10-14T21:54:07.046343] [INFO ] [MAIN ] THR: Full history saved. [2025-10-14T21:54:07.046416] [INFO ] [MAIN ] Update Progress: 2091/2369 symbols completed. THR took 42.8s. Estimated remaining: 39m 6s. Rate: 7.1 symbols/min [2025-10-14T21:54:07.163159] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-14T21:54:07.217264] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:07.246925] [DEBUG] [LOCAL ] TIXT: Loaded 32346 existing records from primary storage. [2025-10-14T21:54:07.247185] [INFO ] [MAIN ] TIXT: Loaded 32346 existing records. [2025-10-14T21:54:07.423637] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:07.423846] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-14T21:54:07.423893] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-14T21:54:07.424776] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-14T21:54:07.424835] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-14T21:54:07.780435] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:07.931440] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-14T21:54:07.958024] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-14T21:54:08.758047] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-14T21:54:08.787612] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T21:54:09.558078] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-14T21:54:10.008164] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T21:54:10.168090] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-14T21:54:10.358072] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-14T21:54:10.952972] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-14T21:54:11.158064] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-14T21:54:11.958082] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-14T21:54:12.163730] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T21:54:12.166316] [INFO ] [REMOTE ] THW: Full fetch complete (29107 records). [2025-10-14T21:54:12.166389] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-14T21:54:12.613842] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-14T21:54:12.613920] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-14T21:54:12.614585] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-14T21:54:12.614670] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-14T21:54:12.615448] [DEBUG] [LOCAL ] THW: Trimmed 29107 records to 19747 (keeping 200 days of data) [2025-10-14T21:54:12.740682] [DEBUG] [LOCAL ] THW: Primary data saved (19747 records). [2025-10-14T21:54:12.740846] [INFO ] [MAIN ] THW: Full history saved. [2025-10-14T21:54:12.740964] [INFO ] [MAIN ] Update Progress: 2092/2369 symbols completed. THW took 39.9s. Estimated remaining: 38m 57s. Rate: 7.1 symbols/min [2025-10-14T21:54:12.763188] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-14T21:54:12.915131] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:12.966546] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-14T21:54:12.966897] [INFO ] [MAIN ] TJX: Loaded 53668 existing records. [2025-10-14T21:54:13.153518] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:13.153736] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-14T21:54:13.153795] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-14T21:54:13.154701] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-14T21:54:13.154759] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-14T21:54:13.374818] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T21:54:13.473120] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T21:54:13.562322] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:13.559229] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-14T21:54:14.358061] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-14T21:54:14.963827] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T21:54:15.158070] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-14T21:54:15.842759] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T21:54:15.958040] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-14T21:54:16.259012] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T21:54:16.758067] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-14T21:54:17.285918] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-14T21:54:17.558098] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-14T21:54:18.358113] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-14T21:54:18.593692] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T21:54:18.671704] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T21:54:18.675160] [INFO ] [REMOTE ] TIMB: Full fetch complete (53605 records). [2025-10-14T21:54:18.675239] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-14T21:54:18.847176] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T21:54:19.082989] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-14T21:54:19.083066] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-14T21:54:19.084266] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-14T21:54:19.084349] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-14T21:54:19.085873] [DEBUG] [LOCAL ] TIMB: Trimmed 53605 records to 35322 (keeping 200 days of data) [2025-10-14T21:54:19.163132] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-14T21:54:19.329852] [DEBUG] [LOCAL ] TIMB: Primary data saved (35322 records). [2025-10-14T21:54:19.329991] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-14T21:54:19.330082] [INFO ] [MAIN ] Update Progress: 2093/2369 symbols completed. TIMB took 37.6s. Estimated remaining: 38m 48s. Rate: 7.1 symbols/min [2025-10-14T21:54:19.498305] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:19.534332] [DEBUG] [LOCAL ] TK: Loaded 39201 existing records from primary storage. [2025-10-14T21:54:19.534604] [INFO ] [MAIN ] TK: Loaded 39201 existing records. [2025-10-14T21:54:19.714210] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:19.714436] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-14T21:54:19.714485] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-14T21:54:19.714878] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-14T21:54:19.714935] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-14T21:54:19.958538] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-14T21:54:20.074969] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:20.330397] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-14T21:54:20.758068] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-14T21:54:21.558103] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-14T21:54:21.945697] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T21:54:22.358050] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-14T21:54:22.688482] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-14T21:54:22.719710] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T21:54:22.826596] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T21:54:22.827623] [INFO ] [REMOTE ] TISI: Full fetch complete (4915 records). [2025-10-14T21:54:22.827722] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-14T21:54:23.158465] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-14T21:54:23.181722] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-14T21:54:23.181804] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-14T21:54:23.181963] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-14T21:54:23.182001] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-14T21:54:23.182345] [DEBUG] [LOCAL ] TISI: Trimmed 4915 records to 3343 (keeping 200 days of data) [2025-10-14T21:54:23.202243] [DEBUG] [LOCAL ] TISI: Primary data saved (3343 records). [2025-10-14T21:54:23.202335] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-14T21:54:23.202422] [INFO ] [MAIN ] Update Progress: 2094/2369 symbols completed. TISI took 26.9s. Estimated remaining: 38m 39s. Rate: 7.1 symbols/min [2025-10-14T21:54:23.368491] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:23.401728] [DEBUG] [LOCAL ] TKC: Loaded 39245 existing records from primary storage. [2025-10-14T21:54:23.402021] [INFO ] [MAIN ] TKC: Loaded 39245 existing records. [2025-10-14T21:54:23.581888] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:23.582187] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-14T21:54:23.582282] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-14T21:54:23.583978] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-14T21:54:23.584035] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-14T21:54:23.935956] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:23.958027] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-14T21:54:24.254018] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T21:54:24.758115] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-14T21:54:25.178325] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T21:54:25.558078] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-14T21:54:25.937267] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T21:54:26.358159] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-14T21:54:27.158092] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-14T21:54:27.410771] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T21:54:27.529085] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T21:54:27.958071] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-14T21:54:28.524639] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T21:54:28.758096] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-14T21:54:29.385116] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T21:54:29.558053] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-14T21:54:30.253360] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T21:54:30.358101] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-14T21:54:30.391446] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T21:54:31.158137] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-14T21:54:31.958091] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-14T21:54:32.195374] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T21:54:32.252058] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-14T21:54:32.758041] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-14T21:54:33.406244] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T21:54:33.558062] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-14T21:54:34.358129] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-14T21:54:34.440475] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T21:54:34.703450] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T21:54:35.158077] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-14T21:54:35.634590] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T21:54:35.958072] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-14T21:54:36.758060] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-14T21:54:36.952607] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T21:54:37.474620] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T21:54:37.558044] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-14T21:54:37.804749] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T21:54:38.358056] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-14T21:54:39.080859] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-14T21:54:39.158024] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-14T21:54:39.886299] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T21:54:39.958112] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-14T21:54:40.758300] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-14T21:54:40.758212] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T21:54:41.507066] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T21:54:41.558056] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-14T21:54:42.358100] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-14T21:54:42.933387] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T21:54:42.946445] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-14T21:54:42.951397] [INFO ] [REMOTE ] TIXT: Full fetch complete (46359 records). [2025-10-14T21:54:42.951535] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-14T21:54:43.164512] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-14T21:54:43.337153] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-14T21:54:43.337227] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-14T21:54:43.338205] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-14T21:54:43.338269] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-14T21:54:43.339270] [DEBUG] [LOCAL ] TIXT: Trimmed 46359 records to 32339 (keeping 200 days of data) [2025-10-14T21:54:43.530670] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T21:54:43.561219] [DEBUG] [LOCAL ] TIXT: Primary data saved (32339 records). [2025-10-14T21:54:43.561376] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-14T21:54:43.561464] [INFO ] [MAIN ] Update Progress: 2095/2369 symbols completed. TIXT took 36.5s. Estimated remaining: 38m 32s. Rate: 7.1 symbols/min [2025-10-14T21:54:43.734875] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:43.773678] [DEBUG] [LOCAL ] TKO: Loaded 43845 existing records from primary storage. [2025-10-14T21:54:43.773961] [INFO ] [MAIN ] TKO: Loaded 43845 existing records. [2025-10-14T21:54:43.949249] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:43.949489] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-14T21:54:43.949536] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-14T21:54:43.950469] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-14T21:54:43.950529] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-14T21:54:43.963228] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-14T21:54:44.306400] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:44.703514] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-14T21:54:44.758082] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-14T21:54:45.410837] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T21:54:45.558063] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-14T21:54:46.141697] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T21:54:46.358139] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-14T21:54:46.526081] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T21:54:46.530909] [INFO ] [REMOTE ] TK: Full fetch complete (56302 records). [2025-10-14T21:54:46.531067] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-14T21:54:47.069761] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-14T21:54:47.069904] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-14T21:54:47.071594] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-14T21:54:47.071713] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-14T21:54:47.073129] [DEBUG] [LOCAL ] TK: Trimmed 56302 records to 39177 (keeping 200 days of data) [2025-10-14T21:54:47.196252] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-14T21:54:47.378610] [DEBUG] [LOCAL ] TK: Primary data saved (39177 records). [2025-10-14T21:54:47.378779] [INFO ] [MAIN ] TK: Full history saved. [2025-10-14T21:54:47.378864] [INFO ] [MAIN ] Update Progress: 2096/2369 symbols completed. TK took 28.0s. Estimated remaining: 38m 23s. Rate: 7.1 symbols/min [2025-10-14T21:54:47.551526] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:47.586462] [DEBUG] [LOCAL ] TKR: Loaded 39889 existing records from primary storage. [2025-10-14T21:54:47.586776] [INFO ] [MAIN ] TKR: Loaded 39889 existing records. [2025-10-14T21:54:47.762887] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:47.763085] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-14T21:54:47.763132] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-14T21:54:47.763872] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-14T21:54:47.763930] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-14T21:54:47.970516] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-14T21:54:48.145858] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:48.300353] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-14T21:54:48.657605] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T21:54:48.758071] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-14T21:54:49.558059] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-14T21:54:49.587139] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-14T21:54:50.125961] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T21:54:50.358071] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-14T21:54:50.969851] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T21:54:51.158086] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-14T21:54:51.820451] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T21:54:51.958048] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-14T21:54:52.758096] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-14T21:54:53.092130] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T21:54:53.448897] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T21:54:53.454134] [INFO ] [REMOTE ] TKC: Full fetch complete (53542 records). [2025-10-14T21:54:53.454249] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-14T21:54:53.560182] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-14T21:54:53.854383] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-14T21:54:53.854467] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-14T21:54:53.855464] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-14T21:54:53.855532] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-14T21:54:53.856753] [DEBUG] [LOCAL ] TKC: Trimmed 53542 records to 39400 (keeping 200 days of data) [2025-10-14T21:54:54.079155] [DEBUG] [LOCAL ] TKC: Primary data saved (39400 records). [2025-10-14T21:54:54.079389] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-14T21:54:54.079526] [INFO ] [MAIN ] Update Progress: 2097/2369 symbols completed. TKC took 30.9s. Estimated remaining: 38m 15s. Rate: 7.1 symbols/min [2025-10-14T21:54:54.269335] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:54.271091] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T21:54:54.277574] [INFO ] [REMOTE ] TJX: Full fetch complete (77831 records). [2025-10-14T21:54:54.277756] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-14T21:54:54.373372] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T21:54:54.364216] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-14T21:54:54.641231] [DEBUG] [LOCAL ] TLK: Loaded 38623 existing records from primary storage. [2025-10-14T21:54:54.650097] [INFO ] [MAIN ] TLK: Loaded 38623 existing records. [2025-10-14T21:54:54.878218] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-14T21:54:54.883510] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-14T21:54:54.890020] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-14T21:54:54.901620] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-14T21:54:54.947566] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:54.947710] [DEBUG] [LOCAL ] TJX: Trimmed 77831 records to 53668 (keeping 200 days of data) [2025-10-14T21:54:54.948331] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-14T21:54:54.948394] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-14T21:54:54.949312] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-14T21:54:54.949389] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-14T21:54:55.158406] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-14T21:54:55.473974] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:55.696695] [DEBUG] [LOCAL ] TJX: Primary data saved (53668 records). [2025-10-14T21:54:55.696837] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-14T21:54:55.697442] [INFO ] [MAIN ] Update Progress: 2098/2369 symbols completed. TJX took 43.0s. Estimated remaining: 38m 5s. Rate: 7.1 symbols/min [2025-10-14T21:54:55.866453] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:54:55.884176] [DEBUG] [LOCAL ] TLYS: Loaded 16571 existing records from primary storage. [2025-10-14T21:54:55.884387] [INFO ] [MAIN ] TLYS: Loaded 16571 existing records. [2025-10-14T21:54:55.958867] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-14T21:54:56.080837] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:54:56.081168] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-14T21:54:56.081279] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-14T21:54:56.081806] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-14T21:54:56.081881] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-14T21:54:56.374975] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-14T21:54:56.484433] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:54:56.758087] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-14T21:54:56.800541] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T21:54:57.341685] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T21:54:57.454597] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T21:54:57.558076] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-14T21:54:58.358107] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-14T21:54:58.989134] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T21:54:59.158096] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-14T21:54:59.942225] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T21:54:59.958028] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-14T21:55:00.494287] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T21:55:00.758098] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-14T21:55:01.558111] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-14T21:55:01.719341] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T21:55:02.253530] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T21:55:02.358088] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-14T21:55:03.159198] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-14T21:55:03.161676] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T21:55:03.543920] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-14T21:55:03.958104] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-14T21:55:04.758092] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-14T21:55:04.975546] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-14T21:55:05.558080] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-14T21:55:05.680060] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T21:55:06.291554] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T21:55:06.358120] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-14T21:55:06.713076] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T21:55:07.106071] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T21:55:07.158029] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-14T21:55:07.958076] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-14T21:55:08.003731] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T21:55:08.758081] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-14T21:55:09.478690] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T21:55:09.558078] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-14T21:55:10.109142] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T21:55:10.358034] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-14T21:55:11.087043] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T21:55:11.158035] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-14T21:55:11.901408] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:55:11.958043] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-14T21:55:12.660220] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T21:55:12.758037] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-14T21:55:13.416859] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:55:13.558067] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-14T21:55:14.257943] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-14T21:55:14.358057] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-14T21:55:15.166272] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-14T21:55:15.171674] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T21:55:15.404882] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T21:55:15.958132] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-14T21:55:15.983823] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T21:55:16.758101] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-14T21:55:17.340431] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T21:55:17.344873] [INFO ] [REMOTE ] TKR: Full fetch complete (57909 records). [2025-10-14T21:55:17.345020] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-14T21:55:17.566025] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-14T21:55:17.772896] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-14T21:55:17.772982] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-14T21:55:17.773996] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-14T21:55:17.774058] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-14T21:55:17.775264] [DEBUG] [LOCAL ] TKR: Trimmed 57909 records to 39830 (keeping 200 days of data) [2025-10-14T21:55:18.033531] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T21:55:18.041357] [INFO ] [REMOTE ] TLK: Full fetch complete (57349 records). [2025-10-14T21:55:18.045686] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-14T21:55:18.045809] [DEBUG] [LOCAL ] TKR: Primary data saved (39830 records). [2025-10-14T21:55:18.046278] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-14T21:55:18.046416] [INFO ] [MAIN ] Update Progress: 2099/2369 symbols completed. TKR took 30.7s. Estimated remaining: 37m 59s. Rate: 7.1 symbols/min [2025-10-14T21:55:18.378175] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-14T21:55:18.428287] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:55:18.637026] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-14T21:55:18.637120] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-14T21:55:18.638312] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-14T21:55:18.638457] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-14T21:55:18.651441] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T21:55:18.667736] [DEBUG] [LOCAL ] TLK: Trimmed 57349 records to 38631 (keeping 200 days of data) [2025-10-14T21:55:18.668376] [DEBUG] [LOCAL ] TM: Loaded 36628 existing records from primary storage. [2025-10-14T21:55:18.668955] [INFO ] [MAIN ] TM: Loaded 36628 existing records. [2025-10-14T21:55:18.942996] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:55:18.944731] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-14T21:55:18.945239] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-14T21:55:18.946621] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-14T21:55:18.947140] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-14T21:55:19.168012] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-14T21:55:19.332877] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:55:19.451520] [DEBUG] [LOCAL ] TLK: Primary data saved (38631 records). [2025-10-14T21:55:19.451674] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-14T21:55:19.451775] [INFO ] [MAIN ] Update Progress: 2100/2369 symbols completed. TLK took 25.4s. Estimated remaining: 37m 49s. Rate: 7.1 symbols/min [2025-10-14T21:55:19.624113] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:55:19.679394] [DEBUG] [LOCAL ] TME: Loaded 53188 existing records from primary storage. [2025-10-14T21:55:19.679756] [INFO ] [MAIN ] TME: Loaded 53188 existing records. [2025-10-14T21:55:19.861623] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:55:19.861840] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-14T21:55:19.861887] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-14T21:55:19.862348] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-14T21:55:19.862405] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-14T21:55:19.963018] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-14T21:55:20.226176] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:55:20.251770] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T21:55:20.643337] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-14T21:55:20.758050] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-14T21:55:21.432730] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T21:55:21.558086] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-14T21:55:22.358067] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-14T21:55:22.573291] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T21:55:23.158068] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-14T21:55:23.201027] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T21:55:23.958099] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-14T21:55:24.019948] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T21:55:24.758088] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-14T21:55:24.804452] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T21:55:25.554619] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T21:55:25.561110] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-14T21:55:25.782614] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T21:55:26.358090] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-14T21:55:27.158047] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-14T21:55:27.190769] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T21:55:27.613707] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T21:55:27.958088] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-14T21:55:28.751339] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T21:55:28.761761] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-14T21:55:29.558035] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-14T21:55:29.569522] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-14T21:55:29.732879] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T21:55:30.358092] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-14T21:55:31.158055] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-14T21:55:31.187863] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:55:31.372737] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T21:55:31.958082] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-14T21:55:32.758069] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-14T21:55:33.203063] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-14T21:55:33.501252] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T21:55:33.502695] [INFO ] [REMOTE ] TLYS: Full fetch complete (21627 records). [2025-10-14T21:55:33.502762] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-14T21:55:33.558589] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-14T21:55:33.819208] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T21:55:33.910981] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-14T21:55:33.911052] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-14T21:55:33.911476] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-14T21:55:33.911521] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-14T21:55:33.912117] [DEBUG] [LOCAL ] TLYS: Trimmed 21627 records to 16568 (keeping 200 days of data) [2025-10-14T21:55:34.009673] [DEBUG] [LOCAL ] TLYS: Primary data saved (16568 records). [2025-10-14T21:55:34.009821] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-14T21:55:34.009913] [INFO ] [MAIN ] Update Progress: 2101/2369 symbols completed. TLYS took 38.3s. Estimated remaining: 37m 42s. Rate: 7.1 symbols/min [2025-10-14T21:55:34.178914] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:55:34.221273] [DEBUG] [LOCAL ] TMHC: Loaded 45406 existing records from primary storage. [2025-10-14T21:55:34.221555] [INFO ] [MAIN ] TMHC: Loaded 45406 existing records. [2025-10-14T21:55:34.363179] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-14T21:55:34.401927] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:55:34.402238] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-14T21:55:34.402288] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-14T21:55:34.402815] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-14T21:55:34.402871] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-14T21:55:34.759133] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:55:35.026725] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T21:55:35.031958] [INFO ] [REMOTE ] TKO: Full fetch complete (65112 records). [2025-10-14T21:55:35.032061] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-14T21:55:35.162270] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-14T21:55:35.436220] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-14T21:55:35.436316] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-14T21:55:35.437412] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-14T21:55:35.437491] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-14T21:55:35.458520] [DEBUG] [LOCAL ] TKO: Trimmed 65112 records to 43799 (keeping 200 days of data) [2025-10-14T21:55:35.458399] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T21:55:35.737859] [DEBUG] [LOCAL ] TKO: Primary data saved (43799 records). [2025-10-14T21:55:35.737993] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-14T21:55:35.738068] [INFO ] [MAIN ] Update Progress: 2102/2369 symbols completed. TKO took 52.2s. Estimated remaining: 37m 32s. Rate: 7.1 symbols/min [2025-10-14T21:55:35.905517] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:55:35.958171] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-14T21:55:35.958084] [DEBUG] [LOCAL ] TMO: Loaded 52450 existing records from primary storage. [2025-10-14T21:55:35.959386] [INFO ] [MAIN ] TMO: Loaded 52450 existing records. [2025-10-14T21:55:36.146631] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:55:36.146833] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-14T21:55:36.146889] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-14T21:55:36.147171] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-14T21:55:36.147210] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-14T21:55:36.511063] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:55:36.721789] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T21:55:36.758028] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-14T21:55:37.558039] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-14T21:55:37.923307] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T21:55:38.297007] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T21:55:38.358127] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-14T21:55:39.158067] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-14T21:55:39.271013] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T21:55:39.958144] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-14T21:55:40.182889] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T21:55:40.664390] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T21:55:40.758145] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-14T21:55:41.558078] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-14T21:55:41.817027] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T21:55:42.358095] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-14T21:55:42.389771] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T21:55:43.158052] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-14T21:55:43.340496] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-14T21:55:43.958086] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-14T21:55:44.007311] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T21:55:44.518599] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T21:55:44.758096] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-14T21:55:45.558060] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-14T21:55:45.994294] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T21:55:46.358108] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-14T21:55:46.583523] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-14T21:55:46.636527] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T21:55:47.158089] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-14T21:55:47.958073] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-14T21:55:48.330147] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T21:55:48.623392] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T21:55:48.758059] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-14T21:55:49.302238] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T21:55:49.558065] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-14T21:55:50.080406] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T21:55:50.084117] [INFO ] [REMOTE ] TM: Full fetch complete (52642 records). [2025-10-14T21:55:50.084197] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-14T21:55:50.363302] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-14T21:55:50.466046] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-14T21:55:50.466126] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-14T21:55:50.467114] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-14T21:55:50.467174] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-14T21:55:50.468323] [DEBUG] [LOCAL ] TM: Trimmed 52642 records to 36538 (keeping 200 days of data) [2025-10-14T21:55:50.689507] [DEBUG] [LOCAL ] TM: Primary data saved (36538 records). [2025-10-14T21:55:50.689672] [INFO ] [MAIN ] TM: Full history saved. [2025-10-14T21:55:50.689786] [INFO ] [MAIN ] Update Progress: 2103/2369 symbols completed. TM took 32.6s. Estimated remaining: 37m 25s. Rate: 7.1 symbols/min [2025-10-14T21:55:50.857734] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:55:50.873105] [DEBUG] [LOCAL ] TNC: Loaded 14489 existing records from primary storage. [2025-10-14T21:55:50.873333] [INFO ] [MAIN ] TNC: Loaded 14489 existing records. [2025-10-14T21:55:51.049176] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:55:51.049374] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-14T21:55:51.049422] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-14T21:55:51.049572] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-14T21:55:51.049609] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-14T21:55:51.163226] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-14T21:55:51.416938] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:55:51.447721] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T21:55:51.680351] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T21:55:51.958146] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-14T21:55:52.758141] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-14T21:55:52.956174] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T21:55:53.284272] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-14T21:55:53.558072] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-14T21:55:54.277226] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T21:55:54.358119] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-14T21:55:55.158078] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-14T21:55:55.259333] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T21:55:55.265889] [INFO ] [REMOTE ] TME: Full fetch complete (77088 records). [2025-10-14T21:55:55.266039] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-14T21:55:55.377761] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T21:55:55.696577] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-14T21:55:55.696677] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-14T21:55:55.697899] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-14T21:55:55.697960] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-14T21:55:55.699345] [DEBUG] [LOCAL ] TME: Trimmed 77088 records to 53189 (keeping 200 days of data) [2025-10-14T21:55:55.961249] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-14T21:55:56.011944] [DEBUG] [LOCAL ] TME: Primary data saved (53189 records). [2025-10-14T21:55:56.012074] [INFO ] [MAIN ] TME: Full history saved. [2025-10-14T21:55:56.012150] [INFO ] [MAIN ] Update Progress: 2104/2369 symbols completed. TME took 36.6s. Estimated remaining: 37m 16s. Rate: 7.1 symbols/min [2025-10-14T21:55:56.207235] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:55:56.237501] [DEBUG] [LOCAL ] TNET: Loaded 28317 existing records from primary storage. [2025-10-14T21:55:56.237841] [INFO ] [MAIN ] TNET: Loaded 28317 existing records. [2025-10-14T21:55:56.418614] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:55:56.418845] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-14T21:55:56.418929] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-14T21:55:56.419285] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-14T21:55:56.419342] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-14T21:55:56.762368] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-14T21:55:56.803170] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:55:56.809395] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T21:55:57.558047] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-14T21:55:57.829446] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-14T21:55:57.926126] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T21:55:58.306873] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-14T21:55:58.358060] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-14T21:55:59.158115] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-14T21:55:59.509470] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T21:55:59.958070] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-14T21:56:00.586777] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T21:56:00.758118] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-14T21:56:01.138342] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T21:56:01.558062] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-14T21:56:01.982802] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-14T21:56:02.165279] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-14T21:56:02.358100] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-14T21:56:03.158069] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-14T21:56:03.958043] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-14T21:56:04.250448] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T21:56:04.534060] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-14T21:56:04.758060] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-14T21:56:05.363380] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T21:56:05.558050] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-14T21:56:06.358043] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-14T21:56:06.882790] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T21:56:06.979075] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T21:56:07.158081] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-14T21:56:07.342090] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T21:56:07.958099] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-14T21:56:08.551708] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T21:56:08.758085] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-14T21:56:09.558044] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-14T21:56:09.905063] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T21:56:10.105251] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T21:56:10.358035] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-14T21:56:10.548922] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T21:56:11.158051] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-14T21:56:11.256395] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T21:56:11.921548] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-14T21:56:11.958027] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-14T21:56:12.758061] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-14T21:56:13.558065] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-14T21:56:13.782890] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-14T21:56:14.220191] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T21:56:14.226311] [INFO ] [REMOTE ] TMHC: Full fetch complete (66186 records). [2025-10-14T21:56:14.226469] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-14T21:56:14.363256] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-14T21:56:14.566326] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-14T21:56:14.662449] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-14T21:56:14.662542] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-14T21:56:14.663738] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-14T21:56:14.663803] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-14T21:56:14.665147] [DEBUG] [LOCAL ] TMHC: Trimmed 66186 records to 45442 (keeping 200 days of data) [2025-10-14T21:56:14.928529] [DEBUG] [LOCAL ] TMHC: Primary data saved (45442 records). [2025-10-14T21:56:14.928689] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-14T21:56:14.928785] [INFO ] [MAIN ] Update Progress: 2105/2369 symbols completed. TMHC took 40.9s. Estimated remaining: 37m 9s. Rate: 7.1 symbols/min [2025-10-14T21:56:15.098154] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:15.098357] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-14T21:56:15.098484] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-14T21:56:15.098731] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-14T21:56:15.098920] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-14T21:56:15.098996] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-14T21:56:15.099092] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-14T21:56:15.170286] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-14T21:56:15.218987] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:56:15.236668] [INFO ] [REMOTE ] TMO: Full fetch complete (75632 records). [2025-10-14T21:56:15.247069] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-14T21:56:15.787883] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:15.907622] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-14T21:56:15.907740] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-14T21:56:15.909120] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-14T21:56:15.909222] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-14T21:56:15.910760] [DEBUG] [LOCAL ] TMO: Trimmed 75632 records to 52458 (keeping 200 days of data) [2025-10-14T21:56:15.965981] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-14T21:56:16.020507] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T21:56:16.023702] [INFO ] [REMOTE ] TNC: Full fetch complete (22395 records). [2025-10-14T21:56:16.024018] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-14T21:56:16.214333] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T21:56:16.237686] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-14T21:56:16.238338] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:56:16.249405] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-14T21:56:16.278497] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:56:16.279685] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-14T21:56:16.292411] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-14T21:56:16.307754] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-14T21:56:16.307873] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-14T21:56:16.311037] [INFO ] [MAIN ] Update Progress: 2106/2369 symbols completed. TNGY took 1.4s. Estimated remaining: 36m 59s. Rate: 7.1 symbols/min [2025-10-14T21:56:16.631831] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-14T21:56:16.638699] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-14T21:56:16.649784] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-14T21:56:16.655569] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-14T21:56:16.709850] [DEBUG] [LOCAL ] TNC: Trimmed 22395 records to 14451 (keeping 200 days of data) [2025-10-14T21:56:16.709754] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:16.777371] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-14T21:56:16.825416] [DEBUG] [LOCAL ] TNK: Loaded 35356 existing records from primary storage. [2025-10-14T21:56:16.828274] [INFO ] [MAIN ] TNK: Loaded 35356 existing records. [2025-10-14T21:56:16.979027] [DEBUG] [LOCAL ] TNC: Primary data saved (14451 records). [2025-10-14T21:56:16.993492] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-14T21:56:17.004817] [INFO ] [MAIN ] Update Progress: 2107/2369 symbols completed. TNC took 26.3s. Estimated remaining: 36m 50s. Rate: 7.1 symbols/min [2025-10-14T21:56:17.073270] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:17.102025] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-14T21:56:17.110778] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-14T21:56:17.140028] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-14T21:56:17.150692] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-14T21:56:17.363896] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:17.672963] [DEBUG] [LOCAL ] TNL: Loaded 41758 existing records from primary storage. [2025-10-14T21:56:17.702438] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:17.707378] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-14T21:56:17.703000] [INFO ] [MAIN ] TNL: Loaded 41758 existing records. [2025-10-14T21:56:17.716662] [DEBUG] [LOCAL ] TMO: Primary data saved (52458 records). [2025-10-14T21:56:17.742795] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-14T21:56:17.822796] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T21:56:17.814821] [INFO ] [MAIN ] Update Progress: 2108/2369 symbols completed. TMO took 42.1s. Estimated remaining: 36m 41s. Rate: 7.1 symbols/min [2025-10-14T21:56:18.056959] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:18.101125] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:18.101389] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-14T21:56:18.101609] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-14T21:56:18.102229] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-14T21:56:18.102289] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-14T21:56:18.363171] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-14T21:56:18.508583] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:18.509897] [DEBUG] [LOCAL ] TOL: Loaded 50684 existing records from primary storage. [2025-10-14T21:56:18.510109] [INFO ] [MAIN ] TOL: Loaded 50684 existing records. [2025-10-14T21:56:18.701102] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:18.701283] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-14T21:56:18.701378] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-14T21:56:18.701673] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-14T21:56:18.701741] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-14T21:56:19.048351] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:19.158043] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-14T21:56:19.381600] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T21:56:19.778004] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T21:56:19.958096] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-14T21:56:20.162794] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T21:56:20.758110] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-14T21:56:21.558056] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-14T21:56:21.705840] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T21:56:22.013118] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T21:56:22.358108] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-14T21:56:22.637558] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T21:56:23.158123] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-14T21:56:23.734945] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-14T21:56:23.958114] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-14T21:56:24.758042] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-14T21:56:24.839686] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T21:56:24.944269] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T21:56:25.558077] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-14T21:56:26.254192] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T21:56:26.358081] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-14T21:56:26.978328] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T21:56:27.158113] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-14T21:56:27.566176] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T21:56:27.958068] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-14T21:56:28.562703] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-14T21:56:28.758062] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-14T21:56:29.507123] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T21:56:29.558033] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-14T21:56:30.358073] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-14T21:56:30.608015] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-14T21:56:30.684498] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T21:56:31.158075] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-14T21:56:31.574003] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-14T21:56:31.958078] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-14T21:56:32.398516] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T21:56:32.758079] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-14T21:56:32.789601] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T21:56:32.794077] [INFO ] [REMOTE ] TNET: Full fetch complete (41695 records). [2025-10-14T21:56:32.794228] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-14T21:56:33.193364] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-14T21:56:33.193436] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-14T21:56:33.194298] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-14T21:56:33.194357] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-14T21:56:33.195211] [DEBUG] [LOCAL ] TNET: Trimmed 41695 records to 28269 (keeping 200 days of data) [2025-10-14T21:56:33.374026] [DEBUG] [LOCAL ] TNET: Primary data saved (28269 records). [2025-10-14T21:56:33.374160] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-14T21:56:33.374241] [INFO ] [MAIN ] Update Progress: 2109/2369 symbols completed. TNET took 37.4s. Estimated remaining: 36m 33s. Rate: 7.1 symbols/min [2025-10-14T21:56:33.542760] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:33.571634] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-14T21:56:33.593891] [DEBUG] [LOCAL ] TOST: Loaded 53685 existing records from primary storage. [2025-10-14T21:56:33.594204] [INFO ] [MAIN ] TOST: Loaded 53685 existing records. [2025-10-14T21:56:33.794202] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:33.794395] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-14T21:56:33.794441] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-14T21:56:33.794804] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-14T21:56:33.794861] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-14T21:56:34.160336] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:34.358078] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-14T21:56:34.655390] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T21:56:34.894339] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T21:56:35.158099] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-14T21:56:35.958095] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-14T21:56:35.959484] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T21:56:36.579190] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T21:56:36.758076] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-14T21:56:37.466838] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T21:56:37.558036] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-14T21:56:38.126315] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T21:56:38.358074] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-14T21:56:39.158070] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-14T21:56:39.192859] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T21:56:39.341248] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-14T21:56:39.958084] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-14T21:56:40.758115] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-14T21:56:41.028349] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T21:56:41.279316] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T21:56:41.558073] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-14T21:56:41.952244] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T21:56:42.358078] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-14T21:56:42.666024] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T21:56:43.158159] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-14T21:56:43.782995] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T21:56:43.958110] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-14T21:56:44.651088] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-14T21:56:44.758077] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-14T21:56:45.170916] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-14T21:56:45.174756] [INFO ] [REMOTE ] TNK: Full fetch complete (51899 records). [2025-10-14T21:56:45.174841] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-14T21:56:45.560161] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-14T21:56:45.559905] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-14T21:56:45.561080] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-14T21:56:45.562420] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-14T21:56:45.562626] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-14T21:56:45.563929] [DEBUG] [LOCAL ] TNK: Trimmed 51899 records to 35389 (keeping 200 days of data) [2025-10-14T21:56:45.779297] [DEBUG] [LOCAL ] TNK: Primary data saved (35389 records). [2025-10-14T21:56:45.779453] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-14T21:56:45.779561] [INFO ] [MAIN ] Update Progress: 2110/2369 symbols completed. TNK took 29.5s. Estimated remaining: 36m 25s. Rate: 7.1 symbols/min [2025-10-14T21:56:45.960395] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:45.986486] [DEBUG] [LOCAL ] TPB: Loaded 25891 existing records from primary storage. [2025-10-14T21:56:45.986865] [INFO ] [MAIN ] TPB: Loaded 25891 existing records. [2025-10-14T21:56:46.165165] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:46.165375] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-14T21:56:46.165439] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-14T21:56:46.165844] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-14T21:56:46.165915] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-14T21:56:46.367616] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-14T21:56:46.537556] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:46.564343] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T21:56:47.158169] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-14T21:56:47.226730] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T21:56:47.508083] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T21:56:47.958129] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-14T21:56:48.697353] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T21:56:48.758127] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-14T21:56:49.533513] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T21:56:49.558121] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-14T21:56:50.099162] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T21:56:50.104280] [INFO ] [REMOTE ] TNL: Full fetch complete (59412 records). [2025-10-14T21:56:50.104379] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-14T21:56:50.365997] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-14T21:56:50.485474] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-14T21:56:50.485554] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-14T21:56:50.486630] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-14T21:56:50.486723] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-14T21:56:50.488014] [DEBUG] [LOCAL ] TNL: Trimmed 59412 records to 41832 (keeping 200 days of data) [2025-10-14T21:56:50.740409] [DEBUG] [LOCAL ] TNL: Primary data saved (41832 records). [2025-10-14T21:56:50.740552] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-14T21:56:50.740633] [INFO ] [MAIN ] Update Progress: 2111/2369 symbols completed. TNL took 33.7s. Estimated remaining: 36m 16s. Rate: 7.1 symbols/min [2025-10-14T21:56:50.950166] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:50.971561] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T21:56:50.979861] [INFO ] [REMOTE ] TOL: Full fetch complete (73760 records). [2025-10-14T21:56:50.980111] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-14T21:56:51.161342] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-14T21:56:51.308921] [DEBUG] [LOCAL ] TPC: Loaded 39010 existing records from primary storage. [2025-10-14T21:56:51.320187] [INFO ] [MAIN ] TPC: Loaded 39010 existing records. [2025-10-14T21:56:51.510970] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-14T21:56:51.511365] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-14T21:56:51.518298] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-14T21:56:51.518391] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-14T21:56:51.591954] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:51.592429] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-14T21:56:51.592630] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-14T21:56:51.592853] [DEBUG] [LOCAL ] TOL: Trimmed 73760 records to 50688 (keeping 200 days of data) [2025-10-14T21:56:51.593107] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-14T21:56:51.593576] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-14T21:56:51.970412] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-14T21:56:51.997440] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-14T21:56:52.117724] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:52.322302] [DEBUG] [LOCAL ] TOL: Primary data saved (50688 records). [2025-10-14T21:56:52.322443] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-14T21:56:52.322518] [INFO ] [MAIN ] Update Progress: 2112/2369 symbols completed. TOL took 34.5s. Estimated remaining: 36m 7s. Rate: 7.1 symbols/min [2025-10-14T21:56:52.489170] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:56:52.528581] [DEBUG] [LOCAL ] TPH: Loaded 44898 existing records from primary storage. [2025-10-14T21:56:52.528886] [INFO ] [MAIN ] TPH: Loaded 44898 existing records. [2025-10-14T21:56:52.707532] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:56:52.707810] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-14T21:56:52.707905] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-14T21:56:52.708180] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-14T21:56:52.708250] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-14T21:56:52.767516] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-14T21:56:53.077213] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:56:53.095782] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-14T21:56:53.150682] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-14T21:56:53.558079] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-14T21:56:53.798119] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T21:56:54.358074] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-14T21:56:55.158049] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-14T21:56:55.256386] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T21:56:55.379401] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-14T21:56:55.958102] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-14T21:56:56.656630] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T21:56:56.723131] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T21:56:56.758071] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-14T21:56:57.558088] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-14T21:56:57.928747] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T21:56:58.358104] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-14T21:56:59.158036] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-14T21:56:59.518750] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-14T21:56:59.714728] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:56:59.844288] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T21:56:59.958035] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-14T21:57:00.758089] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-14T21:57:01.558108] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-14T21:57:02.010192] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T21:57:02.052000] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-14T21:57:02.358101] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-14T21:57:02.766422] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T21:57:03.158097] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-14T21:57:03.959611] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-14T21:57:03.963376] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T21:57:04.246877] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T21:57:04.758092] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-14T21:57:05.558060] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-14T21:57:05.818894] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T21:57:06.166671] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T21:57:06.358052] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-14T21:57:06.705075] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-14T21:57:07.158078] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-14T21:57:07.933556] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T21:57:07.958036] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-14T21:57:08.182876] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T21:57:08.758090] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-14T21:57:09.361781] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T21:57:09.558074] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-14T21:57:09.814898] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-14T21:57:10.358088] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-14T21:57:11.148444] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T21:57:11.158090] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-14T21:57:11.713314] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T21:57:11.958093] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-14T21:57:12.580937] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T21:57:12.758066] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-14T21:57:13.416026] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:57:13.558072] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-14T21:57:14.258108] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T21:57:14.358146] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-14T21:57:15.158084] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-14T21:57:15.480113] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T21:57:15.511203] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-14T21:57:15.958097] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-14T21:57:16.343625] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T21:57:16.758054] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-14T21:57:16.780346] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T21:57:16.784337] [INFO ] [REMOTE ] TPB: Full fetch complete (35861 records). [2025-10-14T21:57:16.784427] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-14T21:57:17.178359] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-14T21:57:17.178436] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-14T21:57:17.179157] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-14T21:57:17.179219] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-14T21:57:17.180040] [DEBUG] [LOCAL ] TPB: Trimmed 35861 records to 26074 (keeping 200 days of data) [2025-10-14T21:57:17.349385] [DEBUG] [LOCAL ] TPB: Primary data saved (26074 records). [2025-10-14T21:57:17.349517] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-14T21:57:17.349858] [INFO ] [MAIN ] Update Progress: 2113/2369 symbols completed. TPB took 31.6s. Estimated remaining: 36m 1s. Rate: 7.1 symbols/min [2025-10-14T21:57:17.517093] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:17.530563] [DEBUG] [LOCAL ] TPL: Loaded 12304 existing records from primary storage. [2025-10-14T21:57:17.530810] [INFO ] [MAIN ] TPL: Loaded 12304 existing records. [2025-10-14T21:57:17.563255] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-14T21:57:17.716622] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:17.716877] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-14T21:57:17.716924] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-14T21:57:17.717086] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-14T21:57:17.717141] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-14T21:57:18.070390] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:57:18.247427] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T21:57:18.358060] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-14T21:57:19.158045] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-14T21:57:19.368634] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T21:57:19.460436] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T21:57:19.467677] [INFO ] [REMOTE ] TOST: Full fetch complete (77850 records). [2025-10-14T21:57:19.467883] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-14T21:57:19.876447] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-14T21:57:19.876551] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-14T21:57:19.878426] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-14T21:57:19.878493] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-14T21:57:19.880592] [DEBUG] [LOCAL ] TOST: Trimmed 77850 records to 53690 (keeping 200 days of data) [2025-10-14T21:57:19.968150] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-14T21:57:20.207345] [DEBUG] [LOCAL ] TOST: Primary data saved (53690 records). [2025-10-14T21:57:20.207477] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-14T21:57:20.207556] [INFO ] [MAIN ] Update Progress: 2114/2369 symbols completed. TOST took 46.8s. Estimated remaining: 35m 52s. Rate: 7.1 symbols/min [2025-10-14T21:57:20.379069] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:20.432701] [DEBUG] [LOCAL ] TPR: Loaded 53446 existing records from primary storage. [2025-10-14T21:57:20.433101] [INFO ] [MAIN ] TPR: Loaded 53446 existing records. [2025-10-14T21:57:20.630407] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:20.632221] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-14T21:57:20.632025] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T21:57:20.632322] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-14T21:57:20.637628] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-14T21:57:20.637754] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-14T21:57:20.637891] [INFO ] [REMOTE ] TPH: Full fetch complete (64968 records). [2025-10-14T21:57:20.682033] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-14T21:57:20.758597] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-14T21:57:21.331891] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T21:57:21.327141] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:57:21.429843] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-14T21:57:21.429937] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-14T21:57:21.431184] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-14T21:57:21.431250] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-14T21:57:21.432704] [DEBUG] [LOCAL ] TPH: Trimmed 64968 records to 44879 (keeping 200 days of data) [2025-10-14T21:57:21.601988] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-14T21:57:21.700433] [DEBUG] [LOCAL ] TPH: Primary data saved (44879 records). [2025-10-14T21:57:21.700562] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-14T21:57:21.700639] [INFO ] [MAIN ] Update Progress: 2115/2369 symbols completed. TPH took 29.4s. Estimated remaining: 35m 42s. Rate: 7.1 symbols/min [2025-10-14T21:57:21.871349] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:21.899167] [DEBUG] [LOCAL ] TPVG: Loaded 27290 existing records from primary storage. [2025-10-14T21:57:21.899434] [INFO ] [MAIN ] TPVG: Loaded 27290 existing records. [2025-10-14T21:57:22.078692] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:22.078922] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-14T21:57:22.078969] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-14T21:57:22.079289] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-14T21:57:22.079346] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-14T21:57:22.360764] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-14T21:57:22.442517] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:57:22.499440] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T21:57:23.158097] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-14T21:57:23.304708] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T21:57:23.539490] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T21:57:23.958096] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-14T21:57:24.724573] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T21:57:24.758043] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-14T21:57:24.932613] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T21:57:25.558078] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-14T21:57:26.063400] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T21:57:26.358095] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-14T21:57:26.598957] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T21:57:27.158069] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-14T21:57:27.490933] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T21:57:27.958070] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-14T21:57:28.223629] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T21:57:28.228095] [INFO ] [REMOTE ] TPC: Full fetch complete (55272 records). [2025-10-14T21:57:28.228197] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-14T21:57:28.666196] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-14T21:57:28.666285] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-14T21:57:28.667294] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-14T21:57:28.667355] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-14T21:57:28.668564] [DEBUG] [LOCAL ] TPC: Trimmed 55272 records to 38979 (keeping 200 days of data) [2025-10-14T21:57:28.761770] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-14T21:57:28.783874] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T21:57:28.913017] [DEBUG] [LOCAL ] TPC: Primary data saved (38979 records). [2025-10-14T21:57:28.913162] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-14T21:57:28.913264] [INFO ] [MAIN ] Update Progress: 2116/2369 symbols completed. TPC took 38.2s. Estimated remaining: 35m 34s. Rate: 7.1 symbols/min [2025-10-14T21:57:29.080686] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:29.090829] [DEBUG] [LOCAL ] TPYP: Loaded 7942 existing records from primary storage. [2025-10-14T21:57:29.091042] [INFO ] [MAIN ] TPYP: Loaded 7942 existing records. [2025-10-14T21:57:29.268256] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:29.268485] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-14T21:57:29.268531] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-14T21:57:29.268719] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-14T21:57:29.268773] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-14T21:57:29.563229] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-14T21:57:29.621557] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:57:29.944205] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T21:57:30.358080] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-14T21:57:31.158061] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-14T21:57:31.413937] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T21:57:31.527203] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-14T21:57:31.958076] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-14T21:57:32.049810] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T21:57:32.758059] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-14T21:57:33.558034] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-14T21:57:33.745418] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-14T21:57:33.765766] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T21:57:34.358080] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-14T21:57:34.445996] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-14T21:57:35.158071] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-14T21:57:35.709627] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T21:57:35.958038] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-14T21:57:36.168178] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T21:57:36.758090] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-14T21:57:37.242808] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T21:57:37.510329] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T21:57:37.558068] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-14T21:57:38.358040] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-14T21:57:38.744136] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T21:57:38.809069] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-14T21:57:39.158075] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-14T21:57:39.958120] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-14T21:57:40.758139] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-14T21:57:40.785742] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T21:57:41.044768] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T21:57:41.558066] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-14T21:57:41.595764] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T21:57:42.358102] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-14T21:57:42.424501] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T21:57:42.801353] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-14T21:57:43.158067] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-14T21:57:43.602417] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T21:57:43.958083] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-14T21:57:44.247236] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-14T21:57:44.248947] [INFO ] [REMOTE ] TPL: Full fetch complete (17662 records). [2025-10-14T21:57:44.249014] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-14T21:57:44.610919] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-14T21:57:44.611004] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-14T21:57:44.611431] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-14T21:57:44.611472] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-14T21:57:44.612218] [DEBUG] [LOCAL ] TPL: Trimmed 17662 records to 12351 (keeping 200 days of data) [2025-10-14T21:57:44.694990] [DEBUG] [LOCAL ] TPL: Primary data saved (12351 records). [2025-10-14T21:57:44.695179] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-14T21:57:44.695266] [INFO ] [MAIN ] Update Progress: 2117/2369 symbols completed. TPL took 27.3s. Estimated remaining: 35m 26s. Rate: 7.1 symbols/min [2025-10-14T21:57:44.758114] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-14T21:57:45.558091] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-14T21:57:46.292039] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-14T21:57:46.358081] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-14T21:57:46.584576] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-14T21:57:46.785207] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-14T21:57:47.158106] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-14T21:57:47.958180] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-14T21:57:48.758124] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-14T21:57:49.049639] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T21:57:49.202979] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T21:57:49.215944] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-14T21:57:49.558105] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-14T21:57:50.358071] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-14T21:57:51.158081] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-14T21:57:51.243579] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T21:57:51.524585] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-14T21:57:51.550329] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-14T21:57:51.551593] [INFO ] [REMOTE ] TPYP: Full fetch complete (12483 records). [2025-10-14T21:57:51.551703] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-14T21:57:51.916506] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-14T21:57:51.916576] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-14T21:57:51.916852] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-14T21:57:51.916922] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-14T21:57:51.917338] [DEBUG] [LOCAL ] TPYP: Trimmed 12483 records to 7955 (keeping 200 days of data) [2025-10-14T21:57:51.965282] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-14T21:57:51.965216] [DEBUG] [LOCAL ] TPYP: Primary data saved (7955 records). [2025-10-14T21:57:51.966253] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-14T21:57:51.966338] [INFO ] [MAIN ] Update Progress: 2118/2369 symbols completed. TPYP took 23.1s. Estimated remaining: 35m 18s. Rate: 7.1 symbols/min [2025-10-14T21:57:52.758103] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-14T21:57:53.910404] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-14T21:57:53.922551] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-14T21:57:53.939084] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-14T21:57:54.358111] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-14T21:57:55.347876] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T21:57:55.359189] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-14T21:57:55.546609] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-14T21:57:55.958069] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-14T21:57:56.873929] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T21:57:56.885426] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-14T21:57:57.145355] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T21:57:57.149253] [INFO ] [REMOTE ] TPVG: Full fetch complete (39654 records). [2025-10-14T21:57:57.149404] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-14T21:57:57.556783] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-14T21:57:57.557388] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-14T21:57:57.559068] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T21:57:57.558303] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-14T21:57:57.559182] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-14T21:57:57.565739] [DEBUG] [LOCAL ] TPVG: Trimmed 39654 records to 27289 (keeping 200 days of data) [2025-10-14T21:57:57.565614] [INFO ] [REMOTE ] TPR: Full fetch complete (77553 records). [2025-10-14T21:57:57.565900] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-14T21:57:58.065229] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-14T21:57:58.065671] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-14T21:57:58.067975] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-14T21:57:58.068059] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-14T21:57:58.071964] [DEBUG] [LOCAL ] TPR: Trimmed 77553 records to 53439 (keeping 200 days of data) [2025-10-14T21:57:58.244205] [DEBUG] [LOCAL ] TPVG: Primary data saved (27289 records). [2025-10-14T21:57:58.245098] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-14T21:57:58.245492] [INFO ] [MAIN ] Update Progress: 2119/2369 symbols completed. TPVG took 36.5s. Estimated remaining: 35m 9s. Rate: 7.1 symbols/min [2025-10-14T21:57:58.459703] [DEBUG] [LOCAL ] TPR: Primary data saved (53439 records). [2025-10-14T21:57:58.459828] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-14T21:57:58.459930] [INFO ] [MAIN ] Update Progress: 2120/2369 symbols completed. TPR took 38.3s. Estimated remaining: 34m 59s. Rate: 7.1 symbols/min [2025-10-14T21:57:59.109805] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:59.141745] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:59.144741] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:59.104695] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:57:59.153340] [DEBUG] [LOCAL ] TPZ: Loaded 4764 existing records from primary storage. [2025-10-14T21:57:59.153760] [INFO ] [MAIN ] TPZ: Loaded 4764 existing records. [2025-10-14T21:57:59.275750] [DEBUG] [LOCAL ] TRC: Loaded 15628 existing records from primary storage. [2025-10-14T21:57:59.279921] [DEBUG] [LOCAL ] TRAK: Loaded 9616 existing records from primary storage. [2025-10-14T21:57:59.299294] [DEBUG] [LOCAL ] TR: Loaded 18914 existing records from primary storage. [2025-10-14T21:57:59.287918] [INFO ] [MAIN ] TRC: Loaded 15628 existing records. [2025-10-14T21:57:59.288410] [INFO ] [MAIN ] TRAK: Loaded 9616 existing records. [2025-10-14T21:57:59.336114] [INFO ] [MAIN ] TR: Loaded 18914 existing records. [2025-10-14T21:57:59.569172] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:59.653281] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-14T21:57:59.693394] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-14T21:57:59.805825] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:59.855672] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-14T21:57:59.904468] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-14T21:57:59.904413] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:59.928124] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-14T21:57:59.885852] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-14T21:57:59.960313] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-14T21:57:59.970066] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:57:59.939139] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-14T21:58:00.004718] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-14T21:57:59.999451] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-14T21:58:00.004910] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-14T21:58:00.028162] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-14T21:58:00.028278] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-14T21:58:00.028382] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-14T21:58:00.101371] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-14T21:58:00.113993] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-14T21:58:01.117183] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:01.173806] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-14T21:58:01.267638] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:01.313708] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-14T21:58:01.378776] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:01.384215] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-14T21:58:01.444841] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:01.445130] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-14T21:58:02.117146] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-14T21:58:02.119585] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-14T21:58:02.380763] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T21:58:02.384151] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-14T21:58:02.402497] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T21:58:02.405061] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-14T21:58:02.433429] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T21:58:02.594931] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-14T21:58:03.067632] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-14T21:58:03.102698] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T21:58:03.158088] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-14T21:58:03.819636] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T21:58:03.958076] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-14T21:58:04.706344] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T21:58:04.758026] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-14T21:58:05.478075] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T21:58:05.558039] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-14T21:58:06.358103] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-14T21:58:06.507451] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-14T21:58:07.158093] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-14T21:58:07.179854] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T21:58:07.765205] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T21:58:07.958066] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-14T21:58:08.758105] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-14T21:58:08.934717] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T21:58:09.536885] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-14T21:58:09.558028] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-14T21:58:10.276802] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T21:58:10.358063] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-14T21:58:11.063534] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T21:58:11.158094] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-14T21:58:11.958081] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-14T21:58:12.212352] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T21:58:12.405683] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T21:58:12.758082] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-14T21:58:13.558073] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-14T21:58:13.740880] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T21:58:14.358104] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-14T21:58:14.391722] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T21:58:15.158063] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-14T21:58:15.391731] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T21:58:15.958195] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-14T21:58:16.038965] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T21:58:16.330021] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-14T21:58:16.758105] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-14T21:58:17.558044] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-14T21:58:17.796104] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T21:58:18.102861] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-14T21:58:18.358111] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-14T21:58:19.158086] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-14T21:58:19.450328] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T21:58:19.946210] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-14T21:58:19.958028] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-14T21:58:20.758044] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-14T21:58:21.098739] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T21:58:21.367991] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-14T21:58:21.558065] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-14T21:58:22.359553] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-14T21:58:22.363947] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T21:58:23.158084] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-14T21:58:23.292513] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-14T21:58:23.958066] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-14T21:58:24.101911] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-14T21:58:24.758049] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-14T21:58:24.991923] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T21:58:25.558036] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-14T21:58:25.693930] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T21:58:26.116490] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T21:58:26.118376] [INFO ] [REMOTE ] TRAK: Full fetch complete (13623 records). [2025-10-14T21:58:26.118450] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-14T21:58:26.363214] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-14T21:58:26.495727] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-14T21:58:26.495810] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-14T21:58:26.496141] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-14T21:58:26.496201] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-14T21:58:26.496787] [DEBUG] [LOCAL ] TRAK: Trimmed 13623 records to 9650 (keeping 200 days of data) [2025-10-14T21:58:26.557246] [DEBUG] [LOCAL ] TRAK: Primary data saved (9650 records). [2025-10-14T21:58:26.557415] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-14T21:58:26.557511] [INFO ] [MAIN ] Update Progress: 2121/2369 symbols completed. TRAK took 28.1s. Estimated remaining: 34m 53s. Rate: 7.1 symbols/min [2025-10-14T21:58:26.731014] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:58:26.776472] [DEBUG] [LOCAL ] TREX: Loaded 49851 existing records from primary storage. [2025-10-14T21:58:26.776864] [INFO ] [MAIN ] TREX: Loaded 49851 existing records. [2025-10-14T21:58:26.956133] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:58:26.956365] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-14T21:58:26.956463] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-14T21:58:26.956775] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-14T21:58:26.956844] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-14T21:58:27.167248] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-14T21:58:27.320613] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:27.330882] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T21:58:27.890414] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T21:58:27.958059] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-14T21:58:28.419449] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T21:58:28.758084] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-14T21:58:29.309947] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T21:58:29.558061] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-14T21:58:30.358107] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-14T21:58:30.925404] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T21:58:31.158073] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-14T21:58:31.323670] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T21:58:31.326100] [INFO ] [REMOTE ] TR: Full fetch complete (25432 records). [2025-10-14T21:58:31.326169] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-14T21:58:31.695534] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-14T21:58:31.695604] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-14T21:58:31.696137] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-14T21:58:31.696196] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-14T21:58:31.696819] [DEBUG] [LOCAL ] TR: Trimmed 25432 records to 18940 (keeping 200 days of data) [2025-10-14T21:58:31.812498] [DEBUG] [LOCAL ] TR: Primary data saved (18940 records). [2025-10-14T21:58:31.812626] [INFO ] [MAIN ] TR: Full history saved. [2025-10-14T21:58:31.812749] [INFO ] [MAIN ] Update Progress: 2122/2369 symbols completed. TR took 33.3s. Estimated remaining: 34m 44s. Rate: 7.1 symbols/min [2025-10-14T21:58:31.960785] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-14T21:58:31.984817] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:58:32.035905] [DEBUG] [LOCAL ] TRGP: Loaded 50843 existing records from primary storage. [2025-10-14T21:58:32.036196] [INFO ] [MAIN ] TRGP: Loaded 50843 existing records. [2025-10-14T21:58:32.212019] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:58:32.212206] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-14T21:58:32.212271] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-14T21:58:32.212580] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-14T21:58:32.212620] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-14T21:58:32.575614] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:32.581103] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T21:58:32.733016] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T21:58:32.758029] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-14T21:58:33.244046] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T21:58:33.245259] [INFO ] [REMOTE ] TPZ: Full fetch complete (9056 records). [2025-10-14T21:58:33.245345] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-14T21:58:33.563210] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-14T21:58:33.624591] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-14T21:58:33.624722] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-14T21:58:33.625032] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-14T21:58:33.625095] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-14T21:58:33.625722] [DEBUG] [LOCAL ] TPZ: Trimmed 9056 records to 4740 (keeping 200 days of data) [2025-10-14T21:58:33.657206] [DEBUG] [LOCAL ] TPZ: Primary data saved (4740 records). [2025-10-14T21:58:33.657354] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-14T21:58:33.657469] [INFO ] [MAIN ] Update Progress: 2123/2369 symbols completed. TPZ took 35.2s. Estimated remaining: 34m 35s. Rate: 7.1 symbols/min [2025-10-14T21:58:33.827556] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:58:33.863737] [DEBUG] [LOCAL ] TRN: Loaded 36838 existing records from primary storage. [2025-10-14T21:58:33.864010] [INFO ] [MAIN ] TRN: Loaded 36838 existing records. [2025-10-14T21:58:34.039316] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:58:34.039559] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-14T21:58:34.039619] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-14T21:58:34.039962] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-14T21:58:34.040011] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-14T21:58:34.363270] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-14T21:58:34.401536] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:35.158103] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-14T21:58:35.213509] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T21:58:35.226737] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-14T21:58:35.239389] [INFO ] [REMOTE ] TRC: Full fetch complete (21842 records). [2025-10-14T21:58:35.239593] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-14T21:58:35.298102] [DEBUG] [REMOTE ] TRGP: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-14T21:58:35.342511] [WARN ] [REMOTE ] TRGP: No data returned for month 2024-12 [2025-10-14T21:58:35.382604] [FATAL] [REMOTE ] TRGP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T21:58:35.400405] [FATAL] [MAIN ] TRGP: Failed to fetch primary data. [2025-10-14T21:58:35.406418] [WARN ] [MAIN ] TRGP: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T21:58:35.421963] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-14T21:58:35.437624] [DEBUG] [LOCAL ] TRGP: No primary data file found to delete. [2025-10-14T21:58:35.457575] [INFO ] [LOCAL ] TRGP: Starting deletion of derivative data. [2025-10-14T21:58:35.474803] [DEBUG] [LOCAL ] TRGP: Deleted derivative data file. [2025-10-14T21:58:35.493916] [INFO ] [MAIN ] Update Progress: 2124/2369 symbols completed. TRGP took 3.7s. Estimated remaining: 34m 26s. Rate: 7.1 symbols/min [2025-10-14T21:58:35.881523] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:58:35.881714] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-14T21:58:35.881788] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-14T21:58:35.882546] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-14T21:58:35.882609] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-14T21:58:35.883266] [DEBUG] [LOCAL ] TRC: Trimmed 21842 records to 15544 (keeping 200 days of data) [2025-10-14T21:58:35.958430] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-14T21:58:35.990257] [DEBUG] [LOCAL ] TRC: Primary data saved (15544 records). [2025-10-14T21:58:35.990438] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-14T21:58:35.990528] [INFO ] [MAIN ] Update Progress: 2125/2369 symbols completed. TRC took 37.5s. Estimated remaining: 34m 17s. Rate: 7.1 symbols/min [2025-10-14T21:58:36.127033] [DEBUG] [LOCAL ] TRNO: Loaded 43857 existing records from primary storage. [2025-10-14T21:58:36.150882] [INFO ] [MAIN ] TRNO: Loaded 43857 existing records. [2025-10-14T21:58:36.251608] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:58:36.358275] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:58:36.358539] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-14T21:58:36.358594] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-14T21:58:36.358840] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-14T21:58:36.358896] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-14T21:58:36.609129] [DEBUG] [LOCAL ] TROX: Loaded 52089 existing records from primary storage. [2025-10-14T21:58:36.658586] [INFO ] [MAIN ] TROX: Loaded 52089 existing records. [2025-10-14T21:58:36.766682] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-14T21:58:36.868188] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:36.942883] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:58:36.943029] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-14T21:58:36.943075] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-14T21:58:36.943246] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-14T21:58:36.943284] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-14T21:58:37.296114] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:37.558073] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-14T21:58:37.667394] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T21:58:38.218954] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T21:58:38.358087] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-14T21:58:39.073582] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T21:58:39.158095] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-14T21:58:39.609859] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-14T21:58:39.958073] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-14T21:58:40.758096] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-14T21:58:40.806461] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T21:58:41.558066] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-14T21:58:41.831747] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T21:58:42.358118] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-14T21:58:42.431308] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T21:58:42.720108] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T21:58:43.158074] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-14T21:58:43.845522] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T21:58:43.958037] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-14T21:58:44.420839] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T21:58:44.758074] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-14T21:58:45.497087] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T21:58:45.558042] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-14T21:58:46.358087] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-14T21:58:46.432584] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T21:58:47.158066] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-14T21:58:47.275053] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T21:58:47.710322] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T21:58:47.958114] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-14T21:58:48.758045] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-14T21:58:48.796929] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T21:58:49.241865] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T21:58:49.558082] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-14T21:58:49.900841] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T21:58:50.358156] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-14T21:58:51.158077] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-14T21:58:51.325854] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-14T21:58:51.671477] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-14T21:58:51.958115] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-14T21:58:52.463142] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T21:58:52.468778] [INFO ] [REMOTE ] TREX: Full fetch complete (71395 records). [2025-10-14T21:58:52.468917] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-14T21:58:52.763179] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-14T21:58:52.878545] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-14T21:58:52.878625] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-14T21:58:52.879896] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-14T21:58:52.879959] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-14T21:58:52.881445] [DEBUG] [LOCAL ] TREX: Trimmed 71395 records to 49850 (keeping 200 days of data) [2025-10-14T21:58:53.105539] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-14T21:58:53.208105] [DEBUG] [LOCAL ] TREX: Primary data saved (49850 records). [2025-10-14T21:58:53.208246] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-14T21:58:53.208323] [INFO ] [MAIN ] Update Progress: 2126/2369 symbols completed. TREX took 26.7s. Estimated remaining: 34m 9s. Rate: 7.1 symbols/min [2025-10-14T21:58:53.383206] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:58:53.430128] [DEBUG] [LOCAL ] TRP: Loaded 52141 existing records from primary storage. [2025-10-14T21:58:53.430477] [INFO ] [MAIN ] TRP: Loaded 52141 existing records. [2025-10-14T21:58:53.572598] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-14T21:58:53.612960] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:58:53.613726] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-14T21:58:53.613778] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-14T21:58:53.613988] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-14T21:58:53.614044] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-14T21:58:53.978611] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:58:54.133418] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-14T21:58:54.358040] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-14T21:58:55.123179] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T21:58:55.158019] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-14T21:58:55.343294] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T21:58:55.958075] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-14T21:58:56.623635] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-14T21:58:56.758131] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-14T21:58:57.437668] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T21:58:57.558038] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-14T21:58:57.683374] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T21:58:58.358120] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-14T21:58:59.158108] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-14T21:58:59.404999] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-14T21:58:59.868303] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T21:58:59.958042] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-14T21:59:00.758071] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-14T21:59:00.842402] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T21:59:01.558087] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-14T21:59:01.586957] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T21:59:02.358108] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-14T21:59:02.511213] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T21:59:03.158085] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-14T21:59:03.324378] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T21:59:03.671555] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T21:59:03.958065] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-14T21:59:04.524385] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T21:59:04.530216] [INFO ] [REMOTE ] TROX: Full fetch complete (73712 records). [2025-10-14T21:59:04.530335] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-14T21:59:04.767011] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-14T21:59:04.920566] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-14T21:59:04.920663] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-14T21:59:04.921872] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-14T21:59:04.921933] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-14T21:59:04.923256] [DEBUG] [LOCAL ] TROX: Trimmed 73712 records to 52150 (keeping 200 days of data) [2025-10-14T21:59:05.222345] [DEBUG] [LOCAL ] TROX: Primary data saved (52150 records). [2025-10-14T21:59:05.222472] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-14T21:59:05.222555] [INFO ] [MAIN ] Update Progress: 2127/2369 symbols completed. TROX took 29.2s. Estimated remaining: 34m 1s. Rate: 7.1 symbols/min [2025-10-14T21:59:05.394994] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:05.429068] [DEBUG] [LOCAL ] TRTX: Loaded 37391 existing records from primary storage. [2025-10-14T21:59:05.429408] [INFO ] [MAIN ] TRTX: Loaded 37391 existing records. [2025-10-14T21:59:05.572332] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-14T21:59:05.616809] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:05.617399] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-14T21:59:05.617479] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-14T21:59:05.617896] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-14T21:59:05.617957] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-14T21:59:05.890083] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-14T21:59:06.037978] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:06.307819] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T21:59:06.358103] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-14T21:59:06.665603] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T21:59:07.158059] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-14T21:59:07.958076] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-14T21:59:07.993561] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T21:59:08.447925] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T21:59:08.451792] [INFO ] [REMOTE ] TRN: Full fetch complete (52664 records). [2025-10-14T21:59:08.451873] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-14T21:59:08.763267] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-14T21:59:08.833118] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-14T21:59:08.833195] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-14T21:59:08.834187] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-14T21:59:08.834248] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-14T21:59:08.835317] [DEBUG] [LOCAL ] TRN: Trimmed 52664 records to 36858 (keeping 200 days of data) [2025-10-14T21:59:09.046155] [DEBUG] [LOCAL ] TRN: Primary data saved (36858 records). [2025-10-14T21:59:09.046283] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-14T21:59:09.046366] [INFO ] [MAIN ] Update Progress: 2128/2369 symbols completed. TRN took 35.4s. Estimated remaining: 33m 52s. Rate: 7.1 symbols/min [2025-10-14T21:59:09.218330] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:09.264532] [DEBUG] [LOCAL ] TRU: Loaded 51424 existing records from primary storage. [2025-10-14T21:59:09.264878] [INFO ] [MAIN ] TRU: Loaded 51424 existing records. [2025-10-14T21:59:09.443385] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:09.443729] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-14T21:59:09.443835] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-14T21:59:09.444068] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-14T21:59:09.444122] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-14T21:59:09.567229] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-14T21:59:09.755121] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T21:59:09.840758] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:10.190023] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T21:59:10.358078] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-14T21:59:11.023132] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T21:59:11.158048] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-14T21:59:11.814633] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T21:59:11.958069] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-14T21:59:12.398591] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T21:59:12.758063] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-14T21:59:13.558114] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-14T21:59:13.746131] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-14T21:59:14.087934] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-14T21:59:14.092888] [INFO ] [REMOTE ] TRNO: Full fetch complete (63135 records). [2025-10-14T21:59:14.093016] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-14T21:59:14.363338] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-14T21:59:14.491433] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-14T21:59:14.491514] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-14T21:59:14.492609] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-14T21:59:14.492693] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-14T21:59:14.494528] [DEBUG] [LOCAL ] TRNO: Trimmed 63135 records to 43872 (keeping 200 days of data) [2025-10-14T21:59:14.775481] [DEBUG] [LOCAL ] TRNO: Primary data saved (43872 records). [2025-10-14T21:59:14.775619] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-14T21:59:14.775733] [INFO ] [MAIN ] Update Progress: 2129/2369 symbols completed. TRNO took 39.2s. Estimated remaining: 33m 44s. Rate: 7.1 symbols/min [2025-10-14T21:59:14.956348] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:14.984925] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T21:59:15.023519] [DEBUG] [LOCAL ] TRV: Loaded 47472 existing records from primary storage. [2025-10-14T21:59:15.023935] [INFO ] [MAIN ] TRV: Loaded 47472 existing records. [2025-10-14T21:59:15.169349] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-14T21:59:15.209978] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:15.210425] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-14T21:59:15.210481] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-14T21:59:15.210705] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-14T21:59:15.210763] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-14T21:59:15.566052] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:15.673392] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-14T21:59:15.958096] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-14T21:59:16.669407] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T21:59:16.758083] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-14T21:59:17.558128] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-14T21:59:17.687466] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T21:59:18.358138] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-14T21:59:18.756253] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T21:59:19.158152] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-14T21:59:19.958036] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-14T21:59:20.226860] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-14T21:59:20.758100] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-14T21:59:21.656979] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T21:59:21.668509] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-14T21:59:22.202079] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (5.44 seconds). [2025-10-14T21:59:22.358041] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-14T21:59:22.516056] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-14T21:59:23.121254] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T21:59:23.158021] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-14T21:59:23.389517] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (4.23 seconds). [2025-10-14T21:59:23.927633] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T21:59:23.958030] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-14T21:59:24.758039] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-14T21:59:24.994521] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T21:59:25.471991] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T21:59:25.558033] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-14T21:59:26.358064] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-14T21:59:26.540215] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T21:59:27.158059] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-14T21:59:27.311514] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T21:59:27.496271] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T21:59:27.958082] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-14T21:59:28.758088] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-14T21:59:28.887044] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-14T21:59:29.558091] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-14T21:59:29.639968] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T21:59:30.154504] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T21:59:30.358086] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-14T21:59:31.158071] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-14T21:59:31.235216] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T21:59:31.403021] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-14T21:59:31.958046] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-14T21:59:32.758049] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-14T21:59:32.864866] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T21:59:33.330588] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T21:59:33.558059] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-14T21:59:33.735387] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T21:59:34.358070] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-14T21:59:35.022051] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-14T21:59:35.158063] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-14T21:59:35.757529] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T21:59:35.958067] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-14T21:59:36.758094] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-14T21:59:36.836768] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T21:59:37.242788] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T21:59:37.558059] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-14T21:59:38.305040] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T21:59:38.310874] [INFO ] [REMOTE ] TRP: Full fetch complete (75688 records). [2025-10-14T21:59:38.310995] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-14T21:59:38.370292] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-14T21:59:38.729969] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-14T21:59:38.730073] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-14T21:59:38.731419] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-14T21:59:38.731484] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-14T21:59:38.733700] [DEBUG] [LOCAL ] TRP: Trimmed 75688 records to 52150 (keeping 200 days of data) [2025-10-14T21:59:38.988007] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T21:59:39.109582] [DEBUG] [LOCAL ] TRP: Primary data saved (52150 records). [2025-10-14T21:59:39.109755] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-14T21:59:39.109847] [INFO ] [MAIN ] Update Progress: 2130/2369 symbols completed. TRP took 45.9s. Estimated remaining: 33m 37s. Rate: 7.1 symbols/min [2025-10-14T21:59:39.166927] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-14T21:59:39.285936] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:39.332837] [DEBUG] [LOCAL ] TS: Loaded 51672 existing records from primary storage. [2025-10-14T21:59:39.333136] [INFO ] [MAIN ] TS: Loaded 51672 existing records. [2025-10-14T21:59:39.540388] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:39.540681] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-14T21:59:39.540738] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-14T21:59:39.541198] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-14T21:59:39.541255] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-14T21:59:39.920406] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:39.958031] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-14T21:59:40.124178] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T21:59:40.172383] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T21:59:40.176563] [INFO ] [REMOTE ] TRTX: Full fetch complete (53139 records). [2025-10-14T21:59:40.176735] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-14T21:59:40.563280] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-14T21:59:40.563371] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-14T21:59:40.564381] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-14T21:59:40.564442] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-14T21:59:40.565581] [DEBUG] [LOCAL ] TRTX: Trimmed 53139 records to 37327 (keeping 200 days of data) [2025-10-14T21:59:40.758424] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-14T21:59:40.784352] [DEBUG] [LOCAL ] TRTX: Primary data saved (37327 records). [2025-10-14T21:59:40.784500] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-14T21:59:40.784583] [INFO ] [MAIN ] Update Progress: 2131/2369 symbols completed. TRTX took 35.6s. Estimated remaining: 33m 28s. Rate: 7.1 symbols/min [2025-10-14T21:59:40.961274] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:40.987314] [DEBUG] [LOCAL ] TSE: Loaded 27793 existing records from primary storage. [2025-10-14T21:59:40.987553] [INFO ] [MAIN ] TSE: Loaded 27793 existing records. [2025-10-14T21:59:41.175562] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:41.175795] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-14T21:59:41.175841] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-14T21:59:41.176099] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-14T21:59:41.176139] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-14T21:59:41.550283] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:41.558035] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-14T21:59:41.680181] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T21:59:42.358051] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-14T21:59:42.613745] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-14T21:59:42.874169] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T21:59:43.158133] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-14T21:59:43.813923] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T21:59:43.819971] [INFO ] [REMOTE ] TRU: Full fetch complete (73917 records). [2025-10-14T21:59:43.820097] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-14T21:59:43.963191] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-14T21:59:44.244733] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-14T21:59:44.244855] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-14T21:59:44.246005] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-14T21:59:44.246065] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-14T21:59:44.247507] [DEBUG] [LOCAL ] TRU: Trimmed 73917 records to 51431 (keeping 200 days of data) [2025-10-14T21:59:44.580247] [DEBUG] [LOCAL ] TRU: Primary data saved (51431 records). [2025-10-14T21:59:44.580389] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-14T21:59:44.580470] [INFO ] [MAIN ] Update Progress: 2132/2369 symbols completed. TRU took 35.5s. Estimated remaining: 33m 19s. Rate: 7.1 symbols/min [2025-10-14T21:59:44.760847] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-14T21:59:44.791248] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:44.801704] [DEBUG] [LOCAL ] TSI: Loaded 7889 existing records from primary storage. [2025-10-14T21:59:44.801921] [INFO ] [MAIN ] TSI: Loaded 7889 existing records. [2025-10-14T21:59:44.952664] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T21:59:45.051330] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:45.051545] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-14T21:59:45.051594] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-14T21:59:45.051788] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-14T21:59:45.051846] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-14T21:59:45.432101] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:45.558088] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-14T21:59:45.720670] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T21:59:45.916278] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T21:59:45.997586] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-14T21:59:46.358117] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-14T21:59:47.158055] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-14T21:59:47.846290] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-14T21:59:47.958041] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-14T21:59:48.075355] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-14T21:59:48.758040] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-14T21:59:48.897432] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T21:59:49.558081] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-14T21:59:49.990070] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T21:59:50.140900] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T21:59:50.147244] [INFO ] [REMOTE ] TRV: Full fetch complete (69647 records). [2025-10-14T21:59:50.147481] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-14T21:59:50.370916] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-14T21:59:50.600415] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-14T21:59:50.600505] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-14T21:59:50.601816] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-14T21:59:50.601886] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-14T21:59:50.603406] [DEBUG] [LOCAL ] TRV: Trimmed 69647 records to 47444 (keeping 200 days of data) [2025-10-14T21:59:50.897587] [DEBUG] [LOCAL ] TRV: Primary data saved (47444 records). [2025-10-14T21:59:50.897751] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-14T21:59:50.898457] [INFO ] [MAIN ] Update Progress: 2133/2369 symbols completed. TRV took 36.1s. Estimated remaining: 33m 10s. Rate: 7.1 symbols/min [2025-10-14T21:59:51.091502] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T21:59:51.126111] [DEBUG] [LOCAL ] TSLX: Loaded 35780 existing records from primary storage. [2025-10-14T21:59:51.126397] [INFO ] [MAIN ] TSLX: Loaded 35780 existing records. [2025-10-14T21:59:51.163391] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-14T21:59:51.309211] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T21:59:51.309622] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-14T21:59:51.309771] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-14T21:59:51.309961] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-14T21:59:51.310001] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-14T21:59:51.663962] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T21:59:51.734011] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T21:59:51.958047] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-14T21:59:52.137451] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T21:59:52.758070] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-14T21:59:52.993800] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T21:59:53.558072] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-14T21:59:54.287781] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T21:59:54.312307] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T21:59:54.358026] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-14T21:59:55.158090] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-14T21:59:55.631125] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T21:59:55.958099] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-14T21:59:56.679561] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T21:59:56.758067] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-14T21:59:57.316710] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-14T21:59:57.558099] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-14T21:59:58.170378] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T21:59:58.358116] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-14T21:59:59.008609] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T21:59:59.158069] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-14T21:59:59.958099] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-14T22:00:00.169855] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T22:00:00.556186] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T22:00:00.732886] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T22:00:00.758055] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-14T22:00:01.558078] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-14T22:00:02.318074] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T22:00:02.358024] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-14T22:00:02.713784] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-14T22:00:03.139715] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-14T22:00:03.158031] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-14T22:00:03.958107] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-14T22:00:04.758102] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-14T22:00:04.898330] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T22:00:04.935239] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T22:00:05.558061] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-14T22:00:05.950404] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T22:00:06.221113] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-14T22:00:06.358077] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-14T22:00:07.160534] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-14T22:00:07.162299] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T22:00:07.165453] [INFO ] [REMOTE ] TSI: Full fetch complete (13816 records). [2025-10-14T22:00:07.165548] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-14T22:00:07.540713] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-14T22:00:07.540797] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-14T22:00:07.541095] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-14T22:00:07.541134] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-14T22:00:07.541601] [DEBUG] [LOCAL ] TSI: Trimmed 13816 records to 8000 (keeping 200 days of data) [2025-10-14T22:00:07.587953] [DEBUG] [LOCAL ] TSI: Primary data saved (8000 records). [2025-10-14T22:00:07.588085] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-14T22:00:07.588166] [INFO ] [MAIN ] Update Progress: 2134/2369 symbols completed. TSI took 23.0s. Estimated remaining: 33m 3s. Rate: 7.1 symbols/min [2025-10-14T22:00:07.754947] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:07.805268] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-14T22:00:07.805612] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-14T22:00:07.982615] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-14T22:00:07.988217] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:07.988426] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-14T22:00:07.989219] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-14T22:00:07.990240] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-14T22:00:07.990299] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-14T22:00:08.356672] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:08.758073] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-14T22:00:09.051100] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T22:00:09.172068] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-14T22:00:09.558065] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-14T22:00:10.358092] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-14T22:00:10.606518] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T22:00:11.158117] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-14T22:00:11.958106] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-14T22:00:12.749137] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T22:00:12.758022] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-14T22:00:13.163844] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (3.61 seconds). [2025-10-14T22:00:13.385715] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-10-14T22:00:13.558074] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-14T22:00:14.292677] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:00:14.358035] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-14T22:00:15.158081] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-14T22:00:15.861980] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T22:00:15.958091] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-14T22:00:16.070263] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (4.11 seconds). [2025-10-14T22:00:16.340837] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-10-14T22:00:16.758065] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-14T22:00:16.937566] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T22:00:16.942455] [INFO ] [REMOTE ] TSLX: Full fetch complete (50135 records). [2025-10-14T22:00:16.942597] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-14T22:00:17.330752] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-14T22:00:17.330833] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-14T22:00:17.331908] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-14T22:00:17.331971] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-14T22:00:17.333041] [DEBUG] [LOCAL ] TSLX: Trimmed 50135 records to 35821 (keeping 200 days of data) [2025-10-14T22:00:17.549147] [DEBUG] [LOCAL ] TSLX: Primary data saved (35821 records). [2025-10-14T22:00:17.549279] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-14T22:00:17.549358] [INFO ] [MAIN ] Update Progress: 2135/2369 symbols completed. TSLX took 26.7s. Estimated remaining: 32m 54s. Rate: 7.1 symbols/min [2025-10-14T22:00:17.572880] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-14T22:00:17.732872] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:17.780915] [DEBUG] [LOCAL ] TSN: Loaded 53006 existing records from primary storage. [2025-10-14T22:00:17.781211] [INFO ] [MAIN ] TSN: Loaded 53006 existing records. [2025-10-14T22:00:17.907348] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-14T22:00:17.994181] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:17.994487] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-14T22:00:17.994707] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-14T22:00:17.995122] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-14T22:00:17.995209] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-14T22:00:18.354070] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:18.358024] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-14T22:00:18.636898] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T22:00:19.158115] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-14T22:00:19.958091] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-14T22:00:20.107249] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T22:00:20.281120] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-14T22:00:20.623873] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T22:00:20.629507] [INFO ] [REMOTE ] TS: Full fetch complete (74673 records). [2025-10-14T22:00:20.629615] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-14T22:00:20.769270] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-14T22:00:21.026490] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-14T22:00:21.026590] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-14T22:00:21.027787] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-14T22:00:21.027893] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-14T22:00:21.029319] [DEBUG] [LOCAL ] TS: Trimmed 74673 records to 51676 (keeping 200 days of data) [2025-10-14T22:00:21.255770] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T22:00:21.353602] [DEBUG] [LOCAL ] TS: Primary data saved (51676 records). [2025-10-14T22:00:21.353784] [INFO ] [MAIN ] TS: Full history saved. [2025-10-14T22:00:21.353873] [INFO ] [MAIN ] Update Progress: 2136/2369 symbols completed. TS took 42.2s. Estimated remaining: 32m 45s. Rate: 7.1 symbols/min [2025-10-14T22:00:21.523254] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:21.534394] [DEBUG] [LOCAL ] TSQ: Loaded 11703 existing records from primary storage. [2025-10-14T22:00:21.534611] [INFO ] [MAIN ] TSQ: Loaded 11703 existing records. [2025-10-14T22:00:21.565494] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-14T22:00:21.714699] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:21.714906] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-14T22:00:21.714953] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-14T22:00:21.715246] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-14T22:00:21.715303] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-14T22:00:22.074077] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:22.358098] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-14T22:00:22.388440] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-14T22:00:23.158078] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-14T22:00:23.940691] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T22:00:23.958035] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-14T22:00:24.064959] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (3.30 seconds). [2025-10-14T22:00:24.367475] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-14T22:00:24.754518] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T22:00:24.758019] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-14T22:00:25.274226] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-14T22:00:25.558069] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-14T22:00:26.244566] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T22:00:26.247813] [INFO ] [REMOTE ] TSE: Full fetch complete (40678 records). [2025-10-14T22:00:26.247996] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-14T22:00:26.361426] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-14T22:00:26.649200] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-14T22:00:26.649288] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-14T22:00:26.650190] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-14T22:00:26.650254] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-14T22:00:26.651322] [DEBUG] [LOCAL ] TSE: Trimmed 40678 records to 27791 (keeping 200 days of data) [2025-10-14T22:00:26.808438] [DEBUG] [LOCAL ] TSE: Primary data saved (27791 records). [2025-10-14T22:00:26.808587] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-14T22:00:26.808701] [INFO ] [MAIN ] Update Progress: 2137/2369 symbols completed. TSE took 46.0s. Estimated remaining: 32m 37s. Rate: 7.1 symbols/min [2025-10-14T22:00:26.980342] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:27.021985] [DEBUG] [LOCAL ] TT: Loaded 47416 existing records from primary storage. [2025-10-14T22:00:27.022324] [INFO ] [MAIN ] TT: Loaded 47416 existing records. [2025-10-14T22:00:27.165408] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-14T22:00:27.206778] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:27.206979] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-14T22:00:27.207025] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-14T22:00:27.207800] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-14T22:00:27.207904] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-14T22:00:27.563506] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:27.958106] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-14T22:00:28.764176] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-14T22:00:28.766744] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-14T22:00:28.833163] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-14T22:00:29.187894] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-14T22:00:29.558089] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-14T22:00:30.353212] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T22:00:30.358021] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-14T22:00:30.640455] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T22:00:31.158074] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-14T22:00:31.280852] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-14T22:00:31.958068] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-14T22:00:32.758083] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-14T22:00:33.106117] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-14T22:00:33.558048] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-14T22:00:33.597756] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T22:00:34.358069] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-14T22:00:35.158080] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-14T22:00:35.361566] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T22:00:35.445887] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-14T22:00:35.687368] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T22:00:35.743941] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-14T22:00:35.958145] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-14T22:00:36.758110] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-14T22:00:37.526460] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T22:00:37.558026] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-14T22:00:38.303521] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-14T22:00:38.358122] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-14T22:00:38.590182] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-14T22:00:39.158111] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-14T22:00:39.958146] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-14T22:00:40.224936] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T22:00:40.602434] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-14T22:00:40.604004] [INFO ] [REMOTE ] TSQ: Full fetch complete (16432 records). [2025-10-14T22:00:40.604080] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-14T22:00:40.762110] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-14T22:00:40.971746] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-14T22:00:40.971826] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-14T22:00:40.972189] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-14T22:00:40.972226] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-14T22:00:40.972858] [DEBUG] [LOCAL ] TSQ: Trimmed 16432 records to 11710 (keeping 200 days of data) [2025-10-14T22:00:41.039847] [DEBUG] [LOCAL ] TSQ: Primary data saved (11710 records). [2025-10-14T22:00:41.039985] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-14T22:00:41.040063] [INFO ] [MAIN ] Update Progress: 2138/2369 symbols completed. TSQ took 19.7s. Estimated remaining: 32m 29s. Rate: 7.1 symbols/min [2025-10-14T22:00:41.211794] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:41.211956] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-14T22:00:41.211993] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-14T22:00:41.212128] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-14T22:00:41.212193] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-14T22:00:41.212245] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-14T22:00:41.212279] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-14T22:00:41.558050] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-14T22:00:41.581482] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:41.628665] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-14T22:00:42.358115] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-14T22:00:42.768812] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-14T22:00:43.158076] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-14T22:00:43.356931] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:00:43.357281] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-14T22:00:43.357370] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:00:43.357415] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-14T22:00:43.357471] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:00:43.357561] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-14T22:00:43.357622] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-14T22:00:43.357692] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-14T22:00:43.357749] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-14T22:00:43.357795] [INFO ] [MAIN ] Update Progress: 2139/2369 symbols completed. TTAM took 2.3s. Estimated remaining: 32m 20s. Rate: 7.1 symbols/min [2025-10-14T22:00:43.527733] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:43.563431] [DEBUG] [LOCAL ] TTC: Loaded 42016 existing records from primary storage. [2025-10-14T22:00:43.563720] [INFO ] [MAIN ] TTC: Loaded 42016 existing records. [2025-10-14T22:00:43.754206] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:43.771998] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-14T22:00:43.772117] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-14T22:00:43.773938] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-14T22:00:43.773876] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-14T22:00:43.774048] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-14T22:00:43.968897] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-14T22:00:44.137788] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:44.758095] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-14T22:00:45.342069] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-10-14T22:00:45.558121] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-14T22:00:46.264205] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-14T22:00:46.310936] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T22:00:46.358054] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-14T22:00:47.158110] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-14T22:00:47.921976] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T22:00:47.958074] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-14T22:00:48.335147] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-14T22:00:48.758111] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-14T22:00:49.257257] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-14T22:00:49.558033] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-14T22:00:49.623926] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T22:00:50.358039] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-14T22:00:50.489412] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T22:00:51.158070] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-14T22:00:51.958164] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-14T22:00:52.271786] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-14T22:00:52.310428] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-14T22:00:52.316534] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-14T22:00:52.316684] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-14T22:00:52.647430] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T22:00:52.752509] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-14T22:00:52.752590] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-14T22:00:52.753785] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-14T22:00:52.753847] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-14T22:00:52.755567] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-14T22:00:52.810585] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-14T22:00:53.093450] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-14T22:00:53.093586] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-14T22:00:53.094383] [INFO ] [MAIN ] Update Progress: 2140/2369 symbols completed. TSM took 45.5s. Estimated remaining: 32m 11s. Rate: 7.1 symbols/min [2025-10-14T22:00:53.271161] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:53.319429] [DEBUG] [LOCAL ] TTE: Loaded 51576 existing records from primary storage. [2025-10-14T22:00:53.319807] [INFO ] [MAIN ] TTE: Loaded 51576 existing records. [2025-10-14T22:00:53.498368] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:53.498668] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-14T22:00:53.498788] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-14T22:00:53.499698] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-14T22:00:53.499759] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-14T22:00:53.562687] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-14T22:00:53.946045] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-14T22:00:53.989393] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:54.358058] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-14T22:00:54.458778] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T22:00:55.158068] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-14T22:00:55.525783] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-14T22:00:55.958126] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-14T22:00:56.098481] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T22:00:56.631782] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-14T22:00:56.758044] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-14T22:00:57.046799] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-14T22:00:57.053567] [INFO ] [REMOTE ] TSN: Full fetch complete (76582 records). [2025-10-14T22:00:57.053754] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-14T22:00:57.467053] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-14T22:00:57.467194] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-14T22:00:57.468430] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-14T22:00:57.468515] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-14T22:00:57.470149] [DEBUG] [LOCAL ] TSN: Trimmed 76582 records to 53014 (keeping 200 days of data) [2025-10-14T22:00:57.561459] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-14T22:00:57.610217] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-14T22:00:57.842367] [DEBUG] [LOCAL ] TSN: Primary data saved (53014 records). [2025-10-14T22:00:57.842512] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-14T22:00:57.842614] [INFO ] [MAIN ] Update Progress: 2141/2369 symbols completed. TSN took 40.3s. Estimated remaining: 32m 3s. Rate: 7.1 symbols/min [2025-10-14T22:00:58.009608] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:00:58.049726] [DEBUG] [LOCAL ] TTI: Loaded 46249 existing records from primary storage. [2025-10-14T22:00:58.050025] [INFO ] [MAIN ] TTI: Loaded 46249 existing records. [2025-10-14T22:00:58.224173] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:00:58.224405] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-14T22:00:58.224453] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-14T22:00:58.225118] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-14T22:00:58.225186] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-14T22:00:58.363255] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-14T22:00:58.580530] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:00:59.158097] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-14T22:00:59.292326] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T22:00:59.958075] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-14T22:01:00.276230] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T22:01:00.379298] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T22:01:00.758068] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-14T22:01:01.558042] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-14T22:01:01.752206] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-14T22:01:02.358128] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-14T22:01:02.570140] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-14T22:01:03.158080] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-14T22:01:03.586499] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-14T22:01:03.958043] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-14T22:01:04.226700] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-14T22:01:04.586839] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T22:01:04.758044] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-14T22:01:05.558050] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-14T22:01:05.883923] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-14T22:01:06.143125] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T22:01:06.171109] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T22:01:06.178760] [INFO ] [REMOTE ] TT: Full fetch complete (69904 records). [2025-10-14T22:01:06.178894] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-14T22:01:06.359727] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-14T22:01:06.589022] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-14T22:01:06.589106] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-14T22:01:06.590232] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-14T22:01:06.590296] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-14T22:01:06.591697] [DEBUG] [LOCAL ] TT: Trimmed 69904 records to 47349 (keeping 200 days of data) [2025-10-14T22:01:06.883602] [DEBUG] [LOCAL ] TT: Primary data saved (47349 records). [2025-10-14T22:01:06.883765] [INFO ] [MAIN ] TT: Full history saved. [2025-10-14T22:01:06.883857] [INFO ] [MAIN ] Update Progress: 2142/2369 symbols completed. TT took 40.1s. Estimated remaining: 31m 54s. Rate: 7.1 symbols/min [2025-10-14T22:01:07.053171] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:01:07.099157] [DEBUG] [LOCAL ] TU: Loaded 49821 existing records from primary storage. [2025-10-14T22:01:07.099454] [INFO ] [MAIN ] TU: Loaded 49821 existing records. [2025-10-14T22:01:07.163176] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-14T22:01:07.283139] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:01:07.283342] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-14T22:01:07.283416] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-14T22:01:07.284412] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-14T22:01:07.284473] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-14T22:01:07.649010] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:01:07.958119] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-14T22:01:08.015692] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T22:01:08.328686] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-14T22:01:08.758063] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-14T22:01:09.388105] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T22:01:09.558061] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-14T22:01:10.277550] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T22:01:10.358069] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-14T22:01:10.870501] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T22:01:11.158076] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-14T22:01:11.773067] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T22:01:11.777962] [INFO ] [REMOTE ] TTC: Full fetch complete (62181 records). [2025-10-14T22:01:11.778073] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-14T22:01:11.967312] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-14T22:01:12.168342] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-14T22:01:12.168414] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-14T22:01:12.169463] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-14T22:01:12.169524] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-14T22:01:12.170613] [DEBUG] [LOCAL ] TTC: Trimmed 62181 records to 42049 (keeping 200 days of data) [2025-10-14T22:01:12.426098] [DEBUG] [LOCAL ] TTC: Primary data saved (42049 records). [2025-10-14T22:01:12.426247] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-14T22:01:12.426340] [INFO ] [MAIN ] Update Progress: 2143/2369 symbols completed. TTC took 29.1s. Estimated remaining: 31m 46s. Rate: 7.1 symbols/min [2025-10-14T22:01:12.594796] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:01:12.633092] [DEBUG] [LOCAL ] TUYA: Loaded 45957 existing records from primary storage. [2025-10-14T22:01:12.633376] [INFO ] [MAIN ] TUYA: Loaded 45957 existing records. [2025-10-14T22:01:12.774271] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-14T22:01:12.815281] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:01:12.816229] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-14T22:01:12.816370] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-14T22:01:12.826732] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-14T22:01:12.833620] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-14T22:01:12.926850] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-14T22:01:13.213451] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:01:13.382984] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T22:01:13.558086] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-14T22:01:14.358077] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-14T22:01:14.406476] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T22:01:15.046198] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-14T22:01:15.158059] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-14T22:01:15.661884] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-14T22:01:15.958074] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-14T22:01:16.553188] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-14T22:01:16.758048] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-14T22:01:17.558067] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-14T22:01:17.703897] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T22:01:17.876279] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T22:01:18.358067] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-14T22:01:19.158047] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-14T22:01:19.231520] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-14T22:01:19.963246] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-14T22:01:19.993259] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T22:01:20.758032] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-14T22:01:20.899063] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T22:01:21.558083] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-14T22:01:21.836508] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T22:01:22.358112] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-14T22:01:22.766684] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T22:01:22.953017] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T22:01:23.158103] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-14T22:01:23.958045] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-14T22:01:24.059279] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T22:01:24.703151] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T22:01:24.758070] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-14T22:01:25.558064] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-14T22:01:25.766972] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T22:01:26.358050] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-14T22:01:26.477369] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T22:01:27.158085] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-14T22:01:27.286783] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T22:01:27.958159] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-14T22:01:28.087393] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T22:01:28.402736] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T22:01:28.758180] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-14T22:01:29.325002] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T22:01:29.558074] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-14T22:01:30.358075] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-14T22:01:30.470817] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-14T22:01:31.165269] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-14T22:01:31.169701] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-14T22:01:31.176312] [INFO ] [REMOTE ] TTE: Full fetch complete (75125 records). [2025-10-14T22:01:31.176465] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-14T22:01:31.662237] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-14T22:01:31.662350] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-14T22:01:31.664949] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-14T22:01:31.665137] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-14T22:01:31.667283] [DEBUG] [LOCAL ] TTE: Trimmed 75125 records to 51576 (keeping 200 days of data) [2025-10-14T22:01:31.971869] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-14T22:01:32.031054] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T22:01:32.150610] [DEBUG] [LOCAL ] TTE: Primary data saved (51576 records). [2025-10-14T22:01:32.150814] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-14T22:01:32.150923] [INFO ] [MAIN ] Update Progress: 2144/2369 symbols completed. TTE took 39.1s. Estimated remaining: 31m 38s. Rate: 7.1 symbols/min [2025-10-14T22:01:32.363673] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:01:32.407544] [DEBUG] [LOCAL ] TV: Loaded 41852 existing records from primary storage. [2025-10-14T22:01:32.407962] [INFO ] [MAIN ] TV: Loaded 41852 existing records. [2025-10-14T22:01:32.599359] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:01:32.599575] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-14T22:01:32.599620] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-14T22:01:32.600353] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-14T22:01:32.600411] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-14T22:01:32.765439] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-14T22:01:33.040629] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:01:33.068337] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T22:01:33.558071] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-14T22:01:33.604001] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T22:01:34.054253] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-14T22:01:34.060181] [INFO ] [REMOTE ] TU: Full fetch complete (72913 records). [2025-10-14T22:01:34.060352] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-14T22:01:34.362386] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-14T22:01:34.459098] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-14T22:01:34.459207] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-14T22:01:34.460368] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-14T22:01:34.460434] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-14T22:01:34.461902] [DEBUG] [LOCAL ] TU: Trimmed 72913 records to 49830 (keeping 200 days of data) [2025-10-14T22:01:34.766956] [DEBUG] [LOCAL ] TU: Primary data saved (49830 records). [2025-10-14T22:01:34.767074] [INFO ] [MAIN ] TU: Full history saved. [2025-10-14T22:01:34.767150] [INFO ] [MAIN ] Update Progress: 2145/2369 symbols completed. TU took 27.9s. Estimated remaining: 31m 29s. Rate: 7.1 symbols/min [2025-10-14T22:01:34.938987] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:01:34.943375] [DEBUG] [LOCAL ] TVC: Loaded 3252 existing records from primary storage. [2025-10-14T22:01:34.943517] [INFO ] [MAIN ] TVC: Loaded 3252 existing records. [2025-10-14T22:01:35.152483] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:01:35.152783] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-14T22:01:35.152844] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-14T22:01:35.153060] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-14T22:01:35.153127] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-14T22:01:35.158492] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-14T22:01:35.343959] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T22:01:35.557570] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:01:35.958050] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-14T22:01:36.201378] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T22:01:36.670183] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T22:01:36.758075] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-14T22:01:36.892337] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T22:01:37.349476] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T22:01:37.558130] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-14T22:01:38.358154] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-14T22:01:38.796941] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T22:01:38.797192] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-14T22:01:39.158084] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-14T22:01:39.958093] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-14T22:01:40.497618] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-14T22:01:40.715496] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-14T22:01:40.721472] [INFO ] [REMOTE ] TTI: Full fetch complete (65931 records). [2025-10-14T22:01:40.721676] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-14T22:01:40.763322] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-14T22:01:41.130288] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-14T22:01:41.130370] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-14T22:01:41.131463] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-14T22:01:41.131526] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-14T22:01:41.133080] [DEBUG] [LOCAL ] TTI: Trimmed 65931 records to 46300 (keeping 200 days of data) [2025-10-14T22:01:41.399963] [DEBUG] [LOCAL ] TTI: Primary data saved (46300 records). [2025-10-14T22:01:41.400099] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-14T22:01:41.400179] [INFO ] [MAIN ] Update Progress: 2146/2369 symbols completed. TTI took 43.6s. Estimated remaining: 31m 21s. Rate: 7.1 symbols/min [2025-10-14T22:01:41.566931] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-14T22:01:41.589701] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:01:41.594722] [DEBUG] [LOCAL ] TVE: Loaded 2700 existing records from primary storage. [2025-10-14T22:01:41.594944] [INFO ] [MAIN ] TVE: Loaded 2700 existing records. [2025-10-14T22:01:41.778181] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:01:41.778414] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-14T22:01:41.778461] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-14T22:01:41.778623] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-14T22:01:41.778708] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-14T22:01:42.094675] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-14T22:01:42.163374] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:01:42.212285] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-14T22:01:42.358061] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-14T22:01:43.158119] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-14T22:01:43.692609] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T22:01:43.959456] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-14T22:01:43.958387] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-14T22:01:44.533413] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T22:01:44.758118] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-14T22:01:45.324744] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-14T22:01:45.558066] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-14T22:01:45.926024] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-14T22:01:46.358058] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-14T22:01:46.822392] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T22:01:47.158064] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-14T22:01:47.729742] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T22:01:47.958065] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-14T22:01:48.758063] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-14T22:01:49.465836] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-14T22:01:49.496762] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T22:01:49.558051] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-14T22:01:50.077150] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-14T22:01:50.358094] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-14T22:01:51.158078] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-14T22:01:51.650174] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T22:01:51.771532] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T22:01:51.958067] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-14T22:01:52.758103] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-14T22:01:53.399835] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-14T22:01:53.558078] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-14T22:01:53.829483] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T22:01:53.956885] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-14T22:01:53.957699] [INFO ] [REMOTE ] TVC: Full fetch complete (5323 records). [2025-10-14T22:01:53.957766] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-14T22:01:54.338861] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-14T22:01:54.338938] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-14T22:01:54.339098] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-14T22:01:54.339134] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-14T22:01:54.339483] [DEBUG] [LOCAL ] TVC: Trimmed 5323 records to 3241 (keeping 200 days of data) [2025-10-14T22:01:54.358081] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-14T22:01:54.363073] [DEBUG] [LOCAL ] TVC: Primary data saved (3241 records). [2025-10-14T22:01:54.363239] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-14T22:01:54.363392] [INFO ] [MAIN ] Update Progress: 2147/2369 symbols completed. TVC took 19.6s. Estimated remaining: 31m 13s. Rate: 7.1 symbols/min [2025-10-14T22:01:54.536779] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:01:54.568497] [DEBUG] [LOCAL ] TWI: Loaded 33932 existing records from primary storage. [2025-10-14T22:01:54.568830] [INFO ] [MAIN ] TWI: Loaded 33932 existing records. [2025-10-14T22:01:54.747560] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:01:54.747804] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-14T22:01:54.747882] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-14T22:01:54.748136] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-14T22:01:54.748191] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-14T22:01:54.906380] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T22:01:55.137297] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:01:55.158037] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-14T22:01:55.958089] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-14T22:01:56.664004] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-14T22:01:56.758035] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-14T22:01:57.278318] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T22:01:57.558059] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-14T22:01:58.248348] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T22:01:58.358052] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-14T22:01:59.083114] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T22:01:59.158051] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-14T22:01:59.791197] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T22:01:59.958066] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-14T22:02:00.571705] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T22:02:00.576811] [INFO ] [REMOTE ] TUYA: Full fetch complete (66245 records). [2025-10-14T22:02:00.576985] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-14T22:02:00.769855] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-14T22:02:00.969616] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-14T22:02:00.969721] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-14T22:02:00.970839] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-14T22:02:00.970899] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-14T22:02:00.972140] [DEBUG] [LOCAL ] TUYA: Trimmed 66245 records to 45942 (keeping 200 days of data) [2025-10-14T22:02:01.213525] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T22:02:01.278377] [DEBUG] [LOCAL ] TUYA: Primary data saved (45942 records). [2025-10-14T22:02:01.278524] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-14T22:02:01.278613] [INFO ] [MAIN ] Update Progress: 2148/2369 symbols completed. TUYA took 48.9s. Estimated remaining: 31m 4s. Rate: 7.1 symbols/min [2025-10-14T22:02:01.475787] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:01.475953] [DEBUG] [LOCAL ] TWLO: No existing data file found in primary storage. [2025-10-14T22:02:01.475990] [WARN ] [MAIN ] TWLO: No existing data found, performing full refresh instead. [2025-10-14T22:02:01.476102] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-14T22:02:01.476142] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-14T22:02:01.476180] [DEBUG] [LOCAL ] TWLO: No primary data file found to delete. [2025-10-14T22:02:01.476211] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-14T22:02:01.563196] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-14T22:02:01.850293] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:02.340476] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T22:02:02.358031] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-14T22:02:03.048225] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T22:02:03.158068] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-14T22:02:03.615679] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T22:02:03.958074] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-14T22:02:04.562498] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T22:02:04.758096] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-14T22:02:04.867626] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T22:02:05.558068] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-14T22:02:06.358079] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-14T22:02:06.392878] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T22:02:06.788574] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-14T22:02:07.158042] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-14T22:02:07.650862] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T22:02:07.958070] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-14T22:02:08.354522] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T22:02:08.758130] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-14T22:02:09.558063] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-14T22:02:10.011114] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T22:02:10.014027] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-14T22:02:10.137638] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T22:02:10.358106] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-14T22:02:11.158069] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-14T22:02:11.640981] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T22:02:11.645289] [INFO ] [REMOTE ] TV: Full fetch complete (61413 records). [2025-10-14T22:02:11.645413] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-14T22:02:11.963141] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-14T22:02:12.076413] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-14T22:02:12.076478] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-14T22:02:12.077679] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-14T22:02:12.077743] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-14T22:02:12.079012] [DEBUG] [LOCAL ] TV: Trimmed 61413 records to 41720 (keeping 200 days of data) [2025-10-14T22:02:12.323932] [DEBUG] [LOCAL ] TV: Primary data saved (41720 records). [2025-10-14T22:02:12.324052] [INFO ] [MAIN ] TV: Full history saved. [2025-10-14T22:02:12.324124] [INFO ] [MAIN ] Update Progress: 2149/2369 symbols completed. TV took 40.2s. Estimated remaining: 30m 56s. Rate: 7.1 symbols/min [2025-10-14T22:02:12.407331] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-14T22:02:12.524223] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:12.529980] [DEBUG] [LOCAL ] TWN: Loaded 3230 existing records from primary storage. [2025-10-14T22:02:12.530143] [INFO ] [MAIN ] TWN: Loaded 3230 existing records. [2025-10-14T22:02:12.667322] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T22:02:12.753412] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:12.753623] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-14T22:02:12.753700] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-14T22:02:12.753911] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-14T22:02:12.753971] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-14T22:02:12.765042] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-14T22:02:13.137830] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:13.149293] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-14T22:02:13.150046] [INFO ] [REMOTE ] TVE: Full fetch complete (4305 records). [2025-10-14T22:02:13.150111] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-14T22:02:13.511947] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-14T22:02:13.512022] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-14T22:02:13.512165] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-14T22:02:13.512203] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-14T22:02:13.512549] [DEBUG] [LOCAL ] TVE: Trimmed 4305 records to 2679 (keeping 200 days of data) [2025-10-14T22:02:13.529101] [DEBUG] [LOCAL ] TVE: Primary data saved (2679 records). [2025-10-14T22:02:13.529163] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-14T22:02:13.529226] [INFO ] [MAIN ] Update Progress: 2150/2369 symbols completed. TVE took 32.1s. Estimated remaining: 30m 47s. Rate: 7.1 symbols/min [2025-10-14T22:02:13.561128] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-14T22:02:13.702397] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:13.748014] [DEBUG] [LOCAL ] TWO: Loaded 48593 existing records from primary storage. [2025-10-14T22:02:13.748318] [INFO ] [MAIN ] TWO: Loaded 48593 existing records. [2025-10-14T22:02:13.939119] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:13.939365] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-14T22:02:13.939426] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-14T22:02:13.939927] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-14T22:02:13.939987] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-14T22:02:14.318481] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:14.358036] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-14T22:02:15.076258] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T22:02:15.158048] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-14T22:02:15.958077] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-14T22:02:16.120638] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T22:02:16.573268] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T22:02:16.758067] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-14T22:02:17.219186] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T22:02:17.558068] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-14T22:02:18.052026] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-14T22:02:18.121929] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-14T22:02:18.358085] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-14T22:02:18.977003] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-14T22:02:19.158072] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-14T22:02:19.958122] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-14T22:02:20.689539] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T22:02:20.758032] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-14T22:02:21.228526] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-14T22:02:21.558059] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-14T22:02:22.358066] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-14T22:02:22.402823] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T22:02:22.621539] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T22:02:23.158108] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-14T22:02:23.187114] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-14T22:02:23.191445] [INFO ] [REMOTE ] TWI: Full fetch complete (52216 records). [2025-10-14T22:02:23.191602] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-14T22:02:23.623403] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-14T22:02:23.623489] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-14T22:02:23.624474] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-14T22:02:23.624538] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-14T22:02:23.625697] [DEBUG] [LOCAL ] TWI: Trimmed 52216 records to 33919 (keeping 200 days of data) [2025-10-14T22:02:23.831846] [DEBUG] [LOCAL ] TWI: Primary data saved (33919 records). [2025-10-14T22:02:23.832026] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-14T22:02:23.832132] [INFO ] [MAIN ] Update Progress: 2151/2369 symbols completed. TWI took 29.5s. Estimated remaining: 30m 38s. Rate: 7.1 symbols/min [2025-10-14T22:02:23.963171] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-14T22:02:24.054853] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:24.055064] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-14T22:02:24.055119] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-14T22:02:24.055237] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-14T22:02:24.055282] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-14T22:02:24.055324] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-14T22:02:24.055358] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-14T22:02:24.598335] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:24.640165] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-14T22:02:24.758081] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-14T22:02:24.958093] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-14T22:02:25.558092] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-14T22:02:26.151285] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T22:02:26.358090] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-14T22:02:26.437003] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T22:02:27.158109] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-14T22:02:27.958111] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-14T22:02:28.022851] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T22:02:28.553392] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T22:02:28.758057] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-14T22:02:29.001390] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-14T22:02:29.058696] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-14T22:02:29.558061] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-14T22:02:30.141845] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T22:02:30.358119] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-14T22:02:30.811748] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-14T22:02:31.158130] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-14T22:02:31.682678] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T22:02:31.958064] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-14T22:02:32.758132] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-14T22:02:33.558071] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-14T22:02:33.767975] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:02:33.768624] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-14T22:02:33.768774] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:02:33.768862] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-14T22:02:33.768938] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:02:33.769058] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-14T22:02:33.769142] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-14T22:02:33.769187] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-14T22:02:33.769239] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-14T22:02:33.769294] [INFO ] [MAIN ] Update Progress: 2152/2369 symbols completed. TWOD took 9.9s. Estimated remaining: 30m 30s. Rate: 7.1 symbols/min [2025-10-14T22:02:33.954430] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:33.992966] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-14T22:02:34.021570] [DEBUG] [LOCAL ] TX: Loaded 23267 existing records from primary storage. [2025-10-14T22:02:34.022016] [INFO ] [MAIN ] TX: Loaded 23267 existing records. [2025-10-14T22:02:34.220716] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T22:02:34.267950] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:34.269048] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-14T22:02:34.269141] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-14T22:02:34.269694] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-14T22:02:34.269766] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-14T22:02:34.363227] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-14T22:02:34.643135] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:35.158163] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-14T22:02:35.716286] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T22:02:35.717413] [INFO ] [REMOTE ] TWN: Full fetch complete (5304 records). [2025-10-14T22:02:35.717480] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-14T22:02:35.972983] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-14T22:02:36.093301] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-14T22:02:36.093493] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-14T22:02:36.093825] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-14T22:02:36.093922] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-14T22:02:36.094693] [DEBUG] [LOCAL ] TWN: Trimmed 5304 records to 3274 (keeping 200 days of data) [2025-10-14T22:02:36.136496] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T22:02:36.149168] [DEBUG] [LOCAL ] TWN: Primary data saved (3274 records). [2025-10-14T22:02:36.149553] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-14T22:02:36.149668] [INFO ] [MAIN ] Update Progress: 2153/2369 symbols completed. TWN took 23.8s. Estimated remaining: 30m 21s. Rate: 7.1 symbols/min [2025-10-14T22:02:36.323272] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:36.365718] [DEBUG] [LOCAL ] TXNM: Loaded 43470 existing records from primary storage. [2025-10-14T22:02:36.366093] [INFO ] [MAIN ] TXNM: Loaded 43470 existing records. [2025-10-14T22:02:36.548342] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:36.548567] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-14T22:02:36.548615] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-14T22:02:36.548968] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-14T22:02:36.549056] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-14T22:02:36.764843] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-14T22:02:36.920353] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:37.558064] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-14T22:02:37.668009] [DEBUG] [REMOTE ] TXNM: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-14T22:02:37.670266] [WARN ] [REMOTE ] TXNM: No data returned for month 2024-12 [2025-10-14T22:02:37.670567] [FATAL] [REMOTE ] TXNM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:02:37.671678] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-14T22:02:37.671034] [FATAL] [MAIN ] TXNM: Failed to fetch primary data. [2025-10-14T22:02:37.677449] [WARN ] [MAIN ] TXNM: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:02:37.677530] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-14T22:02:37.677594] [DEBUG] [LOCAL ] TXNM: No primary data file found to delete. [2025-10-14T22:02:37.677631] [INFO ] [LOCAL ] TXNM: Starting deletion of derivative data. [2025-10-14T22:02:37.677834] [DEBUG] [LOCAL ] TXNM: Deleted derivative data file. [2025-10-14T22:02:37.677956] [INFO ] [MAIN ] Update Progress: 2154/2369 symbols completed. TXNM took 1.5s. Estimated remaining: 30m 12s. Rate: 7.1 symbols/min [2025-10-14T22:02:37.847246] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:37.867086] [DEBUG] [LOCAL ] TXO: Loaded 19640 existing records from primary storage. [2025-10-14T22:02:37.867308] [INFO ] [MAIN ] TXO: Loaded 19640 existing records. [2025-10-14T22:02:38.049196] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:38.049420] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-14T22:02:38.049548] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-14T22:02:38.049928] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-14T22:02:38.050087] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-14T22:02:38.272065] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-14T22:02:38.361272] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-14T22:02:38.485972] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:39.158093] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-14T22:02:39.958127] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-14T22:02:40.008718] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T22:02:40.053731] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-14T22:02:40.758043] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-14T22:02:41.002127] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T22:02:41.558077] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-14T22:02:42.358166] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-14T22:02:42.398351] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T22:02:42.828956] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-14T22:02:43.158123] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-14T22:02:43.617953] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T22:02:43.623688] [INFO ] [REMOTE ] TWLO: Full fetch complete (76594 records). [2025-10-14T22:02:43.623833] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-14T22:02:43.963224] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-14T22:02:44.022839] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-14T22:02:44.022918] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-14T22:02:44.024293] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-14T22:02:44.024360] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-14T22:02:44.026371] [DEBUG] [LOCAL ] TWLO: Trimmed 76594 records to 52819 (keeping 200 days of data) [2025-10-14T22:02:44.361545] [DEBUG] [LOCAL ] TWLO: Primary data saved (52819 records). [2025-10-14T22:02:44.361696] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-14T22:02:44.361781] [INFO ] [MAIN ] Update Progress: 2155/2369 symbols completed. TWLO took 43.1s. Estimated remaining: 30m 3s. Rate: 7.1 symbols/min [2025-10-14T22:02:44.549020] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:44.560253] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T22:02:44.596072] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T22:02:44.644601] [DEBUG] [LOCAL ] TXT: Loaded 49685 existing records from primary storage. [2025-10-14T22:02:44.644989] [INFO ] [MAIN ] TXT: Loaded 49685 existing records. [2025-10-14T22:02:44.763167] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-14T22:02:44.839484] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:44.839792] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-14T22:02:44.839842] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-14T22:02:44.840173] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-14T22:02:44.840213] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-14T22:02:45.200420] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:45.558110] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-14T22:02:46.092694] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T22:02:46.358065] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-14T22:02:47.079847] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T22:02:47.154340] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T22:02:47.163608] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-14T22:02:47.958060] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-14T22:02:48.420618] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-14T22:02:48.758050] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-14T22:02:48.907030] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-14T22:02:49.558068] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-14T22:02:50.170187] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T22:02:50.358073] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-14T22:02:50.637203] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-14T22:02:51.158136] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-14T22:02:51.776490] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T22:02:51.958097] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-14T22:02:52.059076] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T22:02:52.758094] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-14T22:02:53.472454] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T22:02:53.477889] [INFO ] [REMOTE ] TWO: Full fetch complete (69268 records). [2025-10-14T22:02:53.477996] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-14T22:02:53.560042] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-14T22:02:53.683233] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-14T22:02:53.890045] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-14T22:02:53.890128] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-14T22:02:53.891383] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-14T22:02:53.891459] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-14T22:02:53.892894] [DEBUG] [LOCAL ] TWO: Trimmed 69268 records to 48647 (keeping 200 days of data) [2025-10-14T22:02:54.186844] [DEBUG] [LOCAL ] TWO: Primary data saved (48647 records). [2025-10-14T22:02:54.186974] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-14T22:02:54.187052] [INFO ] [MAIN ] Update Progress: 2156/2369 symbols completed. TWO took 40.7s. Estimated remaining: 29m 55s. Rate: 7.1 symbols/min [2025-10-14T22:02:54.354746] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:02:54.358115] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-14T22:02:54.365964] [DEBUG] [LOCAL ] TY: Loaded 7576 existing records from primary storage. [2025-10-14T22:02:54.366150] [INFO ] [MAIN ] TY: Loaded 7576 existing records. [2025-10-14T22:02:54.549267] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:02:54.549463] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-14T22:02:54.549524] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-14T22:02:54.549772] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-14T22:02:54.549829] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-14T22:02:54.927569] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:02:55.158125] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-14T22:02:55.219816] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T22:02:55.266073] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-14T22:02:55.764027] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T22:02:55.958119] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-14T22:02:56.758106] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-14T22:02:57.558070] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-14T22:02:57.834067] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T22:02:58.191609] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T22:02:58.358072] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-14T22:02:59.058921] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-10-14T22:02:59.158127] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-14T22:02:59.790201] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T22:02:59.958085] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-14T22:03:00.658535] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T22:03:00.758049] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-14T22:03:01.062433] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T22:03:01.558077] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-14T22:03:02.245344] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-14T22:03:02.329506] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T22:03:02.358057] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-14T22:03:03.158074] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-14T22:03:03.889102] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T22:03:03.958027] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-14T22:03:04.025575] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T22:03:04.758050] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-14T22:03:04.796857] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-14T22:03:05.564359] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-14T22:03:05.567689] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-14T22:03:06.282165] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T22:03:06.358072] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-14T22:03:07.148001] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T22:03:07.151133] [INFO ] [REMOTE ] TX: Full fetch complete (35787 records). [2025-10-14T22:03:07.151219] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-14T22:03:07.163199] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-14T22:03:07.534620] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-14T22:03:07.534739] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-14T22:03:07.535465] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-14T22:03:07.535505] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-14T22:03:07.536437] [DEBUG] [LOCAL ] TX: Trimmed 35787 records to 23315 (keeping 200 days of data) [2025-10-14T22:03:07.671870] [DEBUG] [LOCAL ] TX: Primary data saved (23315 records). [2025-10-14T22:03:07.671995] [INFO ] [MAIN ] TX: Full history saved. [2025-10-14T22:03:07.672071] [INFO ] [MAIN ] Update Progress: 2157/2369 symbols completed. TX took 33.9s. Estimated remaining: 29m 47s. Rate: 7.1 symbols/min [2025-10-14T22:03:07.958067] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-14T22:03:08.758052] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-14T22:03:08.986579] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T22:03:09.163250] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T22:03:09.220540] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-14T22:03:09.558093] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-14T22:03:10.358069] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-14T22:03:11.075737] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-14T22:03:11.158056] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-14T22:03:11.342466] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T22:03:11.958049] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-14T22:03:12.023478] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-14T22:03:12.703912] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T22:03:12.758034] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-14T22:03:13.382016] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T22:03:13.387582] [INFO ] [REMOTE ] TXT: Full fetch complete (72380 records). [2025-10-14T22:03:13.387716] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-14T22:03:13.565711] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-14T22:03:13.802961] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-14T22:03:13.803049] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-14T22:03:13.804221] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-14T22:03:13.804285] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-14T22:03:13.805774] [DEBUG] [LOCAL ] TXT: Trimmed 72380 records to 49654 (keeping 200 days of data) [2025-10-14T22:03:14.112519] [DEBUG] [LOCAL ] TXT: Primary data saved (49654 records). [2025-10-14T22:03:14.112750] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-14T22:03:14.112878] [INFO ] [MAIN ] Update Progress: 2158/2369 symbols completed. TXT took 29.8s. Estimated remaining: 29m 39s. Rate: 7.1 symbols/min [2025-10-14T22:03:14.358082] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-14T22:03:14.570530] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T22:03:15.158043] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-14T22:03:15.240401] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T22:03:15.958066] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-14T22:03:16.251381] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T22:03:16.508757] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T22:03:16.510473] [INFO ] [REMOTE ] TY: Full fetch complete (11490 records). [2025-10-14T22:03:16.510594] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-14T22:03:16.764981] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-14T22:03:17.062018] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-14T22:03:17.062142] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-14T22:03:17.062830] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-14T22:03:17.062909] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-14T22:03:17.063852] [DEBUG] [LOCAL ] TY: Trimmed 11490 records to 7589 (keeping 200 days of data) [2025-10-14T22:03:17.140232] [DEBUG] [LOCAL ] TY: Primary data saved (7589 records). [2025-10-14T22:03:17.140413] [INFO ] [MAIN ] TY: Full history saved. [2025-10-14T22:03:17.140527] [INFO ] [MAIN ] Update Progress: 2159/2369 symbols completed. TY took 23.0s. Estimated remaining: 29m 30s. Rate: 7.1 symbols/min [2025-10-14T22:03:17.883703] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T22:03:17.886857] [INFO ] [REMOTE ] TXO: Full fetch complete (26824 records). [2025-10-14T22:03:17.886979] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-14T22:03:18.299536] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-14T22:03:18.299613] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-14T22:03:18.300180] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-14T22:03:18.300238] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-14T22:03:18.300915] [DEBUG] [LOCAL ] TXO: Trimmed 26824 records to 19715 (keeping 200 days of data) [2025-10-14T22:03:18.418362] [DEBUG] [LOCAL ] TXO: Primary data saved (19715 records). [2025-10-14T22:03:18.418491] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-14T22:03:18.418565] [INFO ] [MAIN ] Update Progress: 2160/2369 symbols completed. TXO took 40.7s. Estimated remaining: 29m 21s. Rate: 7.1 symbols/min [2025-10-14T22:03:19.049188] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:03:19.158312] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:03:19.156550] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:03:19.152720] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:03:19.180002] [DEBUG] [LOCAL ] TYG: Loaded 13870 existing records from primary storage. [2025-10-14T22:03:19.180245] [INFO ] [MAIN ] TYG: Loaded 13870 existing records. [2025-10-14T22:03:19.222905] [DEBUG] [LOCAL ] TYL: Loaded 22457 existing records from primary storage. [2025-10-14T22:03:19.250909] [INFO ] [MAIN ] TYL: Loaded 22457 existing records. [2025-10-14T22:03:19.520466] [DEBUG] [LOCAL ] UA: Loaded 50465 existing records from primary storage. [2025-10-14T22:03:19.530690] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-14T22:03:19.560226] [INFO ] [MAIN ] UA: Loaded 50465 existing records. [2025-10-14T22:03:19.592452] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-14T22:03:19.622366] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:03:19.637374] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:03:19.771869] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-14T22:03:19.792599] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-14T22:03:19.771806] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-14T22:03:19.797978] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-14T22:03:19.845252] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-14T22:03:19.851392] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-14T22:03:19.877540] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-14T22:03:19.851567] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-14T22:03:20.115131] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:03:20.156213] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:03:20.192260] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-14T22:03:20.218540] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-14T22:03:20.231729] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-14T22:03:20.247142] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-14T22:03:20.263148] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-14T22:03:20.298281] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-14T22:03:20.303498] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-14T22:03:20.358287] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-14T22:03:21.258880] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:03:21.312245] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-14T22:03:21.355142] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:03:21.398143] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-14T22:03:21.532451] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:03:21.553426] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-14T22:03:21.616572] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:03:21.616964] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-14T22:03:22.410616] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T22:03:22.414027] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-14T22:03:22.501039] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T22:03:22.505413] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-14T22:03:22.972392] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-14T22:03:22.982913] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-14T22:03:23.579351] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T22:03:23.585523] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-14T22:03:23.741822] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-14T22:03:23.778580] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-14T22:03:23.958138] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-14T22:03:24.292239] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T22:03:24.567249] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T22:03:24.746707] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T22:03:24.758028] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-14T22:03:25.558061] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-14T22:03:25.925139] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-14T22:03:26.358039] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-14T22:03:26.589754] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T22:03:27.158066] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-14T22:03:27.958060] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-14T22:03:28.648069] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T22:03:28.758089] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-14T22:03:28.986997] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T22:03:29.281198] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-10-14T22:03:29.558060] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-14T22:03:30.047530] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T22:03:30.358076] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-14T22:03:31.158054] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-14T22:03:31.223758] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-14T22:03:31.906749] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-14T22:03:31.958059] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-14T22:03:32.515569] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-14T22:03:32.758150] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-14T22:03:33.558091] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-14T22:03:33.688909] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T22:03:33.923102] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-14T22:03:34.358117] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-14T22:03:35.158045] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-14T22:03:35.435622] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T22:03:35.501700] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T22:03:35.958123] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-14T22:03:36.075699] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-14T22:03:36.758120] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-14T22:03:37.558103] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-14T22:03:37.765582] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T22:03:38.088794] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-14T22:03:38.358084] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-14T22:03:39.012766] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T22:03:39.158103] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-14T22:03:39.958039] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-14T22:03:40.155426] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T22:03:40.419993] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-14T22:03:40.758080] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-14T22:03:41.100117] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T22:03:41.477206] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-14T22:03:41.558079] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-14T22:03:42.358109] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-14T22:03:43.092864] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T22:03:43.158028] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-14T22:03:43.295271] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T22:03:43.749232] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T22:03:43.751044] [INFO ] [REMOTE ] TYG: Full fetch complete (22369 records). [2025-10-14T22:03:43.751120] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-14T22:03:43.964609] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-14T22:03:44.121478] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-14T22:03:44.121550] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-14T22:03:44.122030] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-14T22:03:44.122093] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-14T22:03:44.122703] [DEBUG] [LOCAL ] TYG: Trimmed 22369 records to 13882 (keeping 200 days of data) [2025-10-14T22:03:44.206702] [DEBUG] [LOCAL ] TYG: Primary data saved (13882 records). [2025-10-14T22:03:44.206843] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-14T22:03:44.206921] [INFO ] [MAIN ] Update Progress: 2161/2369 symbols completed. TYG took 25.8s. Estimated remaining: 29m 14s. Rate: 7.1 symbols/min [2025-10-14T22:03:44.378296] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:03:44.426436] [DEBUG] [LOCAL ] UAA: Loaded 53507 existing records from primary storage. [2025-10-14T22:03:44.426776] [INFO ] [MAIN ] UAA: Loaded 53507 existing records. [2025-10-14T22:03:44.603682] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:03:44.603933] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-14T22:03:44.603984] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-14T22:03:44.604338] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-14T22:03:44.604411] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-14T22:03:44.779267] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-14T22:03:44.962021] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:03:45.558075] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-14T22:03:45.616958] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T22:03:46.080580] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T22:03:46.358065] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-14T22:03:46.865212] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-14T22:03:46.868177] [INFO ] [REMOTE ] TYL: Full fetch complete (31561 records). [2025-10-14T22:03:46.868261] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-14T22:03:47.163239] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-14T22:03:47.252053] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-14T22:03:47.252126] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-14T22:03:47.252778] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-14T22:03:47.252838] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-14T22:03:47.253502] [DEBUG] [LOCAL ] TYL: Trimmed 31561 records to 22515 (keeping 200 days of data) [2025-10-14T22:03:47.391729] [DEBUG] [LOCAL ] TYL: Primary data saved (22515 records). [2025-10-14T22:03:47.391853] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-14T22:03:47.391926] [INFO ] [MAIN ] Update Progress: 2162/2369 symbols completed. TYL took 29.0s. Estimated remaining: 29m 5s. Rate: 7.1 symbols/min [2025-10-14T22:03:47.564113] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:03:47.572326] [DEBUG] [LOCAL ] UAN: Loaded 5433 existing records from primary storage. [2025-10-14T22:03:47.572500] [INFO ] [MAIN ] UAN: Loaded 5433 existing records. [2025-10-14T22:03:47.756327] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:03:47.756724] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-14T22:03:47.756877] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-14T22:03:47.757116] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-14T22:03:47.757164] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-14T22:03:47.975034] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-14T22:03:48.135673] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-14T22:03:48.156713] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:03:48.758107] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-14T22:03:48.885460] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T22:03:49.452448] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-14T22:03:49.558079] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-14T22:03:49.718033] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-14T22:03:50.358063] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-14T22:03:51.158118] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-14T22:03:51.820779] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-14T22:03:51.958045] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-14T22:03:52.216881] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-14T22:03:52.559434] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T22:03:52.758066] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-14T22:03:53.558116] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-14T22:03:54.240257] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-14T22:03:54.344682] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-14T22:03:54.359695] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-14T22:03:55.021362] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-14T22:03:55.119188] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-14T22:03:55.158084] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-14T22:03:55.958101] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-14T22:03:56.758079] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-14T22:03:56.927433] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T22:03:57.558082] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-14T22:03:58.273920] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-14T22:03:58.280148] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-14T22:03:58.280322] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-14T22:03:58.359852] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-14T22:03:58.571981] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T22:03:58.616582] [INFO ] [REMOTE ] UA: Full fetch complete (73144 records). [2025-10-14T22:03:58.622288] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-14T22:03:58.822501] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-14T22:03:58.827711] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-14T22:03:58.844561] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-14T22:03:58.862983] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-14T22:03:58.942962] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 53799 (keeping 200 days of data) [2025-10-14T22:03:59.138698] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T22:03:59.186329] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-14T22:03:59.230953] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-14T22:03:59.231480] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-14T22:03:59.233025] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-14T22:03:59.233100] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-14T22:03:59.237726] [DEBUG] [LOCAL ] UA: Trimmed 73144 records to 50470 (keeping 200 days of data) [2025-10-14T22:03:59.592224] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-14T22:03:59.775275] [DEBUG] [LOCAL ] UA: Primary data saved (50470 records). [2025-10-14T22:03:59.775970] [INFO ] [MAIN ] UA: Full history saved. [2025-10-14T22:03:59.777498] [INFO ] [MAIN ] Update Progress: 2163/2369 symbols completed. UA took 41.4s. Estimated remaining: 28m 57s. Rate: 7.1 symbols/min [2025-10-14T22:03:59.905092] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-14T22:03:59.915239] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-14T22:03:59.915085] [INFO ] [MAIN ] U: Full history saved. [2025-10-14T22:03:59.932489] [INFO ] [MAIN ] Update Progress: 2164/2369 symbols completed. U took 41.5s. Estimated remaining: 28m 48s. Rate: 7.1 symbols/min [2025-10-14T22:03:59.963134] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-14T22:04:00.003295] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:00.158903] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:00.200821] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-14T22:04:00.201271] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-14T22:04:00.416279] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:00.412624] [DEBUG] [LOCAL ] UBS: Loaded 52320 existing records from primary storage. [2025-10-14T22:04:00.416713] [INFO ] [MAIN ] UBS: Loaded 52320 existing records. [2025-10-14T22:04:00.416794] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-14T22:04:00.461675] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-14T22:04:00.496586] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-14T22:04:00.525014] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-14T22:04:00.719510] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:00.740372] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-14T22:04:00.768222] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-14T22:04:00.758203] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-14T22:04:00.800469] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-14T22:04:00.803152] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-14T22:04:00.810829] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-14T22:04:01.214368] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:01.350429] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:01.558058] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-14T22:04:02.171297] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-14T22:04:02.358080] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-14T22:04:02.666844] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-14T22:04:02.807745] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-14T22:04:03.158068] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-14T22:04:03.958075] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-14T22:04:04.758063] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-14T22:04:05.471211] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-14T22:04:05.506263] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T22:04:05.558038] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-14T22:04:05.604236] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-14T22:04:06.358060] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-14T22:04:06.984555] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T22:04:07.158043] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-14T22:04:07.406066] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-14T22:04:07.958059] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-14T22:04:08.758059] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-14T22:04:09.408819] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-14T22:04:09.558029] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-14T22:04:09.656140] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T22:04:10.235275] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T22:04:10.358022] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-14T22:04:11.158083] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-14T22:04:11.754355] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-14T22:04:11.958158] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-14T22:04:12.387671] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-14T22:04:12.758095] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-14T22:04:13.037522] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-14T22:04:13.558090] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-14T22:04:14.073137] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-14T22:04:14.358071] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-14T22:04:14.713591] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T22:04:14.779287] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-14T22:04:15.092614] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:04:15.158094] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-14T22:04:15.716309] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T22:04:15.717419] [INFO ] [REMOTE ] UAN: Full fetch complete (8001 records). [2025-10-14T22:04:15.717492] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-14T22:04:15.963247] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-14T22:04:16.087301] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-14T22:04:16.087377] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-14T22:04:16.087574] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-14T22:04:16.087612] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-14T22:04:16.088129] [DEBUG] [LOCAL ] UAN: Trimmed 8001 records to 5446 (keeping 200 days of data) [2025-10-14T22:04:16.121711] [DEBUG] [LOCAL ] UAN: Primary data saved (5446 records). [2025-10-14T22:04:16.121849] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-14T22:04:16.121930] [INFO ] [MAIN ] Update Progress: 2165/2369 symbols completed. UAN took 28.7s. Estimated remaining: 28m 40s. Rate: 7.1 symbols/min [2025-10-14T22:04:16.301290] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:16.337309] [DEBUG] [LOCAL ] UCB: Loaded 37769 existing records from primary storage. [2025-10-14T22:04:16.337587] [INFO ] [MAIN ] UCB: Loaded 37769 existing records. [2025-10-14T22:04:16.519483] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:16.519742] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-14T22:04:16.519797] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-14T22:04:16.520129] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-14T22:04:16.520171] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-14T22:04:16.766293] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-14T22:04:16.869422] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:17.558058] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-14T22:04:17.893704] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-14T22:04:18.358103] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-14T22:04:18.645194] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T22:04:18.716861] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-14T22:04:19.158072] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-14T22:04:19.790565] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T22:04:19.958061] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-14T22:04:20.573388] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T22:04:20.579519] [INFO ] [REMOTE ] UAA: Full fetch complete (77647 records). [2025-10-14T22:04:20.579673] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-14T22:04:20.764016] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-14T22:04:20.999155] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-14T22:04:20.999257] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-14T22:04:21.000458] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-14T22:04:21.000536] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-14T22:04:21.002145] [DEBUG] [LOCAL ] UAA: Trimmed 77647 records to 53505 (keeping 200 days of data) [2025-10-14T22:04:21.102661] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T22:04:21.325795] [DEBUG] [LOCAL ] UAA: Primary data saved (53505 records). [2025-10-14T22:04:21.325925] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-14T22:04:21.326000] [INFO ] [MAIN ] Update Progress: 2166/2369 symbols completed. UAA took 37.1s. Estimated remaining: 28m 31s. Rate: 7.1 symbols/min [2025-10-14T22:04:21.497379] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:21.545697] [DEBUG] [LOCAL ] UDR: Loaded 52006 existing records from primary storage. [2025-10-14T22:04:21.546031] [INFO ] [MAIN ] UDR: Loaded 52006 existing records. [2025-10-14T22:04:21.567887] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-14T22:04:21.732261] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:21.732498] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-14T22:04:21.732548] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-14T22:04:21.732888] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-14T22:04:21.732946] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-14T22:04:22.093795] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:22.358075] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-14T22:04:23.158076] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-14T22:04:23.363497] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-14T22:04:23.582353] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-14T22:04:23.646530] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T22:04:23.958147] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-14T22:04:24.569161] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T22:04:24.758048] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-14T22:04:25.558070] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-14T22:04:25.783518] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-14T22:04:26.358169] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-14T22:04:26.412491] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-14T22:04:27.118423] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T22:04:27.158027] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-14T22:04:27.958092] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-14T22:04:28.647737] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-14T22:04:28.758124] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-14T22:04:29.161237] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-14T22:04:29.558111] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-14T22:04:29.873972] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T22:04:30.358134] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-14T22:04:30.683113] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T22:04:31.052149] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-14T22:04:31.158082] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-14T22:04:31.669779] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-14T22:04:31.958109] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-14T22:04:32.758154] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-14T22:04:33.491561] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T22:04:33.569531] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-14T22:04:33.575614] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-14T22:04:34.358142] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-14T22:04:34.386104] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-14T22:04:34.393735] [INFO ] [REMOTE ] UBS: Full fetch complete (75915 records). [2025-10-14T22:04:34.393993] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-14T22:04:34.860708] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-14T22:04:34.860820] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-14T22:04:34.862255] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-14T22:04:34.862383] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-14T22:04:34.864104] [DEBUG] [LOCAL ] UBS: Trimmed 75915 records to 52316 (keeping 200 days of data) [2025-10-14T22:04:34.975036] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T22:04:35.168832] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-14T22:04:35.226012] [DEBUG] [LOCAL ] UBS: Primary data saved (52316 records). [2025-10-14T22:04:35.226197] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-14T22:04:35.227742] [INFO ] [MAIN ] Update Progress: 2167/2369 symbols completed. UBS took 35.3s. Estimated remaining: 28m 23s. Rate: 7.1 symbols/min [2025-10-14T22:04:35.406946] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:35.448723] [DEBUG] [LOCAL ] UE: Loaded 42613 existing records from primary storage. [2025-10-14T22:04:35.449043] [INFO ] [MAIN ] UE: Loaded 42613 existing records. [2025-10-14T22:04:35.624223] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:35.624448] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-14T22:04:35.624506] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-14T22:04:35.624833] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-14T22:04:35.624902] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-14T22:04:35.975557] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:35.971103] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-14T22:04:36.452969] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-14T22:04:36.685905] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-14T22:04:36.758067] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-14T22:04:37.478065] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T22:04:37.558031] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-14T22:04:38.358117] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-14T22:04:38.741076] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-14T22:04:38.761729] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-14T22:04:39.158077] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-14T22:04:39.958131] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-14T22:04:40.033819] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T22:04:40.309331] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T22:04:40.758063] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-14T22:04:41.077295] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T22:04:41.558093] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-14T22:04:42.069536] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T22:04:42.358142] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-14T22:04:42.545984] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T22:04:42.556607] [INFO ] [REMOTE ] UCB: Full fetch complete (54865 records). [2025-10-14T22:04:42.556809] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-14T22:04:42.947409] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-14T22:04:42.947491] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-14T22:04:42.948705] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-14T22:04:42.948770] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-14T22:04:42.949958] [DEBUG] [LOCAL ] UCB: Trimmed 54865 records to 37813 (keeping 200 days of data) [2025-10-14T22:04:43.158181] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-14T22:04:43.191380] [DEBUG] [LOCAL ] UCB: Primary data saved (37813 records). [2025-10-14T22:04:43.191520] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-14T22:04:43.191601] [INFO ] [MAIN ] Update Progress: 2168/2369 symbols completed. UCB took 27.1s. Estimated remaining: 28m 15s. Rate: 7.1 symbols/min [2025-10-14T22:04:43.363850] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:43.374043] [DEBUG] [LOCAL ] UFI: Loaded 8136 existing records from primary storage. [2025-10-14T22:04:43.374253] [INFO ] [MAIN ] UFI: Loaded 8136 existing records. [2025-10-14T22:04:43.551137] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:43.551343] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-14T22:04:43.551393] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-14T22:04:43.551547] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-14T22:04:43.551601] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-14T22:04:43.930849] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:43.958038] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-14T22:04:44.129534] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T22:04:44.556782] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T22:04:44.580201] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T22:04:44.758089] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-14T22:04:45.454089] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-14T22:04:45.558065] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-14T22:04:46.358117] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-14T22:04:47.129792] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T22:04:47.158053] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-14T22:04:47.183286] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T22:04:47.958085] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-14T22:04:48.583166] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T22:04:48.758049] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-14T22:04:49.515933] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-14T22:04:49.558060] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-14T22:04:49.648586] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T22:04:50.175126] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T22:04:50.181228] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-14T22:04:50.181383] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-14T22:04:50.372415] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-14T22:04:50.570297] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-14T22:04:50.570376] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-14T22:04:50.571590] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-14T22:04:50.571675] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-14T22:04:50.573099] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 53806 (keeping 200 days of data) [2025-10-14T22:04:50.896596] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-14T22:04:50.896765] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-14T22:04:50.896872] [INFO ] [MAIN ] Update Progress: 2169/2369 symbols completed. UBER took 51.1s. Estimated remaining: 28m 6s. Rate: 7.1 symbols/min [2025-10-14T22:04:51.066463] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:04:51.113888] [DEBUG] [LOCAL ] UGI: Loaded 50599 existing records from primary storage. [2025-10-14T22:04:51.114177] [INFO ] [MAIN ] UGI: Loaded 50599 existing records. [2025-10-14T22:04:51.166923] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-14T22:04:51.293515] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:04:51.293781] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-14T22:04:51.293958] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-14T22:04:51.294352] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-14T22:04:51.294410] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-14T22:04:51.422871] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-14T22:04:51.652883] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:04:51.958057] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-14T22:04:52.765683] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-14T22:04:52.777202] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T22:04:52.778014] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T22:04:53.558077] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-14T22:04:54.358045] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-14T22:04:54.498219] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T22:04:55.055454] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-14T22:04:55.158029] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-14T22:04:55.667479] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T22:04:55.958109] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-14T22:04:56.645050] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T22:04:56.702791] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T22:04:56.758061] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-14T22:04:57.378136] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T22:04:57.558055] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-14T22:04:58.358076] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-14T22:04:58.815472] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T22:04:59.158067] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-14T22:04:59.745358] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T22:04:59.958120] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-14T22:05:00.750018] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T22:05:00.758981] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-14T22:05:01.352952] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T22:05:01.359334] [INFO ] [REMOTE ] UDR: Full fetch complete (74957 records). [2025-10-14T22:05:01.359544] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-14T22:05:01.568025] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-14T22:05:01.681107] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T22:05:01.813177] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-14T22:05:01.813259] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-14T22:05:01.814516] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-14T22:05:01.814579] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-14T22:05:01.816010] [DEBUG] [LOCAL ] UDR: Trimmed 74957 records to 52034 (keeping 200 days of data) [2025-10-14T22:05:02.137592] [DEBUG] [LOCAL ] UDR: Primary data saved (52034 records). [2025-10-14T22:05:02.137754] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-14T22:05:02.137840] [INFO ] [MAIN ] Update Progress: 2170/2369 symbols completed. UDR took 40.8s. Estimated remaining: 27m 58s. Rate: 7.1 symbols/min [2025-10-14T22:05:02.305331] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:02.344662] [DEBUG] [LOCAL ] UGP: Loaded 42912 existing records from primary storage. [2025-10-14T22:05:02.344951] [INFO ] [MAIN ] UGP: Loaded 42912 existing records. [2025-10-14T22:05:02.365201] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-14T22:05:02.441482] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T22:05:02.547752] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:02.548003] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-14T22:05:02.548053] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-14T22:05:02.548275] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-14T22:05:02.548316] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-14T22:05:02.910734] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:03.158061] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-14T22:05:03.936503] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T22:05:03.958035] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-14T22:05:04.758039] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-14T22:05:04.829546] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T22:05:05.273130] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T22:05:05.310676] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-14T22:05:05.558065] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-14T22:05:06.358109] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-14T22:05:07.023892] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T22:05:07.158057] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-14T22:05:07.613220] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T22:05:07.958061] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-14T22:05:08.410900] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T22:05:08.758062] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-14T22:05:08.980102] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-14T22:05:09.558057] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-14T22:05:10.358120] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-14T22:05:10.437521] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T22:05:10.899584] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T22:05:11.031419] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T22:05:11.033048] [INFO ] [REMOTE ] UFI: Full fetch complete (12395 records). [2025-10-14T22:05:11.033118] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-14T22:05:11.163162] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-14T22:05:11.412282] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-14T22:05:11.412351] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-14T22:05:11.412677] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-14T22:05:11.412739] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-14T22:05:11.413232] [DEBUG] [LOCAL ] UFI: Trimmed 12395 records to 8163 (keeping 200 days of data) [2025-10-14T22:05:11.456953] [DEBUG] [LOCAL ] UFI: Primary data saved (8163 records). [2025-10-14T22:05:11.457096] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-14T22:05:11.457193] [INFO ] [MAIN ] Update Progress: 2171/2369 symbols completed. UFI took 28.3s. Estimated remaining: 27m 50s. Rate: 7.1 symbols/min [2025-10-14T22:05:11.629341] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:11.646419] [DEBUG] [LOCAL ] UHAL: Loaded 16852 existing records from primary storage. [2025-10-14T22:05:11.646680] [INFO ] [MAIN ] UHAL: Loaded 16852 existing records. [2025-10-14T22:05:11.831572] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:11.831783] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-14T22:05:11.831833] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-14T22:05:11.831990] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-14T22:05:11.832032] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-14T22:05:11.963207] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-14T22:05:12.208225] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:12.701922] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T22:05:12.758042] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-14T22:05:13.327813] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T22:05:13.558067] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-14T22:05:14.021546] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T22:05:14.358067] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-14T22:05:15.094810] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T22:05:15.158071] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-14T22:05:15.927841] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T22:05:15.958027] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-14T22:05:15.977124] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T22:05:16.758134] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-14T22:05:16.960444] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-14T22:05:16.967565] [INFO ] [REMOTE ] UE: Full fetch complete (61106 records). [2025-10-14T22:05:16.967825] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-14T22:05:17.379254] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-14T22:05:17.379409] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-14T22:05:17.380838] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-14T22:05:17.380980] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-14T22:05:17.392002] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T22:05:17.396898] [DEBUG] [LOCAL ] UE: Trimmed 61106 records to 42547 (keeping 200 days of data) [2025-10-14T22:05:17.575355] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-14T22:05:17.662244] [DEBUG] [LOCAL ] UE: Primary data saved (42547 records). [2025-10-14T22:05:17.662370] [INFO ] [MAIN ] UE: Full history saved. [2025-10-14T22:05:17.662443] [INFO ] [MAIN ] Update Progress: 2172/2369 symbols completed. UE took 42.4s. Estimated remaining: 27m 41s. Rate: 7.1 symbols/min [2025-10-14T22:05:17.832108] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:17.873367] [DEBUG] [LOCAL ] UHS: Loaded 40384 existing records from primary storage. [2025-10-14T22:05:17.873686] [INFO ] [MAIN ] UHS: Loaded 40384 existing records. [2025-10-14T22:05:18.068796] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:18.068998] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-14T22:05:18.069097] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-14T22:05:18.069398] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-14T22:05:18.069455] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-14T22:05:18.363235] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-14T22:05:18.432507] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:19.076401] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T22:05:19.083210] [INFO ] [REMOTE ] UGI: Full fetch complete (73432 records). [2025-10-14T22:05:19.083399] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-14T22:05:19.163467] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-14T22:05:19.565041] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-14T22:05:19.565136] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-14T22:05:19.566383] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-14T22:05:19.566450] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-14T22:05:19.568012] [DEBUG] [LOCAL ] UGI: Trimmed 73432 records to 50609 (keeping 200 days of data) [2025-10-14T22:05:19.876812] [DEBUG] [LOCAL ] UGI: Primary data saved (50609 records). [2025-10-14T22:05:19.876969] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-14T22:05:19.877051] [INFO ] [MAIN ] Update Progress: 2173/2369 symbols completed. UGI took 29.0s. Estimated remaining: 27m 32s. Rate: 7.1 symbols/min [2025-10-14T22:05:19.976520] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-14T22:05:20.072680] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:20.074320] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-14T22:05:20.092492] [DEBUG] [LOCAL ] UHT: Loaded 10071 existing records from primary storage. [2025-10-14T22:05:20.092723] [INFO ] [MAIN ] UHT: Loaded 10071 existing records. [2025-10-14T22:05:20.278908] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:20.279151] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-14T22:05:20.279198] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-14T22:05:20.279368] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-14T22:05:20.279407] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-14T22:05:20.672910] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:20.699122] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T22:05:20.758168] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-14T22:05:20.798686] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T22:05:21.558061] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-14T22:05:22.104477] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-14T22:05:22.295376] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T22:05:22.358089] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-14T22:05:23.158051] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-14T22:05:23.192371] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T22:05:23.958073] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-14T22:05:24.713307] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T22:05:24.758042] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-14T22:05:25.439145] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T22:05:25.558045] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-14T22:05:25.658751] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T22:05:26.358113] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-14T22:05:26.797519] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T22:05:26.814240] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-14T22:05:27.158117] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-14T22:05:27.958065] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-14T22:05:28.230697] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T22:05:28.585514] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-14T22:05:28.758059] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-14T22:05:29.558064] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-14T22:05:30.363172] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-14T22:05:30.382864] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T22:05:30.729046] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-14T22:05:30.898758] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-14T22:05:31.158057] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-14T22:05:31.908624] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T22:05:31.958037] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-14T22:05:32.758104] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-14T22:05:33.558083] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-14T22:05:33.598396] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T22:05:33.640293] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T22:05:34.358099] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-14T22:05:35.034980] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T22:05:35.041010] [INFO ] [REMOTE ] UGP: Full fetch complete (62285 records). [2025-10-14T22:05:35.041170] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-14T22:05:35.166808] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-14T22:05:35.316709] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-14T22:05:35.453431] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-14T22:05:35.453562] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-14T22:05:35.454664] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-14T22:05:35.454723] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-14T22:05:35.455830] [DEBUG] [LOCAL ] UGP: Trimmed 62285 records to 42920 (keeping 200 days of data) [2025-10-14T22:05:35.700035] [DEBUG] [LOCAL ] UGP: Primary data saved (42920 records). [2025-10-14T22:05:35.700157] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-14T22:05:35.700232] [INFO ] [MAIN ] Update Progress: 2174/2369 symbols completed. UGP took 33.6s. Estimated remaining: 27m 24s. Rate: 7.1 symbols/min [2025-10-14T22:05:35.870734] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:35.886145] [DEBUG] [LOCAL ] UI: Loaded 13686 existing records from primary storage. [2025-10-14T22:05:35.886359] [INFO ] [MAIN ] UI: Loaded 13686 existing records. [2025-10-14T22:05:35.963320] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-14T22:05:36.068622] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:36.068860] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-14T22:05:36.068908] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-14T22:05:36.069085] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-14T22:05:36.069149] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-14T22:05:36.426155] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:36.758125] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-14T22:05:36.904633] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-14T22:05:36.946542] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T22:05:37.340692] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T22:05:37.558123] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-14T22:05:38.358112] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-14T22:05:39.100761] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T22:05:39.149895] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T22:05:39.158014] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-14T22:05:39.958068] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-14T22:05:40.131216] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T22:05:40.758094] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-14T22:05:41.148178] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-14T22:05:41.478370] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-14T22:05:41.558057] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-14T22:05:42.358804] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-14T22:05:42.361275] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T22:05:43.158064] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-14T22:05:43.881935] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T22:05:43.898452] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-14T22:05:43.958060] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-14T22:05:44.741163] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-14T22:05:44.758042] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-14T22:05:45.464160] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T22:05:45.466056] [INFO ] [REMOTE ] UHT: Full fetch complete (15067 records). [2025-10-14T22:05:45.466135] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-14T22:05:45.563336] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-14T22:05:45.862096] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-14T22:05:45.862177] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-14T22:05:45.862550] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-14T22:05:45.862591] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-14T22:05:45.863111] [DEBUG] [LOCAL ] UHT: Trimmed 15067 records to 10125 (keeping 200 days of data) [2025-10-14T22:05:45.923021] [DEBUG] [LOCAL ] UHT: Primary data saved (10125 records). [2025-10-14T22:05:45.923137] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-14T22:05:45.923214] [INFO ] [MAIN ] Update Progress: 2175/2369 symbols completed. UHT took 26.0s. Estimated remaining: 27m 16s. Rate: 7.1 symbols/min [2025-10-14T22:05:46.093954] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:46.127398] [DEBUG] [LOCAL ] UIS: Loaded 36900 existing records from primary storage. [2025-10-14T22:05:46.127684] [INFO ] [MAIN ] UIS: Loaded 36900 existing records. [2025-10-14T22:05:46.309796] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:46.309982] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-14T22:05:46.310028] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-14T22:05:46.310279] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-14T22:05:46.310345] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-14T22:05:46.365563] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-14T22:05:46.679912] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:46.696463] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T22:05:47.158106] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-14T22:05:47.376985] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T22:05:47.826070] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-14T22:05:47.958135] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-14T22:05:48.641258] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-14T22:05:48.758129] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-14T22:05:49.558067] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-14T22:05:49.569297] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T22:05:50.358091] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-14T22:05:50.551889] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T22:05:51.158074] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-14T22:05:51.697984] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-14T22:05:51.958102] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-14T22:05:52.683467] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-14T22:05:52.747879] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T22:05:52.758046] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-14T22:05:53.558050] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-14T22:05:53.895989] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T22:05:54.358075] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-14T22:05:54.720036] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T22:05:54.911295] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T22:05:54.915474] [INFO ] [REMOTE ] UHS: Full fetch complete (58257 records). [2025-10-14T22:05:54.915581] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-14T22:05:55.168419] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-14T22:05:55.298483] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-14T22:05:55.298561] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-14T22:05:55.299598] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-14T22:05:55.299682] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-14T22:05:55.300768] [DEBUG] [LOCAL ] UHS: Trimmed 58257 records to 40255 (keeping 200 days of data) [2025-10-14T22:05:55.554854] [DEBUG] [LOCAL ] UHS: Primary data saved (40255 records). [2025-10-14T22:05:55.554973] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-14T22:05:55.555713] [INFO ] [MAIN ] Update Progress: 2176/2369 symbols completed. UHS took 37.9s. Estimated remaining: 27m 8s. Rate: 7.1 symbols/min [2025-10-14T22:05:55.723019] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:55.773185] [DEBUG] [LOCAL ] UL: Loaded 53079 existing records from primary storage. [2025-10-14T22:05:55.773483] [INFO ] [MAIN ] UL: Loaded 53079 existing records. [2025-10-14T22:05:55.947797] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:55.948016] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-14T22:05:55.948064] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-14T22:05:55.948446] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-14T22:05:55.948504] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-14T22:05:55.963205] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-14T22:05:56.243048] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-14T22:05:56.291739] [INFO ] [REMOTE ] UHAL: Full fetch complete (23233 records). [2025-10-14T22:05:56.320384] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-14T22:05:56.320305] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:56.675022] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-14T22:05:56.675098] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-14T22:05:56.675482] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-14T22:05:56.675520] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-14T22:05:56.676107] [DEBUG] [LOCAL ] UHAL: Trimmed 23233 records to 16876 (keeping 200 days of data) [2025-10-14T22:05:56.759237] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-14T22:05:56.773875] [DEBUG] [LOCAL ] UHAL: Primary data saved (16876 records). [2025-10-14T22:05:56.774046] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-14T22:05:56.774129] [INFO ] [MAIN ] Update Progress: 2177/2369 symbols completed. UHAL took 45.3s. Estimated remaining: 26m 59s. Rate: 7.1 symbols/min [2025-10-14T22:05:56.940986] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:05:56.979519] [DEBUG] [LOCAL ] ULS: Loaded 39048 existing records from primary storage. [2025-10-14T22:05:56.979847] [INFO ] [MAIN ] ULS: Loaded 39048 existing records. [2025-10-14T22:05:57.164301] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:05:57.169778] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-14T22:05:57.169883] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-14T22:05:57.170933] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-14T22:05:57.170881] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-14T22:05:57.171129] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-14T22:05:57.524620] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:05:57.558028] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-14T22:05:58.358075] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-14T22:05:58.660145] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T22:05:59.045438] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T22:05:59.158045] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-14T22:05:59.333535] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-14T22:05:59.958036] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-14T22:06:00.196678] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T22:06:00.200533] [INFO ] [REMOTE ] UI: Full fetch complete (19227 records). [2025-10-14T22:06:00.200717] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-14T22:06:00.580841] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-14T22:06:00.580918] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-14T22:06:00.581382] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-14T22:06:00.581422] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-14T22:06:00.582041] [DEBUG] [LOCAL ] UI: Trimmed 19227 records to 13864 (keeping 200 days of data) [2025-10-14T22:06:00.669056] [DEBUG] [LOCAL ] UI: Primary data saved (13864 records). [2025-10-14T22:06:00.669199] [INFO ] [MAIN ] UI: Full history saved. [2025-10-14T22:06:00.669280] [INFO ] [MAIN ] Update Progress: 2178/2369 symbols completed. UI took 25.0s. Estimated remaining: 26m 50s. Rate: 7.1 symbols/min [2025-10-14T22:06:00.763190] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-14T22:06:00.846232] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:06:00.895175] [DEBUG] [LOCAL ] UMC: Loaded 52680 existing records from primary storage. [2025-10-14T22:06:00.895494] [INFO ] [MAIN ] UMC: Loaded 52680 existing records. [2025-10-14T22:06:01.086435] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:06:01.086758] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-14T22:06:01.086884] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-14T22:06:01.087262] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-14T22:06:01.087320] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-14T22:06:01.331786] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T22:06:01.475960] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:06:01.558078] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-14T22:06:02.358086] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-14T22:06:02.677535] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-14T22:06:03.158153] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-14T22:06:03.192680] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T22:06:03.321544] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-14T22:06:03.958065] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-14T22:06:04.617980] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T22:06:04.758015] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-14T22:06:05.558037] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-14T22:06:05.837120] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-14T22:06:06.195724] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T22:06:06.358046] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-14T22:06:07.020091] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T22:06:07.158094] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-14T22:06:07.790946] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-14T22:06:07.958094] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-14T22:06:08.758070] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-14T22:06:08.801089] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T22:06:08.968299] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T22:06:09.558069] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-14T22:06:10.358071] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-14T22:06:10.872993] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-14T22:06:10.949816] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-14T22:06:11.158118] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-14T22:06:11.958108] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-14T22:06:12.251281] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-14T22:06:12.758119] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-14T22:06:13.403440] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T22:06:13.558066] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-14T22:06:13.607371] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-14T22:06:14.342836] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-14T22:06:14.358033] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-14T22:06:14.964017] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-14T22:06:15.158078] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-14T22:06:15.958048] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-14T22:06:16.244087] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T22:06:16.316241] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T22:06:16.758175] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-14T22:06:17.540729] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-14T22:06:17.558028] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-14T22:06:17.751622] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T22:06:18.358069] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-14T22:06:19.072352] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-14T22:06:19.158057] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-14T22:06:19.958066] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-14T22:06:20.258550] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T22:06:20.598328] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-14T22:06:20.758116] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-14T22:06:21.360208] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-14T22:06:21.558066] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-14T22:06:21.872883] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T22:06:21.876823] [INFO ] [REMOTE ] ULS: Full fetch complete (54169 records). [2025-10-14T22:06:21.876928] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-14T22:06:22.293223] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-14T22:06:22.293335] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-14T22:06:22.294824] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-14T22:06:22.294906] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-14T22:06:22.296240] [DEBUG] [LOCAL ] ULS: Trimmed 54169 records to 38972 (keeping 200 days of data) [2025-10-14T22:06:22.360333] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-14T22:06:22.542975] [DEBUG] [LOCAL ] ULS: Primary data saved (38972 records). [2025-10-14T22:06:22.543117] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-14T22:06:22.543194] [INFO ] [MAIN ] Update Progress: 2179/2369 symbols completed. ULS took 25.8s. Estimated remaining: 26m 43s. Rate: 7.1 symbols/min [2025-10-14T22:06:22.714474] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:06:22.747529] [DEBUG] [LOCAL ] UMH: Loaded 33956 existing records from primary storage. [2025-10-14T22:06:22.747815] [INFO ] [MAIN ] UMH: Loaded 33956 existing records. [2025-10-14T22:06:22.932378] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:06:22.932632] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-14T22:06:22.932725] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-14T22:06:22.932974] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-14T22:06:22.933045] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-14T22:06:23.162173] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-14T22:06:23.302114] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:06:23.499947] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T22:06:23.958042] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-14T22:06:24.206047] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T22:06:24.725322] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T22:06:24.758032] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-14T22:06:25.558040] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-14T22:06:25.622320] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T22:06:25.746733] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-14T22:06:26.358051] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-14T22:06:27.158035] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-14T22:06:27.467058] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-14T22:06:27.958055] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-14T22:06:28.212635] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T22:06:28.384197] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T22:06:28.388837] [INFO ] [REMOTE ] UIS: Full fetch complete (52031 records). [2025-10-14T22:06:28.388936] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-14T22:06:28.760291] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-14T22:06:28.760550] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-14T22:06:28.760849] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-14T22:06:28.762616] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-14T22:06:28.762847] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-14T22:06:28.764084] [DEBUG] [LOCAL ] UIS: Trimmed 52031 records to 36896 (keeping 200 days of data) [2025-10-14T22:06:28.972038] [DEBUG] [LOCAL ] UIS: Primary data saved (36896 records). [2025-10-14T22:06:28.972185] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-14T22:06:28.972287] [INFO ] [MAIN ] Update Progress: 2180/2369 symbols completed. UIS took 43.0s. Estimated remaining: 26m 34s. Rate: 7.1 symbols/min [2025-10-14T22:06:29.140573] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:06:29.154276] [DEBUG] [LOCAL ] UNF: Loaded 11761 existing records from primary storage. [2025-10-14T22:06:29.154497] [INFO ] [MAIN ] UNF: Loaded 11761 existing records. [2025-10-14T22:06:29.333170] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:06:29.333696] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-14T22:06:29.333753] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-14T22:06:29.333897] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-14T22:06:29.333934] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-14T22:06:29.566586] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-14T22:06:29.697430] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:06:29.842587] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-14T22:06:30.358064] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-14T22:06:30.571238] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-14T22:06:30.577054] [INFO ] [REMOTE ] UL: Full fetch complete (77061 records). [2025-10-14T22:06:30.577161] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-14T22:06:30.960915] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T22:06:31.023278] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-14T22:06:31.023373] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-14T22:06:31.024571] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-14T22:06:31.024638] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-14T22:06:31.026895] [DEBUG] [LOCAL ] UL: Trimmed 77061 records to 53077 (keeping 200 days of data) [2025-10-14T22:06:31.139193] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-14T22:06:31.158432] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-14T22:06:31.370636] [DEBUG] [LOCAL ] UL: Primary data saved (53077 records). [2025-10-14T22:06:31.370793] [INFO ] [MAIN ] UL: Full history saved. [2025-10-14T22:06:31.370883] [INFO ] [MAIN ] Update Progress: 2181/2369 symbols completed. UL took 35.8s. Estimated remaining: 26m 25s. Rate: 7.1 symbols/min [2025-10-14T22:06:31.545317] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:06:31.584787] [DEBUG] [LOCAL ] UNFI: Loaded 42529 existing records from primary storage. [2025-10-14T22:06:31.585087] [INFO ] [MAIN ] UNFI: Loaded 42529 existing records. [2025-10-14T22:06:31.763482] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:06:31.763713] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-14T22:06:31.763767] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-14T22:06:31.764034] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-14T22:06:31.764090] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-14T22:06:31.967833] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-14T22:06:32.131551] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:06:32.758083] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-14T22:06:33.084188] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T22:06:33.149194] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T22:06:33.558136] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-14T22:06:33.759678] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-14T22:06:34.358105] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-14T22:06:34.671150] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T22:06:35.158095] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-14T22:06:35.958078] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-14T22:06:36.061131] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T22:06:36.067928] [INFO ] [REMOTE ] UMC: Full fetch complete (76676 records). [2025-10-14T22:06:36.068148] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-14T22:06:36.482864] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-14T22:06:36.483025] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-14T22:06:36.485059] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-14T22:06:36.485135] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-14T22:06:36.487237] [DEBUG] [LOCAL ] UMC: Trimmed 76676 records to 52685 (keeping 200 days of data) [2025-10-14T22:06:36.759467] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-14T22:06:36.768128] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T22:06:36.858278] [DEBUG] [LOCAL ] UMC: Primary data saved (52685 records). [2025-10-14T22:06:36.858436] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-14T22:06:36.858527] [INFO ] [MAIN ] Update Progress: 2182/2369 symbols completed. UMC took 36.2s. Estimated remaining: 26m 16s. Rate: 7.1 symbols/min [2025-10-14T22:06:37.040009] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:06:37.060359] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-14T22:06:37.112876] [DEBUG] [LOCAL ] UNH: Loaded 53806 existing records from primary storage. [2025-10-14T22:06:37.113209] [INFO ] [MAIN ] UNH: Loaded 53806 existing records. [2025-10-14T22:06:37.290254] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:06:37.290490] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-14T22:06:37.290538] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-14T22:06:37.291014] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-14T22:06:37.291071] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-14T22:06:37.547722] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T22:06:37.559281] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-14T22:06:37.665662] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:06:38.358041] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-14T22:06:39.059847] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T22:06:39.158093] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-14T22:06:39.958100] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-14T22:06:40.290687] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T22:06:40.501036] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-14T22:06:40.758083] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-14T22:06:41.461372] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T22:06:41.482098] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T22:06:41.558049] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-14T22:06:42.358067] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-14T22:06:43.158075] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-14T22:06:43.650971] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T22:06:43.718171] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T22:06:43.958078] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-14T22:06:44.176252] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-14T22:06:44.758070] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-14T22:06:44.928961] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T22:06:45.558062] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-14T22:06:45.780478] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-14T22:06:46.358078] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-14T22:06:46.765050] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T22:06:47.158074] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-14T22:06:47.958042] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-14T22:06:48.444624] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-14T22:06:48.565076] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-14T22:06:48.758054] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-14T22:06:48.945847] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T22:06:49.558083] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-14T22:06:50.358064] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-14T22:06:50.808076] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-14T22:06:50.971935] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-14T22:06:51.005023] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-14T22:06:51.158038] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-14T22:06:51.958106] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-14T22:06:52.374963] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T22:06:52.381255] [INFO ] [REMOTE ] UMH: Full fetch complete (46921 records). [2025-10-14T22:06:52.381407] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-14T22:06:52.764383] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-14T22:06:52.766059] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-14T22:06:52.766157] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-14T22:06:52.767096] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-14T22:06:52.767261] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-14T22:06:52.768274] [DEBUG] [LOCAL ] UMH: Trimmed 46921 records to 34032 (keeping 200 days of data) [2025-10-14T22:06:52.975845] [DEBUG] [LOCAL ] UMH: Primary data saved (34032 records). [2025-10-14T22:06:52.975980] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-14T22:06:52.976059] [INFO ] [MAIN ] Update Progress: 2183/2369 symbols completed. UMH took 30.4s. Estimated remaining: 26m 9s. Rate: 7.1 symbols/min [2025-10-14T22:06:53.159446] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:06:53.202438] [DEBUG] [LOCAL ] UNM: Loaded 48201 existing records from primary storage. [2025-10-14T22:06:53.202755] [INFO ] [MAIN ] UNM: Loaded 48201 existing records. [2025-10-14T22:06:53.394565] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:06:53.394921] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-14T22:06:53.394968] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-14T22:06:53.395414] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-14T22:06:53.395470] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-14T22:06:53.573962] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-14T22:06:53.717830] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-14T22:06:53.779040] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:06:54.358049] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-14T22:06:54.516980] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-14T22:06:55.163152] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-14T22:06:55.175478] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T22:06:55.553481] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T22:06:55.902143] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T22:06:55.958035] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-14T22:06:56.758065] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-14T22:06:57.558095] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-14T22:06:57.616023] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T22:06:58.358066] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-14T22:06:59.093338] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T22:06:59.158065] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-14T22:06:59.223964] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-14T22:06:59.958065] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-14T22:07:00.089905] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-14T22:07:00.523332] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-14T22:07:00.758086] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-14T22:07:01.558062] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-14T22:07:02.325414] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T22:07:02.358078] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-14T22:07:02.623585] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-14T22:07:03.158092] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-14T22:07:03.331496] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T22:07:03.841038] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T22:07:03.857717] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T22:07:03.958057] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-14T22:07:04.758143] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-14T22:07:05.558051] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-14T22:07:05.652336] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-14T22:07:06.058342] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-14T22:07:06.358076] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-14T22:07:07.158106] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-14T22:07:07.385675] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-14T22:07:07.481053] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-14T22:07:07.888587] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T22:07:07.890487] [INFO ] [REMOTE ] UNF: Full fetch complete (17486 records). [2025-10-14T22:07:07.890565] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-14T22:07:07.963213] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-14T22:07:08.265197] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-14T22:07:08.265271] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-14T22:07:08.265675] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-14T22:07:08.265734] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-14T22:07:08.266241] [DEBUG] [LOCAL ] UNF: Trimmed 17486 records to 11797 (keeping 200 days of data) [2025-10-14T22:07:08.340267] [DEBUG] [LOCAL ] UNF: Primary data saved (11797 records). [2025-10-14T22:07:08.340394] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-14T22:07:08.340474] [INFO ] [MAIN ] Update Progress: 2184/2369 symbols completed. UNF took 39.4s. Estimated remaining: 26m 1s. Rate: 7.1 symbols/min [2025-10-14T22:07:08.507562] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:08.513746] [DEBUG] [LOCAL ] UNMA: Loaded 3545 existing records from primary storage. [2025-10-14T22:07:08.513934] [INFO ] [MAIN ] UNMA: Loaded 3545 existing records. [2025-10-14T22:07:08.703896] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:08.704113] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-14T22:07:08.704160] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-14T22:07:08.704332] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-14T22:07:08.704388] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-14T22:07:08.766486] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-14T22:07:09.096818] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:09.542169] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T22:07:09.547446] [INFO ] [REMOTE ] UNFI: Full fetch complete (59572 records). [2025-10-14T22:07:09.547580] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-14T22:07:09.568834] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-14T22:07:09.935904] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-14T22:07:09.935983] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-14T22:07:09.937044] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-14T22:07:09.937105] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-14T22:07:09.938283] [DEBUG] [LOCAL ] UNFI: Trimmed 59572 records to 42585 (keeping 200 days of data) [2025-10-14T22:07:10.190448] [DEBUG] [LOCAL ] UNFI: Primary data saved (42585 records). [2025-10-14T22:07:10.190597] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-14T22:07:10.190722] [INFO ] [MAIN ] Update Progress: 2185/2369 symbols completed. UNFI took 38.8s. Estimated remaining: 25m 52s. Rate: 7.1 symbols/min [2025-10-14T22:07:10.303536] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T22:07:10.377206] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:10.374584] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-14T22:07:10.412070] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T22:07:10.470370] [DEBUG] [LOCAL ] UNP: Loaded 53333 existing records from primary storage. [2025-10-14T22:07:10.470752] [INFO ] [MAIN ] UNP: Loaded 53333 existing records. [2025-10-14T22:07:10.654108] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:10.654318] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-14T22:07:10.654364] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-14T22:07:10.654887] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-14T22:07:10.654944] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-14T22:07:11.025408] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:11.158101] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-14T22:07:11.958098] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-14T22:07:12.491145] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T22:07:12.547539] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T22:07:12.758048] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-14T22:07:12.972942] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-14T22:07:13.102366] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-14T22:07:13.558061] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-14T22:07:14.219763] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T22:07:14.358065] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-14T22:07:15.158078] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-14T22:07:15.719842] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T22:07:15.958107] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-14T22:07:16.758151] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-14T22:07:17.532859] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T22:07:17.558041] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-14T22:07:17.641842] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-14T22:07:18.358075] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-14T22:07:18.438697] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-14T22:07:18.918663] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-14T22:07:19.158049] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-14T22:07:19.313301] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T22:07:19.486673] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-14T22:07:19.958082] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-14T22:07:20.758098] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-14T22:07:20.996965] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T22:07:21.002099] [INFO ] [REMOTE ] UNM: Full fetch complete (69906 records). [2025-10-14T22:07:21.002220] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-14T22:07:21.110362] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-14T22:07:21.393088] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-14T22:07:21.393175] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-14T22:07:21.394277] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-14T22:07:21.394337] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-14T22:07:21.395605] [DEBUG] [LOCAL ] UNM: Trimmed 69906 records to 48154 (keeping 200 days of data) [2025-10-14T22:07:21.568302] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-14T22:07:21.684513] [DEBUG] [LOCAL ] UNM: Primary data saved (48154 records). [2025-10-14T22:07:21.684673] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-14T22:07:21.684772] [INFO ] [MAIN ] Update Progress: 2186/2369 symbols completed. UNM took 28.7s. Estimated remaining: 25m 44s. Rate: 7.1 symbols/min [2025-10-14T22:07:21.852040] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:21.891486] [DEBUG] [LOCAL ] UP: Loaded 43941 existing records from primary storage. [2025-10-14T22:07:21.891787] [INFO ] [MAIN ] UP: Loaded 43941 existing records. [2025-10-14T22:07:22.071400] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:22.071606] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-14T22:07:22.071679] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-14T22:07:22.072020] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-14T22:07:22.072081] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-14T22:07:22.367056] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-14T22:07:22.369877] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-14T22:07:22.397172] [INFO ] [REMOTE ] UNH: Full fetch complete (77957 records). [2025-10-14T22:07:22.402902] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-14T22:07:22.488368] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:22.852281] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-14T22:07:22.852376] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-14T22:07:22.853678] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-14T22:07:22.853741] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-14T22:07:22.855291] [DEBUG] [LOCAL ] UNH: Trimmed 77957 records to 53811 (keeping 200 days of data) [2025-10-14T22:07:23.169333] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-14T22:07:23.195911] [DEBUG] [LOCAL ] UNH: Primary data saved (53811 records). [2025-10-14T22:07:23.196003] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-14T22:07:23.196075] [INFO ] [MAIN ] Update Progress: 2187/2369 symbols completed. UNH took 46.3s. Estimated remaining: 25m 35s. Rate: 7.1 symbols/min [2025-10-14T22:07:23.368032] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:23.417786] [DEBUG] [LOCAL ] UPS: Loaded 53718 existing records from primary storage. [2025-10-14T22:07:23.418166] [INFO ] [MAIN ] UPS: Loaded 53718 existing records. [2025-10-14T22:07:23.595365] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:23.595556] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-14T22:07:23.595602] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-14T22:07:23.595962] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-14T22:07:23.596018] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-14T22:07:23.863812] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T22:07:23.959569] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-14T22:07:23.972989] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:24.078090] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T22:07:24.758096] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-14T22:07:24.788479] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T22:07:25.558073] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-14T22:07:26.046432] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-14T22:07:26.358048] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-14T22:07:26.463356] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T22:07:27.158107] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-14T22:07:27.806125] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T22:07:27.807107] [INFO ] [REMOTE ] UNMA: Full fetch complete (5658 records). [2025-10-14T22:07:27.807173] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-14T22:07:27.958561] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-14T22:07:28.179829] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-14T22:07:28.217580] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-14T22:07:28.217677] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-14T22:07:28.217880] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-14T22:07:28.217946] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-14T22:07:28.218307] [DEBUG] [LOCAL ] UNMA: Trimmed 5658 records to 3529 (keeping 200 days of data) [2025-10-14T22:07:28.238953] [DEBUG] [LOCAL ] UNMA: Primary data saved (3529 records). [2025-10-14T22:07:28.239014] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-14T22:07:28.239087] [INFO ] [MAIN ] Update Progress: 2188/2369 symbols completed. UNMA took 19.9s. Estimated remaining: 25m 26s. Rate: 7.1 symbols/min [2025-10-14T22:07:28.405803] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:28.439726] [DEBUG] [LOCAL ] URI: Loaded 34885 existing records from primary storage. [2025-10-14T22:07:28.440007] [INFO ] [MAIN ] URI: Loaded 34885 existing records. [2025-10-14T22:07:28.615665] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:28.615883] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-14T22:07:28.615931] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-14T22:07:28.616272] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-14T22:07:28.616312] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-14T22:07:28.763133] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-14T22:07:28.978019] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:29.558059] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-14T22:07:29.697595] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T22:07:30.358082] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-14T22:07:30.423124] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T22:07:30.723782] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-14T22:07:31.158127] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-14T22:07:31.958041] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-14T22:07:32.444704] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-14T22:07:32.486159] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T22:07:32.758065] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-14T22:07:33.558042] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-14T22:07:33.915600] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-14T22:07:34.358049] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-14T22:07:34.560439] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T22:07:35.158040] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-14T22:07:35.256082] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T22:07:35.871197] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T22:07:35.958091] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-14T22:07:36.758046] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-14T22:07:37.294946] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-14T22:07:37.558102] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-14T22:07:37.610321] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-14T22:07:38.358078] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-14T22:07:38.632295] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T22:07:39.081414] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T22:07:39.158055] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-14T22:07:39.464614] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T22:07:39.958121] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-14T22:07:40.758094] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-14T22:07:40.867801] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T22:07:41.415033] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T22:07:41.558052] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-14T22:07:42.352521] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T22:07:42.362856] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-14T22:07:43.158091] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-14T22:07:43.328806] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T22:07:43.958151] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-14T22:07:44.635253] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-14T22:07:44.758048] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-14T22:07:44.858365] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T22:07:45.558104] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-14T22:07:46.329002] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-14T22:07:46.358045] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-14T22:07:46.664572] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T22:07:46.843792] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T22:07:47.158094] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-14T22:07:47.958069] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-14T22:07:48.719185] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-14T22:07:48.758042] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-14T22:07:49.257328] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-14T22:07:49.548763] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T22:07:49.558022] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-14T22:07:50.252988] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T22:07:50.358096] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-14T22:07:50.945344] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T22:07:50.951369] [INFO ] [REMOTE ] UNP: Full fetch complete (77081 records). [2025-10-14T22:07:50.951514] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-14T22:07:51.162241] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-14T22:07:51.307022] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-14T22:07:51.414354] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-14T22:07:51.414438] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-14T22:07:51.415745] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-14T22:07:51.415808] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-14T22:07:51.417251] [DEBUG] [LOCAL ] UNP: Trimmed 77081 records to 53343 (keeping 200 days of data) [2025-10-14T22:07:51.746746] [DEBUG] [LOCAL ] UNP: Primary data saved (53343 records). [2025-10-14T22:07:51.746890] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-14T22:07:51.747568] [INFO ] [MAIN ] Update Progress: 2189/2369 symbols completed. UNP took 41.6s. Estimated remaining: 25m 19s. Rate: 7.1 symbols/min [2025-10-14T22:07:51.919740] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:51.954246] [DEBUG] [LOCAL ] USA: Loaded 36209 existing records from primary storage. [2025-10-14T22:07:51.954513] [INFO ] [MAIN ] USA: Loaded 36209 existing records. [2025-10-14T22:07:51.965744] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-14T22:07:52.146094] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:52.146472] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-14T22:07:52.146548] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-14T22:07:52.146821] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-14T22:07:52.146944] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-14T22:07:52.516941] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T22:07:52.555554] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:52.758047] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-14T22:07:53.497918] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T22:07:53.504166] [INFO ] [REMOTE ] UP: Full fetch complete (62917 records). [2025-10-14T22:07:53.504302] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-14T22:07:53.570173] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-14T22:07:53.951273] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-14T22:07:53.951423] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-14T22:07:53.952753] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-14T22:07:53.952894] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-14T22:07:53.954261] [DEBUG] [LOCAL ] UP: Trimmed 62917 records to 44064 (keeping 200 days of data) [2025-10-14T22:07:54.169377] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-14T22:07:54.233248] [DEBUG] [LOCAL ] UP: Primary data saved (44064 records). [2025-10-14T22:07:54.233475] [INFO ] [MAIN ] UP: Full history saved. [2025-10-14T22:07:54.233564] [INFO ] [MAIN ] Update Progress: 2190/2369 symbols completed. UP took 32.5s. Estimated remaining: 25m 10s. Rate: 7.1 symbols/min [2025-10-14T22:07:54.373092] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-14T22:07:54.405142] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:07:54.426463] [DEBUG] [LOCAL ] USAC: Loaded 21651 existing records from primary storage. [2025-10-14T22:07:54.426752] [INFO ] [MAIN ] USAC: Loaded 21651 existing records. [2025-10-14T22:07:54.610863] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:07:54.611140] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-14T22:07:54.611187] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-14T22:07:54.611470] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-14T22:07:54.611526] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-14T22:07:54.968899] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:07:55.006791] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T22:07:55.158054] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-14T22:07:55.797878] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T22:07:55.871242] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-14T22:07:55.958029] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-14T22:07:56.758084] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-14T22:07:57.131199] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T22:07:57.558063] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-14T22:07:57.947017] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-14T22:07:58.358060] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-14T22:07:58.764667] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T22:07:59.158089] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-14T22:07:59.360522] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-14T22:07:59.958065] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-14T22:08:00.445911] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T22:08:00.758088] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-14T22:08:00.932054] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T22:08:00.967422] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-14T22:08:00.970832] [INFO ] [REMOTE ] URI: Full fetch complete (52868 records). [2025-10-14T22:08:00.970919] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-14T22:08:01.352639] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-14T22:08:01.352788] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-14T22:08:01.354006] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-14T22:08:01.354086] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-14T22:08:01.355404] [DEBUG] [LOCAL ] URI: Trimmed 52868 records to 34814 (keeping 200 days of data) [2025-10-14T22:08:01.561444] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-14T22:08:01.574039] [DEBUG] [LOCAL ] URI: Primary data saved (34814 records). [2025-10-14T22:08:01.574195] [INFO ] [MAIN ] URI: Full history saved. [2025-10-14T22:08:01.575065] [INFO ] [MAIN ] Update Progress: 2191/2369 symbols completed. URI took 33.3s. Estimated remaining: 25m 1s. Rate: 7.1 symbols/min [2025-10-14T22:08:01.779220] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:08:01.838246] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-14T22:08:01.838574] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-14T22:08:02.011473] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:08:02.011721] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-14T22:08:02.011775] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-14T22:08:02.012275] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-14T22:08:02.012334] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-14T22:08:02.360306] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-14T22:08:02.363470] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:08:03.140964] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T22:08:03.158040] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-14T22:08:03.958167] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-14T22:08:04.758329] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-14T22:08:04.758411] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-14T22:08:04.799787] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-14T22:08:04.972833] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-14T22:08:05.558096] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-14T22:08:05.880021] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-14T22:08:06.358084] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-14T22:08:07.018387] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T22:08:07.158124] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-14T22:08:07.670060] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T22:08:07.958077] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-14T22:08:08.344326] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T22:08:08.758065] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-14T22:08:09.558090] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-14T22:08:10.018158] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T22:08:10.363232] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-14T22:08:10.380083] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-14T22:08:11.054479] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T22:08:11.158108] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-14T22:08:11.863230] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T22:08:11.958092] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-14T22:08:12.758517] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-14T22:08:12.764272] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T22:08:12.967506] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T22:08:13.558106] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-14T22:08:14.294905] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T22:08:14.358069] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-14T22:08:15.141605] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T22:08:15.158037] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-14T22:08:15.427700] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-14T22:08:15.958079] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-14T22:08:16.758118] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-14T22:08:17.558069] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-14T22:08:17.899934] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T22:08:18.358042] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-14T22:08:19.408143] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T22:08:19.410675] [INFO ] [REMOTE ] USAC: Full fetch complete (35145 records). [2025-10-14T22:08:19.410760] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-14T22:08:19.814292] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-14T22:08:19.814417] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-14T22:08:19.815241] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-14T22:08:19.815320] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-14T22:08:19.816482] [DEBUG] [LOCAL ] USAC: Trimmed 35145 records to 21622 (keeping 200 days of data) [2025-10-14T22:08:19.947155] [DEBUG] [LOCAL ] USAC: Primary data saved (21622 records). [2025-10-14T22:08:19.947289] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-14T22:08:19.947371] [INFO ] [MAIN ] Update Progress: 2192/2369 symbols completed. USAC took 25.7s. Estimated remaining: 24m 54s. Rate: 7.1 symbols/min [2025-10-14T22:08:20.108630] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-14T22:08:20.166471] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:08:20.167306] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-14T22:08:20.213704] [DEBUG] [LOCAL ] USFD: Loaded 51157 existing records from primary storage. [2025-10-14T22:08:20.213998] [INFO ] [MAIN ] USFD: Loaded 51157 existing records. [2025-10-14T22:08:20.389757] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:08:20.390007] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-14T22:08:20.390065] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-14T22:08:20.390503] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-14T22:08:20.390561] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-14T22:08:20.731711] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (5.57 seconds). [2025-10-14T22:08:20.808188] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:08:20.808638] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-14T22:08:20.808929] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-14T22:08:22.484317] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T22:08:22.494122] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-14T22:08:22.638002] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T22:08:22.649230] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-14T22:08:24.187066] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-14T22:08:24.196855] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-14T22:08:24.292162] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T22:08:24.303268] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-14T22:08:24.850818] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (8.89 seconds). [2025-10-14T22:08:24.859687] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-14T22:08:25.832810] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-14T22:08:25.842917] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-14T22:08:26.449127] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-14T22:08:26.463352] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-14T22:08:27.587467] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T22:08:27.598121] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-14T22:08:27.997679] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:08:28.009122] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-14T22:08:29.358737] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T22:08:29.369755] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-14T22:08:29.471434] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (9.30 seconds). [2025-10-14T22:08:29.477571] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-14T22:08:29.477755] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-14T22:08:29.883309] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-14T22:08:29.883444] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-14T22:08:29.885387] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-14T22:08:29.885457] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-14T22:08:29.886908] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 53719 (keeping 200 days of data) [2025-10-14T22:08:30.210683] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (5.35 seconds). [2025-10-14T22:08:30.217155] [INFO ] [REMOTE ] USA: Full fetch complete (52310 records). [2025-10-14T22:08:30.218931] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-14T22:08:30.345726] [DEBUG] [LOCAL ] UPS: Primary data saved (53719 records). [2025-10-14T22:08:30.351595] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-14T22:08:30.356874] [INFO ] [MAIN ] Update Progress: 2193/2369 symbols completed. UPS took 1m 7s. Estimated remaining: 24m 45s. Rate: 7.1 symbols/min [2025-10-14T22:08:30.732672] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:08:30.819361] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-14T22:08:30.819498] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-14T22:08:30.820540] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-14T22:08:30.820618] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-14T22:08:30.826497] [DEBUG] [LOCAL ] USA: Trimmed 52310 records to 36330 (keeping 200 days of data) [2025-10-14T22:08:30.879122] [DEBUG] [LOCAL ] USNA: Loaded 17862 existing records from primary storage. [2025-10-14T22:08:30.879469] [INFO ] [MAIN ] USNA: Loaded 17862 existing records. [2025-10-14T22:08:31.106967] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:08:31.108871] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-14T22:08:31.110692] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-14T22:08:31.111286] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-14T22:08:31.112162] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-14T22:08:31.496251] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:08:31.497410] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-14T22:08:31.595506] [DEBUG] [LOCAL ] USA: Primary data saved (36330 records). [2025-10-14T22:08:31.595637] [INFO ] [MAIN ] USA: Full history saved. [2025-10-14T22:08:31.595756] [INFO ] [MAIN ] Update Progress: 2194/2369 symbols completed. USA took 39.8s. Estimated remaining: 24m 36s. Rate: 7.1 symbols/min [2025-10-14T22:08:31.763469] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:08:31.780685] [DEBUG] [LOCAL ] USPH: Loaded 17123 existing records from primary storage. [2025-10-14T22:08:31.780922] [INFO ] [MAIN ] USPH: Loaded 17123 existing records. [2025-10-14T22:08:31.957018] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:08:31.957222] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-14T22:08:31.957268] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-14T22:08:31.957514] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-14T22:08:31.957570] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-14T22:08:32.313816] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:08:32.314156] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-14T22:08:32.745865] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (4.74 seconds). [2025-10-14T22:08:32.758418] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-14T22:08:33.407905] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T22:08:33.413784] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-14T22:08:33.413907] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-14T22:08:33.703050] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T22:08:33.715849] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-14T22:08:33.850685] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-14T22:08:33.850777] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-14T22:08:33.851979] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-14T22:08:33.852038] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-14T22:08:33.853493] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 53688 (keeping 200 days of data) [2025-10-14T22:08:34.095318] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (4.73 seconds). [2025-10-14T22:08:34.111180] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-14T22:08:34.226041] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-14T22:08:34.226168] [INFO ] [MAIN ] USB: Full history saved. [2025-10-14T22:08:34.226248] [INFO ] [MAIN ] Update Progress: 2195/2369 symbols completed. USB took 32.7s. Estimated remaining: 24m 27s. Rate: 7.1 symbols/min [2025-10-14T22:08:34.347748] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-14T22:08:34.362229] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-14T22:08:34.418950] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:08:34.447831] [DEBUG] [LOCAL ] UTF: Loaded 30678 existing records from primary storage. [2025-10-14T22:08:34.448192] [INFO ] [MAIN ] UTF: Loaded 30678 existing records. [2025-10-14T22:08:34.641020] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:08:34.648112] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-14T22:08:34.648825] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-14T22:08:34.651418] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-14T22:08:34.652130] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-14T22:08:34.653418] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-14T22:08:34.653476] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-14T22:08:35.022169] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:08:35.158063] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-14T22:08:35.400773] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T22:08:35.730852] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T22:08:35.958080] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-14T22:08:36.008801] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T22:08:36.540356] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-14T22:08:36.758085] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-14T22:08:36.955431] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T22:08:37.558078] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-14T22:08:38.298948] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T22:08:38.358034] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-14T22:08:38.538788] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T22:08:39.158042] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-14T22:08:39.298054] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-14T22:08:39.958121] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-14T22:08:40.758090] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-14T22:08:40.909051] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-14T22:08:40.969112] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T22:08:41.558046] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-14T22:08:41.786557] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T22:08:42.358028] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-14T22:08:43.158087] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-14T22:08:43.379051] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-14T22:08:43.423214] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-14T22:08:43.958068] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-14T22:08:44.394470] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-14T22:08:44.758062] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-14T22:08:45.022103] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-14T22:08:45.558037] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-14T22:08:45.917596] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T22:08:46.358089] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-14T22:08:46.602542] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-14T22:08:47.158042] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-14T22:08:47.303077] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-14T22:08:47.958068] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-14T22:08:48.758073] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-14T22:08:48.829078] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T22:08:48.857171] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-14T22:08:49.558101] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-14T22:08:49.748608] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-14T22:08:50.358107] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-14T22:08:50.698961] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T22:08:51.014436] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-14T22:08:51.158048] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-14T22:08:51.958064] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-14T22:08:52.394464] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-14T22:08:52.758036] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-14T22:08:53.111625] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-14T22:08:53.558100] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-14T22:08:53.997120] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T22:08:54.358077] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-14T22:08:54.468614] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-14T22:08:55.158041] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-14T22:08:55.336253] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T22:08:55.764426] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-14T22:08:55.958063] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-14T22:08:56.758112] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-14T22:08:56.989415] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-14T22:08:57.558059] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-14T22:08:57.713635] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T22:08:58.358094] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-14T22:08:59.035341] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T22:08:59.040380] [INFO ] [REMOTE ] UTF: Full fetch complete (43184 records). [2025-10-14T22:08:59.040464] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-14T22:08:59.163221] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-14T22:08:59.412618] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-14T22:08:59.412729] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-14T22:08:59.413558] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-14T22:08:59.413598] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-14T22:08:59.414546] [DEBUG] [LOCAL ] UTF: Trimmed 43184 records to 30753 (keeping 200 days of data) [2025-10-14T22:08:59.604037] [DEBUG] [LOCAL ] UTF: Primary data saved (30753 records). [2025-10-14T22:08:59.604168] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-14T22:08:59.604253] [INFO ] [MAIN ] Update Progress: 2196/2369 symbols completed. UTF took 25.4s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-14T22:08:59.770972] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:08:59.809395] [DEBUG] [LOCAL ] UTI: Loaded 40604 existing records from primary storage. [2025-10-14T22:08:59.809729] [INFO ] [MAIN ] UTI: Loaded 40604 existing records. [2025-10-14T22:08:59.983667] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-14T22:08:59.988375] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:08:59.989716] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-14T22:08:59.989802] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-14T22:09:00.004238] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-14T22:09:00.004804] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T22:09:00.004964] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-14T22:09:00.066267] [INFO ] [REMOTE ] USFD: Full fetch complete (74134 records). [2025-10-14T22:09:00.080828] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-14T22:09:00.365047] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-14T22:09:00.427155] [INFO ] [REMOTE ] USPH: Full fetch complete (22965 records). [2025-10-14T22:09:00.466157] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-14T22:09:00.796812] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:00.858003] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-14T22:09:01.080683] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-14T22:09:01.098091] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-14T22:09:01.132200] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-14T22:09:01.144264] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-14T22:09:01.144036] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T22:09:01.171707] [INFO ] [REMOTE ] USNA: Full fetch complete (26811 records). [2025-10-14T22:09:01.188251] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-14T22:09:01.199319] [DEBUG] [LOCAL ] USFD: Trimmed 74134 records to 51148 (keeping 200 days of data) [2025-10-14T22:09:01.483609] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-14T22:09:01.489687] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-14T22:09:01.495777] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-14T22:09:01.505951] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-14T22:09:01.532636] [DEBUG] [LOCAL ] USPH: Trimmed 22965 records to 17120 (keeping 200 days of data) [2025-10-14T22:09:01.887289] [DEBUG] [LOCAL ] USPH: Primary data saved (17120 records). [2025-10-14T22:09:01.917912] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-14T22:09:01.922233] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-14T22:09:01.922423] [INFO ] [MAIN ] Update Progress: 2197/2369 symbols completed. USPH took 30.3s. Estimated remaining: 24m 11s. Rate: 7.1 symbols/min [2025-10-14T22:09:01.923180] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-14T22:09:01.928138] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-14T22:09:01.928266] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-14T22:09:02.010827] [DEBUG] [LOCAL ] USNA: Trimmed 26811 records to 17888 (keeping 200 days of data) [2025-10-14T22:09:02.151142] [DEBUG] [LOCAL ] USNA: Primary data saved (17888 records). [2025-10-14T22:09:02.178480] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-14T22:09:02.184803] [INFO ] [MAIN ] Update Progress: 2198/2369 symbols completed. USNA took 31.8s. Estimated remaining: 24m 2s. Rate: 7.1 symbols/min [2025-10-14T22:09:02.220944] [DEBUG] [LOCAL ] USFD: Primary data saved (51148 records). [2025-10-14T22:09:02.221100] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-14T22:09:02.221186] [INFO ] [MAIN ] Update Progress: 2199/2369 symbols completed. USFD took 42.3s. Estimated remaining: 23m 53s. Rate: 7.1 symbols/min [2025-10-14T22:09:02.334434] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T22:09:02.342127] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-14T22:09:03.760398] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-14T22:09:03.768032] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-14T22:09:05.282791] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T22:09:05.291639] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-14T22:09:06.826580] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-14T22:09:06.835627] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-14T22:09:08.466766] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T22:09:08.475967] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-14T22:09:10.137330] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T22:09:10.147564] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-14T22:09:11.358322] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T22:09:11.366488] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-14T22:09:12.654034] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T22:09:12.662125] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-14T22:09:14.332187] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T22:09:14.341151] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-14T22:09:16.183203] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T22:09:16.191860] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-14T22:09:17.840616] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T22:09:17.845058] [INFO ] [REMOTE ] UTI: Full fetch complete (58527 records). [2025-10-14T22:09:17.845191] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-14T22:09:18.226533] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-14T22:09:18.226609] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-14T22:09:18.227735] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-14T22:09:18.227802] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-14T22:09:18.228975] [DEBUG] [LOCAL ] UTI: Trimmed 58527 records to 40511 (keeping 200 days of data) [2025-10-14T22:09:18.460171] [DEBUG] [LOCAL ] UTI: Primary data saved (40511 records). [2025-10-14T22:09:18.460292] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-14T22:09:18.460369] [INFO ] [MAIN ] Update Progress: 2200/2369 symbols completed. UTI took 18.9s. Estimated remaining: 23m 45s. Rate: 7.1 symbols/min [2025-10-14T22:09:19.141141] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:19.167199] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:19.225749] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:19.228861] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:19.262960] [DEBUG] [LOCAL ] UVV: Loaded 22811 existing records from primary storage. [2025-10-14T22:09:19.265037] [INFO ] [MAIN ] UVV: Loaded 22811 existing records. [2025-10-14T22:09:19.264591] [DEBUG] [LOCAL ] UVE: Loaded 21929 existing records from primary storage. [2025-10-14T22:09:19.293502] [INFO ] [MAIN ] UVE: Loaded 21929 existing records. [2025-10-14T22:09:19.307994] [DEBUG] [LOCAL ] UTL: Loaded 11753 existing records from primary storage. [2025-10-14T22:09:19.346106] [INFO ] [MAIN ] UTL: Loaded 11753 existing records. [2025-10-14T22:09:19.529870] [DEBUG] [LOCAL ] UTZ: Loaded 44608 existing records from primary storage. [2025-10-14T22:09:19.584283] [INFO ] [MAIN ] UTZ: Loaded 44608 existing records. [2025-10-14T22:09:19.810596] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:19.834052] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-14T22:09:19.834181] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-14T22:09:19.852420] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:19.855684] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-14T22:09:19.855881] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-14T22:09:19.875148] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-14T22:09:19.900910] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-14T22:09:19.999341] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-14T22:09:19.999202] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:20.004690] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-14T22:09:20.015365] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-14T22:09:20.030964] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-14T22:09:20.188386] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:20.207577] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-14T22:09:20.228516] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-14T22:09:20.231855] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-14T22:09:20.248359] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-14T22:09:20.287784] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-14T22:09:20.293315] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-14T22:09:21.108700] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:21.119584] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-14T22:09:21.302127] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:21.341762] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-14T22:09:21.410123] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:21.431080] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-14T22:09:21.482190] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:21.482528] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-14T22:09:22.087055] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-14T22:09:22.092919] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-14T22:09:22.292932] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T22:09:22.296468] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-14T22:09:22.417182] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-14T22:09:22.420606] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-14T22:09:22.852753] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-14T22:09:22.860639] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-14T22:09:22.930320] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T22:09:22.932770] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-14T22:09:23.016809] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T22:09:23.021005] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-14T22:09:23.085502] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T22:09:23.089690] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-14T22:09:23.466293] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-14T22:09:23.468852] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-14T22:09:23.923847] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-14T22:09:23.928059] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-14T22:09:24.093434] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T22:09:24.096871] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-14T22:09:24.254018] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-14T22:09:24.264047] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-14T22:09:24.294483] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-14T22:09:24.296778] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-14T22:09:24.713739] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T22:09:24.718403] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-14T22:09:25.098525] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-14T22:09:25.102508] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-14T22:09:25.127403] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T22:09:25.130047] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-14T22:09:25.325359] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-14T22:09:25.333883] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-14T22:09:25.666718] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-14T22:09:25.671357] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-14T22:09:25.894633] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T22:09:26.287392] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T22:09:26.358107] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-14T22:09:26.440428] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-14T22:09:26.967699] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T22:09:27.158068] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-14T22:09:27.168813] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T22:09:27.958101] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-14T22:09:28.495443] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T22:09:28.758077] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-14T22:09:28.790357] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T22:09:29.558082] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-14T22:09:29.717299] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-14T22:09:30.358086] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-14T22:09:30.718076] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T22:09:31.158156] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-14T22:09:31.507048] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T22:09:31.958119] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-14T22:09:32.137756] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T22:09:32.758118] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-14T22:09:33.192819] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-14T22:09:33.357141] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T22:09:33.359175] [INFO ] [REMOTE ] UTL: Full fetch complete (15656 records). [2025-10-14T22:09:33.359242] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-14T22:09:33.566023] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-14T22:09:33.719529] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-14T22:09:33.719622] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-14T22:09:33.719998] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-14T22:09:33.720043] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-14T22:09:33.720522] [DEBUG] [LOCAL ] UTL: Trimmed 15656 records to 11767 (keeping 200 days of data) [2025-10-14T22:09:33.789069] [DEBUG] [LOCAL ] UTL: Primary data saved (11767 records). [2025-10-14T22:09:33.789189] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-14T22:09:33.789263] [INFO ] [MAIN ] Update Progress: 2201/2369 symbols completed. UTL took 15.3s. Estimated remaining: 23m 37s. Rate: 7.1 symbols/min [2025-10-14T22:09:33.957986] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:34.003703] [DEBUG] [LOCAL ] UWMC: Loaded 52914 existing records from primary storage. [2025-10-14T22:09:34.004032] [INFO ] [MAIN ] UWMC: Loaded 52914 existing records. [2025-10-14T22:09:34.178870] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:34.179066] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-14T22:09:34.179115] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-14T22:09:34.180005] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-14T22:09:34.180061] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-14T22:09:34.365366] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-14T22:09:34.532270] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:34.630190] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-14T22:09:35.158044] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-14T22:09:35.912692] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T22:09:35.958035] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-14T22:09:36.479232] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T22:09:36.758044] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-14T22:09:37.558080] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-14T22:09:37.858878] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-14T22:09:38.358041] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-14T22:09:38.618221] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T22:09:38.687878] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T22:09:39.104976] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T22:09:39.158033] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-14T22:09:39.844637] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T22:09:39.958044] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-14T22:09:40.758083] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-14T22:09:41.095592] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T22:09:41.558076] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-14T22:09:42.284359] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:09:42.358052] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-14T22:09:42.446546] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T22:09:42.449459] [INFO ] [REMOTE ] UVE: Full fetch complete (30122 records). [2025-10-14T22:09:42.449571] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-14T22:09:42.830080] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-14T22:09:42.830147] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-14T22:09:42.830788] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-14T22:09:42.830848] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-14T22:09:42.831505] [DEBUG] [LOCAL ] UVE: Trimmed 30122 records to 21951 (keeping 200 days of data) [2025-10-14T22:09:42.962761] [DEBUG] [LOCAL ] UVE: Primary data saved (21951 records). [2025-10-14T22:09:42.962888] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-14T22:09:42.962963] [INFO ] [MAIN ] Update Progress: 2202/2369 symbols completed. UVE took 24.5s. Estimated remaining: 23m 29s. Rate: 7.1 symbols/min [2025-10-14T22:09:43.130942] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:43.138539] [DEBUG] [LOCAL ] UZD: Loaded 6333 existing records from primary storage. [2025-10-14T22:09:43.138762] [INFO ] [MAIN ] UZD: Loaded 6333 existing records. [2025-10-14T22:09:43.169091] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-14T22:09:43.322557] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:43.322923] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-14T22:09:43.323002] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-14T22:09:43.323386] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-14T22:09:43.323567] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-14T22:09:43.435340] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-14T22:09:43.691394] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:43.958098] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-14T22:09:44.659247] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T22:09:44.758047] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-14T22:09:44.961772] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-14T22:09:45.558080] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-14T22:09:45.765836] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T22:09:45.768459] [INFO ] [REMOTE ] UVV: Full fetch complete (30098 records). [2025-10-14T22:09:45.768529] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-14T22:09:46.137412] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-14T22:09:46.137509] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-14T22:09:46.138180] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-14T22:09:46.138239] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-14T22:09:46.139140] [DEBUG] [LOCAL ] UVV: Trimmed 30098 records to 22757 (keeping 200 days of data) [2025-10-14T22:09:46.275138] [DEBUG] [LOCAL ] UVV: Primary data saved (22757 records). [2025-10-14T22:09:46.275262] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-14T22:09:46.275337] [INFO ] [MAIN ] Update Progress: 2203/2369 symbols completed. UVV took 27.8s. Estimated remaining: 23m 20s. Rate: 7.1 symbols/min [2025-10-14T22:09:46.363241] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-14T22:09:46.450206] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:46.458745] [DEBUG] [LOCAL ] UZE: Loaded 7446 existing records from primary storage. [2025-10-14T22:09:46.458928] [INFO ] [MAIN ] UZE: Loaded 7446 existing records. [2025-10-14T22:09:46.641880] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:46.642208] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-14T22:09:46.642285] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-14T22:09:46.642728] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-14T22:09:46.642792] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-14T22:09:46.951760] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T22:09:47.035935] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:47.158028] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-14T22:09:47.201410] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-14T22:09:47.856674] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-14T22:09:47.958065] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-14T22:09:48.620830] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T22:09:48.758054] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-14T22:09:49.558065] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-14T22:09:50.358076] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-14T22:09:50.460634] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T22:09:51.050515] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T22:09:51.055483] [INFO ] [REMOTE ] UTZ: Full fetch complete (64688 records). [2025-10-14T22:09:51.055687] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-14T22:09:51.159779] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-14T22:09:51.373708] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T22:09:51.464123] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-14T22:09:51.464234] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-14T22:09:51.465572] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-14T22:09:51.465681] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-14T22:09:51.466992] [DEBUG] [LOCAL ] UTZ: Trimmed 64688 records to 44663 (keeping 200 days of data) [2025-10-14T22:09:51.686025] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-14T22:09:51.746488] [DEBUG] [LOCAL ] UTZ: Primary data saved (44663 records). [2025-10-14T22:09:51.746617] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-14T22:09:51.746723] [INFO ] [MAIN ] Update Progress: 2204/2369 symbols completed. UTZ took 33.3s. Estimated remaining: 23m 12s. Rate: 7.1 symbols/min [2025-10-14T22:09:51.933847] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:09:51.940964] [DEBUG] [LOCAL ] UZF: Loaded 6210 existing records from primary storage. [2025-10-14T22:09:51.941141] [INFO ] [MAIN ] UZF: Loaded 6210 existing records. [2025-10-14T22:09:51.963124] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-14T22:09:52.119479] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:09:52.119675] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-14T22:09:52.119731] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-14T22:09:52.119973] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-14T22:09:52.120028] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-14T22:09:52.466113] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:09:52.758095] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-14T22:09:53.494530] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-14T22:09:53.566283] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-14T22:09:53.586324] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T22:09:54.153909] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-14T22:09:54.358061] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-14T22:09:55.052204] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T22:09:55.158034] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-14T22:09:55.884601] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-14T22:09:55.958182] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-14T22:09:56.681107] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T22:09:56.758059] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-14T22:09:57.480149] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-14T22:09:57.558072] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-14T22:09:58.111828] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T22:09:58.358222] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-14T22:09:59.028442] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-14T22:09:59.158122] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-14T22:09:59.556346] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-14T22:09:59.958077] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-14T22:10:00.524484] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-14T22:10:00.758102] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-14T22:10:01.558070] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-14T22:10:02.142510] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T22:10:02.358105] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-14T22:10:02.930197] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T22:10:03.158092] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-14T22:10:03.420759] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-14T22:10:03.958043] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-14T22:10:04.238632] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-14T22:10:04.758072] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-14T22:10:05.342109] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-14T22:10:05.447433] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T22:10:05.558072] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-14T22:10:05.946425] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-14T22:10:06.358072] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-14T22:10:07.158068] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-14T22:10:07.541080] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-14T22:10:07.958089] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-14T22:10:08.208500] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-14T22:10:08.520370] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T22:10:08.521607] [INFO ] [REMOTE ] UZE: Full fetch complete (10001 records). [2025-10-14T22:10:08.521705] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-14T22:10:08.763208] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-14T22:10:08.913132] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-14T22:10:08.913205] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-14T22:10:08.913455] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-14T22:10:08.913493] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-14T22:10:08.913990] [DEBUG] [LOCAL ] UZE: Trimmed 10001 records to 7371 (keeping 200 days of data) [2025-10-14T22:10:08.958823] [DEBUG] [LOCAL ] UZE: Primary data saved (7371 records). [2025-10-14T22:10:08.958953] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-14T22:10:08.959033] [INFO ] [MAIN ] Update Progress: 2205/2369 symbols completed. UZE took 22.7s. Estimated remaining: 23m 4s. Rate: 7.1 symbols/min [2025-10-14T22:10:09.131127] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:09.186211] [DEBUG] [LOCAL ] V: Loaded 53753 existing records from primary storage. [2025-10-14T22:10:09.186611] [INFO ] [MAIN ] V: Loaded 53753 existing records. [2025-10-14T22:10:09.393915] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:09.394171] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-14T22:10:09.394225] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-14T22:10:09.394919] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-14T22:10:09.394980] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-14T22:10:09.558982] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-14T22:10:09.770891] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:10.162661] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-14T22:10:10.358072] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-14T22:10:10.783545] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T22:10:10.821563] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-14T22:10:11.158075] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-14T22:10:11.958093] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-14T22:10:12.398472] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-14T22:10:12.758085] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-14T22:10:13.223866] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-14T22:10:13.558073] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-14T22:10:14.305080] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T22:10:14.358084] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-14T22:10:14.494711] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T22:10:14.926149] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T22:10:15.158151] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-14T22:10:15.740177] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-14T22:10:15.958065] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-14T22:10:16.758110] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-14T22:10:17.174132] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T22:10:17.175100] [INFO ] [REMOTE ] UZD: Full fetch complete (9234 records). [2025-10-14T22:10:17.175178] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-14T22:10:17.557702] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-14T22:10:17.557829] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-14T22:10:17.558153] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-14T22:10:17.558100] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-14T22:10:17.559002] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-14T22:10:17.559432] [DEBUG] [LOCAL ] UZD: Trimmed 9234 records to 6257 (keeping 200 days of data) [2025-10-14T22:10:17.596767] [DEBUG] [LOCAL ] UZD: Primary data saved (6257 records). [2025-10-14T22:10:17.596865] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-14T22:10:17.596937] [INFO ] [MAIN ] Update Progress: 2206/2369 symbols completed. UZD took 34.6s. Estimated remaining: 22m 55s. Rate: 7.1 symbols/min [2025-10-14T22:10:17.774772] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:17.808987] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T22:10:17.842855] [DEBUG] [LOCAL ] VAC: Loaded 34246 existing records from primary storage. [2025-10-14T22:10:17.843123] [INFO ] [MAIN ] VAC: Loaded 34246 existing records. [2025-10-14T22:10:18.029247] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:18.029480] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-14T22:10:18.029534] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-14T22:10:18.030127] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-14T22:10:18.030186] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-14T22:10:18.363541] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-14T22:10:18.403205] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:19.158044] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-14T22:10:19.198960] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T22:10:19.798056] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-14T22:10:19.958102] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-14T22:10:20.527843] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-14T22:10:20.695323] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T22:10:20.701354] [INFO ] [REMOTE ] UWMC: Full fetch complete (75849 records). [2025-10-14T22:10:20.701490] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-14T22:10:20.763744] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-14T22:10:21.106775] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-14T22:10:21.107103] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-14T22:10:21.108448] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-14T22:10:21.108512] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-14T22:10:21.110111] [DEBUG] [LOCAL ] UWMC: Trimmed 75849 records to 52937 (keeping 200 days of data) [2025-10-14T22:10:21.313021] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T22:10:21.315407] [INFO ] [REMOTE ] UZF: Full fetch complete (8719 records). [2025-10-14T22:10:21.316241] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-14T22:10:21.563138] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-14T22:10:21.767972] [DEBUG] [LOCAL ] UWMC: Primary data saved (52937 records). [2025-10-14T22:10:21.790795] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-14T22:10:21.790886] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-14T22:10:21.790960] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-14T22:10:21.791069] [INFO ] [MAIN ] Update Progress: 2207/2369 symbols completed. UWMC took 48.0s. Estimated remaining: 22m 47s. Rate: 7.1 symbols/min [2025-10-14T22:10:21.802805] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-14T22:10:21.823674] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-14T22:10:21.868391] [DEBUG] [LOCAL ] UZF: Trimmed 8719 records to 6123 (keeping 200 days of data) [2025-10-14T22:10:22.002968] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:22.005950] [DEBUG] [LOCAL ] UZF: Primary data saved (6123 records). [2025-10-14T22:10:22.006157] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-14T22:10:22.006299] [INFO ] [MAIN ] Update Progress: 2208/2369 symbols completed. UZF took 30.3s. Estimated remaining: 22m 38s. Rate: 7.1 symbols/min [2025-10-14T22:10:22.208435] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:22.225585] [DEBUG] [LOCAL ] VAL: Loaded 50170 existing records from primary storage. [2025-10-14T22:10:22.225924] [INFO ] [MAIN ] VAL: Loaded 50170 existing records. [2025-10-14T22:10:22.366955] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-14T22:10:22.410389] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:22.424442] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-14T22:10:22.424519] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-14T22:10:22.425271] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-14T22:10:22.425329] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-14T22:10:22.565295] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-14T22:10:22.601512] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-14T22:10:22.943948] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:22.963277] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-14T22:10:22.964302] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-14T22:10:22.983737] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:22.984123] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-14T22:10:22.984194] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-14T22:10:23.189250] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-14T22:10:23.338770] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:23.415191] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T22:10:23.747783] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-14T22:10:23.958107] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-14T22:10:24.758127] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-14T22:10:24.961251] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T22:10:25.558083] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-14T22:10:25.790054] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T22:10:26.358070] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-14T22:10:26.785689] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-14T22:10:26.897438] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-14T22:10:27.158143] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-14T22:10:27.958116] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-14T22:10:28.505346] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-14T22:10:28.758051] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-14T22:10:29.135678] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-14T22:10:29.558042] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-14T22:10:29.604035] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-14T22:10:30.358040] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-14T22:10:30.706639] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-14T22:10:31.158044] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-14T22:10:31.820442] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-14T22:10:31.958096] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-14T22:10:32.196342] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T22:10:32.758065] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-14T22:10:32.870507] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T22:10:33.265832] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-14T22:10:33.558067] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-14T22:10:34.358054] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-14T22:10:34.479201] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-14T22:10:34.603253] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T22:10:35.158063] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-14T22:10:35.958086] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-14T22:10:36.517920] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-14T22:10:36.758079] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-14T22:10:36.854238] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T22:10:37.558067] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-14T22:10:38.048417] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T22:10:38.176736] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-14T22:10:38.358073] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-14T22:10:38.981455] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T22:10:39.158128] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-14T22:10:39.519729] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T22:10:39.958097] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-14T22:10:40.758084] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-14T22:10:40.875586] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-14T22:10:41.438362] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-14T22:10:41.558070] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-14T22:10:42.209538] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-14T22:10:42.358059] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-14T22:10:43.158053] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-14T22:10:43.698990] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-14T22:10:43.958088] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-14T22:10:44.253835] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-14T22:10:44.758110] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-14T22:10:44.899115] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-14T22:10:45.320383] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-14T22:10:45.558068] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-14T22:10:46.358111] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-14T22:10:46.913074] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T22:10:46.981537] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-14T22:10:47.158055] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-14T22:10:47.665374] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T22:10:47.958077] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-14T22:10:48.758139] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-14T22:10:49.003812] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T22:10:49.260243] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T22:10:49.558065] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-14T22:10:50.358063] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-14T22:10:50.933752] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-14T22:10:50.980250] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-14T22:10:50.986432] [INFO ] [REMOTE ] V: Full fetch complete (77928 records). [2025-10-14T22:10:50.986619] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-14T22:10:51.174994] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-14T22:10:51.524205] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-14T22:10:51.527535] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-14T22:10:51.529753] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-14T22:10:51.530452] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-14T22:10:51.533133] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-14T22:10:51.547597] [DEBUG] [LOCAL ] V: Trimmed 77928 records to 53753 (keeping 200 days of data) [2025-10-14T22:10:51.963348] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-14T22:10:51.996487] [DEBUG] [LOCAL ] V: Primary data saved (53753 records). [2025-10-14T22:10:51.996710] [INFO ] [MAIN ] V: Full history saved. [2025-10-14T22:10:51.997460] [INFO ] [MAIN ] Update Progress: 2209/2369 symbols completed. V took 43.0s. Estimated remaining: 22m 31s. Rate: 7.1 symbols/min [2025-10-14T22:10:52.276363] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:52.287143] [DEBUG] [LOCAL ] VATE: Loaded 5225 existing records from primary storage. [2025-10-14T22:10:52.287424] [INFO ] [MAIN ] VATE: Loaded 5225 existing records. [2025-10-14T22:10:52.495145] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-14T22:10:52.516106] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:52.520504] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-14T22:10:52.520566] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-14T22:10:52.520679] [INFO ] [REMOTE ] VAC: Full fetch complete (48693 records). [2025-10-14T22:10:52.520822] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-14T22:10:52.520899] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-14T22:10:52.520800] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-14T22:10:52.759868] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-14T22:10:53.254198] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:53.289263] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-14T22:10:53.289348] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-14T22:10:53.290334] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-14T22:10:53.290397] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-14T22:10:53.291524] [DEBUG] [LOCAL ] VAC: Trimmed 48693 records to 34176 (keeping 200 days of data) [2025-10-14T22:10:53.502666] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-14T22:10:53.512886] [INFO ] [REMOTE ] VAL: Full fetch complete (73232 records). [2025-10-14T22:10:53.517146] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-14T22:10:53.562848] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-14T22:10:53.694339] [DEBUG] [LOCAL ] VAC: Primary data saved (34176 records). [2025-10-14T22:10:53.697463] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-14T22:10:53.697927] [INFO ] [MAIN ] Update Progress: 2210/2369 symbols completed. VAC took 36.1s. Estimated remaining: 22m 22s. Rate: 7.1 symbols/min [2025-10-14T22:10:54.072265] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:54.110835] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-14T22:10:54.111005] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-14T22:10:54.112390] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-14T22:10:54.112452] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-14T22:10:54.117126] [DEBUG] [LOCAL ] VAL: Trimmed 73232 records to 50194 (keeping 200 days of data) [2025-10-14T22:10:54.121474] [DEBUG] [LOCAL ] VBF: Loaded 7121 existing records from primary storage. [2025-10-14T22:10:54.176543] [INFO ] [MAIN ] VBF: Loaded 7121 existing records. [2025-10-14T22:10:54.294478] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T22:10:54.371223] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-14T22:10:54.425283] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:54.429557] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-14T22:10:54.430348] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-14T22:10:54.432232] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-14T22:10:54.432376] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-14T22:10:55.028288] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:55.049380] [DEBUG] [LOCAL ] VAL: Primary data saved (50194 records). [2025-10-14T22:10:55.049543] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-14T22:10:55.049709] [INFO ] [MAIN ] Update Progress: 2211/2369 symbols completed. VAL took 33.3s. Estimated remaining: 22m 13s. Rate: 7.1 symbols/min [2025-10-14T22:10:55.165873] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-14T22:10:55.184018] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-14T22:10:55.275194] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:10:55.291784] [DEBUG] [LOCAL ] VCV: Loaded 13590 existing records from primary storage. [2025-10-14T22:10:55.292038] [INFO ] [MAIN ] VCV: Loaded 13590 existing records. [2025-10-14T22:10:55.484563] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:10:55.485122] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-14T22:10:55.485229] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-14T22:10:55.494781] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-14T22:10:55.495133] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-14T22:10:55.495197] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-14T22:10:55.842555] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-14T22:10:55.861822] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:10:55.958054] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-14T22:10:56.758082] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-14T22:10:57.031764] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T22:10:57.558059] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-14T22:10:58.341039] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T22:10:58.358034] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-14T22:10:58.599844] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-14T22:10:59.161500] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-14T22:10:59.163430] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T22:10:59.534914] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-14T22:10:59.958096] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-14T22:11:00.758086] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-14T22:11:00.924534] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-14T22:11:01.558065] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-14T22:11:02.351600] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T22:11:02.352400] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T22:11:02.358030] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-14T22:11:02.363143] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-14T22:11:02.363310] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-14T22:11:02.747659] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-14T22:11:02.747745] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-14T22:11:02.748935] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-14T22:11:02.748997] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-14T22:11:02.750369] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-14T22:11:03.068711] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-14T22:11:03.068842] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-14T22:11:03.068919] [INFO ] [MAIN ] Update Progress: 2212/2369 symbols completed. VALE took 41.1s. Estimated remaining: 22m 4s. Rate: 7.1 symbols/min [2025-10-14T22:11:03.163273] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-14T22:11:03.242605] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:03.252972] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T22:11:03.293684] [DEBUG] [LOCAL ] VEEV: Loaded 47238 existing records from primary storage. [2025-10-14T22:11:03.293986] [INFO ] [MAIN ] VEEV: Loaded 47238 existing records. [2025-10-14T22:11:03.468830] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:11:03.469052] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-14T22:11:03.469099] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-14T22:11:03.469504] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-14T22:11:03.469561] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-14T22:11:03.825013] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:03.838083] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T22:11:03.958059] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-14T22:11:04.758124] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-14T22:11:05.558068] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-14T22:11:05.580638] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T22:11:05.707439] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T22:11:06.062019] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-14T22:11:06.358116] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-14T22:11:07.158043] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-14T22:11:07.314310] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T22:11:07.827004] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T22:11:07.958144] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-14T22:11:08.592421] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T22:11:08.758096] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-14T22:11:09.367418] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T22:11:09.558119] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-14T22:11:10.358045] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-14T22:11:11.158114] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-14T22:11:11.303121] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-14T22:11:11.339522] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T22:11:11.772814] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-14T22:11:11.958124] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-14T22:11:12.758056] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-14T22:11:13.033004] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-14T22:11:13.336222] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T22:11:13.558067] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-14T22:11:14.209809] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T22:11:14.211202] [INFO ] [REMOTE ] VCV: Full fetch complete (18504 records). [2025-10-14T22:11:14.211270] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-14T22:11:14.363215] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-14T22:11:14.600745] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-14T22:11:14.600826] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-14T22:11:14.601210] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-14T22:11:14.601309] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-14T22:11:14.601981] [DEBUG] [LOCAL ] VCV: Trimmed 18504 records to 13625 (keeping 200 days of data) [2025-10-14T22:11:14.680814] [DEBUG] [LOCAL ] VCV: Primary data saved (13625 records). [2025-10-14T22:11:14.680934] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-14T22:11:14.681008] [INFO ] [MAIN ] Update Progress: 2213/2369 symbols completed. VCV took 19.6s. Estimated remaining: 21m 56s. Rate: 7.1 symbols/min [2025-10-14T22:11:14.851792] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:14.865434] [DEBUG] [LOCAL ] VEL: Loaded 12240 existing records from primary storage. [2025-10-14T22:11:14.865669] [INFO ] [MAIN ] VEL: Loaded 12240 existing records. [2025-10-14T22:11:15.047610] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:11:15.047843] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-14T22:11:15.047942] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-14T22:11:15.048171] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-14T22:11:15.048227] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-14T22:11:15.158745] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-14T22:11:15.205341] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-14T22:11:15.427900] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:15.958085] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-14T22:11:16.647034] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-14T22:11:16.646865] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-14T22:11:16.758025] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-14T22:11:17.558101] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-14T22:11:18.157232] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T22:11:18.321726] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T22:11:18.358045] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-14T22:11:19.158114] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-14T22:11:19.958051] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-14T22:11:20.081739] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T22:11:20.110633] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T22:11:20.499022] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T22:11:20.758065] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-14T22:11:21.511157] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-14T22:11:21.558031] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-14T22:11:22.358076] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-14T22:11:22.383586] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T22:11:23.158083] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-14T22:11:23.862619] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T22:11:23.958071] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-14T22:11:23.999610] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T22:11:24.736038] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T22:11:24.738102] [INFO ] [REMOTE ] VBF: Full fetch complete (10873 records). [2025-10-14T22:11:24.738186] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-14T22:11:24.763163] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-14T22:11:25.125600] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-14T22:11:25.125719] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-14T22:11:25.126008] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-14T22:11:25.126049] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-14T22:11:25.126632] [DEBUG] [LOCAL ] VBF: Trimmed 10873 records to 7171 (keeping 200 days of data) [2025-10-14T22:11:25.172875] [DEBUG] [LOCAL ] VBF: Primary data saved (7171 records). [2025-10-14T22:11:25.173014] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-14T22:11:25.173094] [INFO ] [MAIN ] Update Progress: 2214/2369 symbols completed. VBF took 31.5s. Estimated remaining: 21m 48s. Rate: 7.1 symbols/min [2025-10-14T22:11:25.345778] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:25.384893] [DEBUG] [LOCAL ] VET: Loaded 44077 existing records from primary storage. [2025-10-14T22:11:25.385189] [INFO ] [MAIN ] VET: Loaded 44077 existing records. [2025-10-14T22:11:25.586335] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:11:25.576768] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-14T22:11:25.588445] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-14T22:11:25.588378] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T22:11:25.588626] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-14T22:11:25.589411] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-14T22:11:25.591540] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-14T22:11:25.946011] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:26.358069] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-14T22:11:26.923173] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-14T22:11:27.158054] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-14T22:11:27.324094] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T22:11:27.875179] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T22:11:27.958081] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-14T22:11:28.672416] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-14T22:11:28.758072] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-14T22:11:29.278336] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T22:11:29.279475] [INFO ] [REMOTE ] VATE: Full fetch complete (10553 records). [2025-10-14T22:11:29.279549] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-14T22:11:29.563343] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-14T22:11:29.660946] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-14T22:11:29.661025] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-14T22:11:29.661287] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-14T22:11:29.661329] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-14T22:11:29.661814] [DEBUG] [LOCAL ] VATE: Trimmed 10553 records to 5216 (keeping 200 days of data) [2025-10-14T22:11:29.691181] [DEBUG] [LOCAL ] VATE: Primary data saved (5216 records). [2025-10-14T22:11:29.691313] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-14T22:11:29.691393] [INFO ] [MAIN ] Update Progress: 2215/2369 symbols completed. VATE took 37.7s. Estimated remaining: 21m 39s. Rate: 7.1 symbols/min [2025-10-14T22:11:29.858459] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:29.909792] [DEBUG] [LOCAL ] VFC: Loaded 53606 existing records from primary storage. [2025-10-14T22:11:29.910110] [INFO ] [MAIN ] VFC: Loaded 53606 existing records. [2025-10-14T22:11:30.087204] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:11:30.087406] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-14T22:11:30.087455] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-14T22:11:30.087674] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-14T22:11:30.087734] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-14T22:11:30.366566] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-14T22:11:30.446419] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:31.158093] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-14T22:11:31.744741] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T22:11:31.958083] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-14T22:11:32.159223] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-14T22:11:32.209524] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-14T22:11:32.758117] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-14T22:11:33.483431] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T22:11:33.558074] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-14T22:11:34.022371] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T22:11:34.358118] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-14T22:11:35.139030] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T22:11:35.158040] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-14T22:11:35.176805] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-14T22:11:35.958069] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-14T22:11:36.758068] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-14T22:11:36.875373] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T22:11:37.308366] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T22:11:37.461965] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T22:11:37.558043] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-14T22:11:38.358099] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-14T22:11:38.486345] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-14T22:11:39.158122] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-14T22:11:39.958077] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-14T22:11:40.052005] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T22:11:40.726371] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T22:11:40.758023] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-14T22:11:41.558103] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-14T22:11:41.826687] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T22:11:42.358083] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-14T22:11:42.386607] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T22:11:42.409829] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-14T22:11:43.158104] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-14T22:11:43.923704] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-14T22:11:43.929026] [INFO ] [REMOTE ] VEEV: Full fetch complete (68374 records). [2025-10-14T22:11:43.929139] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-14T22:11:43.963139] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-14T22:11:44.345219] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-14T22:11:44.345390] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-14T22:11:44.346709] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-14T22:11:44.346773] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-14T22:11:44.348137] [DEBUG] [LOCAL ] VEEV: Trimmed 68374 records to 47276 (keeping 200 days of data) [2025-10-14T22:11:44.592024] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-14T22:11:44.673709] [DEBUG] [LOCAL ] VEEV: Primary data saved (47276 records). [2025-10-14T22:11:44.673834] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-14T22:11:44.673909] [INFO ] [MAIN ] Update Progress: 2216/2369 symbols completed. VEEV took 41.6s. Estimated remaining: 21m 31s. Rate: 7.1 symbols/min [2025-10-14T22:11:44.767517] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-14T22:11:44.849472] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:44.849616] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-14T22:11:44.849683] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-14T22:11:44.849840] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-14T22:11:44.849902] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-14T22:11:44.849970] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-14T22:11:44.850004] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-14T22:11:45.216777] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:45.558042] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-14T22:11:45.607149] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-14T22:11:46.336745] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-14T22:11:46.358034] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-14T22:11:46.853604] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-14T22:11:47.131974] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T22:11:47.158051] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-14T22:11:47.685315] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T22:11:47.687039] [INFO ] [REMOTE ] VEL: Full fetch complete (17135 records). [2025-10-14T22:11:47.687109] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-14T22:11:47.967120] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-14T22:11:48.052825] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-14T22:11:48.052898] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-14T22:11:48.053292] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-14T22:11:48.053334] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-14T22:11:48.053874] [DEBUG] [LOCAL ] VEL: Trimmed 17135 records to 12210 (keeping 200 days of data) [2025-10-14T22:11:48.122852] [DEBUG] [LOCAL ] VEL: Primary data saved (12210 records). [2025-10-14T22:11:48.122971] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-14T22:11:48.123046] [INFO ] [MAIN ] Update Progress: 2217/2369 symbols completed. VEL took 33.4s. Estimated remaining: 21m 22s. Rate: 7.1 symbols/min [2025-10-14T22:11:48.292969] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:48.300587] [DEBUG] [LOCAL ] VGI: Loaded 5217 existing records from primary storage. [2025-10-14T22:11:48.300807] [INFO ] [MAIN ] VGI: Loaded 5217 existing records. [2025-10-14T22:11:48.479398] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:11:48.479599] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-14T22:11:48.479664] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-14T22:11:48.479820] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-14T22:11:48.479857] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-14T22:11:48.758780] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-14T22:11:48.835534] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:48.991290] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:11:48.991593] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-14T22:11:48.991703] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:11:48.991773] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-14T22:11:48.991837] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:11:48.991907] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-14T22:11:48.991984] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-14T22:11:48.992020] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-14T22:11:48.992060] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-14T22:11:48.992105] [INFO ] [MAIN ] Update Progress: 2218/2369 symbols completed. VG took 4.3s. Estimated remaining: 21m 13s. Rate: 7.1 symbols/min [2025-10-14T22:11:49.161101] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:11:49.178699] [DEBUG] [LOCAL ] VGM: Loaded 18509 existing records from primary storage. [2025-10-14T22:11:49.178923] [INFO ] [MAIN ] VGM: Loaded 18509 existing records. [2025-10-14T22:11:49.353551] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:11:49.353765] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-14T22:11:49.353822] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-14T22:11:49.354007] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-14T22:11:49.354048] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-14T22:11:49.567666] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-14T22:11:49.722807] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:11:49.763480] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T22:11:50.358100] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-14T22:11:50.636514] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-14T22:11:50.962118] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-14T22:11:51.158086] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-14T22:11:51.958130] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-14T22:11:52.153728] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-14T22:11:52.758096] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-14T22:11:53.340896] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T22:11:53.558111] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-14T22:11:53.850128] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-14T22:11:54.358047] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-14T22:11:54.597257] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T22:11:55.158068] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-14T22:11:55.958047] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-14T22:11:56.079425] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-14T22:11:56.578536] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-14T22:11:56.758069] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-14T22:11:57.528293] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T22:11:57.558031] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-14T22:11:58.358084] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-14T22:11:58.707486] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-14T22:11:59.158797] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-14T22:11:59.162309] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-14T22:11:59.189302] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T22:11:59.958056] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-14T22:12:00.262090] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-14T22:12:00.758122] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-14T22:12:01.462213] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-14T22:12:01.558089] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-14T22:12:01.881002] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-14T22:12:02.358110] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-14T22:12:02.644475] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T22:12:03.158105] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-14T22:12:03.813367] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T22:12:03.819575] [INFO ] [REMOTE ] VFC: Full fetch complete (77750 records). [2025-10-14T22:12:03.819797] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-14T22:12:03.963256] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-14T22:12:04.223581] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-14T22:12:04.223687] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-14T22:12:04.224877] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-14T22:12:04.224975] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-14T22:12:04.226475] [DEBUG] [LOCAL ] VFC: Trimmed 77750 records to 53605 (keeping 200 days of data) [2025-10-14T22:12:04.508002] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-14T22:12:04.621485] [DEBUG] [LOCAL ] VFC: Primary data saved (53605 records). [2025-10-14T22:12:04.621631] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-14T22:12:04.621747] [INFO ] [MAIN ] Update Progress: 2219/2369 symbols completed. VFC took 34.9s. Estimated remaining: 21m 5s. Rate: 7.1 symbols/min [2025-10-14T22:12:04.762856] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-14T22:12:04.818128] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:04.824398] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T22:12:04.832426] [DEBUG] [LOCAL ] VHI: Loaded 2756 existing records from primary storage. [2025-10-14T22:12:04.832592] [INFO ] [MAIN ] VHI: Loaded 2756 existing records. [2025-10-14T22:12:05.011897] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:05.012095] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-14T22:12:05.012143] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-14T22:12:05.012274] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-14T22:12:05.012314] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-14T22:12:05.370583] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:05.558052] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-14T22:12:06.182256] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T22:12:06.281109] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T22:12:06.286204] [INFO ] [REMOTE ] VET: Full fetch complete (64661 records). [2025-10-14T22:12:06.286302] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-14T22:12:06.363235] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-14T22:12:06.670016] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-14T22:12:06.670099] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-14T22:12:06.671343] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-14T22:12:06.671416] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-14T22:12:06.672743] [DEBUG] [LOCAL ] VET: Trimmed 64661 records to 44140 (keeping 200 days of data) [2025-10-14T22:12:06.931680] [DEBUG] [LOCAL ] VET: Primary data saved (44140 records). [2025-10-14T22:12:06.931908] [INFO ] [MAIN ] VET: Full history saved. [2025-10-14T22:12:06.932060] [INFO ] [MAIN ] Update Progress: 2220/2369 symbols completed. VET took 41.8s. Estimated remaining: 20m 57s. Rate: 7.1 symbols/min [2025-10-14T22:12:07.002404] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T22:12:07.111676] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:07.111837] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-14T22:12:07.111874] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-14T22:12:07.111981] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-14T22:12:07.112021] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-14T22:12:07.112061] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-14T22:12:07.112091] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-14T22:12:07.164742] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-14T22:12:07.472671] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:07.908885] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-14T22:12:07.958038] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-14T22:12:08.540485] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T22:12:08.758202] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-14T22:12:09.558055] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-14T22:12:09.648729] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T22:12:09.756575] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:12:09.756932] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-14T22:12:09.757024] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:12:09.757071] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-14T22:12:09.757105] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:12:09.757143] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-14T22:12:09.757197] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-14T22:12:09.757231] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-14T22:12:09.757270] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-14T22:12:09.757315] [INFO ] [MAIN ] Update Progress: 2221/2369 symbols completed. VIA took 2.8s. Estimated remaining: 20m 48s. Rate: 7.1 symbols/min [2025-10-14T22:12:09.926162] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:09.974046] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-14T22:12:09.974339] [INFO ] [MAIN ] VICI: Loaded 53653 existing records. [2025-10-14T22:12:10.152275] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:10.152485] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-14T22:12:10.152581] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-14T22:12:10.152988] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-14T22:12:10.153045] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-14T22:12:10.364266] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-14T22:12:10.502963] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:10.977497] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-14T22:12:11.158092] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-14T22:12:11.958094] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-14T22:12:12.414069] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-14T22:12:12.758123] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-14T22:12:13.062510] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-14T22:12:13.111275] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-14T22:12:13.558067] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-14T22:12:14.358064] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-14T22:12:14.574939] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T22:12:14.947100] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-14T22:12:15.158083] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-14T22:12:15.683146] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-14T22:12:15.958097] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-14T22:12:16.530957] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-14T22:12:16.758053] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-14T22:12:17.558053] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-14T22:12:17.599880] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-14T22:12:17.602439] [INFO ] [REMOTE ] VGM: Full fetch complete (25999 records). [2025-10-14T22:12:17.602523] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-14T22:12:17.993888] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-14T22:12:17.993966] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-14T22:12:17.994493] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-14T22:12:17.994531] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-14T22:12:17.995197] [DEBUG] [LOCAL ] VGM: Trimmed 25999 records to 18483 (keeping 200 days of data) [2025-10-14T22:12:18.104171] [DEBUG] [LOCAL ] VGM: Primary data saved (18483 records). [2025-10-14T22:12:18.104322] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-14T22:12:18.104399] [INFO ] [MAIN ] Update Progress: 2222/2369 symbols completed. VGM took 29.1s. Estimated remaining: 20m 39s. Rate: 7.1 symbols/min [2025-10-14T22:12:18.195241] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T22:12:18.289675] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:18.344346] [DEBUG] [LOCAL ] VIK: Loaded 52445 existing records from primary storage. [2025-10-14T22:12:18.344744] [INFO ] [MAIN ] VIK: Loaded 52445 existing records. [2025-10-14T22:12:18.364971] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-14T22:12:18.522503] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:18.522718] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-14T22:12:18.522772] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-14T22:12:18.523234] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-14T22:12:18.523286] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-14T22:12:18.881595] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:19.158090] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-14T22:12:19.958049] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-14T22:12:20.024737] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-14T22:12:20.503461] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-14T22:12:20.758043] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-14T22:12:20.842505] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T22:12:21.337763] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-14T22:12:21.558096] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-14T22:12:22.114754] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T22:12:22.358116] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-14T22:12:23.158124] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-14T22:12:23.764311] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T22:12:23.864038] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T22:12:23.958075] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-14T22:12:24.758106] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-14T22:12:25.558074] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-14T22:12:26.004949] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-14T22:12:26.163894] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T22:12:26.248632] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-14T22:12:26.358096] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-14T22:12:27.158105] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-14T22:12:27.871898] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-14T22:12:27.958067] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-14T22:12:28.750982] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T22:12:28.761482] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-14T22:12:29.192919] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-14T22:12:29.236902] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-14T22:12:29.558069] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-14T22:12:30.024312] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-14T22:12:30.025251] [INFO ] [REMOTE ] VHI: Full fetch complete (4364 records). [2025-10-14T22:12:30.025323] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-14T22:12:30.360289] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-14T22:12:30.383486] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-14T22:12:30.383571] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-14T22:12:30.383758] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-14T22:12:30.383819] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-14T22:12:30.384227] [DEBUG] [LOCAL ] VHI: Trimmed 4364 records to 2770 (keeping 200 days of data) [2025-10-14T22:12:30.401580] [DEBUG] [LOCAL ] VHI: Primary data saved (2770 records). [2025-10-14T22:12:30.401725] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-14T22:12:30.401823] [INFO ] [MAIN ] Update Progress: 2223/2369 symbols completed. VHI took 25.8s. Estimated remaining: 20m 31s. Rate: 7.1 symbols/min [2025-10-14T22:12:30.568516] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:30.618522] [DEBUG] [LOCAL ] VIPS: Loaded 51246 existing records from primary storage. [2025-10-14T22:12:30.618875] [INFO ] [MAIN ] VIPS: Loaded 51246 existing records. [2025-10-14T22:12:30.794379] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:30.794580] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-14T22:12:30.794626] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-14T22:12:30.795021] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-14T22:12:30.795069] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-14T22:12:31.161337] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-14T22:12:31.165354] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:31.958098] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-14T22:12:32.340227] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-14T22:12:32.758125] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-14T22:12:32.856330] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T22:12:33.290586] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T22:12:33.558057] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-14T22:12:34.266990] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T22:12:34.358032] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-14T22:12:34.818218] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T22:12:35.158065] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-14T22:12:35.873631] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-14T22:12:35.958035] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-14T22:12:36.443721] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T22:12:36.758068] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-14T22:12:37.558106] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-14T22:12:37.604713] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T22:12:38.164288] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T22:12:38.287679] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-14T22:12:38.358085] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-14T22:12:38.922051] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T22:12:38.923186] [INFO ] [REMOTE ] VGI: Full fetch complete (7663 records). [2025-10-14T22:12:38.923259] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-14T22:12:39.163293] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-14T22:12:39.332479] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-14T22:12:39.332554] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-14T22:12:39.332799] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-14T22:12:39.332858] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-14T22:12:39.333237] [DEBUG] [LOCAL ] VGI: Trimmed 7663 records to 5203 (keeping 200 days of data) [2025-10-14T22:12:39.363243] [DEBUG] [LOCAL ] VGI: Primary data saved (5203 records). [2025-10-14T22:12:39.363351] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-14T22:12:39.363426] [INFO ] [MAIN ] Update Progress: 2224/2369 symbols completed. VGI took 51.2s. Estimated remaining: 20m 23s. Rate: 7.1 symbols/min [2025-10-14T22:12:39.542796] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:39.593202] [DEBUG] [LOCAL ] VIRT: Loaded 46744 existing records from primary storage. [2025-10-14T22:12:39.593705] [INFO ] [MAIN ] VIRT: Loaded 46744 existing records. [2025-10-14T22:12:39.804893] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:39.805218] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-14T22:12:39.805297] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-14T22:12:39.806006] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-14T22:12:39.806065] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-14T22:12:39.963186] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-14T22:12:40.177962] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:40.758068] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-14T22:12:41.004377] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T22:12:41.558067] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-14T22:12:41.752145] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T22:12:42.221074] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T22:12:42.358049] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-14T22:12:43.150940] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T22:12:43.159174] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-14T22:12:43.274882] [DEBUG] [REMOTE ] VIPS: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-14T22:12:43.275194] [WARN ] [REMOTE ] VIPS: No data returned for month 2025-04 [2025-10-14T22:12:43.275284] [FATAL] [REMOTE ] VIPS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:12:43.275357] [FATAL] [MAIN ] VIPS: Failed to fetch primary data. [2025-10-14T22:12:43.275418] [WARN ] [MAIN ] VIPS: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:12:43.275488] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-14T22:12:43.275548] [DEBUG] [LOCAL ] VIPS: No primary data file found to delete. [2025-10-14T22:12:43.275586] [INFO ] [LOCAL ] VIPS: Starting deletion of derivative data. [2025-10-14T22:12:43.275805] [DEBUG] [LOCAL ] VIPS: Deleted derivative data file. [2025-10-14T22:12:43.275886] [INFO ] [MAIN ] Update Progress: 2225/2369 symbols completed. VIPS took 12.9s. Estimated remaining: 20m 14s. Rate: 7.1 symbols/min [2025-10-14T22:12:43.443704] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:43.485312] [DEBUG] [LOCAL ] VIST: Loaded 46429 existing records from primary storage. [2025-10-14T22:12:43.485633] [INFO ] [MAIN ] VIST: Loaded 46429 existing records. [2025-10-14T22:12:43.663796] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:43.663980] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-14T22:12:43.664025] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-14T22:12:43.664251] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-14T22:12:43.664291] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-14T22:12:43.972797] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-14T22:12:44.026132] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:44.059608] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T22:12:44.758056] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-14T22:12:45.368013] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-14T22:12:45.373834] [INFO ] [REMOTE ] VICI: Full fetch complete (77798 records). [2025-10-14T22:12:45.373946] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-14T22:12:45.571903] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-14T22:12:45.781748] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-14T22:12:45.781868] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-14T22:12:45.783198] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-14T22:12:45.783280] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-14T22:12:45.807255] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-14T22:12:45.815914] [DEBUG] [LOCAL ] VICI: Trimmed 77798 records to 53653 (keeping 200 days of data) [2025-10-14T22:12:46.134771] [DEBUG] [LOCAL ] VICI: Primary data saved (53653 records). [2025-10-14T22:12:46.134899] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-14T22:12:46.135016] [INFO ] [MAIN ] Update Progress: 2226/2369 symbols completed. VICI took 36.4s. Estimated remaining: 20m 5s. Rate: 7.1 symbols/min [2025-10-14T22:12:46.302096] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:46.343305] [DEBUG] [LOCAL ] VIV: Loaded 44909 existing records from primary storage. [2025-10-14T22:12:46.343608] [INFO ] [MAIN ] VIV: Loaded 44909 existing records. [2025-10-14T22:12:46.368764] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-14T22:12:46.527915] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:46.528172] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-14T22:12:46.528232] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-14T22:12:46.529122] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-14T22:12:46.529182] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-14T22:12:46.893795] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:47.115484] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T22:12:47.158024] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-14T22:12:47.958068] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-14T22:12:48.338110] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T22:12:48.451033] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-14T22:12:48.758142] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-14T22:12:49.374492] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-14T22:12:49.558106] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-14T22:12:50.182052] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T22:12:50.358119] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-14T22:12:51.158055] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-14T22:12:51.270497] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-14T22:12:51.595517] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-14T22:12:51.601289] [INFO ] [REMOTE ] VIK: Full fetch complete (76052 records). [2025-10-14T22:12:51.601422] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-14T22:12:51.971538] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-14T22:12:51.995168] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-14T22:12:51.996183] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-14T22:12:51.997403] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-14T22:12:51.997566] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-14T22:12:51.999035] [DEBUG] [LOCAL ] VIK: Trimmed 76052 records to 52466 (keeping 200 days of data) [2025-10-14T22:12:52.305723] [DEBUG] [LOCAL ] VIK: Primary data saved (52466 records). [2025-10-14T22:12:52.305892] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-14T22:12:52.305998] [INFO ] [MAIN ] Update Progress: 2227/2369 symbols completed. VIK took 34.2s. Estimated remaining: 19m 57s. Rate: 7.1 symbols/min [2025-10-14T22:12:52.485272] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:12:52.502715] [DEBUG] [LOCAL ] VKQ: Loaded 17504 existing records from primary storage. [2025-10-14T22:12:52.502952] [INFO ] [MAIN ] VKQ: Loaded 17504 existing records. [2025-10-14T22:12:52.684211] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:12:52.684457] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-14T22:12:52.684576] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-14T22:12:52.684881] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-14T22:12:52.684952] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-14T22:12:52.761068] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-14T22:12:52.927367] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T22:12:53.160220] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:12:53.558077] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-14T22:12:53.841128] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-14T22:12:54.346464] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T22:12:54.358027] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-14T22:12:54.512078] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-14T22:12:55.158114] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-14T22:12:55.878391] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T22:12:55.958045] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-14T22:12:56.758075] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-14T22:12:56.838064] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T22:12:56.857223] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T22:12:57.558129] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-14T22:12:58.260994] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T22:12:58.358120] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-14T22:12:58.972894] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T22:12:59.158085] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-14T22:12:59.521031] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-14T22:12:59.958082] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-14T22:13:00.758138] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-14T22:13:00.920856] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T22:13:01.558093] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-14T22:13:01.695562] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T22:13:01.723373] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T22:13:02.358099] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-14T22:13:02.957290] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T22:13:03.158110] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-14T22:13:03.299142] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-14T22:13:03.958062] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-14T22:13:04.598043] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T22:13:04.758085] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-14T22:13:05.066923] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-14T22:13:05.558057] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-14T22:13:06.228597] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T22:13:06.358104] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-14T22:13:06.634500] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-14T22:13:07.158060] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-14T22:13:07.701284] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T22:13:07.958099] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-14T22:13:08.758097] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-14T22:13:08.892738] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T22:13:09.294743] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T22:13:09.558092] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-14T22:13:10.358126] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-14T22:13:10.432573] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T22:13:10.988520] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-14T22:13:10.993957] [INFO ] [REMOTE ] VIRT: Full fetch complete (67460 records). [2025-10-14T22:13:10.994080] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-14T22:13:11.166992] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-14T22:13:11.159703] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-14T22:13:11.405514] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-14T22:13:11.405599] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-14T22:13:11.406724] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-14T22:13:11.406786] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-14T22:13:11.408183] [DEBUG] [LOCAL ] VIRT: Trimmed 67460 records to 46659 (keeping 200 days of data) [2025-10-14T22:13:11.691921] [DEBUG] [LOCAL ] VIRT: Primary data saved (46659 records). [2025-10-14T22:13:11.692054] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-14T22:13:11.692134] [INFO ] [MAIN ] Update Progress: 2228/2369 symbols completed. VIRT took 32.3s. Estimated remaining: 19m 49s. Rate: 7.1 symbols/min [2025-10-14T22:13:11.886746] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:11.916257] [DEBUG] [LOCAL ] VLN: Loaded 30394 existing records from primary storage. [2025-10-14T22:13:11.916553] [INFO ] [MAIN ] VLN: Loaded 30394 existing records. [2025-10-14T22:13:11.963312] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-14T22:13:12.098611] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:12.098837] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-14T22:13:12.098884] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-14T22:13:12.099119] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-14T22:13:12.099158] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-14T22:13:12.451714] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:12.669130] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T22:13:12.758030] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-14T22:13:13.558057] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-14T22:13:13.643320] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T22:13:14.295910] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T22:13:14.318313] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-14T22:13:14.358058] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-14T22:13:15.158039] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-14T22:13:15.363314] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-14T22:13:15.958074] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-14T22:13:16.758065] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-14T22:13:16.851069] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T22:13:16.879134] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T22:13:17.558071] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-14T22:13:18.330327] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T22:13:18.358032] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-14T22:13:18.516145] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T22:13:18.521809] [INFO ] [REMOTE ] VIST: Full fetch complete (67053 records). [2025-10-14T22:13:18.521973] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-14T22:13:18.920282] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-14T22:13:18.920374] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-14T22:13:18.921678] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-14T22:13:18.921743] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-14T22:13:18.923172] [DEBUG] [LOCAL ] VIST: Trimmed 67053 records to 46457 (keeping 200 days of data) [2025-10-14T22:13:19.159011] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-14T22:13:19.198596] [DEBUG] [LOCAL ] VIST: Primary data saved (46457 records). [2025-10-14T22:13:19.198869] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-14T22:13:19.198960] [INFO ] [MAIN ] Update Progress: 2229/2369 symbols completed. VIST took 35.9s. Estimated remaining: 19m 41s. Rate: 7.1 symbols/min [2025-10-14T22:13:19.378249] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:19.432594] [DEBUG] [LOCAL ] VLO: Loaded 53046 existing records from primary storage. [2025-10-14T22:13:19.432978] [INFO ] [MAIN ] VLO: Loaded 53046 existing records. [2025-10-14T22:13:19.624776] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:19.625108] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-14T22:13:19.625164] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-14T22:13:19.625588] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-14T22:13:19.625675] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-14T22:13:19.959554] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-14T22:13:19.961529] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-14T22:13:20.053771] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:20.639158] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-14T22:13:20.758082] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-14T22:13:20.977287] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T22:13:21.558069] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-14T22:13:22.039737] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T22:13:22.358084] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-14T22:13:23.158041] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-14T22:13:23.190162] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T22:13:23.238008] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-14T22:13:23.240375] [INFO ] [REMOTE ] VKQ: Full fetch complete (24462 records). [2025-10-14T22:13:23.240463] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-14T22:13:23.613298] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-14T22:13:23.613366] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-14T22:13:23.613868] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-14T22:13:23.613928] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-14T22:13:23.614525] [DEBUG] [LOCAL ] VKQ: Trimmed 24462 records to 17557 (keeping 200 days of data) [2025-10-14T22:13:23.717788] [DEBUG] [LOCAL ] VKQ: Primary data saved (17557 records). [2025-10-14T22:13:23.717949] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-14T22:13:23.718036] [INFO ] [MAIN ] Update Progress: 2230/2369 symbols completed. VKQ took 31.4s. Estimated remaining: 19m 32s. Rate: 7.1 symbols/min [2025-10-14T22:13:23.888756] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:23.924912] [DEBUG] [LOCAL ] VLRS: Loaded 39975 existing records from primary storage. [2025-10-14T22:13:23.925189] [INFO ] [MAIN ] VLRS: Loaded 39975 existing records. [2025-10-14T22:13:23.963225] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-14T22:13:24.112709] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:24.112920] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-14T22:13:24.112967] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-14T22:13:24.113307] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-14T22:13:24.113380] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-14T22:13:24.448714] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-14T22:13:24.552800] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:24.758063] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-14T22:13:25.558064] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-14T22:13:25.725915] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T22:13:26.175709] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T22:13:26.196767] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T22:13:26.358052] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-14T22:13:27.158133] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-14T22:13:27.683272] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-14T22:13:27.958055] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-14T22:13:28.514053] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T22:13:28.519115] [INFO ] [REMOTE ] VIV: Full fetch complete (64534 records). [2025-10-14T22:13:28.519220] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-14T22:13:28.759525] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-14T22:13:28.910184] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-14T22:13:28.910273] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-14T22:13:28.911371] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-14T22:13:28.911434] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-14T22:13:28.912736] [DEBUG] [LOCAL ] VIV: Trimmed 64534 records to 44865 (keeping 200 days of data) [2025-10-14T22:13:29.180514] [DEBUG] [LOCAL ] VIV: Primary data saved (44865 records). [2025-10-14T22:13:29.180636] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-14T22:13:29.180760] [INFO ] [MAIN ] Update Progress: 2231/2369 symbols completed. VIV took 43.0s. Estimated remaining: 19m 23s. Rate: 7.1 symbols/min [2025-10-14T22:13:29.278818] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T22:13:29.377262] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:29.383991] [DEBUG] [LOCAL ] VLT: Loaded 4440 existing records from primary storage. [2025-10-14T22:13:29.384170] [INFO ] [MAIN ] VLT: Loaded 4440 existing records. [2025-10-14T22:13:29.555786] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:29.555955] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-14T22:13:29.556005] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-14T22:13:29.556198] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-14T22:13:29.556255] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-14T22:13:29.567309] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-14T22:13:29.907991] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:30.225683] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-14T22:13:30.358043] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-14T22:13:31.158086] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-14T22:13:31.424556] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-14T22:13:31.522681] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T22:13:31.958085] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-14T22:13:32.245425] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T22:13:32.758112] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-14T22:13:33.292717] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T22:13:33.491246] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-14T22:13:33.558049] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-14T22:13:34.350762] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T22:13:34.358056] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-14T22:13:34.964040] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T22:13:35.158066] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-14T22:13:35.958054] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-14T22:13:36.651595] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-14T22:13:36.758029] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-14T22:13:37.073437] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T22:13:37.401960] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-14T22:13:37.558073] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-14T22:13:37.966479] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-14T22:13:38.358051] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-14T22:13:39.158076] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-14T22:13:39.721519] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T22:13:39.958067] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-14T22:13:40.090887] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T22:13:40.517013] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-14T22:13:40.758066] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-14T22:13:41.319998] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-14T22:13:41.558071] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-14T22:13:42.358080] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-14T22:13:42.946697] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T22:13:43.109019] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-14T22:13:43.158050] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-14T22:13:43.750396] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T22:13:43.958069] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-14T22:13:44.758060] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-14T22:13:45.291827] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-14T22:13:45.293303] [INFO ] [REMOTE ] VLT: Full fetch complete (7510 records). [2025-10-14T22:13:45.293390] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-14T22:13:45.558938] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-14T22:13:45.755599] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-14T22:13:45.755742] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-14T22:13:45.755989] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-14T22:13:45.756030] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-14T22:13:45.756719] [DEBUG] [LOCAL ] VLT: Trimmed 7510 records to 4433 (keeping 200 days of data) [2025-10-14T22:13:45.797825] [DEBUG] [LOCAL ] VLT: Primary data saved (4433 records). [2025-10-14T22:13:45.798062] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-14T22:13:45.798280] [INFO ] [MAIN ] Update Progress: 2232/2369 symbols completed. VLT took 16.6s. Estimated remaining: 19m 15s. Rate: 7.1 symbols/min [2025-10-14T22:13:46.066456] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:46.122667] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-14T22:13:46.195394] [DEBUG] [LOCAL ] VLTO: Loaded 46167 existing records from primary storage. [2025-10-14T22:13:46.195829] [INFO ] [MAIN ] VLTO: Loaded 46167 existing records. [2025-10-14T22:13:46.366037] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-14T22:13:46.411125] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:46.411491] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-14T22:13:46.411539] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-14T22:13:46.412003] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-14T22:13:46.412063] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-14T22:13:46.766544] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:46.975757] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-14T22:13:47.158061] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-14T22:13:47.958085] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-14T22:13:47.997025] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-14T22:13:48.594297] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-14T22:13:48.758075] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-14T22:13:49.558050] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-14T22:13:49.905828] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-14T22:13:50.123632] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-14T22:13:50.358057] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-14T22:13:50.504701] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-14T22:13:51.158078] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-14T22:13:51.374364] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-14T22:13:51.379286] [INFO ] [REMOTE ] VLN: Full fetch complete (43648 records). [2025-10-14T22:13:51.379437] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-14T22:13:51.810137] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-14T22:13:51.810242] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-14T22:13:51.811474] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-14T22:13:51.811537] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-14T22:13:51.812943] [DEBUG] [LOCAL ] VLN: Trimmed 43648 records to 30586 (keeping 200 days of data) [2025-10-14T22:13:51.960231] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-14T22:13:52.003831] [DEBUG] [LOCAL ] VLN: Primary data saved (30586 records). [2025-10-14T22:13:52.003953] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-14T22:13:52.004052] [INFO ] [MAIN ] Update Progress: 2233/2369 symbols completed. VLN took 40.3s. Estimated remaining: 19m 7s. Rate: 7.1 symbols/min [2025-10-14T22:13:52.201678] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:52.246221] [DEBUG] [LOCAL ] VMC: Loaded 42665 existing records from primary storage. [2025-10-14T22:13:52.246517] [INFO ] [MAIN ] VMC: Loaded 42665 existing records. [2025-10-14T22:13:52.425402] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:52.425635] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-14T22:13:52.425720] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-14T22:13:52.426094] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-14T22:13:52.426134] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-14T22:13:52.766526] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-14T22:13:52.796131] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:52.837442] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T22:13:53.355691] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-14T22:13:53.558048] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-14T22:13:54.055725] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T22:13:54.358088] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-14T22:13:55.158127] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-14T22:13:55.310380] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-14T22:13:55.314519] [INFO ] [REMOTE ] VLRS: Full fetch complete (58441 records). [2025-10-14T22:13:55.314614] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-14T22:13:55.706014] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-14T22:13:55.706171] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-14T22:13:55.707230] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-14T22:13:55.707452] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-14T22:13:55.708842] [DEBUG] [LOCAL ] VLRS: Trimmed 58441 records to 39894 (keeping 200 days of data) [2025-10-14T22:13:55.739777] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-14T22:13:55.958686] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-14T22:13:55.973014] [DEBUG] [LOCAL ] VLRS: Primary data saved (39894 records). [2025-10-14T22:13:55.973510] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-14T22:13:55.973614] [INFO ] [MAIN ] Update Progress: 2234/2369 symbols completed. VLRS took 32.3s. Estimated remaining: 18m 58s. Rate: 7.1 symbols/min [2025-10-14T22:13:56.141294] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:13:56.159002] [DEBUG] [LOCAL ] VMI: Loaded 15102 existing records from primary storage. [2025-10-14T22:13:56.159296] [INFO ] [MAIN ] VMI: Loaded 15102 existing records. [2025-10-14T22:13:56.344305] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:13:56.344687] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-14T22:13:56.344774] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-14T22:13:56.345118] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-14T22:13:56.345172] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-14T22:13:56.730022] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:13:56.752587] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T22:13:56.761300] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-14T22:13:57.558069] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-14T22:13:57.645562] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-14T22:13:58.363753] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-14T22:13:58.382192] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T22:13:59.154971] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T22:13:59.164157] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-14T22:13:59.175372] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T22:13:59.958064] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-14T22:14:00.680188] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T22:14:00.758034] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-14T22:14:01.558064] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-14T22:14:02.011823] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-14T22:14:02.358081] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-14T22:14:02.501088] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T22:14:02.952227] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-14T22:14:03.094840] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T22:14:03.158027] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-14T22:14:03.958068] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-14T22:14:04.627859] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T22:14:04.633710] [INFO ] [REMOTE ] VLO: Full fetch complete (76987 records). [2025-10-14T22:14:04.633907] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-14T22:14:04.761421] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-14T22:14:05.052750] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-14T22:14:05.052948] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-14T22:14:05.054206] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-14T22:14:05.054291] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-14T22:14:05.080334] [DEBUG] [LOCAL ] VLO: Trimmed 76987 records to 53039 (keeping 200 days of data) [2025-10-14T22:14:05.081184] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T22:14:05.417933] [DEBUG] [LOCAL ] VLO: Primary data saved (53039 records). [2025-10-14T22:14:05.418075] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-14T22:14:05.418886] [INFO ] [MAIN ] Update Progress: 2235/2369 symbols completed. VLO took 46.2s. Estimated remaining: 18m 50s. Rate: 7.1 symbols/min [2025-10-14T22:14:05.567496] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-14T22:14:05.593710] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:14:05.618600] [DEBUG] [LOCAL ] VMO: Loaded 20797 existing records from primary storage. [2025-10-14T22:14:05.618897] [INFO ] [MAIN ] VMO: Loaded 20797 existing records. [2025-10-14T22:14:05.797548] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:14:05.797850] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-14T22:14:05.797930] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-14T22:14:05.798202] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-14T22:14:05.798259] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-14T22:14:06.173075] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:14:06.358079] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-14T22:14:06.446798] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T22:14:06.563824] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-14T22:14:07.158062] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-14T22:14:07.958039] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-14T22:14:08.057330] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-14T22:14:08.163690] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T22:14:08.762051] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-14T22:14:08.766289] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T22:14:09.558067] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-14T22:14:10.358066] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-14T22:14:10.491803] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T22:14:10.539708] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T22:14:11.158115] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-14T22:14:11.820024] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T22:14:11.940302] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-14T22:14:11.958047] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-14T22:14:12.758052] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-14T22:14:12.995124] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-14T22:14:13.558075] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-14T22:14:14.358101] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-14T22:14:14.397114] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T22:14:14.459481] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-14T22:14:15.158059] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-14T22:14:15.927514] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T22:14:15.958027] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-14T22:14:16.289407] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T22:14:16.758106] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-14T22:14:17.521139] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T22:14:17.558032] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-14T22:14:18.358116] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-14T22:14:18.398500] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T22:14:19.159248] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-14T22:14:19.173868] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T22:14:19.399412] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-14T22:14:19.958042] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-14T22:14:20.243224] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T22:14:20.758094] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-14T22:14:21.522574] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T22:14:21.558035] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-14T22:14:21.633550] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T22:14:21.817802] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-14T22:14:21.822194] [INFO ] [REMOTE ] VMC: Full fetch complete (62217 records). [2025-10-14T22:14:21.822309] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-14T22:14:22.205685] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-14T22:14:22.205770] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-14T22:14:22.206818] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-14T22:14:22.206879] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-14T22:14:22.208066] [DEBUG] [LOCAL ] VMC: Trimmed 62217 records to 42613 (keeping 200 days of data) [2025-10-14T22:14:22.383566] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-14T22:14:22.472616] [DEBUG] [LOCAL ] VMC: Primary data saved (42613 records). [2025-10-14T22:14:22.472760] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-14T22:14:22.473343] [INFO ] [MAIN ] Update Progress: 2236/2369 symbols completed. VMC took 30.5s. Estimated remaining: 18m 42s. Rate: 7.1 symbols/min [2025-10-14T22:14:22.645048] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:14:22.655564] [DEBUG] [LOCAL ] VNCE: Loaded 8785 existing records from primary storage. [2025-10-14T22:14:22.655796] [INFO ] [MAIN ] VNCE: Loaded 8785 existing records. [2025-10-14T22:14:22.832813] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:14:22.833023] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-14T22:14:22.833069] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-14T22:14:22.833285] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-14T22:14:22.833342] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-14T22:14:23.163822] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-14T22:14:23.194789] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:14:23.499323] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-14T22:14:23.958138] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-14T22:14:24.734338] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-14T22:14:24.758041] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-14T22:14:24.789460] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-14T22:14:25.558113] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-14T22:14:26.358043] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-14T22:14:26.465765] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-14T22:14:26.518058] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-14T22:14:27.158038] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-14T22:14:27.380477] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T22:14:27.958040] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-14T22:14:28.035325] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-14T22:14:28.758064] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-14T22:14:28.946870] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-14T22:14:29.558068] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-14T22:14:30.031629] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T22:14:30.104832] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-14T22:14:30.110180] [INFO ] [REMOTE ] VLTO: Full fetch complete (67193 records). [2025-10-14T22:14:30.110354] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-14T22:14:30.363168] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-14T22:14:30.500838] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-14T22:14:30.500910] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-14T22:14:30.502013] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-14T22:14:30.502073] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-14T22:14:30.503280] [DEBUG] [LOCAL ] VLTO: Trimmed 67193 records to 46185 (keeping 200 days of data) [2025-10-14T22:14:30.800840] [DEBUG] [LOCAL ] VLTO: Primary data saved (46185 records). [2025-10-14T22:14:30.800973] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-14T22:14:30.801054] [INFO ] [MAIN ] Update Progress: 2237/2369 symbols completed. VLTO took 45.0s. Estimated remaining: 18m 33s. Rate: 7.1 symbols/min [2025-10-14T22:14:31.158054] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-14T22:14:31.360465] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-14T22:14:31.958083] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-14T22:14:32.103049] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-14T22:14:32.106131] [INFO ] [REMOTE ] VMO: Full fetch complete (31101 records). [2025-10-14T22:14:32.106208] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-14T22:14:32.536681] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-14T22:14:32.536768] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-14T22:14:32.537375] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-14T22:14:32.537414] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-14T22:14:32.538309] [DEBUG] [LOCAL ] VMO: Trimmed 31101 records to 20806 (keeping 200 days of data) [2025-10-14T22:14:32.664434] [DEBUG] [LOCAL ] VMO: Primary data saved (20806 records). [2025-10-14T22:14:32.664543] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-14T22:14:32.664614] [INFO ] [MAIN ] Update Progress: 2238/2369 symbols completed. VMO took 27.2s. Estimated remaining: 18m 24s. Rate: 7.1 symbols/min [2025-10-14T22:14:32.749240] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-14T22:14:32.758031] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-14T22:14:33.406518] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T22:14:33.408418] [INFO ] [REMOTE ] VMI: Full fetch complete (21104 records). [2025-10-14T22:14:33.408487] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-14T22:14:33.565333] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-14T22:14:33.779146] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-14T22:14:33.779221] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-14T22:14:33.779678] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-14T22:14:33.779738] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-14T22:14:33.780278] [DEBUG] [LOCAL ] VMI: Trimmed 21104 records to 15080 (keeping 200 days of data) [2025-10-14T22:14:33.873359] [DEBUG] [LOCAL ] VMI: Primary data saved (15080 records). [2025-10-14T22:14:33.873489] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-14T22:14:33.873564] [INFO ] [MAIN ] Update Progress: 2239/2369 symbols completed. VMI took 37.9s. Estimated remaining: 18m 16s. Rate: 7.1 symbols/min [2025-10-14T22:14:34.532914] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-14T22:14:34.535745] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-14T22:14:35.135785] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-14T22:14:35.158072] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-14T22:14:35.782670] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-14T22:14:35.958084] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-14T22:14:36.573271] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-14T22:14:36.758105] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-14T22:14:37.464190] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-14T22:14:37.558061] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-14T22:14:38.171282] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-14T22:14:38.358146] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-14T22:14:38.894490] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-14T22:14:39.158135] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-14T22:14:40.452815] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T22:14:40.458854] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-14T22:14:41.603394] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-14T22:14:41.606399] [INFO ] [REMOTE ] VNCE: Full fetch complete (15658 records). [2025-10-14T22:14:41.606475] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-14T22:14:42.021022] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-14T22:14:42.021099] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-14T22:14:42.021460] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-14T22:14:42.021500] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-14T22:14:42.022001] [DEBUG] [LOCAL ] VNCE: Trimmed 15658 records to 8930 (keeping 200 days of data) [2025-10-14T22:14:42.076467] [DEBUG] [LOCAL ] VNCE: Primary data saved (8930 records). [2025-10-14T22:14:42.076592] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-14T22:14:42.076698] [INFO ] [MAIN ] Update Progress: 2240/2369 symbols completed. VNCE took 19.6s. Estimated remaining: 18m 7s. Rate: 7.1 symbols/min [2025-10-14T22:14:42.746725] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:14:42.726607] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:14:42.783124] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:14:42.858155] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:14:42.863058] [DEBUG] [LOCAL ] VOC: Loaded 9019 existing records from primary storage. [2025-10-14T22:14:42.863497] [INFO ] [MAIN ] VOC: Loaded 9019 existing records. [2025-10-14T22:14:43.098800] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:14:43.095081] [DEBUG] [LOCAL ] VOYA: Loaded 42227 existing records from primary storage. [2025-10-14T22:14:43.100068] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-14T22:14:43.100288] [INFO ] [MAIN ] VOYA: Loaded 42227 existing records. [2025-10-14T22:14:43.105977] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-14T22:14:43.147388] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-14T22:14:43.167864] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-14T22:14:43.217487] [DEBUG] [LOCAL ] VNT: Loaded 43883 existing records from primary storage. [2025-10-14T22:14:43.233224] [DEBUG] [LOCAL ] VNO: Loaded 48943 existing records from primary storage. [2025-10-14T22:14:43.265785] [INFO ] [MAIN ] VNT: Loaded 43883 existing records. [2025-10-14T22:14:43.272151] [INFO ] [MAIN ] VNO: Loaded 48943 existing records. [2025-10-14T22:14:43.696682] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:14:43.712966] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-14T22:14:43.715615] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-14T22:14:43.795730] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-14T22:14:43.872616] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:14:43.872763] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-14T22:14:44.046338] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:14:44.038730] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-14T22:14:44.080786] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-14T22:14:44.086510] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-14T22:14:44.091828] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-14T22:14:44.153899] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-14T22:14:44.153841] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-14T22:14:44.154080] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-14T22:14:44.168773] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-14T22:14:44.348476] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:14:44.380689] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-14T22:14:45.028329] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:14:45.093385] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-14T22:14:45.167828] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T22:14:45.216639] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:14:45.239154] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-14T22:14:45.230291] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-14T22:14:45.262750] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:14:45.263912] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-14T22:14:46.056894] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T22:14:46.059543] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-14T22:14:46.705018] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-14T22:14:46.714313] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-14T22:14:46.830388] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-14T22:14:46.840343] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-14T22:14:46.897320] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T22:14:46.898968] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T22:14:47.158062] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-14T22:14:47.958068] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-14T22:14:48.252417] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T22:14:48.322994] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T22:14:48.444146] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-14T22:14:48.758055] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-14T22:14:48.828449] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-14T22:14:49.558108] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-14T22:14:50.274824] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T22:14:50.358041] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-14T22:14:50.388400] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T22:14:51.158126] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-14T22:14:51.924284] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-14T22:14:51.958067] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-14T22:14:52.701780] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-14T22:14:52.758027] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-14T22:14:53.511462] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T22:14:53.558025] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-14T22:14:53.893589] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T22:14:54.358106] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-14T22:14:54.795892] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-14T22:14:54.867716] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-14T22:14:55.158133] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-14T22:14:55.958125] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-14T22:14:56.758085] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-14T22:14:56.809099] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T22:14:57.558086] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-14T22:14:57.595904] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-14T22:14:58.305212] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-14T22:14:58.358056] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-14T22:14:58.384345] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-14T22:14:59.158090] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-14T22:14:59.954842] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T22:14:59.964169] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-14T22:14:59.987182] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-14T22:15:00.758095] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-14T22:15:01.558073] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-14T22:15:01.625335] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T22:15:02.358087] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-14T22:15:02.512733] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-14T22:15:02.538303] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-14T22:15:03.158154] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-14T22:15:03.928353] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T22:15:03.958081] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-14T22:15:04.041539] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T22:15:04.401751] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-14T22:15:04.403179] [INFO ] [REMOTE ] VOC: Full fetch complete (13192 records). [2025-10-14T22:15:04.403253] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-14T22:15:04.778922] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-14T22:15:04.779121] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-14T22:15:04.769775] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-14T22:15:04.779522] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-14T22:15:04.779775] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-14T22:15:04.781135] [DEBUG] [LOCAL ] VOC: Trimmed 13192 records to 9019 (keeping 200 days of data) [2025-10-14T22:15:04.834684] [DEBUG] [LOCAL ] VOC: Primary data saved (9019 records). [2025-10-14T22:15:04.834824] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-14T22:15:04.834907] [INFO ] [MAIN ] Update Progress: 2241/2369 symbols completed. VOC took 22.7s. Estimated remaining: 17m 60s. Rate: 7.1 symbols/min [2025-10-14T22:15:05.010476] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:05.010703] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-14T22:15:05.010755] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-14T22:15:05.010868] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-14T22:15:05.010911] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-14T22:15:05.010953] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-14T22:15:05.010985] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-14T22:15:05.371807] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:05.558061] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-14T22:15:05.754024] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:15:05.754377] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-14T22:15:05.754505] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:15:05.754555] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-14T22:15:05.754587] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:15:05.754675] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-14T22:15:05.754763] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-14T22:15:05.754817] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-14T22:15:05.754859] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-14T22:15:05.754904] [INFO ] [MAIN ] Update Progress: 2242/2369 symbols completed. VOYG took 0.9s. Estimated remaining: 17m 51s. Rate: 7.1 symbols/min [2025-10-14T22:15:05.926334] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:05.943830] [DEBUG] [LOCAL ] VPG: Loaded 17099 existing records from primary storage. [2025-10-14T22:15:05.944048] [INFO ] [MAIN ] VPG: Loaded 17099 existing records. [2025-10-14T22:15:06.119029] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:15:06.119249] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-14T22:15:06.119295] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-14T22:15:06.119773] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-14T22:15:06.119843] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-14T22:15:06.363367] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-14T22:15:06.483688] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:06.514479] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-14T22:15:07.158069] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-14T22:15:07.760981] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-14T22:15:07.958145] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-14T22:15:08.081945] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-14T22:15:08.758129] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-14T22:15:09.304206] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-14T22:15:09.339261] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-14T22:15:09.558072] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-14T22:15:10.358125] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-14T22:15:10.383973] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T22:15:11.158074] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-14T22:15:11.958067] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-14T22:15:12.056496] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-14T22:15:12.250052] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T22:15:12.758141] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-14T22:15:13.491767] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-14T22:15:13.509367] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-14T22:15:13.558038] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-14T22:15:14.358062] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-14T22:15:14.763130] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T22:15:15.158079] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-14T22:15:15.958044] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-14T22:15:16.123849] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-14T22:15:16.275981] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-14T22:15:16.758128] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-14T22:15:17.310698] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T22:15:17.315840] [INFO ] [REMOTE ] VNT: Full fetch complete (63809 records). [2025-10-14T22:15:17.315930] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-14T22:15:17.569231] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-14T22:15:17.697948] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-14T22:15:17.698023] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-14T22:15:17.699075] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-14T22:15:17.699134] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-14T22:15:17.700679] [DEBUG] [LOCAL ] VNT: Trimmed 63809 records to 43921 (keeping 200 days of data) [2025-10-14T22:15:17.961847] [DEBUG] [LOCAL ] VNT: Primary data saved (43921 records). [2025-10-14T22:15:17.961935] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-14T22:15:17.962010] [INFO ] [MAIN ] Update Progress: 2243/2369 symbols completed. VNT took 35.9s. Estimated remaining: 17m 43s. Rate: 7.1 symbols/min [2025-10-14T22:15:18.125667] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-14T22:15:18.164562] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:18.171550] [DEBUG] [LOCAL ] VPV: Loaded 5439 existing records from primary storage. [2025-10-14T22:15:18.171735] [INFO ] [MAIN ] VPV: Loaded 5439 existing records. [2025-10-14T22:15:18.350161] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:15:18.350378] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-14T22:15:18.350426] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-14T22:15:18.350551] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-14T22:15:18.350588] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-14T22:15:18.363314] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-14T22:15:18.651889] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-14T22:15:18.719758] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:19.158141] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-14T22:15:19.755431] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T22:15:19.776361] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T22:15:19.958098] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-14T22:15:20.758148] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-14T22:15:20.948928] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T22:15:21.558060] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-14T22:15:22.298780] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T22:15:22.358622] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-14T22:15:22.358297] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-14T22:15:23.158055] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-14T22:15:23.241143] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-14T22:15:23.958078] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-14T22:15:24.235050] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-14T22:15:24.239983] [INFO ] [REMOTE ] VOYA: Full fetch complete (61761 records). [2025-10-14T22:15:24.240110] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-14T22:15:24.558068] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T22:15:24.633399] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-14T22:15:24.633466] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-14T22:15:24.634537] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-14T22:15:24.634598] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-14T22:15:24.635770] [DEBUG] [LOCAL ] VOYA: Trimmed 61761 records to 42230 (keeping 200 days of data) [2025-10-14T22:15:24.758243] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-14T22:15:24.891954] [DEBUG] [LOCAL ] VOYA: Primary data saved (42230 records). [2025-10-14T22:15:24.892072] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-14T22:15:24.892145] [INFO ] [MAIN ] Update Progress: 2244/2369 symbols completed. VOYA took 42.8s. Estimated remaining: 17m 34s. Rate: 7.1 symbols/min [2025-10-14T22:15:25.063046] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:25.097238] [DEBUG] [LOCAL ] VRE: Loaded 35162 existing records from primary storage. [2025-10-14T22:15:25.097497] [INFO ] [MAIN ] VRE: Loaded 35162 existing records. [2025-10-14T22:15:25.280768] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:15:25.281074] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-14T22:15:25.281120] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-14T22:15:25.281308] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-14T22:15:25.281366] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-14T22:15:25.564311] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-14T22:15:25.633458] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T22:15:25.657714] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:26.358120] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-14T22:15:27.158080] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-14T22:15:27.340294] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T22:15:27.676201] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T22:15:27.871424] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-14T22:15:27.873292] [INFO ] [REMOTE ] VPG: Full fetch complete (22745 records). [2025-10-14T22:15:27.873361] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-14T22:15:27.963227] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-14T22:15:28.249966] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-14T22:15:28.250038] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-14T22:15:28.250503] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-14T22:15:28.250540] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-14T22:15:28.251223] [DEBUG] [LOCAL ] VPG: Trimmed 22745 records to 17069 (keeping 200 days of data) [2025-10-14T22:15:28.349705] [DEBUG] [LOCAL ] VPG: Primary data saved (17069 records). [2025-10-14T22:15:28.349830] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-14T22:15:28.349905] [INFO ] [MAIN ] Update Progress: 2245/2369 symbols completed. VPG took 22.6s. Estimated remaining: 17m 25s. Rate: 7.1 symbols/min [2025-10-14T22:15:28.522892] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:28.574524] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-14T22:15:28.574918] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-14T22:15:28.764325] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:15:28.764429] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-14T22:15:28.765404] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-14T22:15:28.765482] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-14T22:15:28.765811] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-14T22:15:28.765884] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-14T22:15:29.092072] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-14T22:15:29.157028] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:29.425461] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-14T22:15:29.558122] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-14T22:15:30.358055] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-14T22:15:31.158082] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-14T22:15:31.848603] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T22:15:31.853909] [INFO ] [REMOTE ] VNO: Full fetch complete (70472 records). [2025-10-14T22:15:31.854038] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-14T22:15:31.959476] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-14T22:15:32.255493] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T22:15:32.282596] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-14T22:15:32.283541] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-14T22:15:32.284882] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-14T22:15:32.285010] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-14T22:15:32.315762] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-10-14T22:15:32.314409] [DEBUG] [LOCAL ] VNO: Trimmed 70472 records to 48953 (keeping 200 days of data) [2025-10-14T22:15:32.606057] [DEBUG] [LOCAL ] VNO: Primary data saved (48953 records). [2025-10-14T22:15:32.606182] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-14T22:15:32.606258] [INFO ] [MAIN ] Update Progress: 2246/2369 symbols completed. VNO took 50.5s. Estimated remaining: 17m 17s. Rate: 7.1 symbols/min [2025-10-14T22:15:32.777065] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:32.774583] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-14T22:15:32.784511] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-14T22:15:32.795507] [DEBUG] [LOCAL ] VRTS: Loaded 9348 existing records from primary storage. [2025-10-14T22:15:32.795806] [INFO ] [MAIN ] VRTS: Loaded 9348 existing records. [2025-10-14T22:15:32.996522] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:15:32.996755] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-14T22:15:32.996804] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-14T22:15:32.997019] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-14T22:15:32.997075] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-14T22:15:33.350444] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:33.558030] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-14T22:15:34.154784] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-14T22:15:34.358066] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-14T22:15:34.963549] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T22:15:35.131937] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-14T22:15:35.158027] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-14T22:15:35.958073] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-14T22:15:36.758093] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-14T22:15:37.110873] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T22:15:37.358485] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T22:15:37.549550] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-14T22:15:37.559341] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-14T22:15:38.201527] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T22:15:38.358070] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-14T22:15:39.158078] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-14T22:15:39.573908] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-14T22:15:39.958091] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-14T22:15:40.702475] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-14T22:15:40.758027] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-14T22:15:41.318139] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-14T22:15:41.372040] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-14T22:15:41.558055] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-14T22:15:42.358042] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-14T22:15:42.966692] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-14T22:15:43.158077] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-14T22:15:43.899377] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-14T22:15:43.958056] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-14T22:15:44.267431] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-14T22:15:44.758076] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-14T22:15:45.214209] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T22:15:45.294508] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T22:15:45.295726] [INFO ] [REMOTE ] VPV: Full fetch complete (9093 records). [2025-10-14T22:15:45.295798] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-14T22:15:45.563223] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-14T22:15:45.651526] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-14T22:15:45.651605] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-14T22:15:45.651813] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-14T22:15:45.651878] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-14T22:15:45.652301] [DEBUG] [LOCAL ] VPV: Trimmed 9093 records to 5452 (keeping 200 days of data) [2025-10-14T22:15:45.683629] [DEBUG] [LOCAL ] VPV: Primary data saved (5452 records). [2025-10-14T22:15:45.683729] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-14T22:15:45.683802] [INFO ] [MAIN ] Update Progress: 2247/2369 symbols completed. VPV took 27.7s. Estimated remaining: 17m 8s. Rate: 7.1 symbols/min [2025-10-14T22:15:45.852459] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:15:45.906461] [DEBUG] [LOCAL ] VSCO: Loaded 52734 existing records from primary storage. [2025-10-14T22:15:45.906783] [INFO ] [MAIN ] VSCO: Loaded 52734 existing records. [2025-10-14T22:15:46.088586] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:15:46.088875] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-14T22:15:46.088927] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-14T22:15:46.089161] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-14T22:15:46.089225] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-14T22:15:46.231168] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-14T22:15:46.363245] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-14T22:15:46.512084] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:15:47.158116] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-14T22:15:47.792547] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T22:15:47.958073] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-14T22:15:48.033917] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-14T22:15:48.758120] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-14T22:15:49.558081] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-14T22:15:50.352407] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T22:15:50.360854] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-14T22:15:50.802863] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-14T22:15:50.858968] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-14T22:15:51.158038] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-14T22:15:51.829047] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-14T22:15:51.958126] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-14T22:15:52.758100] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-14T22:15:52.920791] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T22:15:53.155383] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-14T22:15:53.558044] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-14T22:15:54.042243] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T22:15:54.358065] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-14T22:15:54.434454] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T22:15:55.158079] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-14T22:15:55.958113] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-14T22:15:56.010968] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-14T22:15:56.758097] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-14T22:15:56.982974] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-14T22:15:57.558071] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-14T22:15:57.596475] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T22:15:58.358069] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-14T22:15:58.441418] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T22:15:59.158091] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-14T22:15:59.294668] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T22:15:59.958039] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-14T22:16:00.139552] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-14T22:16:00.628933] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-14T22:16:00.630290] [INFO ] [REMOTE ] VRTS: Full fetch complete (11573 records). [2025-10-14T22:16:00.630357] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-14T22:16:00.762482] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-14T22:16:01.009672] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-14T22:16:01.009851] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-14T22:16:01.010272] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-14T22:16:01.010358] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-14T22:16:01.011117] [DEBUG] [LOCAL ] VRTS: Trimmed 11573 records to 9357 (keeping 200 days of data) [2025-10-14T22:16:01.090467] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-14T22:16:01.114457] [DEBUG] [LOCAL ] VRTS: Primary data saved (9357 records). [2025-10-14T22:16:01.114599] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-14T22:16:01.114704] [INFO ] [MAIN ] Update Progress: 2248/2369 symbols completed. VRTS took 28.5s. Estimated remaining: 17m 0s. Rate: 7.1 symbols/min [2025-10-14T22:16:01.283992] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:01.329387] [DEBUG] [LOCAL ] VSH: Loaded 48189 existing records from primary storage. [2025-10-14T22:16:01.329735] [INFO ] [MAIN ] VSH: Loaded 48189 existing records. [2025-10-14T22:16:01.512906] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:01.513121] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-14T22:16:01.513167] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-14T22:16:01.513357] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-14T22:16:01.513412] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-14T22:16:01.568165] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-14T22:16:01.873480] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:02.117571] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T22:16:02.121935] [INFO ] [REMOTE ] VRE: Full fetch complete (48428 records). [2025-10-14T22:16:02.122070] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-14T22:16:02.370080] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-14T22:16:02.536604] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-14T22:16:02.536717] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-14T22:16:02.537689] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-14T22:16:02.537749] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-14T22:16:02.538925] [DEBUG] [LOCAL ] VRE: Trimmed 48428 records to 35222 (keeping 200 days of data) [2025-10-14T22:16:02.749753] [DEBUG] [LOCAL ] VRE: Primary data saved (35222 records). [2025-10-14T22:16:02.749880] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-14T22:16:02.749956] [INFO ] [MAIN ] Update Progress: 2249/2369 symbols completed. VRE took 37.9s. Estimated remaining: 16m 52s. Rate: 7.1 symbols/min [2025-10-14T22:16:02.918379] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:02.975627] [DEBUG] [LOCAL ] VST: Loaded 53712 existing records from primary storage. [2025-10-14T22:16:02.975951] [INFO ] [MAIN ] VST: Loaded 53712 existing records. [2025-10-14T22:16:03.159442] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:03.159550] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-14T22:16:03.160536] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-14T22:16:03.160610] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-14T22:16:03.161120] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-14T22:16:03.161179] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-14T22:16:03.536593] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:03.566197] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T22:16:03.958080] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-14T22:16:04.226849] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-14T22:16:04.758081] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-14T22:16:05.558062] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-14T22:16:05.948608] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-14T22:16:06.323176] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-14T22:16:06.358039] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-14T22:16:06.619240] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T22:16:07.163969] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-14T22:16:07.169413] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-14T22:16:07.958114] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-14T22:16:08.531856] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-14T22:16:08.537797] [INFO ] [REMOTE ] VRT: Full fetch complete (77932 records). [2025-10-14T22:16:08.537950] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-14T22:16:08.763587] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-14T22:16:08.947230] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-14T22:16:08.947409] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-14T22:16:08.948686] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-14T22:16:08.948759] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-14T22:16:08.950460] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 53753 (keeping 200 days of data) [2025-10-14T22:16:09.075772] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-14T22:16:09.333169] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-14T22:16:09.333299] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-14T22:16:09.333374] [INFO ] [MAIN ] Update Progress: 2250/2369 symbols completed. VRT took 41.0s. Estimated remaining: 16m 43s. Rate: 7.1 symbols/min [2025-10-14T22:16:09.503082] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:09.503250] [DEBUG] [LOCAL ] VSTS: No existing data file found in primary storage. [2025-10-14T22:16:09.503288] [WARN ] [MAIN ] VSTS: No existing data found, performing full refresh instead. [2025-10-14T22:16:09.503397] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-14T22:16:09.503438] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-14T22:16:09.503478] [DEBUG] [LOCAL ] VSTS: No primary data file found to delete. [2025-10-14T22:16:09.503511] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-14T22:16:09.565101] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-14T22:16:09.854834] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:10.081677] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T22:16:10.358085] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-14T22:16:10.716335] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-14T22:16:11.158087] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-14T22:16:11.427862] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T22:16:11.834533] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T22:16:11.958068] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-14T22:16:12.758101] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-14T22:16:12.911359] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-14T22:16:13.558152] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-14T22:16:13.995723] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-14T22:16:14.358108] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-14T22:16:14.818793] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T22:16:15.164591] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-14T22:16:15.183589] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-14T22:16:15.958038] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-14T22:16:16.093951] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T22:16:16.758135] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-14T22:16:16.842006] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T22:16:17.558105] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-14T22:16:17.820346] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T22:16:18.358125] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-14T22:16:19.158074] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-14T22:16:19.338596] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-14T22:16:19.470008] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-14T22:16:19.614599] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-14T22:16:19.958065] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-14T22:16:20.758101] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-14T22:16:20.846188] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T22:16:21.204204] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-14T22:16:21.558047] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-14T22:16:22.008840] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-14T22:16:22.358101] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-14T22:16:23.158125] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-14T22:16:23.274321] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-14T22:16:23.280309] [INFO ] [REMOTE ] VSCO: Full fetch complete (76409 records). [2025-10-14T22:16:23.280424] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-14T22:16:23.677214] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-14T22:16:23.677287] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-14T22:16:23.678536] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-14T22:16:23.678597] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-14T22:16:23.680047] [DEBUG] [LOCAL ] VSCO: Trimmed 76409 records to 52743 (keeping 200 days of data) [2025-10-14T22:16:23.962240] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-14T22:16:23.986324] [DEBUG] [LOCAL ] VSCO: Primary data saved (52743 records). [2025-10-14T22:16:23.986409] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-14T22:16:23.986479] [INFO ] [MAIN ] Update Progress: 2251/2369 symbols completed. VSCO took 38.3s. Estimated remaining: 16m 35s. Rate: 7.1 symbols/min [2025-10-14T22:16:24.191876] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:24.198850] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T22:16:24.250987] [DEBUG] [LOCAL ] VTEX: Loaded 43014 existing records from primary storage. [2025-10-14T22:16:24.251303] [INFO ] [MAIN ] VTEX: Loaded 43014 existing records. [2025-10-14T22:16:24.436040] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:24.436273] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-14T22:16:24.436320] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-14T22:16:24.436578] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-14T22:16:24.436637] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-14T22:16:24.763225] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-14T22:16:24.792190] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:25.558079] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-14T22:16:25.752510] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-14T22:16:25.790357] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-14T22:16:26.358111] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-14T22:16:26.481971] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T22:16:26.754555] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T22:16:27.158173] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-14T22:16:27.968869] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-14T22:16:27.975121] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T22:16:28.758123] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-14T22:16:28.800794] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T22:16:29.558060] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-14T22:16:30.358076] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-14T22:16:30.639689] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-14T22:16:30.717230] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-14T22:16:31.038000] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T22:16:31.158095] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-14T22:16:31.958052] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-14T22:16:32.040076] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T22:16:32.446132] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T22:16:32.758079] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-14T22:16:33.558072] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-14T22:16:34.320787] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T22:16:34.363258] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-14T22:16:34.380167] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-14T22:16:35.028357] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T22:16:35.033773] [INFO ] [REMOTE ] VSH: Full fetch complete (70853 records). [2025-10-14T22:16:35.033925] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-14T22:16:35.163194] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-14T22:16:35.478969] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-14T22:16:35.479065] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-14T22:16:35.480344] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-14T22:16:35.480413] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-14T22:16:35.481908] [DEBUG] [LOCAL ] VSH: Trimmed 70853 records to 48180 (keeping 200 days of data) [2025-10-14T22:16:35.754054] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-14T22:16:35.834373] [DEBUG] [LOCAL ] VSH: Primary data saved (48180 records). [2025-10-14T22:16:35.834539] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-14T22:16:35.834664] [INFO ] [MAIN ] Update Progress: 2252/2369 symbols completed. VSH took 34.7s. Estimated remaining: 16m 27s. Rate: 7.1 symbols/min [2025-10-14T22:16:35.960471] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-14T22:16:36.033225] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:36.092609] [DEBUG] [LOCAL ] VTLE: Loaded 48154 existing records from primary storage. [2025-10-14T22:16:36.093008] [INFO ] [MAIN ] VTLE: Loaded 48154 existing records. [2025-10-14T22:16:36.272014] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:36.272262] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-14T22:16:36.272312] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-14T22:16:36.272785] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-14T22:16:36.272843] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-14T22:16:36.629134] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:36.731488] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-14T22:16:36.758055] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-14T22:16:37.558071] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-14T22:16:37.661508] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T22:16:38.251601] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T22:16:38.358064] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-14T22:16:38.948620] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T22:16:39.158050] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-14T22:16:39.958126] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-14T22:16:40.655857] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-14T22:16:40.692425] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-14T22:16:40.758071] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-14T22:16:41.486864] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T22:16:41.494199] [INFO ] [REMOTE ] VSTS: Full fetch complete (69763 records). [2025-10-14T22:16:41.494517] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-14T22:16:41.563507] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-14T22:16:42.067726] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-14T22:16:42.067848] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-14T22:16:42.069463] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-14T22:16:42.069540] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-14T22:16:42.071062] [DEBUG] [LOCAL ] VSTS: Trimmed 69763 records to 48940 (keeping 200 days of data) [2025-10-14T22:16:42.358297] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-14T22:16:42.368977] [DEBUG] [LOCAL ] VSTS: Primary data saved (48940 records). [2025-10-14T22:16:42.369133] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-14T22:16:42.369215] [INFO ] [MAIN ] Update Progress: 2253/2369 symbols completed. VSTS took 33.0s. Estimated remaining: 16m 18s. Rate: 7.1 symbols/min [2025-10-14T22:16:42.537783] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:42.555974] [DEBUG] [LOCAL ] VTMX: Loaded 17610 existing records from primary storage. [2025-10-14T22:16:42.556226] [INFO ] [MAIN ] VTMX: Loaded 17610 existing records. [2025-10-14T22:16:42.741608] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:42.741894] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-14T22:16:42.741942] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-14T22:16:42.742144] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-14T22:16:42.742203] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-14T22:16:43.110634] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:43.158061] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-14T22:16:43.212429] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-14T22:16:43.249571] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-14T22:16:43.501869] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T22:16:43.927903] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T22:16:43.958044] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-14T22:16:44.636979] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-14T22:16:44.758078] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-14T22:16:45.558078] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-14T22:16:45.887804] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T22:16:46.358067] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-14T22:16:47.158112] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-14T22:16:47.958074] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-14T22:16:48.039760] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T22:16:48.163371] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-14T22:16:48.185848] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T22:16:48.758045] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-14T22:16:49.194006] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-14T22:16:49.558076] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-14T22:16:50.358050] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-14T22:16:50.471249] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-14T22:16:50.878457] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-14T22:16:50.953680] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T22:16:50.959830] [INFO ] [REMOTE ] VST: Full fetch complete (77889 records). [2025-10-14T22:16:50.959997] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-14T22:16:51.163278] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-14T22:16:51.357920] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-14T22:16:51.358022] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-14T22:16:51.359243] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-14T22:16:51.359309] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-14T22:16:51.360947] [DEBUG] [LOCAL ] VST: Trimmed 77889 records to 53711 (keeping 200 days of data) [2025-10-14T22:16:51.695192] [DEBUG] [LOCAL ] VST: Primary data saved (53711 records). [2025-10-14T22:16:51.695320] [INFO ] [MAIN ] VST: Full history saved. [2025-10-14T22:16:51.696065] [INFO ] [MAIN ] Update Progress: 2254/2369 symbols completed. VST took 48.9s. Estimated remaining: 16m 10s. Rate: 7.1 symbols/min [2025-10-14T22:16:51.864995] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:51.874609] [DEBUG] [LOCAL ] VTN: Loaded 6997 existing records from primary storage. [2025-10-14T22:16:51.874839] [INFO ] [MAIN ] VTN: Loaded 6997 existing records. [2025-10-14T22:16:51.964503] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-14T22:16:52.052145] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:52.052338] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-14T22:16:52.052384] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-14T22:16:52.052527] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-14T22:16:52.052564] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-14T22:16:52.405166] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:52.492197] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T22:16:52.758136] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-14T22:16:53.429607] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-14T22:16:53.434369] [INFO ] [REMOTE ] VTEX: Full fetch complete (60687 records). [2025-10-14T22:16:53.434473] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-14T22:16:53.572497] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-14T22:16:53.819107] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-14T22:16:53.819184] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-14T22:16:53.820391] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-14T22:16:53.820455] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-14T22:16:53.821696] [DEBUG] [LOCAL ] VTEX: Trimmed 60687 records to 42979 (keeping 200 days of data) [2025-10-14T22:16:54.064423] [DEBUG] [LOCAL ] VTEX: Primary data saved (42979 records). [2025-10-14T22:16:54.064547] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-14T22:16:54.064623] [INFO ] [MAIN ] Update Progress: 2255/2369 symbols completed. VTEX took 30.1s. Estimated remaining: 16m 1s. Rate: 7.1 symbols/min [2025-10-14T22:16:54.250059] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:16:54.280005] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T22:16:54.322042] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T22:16:54.322743] [DEBUG] [LOCAL ] VTOL: Loaded 19518 existing records from primary storage. [2025-10-14T22:16:54.329159] [INFO ] [MAIN ] VTOL: Loaded 19518 existing records. [2025-10-14T22:16:54.363299] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-14T22:16:54.539314] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:16:54.539481] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-14T22:16:54.539530] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-14T22:16:54.539781] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-14T22:16:54.539839] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-14T22:16:54.901943] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:16:55.158045] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-14T22:16:55.473239] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T22:16:55.958067] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-14T22:16:56.017171] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-14T22:16:56.758062] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-14T22:16:56.883879] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T22:16:57.558061] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-14T22:16:57.757692] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T22:16:58.358107] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-14T22:16:59.161057] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-14T22:16:59.162948] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T22:16:59.212296] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T22:16:59.657372] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T22:16:59.958083] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-14T22:17:00.758059] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-14T22:17:00.963551] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-14T22:17:01.558093] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-14T22:17:01.775753] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-14T22:17:02.358151] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-14T22:17:03.134630] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-14T22:17:03.158027] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-14T22:17:03.345221] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-14T22:17:03.958115] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-14T22:17:04.082149] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-14T22:17:04.758066] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-14T22:17:04.945618] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T22:17:04.947858] [INFO ] [REMOTE ] VTMX: Full fetch complete (25619 records). [2025-10-14T22:17:04.947972] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-14T22:17:05.319664] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-14T22:17:05.319756] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-14T22:17:05.320278] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-14T22:17:05.320317] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-14T22:17:05.321099] [DEBUG] [LOCAL ] VTMX: Trimmed 25619 records to 17622 (keeping 200 days of data) [2025-10-14T22:17:05.429568] [DEBUG] [LOCAL ] VTMX: Primary data saved (17622 records). [2025-10-14T22:17:05.429745] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-14T22:17:05.429842] [INFO ] [MAIN ] Update Progress: 2256/2369 symbols completed. VTMX took 23.1s. Estimated remaining: 15m 53s. Rate: 7.1 symbols/min [2025-10-14T22:17:05.571414] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-14T22:17:05.606882] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:05.656112] [DEBUG] [LOCAL ] VTR: Loaded 52772 existing records from primary storage. [2025-10-14T22:17:05.656498] [INFO ] [MAIN ] VTR: Loaded 52772 existing records. [2025-10-14T22:17:05.835528] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:05.835827] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-14T22:17:05.835878] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-14T22:17:05.836265] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-14T22:17:05.836325] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-14T22:17:06.211721] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:06.359103] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-14T22:17:06.363097] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T22:17:06.470045] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T22:17:07.158103] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-14T22:17:07.818376] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-14T22:17:07.891450] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-14T22:17:07.958092] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-14T22:17:08.644273] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-14T22:17:08.758113] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-14T22:17:09.558059] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-14T22:17:09.747616] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-14T22:17:10.358081] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-14T22:17:11.158124] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-14T22:17:11.202123] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T22:17:11.500930] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-14T22:17:11.958105] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-14T22:17:12.758070] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-14T22:17:12.859604] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T22:17:13.436506] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-14T22:17:13.442412] [INFO ] [REMOTE ] VTLE: Full fetch complete (68784 records). [2025-10-14T22:17:13.442688] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-14T22:17:13.558938] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-14T22:17:13.900353] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-14T22:17:13.900548] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-14T22:17:13.901750] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-14T22:17:13.901866] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-14T22:17:13.916345] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T22:17:13.916497] [DEBUG] [LOCAL ] VTLE: Trimmed 68784 records to 48088 (keeping 200 days of data) [2025-10-14T22:17:14.198846] [DEBUG] [LOCAL ] VTLE: Primary data saved (48088 records). [2025-10-14T22:17:14.198988] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-14T22:17:14.199069] [INFO ] [MAIN ] Update Progress: 2257/2369 symbols completed. VTLE took 38.4s. Estimated remaining: 15m 44s. Rate: 7.1 symbols/min [2025-10-14T22:17:14.361807] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-14T22:17:14.354622] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-14T22:17:14.384948] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:14.416114] [DEBUG] [LOCAL ] VTS: Loaded 30006 existing records from primary storage. [2025-10-14T22:17:14.416394] [INFO ] [MAIN ] VTS: Loaded 30006 existing records. [2025-10-14T22:17:14.598257] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:14.598483] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-14T22:17:14.598529] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-14T22:17:14.599079] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-14T22:17:14.599138] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-14T22:17:14.948471] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:15.158096] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-14T22:17:15.958047] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-14T22:17:16.045548] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T22:17:16.303949] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-14T22:17:16.718247] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-14T22:17:16.758063] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-14T22:17:17.558062] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-14T22:17:18.358069] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-14T22:17:18.680242] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T22:17:18.859017] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-14T22:17:19.158047] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-14T22:17:19.551198] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-14T22:17:19.958078] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-14T22:17:20.183801] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-14T22:17:20.726257] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T22:17:20.758086] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-14T22:17:21.558065] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-14T22:17:21.873450] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T22:17:22.358074] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-14T22:17:22.432785] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-14T22:17:23.158051] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-14T22:17:23.323563] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-14T22:17:23.958078] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-14T22:17:24.099181] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-14T22:17:24.758042] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-14T22:17:24.804452] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T22:17:24.806576] [INFO ] [REMOTE ] VTOL: Full fetch complete (26047 records). [2025-10-14T22:17:24.806686] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-14T22:17:25.214009] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-14T22:17:25.214087] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-14T22:17:25.214612] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-14T22:17:25.214697] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-14T22:17:25.215372] [DEBUG] [LOCAL ] VTOL: Trimmed 26047 records to 19561 (keeping 200 days of data) [2025-10-14T22:17:25.328281] [DEBUG] [LOCAL ] VTOL: Primary data saved (19561 records). [2025-10-14T22:17:25.328421] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-14T22:17:25.328502] [INFO ] [MAIN ] Update Progress: 2258/2369 symbols completed. VTOL took 31.3s. Estimated remaining: 15m 36s. Rate: 7.1 symbols/min [2025-10-14T22:17:25.504349] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:25.534800] [DEBUG] [LOCAL ] VVR: Loaded 31230 existing records from primary storage. [2025-10-14T22:17:25.535065] [INFO ] [MAIN ] VVR: Loaded 31230 existing records. [2025-10-14T22:17:25.566273] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-14T22:17:25.715612] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:25.715867] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-14T22:17:25.715934] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-14T22:17:25.716321] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-14T22:17:25.716404] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-14T22:17:26.068751] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:26.225381] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-14T22:17:26.226676] [INFO ] [REMOTE ] VTN: Full fetch complete (10911 records). [2025-10-14T22:17:26.226749] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-14T22:17:26.363155] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-14T22:17:26.634700] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-14T22:17:26.634892] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-14T22:17:26.635269] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-14T22:17:26.635353] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-14T22:17:26.636159] [DEBUG] [LOCAL ] VTN: Trimmed 10911 records to 6973 (keeping 200 days of data) [2025-10-14T22:17:26.702008] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-14T22:17:26.725495] [DEBUG] [LOCAL ] VTN: Primary data saved (6973 records). [2025-10-14T22:17:26.725687] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-14T22:17:26.725797] [INFO ] [MAIN ] Update Progress: 2259/2369 symbols completed. VTN took 35.0s. Estimated remaining: 15m 27s. Rate: 7.1 symbols/min [2025-10-14T22:17:26.931739] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:26.983470] [DEBUG] [LOCAL ] VVV: Loaded 50305 existing records from primary storage. [2025-10-14T22:17:26.983856] [INFO ] [MAIN ] VVV: Loaded 50305 existing records. [2025-10-14T22:17:27.163177] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-14T22:17:27.192801] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:27.193089] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-14T22:17:27.193156] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-14T22:17:27.193495] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-14T22:17:27.193553] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-14T22:17:27.574823] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:27.909479] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-14T22:17:27.958062] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-14T22:17:28.690551] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-14T22:17:28.758024] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-14T22:17:29.558086] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-14T22:17:29.631722] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-14T22:17:30.358099] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-14T22:17:30.527307] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-14T22:17:30.597129] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T22:17:31.158074] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-14T22:17:31.709070] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-14T22:17:31.958111] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-14T22:17:32.758066] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-14T22:17:32.794489] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T22:17:33.194205] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T22:17:33.558095] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-14T22:17:34.358093] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-14T22:17:34.604861] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T22:17:35.068398] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-14T22:17:35.158103] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-14T22:17:35.484250] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-14T22:17:35.958064] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-14T22:17:36.658005] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T22:17:36.758081] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-14T22:17:37.558041] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-14T22:17:37.679993] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-14T22:17:37.747179] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-14T22:17:38.358043] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-14T22:17:38.417590] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T22:17:39.158059] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-14T22:17:39.958043] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-14T22:17:40.118807] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-14T22:17:40.540249] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-14T22:17:40.758084] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-14T22:17:41.317713] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-14T22:17:41.558079] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-14T22:17:42.071840] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T22:17:42.358096] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-14T22:17:43.029624] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-14T22:17:43.158044] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-14T22:17:43.678816] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-14T22:17:43.958076] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-14T22:17:44.744926] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T22:17:44.758019] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-14T22:17:45.360932] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-14T22:17:45.558090] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-14T22:17:46.325807] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-14T22:17:46.358053] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-14T22:17:46.918361] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-14T22:17:47.158116] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-14T22:17:47.958076] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-14T22:17:48.112380] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T22:17:48.402154] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T22:17:48.758115] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-14T22:17:49.558102] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-14T22:17:49.723088] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T22:17:49.987085] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-14T22:17:50.358080] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-14T22:17:50.780078] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T22:17:50.943285] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T22:17:50.949340] [INFO ] [REMOTE ] VTR: Full fetch complete (76507 records). [2025-10-14T22:17:50.949497] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-14T22:17:51.167117] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-14T22:17:51.346536] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-14T22:17:51.346627] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-14T22:17:51.347854] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-14T22:17:51.347940] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-14T22:17:51.349389] [DEBUG] [LOCAL ] VTR: Trimmed 76507 records to 52778 (keeping 200 days of data) [2025-10-14T22:17:51.677233] [DEBUG] [LOCAL ] VTR: Primary data saved (52778 records). [2025-10-14T22:17:51.677393] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-14T22:17:51.677488] [INFO ] [MAIN ] Update Progress: 2260/2369 symbols completed. VTR took 46.2s. Estimated remaining: 15m 20s. Rate: 7.1 symbols/min [2025-10-14T22:17:51.847869] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:51.870179] [DEBUG] [LOCAL ] VVX: Loaded 22933 existing records from primary storage. [2025-10-14T22:17:51.870434] [INFO ] [MAIN ] VVX: Loaded 22933 existing records. [2025-10-14T22:17:51.963243] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-14T22:17:52.050541] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:52.050793] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-14T22:17:52.050843] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-14T22:17:52.051113] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-14T22:17:52.051171] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-14T22:17:52.419237] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:52.578691] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T22:17:52.758061] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-14T22:17:53.186032] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-14T22:17:53.191637] [INFO ] [REMOTE ] VVV: Full fetch complete (72622 records). [2025-10-14T22:17:53.191773] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-14T22:17:53.561585] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-14T22:17:53.584580] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-14T22:17:53.584692] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-14T22:17:53.585893] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-14T22:17:53.585974] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-14T22:17:53.588013] [DEBUG] [LOCAL ] VVV: Trimmed 72622 records to 50339 (keeping 200 days of data) [2025-10-14T22:17:53.851347] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T22:17:53.932429] [DEBUG] [LOCAL ] VVV: Primary data saved (50339 records). [2025-10-14T22:17:53.932593] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-14T22:17:53.932715] [INFO ] [MAIN ] Update Progress: 2261/2369 symbols completed. VVV took 27.2s. Estimated remaining: 15m 11s. Rate: 7.1 symbols/min [2025-10-14T22:17:54.098368] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:54.144491] [DEBUG] [LOCAL ] VYX: Loaded 48548 existing records from primary storage. [2025-10-14T22:17:54.144802] [INFO ] [MAIN ] VYX: Loaded 48548 existing records. [2025-10-14T22:17:54.318961] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:54.319186] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-14T22:17:54.319233] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-14T22:17:54.319693] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-14T22:17:54.319751] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-14T22:17:54.363325] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-14T22:17:54.679416] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:54.696242] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-14T22:17:55.158130] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-14T22:17:55.338165] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-14T22:17:55.342788] [INFO ] [REMOTE ] VVR: Full fetch complete (46875 records). [2025-10-14T22:17:55.342913] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-14T22:17:55.714302] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-14T22:17:55.714384] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-14T22:17:55.715290] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-14T22:17:55.715350] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-14T22:17:55.716326] [DEBUG] [LOCAL ] VVR: Trimmed 46875 records to 31242 (keeping 200 days of data) [2025-10-14T22:17:55.896134] [DEBUG] [LOCAL ] VVR: Primary data saved (31242 records). [2025-10-14T22:17:55.896272] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-14T22:17:55.896368] [INFO ] [MAIN ] Update Progress: 2262/2369 symbols completed. VVR took 30.6s. Estimated remaining: 15m 2s. Rate: 7.1 symbols/min [2025-10-14T22:17:55.963227] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-14T22:17:56.064290] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:56.113859] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-14T22:17:56.114185] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-14T22:17:56.288352] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:56.288619] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-14T22:17:56.288696] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-14T22:17:56.289316] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-14T22:17:56.289373] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-14T22:17:56.642898] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:56.715340] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T22:17:56.758040] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-14T22:17:57.148801] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-14T22:17:57.152135] [INFO ] [REMOTE ] VTS: Full fetch complete (41421 records). [2025-10-14T22:17:57.152240] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-14T22:17:57.523186] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-14T22:17:57.523265] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-14T22:17:57.524056] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-14T22:17:57.524115] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-14T22:17:57.524973] [DEBUG] [LOCAL ] VTS: Trimmed 41421 records to 29989 (keeping 200 days of data) [2025-10-14T22:17:57.577744] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-14T22:17:57.705132] [DEBUG] [LOCAL ] VTS: Primary data saved (29989 records). [2025-10-14T22:17:57.705252] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-14T22:17:57.705326] [INFO ] [MAIN ] Update Progress: 2263/2369 symbols completed. VTS took 43.5s. Estimated remaining: 14m 53s. Rate: 7.1 symbols/min [2025-10-14T22:17:57.872623] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:17:57.925639] [DEBUG] [LOCAL ] W: Loaded 53438 existing records from primary storage. [2025-10-14T22:17:57.925984] [INFO ] [MAIN ] W: Loaded 53438 existing records. [2025-10-14T22:17:58.102937] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:17:58.103112] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-14T22:17:58.103157] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-14T22:17:58.103485] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-14T22:17:58.103525] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-14T22:17:58.366959] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-14T22:17:58.468617] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T22:17:58.487709] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:17:58.628758] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-14T22:17:59.158069] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-14T22:17:59.958120] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-14T22:18:00.755722] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-14T22:18:00.767201] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-14T22:18:01.178694] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T22:18:01.237598] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-14T22:18:01.558064] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-14T22:18:02.207956] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T22:18:02.358123] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-14T22:18:03.141595] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-14T22:18:03.158046] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-14T22:18:03.958073] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-14T22:18:04.759449] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-14T22:18:04.763217] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-14T22:18:05.082860] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-14T22:18:05.558050] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-14T22:18:05.806770] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T22:18:05.919135] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T22:18:06.358105] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-14T22:18:07.158062] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-14T22:18:07.614732] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-14T22:18:07.803087] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T22:18:07.958030] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-14T22:18:08.321095] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-14T22:18:08.758095] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-14T22:18:09.314300] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T22:18:09.558068] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-14T22:18:10.363158] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-14T22:18:10.385078] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T22:18:11.159488] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-14T22:18:11.164405] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-14T22:18:11.958036] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-14T22:18:12.353965] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T22:18:12.619267] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-14T22:18:12.758100] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-14T22:18:13.558031] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-14T22:18:14.041970] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-14T22:18:14.358137] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-14T22:18:15.132137] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-14T22:18:15.158019] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-14T22:18:15.217350] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-14T22:18:15.241688] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T22:18:15.958159] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-14T22:18:16.758117] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-14T22:18:17.094462] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T22:18:17.531242] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-14T22:18:17.558051] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-14T22:18:18.317322] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T22:18:18.358031] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-14T22:18:19.158095] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-14T22:18:19.877530] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-14T22:18:19.963166] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-14T22:18:19.983872] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T22:18:20.252578] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-14T22:18:20.758081] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-14T22:18:21.558135] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-14T22:18:22.003925] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-14T22:18:22.358134] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-14T22:18:22.417090] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-14T22:18:23.158039] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-14T22:18:23.568221] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-14T22:18:23.958158] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-14T22:18:24.445233] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T22:18:24.758111] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-14T22:18:24.935874] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-14T22:18:25.558079] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-14T22:18:25.807946] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-14T22:18:26.017513] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T22:18:26.023103] [INFO ] [REMOTE ] VYX: Full fetch complete (70233 records). [2025-10-14T22:18:26.023260] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-14T22:18:26.370566] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-14T22:18:26.433331] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-14T22:18:26.433433] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-14T22:18:26.434961] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-14T22:18:26.435041] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-14T22:18:26.436978] [DEBUG] [LOCAL ] VYX: Trimmed 70233 records to 48535 (keeping 200 days of data) [2025-10-14T22:18:26.811141] [DEBUG] [LOCAL ] VYX: Primary data saved (48535 records). [2025-10-14T22:18:26.811325] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-14T22:18:26.811444] [INFO ] [MAIN ] Update Progress: 2264/2369 symbols completed. VYX took 32.9s. Estimated remaining: 14m 46s. Rate: 7.1 symbols/min [2025-10-14T22:18:27.071531] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:18:27.117863] [DEBUG] [LOCAL ] WAB: Loaded 44045 existing records from primary storage. [2025-10-14T22:18:27.118290] [INFO ] [MAIN ] WAB: Loaded 44045 existing records. [2025-10-14T22:18:27.167863] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-14T22:18:27.365115] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:18:27.365524] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-14T22:18:27.365603] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-14T22:18:27.366384] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-14T22:18:27.366457] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-14T22:18:27.772281] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:18:27.791831] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T22:18:27.830792] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-14T22:18:27.958054] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-14T22:18:28.758072] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-14T22:18:28.945562] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-14T22:18:28.951506] [INFO ] [REMOTE ] W: Full fetch complete (77526 records). [2025-10-14T22:18:28.951632] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-14T22:18:29.340708] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-14T22:18:29.340785] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-14T22:18:29.341975] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-14T22:18:29.342035] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-14T22:18:29.343388] [DEBUG] [LOCAL ] W: Trimmed 77526 records to 53441 (keeping 200 days of data) [2025-10-14T22:18:29.558067] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-14T22:18:29.678943] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-14T22:18:29.699341] [DEBUG] [LOCAL ] W: Primary data saved (53441 records). [2025-10-14T22:18:29.699479] [INFO ] [MAIN ] W: Full history saved. [2025-10-14T22:18:29.699558] [INFO ] [MAIN ] Update Progress: 2265/2369 symbols completed. W took 32.0s. Estimated remaining: 14m 37s. Rate: 7.1 symbols/min [2025-10-14T22:18:29.865352] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:18:29.904338] [DEBUG] [LOCAL ] WAL: Loaded 45391 existing records from primary storage. [2025-10-14T22:18:29.904637] [INFO ] [MAIN ] WAL: Loaded 45391 existing records. [2025-10-14T22:18:30.080410] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:18:30.080638] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-14T22:18:30.080764] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-14T22:18:30.081447] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-14T22:18:30.081503] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-14T22:18:30.365102] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-14T22:18:30.446148] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:18:30.467313] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T22:18:30.470524] [INFO ] [REMOTE ] VVX: Full fetch complete (33139 records). [2025-10-14T22:18:30.470636] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-14T22:18:30.863892] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-14T22:18:30.864004] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-14T22:18:30.865594] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-14T22:18:30.865693] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-14T22:18:30.866697] [DEBUG] [LOCAL ] VVX: Trimmed 33139 records to 22906 (keeping 200 days of data) [2025-10-14T22:18:30.999269] [DEBUG] [LOCAL ] VVX: Primary data saved (22906 records). [2025-10-14T22:18:30.999399] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-14T22:18:30.999477] [INFO ] [MAIN ] Update Progress: 2266/2369 symbols completed. VVX took 39.3s. Estimated remaining: 14m 29s. Rate: 7.1 symbols/min [2025-10-14T22:18:31.170832] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:18:31.171004] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-14T22:18:31.203163] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-14T22:18:31.241466] [DEBUG] [LOCAL ] WAT: Loaded 35698 existing records from primary storage. [2025-10-14T22:18:31.241782] [INFO ] [MAIN ] WAT: Loaded 35698 existing records. [2025-10-14T22:18:31.416146] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:18:31.416439] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-14T22:18:31.416539] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-14T22:18:31.417273] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-14T22:18:31.417332] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-14T22:18:31.772410] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:18:31.958034] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-14T22:18:32.077387] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-14T22:18:32.606463] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-14T22:18:32.612503] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-14T22:18:32.612666] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-14T22:18:32.768019] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-14T22:18:33.032466] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-14T22:18:33.032596] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-14T22:18:33.034367] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-14T22:18:33.034516] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-14T22:18:33.061838] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T22:18:33.060516] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 53791 (keeping 200 days of data) [2025-10-14T22:18:33.417418] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-14T22:18:33.417551] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-14T22:18:33.417627] [INFO ] [MAIN ] Update Progress: 2267/2369 symbols completed. VZ took 37.5s. Estimated remaining: 14m 20s. Rate: 7.1 symbols/min [2025-10-14T22:18:33.567072] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-14T22:18:33.592472] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:18:33.593468] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-14T22:18:33.593528] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-14T22:18:33.593668] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-14T22:18:33.593744] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-14T22:18:33.593792] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-14T22:18:33.593824] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-14T22:18:33.963414] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:18:34.211251] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-14T22:18:34.358086] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-14T22:18:34.569555] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:18:34.569868] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-14T22:18:34.569954] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:18:34.570054] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-14T22:18:34.570119] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:18:34.570187] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-14T22:18:34.570247] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-14T22:18:34.570282] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-14T22:18:34.570321] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-14T22:18:34.570364] [INFO ] [MAIN ] Update Progress: 2268/2369 symbols completed. WBI took 1.2s. Estimated remaining: 14m 11s. Rate: 7.1 symbols/min [2025-10-14T22:18:34.737335] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:18:34.777438] [DEBUG] [LOCAL ] WBS: Loaded 48737 existing records from primary storage. [2025-10-14T22:18:34.777752] [INFO ] [MAIN ] WBS: Loaded 48737 existing records. [2025-10-14T22:18:34.952340] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:18:34.952571] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-14T22:18:34.952623] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-14T22:18:34.953489] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-14T22:18:34.953547] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-14T22:18:35.172356] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-14T22:18:35.343509] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:18:35.372082] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-14T22:18:35.958065] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-14T22:18:36.758048] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-14T22:18:36.834009] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T22:18:36.863697] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-14T22:18:37.558034] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-14T22:18:38.358081] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-14T22:18:38.459676] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T22:18:38.737321] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-14T22:18:39.158117] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-14T22:18:39.761686] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-14T22:18:39.958123] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-14T22:18:40.711277] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-14T22:18:40.758023] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-14T22:18:41.247028] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T22:18:41.558112] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-14T22:18:42.204555] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T22:18:42.358098] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-14T22:18:42.812455] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T22:18:43.158076] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-14T22:18:43.784365] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T22:18:43.958099] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-14T22:18:44.758070] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-14T22:18:45.033866] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T22:18:45.203498] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-14T22:18:45.558075] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-14T22:18:46.350119] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-14T22:18:46.360577] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-14T22:18:46.639290] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-14T22:18:47.158101] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-14T22:18:47.699575] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-14T22:18:47.958125] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-14T22:18:48.325152] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T22:18:48.758091] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-14T22:18:49.214450] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-14T22:18:49.558080] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-14T22:18:50.073611] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-14T22:18:50.358099] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-14T22:18:51.158052] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-14T22:18:51.257336] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T22:18:51.380387] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T22:18:51.958081] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-14T22:18:52.575495] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T22:18:52.758106] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-14T22:18:53.541590] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-14T22:18:53.558032] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-14T22:18:54.163375] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T22:18:54.358111] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-14T22:18:55.158157] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-14T22:18:55.227722] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-14T22:18:55.897938] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T22:18:55.958079] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-14T22:18:56.514623] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-14T22:18:56.519164] [INFO ] [REMOTE ] WAT: Full fetch complete (50434 records). [2025-10-14T22:18:56.519280] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-14T22:18:56.759945] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-14T22:18:56.917014] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-14T22:18:56.917115] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-14T22:18:56.918468] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-14T22:18:56.918578] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-14T22:18:56.919869] [DEBUG] [LOCAL ] WAT: Trimmed 50434 records to 35781 (keeping 200 days of data) [2025-10-14T22:18:57.050010] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-14T22:18:57.194276] [DEBUG] [LOCAL ] WAT: Primary data saved (35781 records). [2025-10-14T22:18:57.194437] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-14T22:18:57.194544] [INFO ] [MAIN ] Update Progress: 2269/2369 symbols completed. WAT took 26.2s. Estimated remaining: 14m 3s. Rate: 7.1 symbols/min [2025-10-14T22:18:57.372029] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:18:57.383822] [DEBUG] [LOCAL ] WBX: Loaded 10656 existing records from primary storage. [2025-10-14T22:18:57.384053] [INFO ] [MAIN ] WBX: Loaded 10656 existing records. [2025-10-14T22:18:57.562999] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-14T22:18:57.566708] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:18:57.567104] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-14T22:18:57.567183] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-14T22:18:57.571714] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-14T22:18:57.571780] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-14T22:18:57.921912] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:18:58.358125] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-14T22:18:58.567770] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-14T22:18:59.158119] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-14T22:18:59.186698] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-14T22:18:59.640390] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-14T22:18:59.958146] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-14T22:19:00.220826] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T22:19:00.758083] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-14T22:19:01.558100] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-14T22:19:01.627071] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T22:19:02.358092] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-14T22:19:02.481705] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-14T22:19:02.858863] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-14T22:19:03.158158] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-14T22:19:03.640547] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-14T22:19:03.646184] [INFO ] [REMOTE ] WAL: Full fetch complete (66927 records). [2025-10-14T22:19:03.646329] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-14T22:19:03.963315] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-14T22:19:04.049304] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-14T22:19:04.049424] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-14T22:19:04.050683] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-14T22:19:04.050752] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-14T22:19:04.052236] [DEBUG] [LOCAL ] WAL: Trimmed 66927 records to 45445 (keeping 200 days of data) [2025-10-14T22:19:04.333353] [DEBUG] [LOCAL ] WAL: Primary data saved (45445 records). [2025-10-14T22:19:04.333497] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-14T22:19:04.333578] [INFO ] [MAIN ] Update Progress: 2270/2369 symbols completed. WAL took 34.6s. Estimated remaining: 13m 55s. Rate: 7.1 symbols/min [2025-10-14T22:19:04.517539] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-14T22:19:04.543949] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:04.579039] [DEBUG] [LOCAL ] WCC: Loaded 39131 existing records from primary storage. [2025-10-14T22:19:04.579340] [INFO ] [MAIN ] WCC: Loaded 39131 existing records. [2025-10-14T22:19:04.758581] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-14T22:19:04.762892] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:19:04.764273] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-14T22:19:04.764330] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-14T22:19:04.765025] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-14T22:19:04.765089] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-14T22:19:05.125508] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:05.504398] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-14T22:19:05.558072] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-14T22:19:05.995445] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T22:19:06.358066] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-14T22:19:06.638034] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-14T22:19:06.645777] [INFO ] [REMOTE ] WAB: Full fetch complete (64221 records). [2025-10-14T22:19:06.645976] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-14T22:19:07.072967] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-14T22:19:07.073072] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-14T22:19:07.074209] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-14T22:19:07.074284] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-14T22:19:07.100790] [DEBUG] [LOCAL ] WAB: Trimmed 64221 records to 44007 (keeping 200 days of data) [2025-10-14T22:19:07.101931] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T22:19:07.166459] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-14T22:19:07.386542] [DEBUG] [LOCAL ] WAB: Primary data saved (44007 records). [2025-10-14T22:19:07.386697] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-14T22:19:07.387382] [INFO ] [MAIN ] Update Progress: 2271/2369 symbols completed. WAB took 40.6s. Estimated remaining: 13m 46s. Rate: 7.1 symbols/min [2025-10-14T22:19:07.560524] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:07.604934] [DEBUG] [LOCAL ] WCN: Loaded 47938 existing records from primary storage. [2025-10-14T22:19:07.605250] [INFO ] [MAIN ] WCN: Loaded 47938 existing records. [2025-10-14T22:19:07.788497] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:19:07.788761] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-14T22:19:07.788812] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-14T22:19:07.789751] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-14T22:19:07.789807] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-14T22:19:07.961601] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-14T22:19:08.176173] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:08.758085] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-14T22:19:08.911175] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T22:19:08.975543] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-14T22:19:09.558068] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-14T22:19:10.227123] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-14T22:19:10.300501] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T22:19:10.358041] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-14T22:19:11.158067] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-14T22:19:11.418670] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-14T22:19:11.958087] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-14T22:19:12.675831] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-14T22:19:12.681317] [INFO ] [REMOTE ] WBS: Full fetch complete (69980 records). [2025-10-14T22:19:12.681452] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-14T22:19:12.763206] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-14T22:19:13.069554] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-14T22:19:13.069694] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-14T22:19:13.070839] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-14T22:19:13.070900] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-14T22:19:13.072231] [DEBUG] [LOCAL ] WBS: Trimmed 69980 records to 48738 (keeping 200 days of data) [2025-10-14T22:19:13.360666] [DEBUG] [LOCAL ] WBS: Primary data saved (48738 records). [2025-10-14T22:19:13.360795] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-14T22:19:13.360870] [INFO ] [MAIN ] Update Progress: 2272/2369 symbols completed. WBS took 38.8s. Estimated remaining: 13m 38s. Rate: 7.1 symbols/min [2025-10-14T22:19:13.537838] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:13.559180] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-14T22:19:13.559945] [DEBUG] [LOCAL ] WD: Loaded 23185 existing records from primary storage. [2025-10-14T22:19:13.560874] [INFO ] [MAIN ] WD: Loaded 23185 existing records. [2025-10-14T22:19:13.753261] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:19:13.778674] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-14T22:19:13.778843] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-14T22:19:13.779986] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-14T22:19:13.783579] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T22:19:13.783828] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-14T22:19:14.164623] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:14.358033] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-14T22:19:14.404090] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-14T22:19:14.610499] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-14T22:19:15.158120] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-14T22:19:15.958058] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-14T22:19:16.078486] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-14T22:19:16.301850] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-14T22:19:16.644433] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-14T22:19:16.758090] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-14T22:19:17.558063] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-14T22:19:18.369744] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-14T22:19:18.404901] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T22:19:18.404377] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-14T22:19:19.053975] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-14T22:19:19.158080] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-14T22:19:19.958044] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-14T22:19:20.203060] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T22:19:20.358409] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-14T22:19:20.758069] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-14T22:19:21.558073] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-14T22:19:21.863571] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-14T22:19:22.358087] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-14T22:19:22.985251] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T22:19:22.986905] [INFO ] [REMOTE ] WBX: Full fetch complete (23400 records). [2025-10-14T22:19:22.986979] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-14T22:19:23.165221] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-14T22:19:23.366146] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-14T22:19:23.366245] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-14T22:19:23.366850] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-14T22:19:23.366910] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-14T22:19:23.367444] [DEBUG] [LOCAL ] WBX: Trimmed 23400 records to 10592 (keeping 200 days of data) [2025-10-14T22:19:23.425536] [DEBUG] [LOCAL ] WBX: Primary data saved (10592 records). [2025-10-14T22:19:23.425882] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-14T22:19:23.425998] [INFO ] [MAIN ] Update Progress: 2273/2369 symbols completed. WBX took 26.2s. Estimated remaining: 13m 29s. Rate: 7.1 symbols/min [2025-10-14T22:19:23.600222] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:23.627042] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-14T22:19:23.650203] [DEBUG] [LOCAL ] WDH: Loaded 18004 existing records from primary storage. [2025-10-14T22:19:23.650434] [INFO ] [MAIN ] WDH: Loaded 18004 existing records. [2025-10-14T22:19:23.823107] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:19:23.823299] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-14T22:19:23.823345] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-14T22:19:23.823753] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-14T22:19:23.823813] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-14T22:19:23.963206] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-14T22:19:24.175185] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:24.758031] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-14T22:19:24.948877] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T22:19:25.558097] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-14T22:19:25.799391] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-14T22:19:25.912026] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-14T22:19:26.358115] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-14T22:19:27.111592] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T22:19:27.158077] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-14T22:19:27.862587] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T22:19:27.958025] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-14T22:19:28.557989] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-14T22:19:28.758051] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-14T22:19:29.558059] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-14T22:19:29.717136] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-14T22:19:29.836607] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-14T22:19:30.358052] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-14T22:19:30.608885] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T22:19:31.158134] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-14T22:19:31.554374] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-14T22:19:31.958060] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-14T22:19:32.691121] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:19:32.758880] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-14T22:19:32.758318] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-14T22:19:33.303246] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-14T22:19:33.558082] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-14T22:19:34.358067] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-14T22:19:35.065582] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-14T22:19:35.158079] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-14T22:19:35.247792] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-14T22:19:35.958089] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-14T22:19:36.616063] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-14T22:19:36.758041] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-14T22:19:36.981607] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T22:19:37.558086] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-14T22:19:38.358063] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-14T22:19:38.571292] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T22:19:38.820034] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-14T22:19:38.825022] [INFO ] [REMOTE ] WCC: Full fetch complete (57411 records). [2025-10-14T22:19:38.825168] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-14T22:19:39.163201] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-14T22:19:39.232537] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-14T22:19:39.232631] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-14T22:19:39.234365] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-14T22:19:39.234427] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-14T22:19:39.235602] [DEBUG] [LOCAL ] WCC: Trimmed 57411 records to 39070 (keeping 200 days of data) [2025-10-14T22:19:39.335873] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T22:19:39.496790] [DEBUG] [LOCAL ] WCC: Primary data saved (39070 records). [2025-10-14T22:19:39.496932] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-14T22:19:39.497019] [INFO ] [MAIN ] Update Progress: 2274/2369 symbols completed. WCC took 35.2s. Estimated remaining: 13m 21s. Rate: 7.1 symbols/min [2025-10-14T22:19:39.662121] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:39.680932] [DEBUG] [LOCAL ] WDI: Loaded 21111 existing records from primary storage. [2025-10-14T22:19:39.681154] [INFO ] [MAIN ] WDI: Loaded 21111 existing records. [2025-10-14T22:19:39.854217] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:19:39.854443] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-14T22:19:39.854489] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-14T22:19:39.854928] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-14T22:19:39.854984] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-14T22:19:39.963308] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-14T22:19:40.210981] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:40.758082] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-14T22:19:40.871374] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-14T22:19:40.970984] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T22:19:41.224426] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-14T22:19:41.558081] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-14T22:19:42.358095] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-14T22:19:42.665571] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T22:19:42.938534] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-14T22:19:43.158069] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-14T22:19:43.958069] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-14T22:19:44.122750] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-14T22:19:44.758051] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-14T22:19:44.821186] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T22:19:45.558084] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-14T22:19:46.214886] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-14T22:19:46.358057] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-14T22:19:46.548241] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T22:19:47.158074] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-14T22:19:47.319583] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-14T22:19:47.875701] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-14T22:19:47.958026] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-14T22:19:48.758121] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-14T22:19:49.169298] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-14T22:19:49.390984] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-14T22:19:49.558112] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-14T22:19:50.244860] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-14T22:19:50.358072] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-14T22:19:51.158080] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-14T22:19:51.699629] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T22:19:51.958061] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-14T22:19:52.019385] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T22:19:52.758054] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-14T22:19:53.069358] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T22:19:53.072623] [INFO ] [REMOTE ] WDH: Full fetch complete (23877 records). [2025-10-14T22:19:53.072724] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-14T22:19:53.433994] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-14T22:19:53.434069] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-14T22:19:53.434609] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-14T22:19:53.434673] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-14T22:19:53.435316] [DEBUG] [LOCAL ] WDH: Trimmed 23877 records to 18114 (keeping 200 days of data) [2025-10-14T22:19:53.540703] [DEBUG] [LOCAL ] WDH: Primary data saved (18114 records). [2025-10-14T22:19:53.540835] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-14T22:19:53.540932] [INFO ] [MAIN ] Update Progress: 2275/2369 symbols completed. WDH took 30.1s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-14T22:19:53.563252] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-14T22:19:53.721352] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:53.721517] [DEBUG] [LOCAL ] WDS: No existing data file found in primary storage. [2025-10-14T22:19:53.721555] [WARN ] [MAIN ] WDS: No existing data found, performing full refresh instead. [2025-10-14T22:19:53.721691] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-14T22:19:53.721744] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-14T22:19:53.721787] [DEBUG] [LOCAL ] WDS: No primary data file found to delete. [2025-10-14T22:19:53.721821] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-14T22:19:54.082088] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:54.271732] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-14T22:19:54.277295] [INFO ] [REMOTE ] WCN: Full fetch complete (69413 records). [2025-10-14T22:19:54.277403] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-14T22:19:54.363208] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-14T22:19:54.689305] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-14T22:19:54.689474] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-14T22:19:54.690743] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-14T22:19:54.690941] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-14T22:19:54.705525] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T22:19:54.711607] [DEBUG] [LOCAL ] WCN: Trimmed 69413 records to 48017 (keeping 200 days of data) [2025-10-14T22:19:55.032395] [DEBUG] [LOCAL ] WCN: Primary data saved (48017 records). [2025-10-14T22:19:55.032526] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-14T22:19:55.033373] [INFO ] [MAIN ] Update Progress: 2276/2369 symbols completed. WCN took 47.6s. Estimated remaining: 13m 4s. Rate: 7.1 symbols/min [2025-10-14T22:19:55.162547] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-14T22:19:55.232180] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:19:55.247825] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-14T22:19:55.259781] [DEBUG] [LOCAL ] WEA: Loaded 7656 existing records from primary storage. [2025-10-14T22:19:55.260032] [INFO ] [MAIN ] WEA: Loaded 7656 existing records. [2025-10-14T22:19:55.437033] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:19:55.437284] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-14T22:19:55.437334] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-14T22:19:55.437552] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-14T22:19:55.437609] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-14T22:19:55.785983] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:19:55.958064] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-14T22:19:56.580722] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-14T22:19:56.758086] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-14T22:19:56.798971] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-14T22:19:57.558064] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-14T22:19:57.586111] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-14T22:19:58.358128] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-14T22:19:58.932250] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-14T22:19:58.962353] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-14T22:19:59.158039] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-14T22:19:59.751919] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T22:19:59.958202] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-14T22:20:00.587491] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-14T22:20:00.758122] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-14T22:20:01.558125] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-14T22:20:01.983517] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T22:20:02.358077] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-14T22:20:02.414835] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-14T22:20:03.158079] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-14T22:20:03.926858] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-14T22:20:03.958028] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-14T22:20:04.244011] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-14T22:20:04.246542] [INFO ] [REMOTE ] WD: Full fetch complete (33246 records). [2025-10-14T22:20:04.246631] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-14T22:20:04.646237] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-14T22:20:04.646336] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-14T22:20:04.647037] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-14T22:20:04.647098] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-14T22:20:04.647964] [DEBUG] [LOCAL ] WD: Trimmed 33246 records to 23172 (keeping 200 days of data) [2025-10-14T22:20:04.758606] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-14T22:20:04.790446] [DEBUG] [LOCAL ] WD: Primary data saved (23172 records). [2025-10-14T22:20:04.790565] [INFO ] [MAIN ] WD: Full history saved. [2025-10-14T22:20:04.790666] [INFO ] [MAIN ] Update Progress: 2277/2369 symbols completed. WD took 51.4s. Estimated remaining: 12m 56s. Rate: 7.1 symbols/min [2025-10-14T22:20:05.504061] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-14T22:20:05.539093] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T22:20:05.558029] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-14T22:20:06.358065] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-14T22:20:07.013819] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-14T22:20:07.158076] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-14T22:20:07.252402] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T22:20:07.958094] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-14T22:20:08.301967] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T22:20:08.579011] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-14T22:20:08.758093] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-14T22:20:09.526627] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-14T22:20:09.558027] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-14T22:20:10.196095] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-14T22:20:10.358065] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-14T22:20:11.158054] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-14T22:20:11.341364] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-14T22:20:11.344110] [INFO ] [REMOTE ] WDI: Full fetch complete (30468 records). [2025-10-14T22:20:11.344196] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-14T22:20:11.716351] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-14T22:20:11.716436] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-14T22:20:11.717992] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-14T22:20:11.718055] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-14T22:20:11.718854] [DEBUG] [LOCAL ] WDI: Trimmed 30468 records to 21180 (keeping 200 days of data) [2025-10-14T22:20:11.847586] [DEBUG] [LOCAL ] WDI: Primary data saved (21180 records). [2025-10-14T22:20:11.847733] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-14T22:20:11.847816] [INFO ] [MAIN ] Update Progress: 2278/2369 symbols completed. WDI took 32.4s. Estimated remaining: 12m 47s. Rate: 7.1 symbols/min [2025-10-14T22:20:11.958117] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-14T22:20:12.695830] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-14T22:20:12.697345] [INFO ] [REMOTE ] WEA: Full fetch complete (9975 records). [2025-10-14T22:20:12.697451] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-14T22:20:12.898728] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T22:20:12.990782] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-14T22:20:13.132839] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-14T22:20:13.132916] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-14T22:20:13.133196] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-14T22:20:13.133234] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-14T22:20:13.133688] [DEBUG] [LOCAL ] WEA: Trimmed 9975 records to 7733 (keeping 200 days of data) [2025-10-14T22:20:13.179461] [DEBUG] [LOCAL ] WEA: Primary data saved (7733 records). [2025-10-14T22:20:13.179591] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-14T22:20:13.179692] [INFO ] [MAIN ] Update Progress: 2279/2369 symbols completed. WEA took 18.1s. Estimated remaining: 12m 39s. Rate: 7.1 symbols/min [2025-10-14T22:20:14.716284] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-14T22:20:14.727489] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-14T22:20:16.289827] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-14T22:20:16.299118] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-14T22:20:17.837933] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-14T22:20:17.846558] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-14T22:20:19.532056] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T22:20:19.541623] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-14T22:20:20.894574] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-14T22:20:20.899726] [INFO ] [REMOTE ] WDS: Full fetch complete (64317 records). [2025-10-14T22:20:20.899874] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-14T22:20:21.327802] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-14T22:20:21.327876] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-14T22:20:21.329062] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-14T22:20:21.329120] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-14T22:20:21.330362] [DEBUG] [LOCAL ] WDS: Trimmed 64317 records to 43136 (keeping 200 days of data) [2025-10-14T22:20:21.587749] [DEBUG] [LOCAL ] WDS: Primary data saved (43136 records). [2025-10-14T22:20:21.587931] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-14T22:20:21.588020] [INFO ] [MAIN ] Update Progress: 2280/2369 symbols completed. WDS took 28.0s. Estimated remaining: 12m 30s. Rate: 7.1 symbols/min [2025-10-14T22:20:22.162957] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:22.278794] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:22.307282] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:22.308677] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:22.405140] [DEBUG] [LOCAL ] WES: Loaded 48437 existing records from primary storage. [2025-10-14T22:20:22.406510] [DEBUG] [LOCAL ] WELL: Loaded 52331 existing records from primary storage. [2025-10-14T22:20:22.418041] [INFO ] [MAIN ] WES: Loaded 48437 existing records. [2025-10-14T22:20:22.450969] [INFO ] [MAIN ] WELL: Loaded 52331 existing records. [2025-10-14T22:20:22.467155] [DEBUG] [LOCAL ] WEAV: Loaded 42194 existing records from primary storage. [2025-10-14T22:20:22.560036] [INFO ] [MAIN ] WEAV: Loaded 42194 existing records. [2025-10-14T22:20:22.641773] [DEBUG] [LOCAL ] WEC: Loaded 52165 existing records from primary storage. [2025-10-14T22:20:22.717068] [INFO ] [MAIN ] WEC: Loaded 52165 existing records. [2025-10-14T22:20:22.975748] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:23.005447] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:23.048636] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-14T22:20:23.081894] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-14T22:20:23.082476] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-14T22:20:23.082007] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-14T22:20:23.113020] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:23.155856] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-14T22:20:23.128797] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-14T22:20:23.159503] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-14T22:20:23.184148] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-14T22:20:23.184289] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-14T22:20:23.184043] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:23.195221] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-14T22:20:23.178207] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-14T22:20:23.204774] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-14T22:20:23.213581] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-14T22:20:23.204889] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-14T22:20:23.234874] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-14T22:20:23.290310] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-14T22:20:24.506774] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:24.553579] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-14T22:20:24.566986] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:24.616781] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-14T22:20:24.683121] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:24.684111] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-14T22:20:24.704423] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:24.705523] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-14T22:20:26.207666] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-14T22:20:26.217339] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-14T22:20:26.292024] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-14T22:20:26.302516] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-14T22:20:26.445952] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T22:20:26.456945] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-14T22:20:26.485393] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-14T22:20:26.495373] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-14T22:20:27.674517] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T22:20:27.688287] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-14T22:20:27.752246] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-14T22:20:27.762680] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-14T22:20:27.787809] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-14T22:20:27.797085] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-14T22:20:27.889319] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T22:20:27.899901] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-14T22:20:29.299092] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T22:20:29.307954] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-14T22:20:29.365197] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T22:20:29.374619] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-14T22:20:29.455433] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T22:20:29.465595] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-14T22:20:29.629926] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-14T22:20:29.640206] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-14T22:20:30.486571] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T22:20:30.500637] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-14T22:20:31.053231] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-14T22:20:31.065491] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-14T22:20:31.203581] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T22:20:31.215108] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-14T22:20:31.260049] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-14T22:20:31.958095] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-14T22:20:32.005171] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-14T22:20:32.392519] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-14T22:20:32.758106] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-14T22:20:33.064091] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T22:20:33.511451] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T22:20:33.558038] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-14T22:20:34.219784] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T22:20:34.358064] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-14T22:20:35.158077] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-14T22:20:35.354878] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T22:20:35.770142] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-14T22:20:35.958036] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-14T22:20:36.758058] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-14T22:20:36.859099] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T22:20:37.240943] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-14T22:20:37.558062] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-14T22:20:38.195943] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T22:20:38.358076] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-14T22:20:38.968502] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T22:20:39.158115] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-14T22:20:39.500504] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-14T22:20:39.958086] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-14T22:20:40.758065] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-14T22:20:41.176506] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-14T22:20:41.514682] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-14T22:20:41.558068] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-14T22:20:41.979108] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T22:20:42.358073] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-14T22:20:42.800627] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-14T22:20:43.158111] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-14T22:20:43.958067] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-14T22:20:44.105040] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-14T22:20:44.379367] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T22:20:44.758064] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-14T22:20:45.363793] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T22:20:45.368974] [INFO ] [REMOTE ] WEAV: Full fetch complete (61765 records). [2025-10-14T22:20:45.369081] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-14T22:20:45.564686] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-14T22:20:45.770452] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-14T22:20:45.770570] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-14T22:20:45.771973] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-14T22:20:45.772059] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-14T22:20:45.773629] [DEBUG] [LOCAL ] WEAV: Trimmed 61765 records to 42250 (keeping 200 days of data) [2025-10-14T22:20:46.007927] [DEBUG] [LOCAL ] WEAV: Primary data saved (42250 records). [2025-10-14T22:20:46.008051] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-14T22:20:46.008129] [INFO ] [MAIN ] Update Progress: 2281/2369 symbols completed. WEAV took 24.4s. Estimated remaining: 12m 22s. Rate: 7.1 symbols/min [2025-10-14T22:20:46.177092] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:46.210356] [DEBUG] [LOCAL ] WEX: Loaded 33233 existing records from primary storage. [2025-10-14T22:20:46.210607] [INFO ] [MAIN ] WEX: Loaded 33233 existing records. [2025-10-14T22:20:46.363214] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-14T22:20:46.392937] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:46.393344] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-14T22:20:46.393537] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-14T22:20:46.394263] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-14T22:20:46.394359] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-14T22:20:46.796749] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:46.798839] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-14T22:20:47.166573] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-14T22:20:47.171974] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-14T22:20:47.958046] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-14T22:20:48.255071] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-14T22:20:48.570355] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T22:20:48.758096] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-14T22:20:49.162978] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-14T22:20:49.328862] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-14T22:20:49.335320] [INFO ] [REMOTE ] WELL: Full fetch complete (75885 records). [2025-10-14T22:20:49.335491] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-14T22:20:49.563233] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-14T22:20:49.766082] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-14T22:20:49.766171] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-14T22:20:49.767394] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-14T22:20:49.767460] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-14T22:20:49.769087] [DEBUG] [LOCAL ] WELL: Trimmed 75885 records to 52329 (keeping 200 days of data) [2025-10-14T22:20:50.100013] [DEBUG] [LOCAL ] WELL: Primary data saved (52329 records). [2025-10-14T22:20:50.100145] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-14T22:20:50.100224] [INFO ] [MAIN ] Update Progress: 2282/2369 symbols completed. WELL took 28.5s. Estimated remaining: 12m 14s. Rate: 7.1 symbols/min [2025-10-14T22:20:50.273914] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:50.286140] [DEBUG] [LOCAL ] WF: Loaded 10850 existing records from primary storage. [2025-10-14T22:20:50.286360] [INFO ] [MAIN ] WF: Loaded 10850 existing records. [2025-10-14T22:20:50.363379] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-14T22:20:50.472236] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:50.472511] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-14T22:20:50.472560] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-14T22:20:50.472812] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-14T22:20:50.472869] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-14T22:20:50.834811] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:51.158093] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-14T22:20:51.452744] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-14T22:20:51.958052] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-14T22:20:52.113926] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-14T22:20:52.119747] [INFO ] [REMOTE ] WES: Full fetch complete (70370 records). [2025-10-14T22:20:52.119858] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-14T22:20:52.239012] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-14T22:20:52.540761] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-14T22:20:52.540839] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-14T22:20:52.542211] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-14T22:20:52.542274] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-14T22:20:52.543585] [DEBUG] [LOCAL ] WES: Trimmed 70370 records to 48500 (keeping 200 days of data) [2025-10-14T22:20:52.758990] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-14T22:20:52.828233] [DEBUG] [LOCAL ] WES: Primary data saved (48500 records). [2025-10-14T22:20:52.828371] [INFO ] [MAIN ] WES: Full history saved. [2025-10-14T22:20:52.828453] [INFO ] [MAIN ] Update Progress: 2283/2369 symbols completed. WES took 31.2s. Estimated remaining: 12m 5s. Rate: 7.1 symbols/min [2025-10-14T22:20:53.009704] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:53.058421] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-14T22:20:53.058827] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-14T22:20:53.249795] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:53.250078] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-14T22:20:53.250155] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-14T22:20:53.250739] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-14T22:20:53.250799] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-14T22:20:53.566724] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-14T22:20:53.640041] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:53.692564] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T22:20:53.729838] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-14T22:20:54.206975] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-14T22:20:54.358135] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-14T22:20:55.158085] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-14T22:20:55.498148] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T22:20:55.503934] [INFO ] [REMOTE ] WEC: Full fetch complete (75742 records). [2025-10-14T22:20:55.504044] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-14T22:20:55.920417] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-14T22:20:55.920494] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-14T22:20:55.921694] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-14T22:20:55.921757] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-14T22:20:55.923205] [DEBUG] [LOCAL ] WEC: Trimmed 75742 records to 52186 (keeping 200 days of data) [2025-10-14T22:20:55.983513] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-14T22:20:56.257733] [DEBUG] [LOCAL ] WEC: Primary data saved (52186 records). [2025-10-14T22:20:56.257963] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-14T22:20:56.258075] [INFO ] [MAIN ] Update Progress: 2284/2369 symbols completed. WEC took 34.7s. Estimated remaining: 11m 56s. Rate: 7.1 symbols/min [2025-10-14T22:20:56.431158] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:20:56.462154] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-14T22:20:56.491605] [DEBUG] [LOCAL ] WFG: Loaded 24768 existing records from primary storage. [2025-10-14T22:20:56.491930] [INFO ] [MAIN ] WFG: Loaded 24768 existing records. [2025-10-14T22:20:56.665505] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:20:56.665727] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-14T22:20:56.665782] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-14T22:20:56.666184] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-14T22:20:56.666240] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-14T22:20:56.764734] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-14T22:20:57.022628] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:20:57.088331] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T22:20:57.558038] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-14T22:20:57.595683] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T22:20:58.358083] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-14T22:20:59.158040] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-14T22:20:59.206822] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T22:20:59.259435] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T22:20:59.958052] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-14T22:21:00.715129] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-14T22:21:00.758072] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-14T22:21:01.177898] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-14T22:21:01.558087] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-14T22:21:02.210957] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-14T22:21:02.358041] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-14T22:21:02.587391] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T22:21:03.158075] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-14T22:21:03.958063] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-14T22:21:04.140456] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T22:21:04.539427] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T22:21:04.758121] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-14T22:21:04.881744] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T22:21:05.558076] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-14T22:21:06.145430] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-14T22:21:06.169672] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-14T22:21:06.358074] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-14T22:21:07.158074] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-14T22:21:07.745703] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-14T22:21:07.958147] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-14T22:21:08.758082] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-14T22:21:08.961495] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-14T22:21:09.025894] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-14T22:21:09.558097] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-14T22:21:09.713185] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-14T22:21:10.358110] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-14T22:21:11.158088] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-14T22:21:11.750574] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T22:21:11.782194] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-14T22:21:11.958074] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-14T22:21:12.486920] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-14T22:21:12.758065] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-14T22:21:12.805561] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T22:21:12.808860] [INFO ] [REMOTE ] WEX: Full fetch complete (50356 records). [2025-10-14T22:21:12.808946] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-14T22:21:13.189980] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-14T22:21:13.190061] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-14T22:21:13.191081] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-14T22:21:13.191144] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-14T22:21:13.192118] [DEBUG] [LOCAL ] WEX: Trimmed 50356 records to 33069 (keeping 200 days of data) [2025-10-14T22:21:13.384091] [DEBUG] [LOCAL ] WEX: Primary data saved (33069 records). [2025-10-14T22:21:13.384219] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-14T22:21:13.384293] [INFO ] [MAIN ] Update Progress: 2285/2369 symbols completed. WEX took 27.4s. Estimated remaining: 11m 48s. Rate: 7.1 symbols/min [2025-10-14T22:21:13.550059] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:21:13.558184] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-14T22:21:13.586635] [DEBUG] [LOCAL ] WGO: Loaded 38304 existing records from primary storage. [2025-10-14T22:21:13.586934] [INFO ] [MAIN ] WGO: Loaded 38304 existing records. [2025-10-14T22:21:13.772664] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:21:13.773106] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-14T22:21:13.773165] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-14T22:21:13.773527] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-14T22:21:13.773602] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-14T22:21:14.140759] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:21:14.147972] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-14T22:21:14.358051] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-14T22:21:14.368236] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-14T22:21:15.158088] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-14T22:21:15.483404] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-14T22:21:15.958077] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-14T22:21:16.446267] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-14T22:21:16.758074] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-14T22:21:17.073372] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-14T22:21:17.558116] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-14T22:21:18.358081] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-14T22:21:18.559538] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-14T22:21:18.750714] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-14T22:21:19.158077] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-14T22:21:19.583308] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T22:21:19.958854] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-14T22:21:19.959741] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-14T22:21:20.758065] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-14T22:21:21.558041] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-14T22:21:21.977064] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-14T22:21:22.051860] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-14T22:21:22.358067] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-14T22:21:22.723141] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-14T22:21:23.158058] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-14T22:21:23.958106] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-14T22:21:24.200013] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T22:21:24.758176] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-14T22:21:24.837683] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-14T22:21:25.295939] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-14T22:21:25.558059] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-14T22:21:26.358019] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-14T22:21:26.782207] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T22:21:26.852172] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-14T22:21:26.873963] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-14T22:21:27.158309] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-14T22:21:27.937637] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-14T22:21:27.943913] [INFO ] [REMOTE ] WF: Full fetch complete (16298 records). [2025-10-14T22:21:27.944153] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-14T22:21:27.967406] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-14T22:21:28.332037] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-14T22:21:28.332147] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-14T22:21:28.332843] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-14T22:21:28.332912] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-14T22:21:28.333524] [DEBUG] [LOCAL ] WF: Trimmed 16298 records to 10980 (keeping 200 days of data) [2025-10-14T22:21:28.403544] [DEBUG] [LOCAL ] WF: Primary data saved (10980 records). [2025-10-14T22:21:28.403713] [INFO ] [MAIN ] WF: Full history saved. [2025-10-14T22:21:28.403809] [INFO ] [MAIN ] Update Progress: 2286/2369 symbols completed. WF took 38.3s. Estimated remaining: 11m 40s. Rate: 7.1 symbols/min [2025-10-14T22:21:28.573898] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:21:28.614947] [DEBUG] [LOCAL ] WH: Loaded 45237 existing records from primary storage. [2025-10-14T22:21:28.615252] [INFO ] [MAIN ] WH: Loaded 45237 existing records. [2025-10-14T22:21:28.764430] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-14T22:21:28.805246] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:21:28.806778] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-14T22:21:28.806843] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-14T22:21:28.807961] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-14T22:21:28.808024] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-14T22:21:29.173591] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:21:29.491878] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T22:21:29.558067] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-14T22:21:30.358118] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-14T22:21:30.632303] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-14T22:21:30.933810] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-14T22:21:31.143366] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T22:21:31.146579] [INFO ] [REMOTE ] WFG: Full fetch complete (36038 records). [2025-10-14T22:21:31.146675] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-14T22:21:31.167580] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-14T22:21:31.545776] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-14T22:21:31.545941] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-14T22:21:31.547213] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-14T22:21:31.547282] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-14T22:21:31.549229] [DEBUG] [LOCAL ] WFG: Trimmed 36038 records to 24783 (keeping 200 days of data) [2025-10-14T22:21:31.713015] [DEBUG] [LOCAL ] WFG: Primary data saved (24783 records). [2025-10-14T22:21:31.713229] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-14T22:21:31.713345] [INFO ] [MAIN ] Update Progress: 2287/2369 symbols completed. WFG took 35.5s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-14T22:21:31.899662] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:21:31.940972] [DEBUG] [LOCAL ] WHD: Loaded 40114 existing records from primary storage. [2025-10-14T22:21:31.941401] [INFO ] [MAIN ] WHD: Loaded 40114 existing records. [2025-10-14T22:21:31.963278] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-14T22:21:32.135993] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:21:32.136285] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-14T22:21:32.136338] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-14T22:21:32.136798] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-14T22:21:32.136874] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-14T22:21:32.524638] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:21:32.541898] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T22:21:32.548420] [INFO ] [REMOTE ] WFC: Full fetch complete (77925 records). [2025-10-14T22:21:32.548607] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-14T22:21:32.760775] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-14T22:21:32.960265] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T22:21:33.014101] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-14T22:21:33.014203] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-14T22:21:33.015605] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-14T22:21:33.015706] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-14T22:21:33.017455] [DEBUG] [LOCAL ] WFC: Trimmed 77925 records to 53748 (keeping 200 days of data) [2025-10-14T22:21:33.341163] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-14T22:21:33.341300] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-14T22:21:33.341382] [INFO ] [MAIN ] Update Progress: 2288/2369 symbols completed. WFC took 40.5s. Estimated remaining: 11m 23s. Rate: 7.1 symbols/min [2025-10-14T22:21:33.517795] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:21:33.523395] [DEBUG] [LOCAL ] WHG: Loaded 3175 existing records from primary storage. [2025-10-14T22:21:33.523598] [INFO ] [MAIN ] WHG: Loaded 3175 existing records. [2025-10-14T22:21:33.567251] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-14T22:21:33.706549] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:21:33.706806] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-14T22:21:33.706855] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-14T22:21:33.707024] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-14T22:21:33.707081] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-14T22:21:34.075285] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:21:34.341887] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T22:21:34.358016] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-14T22:21:35.166661] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-14T22:21:35.171561] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T22:21:35.675490] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-14T22:21:35.746988] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-14T22:21:35.958058] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-14T22:21:36.758110] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-14T22:21:37.404759] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-14T22:21:37.558069] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-14T22:21:37.881255] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-14T22:21:38.358047] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-14T22:21:38.473912] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-14T22:21:38.707744] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-14T22:21:39.158110] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-14T22:21:39.724554] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-14T22:21:39.958060] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-14T22:21:40.533819] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-14T22:21:40.758078] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-14T22:21:41.558076] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-14T22:21:42.123732] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T22:21:42.223543] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-14T22:21:42.358063] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-14T22:21:43.158068] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-14T22:21:43.958042] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-14T22:21:44.098339] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-14T22:21:44.254700] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T22:21:44.558222] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-14T22:21:44.758084] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-14T22:21:45.558070] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-14T22:21:46.329073] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T22:21:46.358028] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-14T22:21:47.079925] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T22:21:47.158065] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-14T22:21:47.701971] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-14T22:21:47.958096] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-14T22:21:48.070692] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-14T22:21:48.074945] [INFO ] [REMOTE ] WGO: Full fetch complete (57308 records). [2025-10-14T22:21:48.075075] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-14T22:21:48.479187] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-14T22:21:48.479263] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-14T22:21:48.480366] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-14T22:21:48.480426] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-14T22:21:48.481571] [DEBUG] [LOCAL ] WGO: Trimmed 57308 records to 38217 (keeping 200 days of data) [2025-10-14T22:21:48.705498] [DEBUG] [LOCAL ] WGO: Primary data saved (38217 records). [2025-10-14T22:21:48.705627] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-14T22:21:48.705738] [INFO ] [MAIN ] Update Progress: 2289/2369 symbols completed. WGO took 35.3s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-14T22:21:48.768862] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-14T22:21:48.876755] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:21:48.918917] [DEBUG] [LOCAL ] WHR: Loaded 48678 existing records from primary storage. [2025-10-14T22:21:48.919227] [INFO ] [MAIN ] WHR: Loaded 48678 existing records. [2025-10-14T22:21:49.097357] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:21:49.097551] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-14T22:21:49.097594] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-14T22:21:49.098118] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-14T22:21:49.098175] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-14T22:21:49.459962] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:21:49.563160] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-14T22:21:49.573873] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-14T22:21:50.252776] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-14T22:21:50.358059] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-14T22:21:50.953787] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-14T22:21:51.001691] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-14T22:21:51.158123] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-14T22:21:51.958135] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-14T22:21:52.758036] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-14T22:21:52.916019] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T22:21:53.064394] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-14T22:21:53.480079] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T22:21:53.558039] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-14T22:21:54.358108] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-14T22:21:54.660128] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-14T22:21:55.158072] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-14T22:21:55.315126] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T22:21:55.958050] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-14T22:21:56.703170] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T22:21:56.758030] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-14T22:21:57.507901] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T22:21:57.558026] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-14T22:21:58.358109] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-14T22:21:58.523100] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-14T22:21:59.127815] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-14T22:21:59.158062] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-14T22:21:59.490179] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T22:21:59.958116] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-14T22:22:00.268903] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-14T22:22:00.274116] [INFO ] [REMOTE ] WH: Full fetch complete (65110 records). [2025-10-14T22:22:00.274215] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-14T22:22:00.661133] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-14T22:22:00.661206] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-14T22:22:00.662325] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-14T22:22:00.662388] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-14T22:22:00.663753] [DEBUG] [LOCAL ] WH: Trimmed 65110 records to 45249 (keeping 200 days of data) [2025-10-14T22:22:00.758109] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-14T22:22:00.938442] [DEBUG] [LOCAL ] WH: Primary data saved (45249 records). [2025-10-14T22:22:00.938566] [INFO ] [MAIN ] WH: Full history saved. [2025-10-14T22:22:00.938662] [INFO ] [MAIN ] Update Progress: 2290/2369 symbols completed. WH took 32.5s. Estimated remaining: 11m 6s. Rate: 7.1 symbols/min [2025-10-14T22:22:01.105796] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:22:01.112765] [DEBUG] [LOCAL ] WIA: Loaded 4999 existing records from primary storage. [2025-10-14T22:22:01.112959] [INFO ] [MAIN ] WIA: Loaded 4999 existing records. [2025-10-14T22:22:01.291982] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:22:01.292202] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-14T22:22:01.292249] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-14T22:22:01.292442] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-14T22:22:01.292499] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-14T22:22:01.570517] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-14T22:22:01.650115] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:22:01.853595] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-14T22:22:01.991801] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-14T22:22:01.992505] [INFO ] [REMOTE ] WHG: Full fetch complete (4480 records). [2025-10-14T22:22:01.992570] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-14T22:22:02.361982] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-14T22:22:02.367705] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-14T22:22:02.368581] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-14T22:22:02.368896] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-14T22:22:02.369000] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-14T22:22:02.377831] [DEBUG] [LOCAL ] WHG: Trimmed 4480 records to 3169 (keeping 200 days of data) [2025-10-14T22:22:02.393606] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T22:22:02.422281] [DEBUG] [LOCAL ] WHG: Primary data saved (3169 records). [2025-10-14T22:22:02.422380] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-14T22:22:02.422450] [INFO ] [MAIN ] Update Progress: 2291/2369 symbols completed. WHG took 29.1s. Estimated remaining: 10m 58s. Rate: 7.1 symbols/min [2025-10-14T22:22:02.587249] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:22:02.602462] [DEBUG] [LOCAL ] WINN: Loaded 11583 existing records from primary storage. [2025-10-14T22:22:02.602745] [INFO ] [MAIN ] WINN: Loaded 11583 existing records. [2025-10-14T22:22:02.780989] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:22:02.781193] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-14T22:22:02.781239] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-14T22:22:02.781442] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-14T22:22:02.781498] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-14T22:22:03.152762] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:22:03.149063] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T22:22:03.158029] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-14T22:22:03.738577] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-14T22:22:03.958105] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-14T22:22:04.758111] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-14T22:22:05.558076] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-14T22:22:05.754336] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T22:22:06.139292] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-14T22:22:06.356245] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T22:22:06.363967] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-14T22:22:07.158116] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-14T22:22:07.958092] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-14T22:22:08.335198] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-14T22:22:08.654793] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-14T22:22:08.689576] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-14T22:22:08.758134] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-14T22:22:09.314594] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-14T22:22:09.558102] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-14T22:22:10.358106] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-14T22:22:11.158079] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-14T22:22:11.515811] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T22:22:11.849392] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T22:22:11.958067] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-14T22:22:11.975054] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-14T22:22:12.758064] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-14T22:22:13.558055] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-14T22:22:13.642021] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-14T22:22:13.661396] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T22:22:14.358067] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-14T22:22:14.984150] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T22:22:15.082149] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-14T22:22:15.158052] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-14T22:22:15.958055] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-14T22:22:15.973379] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-14T22:22:16.758133] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-14T22:22:17.558092] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-14T22:22:17.727872] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-14T22:22:17.795129] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T22:22:17.800874] [INFO ] [REMOTE ] WHD: Full fetch complete (57758 records). [2025-10-14T22:22:17.801072] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-14T22:22:18.233863] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-14T22:22:18.234164] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-14T22:22:18.235539] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-14T22:22:18.235752] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-14T22:22:18.249135] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-14T22:22:18.253520] [DEBUG] [LOCAL ] WHD: Trimmed 57758 records to 40178 (keeping 200 days of data) [2025-10-14T22:22:18.360531] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-14T22:22:18.526506] [DEBUG] [LOCAL ] WHD: Primary data saved (40178 records). [2025-10-14T22:22:18.526668] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-14T22:22:18.526767] [INFO ] [MAIN ] Update Progress: 2292/2369 symbols completed. WHD took 46.8s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-14T22:22:18.730258] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:22:18.783134] [DEBUG] [LOCAL ] WIT: Loaded 52420 existing records from primary storage. [2025-10-14T22:22:18.783444] [INFO ] [MAIN ] WIT: Loaded 52420 existing records. [2025-10-14T22:22:18.985976] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:22:18.986254] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-14T22:22:18.986305] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-14T22:22:18.986744] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-14T22:22:18.986821] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-14T22:22:19.067917] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T22:22:19.163207] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-14T22:22:19.399491] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:22:19.795441] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-14T22:22:19.958052] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-14T22:22:20.758061] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-14T22:22:21.523909] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T22:22:21.544245] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-14T22:22:21.550846] [INFO ] [REMOTE ] WHR: Full fetch complete (69289 records). [2025-10-14T22:22:21.551080] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-14T22:22:21.564027] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-14T22:22:21.986143] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-14T22:22:21.986226] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-14T22:22:21.987435] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-14T22:22:21.987499] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-14T22:22:21.988879] [DEBUG] [LOCAL ] WHR: Trimmed 69289 records to 48789 (keeping 200 days of data) [2025-10-14T22:22:22.292615] [DEBUG] [LOCAL ] WHR: Primary data saved (48789 records). [2025-10-14T22:22:22.292948] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-14T22:22:22.293084] [INFO ] [MAIN ] Update Progress: 2293/2369 symbols completed. WHR took 33.6s. Estimated remaining: 10m 41s. Rate: 7.1 symbols/min [2025-10-14T22:22:22.305686] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T22:22:22.366516] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-14T22:22:22.478794] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:22:22.499319] [DEBUG] [LOCAL ] WIW: Loaded 20314 existing records from primary storage. [2025-10-14T22:22:22.499554] [INFO ] [MAIN ] WIW: Loaded 20314 existing records. [2025-10-14T22:22:22.675467] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:22:22.675715] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-14T22:22:22.675770] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-14T22:22:22.676029] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-14T22:22:22.676068] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-14T22:22:23.024758] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:22:23.158060] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-14T22:22:23.958049] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-14T22:22:24.193573] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T22:22:24.263503] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-14T22:22:24.758090] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-14T22:22:24.791003] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-14T22:22:25.461049] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-14T22:22:25.558103] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-14T22:22:26.074268] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-14T22:22:26.075446] [INFO ] [REMOTE ] WIA: Full fetch complete (7288 records). [2025-10-14T22:22:26.075512] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-14T22:22:26.363274] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-14T22:22:26.468762] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-14T22:22:26.468838] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-14T22:22:26.469031] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-14T22:22:26.469069] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-14T22:22:26.469480] [DEBUG] [LOCAL ] WIA: Trimmed 7288 records to 5004 (keeping 200 days of data) [2025-10-14T22:22:26.500317] [DEBUG] [LOCAL ] WIA: Primary data saved (5004 records). [2025-10-14T22:22:26.500453] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-14T22:22:26.500532] [INFO ] [MAIN ] Update Progress: 2294/2369 symbols completed. WIA took 25.6s. Estimated remaining: 10m 32s. Rate: 7.1 symbols/min [2025-10-14T22:22:26.669488] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:22:26.706977] [DEBUG] [LOCAL ] WK: Loaded 37386 existing records from primary storage. [2025-10-14T22:22:26.707275] [INFO ] [MAIN ] WK: Loaded 37386 existing records. [2025-10-14T22:22:26.891530] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:22:26.891759] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-14T22:22:26.891810] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-14T22:22:26.892217] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-14T22:22:26.892273] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-14T22:22:27.163568] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-14T22:22:27.252224] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:22:27.909869] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T22:22:27.958064] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-14T22:22:28.299745] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-14T22:22:28.758119] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-14T22:22:29.557091] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T22:22:29.566178] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-14T22:22:29.688350] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-14T22:22:30.046904] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-14T22:22:30.358104] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-14T22:22:31.123697] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-14T22:22:31.158024] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-14T22:22:31.947780] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-14T22:22:31.958025] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-14T22:22:32.550610] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-14T22:22:32.758126] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-14T22:22:33.438782] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-14T22:22:33.440562] [INFO ] [REMOTE ] WINN: Full fetch complete (17453 records). [2025-10-14T22:22:33.440628] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-14T22:22:33.563232] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-14T22:22:33.805263] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-14T22:22:33.805334] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-14T22:22:33.805723] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-14T22:22:33.805782] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-14T22:22:33.806270] [DEBUG] [LOCAL ] WINN: Trimmed 17453 records to 11550 (keeping 200 days of data) [2025-10-14T22:22:33.874499] [DEBUG] [LOCAL ] WINN: Primary data saved (11550 records). [2025-10-14T22:22:33.874614] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-14T22:22:33.874714] [INFO ] [MAIN ] Update Progress: 2295/2369 symbols completed. WINN took 31.5s. Estimated remaining: 10m 24s. Rate: 7.1 symbols/min [2025-10-14T22:22:34.041219] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:22:34.073453] [DEBUG] [LOCAL ] WKC: Loaded 34639 existing records from primary storage. [2025-10-14T22:22:34.073741] [INFO ] [MAIN ] WKC: Loaded 34639 existing records. [2025-10-14T22:22:34.248715] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:22:34.248914] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-14T22:22:34.248986] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-14T22:22:34.249304] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-14T22:22:34.249362] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-14T22:22:34.363265] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-14T22:22:34.623164] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:22:34.929927] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T22:22:35.158079] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-14T22:22:35.738242] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-14T22:22:35.958114] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-14T22:22:36.208578] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T22:22:36.627072] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-14T22:22:36.758071] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-14T22:22:37.558037] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-14T22:22:38.025630] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-14T22:22:38.358104] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-14T22:22:39.158091] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-14T22:22:39.316857] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-14T22:22:39.406901] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T22:22:39.958076] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-14T22:22:40.190229] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-14T22:22:40.758068] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-14T22:22:41.473496] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T22:22:41.558030] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-14T22:22:41.734963] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-14T22:22:42.358090] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-14T22:22:43.027026] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-14T22:22:43.158045] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-14T22:22:43.486270] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-14T22:22:43.958109] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-14T22:22:44.758048] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-14T22:22:44.863478] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T22:22:45.404923] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-14T22:22:45.464217] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T22:22:45.558103] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-14T22:22:46.358075] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-14T22:22:46.776367] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-14T22:22:47.158067] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-14T22:22:47.958094] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-14T22:22:47.999344] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T22:22:48.706264] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T22:22:48.762206] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-14T22:22:48.766542] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-14T22:22:49.558064] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-14T22:22:50.358046] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-14T22:22:50.581696] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-14T22:22:50.614083] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T22:22:51.158080] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-14T22:22:51.958097] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-14T22:22:52.758102] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-14T22:23:06.115103] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (14.96 seconds). [2025-10-14T22:23:06.120581] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-14T22:23:06.214472] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (15.86 seconds). [2025-10-14T22:23:06.222710] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-14T22:23:06.371803] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (14.41 seconds). [2025-10-14T22:23:06.379518] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-14T22:23:07.045687] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T22:23:07.048277] [INFO ] [REMOTE ] WIW: Full fetch complete (29433 records). [2025-10-14T22:23:07.048353] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-14T22:23:07.423414] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-14T22:23:07.423671] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-14T22:23:07.424639] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-14T22:23:07.424754] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-14T22:23:07.487680] [DEBUG] [LOCAL ] WIW: Trimmed 29433 records to 20330 (keeping 200 days of data) [2025-10-14T22:23:07.490928] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (14.73 seconds). [2025-10-14T22:23:07.551322] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-14T22:23:07.635670] [DEBUG] [LOCAL ] WIW: Primary data saved (20330 records). [2025-10-14T22:23:07.636301] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-14T22:23:07.635103] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-14T22:23:07.635892] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-14T22:23:07.637525] [INFO ] [MAIN ] Update Progress: 2296/2369 symbols completed. WIW took 45.3s. Estimated remaining: 10m 16s. Rate: 7.1 symbols/min [2025-10-14T22:23:07.844070] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:07.848419] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T22:23:07.857185] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-14T22:23:07.898384] [DEBUG] [LOCAL ] WLK: Loaded 45653 existing records from primary storage. [2025-10-14T22:23:07.898750] [INFO ] [MAIN ] WLK: Loaded 45653 existing records. [2025-10-14T22:23:08.072517] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:08.072748] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-14T22:23:08.072801] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-14T22:23:08.073222] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-14T22:23:08.073280] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-14T22:23:08.425611] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:08.425961] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-14T22:23:08.998266] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-14T22:23:09.008187] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-14T22:23:09.174027] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T22:23:09.185479] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-14T22:23:09.286076] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-14T22:23:09.294102] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-14T22:23:09.529587] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-14T22:23:09.537558] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-14T22:23:10.257837] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-14T22:23:10.266983] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-14T22:23:10.301559] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-14T22:23:10.310198] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-14T22:23:10.420402] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T22:23:10.427063] [INFO ] [REMOTE ] WIT: Full fetch complete (75876 records). [2025-10-14T22:23:10.427230] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-14T22:23:10.826197] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-14T22:23:10.826298] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-14T22:23:10.827490] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-14T22:23:10.827568] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-14T22:23:10.829255] [DEBUG] [LOCAL ] WIT: Trimmed 75876 records to 52426 (keeping 200 days of data) [2025-10-14T22:23:10.974870] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-14T22:23:11.064416] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-14T22:23:11.175965] [DEBUG] [LOCAL ] WIT: Primary data saved (52426 records). [2025-10-14T22:23:11.176102] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-14T22:23:11.176180] [INFO ] [MAIN ] Update Progress: 2297/2369 symbols completed. WIT took 52.6s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-14T22:23:11.352713] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:11.362017] [DEBUG] [LOCAL ] WLKP: Loaded 6971 existing records from primary storage. [2025-10-14T22:23:11.362249] [INFO ] [MAIN ] WLKP: Loaded 6971 existing records. [2025-10-14T22:23:11.541463] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:11.541713] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-14T22:23:11.541778] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-14T22:23:11.541970] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-14T22:23:11.542040] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-14T22:23:11.874435] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T22:23:11.940188] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:11.940545] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-14T22:23:11.941636] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-14T22:23:11.969939] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-14T22:23:11.979294] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-14T22:23:12.166870] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-14T22:23:12.175116] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-14T22:23:12.728175] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-14T22:23:12.730767] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-14T22:23:12.874951] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-14T22:23:12.878573] [INFO ] [REMOTE ] WKC: Full fetch complete (50238 records). [2025-10-14T22:23:12.878690] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-14T22:23:13.211405] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T22:23:13.265184] [INFO ] [REMOTE ] WK: Full fetch complete (53013 records). [2025-10-14T22:23:13.289370] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-14T22:23:13.302327] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-14T22:23:13.302613] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-14T22:23:13.303902] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-14T22:23:13.304042] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-14T22:23:13.397962] [DEBUG] [LOCAL ] WKC: Trimmed 50238 records to 34575 (keeping 200 days of data) [2025-10-14T22:23:13.625896] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-14T22:23:13.678733] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-14T22:23:13.836456] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-14T22:23:13.837632] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-14T22:23:13.839485] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-14T22:23:13.839892] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-14T22:23:13.866494] [DEBUG] [LOCAL ] WK: Trimmed 53013 records to 37336 (keeping 200 days of data) [2025-10-14T22:23:13.870428] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-14T22:23:13.938927] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-14T22:23:14.179229] [DEBUG] [LOCAL ] WKC: Primary data saved (34575 records). [2025-10-14T22:23:14.179916] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-14T22:23:14.180300] [INFO ] [MAIN ] Update Progress: 2298/2369 symbols completed. WKC took 40.3s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-14T22:23:14.326763] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-14T22:23:14.357387] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-14T22:23:14.386129] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:14.388032] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-14T22:23:14.388432] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-14T22:23:14.390787] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-14T22:23:14.390871] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-14T22:23:14.392745] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-14T22:23:14.393056] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-14T22:23:14.506991] [DEBUG] [LOCAL ] WK: Primary data saved (37336 records). [2025-10-14T22:23:14.533247] [INFO ] [MAIN ] WK: Full history saved. [2025-10-14T22:23:14.551998] [INFO ] [MAIN ] Update Progress: 2299/2369 symbols completed. WK took 48.1s. Estimated remaining: 9m 50s. Rate: 7.1 symbols/min [2025-10-14T22:23:14.947037] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:14.968965] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:14.969881] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-14T22:23:14.976505] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-14T22:23:14.978663] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-14T22:23:15.004956] [DEBUG] [LOCAL ] WLY: Loaded 29735 existing records from primary storage. [2025-10-14T22:23:15.005245] [INFO ] [MAIN ] WLY: Loaded 29735 existing records. [2025-10-14T22:23:15.190517] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:15.190741] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-14T22:23:15.190794] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-14T22:23:15.191160] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-14T22:23:15.191215] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-14T22:23:15.547253] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:15.547897] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-14T22:23:15.557493] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-14T22:23:15.558604] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-14T22:23:15.603060] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T22:23:15.612786] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-14T22:23:15.690852] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-14T22:23:15.693071] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-14T22:23:15.968738] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-14T22:23:15.969821] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-14T22:23:16.444344] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-14T22:23:16.444934] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-14T22:23:16.758053] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-14T22:23:16.946769] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T22:23:17.071312] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-14T22:23:17.097829] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-14T22:23:17.558097] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-14T22:23:18.358082] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-14T22:23:18.757987] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-14T22:23:18.792427] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-14T22:23:19.158068] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-14T22:23:19.495056] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-14T22:23:19.958060] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-14T22:23:20.758097] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-14T22:23:21.170830] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-14T22:23:21.558051] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-14T22:23:21.591916] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-14T22:23:22.018422] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-14T22:23:22.358055] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-14T22:23:23.158081] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-14T22:23:23.716431] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-14T22:23:23.958066] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-14T22:23:24.359689] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-14T22:23:24.758110] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-14T22:23:25.041119] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-14T22:23:25.236115] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T22:23:25.558083] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-14T22:23:26.276558] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-14T22:23:26.358125] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-14T22:23:27.061020] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-14T22:23:27.158113] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-14T22:23:27.498822] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-14T22:23:27.958094] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-14T22:23:28.299217] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-14T22:23:28.299977] [INFO ] [REMOTE ] WLTG: Full fetch complete (1668 records). [2025-10-14T22:23:28.300045] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-14T22:23:28.482321] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-14T22:23:28.482493] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-14T22:23:28.482561] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-14T22:23:28.482631] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-14T22:23:28.482728] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-14T22:23:28.482772] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-14T22:23:28.482814] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-14T22:23:28.482869] [INFO ] [MAIN ] Update Progress: 2300/2369 symbols completed. WLTG took 14.3s. Estimated remaining: 9m 42s. Rate: 7.1 symbols/min [2025-10-14T22:23:28.654541] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:28.703722] [DEBUG] [LOCAL ] WM: Loaded 50991 existing records from primary storage. [2025-10-14T22:23:28.704024] [INFO ] [MAIN ] WM: Loaded 50991 existing records. [2025-10-14T22:23:28.763681] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-14T22:23:28.895836] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:28.896081] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-14T22:23:28.896153] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-14T22:23:28.896584] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-14T22:23:28.896679] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-14T22:23:29.251519] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:29.558044] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-14T22:23:29.589901] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-14T22:23:30.338892] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-14T22:23:30.358027] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-14T22:23:31.158054] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-14T22:23:31.958043] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-14T22:23:32.251165] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-14T22:23:32.304082] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T22:23:32.310627] [INFO ] [REMOTE ] WLK: Full fetch complete (63588 records). [2025-10-14T22:23:32.310858] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-14T22:23:32.725106] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-14T22:23:32.725381] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-14T22:23:32.725457] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-14T22:23:32.726760] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-14T22:23:32.729252] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-14T22:23:32.731009] [DEBUG] [LOCAL ] WLK: Trimmed 63588 records to 45712 (keeping 200 days of data) [2025-10-14T22:23:32.784884] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-14T22:23:33.024869] [DEBUG] [LOCAL ] WLK: Primary data saved (45712 records). [2025-10-14T22:23:33.024997] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-14T22:23:33.025073] [INFO ] [MAIN ] Update Progress: 2301/2369 symbols completed. WLK took 25.4s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-14T22:23:33.194471] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:33.246058] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-14T22:23:33.246359] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-14T22:23:33.426824] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:33.427060] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-14T22:23:33.427106] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-14T22:23:33.427624] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-14T22:23:33.427718] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-14T22:23:33.513221] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-14T22:23:33.537085] [INFO ] [REMOTE ] WLKP: Full fetch complete (10174 records). [2025-10-14T22:23:33.547629] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-14T22:23:33.558350] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-14T22:23:34.071200] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:34.169007] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-14T22:23:34.169060] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-14T22:23:34.169293] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-14T22:23:34.169331] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-14T22:23:34.169773] [DEBUG] [LOCAL ] WLKP: Trimmed 10174 records to 6971 (keeping 200 days of data) [2025-10-14T22:23:34.210764] [DEBUG] [LOCAL ] WLKP: Primary data saved (6971 records). [2025-10-14T22:23:34.210860] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-14T22:23:34.210932] [INFO ] [MAIN ] Update Progress: 2302/2369 symbols completed. WLKP took 23.0s. Estimated remaining: 9m 25s. Rate: 7.1 symbols/min [2025-10-14T22:23:34.362498] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-14T22:23:34.382550] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:34.399148] [DEBUG] [LOCAL ] WMK: Loaded 14665 existing records from primary storage. [2025-10-14T22:23:34.399396] [INFO ] [MAIN ] WMK: Loaded 14665 existing records. [2025-10-14T22:23:34.576943] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:34.577137] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-14T22:23:34.577185] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-14T22:23:34.577493] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-14T22:23:34.577549] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-14T22:23:34.932937] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:35.158114] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-14T22:23:35.735637] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-14T22:23:35.864785] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T22:23:35.927990] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-14T22:23:35.958033] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-14T22:23:36.758078] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-14T22:23:37.064135] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-14T22:23:37.558122] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-14T22:23:38.358075] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-14T22:23:38.561534] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-14T22:23:38.724264] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-14T22:23:39.158115] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-14T22:23:39.880105] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T22:23:39.958030] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-14T22:23:40.010725] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-14T22:23:40.758171] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-14T22:23:41.547328] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-14T22:23:41.558016] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-14T22:23:41.846752] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T22:23:42.148869] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-14T22:23:42.358102] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-14T22:23:43.158065] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-14T22:23:43.958125] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-14T22:23:44.099896] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-14T22:23:44.593417] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T22:23:44.641763] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-14T22:23:44.758033] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-14T22:23:45.558137] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-14T22:23:46.107148] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-14T22:23:46.271811] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-14T22:23:46.358075] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-14T22:23:47.158112] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-14T22:23:47.194327] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-14T22:23:47.958124] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-14T22:23:48.150113] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-14T22:23:48.758106] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-14T22:23:49.558093] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-14T22:23:49.769669] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-14T22:23:50.053026] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-14T22:23:50.097450] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-14T22:23:50.358122] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-14T22:23:51.158096] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-14T22:23:51.958110] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-14T22:23:52.427036] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-14T22:23:52.758094] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-14T22:23:53.130719] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-14T22:23:53.159722] [INFO ] [REMOTE ] WLY: Full fetch complete (42824 records). [2025-10-14T22:23:53.162576] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-14T22:23:53.164753] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-14T22:23:53.557719] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-14T22:23:53.557798] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-14T22:23:53.558727] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-14T22:23:53.558807] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-14T22:23:53.558853] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-14T22:23:53.560752] [DEBUG] [LOCAL ] WLY: Trimmed 42824 records to 29766 (keeping 200 days of data) [2025-10-14T22:23:53.749031] [DEBUG] [LOCAL ] WLY: Primary data saved (29766 records). [2025-10-14T22:23:53.749422] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-14T22:23:53.749517] [INFO ] [MAIN ] Update Progress: 2303/2369 symbols completed. WLY took 39.2s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-14T22:23:53.922797] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:23:53.964855] [DEBUG] [LOCAL ] WMS: Loaded 39678 existing records from primary storage. [2025-10-14T22:23:53.965123] [INFO ] [MAIN ] WMS: Loaded 39678 existing records. [2025-10-14T22:23:54.146681] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:23:54.147848] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-14T22:23:54.147926] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-14T22:23:54.148793] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-14T22:23:54.148850] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-14T22:23:54.368501] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-14T22:23:54.522629] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:23:54.531602] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-14T22:23:54.563672] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T22:23:55.158097] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-14T22:23:55.958055] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-14T22:23:56.204189] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T22:23:56.733406] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-14T22:23:56.758021] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-14T22:23:57.554973] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-14T22:23:57.565196] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-14T22:23:58.240748] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-14T22:23:58.258037] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-14T22:23:58.358029] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-14T22:23:59.158075] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-14T22:23:59.874035] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T22:23:59.958070] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-14T22:24:00.758045] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-14T22:24:01.026599] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-14T22:24:01.114513] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-14T22:24:01.558065] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-14T22:24:02.363663] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-14T22:24:02.383378] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T22:24:03.119251] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-14T22:24:03.158057] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-14T22:24:03.958044] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-14T22:24:04.565259] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-14T22:24:04.758061] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-14T22:24:04.839513] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T22:24:05.508839] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-14T22:24:05.558045] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-14T22:24:06.358059] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-14T22:24:07.097423] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-14T22:24:07.129677] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-14T22:24:07.158022] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-14T22:24:07.958076] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-14T22:24:08.202148] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-14T22:24:08.758002] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-14T22:24:08.828316] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T22:24:08.844161] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-14T22:24:08.846477] [INFO ] [REMOTE ] WMK: Full fetch complete (19938 records). [2025-10-14T22:24:08.846549] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-14T22:24:09.210888] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-14T22:24:09.211018] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-14T22:24:09.211501] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-14T22:24:09.211542] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-14T22:24:09.212243] [DEBUG] [LOCAL ] WMK: Trimmed 19938 records to 14709 (keeping 200 days of data) [2025-10-14T22:24:09.300005] [DEBUG] [LOCAL ] WMK: Primary data saved (14709 records). [2025-10-14T22:24:09.300134] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-14T22:24:09.300210] [INFO ] [MAIN ] Update Progress: 2304/2369 symbols completed. WMK took 35.1s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-14T22:24:09.467403] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:24:09.518153] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-14T22:24:09.518474] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-14T22:24:09.563306] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-14T22:24:09.738132] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:24:09.738350] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-14T22:24:09.738397] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-14T22:24:09.738932] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-14T22:24:09.738989] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-14T22:24:10.093697] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:24:10.358069] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-14T22:24:10.617697] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-14T22:24:10.895778] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-14T22:24:10.934379] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-14T22:24:10.940188] [INFO ] [REMOTE ] WM: Full fetch complete (73864 records). [2025-10-14T22:24:10.940327] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-14T22:24:11.163288] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-14T22:24:11.334270] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-14T22:24:11.334353] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-14T22:24:11.335612] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-14T22:24:11.335698] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-14T22:24:11.337148] [DEBUG] [LOCAL ] WM: Trimmed 73864 records to 50989 (keeping 200 days of data) [2025-10-14T22:24:11.646405] [DEBUG] [LOCAL ] WM: Primary data saved (50989 records). [2025-10-14T22:24:11.646527] [INFO ] [MAIN ] WM: Full history saved. [2025-10-14T22:24:11.646602] [INFO ] [MAIN ] Update Progress: 2305/2369 symbols completed. WM took 43.2s. Estimated remaining: 8m 60s. Rate: 7.1 symbols/min [2025-10-14T22:24:11.813711] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:24:11.850893] [DEBUG] [LOCAL ] WNC: Loaded 38638 existing records from primary storage. [2025-10-14T22:24:11.851163] [INFO ] [MAIN ] WNC: Loaded 38638 existing records. [2025-10-14T22:24:11.963168] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-14T22:24:12.035507] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:24:12.036047] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-14T22:24:12.036098] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-14T22:24:12.036469] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-14T22:24:12.036510] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-14T22:24:12.383909] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:24:12.758063] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-14T22:24:13.558077] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-14T22:24:13.602721] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T22:24:13.652524] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-14T22:24:14.174169] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-14T22:24:14.243281] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-14T22:24:14.249358] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-14T22:24:14.249479] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-14T22:24:14.363165] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-14T22:24:14.639364] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-14T22:24:14.639451] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-14T22:24:14.640710] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-14T22:24:14.640779] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-14T22:24:14.642333] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 53672 (keeping 200 days of data) [2025-10-14T22:24:14.967256] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-14T22:24:14.967379] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-14T22:24:14.967453] [INFO ] [MAIN ] Update Progress: 2306/2369 symbols completed. WMB took 41.9s. Estimated remaining: 8m 51s. Rate: 7.1 symbols/min [2025-10-14T22:24:15.134931] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:24:15.158091] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-14T22:24:15.173114] [DEBUG] [LOCAL ] WNS: Loaded 40018 existing records from primary storage. [2025-10-14T22:24:15.173392] [INFO ] [MAIN ] WNS: Loaded 40018 existing records. [2025-10-14T22:24:15.353707] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:24:15.353953] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-14T22:24:15.354000] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-14T22:24:15.354391] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-14T22:24:15.354451] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-14T22:24:15.714331] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:24:15.958035] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-14T22:24:16.005319] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-14T22:24:16.609376] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T22:24:16.758100] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-14T22:24:17.357850] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T22:24:17.558060] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-14T22:24:18.358101] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-14T22:24:18.967029] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-14T22:24:19.158078] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-14T22:24:19.277436] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-14T22:24:19.407594] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T22:24:19.958068] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-14T22:24:20.039120] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-14T22:24:20.758112] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-14T22:24:21.351027] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-14T22:24:21.558129] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-14T22:24:22.241061] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T22:24:22.358106] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-14T22:24:23.158084] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-14T22:24:23.240196] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-14T22:24:23.958084] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-14T22:24:23.993884] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-14T22:24:24.758149] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-14T22:24:25.564870] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-14T22:24:25.582615] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-14T22:24:25.701462] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-14T22:24:25.747241] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-14T22:24:25.752221] [INFO ] [REMOTE ] WMS: Full fetch complete (57218 records). [2025-10-14T22:24:25.752374] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-14T22:24:26.140549] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-14T22:24:26.140661] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-14T22:24:26.141716] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-14T22:24:26.141774] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-14T22:24:26.142810] [DEBUG] [LOCAL ] WMS: Trimmed 57218 records to 39730 (keeping 200 days of data) [2025-10-14T22:24:26.358050] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-14T22:24:26.392633] [DEBUG] [LOCAL ] WMS: Primary data saved (39730 records). [2025-10-14T22:24:26.392780] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-14T22:24:26.393481] [INFO ] [MAIN ] Update Progress: 2307/2369 symbols completed. WMS took 32.6s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-14T22:24:26.561483] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:24:26.619979] [DEBUG] [LOCAL ] WOLF: Loaded 53171 existing records from primary storage. [2025-10-14T22:24:26.620285] [INFO ] [MAIN ] WOLF: Loaded 53171 existing records. [2025-10-14T22:24:26.797963] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:24:26.798228] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-14T22:24:26.798281] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-14T22:24:26.798735] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-14T22:24:26.798793] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-14T22:24:27.158513] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-14T22:24:27.187522] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:24:27.190145] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T22:24:27.261032] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-14T22:24:27.958070] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-14T22:24:28.758124] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-14T22:24:29.219590] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T22:24:29.349916] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-14T22:24:29.558064] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-14T22:24:29.887131] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T22:24:30.358147] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-14T22:24:31.158117] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-14T22:24:31.315325] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-14T22:24:31.958090] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-14T22:24:32.188475] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-14T22:24:32.259372] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-14T22:24:32.758098] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-14T22:24:33.093199] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-14T22:24:33.558059] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-14T22:24:34.358077] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-14T22:24:34.895615] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-14T22:24:35.158122] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-14T22:24:35.748780] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-14T22:24:35.960734] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-14T22:24:35.963984] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-14T22:24:36.758078] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-14T22:24:36.994673] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-14T22:24:37.344402] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T22:24:37.348901] [INFO ] [REMOTE ] WNS: Full fetch complete (55521 records). [2025-10-14T22:24:37.348999] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-14T22:24:37.569321] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-14T22:24:37.733293] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-14T22:24:37.733378] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-14T22:24:37.734451] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-14T22:24:37.734513] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-14T22:24:37.735629] [DEBUG] [LOCAL ] WNS: Trimmed 55521 records to 40118 (keeping 200 days of data) [2025-10-14T22:24:37.974902] [DEBUG] [LOCAL ] WNS: Primary data saved (40118 records). [2025-10-14T22:24:37.975028] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-14T22:24:37.975100] [INFO ] [MAIN ] Update Progress: 2308/2369 symbols completed. WNS took 23.0s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-14T22:24:38.150711] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:24:38.173635] [DEBUG] [LOCAL ] WOR: Loaded 24262 existing records from primary storage. [2025-10-14T22:24:38.173940] [INFO ] [MAIN ] WOR: Loaded 24262 existing records. [2025-10-14T22:24:38.359211] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:24:38.359320] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-14T22:24:38.359632] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-14T22:24:38.360501] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-14T22:24:38.360916] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-14T22:24:38.360975] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-14T22:24:38.733182] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:24:39.059155] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-14T22:24:39.158057] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-14T22:24:39.241983] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-14T22:24:39.963155] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-14T22:24:39.971691] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-14T22:24:40.759576] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-14T22:24:40.759489] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-14T22:24:41.553063] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-14T22:24:41.557291] [INFO ] [REMOTE ] WNC: Full fetch complete (57620 records). [2025-10-14T22:24:41.557384] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-14T22:24:41.568964] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-14T22:24:41.939947] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-14T22:24:41.940024] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-14T22:24:41.941091] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-14T22:24:41.941151] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-14T22:24:41.942222] [DEBUG] [LOCAL ] WNC: Trimmed 57620 records to 38582 (keeping 200 days of data) [2025-10-14T22:24:42.178258] [DEBUG] [LOCAL ] WNC: Primary data saved (38582 records). [2025-10-14T22:24:42.178402] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-14T22:24:42.178514] [INFO ] [MAIN ] Update Progress: 2309/2369 symbols completed. WNC took 30.5s. Estimated remaining: 8m 26s. Rate: 7.1 symbols/min [2025-10-14T22:24:42.348661] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:24:42.361984] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-14T22:24:42.389058] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-14T22:24:42.425205] [DEBUG] [LOCAL ] WOW: Loaded 30751 existing records from primary storage. [2025-10-14T22:24:42.425496] [INFO ] [MAIN ] WOW: Loaded 30751 existing records. [2025-10-14T22:24:42.597837] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:24:42.598068] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-14T22:24:42.598116] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-14T22:24:42.598275] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-14T22:24:42.598311] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-14T22:24:42.944380] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:24:43.158063] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-14T22:24:43.182538] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-14T22:24:43.937632] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-14T22:24:43.958025] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-14T22:24:44.205160] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T22:24:44.758059] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-14T22:24:45.558047] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-14T22:24:45.676439] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-14T22:24:46.071877] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-14T22:24:46.303505] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T22:24:46.358045] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-14T22:24:47.158102] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-14T22:24:47.769925] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-14T22:24:47.958068] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-14T22:24:48.758089] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-14T22:24:49.142422] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-14T22:24:49.223611] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-14T22:24:49.505165] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-14T22:24:49.558049] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-14T22:24:50.358077] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-14T22:24:50.843065] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-14T22:24:51.158087] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-14T22:24:51.958125] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-14T22:24:52.758092] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-14T22:24:52.864562] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-14T22:24:52.891596] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T22:24:53.558048] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-14T22:24:53.793421] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-14T22:24:54.030209] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-14T22:24:54.358044] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-14T22:24:54.747373] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-14T22:24:55.114502] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-14T22:24:55.158075] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-14T22:24:55.958040] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-14T22:24:56.295135] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-14T22:24:56.758108] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-14T22:24:57.545938] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-14T22:24:57.558019] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-14T22:24:58.358045] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-14T22:24:58.678953] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T22:24:59.158063] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-14T22:24:59.307553] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-14T22:24:59.958110] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-14T22:25:00.293764] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-14T22:25:00.435491] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-14T22:25:00.758076] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-14T22:25:00.819833] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-14T22:25:01.558075] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-14T22:25:02.358049] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-14T22:25:02.595982] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-14T22:25:02.599400] [INFO ] [REMOTE ] WOR: Full fetch complete (36290 records). [2025-10-14T22:25:02.599564] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-14T22:25:03.015491] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-14T22:25:03.015769] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-14T22:25:03.016693] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-14T22:25:03.016754] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-14T22:25:03.017511] [DEBUG] [LOCAL ] WOR: Trimmed 36290 records to 24101 (keeping 200 days of data) [2025-10-14T22:25:03.158086] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-14T22:25:03.165571] [DEBUG] [LOCAL ] WOR: Primary data saved (24101 records). [2025-10-14T22:25:03.165758] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-14T22:25:03.165849] [INFO ] [MAIN ] Update Progress: 2310/2369 symbols completed. WOR took 25.2s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-14T22:25:03.340546] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:03.377758] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-14T22:25:03.422757] [DEBUG] [LOCAL ] WPC: Loaded 48198 existing records from primary storage. [2025-10-14T22:25:03.423089] [INFO ] [MAIN ] WPC: Loaded 48198 existing records. [2025-10-14T22:25:03.605044] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:03.605494] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-14T22:25:03.605570] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-14T22:25:03.614052] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-14T22:25:03.627680] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-14T22:25:03.694539] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-14T22:25:03.966082] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-14T22:25:04.007032] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:04.758119] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-14T22:25:05.397011] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-14T22:25:05.558085] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-14T22:25:05.721759] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-14T22:25:06.358068] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-14T22:25:06.918242] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T22:25:06.922217] [INFO ] [REMOTE ] WOW: Full fetch complete (42720 records). [2025-10-14T22:25:06.922295] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-14T22:25:07.069432] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-14T22:25:07.099030] [INFO ] [REMOTE ] WOLF: Full fetch complete (77343 records). [2025-10-14T22:25:07.116557] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-14T22:25:07.167389] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-14T22:25:07.675128] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-14T22:25:07.675281] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-14T22:25:07.676293] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-14T22:25:07.676368] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-14T22:25:07.754937] [DEBUG] [LOCAL ] WOW: Trimmed 42720 records to 30915 (keeping 200 days of data) [2025-10-14T22:25:07.778785] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-14T22:25:07.779076] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-14T22:25:07.780070] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-14T22:25:07.822268] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-14T22:25:07.867366] [DEBUG] [LOCAL ] WOLF: Trimmed 77343 records to 53168 (keeping 200 days of data) [2025-10-14T22:25:07.991632] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-14T22:25:08.001998] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-14T22:25:08.004051] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-14T22:25:08.566690] [DEBUG] [LOCAL ] WOW: Primary data saved (30915 records). [2025-10-14T22:25:08.568912] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-14T22:25:08.545985] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-14T22:25:08.582397] [INFO ] [MAIN ] Update Progress: 2311/2369 symbols completed. WOW took 26.4s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-14T22:25:08.605858] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-14T22:25:08.708699] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-14T22:25:08.723672] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-14T22:25:08.730486] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-14T22:25:08.735752] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-14T22:25:08.782534] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-14T22:25:08.835528] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:09.160120] [DEBUG] [LOCAL ] WPM: Loaded 52763 existing records from primary storage. [2025-10-14T22:25:09.163095] [INFO ] [MAIN ] WPM: Loaded 52763 existing records. [2025-10-14T22:25:09.368259] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:09.369883] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-14T22:25:09.372246] [DEBUG] [LOCAL ] WOLF: Primary data saved (53168 records). [2025-10-14T22:25:09.372351] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-14T22:25:09.373285] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-14T22:25:09.373235] [INFO ] [MAIN ] Update Progress: 2312/2369 symbols completed. WOLF took 43.0s. Estimated remaining: 8m 1s. Rate: 7.1 symbols/min [2025-10-14T22:25:09.395192] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-14T22:25:09.395315] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-14T22:25:09.683246] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:10.008308] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:10.010261] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-14T22:25:10.025216] [DEBUG] [LOCAL ] WPP: Loaded 34374 existing records from primary storage. [2025-10-14T22:25:10.026294] [INFO ] [MAIN ] WPP: Loaded 34374 existing records. [2025-10-14T22:25:10.218622] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:10.221812] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-14T22:25:10.222167] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-14T22:25:10.223506] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-14T22:25:10.224400] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-14T22:25:10.304484] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-14T22:25:10.320614] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-14T22:25:10.331925] [INFO ] [MAIN ] Update Progress: 2313/2369 symbols completed. WMT took 1m 1s. Estimated remaining: 7m 52s. Rate: 7.1 symbols/min [2025-10-14T22:25:10.702901] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:10.781217] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:10.781638] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-14T22:25:10.809967] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-14T22:25:10.820934] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-14T22:25:10.858298] [DEBUG] [LOCAL ] WRB: Loaded 50777 existing records from primary storage. [2025-10-14T22:25:10.858612] [INFO ] [MAIN ] WRB: Loaded 50777 existing records. [2025-10-14T22:25:11.032083] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:11.032271] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-14T22:25:11.032319] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-14T22:25:11.032700] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-14T22:25:11.032759] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-14T22:25:11.391057] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:11.391398] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-14T22:25:11.713973] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-14T22:25:11.958132] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-14T22:25:11.988402] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-14T22:25:12.436676] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-14T22:25:12.737856] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-14T22:25:12.758025] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-14T22:25:13.558089] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-14T22:25:13.781267] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-14T22:25:14.358042] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-14T22:25:14.535447] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-14T22:25:14.593676] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T22:25:15.158057] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-14T22:25:15.702851] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-14T22:25:15.958053] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-14T22:25:16.764698] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-14T22:25:16.772762] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T22:25:17.546836] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-14T22:25:17.558025] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-14T22:25:18.358053] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-14T22:25:18.430928] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T22:25:19.000401] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T22:25:19.158093] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-14T22:25:19.958047] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-14T22:25:20.239020] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-14T22:25:20.380834] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-14T22:25:20.758090] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-14T22:25:21.558041] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-14T22:25:21.907416] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-14T22:25:21.969921] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T22:25:22.358065] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-14T22:25:22.995239] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T22:25:23.158038] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-14T22:25:23.371041] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-14T22:25:23.958063] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-14T22:25:24.758059] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-14T22:25:24.894418] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T22:25:25.558065] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-14T22:25:25.628344] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T22:25:25.686317] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-14T22:25:26.358067] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-14T22:25:27.158073] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-14T22:25:27.234873] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-14T22:25:27.958049] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-14T22:25:28.051446] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T22:25:28.758108] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-14T22:25:28.864508] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T22:25:29.429557] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-14T22:25:29.558064] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-14T22:25:29.764311] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-14T22:25:30.358074] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-14T22:25:31.098982] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-14T22:25:31.158129] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-14T22:25:31.958067] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-14T22:25:32.077836] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-14T22:25:32.763204] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-14T22:25:32.774861] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-14T22:25:33.558041] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-14T22:25:34.022525] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-14T22:25:34.358039] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-14T22:25:34.437149] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T22:25:34.872141] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-14T22:25:35.158070] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-14T22:25:35.467614] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-14T22:25:35.473438] [INFO ] [REMOTE ] WRB: Full fetch complete (73592 records). [2025-10-14T22:25:35.473581] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-14T22:25:35.860947] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-14T22:25:35.861057] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-14T22:25:35.862253] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-14T22:25:35.862320] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-14T22:25:35.863835] [DEBUG] [LOCAL ] WRB: Trimmed 73592 records to 50785 (keeping 200 days of data) [2025-10-14T22:25:35.960369] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-14T22:25:36.217909] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-14T22:25:36.253403] [DEBUG] [LOCAL ] WRB: Primary data saved (50785 records). [2025-10-14T22:25:36.253579] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-14T22:25:36.253704] [INFO ] [MAIN ] Update Progress: 2314/2369 symbols completed. WRB took 25.9s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-14T22:25:36.434632] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:36.483397] [DEBUG] [LOCAL ] WRBY: Loaded 50695 existing records from primary storage. [2025-10-14T22:25:36.483760] [INFO ] [MAIN ] WRBY: Loaded 50695 existing records. [2025-10-14T22:25:36.659068] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:36.659290] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-14T22:25:36.659335] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-14T22:25:36.659749] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-14T22:25:36.659805] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-14T22:25:36.758055] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-14T22:25:37.015055] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:37.558055] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-14T22:25:37.601904] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T22:25:38.358063] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-14T22:25:38.708558] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-14T22:25:38.756108] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T22:25:39.158067] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-14T22:25:39.730096] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-14T22:25:39.958073] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-14T22:25:40.756365] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T22:25:40.761939] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-14T22:25:40.763872] [INFO ] [REMOTE ] WPM: Full fetch complete (76200 records). [2025-10-14T22:25:40.764095] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-14T22:25:41.177415] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-14T22:25:41.177541] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-14T22:25:41.179082] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-14T22:25:41.179336] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-14T22:25:41.180993] [DEBUG] [LOCAL ] WPM: Trimmed 76200 records to 52772 (keeping 200 days of data) [2025-10-14T22:25:41.307777] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T22:25:41.549695] [DEBUG] [LOCAL ] WPM: Primary data saved (52772 records). [2025-10-14T22:25:41.549836] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-14T22:25:41.549913] [INFO ] [MAIN ] Update Progress: 2315/2369 symbols completed. WPM took 33.0s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-14T22:25:41.563285] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-14T22:25:41.725636] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:41.749595] [DEBUG] [LOCAL ] WS: Loaded 23444 existing records from primary storage. [2025-10-14T22:25:41.749902] [INFO ] [MAIN ] WS: Loaded 23444 existing records. [2025-10-14T22:25:41.943065] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:41.943580] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-14T22:25:41.943634] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-14T22:25:41.944119] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-14T22:25:41.944177] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-14T22:25:42.309097] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:42.358101] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-14T22:25:42.549144] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-14T22:25:43.158042] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-14T22:25:43.180901] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-14T22:25:43.249392] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-14T22:25:43.958039] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-14T22:25:44.435254] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-14T22:25:44.758155] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-14T22:25:45.122388] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-14T22:25:45.558148] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-14T22:25:46.200474] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-14T22:25:46.207852] [INFO ] [REMOTE ] WPC: Full fetch complete (70661 records). [2025-10-14T22:25:46.208029] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-14T22:25:46.363341] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-14T22:25:46.611807] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-14T22:25:46.611895] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-14T22:25:46.613061] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-14T22:25:46.613122] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-14T22:25:46.614343] [DEBUG] [LOCAL ] WPC: Trimmed 70661 records to 48209 (keeping 200 days of data) [2025-10-14T22:25:46.902552] [DEBUG] [LOCAL ] WPC: Primary data saved (48209 records). [2025-10-14T22:25:46.902692] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-14T22:25:46.902781] [INFO ] [MAIN ] Update Progress: 2316/2369 symbols completed. WPC took 43.7s. Estimated remaining: 7m 27s. Rate: 7.1 symbols/min [2025-10-14T22:25:47.053603] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-14T22:25:47.089330] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:25:47.086499] [INFO ] [REMOTE ] WPP: Full fetch complete (46875 records). [2025-10-14T22:25:47.089476] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-14T22:25:47.165436] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-14T22:25:47.471075] [DEBUG] [LOCAL ] WSM: Loaded 49208 existing records from primary storage. [2025-10-14T22:25:47.508638] [INFO ] [MAIN ] WSM: Loaded 49208 existing records. [2025-10-14T22:25:47.554464] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-14T22:25:47.580634] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-14T22:25:47.599106] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-14T22:25:47.618135] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-14T22:25:47.710555] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:25:47.674920] [DEBUG] [LOCAL ] WPP: Trimmed 46875 records to 34428 (keeping 200 days of data) [2025-10-14T22:25:47.712519] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-14T22:25:47.713814] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-14T22:25:47.714978] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T22:25:47.771290] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-14T22:25:47.780954] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-14T22:25:47.961917] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-14T22:25:48.199554] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:25:48.290980] [DEBUG] [LOCAL ] WPP: Primary data saved (34428 records). [2025-10-14T22:25:48.291107] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-14T22:25:48.291181] [INFO ] [MAIN ] Update Progress: 2317/2369 symbols completed. WPP took 38.9s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-14T22:25:48.758120] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-14T22:25:48.944556] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-14T22:25:48.985930] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-14T22:25:49.558099] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-14T22:25:50.358083] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-14T22:25:50.696275] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-14T22:25:50.877154] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-14T22:25:51.158120] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-14T22:25:51.958212] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-14T22:25:52.332517] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T22:25:52.758044] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-14T22:25:52.997550] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-14T22:25:53.100396] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-14T22:25:53.558074] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-14T22:25:54.358099] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-14T22:25:54.627178] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-14T22:25:54.878291] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-14T22:25:55.158088] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-14T22:25:55.511233] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-14T22:25:55.958126] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-14T22:25:56.758095] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-14T22:25:56.787270] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T22:25:57.558088] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-14T22:25:57.961636] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-14T22:25:58.008143] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-14T22:25:58.358055] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-14T22:25:58.875591] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-14T22:25:59.158062] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-14T22:25:59.899137] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T22:25:59.958084] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-14T22:26:00.758080] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-14T22:26:00.824066] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-14T22:26:01.116015] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-14T22:26:01.558081] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-14T22:26:02.358123] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-14T22:26:02.463819] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-14T22:26:03.163315] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-14T22:26:03.187314] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T22:26:03.232252] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-14T22:26:03.958093] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-14T22:26:04.758143] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-14T22:26:05.139338] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-14T22:26:05.505606] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T22:26:05.511343] [INFO ] [REMOTE ] WRBY: Full fetch complete (73691 records). [2025-10-14T22:26:05.511470] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-14T22:26:05.566868] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-14T22:26:05.821854] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-14T22:26:05.825422] [INFO ] [REMOTE ] WS: Full fetch complete (36061 records). [2025-10-14T22:26:05.830973] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-14T22:26:06.039902] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-14T22:26:06.045476] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-14T22:26:06.057128] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-14T22:26:06.062329] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-14T22:26:06.104011] [DEBUG] [LOCAL ] WRBY: Trimmed 73691 records to 50719 (keeping 200 days of data) [2025-10-14T22:26:06.508944] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-14T22:26:06.535909] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-14T22:26:06.553218] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-14T22:26:06.553962] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-14T22:26:06.558990] [DEBUG] [LOCAL ] WS: Trimmed 36061 records to 23392 (keeping 200 days of data) [2025-10-14T22:26:06.783753] [DEBUG] [LOCAL ] WRBY: Primary data saved (50719 records). [2025-10-14T22:26:06.784751] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-14T22:26:06.787106] [INFO ] [MAIN ] Update Progress: 2318/2369 symbols completed. WRBY took 30.5s. Estimated remaining: 7m 10s. Rate: 7.1 symbols/min [2025-10-14T22:26:06.789259] [DEBUG] [LOCAL ] WS: Primary data saved (23392 records). [2025-10-14T22:26:06.789382] [INFO ] [MAIN ] WS: Full history saved. [2025-10-14T22:26:06.789458] [INFO ] [MAIN ] Update Progress: 2319/2369 symbols completed. WS took 25.2s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-14T22:26:07.372313] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-14T22:26:07.383287] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-14T22:26:08.830679] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-14T22:26:08.841609] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-14T22:26:10.500027] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-14T22:26:10.510082] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-14T22:26:11.095178] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-14T22:26:11.100355] [INFO ] [REMOTE ] WSM: Full fetch complete (71718 records). [2025-10-14T22:26:11.100471] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-14T22:26:11.489718] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-14T22:26:11.489799] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-14T22:26:11.490981] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-14T22:26:11.491039] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-14T22:26:11.492274] [DEBUG] [LOCAL ] WSM: Trimmed 71718 records to 49186 (keeping 200 days of data) [2025-10-14T22:26:11.791632] [DEBUG] [LOCAL ] WSM: Primary data saved (49186 records). [2025-10-14T22:26:11.791785] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-14T22:26:11.792532] [INFO ] [MAIN ] Update Progress: 2320/2369 symbols completed. WSM took 24.9s. Estimated remaining: 6m 53s. Rate: 7.1 symbols/min [2025-10-14T22:26:12.442918] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:12.492721] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:12.489689] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:12.512585] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:12.551123] [DEBUG] [LOCAL ] WSR: Loaded 22987 existing records from primary storage. [2025-10-14T22:26:12.552799] [INFO ] [MAIN ] WSR: Loaded 22987 existing records. [2025-10-14T22:26:12.558562] [DEBUG] [LOCAL ] WSO: Loaded 25486 existing records from primary storage. [2025-10-14T22:26:12.567687] [INFO ] [MAIN ] WSO: Loaded 25486 existing records. [2025-10-14T22:26:12.790938] [DEBUG] [LOCAL ] WST: Loaded 36798 existing records from primary storage. [2025-10-14T22:26:12.819722] [DEBUG] [LOCAL ] WT: Loaded 47986 existing records from primary storage. [2025-10-14T22:26:12.825281] [INFO ] [MAIN ] WST: Loaded 36798 existing records. [2025-10-14T22:26:12.830715] [INFO ] [MAIN ] WT: Loaded 47986 existing records. [2025-10-14T22:26:13.162098] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:13.159008] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:13.196896] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-14T22:26:13.197050] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-14T22:26:13.186749] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-14T22:26:13.218106] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-14T22:26:13.303282] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-14T22:26:13.268663] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-14T22:26:13.360375] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:13.360672] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-14T22:26:13.360539] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-14T22:26:13.330408] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:13.377918] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-14T22:26:13.372396] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-14T22:26:13.383914] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-14T22:26:13.404862] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-14T22:26:13.460406] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-14T22:26:13.501497] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-14T22:26:13.532708] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-14T22:26:13.501586] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-14T22:26:14.600921] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:14.620853] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-14T22:26:14.604380] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:14.642210] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-14T22:26:14.898248] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:14.908831] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-14T22:26:14.974765] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:14.975142] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-14T22:26:15.762231] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-14T22:26:15.766248] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-14T22:26:15.841843] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-14T22:26:15.846501] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-14T22:26:15.980199] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-14T22:26:15.986843] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-14T22:26:16.166970] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-14T22:26:16.176451] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-14T22:26:16.535800] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T22:26:16.540009] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-14T22:26:16.890305] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-14T22:26:16.894911] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-14T22:26:16.998936] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-14T22:26:17.005560] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-14T22:26:17.523760] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T22:26:17.558025] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-14T22:26:17.745791] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T22:26:17.884830] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-14T22:26:18.358031] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-14T22:26:18.522270] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T22:26:18.802927] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-14T22:26:19.152281] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-14T22:26:19.158074] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-14T22:26:19.958080] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-14T22:26:20.758103] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-14T22:26:20.824246] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-14T22:26:21.139332] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-14T22:26:21.558070] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-14T22:26:22.358051] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-14T22:26:22.418838] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-14T22:26:23.163103] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-14T22:26:23.168032] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-14T22:26:23.654073] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T22:26:23.958070] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-14T22:26:24.701680] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-14T22:26:24.747702] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-14T22:26:24.758026] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-14T22:26:25.558086] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-14T22:26:25.949796] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-14T22:26:26.358112] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-14T22:26:26.769914] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-14T22:26:27.158100] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-14T22:26:27.955057] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-14T22:26:27.963576] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-14T22:26:27.979940] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-14T22:26:28.758081] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-14T22:26:29.054948] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-14T22:26:29.558080] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-14T22:26:30.070140] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T22:26:30.358078] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-14T22:26:30.737470] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-14T22:26:31.158095] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-14T22:26:31.239018] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-14T22:26:31.958044] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-14T22:26:32.758053] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-14T22:26:32.925704] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T22:26:33.016027] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-14T22:26:33.544976] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-14T22:26:33.558064] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-14T22:26:34.358105] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-14T22:26:35.063209] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-14T22:26:35.158051] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-14T22:26:35.845231] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T22:26:35.958133] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-14T22:26:36.659254] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-14T22:26:36.758039] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-14T22:26:36.816766] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-14T22:26:37.558057] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-14T22:26:38.021668] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T22:26:38.358120] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-14T22:26:38.606069] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-14T22:26:39.158152] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-14T22:26:39.958125] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-14T22:26:40.007122] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T22:26:40.267573] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-14T22:26:40.758115] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-14T22:26:41.003896] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-14T22:26:41.006936] [INFO ] [REMOTE ] WSR: Full fetch complete (32698 records). [2025-10-14T22:26:41.007051] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-14T22:26:41.397214] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-14T22:26:41.397317] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-14T22:26:41.398613] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-14T22:26:41.398703] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-14T22:26:41.399931] [DEBUG] [LOCAL ] WSR: Trimmed 32698 records to 22994 (keeping 200 days of data) [2025-10-14T22:26:41.556378] [DEBUG] [LOCAL ] WSR: Primary data saved (22994 records). [2025-10-14T22:26:41.556590] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-14T22:26:41.556740] [INFO ] [MAIN ] Update Progress: 2321/2369 symbols completed. WSR took 29.8s. Estimated remaining: 6m 45s. Rate: 7.1 symbols/min [2025-10-14T22:26:41.569403] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-14T22:26:41.749139] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:41.795929] [DEBUG] [LOCAL ] WTI: Loaded 44466 existing records from primary storage. [2025-10-14T22:26:41.796323] [INFO ] [MAIN ] WTI: Loaded 44466 existing records. [2025-10-14T22:26:41.992416] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:41.992774] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-14T22:26:41.992839] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-14T22:26:41.993270] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-14T22:26:41.993330] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-14T22:26:42.128337] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-14T22:26:42.177713] [INFO ] [REMOTE ] WSO: Full fetch complete (35222 records). [2025-10-14T22:26:42.193862] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-14T22:26:42.373291] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-14T22:26:42.498448] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:42.791219] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-14T22:26:42.791331] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-14T22:26:42.792867] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-14T22:26:42.793172] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-14T22:26:42.794465] [DEBUG] [LOCAL ] WSO: Trimmed 35222 records to 25521 (keeping 200 days of data) [2025-10-14T22:26:42.966284] [DEBUG] [LOCAL ] WSO: Primary data saved (25521 records). [2025-10-14T22:26:42.966494] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-14T22:26:42.966613] [INFO ] [MAIN ] Update Progress: 2322/2369 symbols completed. WSO took 31.2s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-14T22:26:43.139979] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:43.140301] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-14T22:26:43.140408] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-14T22:26:43.140555] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-14T22:26:43.140674] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-14T22:26:43.140817] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-14T22:26:43.141030] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-14T22:26:43.159413] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-14T22:26:43.174783] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T22:26:43.530524] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:43.730480] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T22:26:43.737251] [INFO ] [REMOTE ] WT: Full fetch complete (69560 records). [2025-10-14T22:26:43.737402] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-14T22:26:43.971160] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-14T22:26:44.167930] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-14T22:26:44.168015] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-14T22:26:44.169255] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-14T22:26:44.169316] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-14T22:26:44.170640] [DEBUG] [LOCAL ] WT: Trimmed 69560 records to 48029 (keeping 200 days of data) [2025-10-14T22:26:44.448800] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-14T22:26:44.462634] [DEBUG] [LOCAL ] WT: Primary data saved (48029 records). [2025-10-14T22:26:44.462818] [INFO ] [MAIN ] WT: Full history saved. [2025-10-14T22:26:44.463880] [INFO ] [MAIN ] Update Progress: 2323/2369 symbols completed. WT took 32.6s. Estimated remaining: 6m 28s. Rate: 7.1 symbols/min [2025-10-14T22:26:44.631613] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:44.681748] [DEBUG] [LOCAL ] WTRG: Loaded 51008 existing records from primary storage. [2025-10-14T22:26:44.682038] [INFO ] [MAIN ] WTRG: Loaded 51008 existing records. [2025-10-14T22:26:44.759863] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-14T22:26:44.870583] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:44.870959] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-14T22:26:44.871016] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-14T22:26:44.871281] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-14T22:26:44.871322] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-14T22:26:45.186360] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-14T22:26:45.272557] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:45.359886] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T22:26:45.364793] [INFO ] [REMOTE ] WST: Full fetch complete (54041 records). [2025-10-14T22:26:45.364998] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-14T22:26:45.563239] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-14T22:26:45.756381] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-14T22:26:45.756482] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-14T22:26:45.758596] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-14T22:26:45.758686] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-14T22:26:45.760105] [DEBUG] [LOCAL ] WST: Trimmed 54041 records to 36760 (keeping 200 days of data) [2025-10-14T22:26:46.000466] [DEBUG] [LOCAL ] WST: Primary data saved (36760 records). [2025-10-14T22:26:46.000669] [INFO ] [MAIN ] WST: Full history saved. [2025-10-14T22:26:46.000826] [INFO ] [MAIN ] Update Progress: 2324/2369 symbols completed. WST took 34.2s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-14T22:26:46.170219] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:46.191075] [DEBUG] [LOCAL ] WTS: Loaded 17552 existing records from primary storage. [2025-10-14T22:26:46.191377] [INFO ] [MAIN ] WTS: Loaded 17552 existing records. [2025-10-14T22:26:46.361046] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-14T22:26:46.372734] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:46.373974] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-14T22:26:46.374032] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-14T22:26:46.374330] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-14T22:26:46.374375] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-14T22:26:46.756514] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:46.864751] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-14T22:26:47.080600] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-14T22:26:47.158039] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-14T22:26:47.958130] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-14T22:26:48.758124] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-14T22:26:48.913914] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T22:26:49.424906] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T22:26:49.558049] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-14T22:26:49.805473] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-14T22:26:49.971287] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-14T22:26:50.358071] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-14T22:26:51.158091] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-14T22:26:51.263247] [DEBUG] [REMOTE ] WTM: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-14T22:26:51.263544] [WARN ] [REMOTE ] WTM: No data returned for month 2025-03 [2025-10-14T22:26:51.263632] [FATAL] [REMOTE ] WTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:26:51.263755] [FATAL] [MAIN ] WTM: Failed to fetch primary data. [2025-10-14T22:26:51.263820] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:26:51.263892] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-14T22:26:51.263973] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-14T22:26:51.264008] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-14T22:26:51.264046] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-14T22:26:51.264089] [INFO ] [MAIN ] Update Progress: 2325/2369 symbols completed. WTM took 8.3s. Estimated remaining: 6m 11s. Rate: 7.1 symbols/min [2025-10-14T22:26:51.431824] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:26:51.479618] [DEBUG] [LOCAL ] WTTR: Loaded 44571 existing records from primary storage. [2025-10-14T22:26:51.480080] [INFO ] [MAIN ] WTTR: Loaded 44571 existing records. [2025-10-14T22:26:51.693401] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:26:51.693705] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-14T22:26:51.693762] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-14T22:26:51.693936] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-14T22:26:51.693974] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-14T22:26:51.886443] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T22:26:51.960018] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-14T22:26:52.108137] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:26:52.758097] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-14T22:26:53.523102] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-14T22:26:53.558026] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-14T22:26:54.285890] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-14T22:26:54.358057] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-14T22:26:55.159925] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-14T22:26:55.164933] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T22:26:55.434952] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-14T22:26:55.958075] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-14T22:26:56.656497] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-14T22:26:56.758025] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-14T22:26:57.558047] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-14T22:26:57.588819] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T22:26:57.811798] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-14T22:26:58.358107] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-14T22:26:59.166129] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-14T22:26:59.184896] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T22:26:59.958089] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-14T22:26:59.999528] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T22:27:00.020676] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T22:27:00.758086] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-14T22:27:01.513260] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-14T22:27:01.558095] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-14T22:27:02.358083] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-14T22:27:02.613359] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T22:27:03.158046] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-14T22:27:03.312162] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-14T22:27:03.963578] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-14T22:27:03.988587] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-14T22:27:04.013103] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-14T22:27:04.758053] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-14T22:27:05.558061] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-14T22:27:05.638976] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T22:27:06.358124] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-14T22:27:06.402743] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T22:27:06.469524] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-14T22:27:07.158072] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-14T22:27:07.473266] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-14T22:27:07.958057] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-14T22:27:08.200560] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-14T22:27:08.758073] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-14T22:27:09.057703] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-14T22:27:09.558090] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-14T22:27:09.937928] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-14T22:27:10.358063] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-14T22:27:10.973346] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T22:27:11.158066] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-14T22:27:11.955509] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-14T22:27:11.964194] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-14T22:27:12.758029] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-14T22:27:12.796703] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-14T22:27:12.922725] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T22:27:13.558079] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-14T22:27:14.358409] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-14T22:27:14.360903] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-14T22:27:14.367042] [INFO ] [REMOTE ] WTI: Full fetch complete (64214 records). [2025-10-14T22:27:14.367138] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-14T22:27:14.772774] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-14T22:27:14.772850] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-14T22:27:14.774110] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-14T22:27:14.774193] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-14T22:27:14.776007] [DEBUG] [LOCAL ] WTI: Trimmed 64214 records to 44501 (keeping 200 days of data) [2025-10-14T22:27:15.001236] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-14T22:27:15.067229] [DEBUG] [LOCAL ] WTI: Primary data saved (44501 records). [2025-10-14T22:27:15.067351] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-14T22:27:15.067426] [INFO ] [MAIN ] Update Progress: 2326/2369 symbols completed. WTI took 33.5s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-14T22:27:15.164862] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-14T22:27:15.237850] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:15.289238] [DEBUG] [LOCAL ] WU: Loaded 53470 existing records from primary storage. [2025-10-14T22:27:15.289698] [INFO ] [MAIN ] WU: Loaded 53470 existing records. [2025-10-14T22:27:15.468216] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:15.468481] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-14T22:27:15.468539] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-14T22:27:15.468826] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-14T22:27:15.468886] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-14T22:27:15.873825] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:15.876462] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-14T22:27:15.958056] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-14T22:27:16.144849] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-14T22:27:16.758144] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-14T22:27:17.421492] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-14T22:27:17.428480] [INFO ] [REMOTE ] WTTR: Full fetch complete (65512 records). [2025-10-14T22:27:17.428711] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-14T22:27:17.573028] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-14T22:27:17.819616] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-14T22:27:17.819719] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-14T22:27:17.820828] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-14T22:27:17.820887] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-14T22:27:17.822092] [DEBUG] [LOCAL ] WTTR: Trimmed 65512 records to 44560 (keeping 200 days of data) [2025-10-14T22:27:18.079638] [DEBUG] [LOCAL ] WTTR: Primary data saved (44560 records). [2025-10-14T22:27:18.079782] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-14T22:27:18.079859] [INFO ] [MAIN ] Update Progress: 2327/2369 symbols completed. WTTR took 26.8s. Estimated remaining: 5m 54s. Rate: 7.1 symbols/min [2025-10-14T22:27:18.248145] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:18.292030] [DEBUG] [LOCAL ] WWW: Loaded 49251 existing records from primary storage. [2025-10-14T22:27:18.292341] [INFO ] [MAIN ] WWW: Loaded 49251 existing records. [2025-10-14T22:27:18.367179] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-14T22:27:18.471184] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:18.471415] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-14T22:27:18.471468] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-14T22:27:18.472010] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-14T22:27:18.472073] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-14T22:27:18.858712] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:18.861526] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-14T22:27:18.884917] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-14T22:27:19.158135] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-14T22:27:19.958071] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-14T22:27:20.275068] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-14T22:27:20.585736] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T22:27:20.758035] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-14T22:27:21.558057] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-14T22:27:21.713813] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-14T22:27:22.358114] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-14T22:27:22.428217] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-14T22:27:23.008820] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T22:27:23.158028] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-14T22:27:23.921939] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-14T22:27:23.958043] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-14T22:27:24.758056] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-14T22:27:24.907727] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-14T22:27:25.111440] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-14T22:27:25.381533] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-14T22:27:25.558031] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-14T22:27:26.056807] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-14T22:27:26.058709] [INFO ] [REMOTE ] WTS: Full fetch complete (25668 records). [2025-10-14T22:27:26.058780] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-14T22:27:26.363268] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-14T22:27:26.424204] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-14T22:27:26.424285] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-14T22:27:26.424840] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-14T22:27:26.424900] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-14T22:27:26.425507] [DEBUG] [LOCAL ] WTS: Trimmed 25668 records to 17497 (keeping 200 days of data) [2025-10-14T22:27:26.532313] [DEBUG] [LOCAL ] WTS: Primary data saved (17497 records). [2025-10-14T22:27:26.532446] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-14T22:27:26.532527] [INFO ] [MAIN ] Update Progress: 2328/2369 symbols completed. WTS took 40.5s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-14T22:27:26.698347] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:26.747082] [DEBUG] [LOCAL ] WY: Loaded 53192 existing records from primary storage. [2025-10-14T22:27:26.747413] [INFO ] [MAIN ] WY: Loaded 53192 existing records. [2025-10-14T22:27:26.921478] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:26.921719] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-14T22:27:26.921775] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-14T22:27:26.921952] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-14T22:27:26.921990] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-14T22:27:27.163200] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-14T22:27:27.271913] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:27.895636] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-14T22:27:27.901822] [INFO ] [REMOTE ] WTRG: Full fetch complete (73691 records). [2025-10-14T22:27:27.901976] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-14T22:27:27.968049] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-14T22:27:28.290764] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-14T22:27:28.290841] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-14T22:27:28.292029] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-14T22:27:28.292089] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-14T22:27:28.293449] [DEBUG] [LOCAL ] WTRG: Trimmed 73691 records to 50985 (keeping 200 days of data) [2025-10-14T22:27:28.599852] [DEBUG] [LOCAL ] WTRG: Primary data saved (50985 records). [2025-10-14T22:27:28.599977] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-14T22:27:28.600054] [INFO ] [MAIN ] Update Progress: 2329/2369 symbols completed. WTRG took 44.1s. Estimated remaining: 5m 37s. Rate: 7.1 symbols/min [2025-10-14T22:27:28.766170] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-14T22:27:28.770242] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:28.799142] [DEBUG] [LOCAL ] XFLT: Loaded 29895 existing records from primary storage. [2025-10-14T22:27:28.799406] [INFO ] [MAIN ] XFLT: Loaded 29895 existing records. [2025-10-14T22:27:28.986451] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:28.986890] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-14T22:27:28.986971] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-14T22:27:28.987685] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-14T22:27:28.987746] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-14T22:27:29.175156] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-14T22:27:29.391923] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:29.558037] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-14T22:27:29.889692] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T22:27:30.358045] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-14T22:27:30.493627] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-14T22:27:30.810369] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-14T22:27:31.158080] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-14T22:27:31.958107] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-14T22:27:32.210911] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T22:27:32.587816] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-14T22:27:32.758110] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-14T22:27:33.496779] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-14T22:27:33.558024] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-14T22:27:34.358066] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-14T22:27:34.451521] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-14T22:27:35.158107] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-14T22:27:35.256706] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-14T22:27:35.604921] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-14T22:27:35.958118] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-14T22:27:36.758099] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-14T22:27:36.857323] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-14T22:27:37.558045] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-14T22:27:37.609918] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-14T22:27:37.757300] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-14T22:27:38.358062] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-14T22:27:39.166467] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-14T22:27:39.184638] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-14T22:27:39.734733] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-14T22:27:39.958061] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-14T22:27:40.758128] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-14T22:27:41.011900] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-14T22:27:41.558109] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-14T22:27:41.814471] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-14T22:27:41.849078] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-14T22:27:42.358121] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-14T22:27:43.158092] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-14T22:27:43.340868] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T22:27:43.958087] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-14T22:27:44.315515] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-14T22:27:44.758063] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-14T22:27:45.093055] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T22:27:45.506742] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T22:27:45.558027] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-14T22:27:46.000519] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T22:27:46.358072] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-14T22:27:47.158108] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-14T22:27:47.210258] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-14T22:27:47.958187] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-14T22:27:47.968310] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-14T22:27:48.497139] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-14T22:27:48.758090] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-14T22:27:49.558088] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-14T22:27:49.678808] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-14T22:27:49.765360] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-14T22:27:50.358117] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-14T22:27:51.158072] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-14T22:27:51.500776] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-14T22:27:51.958092] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-14T22:27:52.139789] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T22:27:52.630444] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T22:27:52.758075] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-14T22:27:52.866881] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-14T22:27:53.558076] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-14T22:27:54.311291] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-14T22:27:54.317064] [INFO ] [REMOTE ] WWW: Full fetch complete (70458 records). [2025-10-14T22:27:54.317220] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-14T22:27:54.363167] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-14T22:27:54.714916] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-14T22:27:54.714995] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-14T22:27:54.716217] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-14T22:27:54.716277] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-14T22:27:54.717594] [DEBUG] [LOCAL ] WWW: Trimmed 70458 records to 49188 (keeping 200 days of data) [2025-10-14T22:27:55.012717] [DEBUG] [LOCAL ] WWW: Primary data saved (49188 records). [2025-10-14T22:27:55.012849] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-14T22:27:55.012931] [INFO ] [MAIN ] Update Progress: 2330/2369 symbols completed. WWW took 36.9s. Estimated remaining: 5m 29s. Rate: 7.1 symbols/min [2025-10-14T22:27:55.163681] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-14T22:27:55.183380] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:55.222303] [DEBUG] [LOCAL ] XHR: Loaded 43633 existing records from primary storage. [2025-10-14T22:27:55.222575] [INFO ] [MAIN ] XHR: Loaded 43633 existing records. [2025-10-14T22:27:55.403144] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:55.403355] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-14T22:27:55.403402] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-14T22:27:55.404078] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-14T22:27:55.404133] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-14T22:27:55.691531] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-14T22:27:55.713772] [INFO ] [REMOTE ] WU: Full fetch complete (77509 records). [2025-10-14T22:27:55.729686] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-14T22:27:55.831020] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:55.964204] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-14T22:27:56.192615] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-14T22:27:56.192836] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-14T22:27:56.194284] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-14T22:27:56.194365] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-14T22:27:56.195949] [DEBUG] [LOCAL ] WU: Trimmed 77509 records to 53481 (keeping 200 days of data) [2025-10-14T22:27:56.321501] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-14T22:27:56.360712] [INFO ] [REMOTE ] XFLT: Full fetch complete (43778 records). [2025-10-14T22:27:56.361496] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-14T22:27:56.363590] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-14T22:27:56.767548] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-14T22:27:56.984909] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-14T22:27:56.988665] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-14T22:27:56.992791] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-14T22:27:56.994252] [DEBUG] [LOCAL ] WU: Primary data saved (53481 records). [2025-10-14T22:27:56.994411] [INFO ] [MAIN ] WU: Full history saved. [2025-10-14T22:27:56.994514] [INFO ] [MAIN ] Update Progress: 2331/2369 symbols completed. WU took 41.9s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-14T22:27:56.994312] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-14T22:27:57.087203] [DEBUG] [LOCAL ] XFLT: Trimmed 43778 records to 29906 (keeping 200 days of data) [2025-10-14T22:27:57.258264] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:57.264138] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-14T22:27:57.269109] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-14T22:27:57.278463] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-14T22:27:57.278833] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-14T22:27:57.280139] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-14T22:27:57.280227] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-14T22:27:57.538223] [DEBUG] [LOCAL ] XFLT: Primary data saved (29906 records). [2025-10-14T22:27:57.558029] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-14T22:27:57.563330] [INFO ] [MAIN ] Update Progress: 2332/2369 symbols completed. XFLT took 29.0s. Estimated remaining: 5m 12s. Rate: 7.1 symbols/min [2025-10-14T22:27:57.763023] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-14T22:27:57.811367] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-14T22:27:57.873855] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:57.919664] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:57.971177] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-14T22:27:57.971494] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-14T22:27:58.149818] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:58.150050] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-14T22:27:58.150096] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-14T22:27:58.151008] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-14T22:27:58.151065] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-14T22:27:58.363311] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-14T22:27:58.516141] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:58.550177] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-14T22:27:58.635495] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:27:58.635913] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-14T22:27:58.636008] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:27:58.636070] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-14T22:27:58.636141] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:27:58.636225] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-14T22:27:58.636308] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-14T22:27:58.636417] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-14T22:27:58.636494] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-14T22:27:58.636547] [INFO ] [MAIN ] Update Progress: 2333/2369 symbols completed. XIFR took 1.6s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-14T22:27:58.803784] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:27:58.831462] [DEBUG] [LOCAL ] XPER: Loaded 30245 existing records from primary storage. [2025-10-14T22:27:58.831759] [INFO ] [MAIN ] XPER: Loaded 30245 existing records. [2025-10-14T22:27:59.008613] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:27:59.008836] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-14T22:27:59.008912] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-14T22:27:59.009426] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-14T22:27:59.009484] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-14T22:27:59.160046] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-14T22:27:59.411442] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-14T22:27:59.410389] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:27:59.958136] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-14T22:28:00.758111] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-14T22:28:00.990815] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-14T22:28:01.558036] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-14T22:28:01.821732] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-14T22:28:02.105068] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T22:28:02.358093] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-14T22:28:02.840271] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-14T22:28:03.158071] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-14T22:28:03.958080] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-14T22:28:04.052240] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-14T22:28:04.758046] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-14T22:28:05.171911] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-14T22:28:05.563156] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-14T22:28:05.583562] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-14T22:28:06.055226] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-14T22:28:06.188875] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-14T22:28:06.198498] [INFO ] [REMOTE ] WY: Full fetch complete (77024 records). [2025-10-14T22:28:06.198744] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-14T22:28:06.365843] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-14T22:28:06.778459] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-14T22:28:06.778851] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-14T22:28:06.780781] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-14T22:28:06.780894] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-14T22:28:06.782788] [DEBUG] [LOCAL ] WY: Trimmed 77024 records to 53199 (keeping 200 days of data) [2025-10-14T22:28:07.135242] [DEBUG] [LOCAL ] WY: Primary data saved (53199 records). [2025-10-14T22:28:07.135393] [INFO ] [MAIN ] WY: Full history saved. [2025-10-14T22:28:07.135471] [INFO ] [MAIN ] Update Progress: 2334/2369 symbols completed. WY took 40.6s. Estimated remaining: 4m 55s. Rate: 7.1 symbols/min [2025-10-14T22:28:07.166378] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-14T22:28:07.308251] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:28:07.355902] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-14T22:28:07.356292] [INFO ] [MAIN ] XPEV: Loaded 53634 existing records. [2025-10-14T22:28:07.535771] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:28:07.536024] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-14T22:28:07.536098] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-14T22:28:07.537151] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-14T22:28:07.537209] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-14T22:28:07.865312] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-14T22:28:07.921163] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:28:07.958024] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-14T22:28:08.543081] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-14T22:28:08.758075] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-14T22:28:09.558059] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-14T22:28:09.873433] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-14T22:28:10.358063] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-14T22:28:10.524257] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-14T22:28:10.625781] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-14T22:28:11.158068] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-14T22:28:11.958108] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-14T22:28:12.529540] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-14T22:28:12.743807] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-14T22:28:12.758034] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-14T22:28:13.173918] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-14T22:28:13.558089] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-14T22:28:14.268100] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-14T22:28:14.358081] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-14T22:28:15.158033] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-14T22:28:15.544038] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T22:28:15.569742] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T22:28:15.958053] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-14T22:28:16.758047] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-14T22:28:17.089229] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-14T22:28:17.391318] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-14T22:28:17.558072] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-14T22:28:18.358107] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-14T22:28:19.158119] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-14T22:28:19.281863] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-14T22:28:19.776984] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-14T22:28:19.898248] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-14T22:28:19.958093] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-14T22:28:20.460442] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-14T22:28:20.758034] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-14T22:28:21.238530] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-14T22:28:21.558060] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-14T22:28:22.358121] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-14T22:28:22.673129] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-14T22:28:22.677355] [INFO ] [REMOTE ] XPER: Full fetch complete (43374 records). [2025-10-14T22:28:22.677433] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-14T22:28:23.056636] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-14T22:28:23.056768] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-14T22:28:23.057731] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-14T22:28:23.057809] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-14T22:28:23.069607] [DEBUG] [LOCAL ] XPER: Trimmed 43374 records to 30321 (keeping 200 days of data) [2025-10-14T22:28:23.089126] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-14T22:28:23.178846] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-14T22:28:23.277954] [DEBUG] [LOCAL ] XPER: Primary data saved (30321 records). [2025-10-14T22:28:23.278083] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-14T22:28:23.278162] [INFO ] [MAIN ] Update Progress: 2335/2369 symbols completed. XPER took 24.6s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-14T22:28:23.464102] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:28:23.507486] [DEBUG] [LOCAL ] XPO: Loaded 47760 existing records from primary storage. [2025-10-14T22:28:23.507861] [INFO ] [MAIN ] XPO: Loaded 47760 existing records. [2025-10-14T22:28:23.686820] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:28:23.687025] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-14T22:28:23.687072] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-14T22:28:23.687831] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-14T22:28:23.687910] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-14T22:28:23.963964] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-14T22:28:24.045367] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:28:24.752783] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-14T22:28:24.763507] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-14T22:28:25.535628] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-14T22:28:25.558040] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-14T22:28:25.596017] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T22:28:26.161604] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-14T22:28:26.358045] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-14T22:28:27.158080] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-14T22:28:27.832861] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-14T22:28:27.873301] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T22:28:27.958028] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-14T22:28:28.758139] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-14T22:28:29.484275] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-14T22:28:29.558101] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-14T22:28:29.607142] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-14T22:28:30.358089] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-14T22:28:30.867028] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-14T22:28:30.871835] [INFO ] [REMOTE ] XHR: Full fetch complete (61887 records). [2025-10-14T22:28:30.871939] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-14T22:28:31.166989] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-14T22:28:31.290132] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-14T22:28:31.321705] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-14T22:28:31.321944] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-14T22:28:31.323207] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-14T22:28:31.323289] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-14T22:28:31.324738] [DEBUG] [LOCAL ] XHR: Trimmed 61887 records to 43595 (keeping 200 days of data) [2025-10-14T22:28:31.587486] [DEBUG] [LOCAL ] XHR: Primary data saved (43595 records). [2025-10-14T22:28:31.587778] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-14T22:28:31.587922] [INFO ] [MAIN ] Update Progress: 2336/2369 symbols completed. XHR took 36.6s. Estimated remaining: 4m 38s. Rate: 7.1 symbols/min [2025-10-14T22:28:31.763408] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:28:31.793613] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-14T22:28:31.837735] [DEBUG] [LOCAL ] XPOF: Loaded 37558 existing records from primary storage. [2025-10-14T22:28:31.838102] [INFO ] [MAIN ] XPOF: Loaded 37558 existing records. [2025-10-14T22:28:31.963224] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-14T22:28:32.023557] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:28:32.023973] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-14T22:28:32.024030] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-14T22:28:32.024578] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-14T22:28:32.024635] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-14T22:28:32.414727] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:28:32.758042] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-14T22:28:33.558081] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-14T22:28:33.728245] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-14T22:28:33.765578] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-14T22:28:34.019168] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-14T22:28:34.358114] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-14T22:28:34.869090] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-14T22:28:35.158083] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-14T22:28:35.958112] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-14T22:28:36.501265] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-14T22:28:36.758065] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-14T22:28:37.252057] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-14T22:28:37.558109] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-14T22:28:37.629079] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-14T22:28:38.358062] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-14T22:28:38.895420] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-14T22:28:38.976098] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-14T22:28:38.982014] [INFO ] [REMOTE ] XPEV: Full fetch complete (77779 records). [2025-10-14T22:28:38.982155] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-14T22:28:39.167688] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-14T22:28:39.392454] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-14T22:28:39.392530] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-14T22:28:39.393889] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-14T22:28:39.393952] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-14T22:28:39.395340] [DEBUG] [LOCAL ] XPEV: Trimmed 77779 records to 53631 (keeping 200 days of data) [2025-10-14T22:28:39.714054] [DEBUG] [LOCAL ] XPEV: Primary data saved (53631 records). [2025-10-14T22:28:39.714182] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-14T22:28:39.714258] [INFO ] [MAIN ] Update Progress: 2337/2369 symbols completed. XPEV took 32.6s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-14T22:28:39.891163] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:28:39.935328] [DEBUG] [LOCAL ] XPRO: Loaded 45959 existing records from primary storage. [2025-10-14T22:28:39.935730] [INFO ] [MAIN ] XPRO: Loaded 45959 existing records. [2025-10-14T22:28:39.967284] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-14T22:28:40.117912] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:28:40.118145] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-14T22:28:40.118192] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-14T22:28:40.119150] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-14T22:28:40.119211] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-14T22:28:40.477175] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:28:40.571312] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-14T22:28:40.758038] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-14T22:28:40.818465] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-14T22:28:40.852894] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-14T22:28:40.984788] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-14T22:28:40.991355] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-14T22:28:40.991503] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-14T22:28:41.405179] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-14T22:28:41.405291] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-14T22:28:41.407265] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-14T22:28:41.407390] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-14T22:28:41.409458] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 53793 (keeping 200 days of data) [2025-10-14T22:28:41.600830] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-14T22:28:41.777139] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-14T22:28:41.777350] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-14T22:28:41.777454] [INFO ] [MAIN ] Update Progress: 2338/2369 symbols completed. XOM took 44.2s. Estimated remaining: 4m 21s. Rate: 7.1 symbols/min [2025-10-14T22:28:41.949216] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:28:41.980131] [DEBUG] [LOCAL ] XYF: Loaded 28103 existing records from primary storage. [2025-10-14T22:28:41.980503] [INFO ] [MAIN ] XYF: Loaded 28103 existing records. [2025-10-14T22:28:42.163933] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:28:42.164210] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-14T22:28:42.164260] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-14T22:28:42.164849] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-14T22:28:42.164907] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-14T22:28:42.363552] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-14T22:28:42.530671] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:28:43.161841] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-14T22:28:43.167633] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-14T22:28:43.958127] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-14T22:28:43.998505] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-14T22:28:44.382205] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-14T22:28:44.572495] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-14T22:28:44.758090] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-14T22:28:45.190545] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-14T22:28:45.558077] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-14T22:28:46.329939] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T22:28:46.358080] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-14T22:28:47.158106] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-14T22:28:47.878100] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-14T22:28:47.958085] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-14T22:28:48.338436] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-14T22:28:48.758126] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-14T22:28:49.483872] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:28:49.558035] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-14T22:28:50.358050] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-14T22:28:50.512287] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-14T22:28:51.108702] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-14T22:28:51.158029] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-14T22:28:51.901583] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-14T22:28:51.958094] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-14T22:28:52.758088] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-14T22:28:53.055562] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-14T22:28:53.061053] [INFO ] [REMOTE ] XPO: Full fetch complete (69821 records). [2025-10-14T22:28:53.061203] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-14T22:28:53.443091] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-14T22:28:53.443168] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-14T22:28:53.444324] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-14T22:28:53.444386] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-14T22:28:53.445731] [DEBUG] [LOCAL ] XPO: Trimmed 69821 records to 47713 (keeping 200 days of data) [2025-10-14T22:28:53.561187] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-14T22:28:53.736303] [DEBUG] [LOCAL ] XPO: Primary data saved (47713 records). [2025-10-14T22:28:53.736428] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-14T22:28:53.736505] [INFO ] [MAIN ] Update Progress: 2339/2369 symbols completed. XPO took 30.5s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-14T22:28:53.908697] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:28:53.929196] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-14T22:28:53.977941] [DEBUG] [LOCAL ] XYL: Loaded 47852 existing records from primary storage. [2025-10-14T22:28:53.978256] [INFO ] [MAIN ] XYL: Loaded 47852 existing records. [2025-10-14T22:28:54.156402] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:28:54.156750] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-14T22:28:54.156833] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-14T22:28:54.167114] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-14T22:28:54.181035] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-14T22:28:54.187919] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T22:28:54.367416] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-14T22:28:54.553272] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:28:55.158175] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-14T22:28:55.269111] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T22:28:55.723280] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-14T22:28:55.958140] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-14T22:28:56.758095] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-14T22:28:56.869246] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-14T22:28:57.007505] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T22:28:57.558103] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-14T22:28:57.715398] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-14T22:28:58.358103] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-14T22:28:59.078127] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-14T22:28:59.158117] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-14T22:28:59.740308] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T22:28:59.958053] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-14T22:29:00.766822] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-14T22:29:00.784177] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-14T22:29:01.516595] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T22:29:01.558064] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-14T22:29:01.991482] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-14T22:29:02.358081] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-14T22:29:03.158035] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-14T22:29:03.214710] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-14T22:29:03.260725] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-14T22:29:03.264805] [INFO ] [REMOTE ] XPOF: Full fetch complete (52745 records). [2025-10-14T22:29:03.264899] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-14T22:29:03.649068] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-14T22:29:03.649148] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-14T22:29:03.650216] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-14T22:29:03.650275] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-14T22:29:03.651329] [DEBUG] [LOCAL ] XPOF: Trimmed 52745 records to 37447 (keeping 200 days of data) [2025-10-14T22:29:03.859028] [DEBUG] [LOCAL ] XPOF: Primary data saved (37447 records). [2025-10-14T22:29:03.859161] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-14T22:29:03.859237] [INFO ] [MAIN ] Update Progress: 2340/2369 symbols completed. XPOF took 32.3s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-14T22:29:03.963060] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-14T22:29:04.032420] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:04.032607] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-14T22:29:04.032667] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-14T22:29:04.032779] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-14T22:29:04.032819] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-14T22:29:04.032858] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-14T22:29:04.032888] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-14T22:29:04.391662] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:04.568130] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-14T22:29:04.758073] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-14T22:29:05.558094] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-14T22:29:05.812569] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-14T22:29:05.850618] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-14T22:29:06.358067] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-14T22:29:07.158081] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-14T22:29:07.289368] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-14T22:29:07.364618] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-14T22:29:07.367560] [INFO ] [REMOTE ] XYF: Full fetch complete (33074 records). [2025-10-14T22:29:07.367631] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-14T22:29:07.459065] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-14T22:29:07.471553] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-14T22:29:07.472050] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:29:07.482546] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-14T22:29:07.492980] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:29:07.511247] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-14T22:29:07.560217] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-14T22:29:07.593243] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-14T22:29:07.633449] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-14T22:29:07.644365] [INFO ] [MAIN ] Update Progress: 2341/2369 symbols completed. XYZ took 3.8s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-14T22:29:07.926785] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-14T22:29:07.929145] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-14T22:29:07.929070] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:07.930105] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-14T22:29:07.930533] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-14T22:29:07.931628] [DEBUG] [LOCAL ] XYF: Trimmed 33074 records to 27954 (keeping 200 days of data) [2025-10-14T22:29:07.983936] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-14T22:29:08.063206] [DEBUG] [LOCAL ] YALA: Loaded 36962 existing records from primary storage. [2025-10-14T22:29:08.066052] [INFO ] [MAIN ] YALA: Loaded 36962 existing records. [2025-10-14T22:29:08.302544] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:29:08.305332] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-14T22:29:08.307034] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-14T22:29:08.308999] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-14T22:29:08.309530] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-14T22:29:08.384618] [DEBUG] [LOCAL ] XYF: Primary data saved (27954 records). [2025-10-14T22:29:08.395609] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-14T22:29:08.406687] [INFO ] [MAIN ] Update Progress: 2342/2369 symbols completed. XYF took 26.6s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-14T22:29:08.788548] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-14T22:29:08.791932] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:08.880160] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:08.913687] [DEBUG] [LOCAL ] YELP: Loaded 45436 existing records from primary storage. [2025-10-14T22:29:08.914024] [INFO ] [MAIN ] YELP: Loaded 45436 existing records. [2025-10-14T22:29:09.090032] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:29:09.090225] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-14T22:29:09.090271] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-14T22:29:09.091004] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-14T22:29:09.091062] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-14T22:29:09.439516] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:09.558035] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-14T22:29:10.239926] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-14T22:29:10.358027] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-14T22:29:10.417259] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T22:29:11.118136] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-14T22:29:11.158020] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-14T22:29:11.958079] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-14T22:29:12.194608] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T22:29:12.626198] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-14T22:29:12.758056] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-14T22:29:13.046606] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-14T22:29:13.558062] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-14T22:29:14.196286] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-14T22:29:14.358102] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-14T22:29:14.424334] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-14T22:29:15.158054] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-14T22:29:15.958048] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-14T22:29:15.996339] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-14T22:29:16.676900] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-14T22:29:16.758039] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-14T22:29:16.772558] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-14T22:29:17.558088] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-14T22:29:18.311634] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-14T22:29:18.358040] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-14T22:29:18.461153] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-14T22:29:19.158109] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-14T22:29:19.904342] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-14T22:29:19.958068] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-14T22:29:20.602489] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-14T22:29:20.758087] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-14T22:29:21.410190] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T22:29:21.558068] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-14T22:29:22.358051] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-14T22:29:22.417335] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-14T22:29:22.817323] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-14T22:29:23.158074] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-14T22:29:23.958092] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-14T22:29:23.997917] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-14T22:29:24.504844] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T22:29:24.758099] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-14T22:29:25.558091] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-14T22:29:25.888832] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-14T22:29:26.213571] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-14T22:29:26.358134] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-14T22:29:27.158072] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-14T22:29:27.236272] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-14T22:29:27.900986] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-14T22:29:27.958075] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-14T22:29:28.542801] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-14T22:29:28.758082] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-14T22:29:29.543243] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-14T22:29:29.558021] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-14T22:29:30.358094] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-14T22:29:30.396740] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-14T22:29:31.158047] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-14T22:29:31.204326] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-14T22:29:31.851821] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-14T22:29:31.958073] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-14T22:29:32.315224] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T22:29:32.758044] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-14T22:29:33.272202] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-14T22:29:33.558096] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-14T22:29:34.094529] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-14T22:29:34.100104] [INFO ] [REMOTE ] YELP: Full fetch complete (64801 records). [2025-10-14T22:29:34.100219] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-14T22:29:34.367301] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-14T22:29:34.487765] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-14T22:29:34.487852] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-14T22:29:34.489055] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-14T22:29:34.489118] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-14T22:29:34.490390] [DEBUG] [LOCAL ] YELP: Trimmed 64801 records to 45451 (keeping 200 days of data) [2025-10-14T22:29:34.754587] [DEBUG] [LOCAL ] YELP: Primary data saved (45451 records). [2025-10-14T22:29:34.754749] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-14T22:29:34.754839] [INFO ] [MAIN ] Update Progress: 2343/2369 symbols completed. YELP took 26.3s. Estimated remaining: 3m 39s. Rate: 7.1 symbols/min [2025-10-14T22:29:34.934461] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:34.975722] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T22:29:34.994564] [INFO ] [REMOTE ] XPRO: Full fetch complete (66472 records). [2025-10-14T22:29:34.995742] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-14T22:29:34.996757] [DEBUG] [LOCAL ] YETI: Loaded 52473 existing records from primary storage. [2025-10-14T22:29:35.031733] [INFO ] [MAIN ] YETI: Loaded 52473 existing records. [2025-10-14T22:29:35.168987] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-14T22:29:35.387816] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:29:35.422207] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-14T22:29:35.431029] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-14T22:29:35.492034] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-14T22:29:35.514929] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-14T22:29:35.514812] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-14T22:29:35.624481] [INFO ] [REMOTE ] YALA: Full fetch complete (46965 records). [2025-10-14T22:29:35.656921] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-14T22:29:35.826403] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-14T22:29:35.926498] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-14T22:29:35.968902] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-14T22:29:36.029002] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-14T22:29:36.138154] [DEBUG] [LOCAL ] XPRO: Trimmed 66472 records to 45907 (keeping 200 days of data) [2025-10-14T22:29:36.286404] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:36.351631] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-14T22:29:36.394302] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-14T22:29:36.519242] [INFO ] [REMOTE ] XYL: Full fetch complete (69863 records). [2025-10-14T22:29:36.621710] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-14T22:29:36.674449] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-14T22:29:36.677606] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-14T22:29:36.681846] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-14T22:29:36.697012] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-14T22:29:36.794966] [DEBUG] [LOCAL ] YALA: Trimmed 46965 records to 36892 (keeping 200 days of data) [2025-10-14T22:29:36.904984] [DEBUG] [LOCAL ] XPRO: Primary data saved (45907 records). [2025-10-14T22:29:36.943973] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-14T22:29:36.950059] [INFO ] [MAIN ] Update Progress: 2344/2369 symbols completed. XPRO took 57.2s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-14T22:29:37.403853] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:37.448908] [DEBUG] [LOCAL ] YALA: Primary data saved (36892 records). [2025-10-14T22:29:37.477432] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-14T22:29:37.477769] [INFO ] [MAIN ] Update Progress: 2345/2369 symbols completed. YALA took 29.8s. Estimated remaining: 3m 22s. Rate: 7.1 symbols/min [2025-10-14T22:29:37.704360] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-14T22:29:37.704840] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-14T22:29:37.712102] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-14T22:29:37.712299] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-14T22:29:37.793251] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:37.795203] [DEBUG] [LOCAL ] YEXT: Loaded 43108 existing records from primary storage. [2025-10-14T22:29:37.794053] [DEBUG] [LOCAL ] XYL: Trimmed 69863 records to 47817 (keeping 200 days of data) [2025-10-14T22:29:37.795904] [INFO ] [MAIN ] YEXT: Loaded 43108 existing records. [2025-10-14T22:29:38.210722] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:29:38.211528] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-14T22:29:38.238273] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-14T22:29:38.261520] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-14T22:29:38.262683] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-14T22:29:38.366046] [DEBUG] [LOCAL ] YMM: Loaded 52604 existing records from primary storage. [2025-10-14T22:29:38.388138] [INFO ] [MAIN ] YMM: Loaded 52604 existing records. [2025-10-14T22:29:38.664196] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-14T22:29:38.784637] [DEBUG] [LOCAL ] XYL: Primary data saved (47817 records). [2025-10-14T22:29:38.789266] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-14T22:29:38.789357] [INFO ] [MAIN ] Update Progress: 2346/2369 symbols completed. XYL took 45.1s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-14T22:29:38.845519] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-14T22:29:38.886168] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:29:38.910404] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-14T22:29:38.970807] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-14T22:29:39.044157] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-14T22:29:39.062688] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-14T22:29:39.197376] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:39.218538] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-14T22:29:39.310777] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:29:39.590139] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:39.590571] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-14T22:29:39.609505] [DEBUG] [LOCAL ] YOU: Loaded 49667 existing records from primary storage. [2025-10-14T22:29:39.609876] [INFO ] [MAIN ] YOU: Loaded 49667 existing records. [2025-10-14T22:29:39.793393] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:29:39.793625] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-14T22:29:39.793710] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-14T22:29:39.794599] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-14T22:29:39.794693] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-14T22:29:40.169235] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:29:40.169593] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-14T22:29:40.199056] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T22:29:40.209366] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-14T22:29:40.844163] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-14T22:29:40.853731] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-14T22:29:41.432918] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-14T22:29:41.538517] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-14T22:29:41.558034] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-14T22:29:41.597102] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-14T22:29:42.363496] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-14T22:29:42.376519] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-14T22:29:42.897172] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T22:29:43.158111] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-14T22:29:43.958065] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-14T22:29:44.064317] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-14T22:29:44.758041] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-14T22:29:45.000971] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-14T22:29:45.563235] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-14T22:29:45.580324] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-14T22:29:46.310451] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-14T22:29:46.358038] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-14T22:29:46.978335] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-14T22:29:47.158045] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-14T22:29:47.961375] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-14T22:29:47.968063] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-14T22:29:48.353368] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-14T22:29:48.758097] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-14T22:29:49.558047] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-14T22:29:49.626790] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T22:29:50.051856] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-14T22:29:50.358115] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-14T22:29:50.907443] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-14T22:29:51.158072] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-14T22:29:51.958143] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-14T22:29:52.105399] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T22:29:52.758102] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-14T22:29:53.005423] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-14T22:29:53.413896] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T22:29:53.558116] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-14T22:29:54.130344] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-14T22:29:54.358045] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-14T22:29:55.158110] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-14T22:29:55.295203] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-14T22:29:55.916737] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-14T22:29:55.958058] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-14T22:29:56.758064] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-14T22:29:57.018336] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-14T22:29:57.061238] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-14T22:29:57.558074] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-14T22:29:58.358115] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-14T22:29:58.499147] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-14T22:29:59.158096] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-14T22:29:59.398931] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T22:29:59.622105] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-14T22:29:59.958087] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-14T22:30:00.584105] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-14T22:30:00.758112] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-14T22:30:01.558044] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-14T22:30:01.945720] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-14T22:30:02.358043] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-14T22:30:02.458688] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T22:30:03.158050] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-14T22:30:03.387912] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-14T22:30:03.815825] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-14T22:30:03.958034] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-14T22:30:04.758049] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-14T22:30:04.784555] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-14T22:30:05.448191] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-14T22:30:05.453870] [INFO ] [REMOTE ] YETI: Full fetch complete (75575 records). [2025-10-14T22:30:05.453994] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-14T22:30:05.563177] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-14T22:30:05.846910] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-14T22:30:05.847004] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-14T22:30:05.848267] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-14T22:30:05.848369] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-14T22:30:05.849970] [DEBUG] [LOCAL ] YETI: Trimmed 75575 records to 52490 (keeping 200 days of data) [2025-10-14T22:30:06.166328] [DEBUG] [LOCAL ] YETI: Primary data saved (52490 records). [2025-10-14T22:30:06.166688] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-14T22:30:06.166793] [INFO ] [MAIN ] Update Progress: 2347/2369 symbols completed. YETI took 31.4s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-14T22:30:06.338326] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:06.364458] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-14T22:30:06.387198] [DEBUG] [LOCAL ] YPF: Loaded 50614 existing records from primary storage. [2025-10-14T22:30:06.387502] [INFO ] [MAIN ] YPF: Loaded 50614 existing records. [2025-10-14T22:30:06.571465] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:06.571793] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-14T22:30:06.571968] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-14T22:30:06.573090] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-14T22:30:06.573152] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-14T22:30:06.730106] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-14T22:30:06.981144] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:07.158042] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-14T22:30:07.405422] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-14T22:30:07.771884] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-14T22:30:07.776928] [INFO ] [REMOTE ] YEXT: Full fetch complete (63293 records). [2025-10-14T22:30:07.777054] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-14T22:30:07.969142] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-14T22:30:08.166365] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-14T22:30:08.166438] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-14T22:30:08.167559] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-14T22:30:08.167620] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-14T22:30:08.171869] [DEBUG] [LOCAL ] YEXT: Trimmed 63293 records to 43121 (keeping 200 days of data) [2025-10-14T22:30:08.407522] [DEBUG] [LOCAL ] YEXT: Primary data saved (43121 records). [2025-10-14T22:30:08.407658] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-14T22:30:08.407754] [INFO ] [MAIN ] Update Progress: 2348/2369 symbols completed. YEXT took 31.5s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-14T22:30:08.579861] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:08.591525] [DEBUG] [LOCAL ] YRD: Loaded 11833 existing records from primary storage. [2025-10-14T22:30:08.591750] [INFO ] [MAIN ] YRD: Loaded 11833 existing records. [2025-10-14T22:30:08.761447] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-14T22:30:08.830009] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:08.833405] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-14T22:30:08.833106] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-14T22:30:08.833705] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-14T22:30:08.849806] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-14T22:30:08.849881] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-14T22:30:09.218828] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:09.558039] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-14T22:30:09.908508] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-14T22:30:10.358046] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-14T22:30:10.486810] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-14T22:30:10.924970] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-14T22:30:11.158034] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-14T22:30:11.318181] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-14T22:30:11.958126] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-14T22:30:12.578226] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-14T22:30:12.591758] [INFO ] [REMOTE ] YOU: Full fetch complete (72287 records). [2025-10-14T22:30:12.592636] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-14T22:30:12.592804] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-14T22:30:12.765026] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-14T22:30:12.986086] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-14T22:30:12.986156] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-14T22:30:12.987313] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-14T22:30:12.987392] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-14T22:30:12.988882] [DEBUG] [LOCAL ] YOU: Trimmed 72287 records to 49635 (keeping 200 days of data) [2025-10-14T22:30:13.281511] [DEBUG] [LOCAL ] YOU: Primary data saved (49635 records). [2025-10-14T22:30:13.281632] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-14T22:30:13.281745] [INFO ] [MAIN ] Update Progress: 2349/2369 symbols completed. YOU took 34.5s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-14T22:30:13.472903] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:13.473067] [DEBUG] [LOCAL ] YSG: No existing data file found in primary storage. [2025-10-14T22:30:13.473111] [WARN ] [MAIN ] YSG: No existing data found, performing full refresh instead. [2025-10-14T22:30:13.473233] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-14T22:30:13.473275] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-14T22:30:13.473316] [DEBUG] [LOCAL ] YSG: No primary data file found to delete. [2025-10-14T22:30:13.473355] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-14T22:30:13.563857] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-14T22:30:13.827161] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:14.330064] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-14T22:30:14.358018] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-14T22:30:14.693513] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-14T22:30:15.158070] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-14T22:30:15.444243] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T22:30:15.958090] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-14T22:30:16.202045] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-14T22:30:16.758090] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-14T22:30:17.186045] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-14T22:30:17.558071] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-14T22:30:18.136187] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T22:30:18.152408] [INFO ] [REMOTE ] YMM: Full fetch complete (76493 records). [2025-10-14T22:30:18.153084] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-14T22:30:18.153407] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-14T22:30:18.363608] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-14T22:30:18.563848] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-14T22:30:18.563916] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-14T22:30:18.565126] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-14T22:30:18.565185] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-14T22:30:18.566620] [DEBUG] [LOCAL ] YMM: Trimmed 76493 records to 52601 (keeping 200 days of data) [2025-10-14T22:30:18.883990] [DEBUG] [LOCAL ] YMM: Primary data saved (52601 records). [2025-10-14T22:30:18.884110] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-14T22:30:18.884187] [INFO ] [MAIN ] Update Progress: 2350/2369 symbols completed. YMM took 41.4s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-14T22:30:19.056447] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:19.108382] [DEBUG] [LOCAL ] YUM: Loaded 51165 existing records from primary storage. [2025-10-14T22:30:19.108693] [INFO ] [MAIN ] YUM: Loaded 51165 existing records. [2025-10-14T22:30:19.171025] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-14T22:30:19.222891] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-14T22:30:19.303336] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:19.303558] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-14T22:30:19.303625] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-14T22:30:19.304677] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-14T22:30:19.304745] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-14T22:30:19.662159] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:19.958066] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-14T22:30:20.758110] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-14T22:30:21.050455] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-14T22:30:21.178561] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-14T22:30:21.558041] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-14T22:30:21.596862] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-14T22:30:22.358151] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-14T22:30:23.158069] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-14T22:30:23.446601] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-14T22:30:23.706474] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-14T22:30:23.836055] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-14T22:30:23.958049] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-14T22:30:24.758104] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-14T22:30:25.046358] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-14T22:30:25.558096] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-14T22:30:26.188057] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-14T22:30:26.358032] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-14T22:30:27.158045] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-14T22:30:27.190744] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-14T22:30:27.958054] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-14T22:30:28.018235] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-14T22:30:28.057189] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-14T22:30:28.758086] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-14T22:30:29.562166] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-14T22:30:29.568039] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-14T22:30:30.358051] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-14T22:30:30.449960] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-14T22:30:30.540526] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-14T22:30:31.158044] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-14T22:30:31.180368] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-14T22:30:31.958079] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-14T22:30:32.758071] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-14T22:30:32.834985] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-14T22:30:32.873005] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T22:30:33.558060] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-14T22:30:33.643375] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-14T22:30:34.358098] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-14T22:30:35.158048] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-14T22:30:35.300231] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-14T22:30:35.339321] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-14T22:30:35.958072] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-14T22:30:36.758048] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-14T22:30:37.063338] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-14T22:30:37.248481] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-14T22:30:37.250273] [INFO ] [REMOTE ] YRD: Full fetch complete (19138 records). [2025-10-14T22:30:37.250343] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-14T22:30:37.559308] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-14T22:30:37.655449] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-14T22:30:37.654504] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-14T22:30:37.655588] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-14T22:30:37.661454] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-14T22:30:37.661675] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-14T22:30:37.662163] [INFO ] [REMOTE ] YPF: Full fetch complete (73699 records). [2025-10-14T22:30:37.662312] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-14T22:30:37.662960] [DEBUG] [LOCAL ] YRD: Trimmed 19138 records to 11665 (keeping 200 days of data) [2025-10-14T22:30:37.909963] [DEBUG] [LOCAL ] YRD: Primary data saved (11665 records). [2025-10-14T22:30:37.930044] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-14T22:30:37.930984] [INFO ] [MAIN ] Update Progress: 2351/2369 symbols completed. YRD took 29.5s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-14T22:30:38.362428] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-14T22:30:38.362563] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-14T22:30:38.358462] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:38.362927] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-14T22:30:38.365339] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-14T22:30:38.365616] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-14T22:30:38.367484] [DEBUG] [LOCAL ] YPF: Trimmed 73699 records to 50641 (keeping 200 days of data) [2025-10-14T22:30:38.511694] [DEBUG] [LOCAL ] YUMC: Loaded 52596 existing records from primary storage. [2025-10-14T22:30:38.513219] [INFO ] [MAIN ] YUMC: Loaded 52596 existing records. [2025-10-14T22:30:38.804424] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:38.806328] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-14T22:30:38.806425] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-14T22:30:38.812065] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-14T22:30:38.812270] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-14T22:30:39.008405] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-14T22:30:39.161362] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-14T22:30:39.213664] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:39.290264] [DEBUG] [LOCAL ] YPF: Primary data saved (50641 records). [2025-10-14T22:30:39.290395] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-14T22:30:39.290474] [INFO ] [MAIN ] Update Progress: 2352/2369 symbols completed. YPF took 33.1s. Estimated remaining: 2m 23s. Rate: 7.1 symbols/min [2025-10-14T22:30:39.458201] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:39.504552] [DEBUG] [LOCAL ] ZBH: Loaded 50790 existing records from primary storage. [2025-10-14T22:30:39.504899] [INFO ] [MAIN ] ZBH: Loaded 50790 existing records. [2025-10-14T22:30:39.677898] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:39.678053] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-14T22:30:39.678098] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-14T22:30:39.678960] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-14T22:30:39.679016] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-14T22:30:39.968087] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-14T22:30:40.051532] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:40.088637] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-14T22:30:40.761407] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-14T22:30:40.764926] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-14T22:30:41.558088] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-14T22:30:41.735573] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-14T22:30:42.358068] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-14T22:30:42.427595] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-14T22:30:42.877397] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-14T22:30:43.158048] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-14T22:30:43.571519] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-14T22:30:43.958062] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-14T22:30:44.758056] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-14T22:30:44.914240] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-14T22:30:45.558039] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-14T22:30:45.639553] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-14T22:30:46.236762] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-14T22:30:46.358112] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-14T22:30:47.158076] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-14T22:30:47.325794] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-14T22:30:47.958047] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-14T22:30:48.068475] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-14T22:30:48.195604] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-14T22:30:48.758047] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-14T22:30:49.557743] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-14T22:30:49.561464] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-14T22:30:50.358063] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-14T22:30:50.443604] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T22:30:51.158064] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-14T22:30:51.310598] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-14T22:30:51.380575] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-14T22:30:51.386342] [INFO ] [REMOTE ] YUM: Full fetch complete (74615 records). [2025-10-14T22:30:51.386459] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-14T22:30:51.804113] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-14T22:30:51.804529] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-14T22:30:51.806213] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-14T22:30:51.806429] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-14T22:30:51.809050] [DEBUG] [LOCAL ] YUM: Trimmed 74615 records to 51156 (keeping 200 days of data) [2025-10-14T22:30:51.941798] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-14T22:30:51.960350] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-14T22:30:52.172242] [DEBUG] [LOCAL ] YUM: Primary data saved (51156 records). [2025-10-14T22:30:52.172372] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-14T22:30:52.173002] [INFO ] [MAIN ] Update Progress: 2353/2369 symbols completed. YUM took 33.3s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-14T22:30:52.342929] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:52.362619] [DEBUG] [LOCAL ] ZEPP: Loaded 18824 existing records from primary storage. [2025-10-14T22:30:52.362920] [INFO ] [MAIN ] ZEPP: Loaded 18824 existing records. [2025-10-14T22:30:52.542256] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:52.542465] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-14T22:30:52.542536] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-14T22:30:52.543043] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-14T22:30:52.543119] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-14T22:30:52.766633] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-14T22:30:52.902913] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:53.558046] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-14T22:30:53.771936] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-14T22:30:53.795801] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T22:30:53.800666] [INFO ] [REMOTE ] YSG: Full fetch complete (32416 records). [2025-10-14T22:30:53.800797] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-14T22:30:54.214195] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-14T22:30:54.214280] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-14T22:30:54.215007] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-14T22:30:54.215074] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-14T22:30:54.216060] [DEBUG] [LOCAL ] YSG: Trimmed 32416 records to 25500 (keeping 200 days of data) [2025-10-14T22:30:54.358110] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-14T22:30:54.368558] [DEBUG] [LOCAL ] YSG: Primary data saved (25500 records). [2025-10-14T22:30:54.368719] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-14T22:30:54.368838] [INFO ] [MAIN ] Update Progress: 2354/2369 symbols completed. YSG took 41.1s. Estimated remaining: 2m 6s. Rate: 7.1 symbols/min [2025-10-14T22:30:54.484614] [DEBUG] [REMOTE ] ZEPP: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-14T22:30:54.485304] [WARN ] [REMOTE ] ZEPP: No data returned for month 2024-12 [2025-10-14T22:30:54.496151] [FATAL] [REMOTE ] ZEPP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-14T22:30:54.506563] [FATAL] [MAIN ] ZEPP: Failed to fetch primary data. [2025-10-14T22:30:54.511818] [WARN ] [MAIN ] ZEPP: Deleting existing primary and derivative data due to fetch failure. [2025-10-14T22:30:54.554798] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-14T22:30:54.558209] [DEBUG] [LOCAL ] ZEPP: No primary data file found to delete. [2025-10-14T22:30:54.558317] [INFO ] [LOCAL ] ZEPP: Starting deletion of derivative data. [2025-10-14T22:30:54.558123] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:54.558669] [DEBUG] [LOCAL ] ZEPP: Deleted derivative data file. [2025-10-14T22:30:54.558803] [INFO ] [MAIN ] Update Progress: 2355/2369 symbols completed. ZEPP took 2.4s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-14T22:30:54.756957] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:30:54.780683] [DEBUG] [LOCAL ] ZETA: Loaded 53611 existing records from primary storage. [2025-10-14T22:30:54.781089] [INFO ] [MAIN ] ZETA: Loaded 53611 existing records. [2025-10-14T22:30:54.988196] [DEBUG] [LOCAL ] ZGN: Loaded 40908 existing records from primary storage. [2025-10-14T22:30:54.987147] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:54.988536] [INFO ] [MAIN ] ZGN: Loaded 40908 existing records. [2025-10-14T22:30:54.988675] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-14T22:30:54.988780] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-14T22:30:55.053679] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-14T22:30:55.058978] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-14T22:30:55.178355] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-14T22:30:55.326081] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:30:55.398789] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-14T22:30:55.404119] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-14T22:30:55.468560] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-14T22:30:55.471778] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-14T22:30:55.653608] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:55.877010] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-14T22:30:55.966777] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:30:55.963793] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-14T22:30:56.690941] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-14T22:30:56.758031] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-14T22:30:57.558035] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-14T22:30:57.802909] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-14T22:30:57.994733] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-14T22:30:58.358094] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-14T22:30:59.158073] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-14T22:30:59.848513] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-14T22:30:59.958039] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-14T22:31:00.142965] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-14T22:31:00.652246] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-14T22:31:00.758131] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-14T22:31:01.306313] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T22:31:01.558075] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-14T22:31:02.358071] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-14T22:31:02.969059] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-14T22:31:03.158074] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-14T22:31:03.357405] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-14T22:31:03.396441] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-14T22:31:03.958064] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-14T22:31:04.758093] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-14T22:31:04.931270] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T22:31:05.420774] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-14T22:31:05.558065] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-14T22:31:06.232257] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-14T22:31:06.358066] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-14T22:31:07.046876] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-14T22:31:07.158056] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-14T22:31:07.958064] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-14T22:31:08.164283] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-14T22:31:08.758125] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-14T22:31:08.935905] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-14T22:31:08.964251] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-14T22:31:08.970200] [INFO ] [REMOTE ] ZBH: Full fetch complete (73818 records). [2025-10-14T22:31:08.970394] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-14T22:31:09.417505] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-14T22:31:09.417768] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-14T22:31:09.419124] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-14T22:31:09.419303] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-14T22:31:09.421127] [DEBUG] [LOCAL ] ZBH: Trimmed 73818 records to 50789 (keeping 200 days of data) [2025-10-14T22:31:09.559901] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-14T22:31:09.610936] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-14T22:31:09.846543] [DEBUG] [LOCAL ] ZBH: Primary data saved (50789 records). [2025-10-14T22:31:09.846791] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-14T22:31:09.846908] [INFO ] [MAIN ] Update Progress: 2356/2369 symbols completed. ZBH took 30.6s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-14T22:31:10.025685] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:31:10.054205] [DEBUG] [LOCAL ] ZH: Loaded 25584 existing records from primary storage. [2025-10-14T22:31:10.054537] [INFO ] [MAIN ] ZH: Loaded 25584 existing records. [2025-10-14T22:31:10.246411] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:31:10.246720] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-14T22:31:10.246783] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-14T22:31:10.247306] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-14T22:31:10.247365] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-14T22:31:10.360040] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-14T22:31:10.641623] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:31:11.158092] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-14T22:31:11.481605] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-14T22:31:11.958106] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-14T22:31:11.994182] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-14T22:31:12.638123] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-14T22:31:12.758108] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-14T22:31:13.558127] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-14T22:31:14.216737] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-14T22:31:14.342344] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-14T22:31:14.350951] [INFO ] [REMOTE ] YUMC: Full fetch complete (76326 records). [2025-10-14T22:31:14.351173] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-14T22:31:14.364368] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-14T22:31:14.779683] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-14T22:31:14.779899] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-14T22:31:14.782602] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-14T22:31:14.782773] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-14T22:31:14.824353] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-14T22:31:14.820552] [DEBUG] [LOCAL ] YUMC: Trimmed 76326 records to 52590 (keeping 200 days of data) [2025-10-14T22:31:15.161730] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-14T22:31:15.177595] [DEBUG] [LOCAL ] YUMC: Primary data saved (52590 records). [2025-10-14T22:31:15.177725] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-14T22:31:15.177811] [INFO ] [MAIN ] Update Progress: 2357/2369 symbols completed. YUMC took 37.2s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-14T22:31:15.958091] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-14T22:31:16.219475] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T22:31:16.516231] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-14T22:31:16.758093] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-14T22:31:17.247505] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-14T22:31:17.413149] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-14T22:31:17.558098] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-14T22:31:18.358105] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-14T22:31:18.968254] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-14T22:31:19.158095] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-14T22:31:19.794074] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-14T22:31:19.958117] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-14T22:31:20.494480] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-14T22:31:20.758073] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-14T22:31:21.558088] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-14T22:31:22.174870] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-14T22:31:22.275488] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-14T22:31:22.358039] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-14T22:31:22.973878] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-14T22:31:23.158105] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-14T22:31:23.347542] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-14T22:31:23.958137] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-14T22:31:24.758053] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-14T22:31:25.066161] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-14T22:31:25.279580] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-14T22:31:25.558094] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-14T22:31:26.114410] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-14T22:31:26.119171] [INFO ] [REMOTE ] ZGN: Full fetch complete (58372 records). [2025-10-14T22:31:26.119274] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-14T22:31:26.364677] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-14T22:31:26.527465] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-14T22:31:26.527597] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-14T22:31:26.528952] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-14T22:31:26.529016] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-14T22:31:26.530269] [DEBUG] [LOCAL ] ZGN: Trimmed 58372 records to 40886 (keeping 200 days of data) [2025-10-14T22:31:26.768498] [DEBUG] [LOCAL ] ZGN: Primary data saved (40886 records). [2025-10-14T22:31:26.768619] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-14T22:31:26.768732] [INFO ] [MAIN ] Update Progress: 2358/2369 symbols completed. ZGN took 32.2s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-14T22:31:27.436111] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-14T22:31:27.442492] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-14T22:31:27.917217] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-14T22:31:27.958094] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-14T22:31:28.142713] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-14T22:31:28.758129] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-14T22:31:30.053044] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-14T22:31:30.065146] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-14T22:31:30.313439] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-14T22:31:30.358037] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-14T22:31:31.384983] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-14T22:31:31.387766] [INFO ] [REMOTE ] ZH: Full fetch complete (40019 records). [2025-10-14T22:31:31.387913] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-14T22:31:31.788295] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-14T22:31:31.788370] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-14T22:31:31.789182] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-14T22:31:31.789240] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-14T22:31:31.790084] [DEBUG] [LOCAL ] ZH: Trimmed 40019 records to 25441 (keeping 200 days of data) [2025-10-14T22:31:31.926721] [DEBUG] [LOCAL ] ZH: Primary data saved (25441 records). [2025-10-14T22:31:31.926844] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-14T22:31:31.926921] [INFO ] [MAIN ] Update Progress: 2359/2369 symbols completed. ZH took 22.1s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-14T22:31:32.682267] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-14T22:31:32.688625] [INFO ] [REMOTE ] ZETA: Full fetch complete (77734 records). [2025-10-14T22:31:32.688810] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-14T22:31:33.092867] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-14T22:31:33.092943] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-14T22:31:33.094134] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-14T22:31:33.094194] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-14T22:31:33.095613] [DEBUG] [LOCAL ] ZETA: Trimmed 77734 records to 53617 (keeping 200 days of data) [2025-10-14T22:31:33.415053] [DEBUG] [LOCAL ] ZETA: Primary data saved (53617 records). [2025-10-14T22:31:33.415184] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-14T22:31:33.415261] [INFO ] [MAIN ] Update Progress: 2360/2369 symbols completed. ZETA took 39.0s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-14T22:31:34.055370] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:31:34.078343] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:31:34.110346] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:31:34.134250] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:31:34.145622] [DEBUG] [LOCAL ] ZKH: Loaded 7571 existing records from primary storage. [2025-10-14T22:31:34.146039] [INFO ] [MAIN ] ZKH: Loaded 7571 existing records. [2025-10-14T22:31:34.381341] [DEBUG] [LOCAL ] ZK: Loaded 39149 existing records from primary storage. [2025-10-14T22:31:34.386747] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:31:34.399048] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-14T22:31:34.398944] [INFO ] [MAIN ] ZK: Loaded 39149 existing records. [2025-10-14T22:31:34.399255] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-14T22:31:34.411783] [DEBUG] [LOCAL ] ZIP: Loaded 43740 existing records from primary storage. [2025-10-14T22:31:34.432969] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-14T22:31:34.445853] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-14T22:31:34.457084] [INFO ] [MAIN ] ZIP: Loaded 43740 existing records. [2025-10-14T22:31:34.553891] [DEBUG] [LOCAL ] ZIM: Loaded 53499 existing records from primary storage. [2025-10-14T22:31:34.583759] [INFO ] [MAIN ] ZIM: Loaded 53499 existing records. [2025-10-14T22:31:34.988810] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:31:35.036922] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-14T22:31:35.055727] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-14T22:31:35.160667] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-14T22:31:35.231152] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:31:35.247917] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-14T22:31:35.258400] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-14T22:31:35.237243] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:31:35.258547] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-14T22:31:35.258778] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-14T22:31:35.275016] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-14T22:31:35.274960] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-14T22:31:35.275162] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-14T22:31:35.316363] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-14T22:31:35.432062] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-14T22:31:35.605334] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:31:35.736523] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-14T22:31:36.446437] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:31:36.440497] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:31:36.457221] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-14T22:31:36.485035] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-14T22:31:36.533228] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:31:36.533627] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-14T22:31:36.582133] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-14T22:31:36.584043] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-14T22:31:37.355625] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-14T22:31:37.357974] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-14T22:31:37.740566] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-14T22:31:37.749014] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-14T22:31:37.860959] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-14T22:31:37.868120] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-14T22:31:38.180868] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T22:31:38.184131] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-14T22:31:38.430058] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-14T22:31:38.441117] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-14T22:31:38.655932] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-14T22:31:38.702594] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-14T22:31:39.099546] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-14T22:31:39.158128] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-14T22:31:39.958077] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-14T22:31:40.379563] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-14T22:31:40.510018] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-14T22:31:40.758065] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-14T22:31:41.543914] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-14T22:31:41.558019] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-14T22:31:41.971128] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-14T22:31:42.358087] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-14T22:31:42.974925] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-14T22:31:43.158043] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-14T22:31:43.958042] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-14T22:31:44.345690] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-14T22:31:44.430984] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-14T22:31:44.731879] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-14T22:31:44.758030] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-14T22:31:45.558069] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-14T22:31:46.119695] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-14T22:31:46.358125] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-14T22:31:46.427197] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-14T22:31:47.158105] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-14T22:31:47.723209] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-14T22:31:47.958060] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-14T22:31:48.452066] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-14T22:31:48.758064] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-14T22:31:49.558092] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-14T22:31:49.888824] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-14T22:31:50.069021] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-14T22:31:50.358057] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-14T22:31:50.465816] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-14T22:31:51.158070] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-14T22:31:51.958056] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-14T22:31:52.548940] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-14T22:31:52.627971] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-14T22:31:52.758078] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-14T22:31:53.062872] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-14T22:31:53.558100] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-14T22:31:54.358118] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-14T22:31:54.891732] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-14T22:31:54.973213] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-14T22:31:55.158083] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-14T22:31:55.583753] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-14T22:31:55.898383] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-14T22:31:55.958079] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-14T22:31:56.758165] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-14T22:31:57.558088] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-14T22:31:58.151523] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-14T22:31:58.313005] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T22:31:58.358078] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-14T22:31:59.111139] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-14T22:31:59.158067] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-14T22:31:59.522369] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-14T22:31:59.958107] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-14T22:32:00.633143] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-14T22:32:00.659946] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-14T22:32:00.758079] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-14T22:32:01.303014] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-14T22:32:01.304178] [INFO ] [REMOTE ] ZKH: Full fetch complete (11932 records). [2025-10-14T22:32:01.304255] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-14T22:32:01.563340] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-14T22:32:01.688501] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-14T22:32:01.688690] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-14T22:32:01.689060] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-14T22:32:01.689138] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-14T22:32:01.689766] [DEBUG] [LOCAL ] ZKH: Trimmed 11932 records to 7520 (keeping 200 days of data) [2025-10-14T22:32:01.734240] [DEBUG] [LOCAL ] ZKH: Primary data saved (7520 records). [2025-10-14T22:32:01.734379] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-14T22:32:01.734461] [INFO ] [MAIN ] Update Progress: 2361/2369 symbols completed. ZKH took 28.3s. Estimated remaining: 1m 7s. Rate: 7.1 symbols/min [2025-10-14T22:32:01.911148] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:32:01.957529] [DEBUG] [LOCAL ] ZTO: Loaded 49519 existing records from primary storage. [2025-10-14T22:32:01.957884] [INFO ] [MAIN ] ZTO: Loaded 49519 existing records. [2025-10-14T22:32:02.137682] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:32:02.137902] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-14T22:32:02.137960] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-14T22:32:02.139338] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-14T22:32:02.139397] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-14T22:32:02.363291] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-14T22:32:02.498171] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:32:03.158060] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-14T22:32:03.793403] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-14T22:32:03.958058] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-14T22:32:04.013137] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-14T22:32:04.018075] [INFO ] [REMOTE ] ZIP: Full fetch complete (60206 records). [2025-10-14T22:32:04.018221] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-14T22:32:04.404473] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-14T22:32:04.404573] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-14T22:32:04.405678] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-14T22:32:04.405737] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-14T22:32:04.406877] [DEBUG] [LOCAL ] ZIP: Trimmed 60206 records to 43727 (keeping 200 days of data) [2025-10-14T22:32:04.646328] [DEBUG] [LOCAL ] ZIP: Primary data saved (43727 records). [2025-10-14T22:32:04.646446] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-14T22:32:04.647255] [INFO ] [MAIN ] Update Progress: 2362/2369 symbols completed. ZIP took 31.2s. Estimated remaining: 59.0s. Rate: 7.1 symbols/min [2025-10-14T22:32:04.763223] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-14T22:32:04.850721] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:32:04.868369] [DEBUG] [LOCAL ] ZTR: Loaded 16829 existing records from primary storage. [2025-10-14T22:32:04.868606] [INFO ] [MAIN ] ZTR: Loaded 16829 existing records. [2025-10-14T22:32:05.051746] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:32:05.052104] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-14T22:32:05.052186] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-14T22:32:05.052712] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-14T22:32:05.052778] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-14T22:32:05.185499] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-14T22:32:05.447423] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:32:05.558018] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-14T22:32:06.110320] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-14T22:32:06.216970] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-14T22:32:06.221368] [INFO ] [REMOTE ] ZK: Full fetch complete (56966 records). [2025-10-14T22:32:06.221456] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-14T22:32:06.366337] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-14T22:32:06.623260] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-14T22:32:06.623339] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-14T22:32:06.624555] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-14T22:32:06.624632] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-14T22:32:06.625928] [DEBUG] [LOCAL ] ZK: Trimmed 56966 records to 39048 (keeping 200 days of data) [2025-10-14T22:32:06.851771] [DEBUG] [LOCAL ] ZK: Primary data saved (39048 records). [2025-10-14T22:32:06.851908] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-14T22:32:06.851987] [INFO ] [MAIN ] Update Progress: 2363/2369 symbols completed. ZK took 33.4s. Estimated remaining: 50.6s. Rate: 7.1 symbols/min [2025-10-14T22:32:07.031306] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:32:07.087455] [DEBUG] [LOCAL ] ZTS: Loaded 53112 existing records from primary storage. [2025-10-14T22:32:07.087941] [INFO ] [MAIN ] ZTS: Loaded 53112 existing records. [2025-10-14T22:32:07.163257] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-14T22:32:07.299326] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-14T22:32:07.297607] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:32:07.309529] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-14T22:32:07.309601] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-14T22:32:07.310750] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-14T22:32:07.310808] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-14T22:32:07.661148] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:32:07.958101] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-14T22:32:08.218399] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-14T22:32:08.400130] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-14T22:32:08.758200] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-14T22:32:09.558112] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-14T22:32:09.840525] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-14T22:32:10.358086] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-14T22:32:10.763302] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-14T22:32:10.770790] [INFO ] [REMOTE ] ZIM: Full fetch complete (77599 records). [2025-10-14T22:32:10.770948] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-14T22:32:11.179296] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-14T22:32:11.179459] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-14T22:32:11.175495] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-14T22:32:11.180868] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-14T22:32:11.180974] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-14T22:32:11.197788] [DEBUG] [LOCAL ] ZIM: Trimmed 77599 records to 53497 (keeping 200 days of data) [2025-10-14T22:32:11.224583] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-14T22:32:11.337715] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-14T22:32:11.586898] [DEBUG] [LOCAL ] ZIM: Primary data saved (53497 records). [2025-10-14T22:32:11.587048] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-14T22:32:11.587131] [INFO ] [MAIN ] Update Progress: 2364/2369 symbols completed. ZIM took 38.2s. Estimated remaining: 42.1s. Rate: 7.1 symbols/min [2025-10-14T22:32:11.756748] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:32:11.789410] [DEBUG] [LOCAL ] ZVIA: Loaded 35625 existing records from primary storage. [2025-10-14T22:32:11.789718] [INFO ] [MAIN ] ZVIA: Loaded 35625 existing records. [2025-10-14T22:32:11.964434] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-14T22:32:11.969803] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:32:11.970913] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-14T22:32:11.970964] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-14T22:32:11.971617] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-14T22:32:11.971744] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-14T22:32:12.332665] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:32:12.630445] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-14T22:32:12.758072] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-14T22:32:13.558181] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-14T22:32:13.874773] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-14T22:32:14.358035] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-14T22:32:14.383172] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-14T22:32:14.469104] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-14T22:32:15.158148] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-14T22:32:15.896497] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-14T22:32:15.958132] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-14T22:32:16.758051] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-14T22:32:16.939936] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-14T22:32:16.984020] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-14T22:32:17.558077] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-14T22:32:18.270241] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-14T22:32:18.358036] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-14T22:32:19.158061] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-14T22:32:19.858335] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-14T22:32:19.880449] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-14T22:32:19.958065] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-14T22:32:20.186891] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-14T22:32:20.758142] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-14T22:32:21.439705] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-14T22:32:21.558069] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-14T22:32:22.358044] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-14T22:32:22.773234] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-14T22:32:22.815834] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-14T22:32:23.158143] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-14T22:32:23.354111] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-14T22:32:23.958127] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-14T22:32:24.366924] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-14T22:32:24.758074] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-14T22:32:25.558094] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-14T22:32:25.637984] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-14T22:32:25.812279] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-14T22:32:26.358133] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-14T22:32:27.158088] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-14T22:32:27.447321] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-14T22:32:27.958061] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-14T22:32:28.151629] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-14T22:32:28.272722] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-14T22:32:28.758073] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-14T22:32:29.558059] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-14T22:32:29.619924] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-14T22:32:29.680025] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-14T22:32:30.358070] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-14T22:32:31.158112] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-14T22:32:31.329440] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-14T22:32:31.958039] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-14T22:32:32.007618] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-14T22:32:32.010104] [INFO ] [REMOTE ] ZTR: Full fetch complete (26952 records). [2025-10-14T22:32:32.010177] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-14T22:32:32.341998] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-14T22:32:32.452595] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-14T22:32:32.452702] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-14T22:32:32.453290] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-14T22:32:32.453333] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-14T22:32:32.454080] [DEBUG] [LOCAL ] ZTR: Trimmed 26952 records to 16762 (keeping 200 days of data) [2025-10-14T22:32:32.553016] [DEBUG] [LOCAL ] ZTR: Primary data saved (16762 records). [2025-10-14T22:32:32.553153] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-14T22:32:32.553231] [INFO ] [MAIN ] Update Progress: 2365/2369 symbols completed. ZTR took 27.9s. Estimated remaining: 33.7s. Rate: 7.1 symbols/min [2025-10-14T22:32:32.726773] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-06 to 2025-10-14. [2025-10-14T22:32:32.764562] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-14T22:32:32.767056] [DEBUG] [LOCAL ] ZWS: Loaded 42321 existing records from primary storage. [2025-10-14T22:32:32.767350] [INFO ] [MAIN ] ZWS: Loaded 42321 existing records. [2025-10-14T22:32:32.976522] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-27, but need from 2024-12-26 for 200 day retention. Performing full refresh. [2025-10-14T22:32:32.976805] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-14T22:32:32.976860] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-14T22:32:32.977623] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-14T22:32:32.977722] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-14T22:32:33.342444] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-26 to 2025-10-14 (requires 11 months of data pull). [2025-10-14T22:32:33.558046] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-14T22:32:33.741195] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-14T22:32:34.284141] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-14T22:32:34.358044] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-14T22:32:34.874385] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-14T22:32:35.158059] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-14T22:32:35.946964] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-14T22:32:35.958014] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-14T22:32:36.760402] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-14T22:32:36.768315] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-14T22:32:37.505846] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-14T22:32:37.558074] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-14T22:32:37.780065] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-14T22:32:38.358111] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-14T22:32:38.939907] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-14T22:32:38.945457] [INFO ] [REMOTE ] ZTO: Full fetch complete (72899 records). [2025-10-14T22:32:38.945614] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-14T22:32:39.166523] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-14T22:32:39.343246] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-14T22:32:39.343322] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-14T22:32:39.344487] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-14T22:32:39.344547] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-14T22:32:39.345934] [DEBUG] [LOCAL ] ZTO: Trimmed 72899 records to 49503 (keeping 200 days of data) [2025-10-14T22:32:39.656511] [DEBUG] [LOCAL ] ZTO: Primary data saved (49503 records). [2025-10-14T22:32:39.656687] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-14T22:32:39.656777] [INFO ] [MAIN ] Update Progress: 2366/2369 symbols completed. ZTO took 37.9s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-14T22:32:39.874361] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-14T22:32:39.958055] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-14T22:32:40.744244] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-14T22:32:40.758032] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-14T22:32:41.356774] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-14T22:32:41.386219] [INFO ] [REMOTE ] ZTS: Full fetch complete (76881 records). [2025-10-14T22:32:41.387078] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-14T22:32:41.396051] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-14T22:32:41.567341] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-14T22:32:41.789100] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-14T22:32:41.789194] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-14T22:32:41.790574] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-14T22:32:41.790662] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-14T22:32:41.792190] [DEBUG] [LOCAL ] ZTS: Trimmed 76881 records to 53127 (keeping 200 days of data) [2025-10-14T22:32:42.123434] [DEBUG] [LOCAL ] ZTS: Primary data saved (53127 records). [2025-10-14T22:32:42.123571] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-14T22:32:42.124174] [INFO ] [MAIN ] Update Progress: 2367/2369 symbols completed. ZTS took 35.3s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-14T22:32:42.358117] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-14T22:32:43.147172] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-14T22:32:43.158025] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-14T22:32:44.017317] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-14T22:32:44.027450] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-14T22:32:44.589244] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-14T22:32:44.758163] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-14T22:32:45.191862] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-14T22:32:45.558131] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-14T22:32:46.227317] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-14T22:32:46.358138] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-14T22:32:46.525430] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-14T22:32:47.158140] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-14T22:32:47.313877] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-14T22:32:47.318204] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52894 records). [2025-10-14T22:32:47.318288] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-14T22:32:47.697660] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-14T22:32:47.697746] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-14T22:32:47.698729] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-14T22:32:47.698791] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-14T22:32:47.699757] [DEBUG] [LOCAL ] ZVIA: Trimmed 52894 records to 35749 (keeping 200 days of data) [2025-10-14T22:32:47.893952] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35749 records). [2025-10-14T22:32:47.894087] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-14T22:32:47.894163] [INFO ] [MAIN ] Update Progress: 2368/2369 symbols completed. ZVIA took 36.3s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-14T22:32:48.809201] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-14T22:32:48.819158] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-14T22:32:50.346197] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-14T22:32:50.355558] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-14T22:32:52.045260] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-14T22:32:52.055106] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-14T22:32:53.351976] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-14T22:32:53.356909] [INFO ] [REMOTE ] ZWS: Full fetch complete (62007 records). [2025-10-14T22:32:53.357020] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-14T22:32:53.805401] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-14T22:32:53.805492] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-14T22:32:53.806795] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-14T22:32:53.806862] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-14T22:32:53.808497] [DEBUG] [LOCAL ] ZWS: Trimmed 62007 records to 42346 (keeping 200 days of data) [2025-10-14T22:32:54.091164] [DEBUG] [LOCAL ] ZWS: Primary data saved (42346 records). [2025-10-14T22:32:54.091320] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-14T22:32:54.091408] [INFO ] [MAIN ] Update Progress: 2369/2369 symbols completed. ZWS took 21.5s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-14T22:32:54.092203] [INFO ] [MAIN ] Parallel update completed in 5h 32m 50s [2025-10-14T22:32:54.092281] [WARN ] [MAIN ] Failed symbols (557): AAMI, AAM, AAT, AAUC, ABBV, ABG, ABT, ACCO, ACEL, ACHR... [2025-10-14T22:32:54.092354] [INFO ] [MAIN ] Update success rate: 76.5% (1812/2369 symbols) [2025-10-14T22:32:54.785337] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1812/2369 @ 76.49%)' [2025-10-14T22:32:54.785774] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-14T22:32:54.785840] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-14T22:32:54.785879] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-14T22:32:54.785965] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-14T22:32:54.785999] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-14T22:32:56.482855] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-14T22:32:56.483008] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-14T22:32:56.483203] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-14T22:32:56.483776] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-14T22:32:56.483832] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-14T22:32:56.483863] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-14T22:32:56.483931] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-14T22:32:56.483963] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-14T22:32:56.483991] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-14T22:32:56.484388] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-14T22:32:56.484439] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-14T22:32:56.484615] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-14T22:32:56.484674] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-14T22:32:56.484725] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-14T22:32:56.484758] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-14T22:32:56.506848] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-14T22:32:56.528195] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-14T22:32:56.528325] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-14T22:32:56.528361] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-14T22:32:56.528390] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-14T22:32:56.528444] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-14T22:32:56.528476] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-14T22:32:56.528510] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-14T22:32:56.529600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-14T22:32:56.529788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-14T22:32:56.529918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-14T22:32:56.530038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-14T22:32:56.530179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-14T22:32:56.530321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-14T22:32:56.530463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-14T22:32:56.530603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-14T22:32:56.530770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-14T22:32:56.530895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-14T22:32:56.531020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-14T22:32:56.531143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-14T22:32:56.531287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-14T22:32:56.531426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-14T22:32:56.531564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-14T22:32:56.531711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-14T22:32:56.531844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-14T22:32:56.531998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-14T22:32:56.532160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-14T22:32:56.532296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-14T22:32:56.532415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-14T22:32:56.532511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-14T22:32:56.532760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-14T22:32:56.532897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-14T22:32:56.533107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-14T22:32:56.533297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-14T22:32:56.533477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-14T22:32:56.533614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-14T22:32:56.533784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-14T22:32:56.533927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-14T22:32:56.534062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-14T22:32:56.534200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-14T22:32:56.534377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-14T22:32:56.534512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-14T22:32:56.534668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-14T22:32:56.534794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-14T22:32:56.534894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-14T22:32:56.534987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-14T22:32:56.535081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-14T22:32:56.535172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-14T22:32:56.535301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-14T22:32:56.535456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-14T22:32:56.535574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-14T22:32:56.535701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-14T22:32:56.535897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-14T22:32:56.535995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-14T22:32:56.536088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-14T22:32:56.536180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-14T22:32:56.536290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-14T22:32:56.536425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-14T22:32:56.536568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-14T22:32:56.536712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-14T22:32:56.536847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-14T22:32:56.536970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-14T22:32:56.537083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-14T22:32:56.537201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-14T22:32:56.537293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-14T22:32:56.537388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-14T22:32:56.537628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-14T22:32:56.537805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-14T22:32:56.537961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-14T22:32:56.538130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-14T22:32:56.538269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-14T22:32:56.538388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-14T22:32:56.538482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-14T22:32:56.538594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-14T22:32:56.538751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-14T22:32:56.538861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-14T22:32:56.538974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-14T22:32:56.539091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-14T22:32:56.539203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-14T22:32:56.539334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-14T22:32:56.539450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-14T22:32:56.539546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-14T22:32:56.539660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-14T22:32:56.539786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-14T22:32:56.539884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-14T22:32:56.539980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-14T22:32:56.540074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-14T22:32:56.540166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-14T22:32:56.540259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-14T22:32:56.540349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-14T22:32:56.540443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-14T22:32:56.540533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-14T22:32:56.540858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-14T22:32:56.540975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-14T22:32:56.541082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-14T22:32:56.541195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-14T22:32:56.541303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-14T22:32:56.541411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-14T22:32:56.541515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-14T22:32:56.541682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-14T22:32:56.541862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-14T22:32:56.542010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-14T22:32:56.542145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-14T22:32:56.542372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-14T22:32:56.542542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-14T22:32:56.542727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-14T22:32:56.542895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-14T22:32:56.543057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-14T22:32:56.543177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-14T22:32:56.543275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-14T22:32:56.543374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-14T22:32:56.543475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-14T22:32:56.543575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-14T22:32:56.543710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-14T22:32:56.543833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-14T22:32:56.543934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-14T22:32:56.544059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-14T22:32:56.544185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-14T22:32:56.544285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-14T22:32:56.544406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-14T22:32:56.544540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-14T22:32:56.544692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-14T22:32:56.544840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-14T22:32:56.544964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-14T22:32:56.545064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-14T22:32:56.545163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-14T22:32:56.545258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-14T22:32:56.545374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-14T22:32:56.545488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-14T22:32:56.545591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-14T22:32:56.545765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-14T22:32:56.545910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-14T22:32:56.546047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-14T22:32:56.546327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-14T22:32:56.546423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-14T22:32:56.546545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-14T22:32:56.546709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-14T22:32:56.546833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-14T22:32:56.546927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-14T22:32:56.547023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-14T22:32:56.547120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-14T22:32:56.547217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-14T22:32:56.547312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-14T22:32:56.547435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-14T22:32:56.547569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-14T22:32:56.547821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-14T22:32:56.547973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-14T22:32:56.548081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-14T22:32:56.548193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-14T22:32:56.548343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-14T22:32:56.548462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-14T22:32:56.548562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-14T22:32:56.548685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-14T22:32:56.548807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-14T22:32:56.548904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-14T22:32:56.549007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-14T22:32:56.549104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-14T22:32:56.549202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-14T22:32:56.549318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-14T22:32:56.549437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-14T22:32:56.549530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-14T22:32:56.549626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-14T22:32:56.549792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-14T22:32:56.549908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-14T22:32:56.550006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-14T22:32:56.550128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-14T22:32:56.550251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-14T22:32:56.550349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-14T22:32:56.550441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-14T22:32:56.550757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-14T22:32:56.550899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-14T22:32:56.551018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-14T22:32:56.551116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-14T22:32:56.551214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-14T22:32:56.551399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-14T22:32:56.551545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-14T22:32:56.551699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-14T22:32:56.551831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-14T22:32:56.551927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-14T22:32:56.552022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-14T22:32:56.552147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-14T22:32:56.552289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-14T22:32:56.552521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-14T22:32:56.552702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-14T22:32:56.552816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-14T22:32:56.552932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-14T22:32:56.553053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-14T22:32:56.553168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-14T22:32:56.553289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-14T22:32:56.553387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-14T22:32:56.553498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-14T22:32:56.553620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-14T22:32:56.553779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-14T22:32:56.553906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-14T22:32:56.554007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-14T22:32:56.554124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-14T22:32:56.554251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-14T22:32:56.554360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-14T22:32:56.554459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-14T22:32:56.554556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-14T22:32:56.554927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-14T22:32:56.555060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-14T22:32:56.555166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-14T22:32:56.555262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-14T22:32:56.555356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-14T22:32:56.555479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-14T22:32:56.555603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-14T22:32:56.555771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-14T22:32:56.555919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-14T22:32:56.556042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-14T22:32:56.556143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-14T22:32:56.556242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-14T22:32:56.556342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-14T22:32:56.556449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-14T22:32:56.556573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-14T22:32:56.556724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-14T22:32:56.557028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-14T22:32:56.557128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-14T22:32:56.557238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-14T22:32:56.557359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-14T22:32:56.557461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-14T22:32:56.557565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-14T22:32:56.557719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-14T22:32:56.557881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-14T22:32:56.558027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-14T22:32:56.558151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-14T22:32:56.558277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-14T22:32:56.558434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-14T22:32:56.558556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-14T22:32:56.558702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-14T22:32:56.558872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-14T22:32:56.559013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-14T22:32:56.559132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-14T22:32:56.559236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-14T22:32:56.559337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-14T22:32:56.559456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-14T22:32:56.559579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-14T22:32:56.559715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-14T22:32:56.559855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-14T22:32:56.560013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-14T22:32:56.560138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-14T22:32:56.560236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-14T22:32:56.560339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-14T22:32:56.560436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-14T22:32:56.560536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-14T22:32:56.560736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-14T22:32:56.560893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-14T22:32:56.561035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-14T22:32:56.561164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-14T22:32:56.561264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-14T22:32:56.561367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-14T22:32:56.561464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-14T22:32:56.561565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-14T22:32:56.561899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-14T22:32:56.562033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-14T22:32:56.562135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-14T22:32:56.562238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-14T22:32:56.562338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-14T22:32:56.562440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-14T22:32:56.562745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-14T22:32:56.562897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-14T22:32:56.563013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-14T22:32:56.563114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-14T22:32:56.563211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-14T22:32:56.563307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-14T22:32:56.563420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-14T22:32:56.563539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-14T22:32:56.563668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-14T22:32:56.563802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-14T22:32:56.563906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-14T22:32:56.564004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-14T22:32:56.564141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-14T22:32:56.564263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-14T22:32:56.564361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-14T22:32:56.564484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-14T22:32:56.564608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-14T22:32:56.564751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-14T22:32:56.564876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-14T22:32:56.564974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-14T22:32:56.565075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-14T22:32:56.565191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-14T22:32:56.565310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-14T22:32:56.565439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-14T22:32:56.565557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-14T22:32:56.565784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-14T22:32:56.565902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-14T22:32:56.566009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-14T22:32:56.566107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-14T22:32:56.566227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-14T22:32:56.566347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-14T22:32:56.566462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-14T22:32:56.566587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-14T22:32:56.566708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-14T22:32:56.566848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-14T22:32:56.566971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-14T22:32:56.567069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-14T22:32:56.567184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-14T22:32:56.567508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-14T22:32:56.567660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-14T22:32:56.567791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-14T22:32:56.567910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-14T22:32:56.568034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-14T22:32:56.568133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-14T22:32:56.568302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-14T22:32:56.568398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-14T22:32:56.568491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-14T22:32:56.568585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-14T22:32:56.568753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-14T22:32:56.568887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-14T22:32:56.568985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-14T22:32:56.569104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-14T22:32:56.569223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-14T22:32:56.569317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-14T22:32:56.569403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-14T22:32:56.569512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-14T22:32:56.569670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-14T22:32:56.569878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-14T22:32:56.570029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-14T22:32:56.570157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-14T22:32:56.570307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-14T22:32:56.570426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-14T22:32:56.570515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-14T22:32:56.570610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-14T22:32:56.570737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-14T22:32:56.570855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-14T22:32:56.570952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-14T22:32:56.571049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-14T22:32:56.571143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-14T22:32:56.571237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-14T22:32:56.571329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-14T22:32:56.571421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-14T22:32:56.571513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-14T22:32:56.571602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-14T22:32:56.571725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-14T22:32:56.571839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-14T22:32:56.571967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-14T22:32:56.572124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-14T22:32:56.572241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-14T22:32:56.572336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-14T22:32:56.572429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-14T22:32:56.572519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-14T22:32:56.572611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-14T22:32:56.572747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-14T22:32:56.572858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-14T22:32:56.572952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-14T22:32:56.573046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-14T22:32:56.573140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-14T22:32:56.573231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-14T22:32:56.573325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-14T22:32:56.573419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-14T22:32:56.573509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-14T22:32:56.573904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-14T22:32:56.574029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-14T22:32:56.574125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-14T22:32:56.574209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-14T22:32:56.574321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-14T22:32:56.574438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-14T22:32:56.574533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-14T22:32:56.574620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-14T22:32:56.574751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-14T22:32:56.574866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-14T22:32:56.574963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-14T22:32:56.575058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-14T22:32:56.575152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-14T22:32:56.575242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-14T22:32:56.575334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-14T22:32:56.575444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-14T22:32:56.575562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-14T22:32:56.575684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-14T22:32:56.575805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-14T22:32:56.575900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-14T22:32:56.575991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-14T22:32:56.576100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-14T22:32:56.576219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-14T22:32:56.576343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-14T22:32:56.576454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-14T22:32:56.576546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-14T22:32:56.576637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-14T22:32:56.576796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-14T22:32:56.576914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-14T22:32:56.577031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-14T22:32:56.577121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-14T22:32:56.577214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-14T22:32:56.577305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-14T22:32:56.577413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-14T22:32:56.577550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-10-14T22:32:56.577698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-14T22:32:56.577914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-14T22:32:56.578190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-14T22:32:56.578314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-14T22:32:56.578409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-14T22:32:56.578502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-14T22:32:56.578601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-14T22:32:56.578719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-14T22:32:56.578892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-14T22:32:56.579018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-14T22:32:56.579114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-14T22:32:56.579213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-14T22:32:56.579307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-14T22:32:56.579421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-14T22:32:56.579541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-14T22:32:56.579637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-14T22:32:56.579783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-14T22:32:56.579886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-14T22:32:56.579999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-14T22:32:56.580117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-14T22:32:56.580214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-14T22:32:56.580469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-14T22:32:56.580584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-14T22:32:56.580739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-14T22:32:56.580876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-14T22:32:56.581001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-14T22:32:56.581099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-14T22:32:56.581227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-14T22:32:56.581341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-14T22:32:56.581438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-14T22:32:56.581552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-14T22:32:56.581762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-14T22:32:56.581879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-14T22:32:56.581974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-14T22:32:56.582070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-14T22:32:56.582171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-14T22:32:56.582262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-14T22:32:56.582355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-14T22:32:56.582447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-14T22:32:56.582544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-14T22:32:56.582635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-14T22:32:56.582800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-14T22:32:56.582921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-14T22:32:56.583019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-14T22:32:56.583110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-14T22:32:56.583204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-14T22:32:56.583295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-14T22:32:56.583408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-14T22:32:56.583528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-14T22:32:56.583628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-14T22:32:56.583764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-14T22:32:56.583867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-14T22:32:56.583960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-14T22:32:56.584053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-14T22:32:56.584147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-14T22:32:56.584242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-14T22:32:56.584334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-14T22:32:56.584425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-14T22:32:56.584518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-14T22:32:56.584612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-14T22:32:56.584744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-14T22:32:56.584894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-14T22:32:56.585191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-14T22:32:56.585311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-14T22:32:56.585409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-14T22:32:56.585511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-14T22:32:56.585604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-14T22:32:56.585738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-14T22:32:56.585856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-14T22:32:56.585954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-14T22:32:56.586045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-14T22:32:56.586156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-14T22:32:56.586358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-14T22:32:56.586513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-14T22:32:56.586678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-14T22:32:56.586812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-14T22:32:56.586928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-14T22:32:56.587087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-14T22:32:56.587205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-14T22:32:56.587303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-14T22:32:56.587398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-14T22:32:56.587491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-14T22:32:56.587583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-14T22:32:56.587715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-14T22:32:56.587834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-14T22:32:56.587989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-14T22:32:56.588107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-14T22:32:56.588204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-14T22:32:56.588297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-14T22:32:56.588389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-14T22:32:56.588508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-14T22:32:56.588628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-14T22:32:56.588781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-14T22:32:56.588899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-14T22:32:56.588991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-14T22:32:56.589085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-14T22:32:56.589176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-14T22:32:56.589269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-14T22:32:56.589360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-14T22:32:56.589455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-14T22:32:56.589564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-14T22:32:56.589843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-14T22:32:56.589990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-14T22:32:56.590135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-14T22:32:56.590247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-14T22:32:56.590343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-14T22:32:56.590450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-14T22:32:56.590560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-14T22:32:56.590685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-14T22:32:56.590827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-14T22:32:56.590944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-14T22:32:56.591040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-14T22:32:56.591307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-14T22:32:56.591425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-14T22:32:56.591519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-14T22:32:56.591613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-14T22:32:56.591764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-14T22:32:56.591883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-14T22:32:56.591978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-14T22:32:56.592069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-14T22:32:56.592217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-14T22:32:56.592340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-14T22:32:56.592440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-14T22:32:56.592555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-14T22:32:56.592711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-14T22:32:56.592834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-14T22:32:56.592933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-14T22:32:56.593030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-14T22:32:56.593124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-14T22:32:56.593213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-14T22:32:56.593306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-14T22:32:56.593402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-14T22:32:56.593497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-14T22:32:56.593589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-14T22:32:56.593707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-14T22:32:56.593816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-14T22:32:56.593915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-14T22:32:56.594012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-14T22:32:56.594105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-14T22:32:56.594199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-14T22:32:56.594291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-14T22:32:56.594428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-14T22:32:56.594543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-14T22:32:56.594736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-14T22:32:56.594889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-14T22:32:56.595027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-14T22:32:56.595240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-14T22:32:56.595339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-14T22:32:56.595434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-14T22:32:56.595530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-14T22:32:56.595621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-14T22:32:56.595760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-14T22:32:56.595870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-14T22:32:56.595964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-14T22:32:56.596062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-14T22:32:56.596157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-14T22:32:56.596249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-14T22:32:56.596344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-14T22:32:56.596438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-14T22:32:56.596533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-14T22:32:56.596626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-14T22:32:56.596799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-14T22:32:56.597086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-14T22:32:56.597203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-14T22:32:56.597327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-14T22:32:56.597423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-14T22:32:56.597517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-14T22:32:56.597613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-14T22:32:56.597936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-14T22:32:56.598058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-14T22:32:56.598154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-14T22:32:56.598271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-14T22:32:56.598390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-14T22:32:56.598489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-14T22:32:56.598584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-14T22:32:56.598704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-14T22:32:56.598814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-14T22:32:56.598912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-14T22:32:56.599004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-14T22:32:56.599106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-14T22:32:56.599196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-14T22:32:56.599289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-14T22:32:56.599380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-14T22:32:56.599471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-14T22:32:56.599565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-14T22:32:56.599682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-14T22:32:56.599802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-14T22:32:56.599920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-14T22:32:56.600039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-14T22:32:56.600131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-14T22:32:56.600225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-14T22:32:56.600318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-14T22:32:56.600429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-14T22:32:56.600545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-14T22:32:56.600674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-14T22:32:56.600803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-14T22:32:56.600903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-14T22:32:56.600996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-14T22:32:56.601293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-14T22:32:56.601411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-14T22:32:56.601508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-14T22:32:56.601605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-14T22:32:56.601738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-14T22:32:56.601859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-14T22:32:56.601957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-14T22:32:56.602071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-14T22:32:56.602188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-14T22:32:56.602300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-14T22:32:56.602417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-14T22:32:56.602512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-14T22:32:56.602605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-14T22:32:56.602738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-14T22:32:56.602859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-14T22:32:56.602955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-14T22:32:56.603143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-14T22:32:56.603288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-14T22:32:56.603430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-14T22:32:56.603552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-14T22:32:56.603678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-14T22:32:56.603799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-14T22:32:56.603895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-14T22:32:56.603985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-14T22:32:56.604079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-14T22:32:56.604187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-14T22:32:56.604304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-14T22:32:56.604399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-14T22:32:56.604493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-14T22:32:56.604586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-14T22:32:56.604710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-14T22:32:56.604861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-14T22:32:56.604999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-14T22:32:56.605113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-14T22:32:56.605230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-14T22:32:56.605364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-14T22:32:56.605483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-14T22:32:56.605573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-14T22:32:56.605825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-14T22:32:56.605949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-14T22:32:56.606044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-14T22:32:56.606136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-14T22:32:56.606221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-14T22:32:56.606352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-14T22:32:56.606560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-14T22:32:56.606683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-14T22:32:56.606811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-14T22:32:56.606911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-14T22:32:56.607006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-14T22:32:56.607102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-14T22:32:56.607211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-14T22:32:56.607321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-14T22:32:56.607418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-14T22:32:56.607513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-14T22:32:56.607605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-14T22:32:56.607725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-14T22:32:56.607848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-14T22:32:56.607992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-14T22:32:56.608101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-14T22:32:56.608189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-14T22:32:56.608284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-14T22:32:56.608383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-14T22:32:56.608504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-14T22:32:56.608624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-14T22:32:56.608772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-14T22:32:56.608916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-14T22:32:56.609155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-14T22:32:56.609250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-14T22:32:56.609343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-14T22:32:56.609437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-14T22:32:56.609530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-14T22:32:56.609623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-14T22:32:56.609759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-14T22:32:56.609870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-14T22:32:56.609972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-14T22:32:56.610067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-14T22:32:56.610177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-14T22:32:56.610287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-14T22:32:56.610387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-14T22:32:56.610483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-14T22:32:56.610577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-14T22:32:56.610744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-14T22:32:56.610884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-14T22:32:56.611021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-14T22:32:56.611142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-14T22:32:56.611257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-14T22:32:56.611369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-14T22:32:56.611555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-14T22:32:56.611728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-14T22:32:56.611874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-14T22:32:56.612119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-14T22:32:56.612219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-14T22:32:56.612330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-14T22:32:56.612445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-14T22:32:56.612542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-14T22:32:56.612635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-14T22:32:56.612826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-14T22:32:56.612952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-14T22:32:56.613049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-14T22:32:56.613152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-14T22:32:56.613287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-14T22:32:56.613486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-14T22:32:56.613583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-14T22:32:56.613826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-14T22:32:56.613946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-14T22:32:56.614042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-14T22:32:56.614130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-14T22:32:56.614225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-14T22:32:56.614319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-14T22:32:56.614412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-14T22:32:56.614524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-14T22:32:56.614670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-14T22:32:56.614796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-14T22:32:56.614892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-14T22:32:56.614988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-14T22:32:56.615080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-14T22:32:56.615172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-14T22:32:56.615427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-14T22:32:56.615520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-14T22:32:56.615613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-14T22:32:56.615736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-14T22:32:56.615888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-14T22:32:56.616008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-14T22:32:56.616103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-14T22:32:56.616198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-14T22:32:56.616294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-14T22:32:56.616386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-14T22:32:56.616479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-14T22:32:56.616566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-14T22:32:56.616714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-14T22:32:56.616836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-14T22:32:56.616931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-14T22:32:56.617025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-14T22:32:56.617116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-14T22:32:56.617242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-14T22:32:56.617352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-14T22:32:56.617447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-14T22:32:56.617538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-14T22:32:56.617630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-14T22:32:56.617768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-14T22:32:56.617896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-14T22:32:56.618016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-14T22:32:56.618111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-14T22:32:56.618249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-14T22:32:56.618368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-14T22:32:56.618476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-14T22:32:56.618609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-14T22:32:56.618753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-14T22:32:56.618857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-14T22:32:56.618954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-14T22:32:56.619053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-14T22:32:56.619171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-14T22:32:56.619258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-14T22:32:56.619549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-14T22:32:56.619693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-14T22:32:56.619810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-14T22:32:56.619906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-14T22:32:56.619995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-14T22:32:56.620168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-14T22:32:56.620315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-14T22:32:56.620455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-14T22:32:56.620608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-14T22:32:56.620775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-14T22:32:56.620899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-14T22:32:56.620995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-14T22:32:56.621087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-14T22:32:56.621202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-14T22:32:56.621323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-14T22:32:56.621418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-14T22:32:56.621535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-14T22:32:56.621825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-14T22:32:56.621954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-14T22:32:56.622052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-14T22:32:56.622184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-14T22:32:56.622288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-14T22:32:56.622385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-14T22:32:56.622471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-14T22:32:56.622563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-14T22:32:56.622684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-14T22:32:56.622802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-14T22:32:56.622901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-14T22:32:56.622999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-14T22:32:56.623091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-14T22:32:56.623185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-14T22:32:56.623276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-14T22:32:56.623399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-14T22:32:56.623521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-14T22:32:56.623610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-14T22:32:56.623751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-14T22:32:56.623872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-14T22:32:56.623967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-14T22:32:56.624064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-14T22:32:56.624159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-14T22:32:56.624253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-14T22:32:56.624362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-14T22:32:56.624480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-14T22:32:56.624578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-14T22:32:56.624709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-14T22:32:56.624836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-14T22:32:56.624937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-14T22:32:56.625034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-14T22:32:56.625316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-14T22:32:56.625411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-14T22:32:56.625504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-14T22:32:56.625599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-14T22:32:56.625825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-14T22:32:56.625944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-14T22:32:56.626035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-14T22:32:56.626129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-14T22:32:56.626222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-14T22:32:56.626316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-14T22:32:56.626445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-14T22:32:56.626557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-14T22:32:56.626677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-14T22:32:56.626799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-14T22:32:56.626896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-14T22:32:56.626989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-14T22:32:56.627078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-14T22:32:56.627171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-14T22:32:56.627264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-14T22:32:56.627358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-14T22:32:56.627452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-14T22:32:56.627545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-14T22:32:56.627636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-14T22:32:56.627779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-14T22:32:56.627915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-14T22:32:56.628034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-14T22:32:56.628129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-14T22:32:56.628223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-14T22:32:56.628399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-14T22:32:56.628543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-14T22:32:56.628696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-14T22:32:56.628811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-14T22:32:56.628911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-14T22:32:56.629006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-14T22:32:56.629098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-14T22:32:56.629185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-14T22:32:56.629294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-14T22:32:56.629405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-14T22:32:56.629503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-14T22:32:56.629614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-14T22:32:56.629764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-14T22:32:56.629871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-14T22:32:56.629960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-14T22:32:56.630054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-14T22:32:56.630162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-14T22:32:56.630281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-14T22:32:56.630377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-14T22:32:56.630468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-14T22:32:56.630567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-14T22:32:56.630685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-14T22:32:56.630898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-14T22:32:56.630992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-14T22:32:56.631084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-14T22:32:56.631223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-14T22:32:56.631340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-14T22:32:56.631453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-14T22:32:56.631575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-14T22:32:56.631727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-14T22:32:56.631845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-14T22:32:56.631944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-14T22:32:56.632036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-14T22:32:56.632177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-14T22:32:56.632294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-14T22:32:56.632387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-14T22:32:56.632478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-14T22:32:56.632564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-14T22:32:56.632685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-14T22:32:56.632804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-14T22:32:56.632894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-14T22:32:56.632988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-14T22:32:56.633079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-14T22:32:56.633350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-14T22:32:56.633444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-14T22:32:56.633558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-14T22:32:56.633824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-14T22:32:56.633943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-14T22:32:56.634057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-14T22:32:56.634181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-14T22:32:56.634280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-14T22:32:56.634376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-14T22:32:56.634471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-14T22:32:56.634586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-10-14T22:32:56.634733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-14T22:32:56.634847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-14T22:32:56.634949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-14T22:32:56.635041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-14T22:32:56.635173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-14T22:32:56.635285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-14T22:32:56.635384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-14T22:32:56.635495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-14T22:32:56.635613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-14T22:32:56.635747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-14T22:32:56.635861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-14T22:32:56.635957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-14T22:32:56.636051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-14T22:32:56.636145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-14T22:32:56.636239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-14T22:32:56.636331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-14T22:32:56.636426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-14T22:32:56.636605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-14T22:32:56.636791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-14T22:32:56.636937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-14T22:32:56.637057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-14T22:32:56.637156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-14T22:32:56.637282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-14T22:32:56.637401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-14T22:32:56.637494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-14T22:32:56.637589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-14T22:32:56.637708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-14T22:32:56.637828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-14T22:32:56.637956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-14T22:32:56.638061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-14T22:32:56.638153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-14T22:32:56.638247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-14T22:32:56.638341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-14T22:32:56.638433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-14T22:32:56.638529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-14T22:32:56.638622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-14T22:32:56.638922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-14T22:32:56.639043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-14T22:32:56.639143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-14T22:32:56.639234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-14T22:32:56.639326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-14T22:32:56.639420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-14T22:32:56.639549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-14T22:32:56.639685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-14T22:32:56.639796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-14T22:32:56.639893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-14T22:32:56.639984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-14T22:32:56.640078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-14T22:32:56.640170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-14T22:32:56.640266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-14T22:32:56.640358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-14T22:32:56.640445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-14T22:32:56.640548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-14T22:32:56.640725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-14T22:32:56.640844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-14T22:32:56.640943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-14T22:32:56.641054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-14T22:32:56.641174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-14T22:32:56.641269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-14T22:32:56.641378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-14T22:32:56.641496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-14T22:32:56.641593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-14T22:32:56.641781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-14T22:32:56.641901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-14T22:32:56.641996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-14T22:32:56.642088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-14T22:32:56.642175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-14T22:32:56.642337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-14T22:32:56.642485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-14T22:32:56.642612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-14T22:32:56.642745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-14T22:32:56.642857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-14T22:32:56.643151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-14T22:32:56.643246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-14T22:32:56.643354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-14T22:32:56.643474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-14T22:32:56.643569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-14T22:32:56.643677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-14T22:32:56.643796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-14T22:32:56.643893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-14T22:32:56.643984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-14T22:32:56.644111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-14T22:32:56.644218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-14T22:32:56.644313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-14T22:32:56.644409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-14T22:32:56.644500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-14T22:32:56.644611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-14T22:32:56.644766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-14T22:32:56.644946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-14T22:32:56.645110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-14T22:32:56.645278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-14T22:32:56.645398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-14T22:32:56.645492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-14T22:32:56.645586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-14T22:32:56.645705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-14T22:32:56.645832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-14T22:32:56.645928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-14T22:32:56.646024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-14T22:32:56.646121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-14T22:32:56.646219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-14T22:32:56.646316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-14T22:32:56.646409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-14T22:32:56.646501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-14T22:32:56.646608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-14T22:32:56.646754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-14T22:32:56.646865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-14T22:32:56.646966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-14T22:32:56.647058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-14T22:32:56.647153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-14T22:32:56.647250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-14T22:32:56.647349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-14T22:32:56.647452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-14T22:32:56.647579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-14T22:32:56.647703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-14T22:32:56.647825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-14T22:32:56.647958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-14T22:32:56.648075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-14T22:32:56.648174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-14T22:32:56.648272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-14T22:32:56.648364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-14T22:32:56.648462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-14T22:32:56.648555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-14T22:32:56.648682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-14T22:32:56.648939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-14T22:32:56.649060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-14T22:32:56.649177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-14T22:32:56.649309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-14T22:32:56.649427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-14T22:32:56.649522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-14T22:32:56.649616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-14T22:32:56.649888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-14T22:32:56.649999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-14T22:32:56.650096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-14T22:32:56.650190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-14T22:32:56.650286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-14T22:32:56.650382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-14T22:32:56.650476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-14T22:32:56.650571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-14T22:32:56.650695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-14T22:32:56.650810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-14T22:32:56.650906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-14T22:32:56.651002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-14T22:32:56.651096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-14T22:32:56.651189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-14T22:32:56.651277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-14T22:32:56.651372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-14T22:32:56.651466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-14T22:32:56.651559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-14T22:32:56.651676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-14T22:32:56.651798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-14T22:32:56.652102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-14T22:32:56.652197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-14T22:32:56.652293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-14T22:32:56.652388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-14T22:32:56.652479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-14T22:32:56.652573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-14T22:32:56.652705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-14T22:32:56.652836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-14T22:32:56.652936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-14T22:32:56.653123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-14T22:32:56.653268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-14T22:32:56.653397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-14T22:32:56.653517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-14T22:32:56.653615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-14T22:32:56.653756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-14T22:32:56.653891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-14T22:32:56.654016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-14T22:32:56.654112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-14T22:32:56.654207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-14T22:32:56.654302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-14T22:32:56.654395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-14T22:32:56.654489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-14T22:32:56.654612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-14T22:32:56.654758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-14T22:32:56.654861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-14T22:32:56.654972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-14T22:32:56.655090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-14T22:32:56.655186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-14T22:32:56.655279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-14T22:32:56.655373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-14T22:32:56.655467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-14T22:32:56.655577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-14T22:32:56.655718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-14T22:32:56.655836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-14T22:32:56.655933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-14T22:32:56.656024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-14T22:32:56.656116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-14T22:32:56.656209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-14T22:32:56.656298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-14T22:32:56.656387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-14T22:32:56.656478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-14T22:32:56.656570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-14T22:32:56.656699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-14T22:32:56.656820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-14T22:32:56.656915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-14T22:32:56.657041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-14T22:32:56.657148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-14T22:32:56.657241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-14T22:32:56.657334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-14T22:32:56.657427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-14T22:32:56.657511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-14T22:32:56.657908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-14T22:32:56.658032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-14T22:32:56.658121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-14T22:32:56.658214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-14T22:32:56.658308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-14T22:32:56.658399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-14T22:32:56.658493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-14T22:32:56.658584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-14T22:32:56.658703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-14T22:32:56.658819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-14T22:32:56.658909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-14T22:32:56.659006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-14T22:32:56.659103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-14T22:32:56.659198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-14T22:32:56.659293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-14T22:32:56.659385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-14T22:32:56.659477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-14T22:32:56.659571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-14T22:32:56.659694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-14T22:32:56.659820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-14T22:32:56.659918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-14T22:32:56.660016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-14T22:32:56.660110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-14T22:32:56.660205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-14T22:32:56.660297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-14T22:32:56.660384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-14T22:32:56.660477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-14T22:32:56.660569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-14T22:32:56.660698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-14T22:32:56.660887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-14T22:32:56.661064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-14T22:32:56.661208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-14T22:32:56.661323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-14T22:32:56.661485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-14T22:32:56.661581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-14T22:32:56.661705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-14T22:32:56.661829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-14T22:32:56.661930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-14T22:32:56.662024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-14T22:32:56.662133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-14T22:32:56.662252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-14T22:32:56.662369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-14T22:32:56.662489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-14T22:32:56.662583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-14T22:32:56.662705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-14T22:32:56.662843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-14T22:32:56.662968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-14T22:32:56.663067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-14T22:32:56.663273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-14T22:32:56.663369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-14T22:32:56.663456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-14T22:32:56.663546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-14T22:32:56.663639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-14T22:32:56.663792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-14T22:32:56.663891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-14T22:32:56.663987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-14T22:32:56.664082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-14T22:32:56.664178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-14T22:32:56.664269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-14T22:32:56.664363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-14T22:32:56.664458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-14T22:32:56.664550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-14T22:32:56.664637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-14T22:32:56.664791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-14T22:32:56.664892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-14T22:32:56.664988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-14T22:32:56.665084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-14T22:32:56.665179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-14T22:32:56.665270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-14T22:32:56.665359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-14T22:32:56.665450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-14T22:32:56.665576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-14T22:32:56.665824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-14T22:32:56.665947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-14T22:32:56.666041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-14T22:32:56.666147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-14T22:32:56.666268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-14T22:32:56.666363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-14T22:32:56.666456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-14T22:32:56.666567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-14T22:32:56.666710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-14T22:32:56.666960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-14T22:32:56.667059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-14T22:32:56.667170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-14T22:32:56.667288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-14T22:32:56.667384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-14T22:32:56.667476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-14T22:32:56.667569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-14T22:32:56.667688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-14T22:32:56.667876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-14T22:32:56.668003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-14T22:32:56.668097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-14T22:32:56.668190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-14T22:32:56.668281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-14T22:32:56.668391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-14T22:32:56.668510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-14T22:32:56.668603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-14T22:32:56.668733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-14T22:32:56.668856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-14T22:32:56.668949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-14T22:32:56.669118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-14T22:32:56.669257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-14T22:32:56.669383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-14T22:32:56.669504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-14T22:32:56.669627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-14T22:32:56.669787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-14T22:32:56.669906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-14T22:32:56.669999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-14T22:32:56.670092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-14T22:32:56.670209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-14T22:32:56.670327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-14T22:32:56.670421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-14T22:32:56.670514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-14T22:32:56.670606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-14T22:32:56.670724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-14T22:32:56.670856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-14T22:32:56.670975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-14T22:32:56.671071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-14T22:32:56.671162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-14T22:32:56.671255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-14T22:32:56.671438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-14T22:32:56.671533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-14T22:32:56.671626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-14T22:32:56.671767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-14T22:32:56.671871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-14T22:32:56.671965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-14T22:32:56.672057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-14T22:32:56.672149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-14T22:32:56.672231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-14T22:32:56.672323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-14T22:32:56.672415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-14T22:32:56.672506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-14T22:32:56.672597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-14T22:32:56.672769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-14T22:32:56.672914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-14T22:32:56.673031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-14T22:32:56.673124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-14T22:32:56.673214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-14T22:32:56.673307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-14T22:32:56.673400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-14T22:32:56.673507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-14T22:32:56.673625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-14T22:32:56.673870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-14T22:32:56.673980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-14T22:32:56.674068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-14T22:32:56.674154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-14T22:32:56.674245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-14T22:32:56.674469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-14T22:32:56.674584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-14T22:32:56.674708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-14T22:32:56.674827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-14T22:32:56.674921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-14T22:32:56.675014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-14T22:32:56.675107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-14T22:32:56.675202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-14T22:32:56.675297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-14T22:32:56.675388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-14T22:32:56.675485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-14T22:32:56.675579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-14T22:32:56.675701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-14T22:32:56.675821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-14T22:32:56.675938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-14T22:32:56.676063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-14T22:32:56.676162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-14T22:32:56.676260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-14T22:32:56.676357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-14T22:32:56.676451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-14T22:32:56.676544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-14T22:32:56.676631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-14T22:32:56.676782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-14T22:32:56.676889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-14T22:32:56.677060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-14T22:32:56.677195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-14T22:32:56.677323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-14T22:32:56.677566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-14T22:32:56.677714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-14T22:32:56.677836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-14T22:32:56.677990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-14T22:32:56.678096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-14T22:32:56.678196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-14T22:32:56.678292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-14T22:32:56.678389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-14T22:32:56.678485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-14T22:32:56.678581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-14T22:32:56.678702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-14T22:32:56.678831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-14T22:32:56.678930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-14T22:32:56.679028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-14T22:32:56.679124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-14T22:32:56.679241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-14T22:32:56.679357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-14T22:32:56.679456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-14T22:32:56.679553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-14T22:32:56.679676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-14T22:32:56.679800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-14T22:32:56.679899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-14T22:32:56.679995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-14T22:32:56.680091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-14T22:32:56.680186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-14T22:32:56.680283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-14T22:32:56.680504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-14T22:32:56.680600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-14T22:32:56.680742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-14T22:32:56.680881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-14T22:32:56.681003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-14T22:32:56.681104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-14T22:32:56.681201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-14T22:32:56.681295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-14T22:32:56.681422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-14T22:32:56.681541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-14T22:32:56.681752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-14T22:32:56.681880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-14T22:32:56.681978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-14T22:32:56.682074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-14T22:32:56.682171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-14T22:32:56.682283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-14T22:32:56.682400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-14T22:32:56.682500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-14T22:32:56.682591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-14T22:32:56.682714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-14T22:32:56.682836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-14T22:32:56.682933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-14T22:32:56.683027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-14T22:32:56.683121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-14T22:32:56.683223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-14T22:32:56.683320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-14T22:32:56.683416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-14T22:32:56.683510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-14T22:32:56.683612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-14T22:32:56.683761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-14T22:32:56.683867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-14T22:32:56.683962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-14T22:32:56.684058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-14T22:32:56.684150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-14T22:32:56.684245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-14T22:32:56.684480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-14T22:32:56.684573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-14T22:32:56.684709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-14T22:32:56.684831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-14T22:32:56.684934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-14T22:32:56.685043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-14T22:32:56.685163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-14T22:32:56.685334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-14T22:32:56.685680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-14T22:32:56.685809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-14T22:32:56.685900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-14T22:32:56.685997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-14T22:32:56.686093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-14T22:32:56.686188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-14T22:32:56.686280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-14T22:32:56.686390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-14T22:32:56.686509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-14T22:32:56.686623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-14T22:32:56.686772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-14T22:32:56.686876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-14T22:32:56.686975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-14T22:32:56.687068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-14T22:32:56.687161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-14T22:32:56.687254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-14T22:32:56.687353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-14T22:32:56.687449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-14T22:32:56.687548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-14T22:32:56.687681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-14T22:32:56.687805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-14T22:32:56.687946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-14T22:32:56.688065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-14T22:32:56.688161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-14T22:32:56.688255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-14T22:32:56.688354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-14T22:32:56.688447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-14T22:32:56.688575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-14T22:32:56.688744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-14T22:32:56.688866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-14T22:32:56.689080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-14T22:32:56.689177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-14T22:32:56.689277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-14T22:32:56.689373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-14T22:32:56.689468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-14T22:32:56.689564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-14T22:32:56.689795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-14T22:32:56.689917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-14T22:32:56.690017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-14T22:32:56.690113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-14T22:32:56.690247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-14T22:32:56.690374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-14T22:32:56.690471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-14T22:32:56.690567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-14T22:32:56.690689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-14T22:32:56.690813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-14T22:32:56.690909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-14T22:32:56.690997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-14T22:32:56.691091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-14T22:32:56.691183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-14T22:32:56.691282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-14T22:32:56.691376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-14T22:32:56.691471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-14T22:32:56.691566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-14T22:32:56.691688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-14T22:32:56.691812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-14T22:32:56.691914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-14T22:32:56.692017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-14T22:32:56.692105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-14T22:32:56.692200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-14T22:32:56.692298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-14T22:32:56.692393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-14T22:32:56.692602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-14T22:32:56.692737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-14T22:32:56.692871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-14T22:32:56.692984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-14T22:32:56.693117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-14T22:32:56.693238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-14T22:32:56.693338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-14T22:32:56.693434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-14T22:32:56.693606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-14T22:32:56.693787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-14T22:32:56.693927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-14T22:32:56.694036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-14T22:32:56.694137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-14T22:32:56.694232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-14T22:32:56.694325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-14T22:32:56.694420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-14T22:32:56.694513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-14T22:32:56.694608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-14T22:32:56.694736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-14T22:32:56.694869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-14T22:32:56.694989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-14T22:32:56.695086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-14T22:32:56.695182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-14T22:32:56.695277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-14T22:32:56.695378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-14T22:32:56.695476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-14T22:32:56.695567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-14T22:32:56.695689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-14T22:32:56.695810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-14T22:32:56.695906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-14T22:32:56.696163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-14T22:32:56.696261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-14T22:32:56.696355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-14T22:32:56.696456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-14T22:32:56.696552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-14T22:32:56.696675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-14T22:32:56.696800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-14T22:32:56.696900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-14T22:32:56.697008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-14T22:32:56.697130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-14T22:32:56.697245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-14T22:32:56.697366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-14T22:32:56.697463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-14T22:32:56.697575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-14T22:32:56.697808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-14T22:32:56.697966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-14T22:32:56.698076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-14T22:32:56.698177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-14T22:32:56.698266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-14T22:32:56.698357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-14T22:32:56.698450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-14T22:32:56.698534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-14T22:32:56.698625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-14T22:32:56.698761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-14T22:32:56.698884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-14T22:32:56.699004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-14T22:32:56.699100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-14T22:32:56.699193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-14T22:32:56.699287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-14T22:32:56.699377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-14T22:32:56.699489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-14T22:32:56.699600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-14T22:32:56.699724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-14T22:32:56.699840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-14T22:32:56.699930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-14T22:32:56.700019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-14T22:32:56.700105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-14T22:32:56.700199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-14T22:32:56.700290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-14T22:32:56.700382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-14T22:32:56.700475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-14T22:32:56.700575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-14T22:32:56.700796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-14T22:32:56.700920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-14T22:32:56.701034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-14T22:32:56.701177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-14T22:32:56.701296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-14T22:32:56.701391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-14T22:32:56.701483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-14T22:32:56.701677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-14T22:32:56.701828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-14T22:32:56.701974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-14T22:32:56.702094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-14T22:32:56.702190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-14T22:32:56.702286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-14T22:32:56.702376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-14T22:32:56.702465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-14T22:32:56.702554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-14T22:32:56.702689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-14T22:32:56.702808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-14T22:32:56.702905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-14T22:32:56.702997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-14T22:32:56.703091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-14T22:32:56.703185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-14T22:32:56.703281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-14T22:32:56.703374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-14T22:32:56.703469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-14T22:32:56.703561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-14T22:32:56.703690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-14T22:32:56.703976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-14T22:32:56.704093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-14T22:32:56.704189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-14T22:32:56.704280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-14T22:32:56.704372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-14T22:32:56.704461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-14T22:32:56.704554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-14T22:32:56.704799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-14T22:32:56.704922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-14T22:32:56.705018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-14T22:32:56.705118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-14T22:32:56.705215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-14T22:32:56.705308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-14T22:32:56.705413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-14T22:32:56.705530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-14T22:32:56.705626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-14T22:32:56.705864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-14T22:32:56.705980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-14T22:32:56.706093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-14T22:32:56.706209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-14T22:32:56.706307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-14T22:32:56.706398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-14T22:32:56.706491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-14T22:32:56.706581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-14T22:32:56.706701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-14T22:32:56.706834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-14T22:32:56.706949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-14T22:32:56.707046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-14T22:32:56.707137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-14T22:32:56.707226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-14T22:32:56.707316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-14T22:32:56.707406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-14T22:32:56.707499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-14T22:32:56.707601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-14T22:32:56.707747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-14T22:32:56.707872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-14T22:32:56.707997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-14T22:32:56.708283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-14T22:32:56.708377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-14T22:32:56.708474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-14T22:32:56.708564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-14T22:32:56.708692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-14T22:32:56.708814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-14T22:32:56.708906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-14T22:32:56.709001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-14T22:32:56.709093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-14T22:32:56.709180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-14T22:32:56.709272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-14T22:32:56.709361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-14T22:32:56.709486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-14T22:32:56.709591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-14T22:32:56.709786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-14T22:32:56.709938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-14T22:32:56.710070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-14T22:32:56.710190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-14T22:32:56.710284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-14T22:32:56.710381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-14T22:32:56.710477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-14T22:32:56.710574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-14T22:32:56.710700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-14T22:32:56.710824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-14T22:32:56.710922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-14T22:32:56.711019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-14T22:32:56.711115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-14T22:32:56.711206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-14T22:32:56.711298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-14T22:32:56.711392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-14T22:32:56.711487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-14T22:32:56.711617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-14T22:32:56.711767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-14T22:32:56.711872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-14T22:32:56.711965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-14T22:32:56.712058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-14T22:32:56.712151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-14T22:32:56.712244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-14T22:32:56.712336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-14T22:32:56.712429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-14T22:32:56.712521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-14T22:32:56.712609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-14T22:32:56.712745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-14T22:32:56.712857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-14T22:32:56.712955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-14T22:32:56.713046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-14T22:32:56.713140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-14T22:32:56.713232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-14T22:32:56.713324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-14T22:32:56.713418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-14T22:32:56.713516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-14T22:32:56.713609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-14T22:32:56.713932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-14T22:32:56.714044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-14T22:32:56.714137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-14T22:32:56.714250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-14T22:32:56.714369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-14T22:32:56.714463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-14T22:32:56.714556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-14T22:32:56.714662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-14T22:32:56.714788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-14T22:32:56.714904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-14T22:32:56.715024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-14T22:32:56.715118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-14T22:32:56.715209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-14T22:32:56.715298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-14T22:32:56.715391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-14T22:32:56.715482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-14T22:32:56.715574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-14T22:32:56.715697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-14T22:32:56.715853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-14T22:32:56.715973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-14T22:32:56.716069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-14T22:32:56.716161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-14T22:32:56.716252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-14T22:32:56.716345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-14T22:32:56.716436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-14T22:32:56.716526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-14T22:32:56.716845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-14T22:32:56.716969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-14T22:32:56.717062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-14T22:32:56.717154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-14T22:32:56.717246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-14T22:32:56.717339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-14T22:32:56.717433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-14T22:32:56.717611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-14T22:32:56.717789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-14T22:32:56.717954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-14T22:32:56.718100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-14T22:32:56.718210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-14T22:32:56.718306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-14T22:32:56.718401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-14T22:32:56.718493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-14T22:32:56.718603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-14T22:32:56.718748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-14T22:32:56.718882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-14T22:32:56.718999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-14T22:32:56.719108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-14T22:32:56.719226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-14T22:32:56.719340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-14T22:32:56.719458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-14T22:32:56.719549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-14T22:32:56.719662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-14T22:32:56.719785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-14T22:32:56.719900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-14T22:32:56.720019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-14T22:32:56.720115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-14T22:32:56.720208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-14T22:32:56.720299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-14T22:32:56.720389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-14T22:32:56.720480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-14T22:32:56.720571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-14T22:32:56.720696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-14T22:32:56.720811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-14T22:32:56.720904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-14T22:32:56.720996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-14T22:32:56.721083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-14T22:32:56.721174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-14T22:32:56.721266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-14T22:32:56.721359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-14T22:32:56.721453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-14T22:32:56.721548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-14T22:32:56.721749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-14T22:32:56.721879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-14T22:32:56.721977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-14T22:32:56.722088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-14T22:32:56.722216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-14T22:32:56.722311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-14T22:32:56.722405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-14T22:32:56.722500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-14T22:32:56.722596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-14T22:32:56.722718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-14T22:32:56.722835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-14T22:32:56.723049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-14T22:32:56.723164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-14T22:32:56.723284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-14T22:32:56.723378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-14T22:32:56.723470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-14T22:32:56.723561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-14T22:32:56.723683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-14T22:32:56.723804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-14T22:32:56.723900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-14T22:32:56.723993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-14T22:32:56.724085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-14T22:32:56.724178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-14T22:32:56.724270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-14T22:32:56.724361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-14T22:32:56.724453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-14T22:32:56.724543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-14T22:32:56.724635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-14T22:32:56.724789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-14T22:32:56.724890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-14T22:32:56.724984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-14T22:32:56.725077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-14T22:32:56.725168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-14T22:32:56.725261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-14T22:32:56.725442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-14T22:32:56.725584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-14T22:32:56.725735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-14T22:32:56.725863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-14T22:32:56.725991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-14T22:32:56.726110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-14T22:32:56.726204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-14T22:32:56.726293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-14T22:32:56.726460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-14T22:32:56.726555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-14T22:32:56.726671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-14T22:32:56.726795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-14T22:32:56.726892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-14T22:32:56.726988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-14T22:32:56.727075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-14T22:32:56.727166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-14T22:32:56.727259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-14T22:32:56.727350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-14T22:32:56.727445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-14T22:32:56.727536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-14T22:32:56.727631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-14T22:32:56.727777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-14T22:32:56.727938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-14T22:32:56.728058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-14T22:32:56.728152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-14T22:32:56.728243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-14T22:32:56.728478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-14T22:32:56.728570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-14T22:32:56.728695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-14T22:32:56.728818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-14T22:32:56.728918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-14T22:32:56.729012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-14T22:32:56.729104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-14T22:32:56.729198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-14T22:32:56.729289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-14T22:32:56.729378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-14T22:32:56.729468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-14T22:32:56.729574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-14T22:32:56.729813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-14T22:32:56.729934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-14T22:32:56.730029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-14T22:32:56.730115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-14T22:32:56.730205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-14T22:32:56.730295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-14T22:32:56.730386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-14T22:32:56.730477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-14T22:32:56.730570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-14T22:32:56.730715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-14T22:32:56.730846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-14T22:32:56.730963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-14T22:32:56.731056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-14T22:32:56.731149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-14T22:32:56.731241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-14T22:32:56.731333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-14T22:32:56.731426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-14T22:32:56.731517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-14T22:32:56.731605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-14T22:32:56.731726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-14T22:32:56.731842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-14T22:32:56.731911] [INFO ] [LOCAL ] Deleted 1716 derivative data files. [2025-10-14T22:32:56.731943] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-14T22:32:56.733768] [INFO ] [LOCAL ] Found 1812 symbols with primary data. [2025-10-14T22:32:56.733984] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1812 symbols [2025-10-14T22:32:56.734382] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:56.735161] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:56.734796] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:56.806627] [DEBUG] [LOCAL ] AAP: Loaded 51878 existing records from primary storage. [2025-10-14T22:32:56.807346] [INFO ] [MAIN ] AAP: Loaded 51878 primary data records. [2025-10-14T22:32:56.858676] [DEBUG] [LOCAL ] AA: Loaded 53621 existing records from primary storage. [2025-10-14T22:32:56.903590] [INFO ] [MAIN ] AA: Loaded 53621 primary data records. [2025-10-14T22:32:56.939050] [DEBUG] [LOCAL ] A: Loaded 50803 existing records from primary storage. [2025-10-14T22:32:56.965571] [INFO ] [MAIN ] A: Loaded 50803 primary data records. [2025-10-14T22:32:57.787688] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:57.789292] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51878 primary records. [2025-10-14T22:32:57.789389] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-14T22:32:57.818874] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:57.820303] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53621 primary records. [2025-10-14T22:32:57.820856] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-14T22:32:57.822408] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-14T22:32:57.824847] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-14T22:32:57.826629] [INFO ] [MAIN ] Derivative Progress: 1/1812 symbols completed. AAP took 1.1s. Estimated remaining: 32m 59s. Rate: 54.9 symbols/min [2025-10-14T22:32:57.837525] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:57.853402] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:57.854573] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50803 primary records. [2025-10-14T22:32:57.855556] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-14T22:32:57.856346] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-14T22:32:57.856931] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-14T22:32:57.859006] [INFO ] [MAIN ] Derivative Progress: 2/1812 symbols completed. AA took 1.1s. Estimated remaining: 16m 58s. Rate: 106.7 symbols/min [2025-10-14T22:32:57.859173] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:57.882490] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-14T22:32:57.882618] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-14T22:32:57.892397] [INFO ] [MAIN ] Derivative Progress: 3/1812 symbols completed. A took 1.2s. Estimated remaining: 11m 39s. Rate: 155.4 symbols/min [2025-10-14T22:32:57.893600] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:57.894199] [DEBUG] [LOCAL ] AB: Loaded 25669 existing records from primary storage. [2025-10-14T22:32:57.894593] [INFO ] [MAIN ] AB: Loaded 25669 primary data records. [2025-10-14T22:32:58.072047] [DEBUG] [LOCAL ] ABCB: Loaded 30529 existing records from primary storage. [2025-10-14T22:32:58.205840] [INFO ] [MAIN ] ABCB: Loaded 30529 primary data records. [2025-10-14T22:32:58.347046] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-14T22:32:58.363554] [INFO ] [MAIN ] ABEV: Loaded 53279 primary data records. [2025-10-14T22:32:58.901912] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:58.903278] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 25669 primary records. [2025-10-14T22:32:58.903689] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-14T22:32:58.923883] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-14T22:32:58.925437] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-14T22:32:58.927481] [INFO ] [MAIN ] Derivative Progress: 4/1812 symbols completed. AB took 1.1s. Estimated remaining: 16m 32s. Rate: 109.4 symbols/min [2025-10-14T22:32:58.927954] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:58.942781] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:58.943546] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30529 primary records. [2025-10-14T22:32:58.943859] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-14T22:32:58.962897] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-14T22:32:58.963167] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-14T22:32:58.965000] [INFO ] [MAIN ] Derivative Progress: 5/1812 symbols completed. ABCB took 1.1s. Estimated remaining: 13m 26s. Rate: 134.5 symbols/min [2025-10-14T22:32:58.965342] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:58.980341] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:58.981436] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53279 primary records. [2025-10-14T22:32:58.981706] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-14T22:32:59.015786] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-14T22:32:59.016483] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-14T22:32:59.016334] [DEBUG] [LOCAL ] ABM: Loaded 32100 existing records from primary storage. [2025-10-14T22:32:59.016699] [INFO ] [MAIN ] ABM: Loaded 32100 primary data records. [2025-10-14T22:32:59.019303] [INFO ] [MAIN ] Derivative Progress: 6/1812 symbols completed. ABEV took 1.1s. Estimated remaining: 11m 28s. Rate: 157.5 symbols/min [2025-10-14T22:32:59.040876] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:32:59.351286] [DEBUG] [LOCAL ] ABR: Loaded 51964 existing records from primary storage. [2025-10-14T22:32:59.362120] [INFO ] [MAIN ] ABR: Loaded 51964 primary data records. [2025-10-14T22:32:59.362569] [DEBUG] [LOCAL ] ACA: Loaded 22976 existing records from primary storage. [2025-10-14T22:32:59.374109] [INFO ] [MAIN ] ACA: Loaded 22976 primary data records. [2025-10-14T22:32:59.997198] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:32:59.998058] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32100 primary records. [2025-10-14T22:32:59.998175] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-14T22:33:00.017446] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-10-14T22:33:00.018059] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-14T22:33:00.019994] [INFO ] [MAIN ] Derivative Progress: 7/1812 symbols completed. ABM took 1.1s. Estimated remaining: 14m 7s. Rate: 127.8 symbols/min [2025-10-14T22:33:00.020231] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:00.038299] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:00.039128] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51964 primary records. [2025-10-14T22:33:00.051062] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-14T22:33:00.052043] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:00.052896] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 22976 primary records. [2025-10-14T22:33:00.064326] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-14T22:33:00.069450] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-14T22:33:00.070086] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-14T22:33:00.078809] [INFO ] [MAIN ] Derivative Progress: 8/1812 symbols completed. ABR took 1.1s. Estimated remaining: 12m 34s. Rate: 143.5 symbols/min [2025-10-14T22:33:00.082900] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:00.088580] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-10-14T22:33:00.088688] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-14T22:33:00.090616] [INFO ] [MAIN ] Derivative Progress: 9/1812 symbols completed. ACA took 1.0s. Estimated remaining: 11m 12s. Rate: 160.9 symbols/min [2025-10-14T22:33:00.104889] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:00.129177] [DEBUG] [LOCAL ] ACI: Loaded 53280 existing records from primary storage. [2025-10-14T22:33:00.129507] [INFO ] [MAIN ] ACI: Loaded 53280 primary data records. [2025-10-14T22:33:00.273195] [DEBUG] [LOCAL ] ACP: Loaded 30979 existing records from primary storage. [2025-10-14T22:33:00.279026] [INFO ] [MAIN ] ACP: Loaded 30979 primary data records. [2025-10-14T22:33:00.279872] [DEBUG] [LOCAL ] ACM: Loaded 43037 existing records from primary storage. [2025-10-14T22:33:00.312081] [INFO ] [MAIN ] ACM: Loaded 43037 primary data records. [2025-10-14T22:33:01.170368] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:01.170815] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:01.172088] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53280 primary records. [2025-10-14T22:33:01.173040] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-14T22:33:01.172899] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 30979 primary records. [2025-10-14T22:33:01.174118] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-14T22:33:01.191685] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-14T22:33:01.192796] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-14T22:33:01.202869] [INFO ] [MAIN ] Derivative Progress: 10/1812 symbols completed. ACI took 1.2s. Estimated remaining: 13m 25s. Rate: 134.3 symbols/min [2025-10-14T22:33:01.203157] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:01.220898] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:01.221822] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43037 primary records. [2025-10-14T22:33:01.222313] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-14T22:33:01.239705] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-14T22:33:01.242098] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-14T22:33:01.242236] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-14T22:33:01.244320] [INFO ] [MAIN ] Derivative Progress: 11/1812 symbols completed. ACP took 1.1s. Estimated remaining: 12m 18s. Rate: 146.3 symbols/min [2025-10-14T22:33:01.244415] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-14T22:33:01.249954] [INFO ] [MAIN ] Derivative Progress: 12/1812 symbols completed. ACM took 1.2s. Estimated remaining: 11m 17s. Rate: 159.4 symbols/min [2025-10-14T22:33:01.250245] [DEBUG] [LOCAL ] ACR: Loaded 5471 existing records from primary storage. [2025-10-14T22:33:01.250442] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:01.250353] [INFO ] [MAIN ] ACR: Loaded 5471 primary data records. [2025-10-14T22:33:01.247542] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:01.367559] [DEBUG] [LOCAL ] ACV: Loaded 7641 existing records from primary storage. [2025-10-14T22:33:01.383302] [INFO ] [MAIN ] ACV: Loaded 7641 primary data records. [2025-10-14T22:33:01.736818] [DEBUG] [LOCAL ] ACVA: Loaded 49301 existing records from primary storage. [2025-10-14T22:33:01.747918] [INFO ] [MAIN ] ACVA: Loaded 49301 primary data records. [2025-10-14T22:33:02.247458] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:02.249420] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5471 primary records. [2025-10-14T22:33:02.249893] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-14T22:33:02.267950] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-14T22:33:02.268349] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-14T22:33:02.272277] [INFO ] [MAIN ] Derivative Progress: 13/1812 symbols completed. ACR took 1.1s. Estimated remaining: 12m 46s. Rate: 140.8 symbols/min [2025-10-14T22:33:02.287003] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:02.287887] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7641 primary records. [2025-10-14T22:33:02.287989] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-14T22:33:02.306352] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-10-14T22:33:02.318600] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-14T22:33:02.321105] [INFO ] [MAIN ] Derivative Progress: 14/1812 symbols completed. ACV took 1.1s. Estimated remaining: 11m 58s. Rate: 150.3 symbols/min [2025-10-14T22:33:02.319044] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:02.322065] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49301 primary records. [2025-10-14T22:33:02.322164] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-14T22:33:02.337824] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-10-14T22:33:02.337916] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-14T22:33:02.340687] [INFO ] [MAIN ] Derivative Progress: 15/1812 symbols completed. ACVA took 1.1s. Estimated remaining: 11m 12s. Rate: 160.5 symbols/min [2025-10-14T22:33:02.341143] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:02.341082] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:02.341036] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:02.394023] [DEBUG] [LOCAL ] ADC: Loaded 46340 existing records from primary storage. [2025-10-14T22:33:02.394311] [INFO ] [MAIN ] ADC: Loaded 46340 primary data records. [2025-10-14T22:33:02.455670] [DEBUG] [LOCAL ] ADCT: Loaded 35199 existing records from primary storage. [2025-10-14T22:33:02.483430] [INFO ] [MAIN ] ADCT: Loaded 35199 primary data records. [2025-10-14T22:33:02.721884] [DEBUG] [LOCAL ] ADM: Loaded 53395 existing records from primary storage. [2025-10-14T22:33:02.825371] [INFO ] [MAIN ] ADM: Loaded 53395 primary data records. [2025-10-14T22:33:03.402561] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:03.403563] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46340 primary records. [2025-10-14T22:33:03.403776] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-14T22:33:03.438145] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-10-14T22:33:03.438330] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-14T22:33:03.441417] [INFO ] [MAIN ] Derivative Progress: 16/1812 symbols completed. ADC took 1.1s. Estimated remaining: 12m 33s. Rate: 143.1 symbols/min [2025-10-14T22:33:03.442377] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:03.437198] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:03.443795] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 35199 primary records. [2025-10-14T22:33:03.443966] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-14T22:33:03.465347] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:03.472929] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53395 primary records. [2025-10-14T22:33:03.473033] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-14T22:33:03.474066] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-14T22:33:03.474241] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-14T22:33:03.476982] [INFO ] [MAIN ] Derivative Progress: 17/1812 symbols completed. ADCT took 1.1s. Estimated remaining: 11m 52s. Rate: 151.3 symbols/min [2025-10-14T22:33:03.477590] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:03.498671] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-14T22:33:03.498898] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-14T22:33:03.501961] [INFO ] [MAIN ] Derivative Progress: 18/1812 symbols completed. ADM took 1.2s. Estimated remaining: 11m 15s. Rate: 159.6 symbols/min [2025-10-14T22:33:03.502300] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:03.545561] [DEBUG] [LOCAL ] ADNT: Loaded 46912 existing records from primary storage. [2025-10-14T22:33:03.545882] [INFO ] [MAIN ] ADNT: Loaded 46912 primary data records. [2025-10-14T22:33:03.680608] [DEBUG] [LOCAL ] ADX: Loaded 27690 existing records from primary storage. [2025-10-14T22:33:03.681299] [DEBUG] [LOCAL ] ADT: Loaded 53444 existing records from primary storage. [2025-10-14T22:33:03.684625] [INFO ] [MAIN ] ADX: Loaded 27690 primary data records. [2025-10-14T22:33:03.684741] [INFO ] [MAIN ] ADT: Loaded 53444 primary data records. [2025-10-14T22:33:04.518962] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:04.520264] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 46912 primary records. [2025-10-14T22:33:04.520758] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-14T22:33:04.559257] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:04.578584] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27690 primary records. [2025-10-14T22:33:04.579512] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-10-14T22:33:04.579837] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-14T22:33:04.580237] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:04.581858] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53444 primary records. [2025-10-14T22:33:04.580461] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-14T22:33:04.582191] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-14T22:33:04.584307] [INFO ] [MAIN ] Derivative Progress: 19/1812 symbols completed. ADNT took 1.1s. Estimated remaining: 12m 21s. Rate: 145.2 symbols/min [2025-10-14T22:33:04.593105] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:04.610824] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-14T22:33:04.611059] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-14T22:33:04.616185] [INFO ] [MAIN ] Derivative Progress: 20/1812 symbols completed. ADX took 1.1s. Estimated remaining: 11m 46s. Rate: 152.2 symbols/min [2025-10-14T22:33:04.620682] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-14T22:33:04.620942] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:04.621538] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-14T22:33:04.623715] [INFO ] [MAIN ] Derivative Progress: 21/1812 symbols completed. ADT took 1.1s. Estimated remaining: 11m 13s. Rate: 159.7 symbols/min [2025-10-14T22:33:04.624014] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:04.633793] [DEBUG] [LOCAL ] AEFC: Loaded 8406 existing records from primary storage. [2025-10-14T22:33:04.633898] [INFO ] [MAIN ] AEFC: Loaded 8406 primary data records. [2025-10-14T22:33:05.058562] [DEBUG] [LOCAL ] AEE: Loaded 50168 existing records from primary storage. [2025-10-14T22:33:05.059048] [INFO ] [MAIN ] AEE: Loaded 50168 primary data records. [2025-10-14T22:33:05.166018] [DEBUG] [LOCAL ] AEM: Loaded 53476 existing records from primary storage. [2025-10-14T22:33:05.179415] [INFO ] [MAIN ] AEM: Loaded 53476 primary data records. [2025-10-14T22:33:05.696092] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:05.696821] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8406 primary records. [2025-10-14T22:33:05.696921] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-14T22:33:05.718342] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-14T22:33:05.718611] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-14T22:33:05.720761] [INFO ] [MAIN ] Derivative Progress: 22/1812 symbols completed. AEFC took 1.1s. Estimated remaining: 12m 11s. Rate: 146.9 symbols/min [2025-10-14T22:33:05.721135] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:05.739161] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:05.740166] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50168 primary records. [2025-10-14T22:33:05.740457] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-14T22:33:05.757023] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-14T22:33:05.757397] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-14T22:33:05.759422] [INFO ] [MAIN ] Derivative Progress: 23/1812 symbols completed. AEE took 1.2s. Estimated remaining: 11m 42s. Rate: 152.9 symbols/min [2025-10-14T22:33:05.759776] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:05.777198] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:05.778068] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53476 primary records. [2025-10-14T22:33:05.778311] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-14T22:33:05.810559] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-14T22:33:05.812206] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-14T22:33:05.814905] [INFO ] [MAIN ] Derivative Progress: 24/1812 symbols completed. AEM took 1.2s. Estimated remaining: 11m 17s. Rate: 158.6 symbols/min [2025-10-14T22:33:05.815933] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:05.844618] [DEBUG] [LOCAL ] AEO: Loaded 53566 existing records from primary storage. [2025-10-14T22:33:05.844945] [INFO ] [MAIN ] AEO: Loaded 53566 primary data records. [2025-10-14T22:33:05.970983] [DEBUG] [LOCAL ] AER: Loaded 48175 existing records from primary storage. [2025-10-14T22:33:05.971249] [INFO ] [MAIN ] AER: Loaded 48175 primary data records. [2025-10-14T22:33:06.332534] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-14T22:33:06.383914] [INFO ] [MAIN ] AES: Loaded 53669 primary data records. [2025-10-14T22:33:06.853072] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:06.854702] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53566 primary records. [2025-10-14T22:33:06.855184] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-14T22:33:06.873289] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-14T22:33:06.876004] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-14T22:33:06.878267] [INFO ] [MAIN ] Derivative Progress: 25/1812 symbols completed. AEO took 1.2s. Estimated remaining: 12m 5s. Rate: 147.9 symbols/min [2025-10-14T22:33:06.878492] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:06.893402] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:06.894208] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48175 primary records. [2025-10-14T22:33:06.894552] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-14T22:33:06.913215] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-14T22:33:06.913499] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-14T22:33:06.915923] [INFO ] [MAIN ] Derivative Progress: 26/1812 symbols completed. AER took 1.2s. Estimated remaining: 11m 39s. Rate: 153.2 symbols/min [2025-10-14T22:33:06.916237] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:06.934124] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:06.934817] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53669 primary records. [2025-10-14T22:33:06.934889] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-14T22:33:06.968996] [DEBUG] [LOCAL ] AFB: Loaded 11214 existing records from primary storage. [2025-10-14T22:33:06.969638] [INFO ] [MAIN ] AFB: Loaded 11214 primary data records. [2025-10-14T22:33:07.016818] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-14T22:33:07.029721] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-14T22:33:07.040795] [INFO ] [MAIN ] Derivative Progress: 27/1812 symbols completed. AES took 1.2s. Estimated remaining: 11m 21s. Rate: 157.2 symbols/min [2025-10-14T22:33:07.046190] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:07.092354] [DEBUG] [LOCAL ] AESI: Loaded 49736 existing records from primary storage. [2025-10-14T22:33:07.096108] [INFO ] [MAIN ] AESI: Loaded 49736 primary data records. [2025-10-14T22:33:07.517731] [DEBUG] [LOCAL ] AFG: Loaded 32274 existing records from primary storage. [2025-10-14T22:33:07.625889] [INFO ] [MAIN ] AFG: Loaded 32274 primary data records. [2025-10-14T22:33:07.965466] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:07.966824] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11214 primary records. [2025-10-14T22:33:07.966942] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-14T22:33:07.998754] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:08.000194] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49736 primary records. [2025-10-14T22:33:08.000847] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-14T22:33:08.022370] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-14T22:33:08.022536] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-14T22:33:08.025067] [INFO ] [MAIN ] Derivative Progress: 28/1812 symbols completed. AESI took 1.1s. Estimated remaining: 11m 59s. Rate: 148.8 symbols/min [2025-10-14T22:33:08.022691] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-14T22:33:08.026476] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-14T22:33:08.029210] [INFO ] [MAIN ] Derivative Progress: 29/1812 symbols completed. AFB took 1.1s. Estimated remaining: 11m 34s. Rate: 154.0 symbols/min [2025-10-14T22:33:08.043384] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:08.044069] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32274 primary records. [2025-10-14T22:33:08.044137] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-14T22:33:08.059192] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-14T22:33:08.059251] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-14T22:33:08.061457] [INFO ] [MAIN ] Derivative Progress: 30/1812 symbols completed. AFG took 1.0s. Estimated remaining: 11m 13s. Rate: 158.9 symbols/min [2025-10-14T22:33:08.062063] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:08.061984] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:08.061884] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:08.072809] [DEBUG] [LOCAL ] AFGD: Loaded 1770 existing records from primary storage. [2025-10-14T22:33:08.073080] [DEBUG] [LOCAL ] AFGB: Loaded 2269 existing records from primary storage. [2025-10-14T22:33:08.075530] [DEBUG] [LOCAL ] AFGC: Loaded 2554 existing records from primary storage. [2025-10-14T22:33:08.075680] [INFO ] [MAIN ] AFGB: Loaded 2269 primary data records. [2025-10-14T22:33:08.073234] [INFO ] [MAIN ] AFGD: Loaded 1770 primary data records. [2025-10-14T22:33:08.087071] [INFO ] [MAIN ] AFGC: Loaded 2554 primary data records. [2025-10-14T22:33:09.099586] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:33:09.099263] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-14T22:33:09.100531] [INFO ] [MAIN ] AFGC: Generated 1790 derivative records from 2554 primary records. [2025-10-14T22:33:09.100671] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-14T22:33:09.102111] [INFO ] [MAIN ] AFGB: Generated 1793 derivative records from 2269 primary records. [2025-10-14T22:33:09.102784] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-14T22:33:09.143773] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:09.143192] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1793 records). [2025-10-14T22:33:09.145543] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1770 primary records. [2025-10-14T22:33:09.145723] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-14T22:33:09.144555] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-14T22:33:09.152274] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1790 records). [2025-10-14T22:33:09.152748] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-14T22:33:09.151274] [INFO ] [MAIN ] Derivative Progress: 31/1812 symbols completed. AFGB took 1.1s. Estimated remaining: 11m 53s. Rate: 149.8 symbols/min [2025-10-14T22:33:09.162125] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:09.162267] [INFO ] [MAIN ] Derivative Progress: 32/1812 symbols completed. AFGC took 1.1s. Estimated remaining: 11m 31s. Rate: 154.5 symbols/min [2025-10-14T22:33:09.166713] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:09.170241] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-10-14T22:33:09.170592] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-14T22:33:09.173183] [INFO ] [MAIN ] Derivative Progress: 33/1812 symbols completed. AFGD took 1.1s. Estimated remaining: 11m 11s. Rate: 159.2 symbols/min [2025-10-14T22:33:09.173396] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:09.178003] [DEBUG] [LOCAL ] AFGE: Loaded 2396 existing records from primary storage. [2025-10-14T22:33:09.178230] [INFO ] [MAIN ] AFGE: Loaded 2396 primary data records. [2025-10-14T22:33:09.517760] [DEBUG] [LOCAL ] AFL: Loaded 53189 existing records from primary storage. [2025-10-14T22:33:09.531804] [INFO ] [MAIN ] AFL: Loaded 53189 primary data records. [2025-10-14T22:33:09.546921] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-14T22:33:09.580599] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-10-14T22:33:10.007762] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:10.036307] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2396 primary records. [2025-10-14T22:33:10.151853] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-14T22:33:10.174232] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-10-14T22:33:10.175249] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-14T22:33:10.177470] [INFO ] [MAIN ] Derivative Progress: 34/1812 symbols completed. AFGE took 1.0s. Estimated remaining: 11m 43s. Rate: 151.7 symbols/min [2025-10-14T22:33:10.178003] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:10.213670] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:10.213423] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:10.214510] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53189 primary records. [2025-10-14T22:33:10.214628] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-14T22:33:10.215271] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53643 primary records. [2025-10-14T22:33:10.216091] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-14T22:33:10.245919] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-14T22:33:10.246433] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-14T22:33:10.249138] [INFO ] [MAIN ] Derivative Progress: 35/1812 symbols completed. AFL took 1.1s. Estimated remaining: 11m 26s. Rate: 155.4 symbols/min [2025-10-14T22:33:10.249605] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:10.262597] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-14T22:33:10.262766] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-14T22:33:10.264818] [INFO ] [MAIN ] Derivative Progress: 36/1812 symbols completed. AG took 1.1s. Estimated remaining: 11m 8s. Rate: 159.6 symbols/min [2025-10-14T22:33:10.265113] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:10.296308] [DEBUG] [LOCAL ] AGD: Loaded 19218 existing records from primary storage. [2025-10-14T22:33:10.297451] [DEBUG] [LOCAL ] AGCO: Loaded 42456 existing records from primary storage. [2025-10-14T22:33:10.297611] [INFO ] [MAIN ] AGD: Loaded 19218 primary data records. [2025-10-14T22:33:10.297916] [INFO ] [MAIN ] AGCO: Loaded 42456 primary data records. [2025-10-14T22:33:10.571337] [DEBUG] [LOCAL ] AGI: Loaded 53424 existing records from primary storage. [2025-10-14T22:33:10.640249] [INFO ] [MAIN ] AGI: Loaded 53424 primary data records. [2025-10-14T22:33:11.311135] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:11.312804] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 19218 primary records. [2025-10-14T22:33:11.313698] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-14T22:33:11.330294] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-14T22:33:11.330526] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-14T22:33:11.339912] [INFO ] [MAIN ] Derivative Progress: 37/1812 symbols completed. AGD took 1.1s. Estimated remaining: 11m 41s. Rate: 152.0 symbols/min [2025-10-14T22:33:11.345095] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:11.345988] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:11.346944] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42456 primary records. [2025-10-14T22:33:11.347079] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-14T22:33:11.379186] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-14T22:33:11.378852] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:11.379353] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-14T22:33:11.380082] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53424 primary records. [2025-10-14T22:33:11.380258] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-14T22:33:11.382894] [INFO ] [MAIN ] Derivative Progress: 38/1812 symbols completed. AGCO took 1.2s. Estimated remaining: 11m 24s. Rate: 155.6 symbols/min [2025-10-14T22:33:11.383311] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:11.400132] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-14T22:33:11.400294] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-14T22:33:11.402518] [INFO ] [MAIN ] Derivative Progress: 39/1812 symbols completed. AGI took 1.1s. Estimated remaining: 11m 7s. Rate: 159.5 symbols/min [2025-10-14T22:33:11.402729] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:11.425297] [DEBUG] [LOCAL ] AGM: Loaded 10669 existing records from primary storage. [2025-10-14T22:33:11.425504] [INFO ] [MAIN ] AGM: Loaded 10669 primary data records. [2025-10-14T22:33:11.555023] [DEBUG] [LOCAL ] AGL: Loaded 52562 existing records from primary storage. [2025-10-14T22:33:11.573996] [INFO ] [MAIN ] AGL: Loaded 52562 primary data records. [2025-10-14T22:33:11.655174] [DEBUG] [LOCAL ] AGO: Loaded 27878 existing records from primary storage. [2025-10-14T22:33:11.822058] [INFO ] [MAIN ] AGO: Loaded 27878 primary data records. [2025-10-14T22:33:12.357707] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:12.359212] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10669 primary records. [2025-10-14T22:33:12.359466] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-14T22:33:12.392113] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-14T22:33:12.393014] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-14T22:33:12.392774] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:12.395124] [INFO ] [MAIN ] Derivative Progress: 40/1812 symbols completed. AGM took 1.0s. Estimated remaining: 11m 34s. Rate: 153.2 symbols/min [2025-10-14T22:33:12.396512] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:12.396202] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52562 primary records. [2025-10-14T22:33:12.397014] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-14T22:33:12.427521] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:12.429101] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27878 primary records. [2025-10-14T22:33:12.429490] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-14T22:33:12.438571] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-14T22:33:12.438948] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-14T22:33:12.441278] [INFO ] [MAIN ] Derivative Progress: 41/1812 symbols completed. AGL took 1.1s. Estimated remaining: 11m 18s. Rate: 156.6 symbols/min [2025-10-14T22:33:12.441466] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:12.457301] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-10-14T22:33:12.457396] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-14T22:33:12.459766] [INFO ] [MAIN ] Derivative Progress: 42/1812 symbols completed. AGO took 1.1s. Estimated remaining: 11m 3s. Rate: 160.2 symbols/min [2025-10-14T22:33:12.460376] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:12.471200] [DEBUG] [LOCAL ] AGRO: Loaded 33181 existing records from primary storage. [2025-10-14T22:33:12.471506] [INFO ] [MAIN ] AGRO: Loaded 33181 primary data records. [2025-10-14T22:33:12.794955] [DEBUG] [LOCAL ] AGX: Loaded 33019 existing records from primary storage. [2025-10-14T22:33:12.795235] [INFO ] [MAIN ] AGX: Loaded 33019 primary data records. [2025-10-14T22:33:12.914899] [DEBUG] [LOCAL ] AHH: Loaded 40550 existing records from primary storage. [2025-10-14T22:33:12.918957] [INFO ] [MAIN ] AHH: Loaded 40550 primary data records. [2025-10-14T22:33:13.479617] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:13.481271] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33181 primary records. [2025-10-14T22:33:13.481788] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-14T22:33:13.500192] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-14T22:33:13.500428] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-14T22:33:13.503074] [INFO ] [MAIN ] Derivative Progress: 43/1812 symbols completed. AGRO took 1.1s. Estimated remaining: 11m 30s. Rate: 153.9 symbols/min [2025-10-14T22:33:13.525815] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:13.539371] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33019 primary records. [2025-10-14T22:33:13.539717] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:13.540823] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40550 primary records. [2025-10-14T22:33:13.539954] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-14T22:33:13.541026] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-14T22:33:13.576292] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-14T22:33:13.576380] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-14T22:33:13.579976] [INFO ] [MAIN ] Derivative Progress: 44/1812 symbols completed. AHH took 1.1s. Estimated remaining: 11m 17s. Rate: 156.7 symbols/min [2025-10-14T22:33:13.577664] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-14T22:33:13.580145] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-14T22:33:13.582808] [INFO ] [MAIN ] Derivative Progress: 45/1812 symbols completed. AGX took 1.1s. Estimated remaining: 11m 2s. Rate: 160.2 symbols/min [2025-10-14T22:33:13.583311] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:13.583453] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:13.583592] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:13.593820] [DEBUG] [LOCAL ] AHT: Loaded 6353 existing records from primary storage. [2025-10-14T22:33:13.593911] [INFO ] [MAIN ] AHT: Loaded 6353 primary data records. [2025-10-14T22:33:13.971546] [DEBUG] [LOCAL ] AHR: Loaded 49074 existing records from primary storage. [2025-10-14T22:33:13.971985] [INFO ] [MAIN ] AHR: Loaded 49074 primary data records. [2025-10-14T22:33:13.974700] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-14T22:33:14.008129] [INFO ] [MAIN ] AI: Loaded 53764 primary data records. [2025-10-14T22:33:14.619608] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:14.621677] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6353 primary records. [2025-10-14T22:33:14.622335] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-14T22:33:14.639971] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-14T22:33:14.640814] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-14T22:33:14.644141] [INFO ] [MAIN ] Derivative Progress: 46/1812 symbols completed. AHT took 1.1s. Estimated remaining: 11m 28s. Rate: 154.1 symbols/min [2025-10-14T22:33:14.644605] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:14.665255] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:14.666199] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49074 primary records. [2025-10-14T22:33:14.666381] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-14T22:33:14.687395] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-14T22:33:14.687725] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-14T22:33:14.690291] [INFO ] [MAIN ] Derivative Progress: 47/1812 symbols completed. AHR took 1.1s. Estimated remaining: 11m 14s. Rate: 157.0 symbols/min [2025-10-14T22:33:14.690596] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:14.720937] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:14.721957] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53764 primary records. [2025-10-14T22:33:14.722039] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-14T22:33:14.739823] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-14T22:33:14.740096] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-14T22:33:14.743094] [INFO ] [MAIN ] Derivative Progress: 48/1812 symbols completed. AI took 1.2s. Estimated remaining: 11m 2s. Rate: 159.9 symbols/min [2025-10-14T22:33:14.743638] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:14.760100] [DEBUG] [LOCAL ] AIG: Loaded 53470 existing records from primary storage. [2025-10-14T22:33:14.760461] [INFO ] [MAIN ] AIG: Loaded 53470 primary data records. [2025-10-14T22:33:14.897227] [DEBUG] [LOCAL ] AIO: Loaded 13374 existing records from primary storage. [2025-10-14T22:33:14.908718] [INFO ] [MAIN ] AIO: Loaded 13374 primary data records. [2025-10-14T22:33:14.954819] [DEBUG] [LOCAL ] AIN: Loaded 24467 existing records from primary storage. [2025-10-14T22:33:14.980092] [INFO ] [MAIN ] AIN: Loaded 24467 primary data records. [2025-10-14T22:33:15.783316] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:15.784218] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53470 primary records. [2025-10-14T22:33:15.784519] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-14T22:33:15.813406] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:15.820896] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-14T22:33:15.822270] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13374 primary records. [2025-10-14T22:33:15.822479] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-14T22:33:15.821271] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-14T22:33:15.825220] [INFO ] [MAIN ] Derivative Progress: 49/1812 symbols completed. AIG took 1.2s. Estimated remaining: 11m 27s. Rate: 154.0 symbols/min [2025-10-14T22:33:15.826008] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:15.846668] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-14T22:33:15.846968] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-14T22:33:15.850504] [INFO ] [MAIN ] Derivative Progress: 50/1812 symbols completed. AIO took 1.1s. Estimated remaining: 11m 14s. Rate: 156.9 symbols/min [2025-10-14T22:33:15.850877] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:15.873254] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:15.874284] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24467 primary records. [2025-10-14T22:33:15.874429] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-14T22:33:15.900924] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-14T22:33:15.899863] [DEBUG] [LOCAL ] AIR: Loaded 29018 existing records from primary storage. [2025-10-14T22:33:15.901128] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-14T22:33:15.904397] [INFO ] [MAIN ] Derivative Progress: 51/1812 symbols completed. AIN took 1.2s. Estimated remaining: 11m 2s. Rate: 159.6 symbols/min [2025-10-14T22:33:15.904573] [INFO ] [MAIN ] AIR: Loaded 29018 primary data records. [2025-10-14T22:33:15.904760] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:16.106452] [DEBUG] [LOCAL ] AIT: Loaded 26970 existing records from primary storage. [2025-10-14T22:33:16.242540] [INFO ] [MAIN ] AIT: Loaded 26970 primary data records. [2025-10-14T22:33:16.279242] [DEBUG] [LOCAL ] AIV: Loaded 41269 existing records from primary storage. [2025-10-14T22:33:16.309263] [INFO ] [MAIN ] AIV: Loaded 41269 primary data records. [2025-10-14T22:33:16.987123] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:33:16.988911] [INFO ] [MAIN ] AIR: Generated 1793 derivative records from 29018 primary records. [2025-10-14T22:33:16.990068] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-14T22:33:17.010064] [DEBUG] [LOCAL ] AIR: Derivative data saved (1793 records). [2025-10-14T22:33:17.012882] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-14T22:33:17.016954] [INFO ] [MAIN ] Derivative Progress: 52/1812 symbols completed. AIR took 1.2s. Estimated remaining: 11m 27s. Rate: 153.8 symbols/min [2025-10-14T22:33:17.017391] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:17.033580] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:17.034840] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 26970 primary records. [2025-10-14T22:33:17.035069] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-14T22:33:17.056608] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-14T22:33:17.057050] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-14T22:33:17.060898] [INFO ] [MAIN ] Derivative Progress: 53/1812 symbols completed. AIT took 1.2s. Estimated remaining: 11m 15s. Rate: 156.4 symbols/min [2025-10-14T22:33:17.061261] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:17.076374] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:17.089387] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 41269 primary records. [2025-10-14T22:33:17.089782] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-14T22:33:17.094129] [DEBUG] [LOCAL ] AIZN: Loaded 4043 existing records from primary storage. [2025-10-14T22:33:17.101570] [INFO ] [MAIN ] AIZN: Loaded 4043 primary data records. [2025-10-14T22:33:17.192592] [DEBUG] [LOCAL ] AIZ: Loaded 29563 existing records from primary storage. [2025-10-14T22:33:17.205931] [INFO ] [MAIN ] AIZ: Loaded 29563 primary data records. [2025-10-14T22:33:17.253936] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-14T22:33:17.275618] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-14T22:33:17.347213] [INFO ] [MAIN ] Derivative Progress: 54/1812 symbols completed. AIV took 1.4s. Estimated remaining: 11m 11s. Rate: 157.2 symbols/min [2025-10-14T22:33:17.412511] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:17.773911] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:17.774971] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 4043 primary records. [2025-10-14T22:33:17.775302] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-14T22:33:17.807393] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-14T22:33:17.808570] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-14T22:33:17.810964] [INFO ] [MAIN ] Derivative Progress: 55/1812 symbols completed. AIZN took 0.7s. Estimated remaining: 11m 13s. Rate: 156.6 symbols/min [2025-10-14T22:33:17.811081] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:17.808370] [DEBUG] [LOCAL ] AJG: Loaded 46548 existing records from primary storage. [2025-10-14T22:33:17.819561] [INFO ] [MAIN ] AJG: Loaded 46548 primary data records. [2025-10-14T22:33:17.830937] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:17.845288] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29563 primary records. [2025-10-14T22:33:17.856903] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-14T22:33:18.014509] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-14T22:33:18.075106] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-14T22:33:18.081428] [INFO ] [MAIN ] Derivative Progress: 56/1812 symbols completed. AIZ took 1.1s. Estimated remaining: 11m 9s. Rate: 157.4 symbols/min [2025-10-14T22:33:18.205862] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:18.224426] [DEBUG] [LOCAL ] AKR: Loaded 46079 existing records from primary storage. [2025-10-14T22:33:18.225368] [INFO ] [MAIN ] AKR: Loaded 46079 primary data records. [2025-10-14T22:33:18.598363] [DEBUG] [LOCAL ] AL: Loaded 44659 existing records from primary storage. [2025-10-14T22:33:18.596387] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:18.598873] [INFO ] [MAIN ] AL: Loaded 44659 primary data records. [2025-10-14T22:33:18.600701] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46548 primary records. [2025-10-14T22:33:18.601006] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-14T22:33:18.746940] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-14T22:33:18.752877] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-14T22:33:18.762001] [INFO ] [MAIN ] Derivative Progress: 57/1812 symbols completed. AJG took 1.3s. Estimated remaining: 11m 18s. Rate: 155.3 symbols/min [2025-10-14T22:33:18.762310] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:18.988841] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:18.990815] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 46079 primary records. [2025-10-14T22:33:18.991000] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-14T22:33:19.011550] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-14T22:33:19.012136] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-14T22:33:19.015486] [INFO ] [MAIN ] Derivative Progress: 58/1812 symbols completed. AKR took 1.2s. Estimated remaining: 11m 14s. Rate: 156.2 symbols/min [2025-10-14T22:33:19.051177] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:19.051924] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44659 primary records. [2025-10-14T22:33:19.052055] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-14T22:33:19.082108] [DEBUG] [LOCAL ] ALB: Loaded 53335 existing records from primary storage. [2025-10-14T22:33:19.082928] [INFO ] [MAIN ] ALB: Loaded 53335 primary data records. [2025-10-14T22:33:19.154142] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-14T22:33:19.165120] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-14T22:33:19.179420] [INFO ] [MAIN ] Derivative Progress: 59/1812 symbols completed. AL took 1.0s. Estimated remaining: 11m 7s. Rate: 157.7 symbols/min [2025-10-14T22:33:19.394336] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:19.395015] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53335 primary records. [2025-10-14T22:33:19.395082] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-14T22:33:19.410450] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-14T22:33:19.410522] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-14T22:33:19.412769] [INFO ] [MAIN ] Derivative Progress: 60/1812 symbols completed. ALB took 0.7s. Estimated remaining: 11m 2s. Rate: 158.7 symbols/min [2025-10-14T22:33:19.413430] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:19.413580] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:19.414917] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:19.477705] [DEBUG] [LOCAL ] ALE: Loaded 31799 existing records from primary storage. [2025-10-14T22:33:19.478477] [DEBUG] [LOCAL ] ALEX: Loaded 31123 existing records from primary storage. [2025-10-14T22:33:19.478753] [INFO ] [MAIN ] ALE: Loaded 31799 primary data records. [2025-10-14T22:33:19.478942] [INFO ] [MAIN ] ALEX: Loaded 31123 primary data records. [2025-10-14T22:33:19.705631] [DEBUG] [LOCAL ] ALC: Loaded 51170 existing records from primary storage. [2025-10-14T22:33:19.720517] [INFO ] [MAIN ] ALC: Loaded 51170 primary data records. [2025-10-14T22:33:20.459577] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:20.462242] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 31799 primary records. [2025-10-14T22:33:20.463403] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-14T22:33:20.494396] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-14T22:33:20.491483] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:20.495514] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-14T22:33:20.499127] [INFO ] [MAIN ] Derivative Progress: 61/1812 symbols completed. ALE took 1.1s. Estimated remaining: 11m 22s. Rate: 154.0 symbols/min [2025-10-14T22:33:20.500490] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:20.500314] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31123 primary records. [2025-10-14T22:33:20.501339] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-14T22:33:20.527884] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:20.533526] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 51170 primary records. [2025-10-14T22:33:20.532255] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-14T22:33:20.533904] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-14T22:33:20.537236] [INFO ] [MAIN ] Derivative Progress: 62/1812 symbols completed. ALEX took 1.1s. Estimated remaining: 11m 12s. Rate: 156.3 symbols/min [2025-10-14T22:33:20.533674] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-14T22:33:20.538037] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:20.560539] [DEBUG] [LOCAL ] ALG: Loaded 9741 existing records from primary storage. [2025-10-14T22:33:20.560937] [INFO ] [MAIN ] ALG: Loaded 9741 primary data records. [2025-10-14T22:33:20.651044] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-14T22:33:20.661426] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-14T22:33:20.674841] [INFO ] [MAIN ] Derivative Progress: 63/1812 symbols completed. ALC took 1.3s. Estimated remaining: 11m 5s. Rate: 157.9 symbols/min [2025-10-14T22:33:20.675070] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:20.911208] [DEBUG] [LOCAL ] ALIT: Loaded 52792 existing records from primary storage. [2025-10-14T22:33:20.912265] [INFO ] [MAIN ] ALIT: Loaded 52792 primary data records. [2025-10-14T22:33:21.099388] [DEBUG] [LOCAL ] ALK: Loaded 53079 existing records from primary storage. [2025-10-14T22:33:21.178922] [INFO ] [MAIN ] ALK: Loaded 53079 primary data records. [2025-10-14T22:33:21.482877] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:21.606715] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9741 primary records. [2025-10-14T22:33:21.607107] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-14T22:33:21.627781] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-14T22:33:21.629069] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-14T22:33:21.634051] [INFO ] [MAIN ] Derivative Progress: 64/1812 symbols completed. ALG took 1.1s. Estimated remaining: 11m 20s. Rate: 154.2 symbols/min [2025-10-14T22:33:21.635465] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:21.649364] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:21.651134] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52792 primary records. [2025-10-14T22:33:21.651364] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-14T22:33:21.667787] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-14T22:33:21.668074] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-14T22:33:21.670605] [INFO ] [MAIN ] Derivative Progress: 65/1812 symbols completed. ALIT took 1.1s. Estimated remaining: 11m 10s. Rate: 156.4 symbols/min [2025-10-14T22:33:21.671350] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:21.690191] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:21.690924] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53079 primary records. [2025-10-14T22:33:21.691005] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-14T22:33:21.707456] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-14T22:33:21.707807] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-14T22:33:21.710284] [INFO ] [MAIN ] Derivative Progress: 66/1812 symbols completed. ALK took 1.0s. Estimated remaining: 11m 1s. Rate: 158.5 symbols/min [2025-10-14T22:33:21.724632] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:21.758411] [DEBUG] [LOCAL ] ALL: Loaded 49767 existing records from primary storage. [2025-10-14T22:33:21.758864] [INFO ] [MAIN ] ALL: Loaded 49767 primary data records. [2025-10-14T22:33:21.884075] [DEBUG] [LOCAL ] ALLE: Loaded 44314 existing records from primary storage. [2025-10-14T22:33:21.903928] [INFO ] [MAIN ] ALLE: Loaded 44314 primary data records. [2025-10-14T22:33:22.032122] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-14T22:33:22.077242] [INFO ] [MAIN ] ALLY: Loaded 53223 primary data records. [2025-10-14T22:33:22.751100] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:22.752004] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49767 primary records. [2025-10-14T22:33:22.752434] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-14T22:33:22.770671] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-14T22:33:22.770881] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-14T22:33:22.773075] [INFO ] [MAIN ] Derivative Progress: 67/1812 symbols completed. ALL took 1.1s. Estimated remaining: 11m 18s. Rate: 154.4 symbols/min [2025-10-14T22:33:22.773316] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:22.791956] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:22.794835] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53223 primary records. [2025-10-14T22:33:22.795186] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-14T22:33:22.815558] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:22.823484] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44314 primary records. [2025-10-14T22:33:22.824681] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-14T22:33:22.824748] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-14T22:33:22.824847] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-14T22:33:22.827394] [INFO ] [MAIN ] Derivative Progress: 68/1812 symbols completed. ALLY took 1.1s. Estimated remaining: 11m 9s. Rate: 156.4 symbols/min [2025-10-14T22:33:22.828259] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:22.857885] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-14T22:33:22.858048] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-14T22:33:22.860120] [INFO ] [MAIN ] Derivative Progress: 69/1812 symbols completed. ALLE took 1.2s. Estimated remaining: 10m 60s. Rate: 158.5 symbols/min [2025-10-14T22:33:22.860306] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:22.879462] [DEBUG] [LOCAL ] ALSN: Loaded 43460 existing records from primary storage. [2025-10-14T22:33:22.881605] [INFO ] [MAIN ] ALSN: Loaded 43460 primary data records. [2025-10-14T22:33:22.931085] [DEBUG] [LOCAL ] ALUR: Loaded 9637 existing records from primary storage. [2025-10-14T22:33:22.970928] [INFO ] [MAIN ] ALUR: Loaded 9637 primary data records. [2025-10-14T22:33:22.995881] [DEBUG] [LOCAL ] ALTG: Loaded 23430 existing records from primary storage. [2025-10-14T22:33:23.019898] [INFO ] [MAIN ] ALTG: Loaded 23430 primary data records. [2025-10-14T22:33:23.881330] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:23.896790] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43460 primary records. [2025-10-14T22:33:23.896898] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-14T22:33:23.895884] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:23.898895] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 9637 primary records. [2025-10-14T22:33:23.900225] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-14T22:33:23.934347] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-14T22:33:23.935007] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-14T22:33:23.937409] [INFO ] [MAIN ] Derivative Progress: 70/1812 symbols completed. ALUR took 1.1s. Estimated remaining: 11m 17s. Rate: 154.4 symbols/min [2025-10-14T22:33:23.938057] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:23.949001] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-14T22:33:23.955282] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-14T22:33:23.955180] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:23.956261] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23430 primary records. [2025-10-14T22:33:23.959276] [INFO ] [MAIN ] Derivative Progress: 71/1812 symbols completed. ALSN took 1.2s. Estimated remaining: 11m 8s. Rate: 156.5 symbols/min [2025-10-14T22:33:23.959501] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-14T22:33:23.959618] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:23.977113] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-14T22:33:23.977296] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-14T22:33:23.980474] [INFO ] [MAIN ] Derivative Progress: 72/1812 symbols completed. ALTG took 1.2s. Estimated remaining: 10m 58s. Rate: 158.6 symbols/min [2025-10-14T22:33:23.983287] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:23.989245] [DEBUG] [LOCAL ] ALX: Loaded 6886 existing records from primary storage. [2025-10-14T22:33:23.989428] [INFO ] [MAIN ] ALX: Loaded 6886 primary data records. [2025-10-14T22:33:24.131676] [DEBUG] [LOCAL ] ALV: Loaded 42132 existing records from primary storage. [2025-10-14T22:33:24.180554] [INFO ] [MAIN ] ALV: Loaded 42132 primary data records. [2025-10-14T22:33:24.501178] [DEBUG] [LOCAL ] AM: Loaded 51955 existing records from primary storage. [2025-10-14T22:33:24.564708] [INFO ] [MAIN ] AM: Loaded 51955 primary data records. [2025-10-14T22:33:25.095947] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:25.097635] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6886 primary records. [2025-10-14T22:33:25.098312] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-14T22:33:25.134584] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-14T22:33:25.135929] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:25.137331] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42132 primary records. [2025-10-14T22:33:25.136144] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-14T22:33:25.141064] [INFO ] [MAIN ] Derivative Progress: 73/1812 symbols completed. ALX took 1.2s. Estimated remaining: 11m 17s. Rate: 154.2 symbols/min [2025-10-14T22:33:25.137616] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-14T22:33:25.163263] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-14T22:33:25.165246] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-14T22:33:25.168239] [INFO ] [MAIN ] Derivative Progress: 74/1812 symbols completed. ALV took 1.2s. Estimated remaining: 11m 8s. Rate: 156.1 symbols/min [2025-10-14T22:33:25.181586] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:25.182511] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 51955 primary records. [2025-10-14T22:33:25.182582] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-14T22:33:25.199313] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-14T22:33:25.199508] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-14T22:33:25.202866] [INFO ] [MAIN ] Derivative Progress: 75/1812 symbols completed. AM took 1.2s. Estimated remaining: 10m 59s. Rate: 158.1 symbols/min [2025-10-14T22:33:25.203746] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:25.203577] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:25.203445] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:25.287450] [DEBUG] [LOCAL ] AMBP: Loaded 44612 existing records from primary storage. [2025-10-14T22:33:25.289343] [INFO ] [MAIN ] AMBP: Loaded 44612 primary data records. [2025-10-14T22:33:25.288380] [DEBUG] [LOCAL ] AMBC: Loaded 36259 existing records from primary storage. [2025-10-14T22:33:25.321794] [INFO ] [MAIN ] AMBC: Loaded 36259 primary data records. [2025-10-14T22:33:25.400882] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-14T22:33:25.464394] [INFO ] [MAIN ] AMC: Loaded 53762 primary data records. [2025-10-14T22:33:26.285414] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:26.294391] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44612 primary records. [2025-10-14T22:33:26.303070] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-14T22:33:26.303872] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:26.305902] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36259 primary records. [2025-10-14T22:33:26.306118] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-14T22:33:26.348377] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:26.351155] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53762 primary records. [2025-10-14T22:33:26.351252] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-14T22:33:26.364571] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-14T22:33:26.367670] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-14T22:33:26.371778] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-14T22:33:26.374686] [INFO ] [MAIN ] Derivative Progress: 76/1812 symbols completed. AMBP took 1.2s. Estimated remaining: 11m 17s. Rate: 153.8 symbols/min [2025-10-14T22:33:26.376196] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:26.376679] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-14T22:33:26.377539] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-14T22:33:26.376907] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-14T22:33:26.379840] [INFO ] [MAIN ] Derivative Progress: 77/1812 symbols completed. AMC took 1.2s. Estimated remaining: 11m 8s. Rate: 155.8 symbols/min [2025-10-14T22:33:26.382295] [INFO ] [MAIN ] Derivative Progress: 78/1812 symbols completed. AMBC took 1.2s. Estimated remaining: 10m 59s. Rate: 157.8 symbols/min [2025-10-14T22:33:26.382463] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:26.382237] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:26.469922] [DEBUG] [LOCAL ] AMH: Loaded 51797 existing records from primary storage. [2025-10-14T22:33:26.471058] [INFO ] [MAIN ] AMH: Loaded 51797 primary data records. [2025-10-14T22:33:26.483021] [DEBUG] [LOCAL ] AME: Loaded 48682 existing records from primary storage. [2025-10-14T22:33:26.507744] [INFO ] [MAIN ] AME: Loaded 48682 primary data records. [2025-10-14T22:33:26.684474] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-14T22:33:26.716262] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-14T22:33:27.479974] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:27.480967] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51797 primary records. [2025-10-14T22:33:27.488553] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-14T22:33:27.494268] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:27.495136] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48682 primary records. [2025-10-14T22:33:27.495232] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-14T22:33:27.539534] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-14T22:33:27.539223] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:27.539904] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-14T22:33:27.542554] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-14T22:33:27.542870] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-14T22:33:27.544470] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-14T22:33:27.541810] [INFO ] [MAIN ] Derivative Progress: 79/1812 symbols completed. AMH took 1.2s. Estimated remaining: 11m 16s. Rate: 153.9 symbols/min [2025-10-14T22:33:27.544907] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-14T22:33:27.547729] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:27.555001] [INFO ] [MAIN ] Derivative Progress: 80/1812 symbols completed. AME took 1.2s. Estimated remaining: 11m 7s. Rate: 155.7 symbols/min [2025-10-14T22:33:27.555473] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:27.566386] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-14T22:33:27.566509] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-14T22:33:27.568759] [INFO ] [MAIN ] Derivative Progress: 81/1812 symbols completed. AMCR took 1.2s. Estimated remaining: 10m 59s. Rate: 157.6 symbols/min [2025-10-14T22:33:27.569041] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:27.604404] [DEBUG] [LOCAL ] AMP: Loaded 32028 existing records from primary storage. [2025-10-14T22:33:27.616544] [INFO ] [MAIN ] AMP: Loaded 32028 primary data records. [2025-10-14T22:33:27.629532] [DEBUG] [LOCAL ] AMN: Loaded 41804 existing records from primary storage. [2025-10-14T22:33:27.649753] [INFO ] [MAIN ] AMN: Loaded 41804 primary data records. [2025-10-14T22:33:28.230080] [DEBUG] [LOCAL ] AMPX: Loaded 52326 existing records from primary storage. [2025-10-14T22:33:28.243778] [INFO ] [MAIN ] AMPX: Loaded 52326 primary data records. [2025-10-14T22:33:28.593910] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:28.596524] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41804 primary records. [2025-10-14T22:33:28.594945] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:28.596850] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-14T22:33:28.597886] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32028 primary records. [2025-10-14T22:33:28.599167] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-14T22:33:28.631330] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-10-14T22:33:28.631788] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-14T22:33:28.634070] [INFO ] [MAIN ] Derivative Progress: 82/1812 symbols completed. AMP took 1.1s. Estimated remaining: 11m 13s. Rate: 154.2 symbols/min [2025-10-14T22:33:28.634220] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:28.631697] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-14T22:33:28.634712] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-14T22:33:28.638579] [INFO ] [MAIN ] Derivative Progress: 83/1812 symbols completed. AMN took 1.1s. Estimated remaining: 11m 5s. Rate: 156.1 symbols/min [2025-10-14T22:33:28.639468] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:28.652918] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:28.653599] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52326 primary records. [2025-10-14T22:33:28.653789] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-14T22:33:28.670052] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-14T22:33:28.670209] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-14T22:33:28.672197] [INFO ] [MAIN ] Derivative Progress: 84/1812 symbols completed. AMPX took 1.1s. Estimated remaining: 10m 57s. Rate: 157.8 symbols/min [2025-10-14T22:33:28.672424] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:28.702792] [DEBUG] [LOCAL ] AMR: Loaded 28850 existing records from primary storage. [2025-10-14T22:33:28.703004] [INFO ] [MAIN ] AMR: Loaded 28850 primary data records. [2025-10-14T22:33:28.799847] [DEBUG] [LOCAL ] AMRC: Loaded 38369 existing records from primary storage. [2025-10-14T22:33:28.819491] [INFO ] [MAIN ] AMRC: Loaded 38369 primary data records. [2025-10-14T22:33:29.250020] [DEBUG] [LOCAL ] AMT: Loaded 52466 existing records from primary storage. [2025-10-14T22:33:29.407186] [INFO ] [MAIN ] AMT: Loaded 52466 primary data records. [2025-10-14T22:33:29.744385] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:29.746368] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28850 primary records. [2025-10-14T22:33:29.746509] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-14T22:33:29.766736] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-14T22:33:29.766959] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-14T22:33:29.768983] [INFO ] [MAIN ] Derivative Progress: 85/1812 symbols completed. AMR took 1.1s. Estimated remaining: 11m 11s. Rate: 154.4 symbols/min [2025-10-14T22:33:29.777044] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:29.782497] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:29.783595] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38369 primary records. [2025-10-14T22:33:29.783848] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-14T22:33:29.800638] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-14T22:33:29.801114] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-14T22:33:29.803292] [INFO ] [MAIN ] Derivative Progress: 86/1812 symbols completed. AMRC took 1.2s. Estimated remaining: 11m 4s. Rate: 156.0 symbols/min [2025-10-14T22:33:29.803621] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:29.826042] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:29.826784] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52466 primary records. [2025-10-14T22:33:29.833827] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-14T22:33:29.835698] [DEBUG] [LOCAL ] AMTB: Loaded 20513 existing records from primary storage. [2025-10-14T22:33:29.838683] [DEBUG] [LOCAL ] AMTD: Loaded 3790 existing records from primary storage. [2025-10-14T22:33:29.838478] [INFO ] [MAIN ] AMTB: Loaded 20513 primary data records. [2025-10-14T22:33:29.839077] [INFO ] [MAIN ] AMTD: Loaded 3790 primary data records. [2025-10-14T22:33:30.089405] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-14T22:33:30.128154] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-14T22:33:30.143967] [INFO ] [MAIN ] Derivative Progress: 87/1812 symbols completed. AMT took 1.5s. Estimated remaining: 11m 2s. Rate: 156.2 symbols/min [2025-10-14T22:33:30.186259] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:30.465502] [DEBUG] [LOCAL ] AMWL: Loaded 9471 existing records from primary storage. [2025-10-14T22:33:30.466108] [INFO ] [MAIN ] AMWL: Loaded 9471 primary data records. [2025-10-14T22:33:30.787999] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:30.800619] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20513 primary records. [2025-10-14T22:33:30.801802] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-14T22:33:30.802531] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:30.811918] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3790 primary records. [2025-10-14T22:33:30.815959] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-14T22:33:30.821272] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-14T22:33:30.821585] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-14T22:33:30.823555] [INFO ] [MAIN ] Derivative Progress: 88/1812 symbols completed. AMTB took 1.0s. Estimated remaining: 11m 8s. Rate: 154.9 symbols/min [2025-10-14T22:33:30.837936] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-14T22:33:30.838044] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-14T22:33:30.840282] [INFO ] [MAIN ] Derivative Progress: 89/1812 symbols completed. AMTD took 1.0s. Estimated remaining: 11m 0s. Rate: 156.6 symbols/min [2025-10-14T22:33:30.856827] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:30.857365] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9471 primary records. [2025-10-14T22:33:30.857426] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-14T22:33:30.871257] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-14T22:33:30.871313] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-14T22:33:30.873282] [INFO ] [MAIN ] Derivative Progress: 90/1812 symbols completed. AMWL took 0.7s. Estimated remaining: 10m 53s. Rate: 158.2 symbols/min [2025-10-14T22:33:30.873719] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:30.874039] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:30.874236] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:30.915518] [DEBUG] [LOCAL ] AN: Loaded 31479 existing records from primary storage. [2025-10-14T22:33:30.928045] [INFO ] [MAIN ] AN: Loaded 31479 primary data records. [2025-10-14T22:33:31.042131] [DEBUG] [LOCAL ] AMX: Loaded 49095 existing records from primary storage. [2025-10-14T22:33:31.073931] [INFO ] [MAIN ] AMX: Loaded 49095 primary data records. [2025-10-14T22:33:31.100994] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-14T22:33:31.192488] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-14T22:33:31.920695] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:31.921800] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 31479 primary records. [2025-10-14T22:33:31.922078] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-14T22:33:31.967387] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:31.961874] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:31.968803] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49095 primary records. [2025-10-14T22:33:31.970005] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-14T22:33:31.970599] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-14T22:33:31.970740] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-14T22:33:31.970881] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-14T22:33:31.968943] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-14T22:33:31.972897] [INFO ] [MAIN ] Derivative Progress: 91/1812 symbols completed. AN took 1.1s. Estimated remaining: 11m 6s. Rate: 154.9 symbols/min [2025-10-14T22:33:31.974048] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:32.004237] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-14T22:33:32.004414] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-14T22:33:32.007588] [INFO ] [MAIN ] Derivative Progress: 92/1812 symbols completed. ANET took 1.1s. Estimated remaining: 10m 59s. Rate: 156.5 symbols/min [2025-10-14T22:33:32.005474] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-14T22:33:32.007844] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:32.008317] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-14T22:33:32.010515] [INFO ] [MAIN ] Derivative Progress: 93/1812 symbols completed. AMX took 1.1s. Estimated remaining: 10m 52s. Rate: 158.2 symbols/min [2025-10-14T22:33:32.010925] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:32.051435] [DEBUG] [LOCAL ] ANRO: Loaded 19308 existing records from primary storage. [2025-10-14T22:33:32.051614] [INFO ] [MAIN ] ANRO: Loaded 19308 primary data records. [2025-10-14T22:33:32.130173] [DEBUG] [LOCAL ] ANVS: Loaded 23680 existing records from primary storage. [2025-10-14T22:33:32.142916] [INFO ] [MAIN ] ANVS: Loaded 23680 primary data records. [2025-10-14T22:33:32.228596] [DEBUG] [LOCAL ] ANF: Loaded 52075 existing records from primary storage. [2025-10-14T22:33:32.264787] [INFO ] [MAIN ] ANF: Loaded 52075 primary data records. [2025-10-14T22:33:33.044565] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:33.045721] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19308 primary records. [2025-10-14T22:33:33.045904] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-14T22:33:33.077179] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:33.077302] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-14T22:33:33.077617] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-14T22:33:33.078615] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23680 primary records. [2025-10-14T22:33:33.080700] [INFO ] [MAIN ] Derivative Progress: 94/1812 symbols completed. ANRO took 1.1s. Estimated remaining: 11m 4s. Rate: 155.2 symbols/min [2025-10-14T22:33:33.081016] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:33.081226] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-14T22:33:33.102497] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-14T22:33:33.103063] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-14T22:33:33.106574] [INFO ] [MAIN ] Derivative Progress: 95/1812 symbols completed. ANVS took 1.1s. Estimated remaining: 10m 57s. Rate: 156.7 symbols/min [2025-10-14T22:33:33.107010] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:33.121337] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:33.122318] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52075 primary records. [2025-10-14T22:33:33.122492] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-14T22:33:33.153237] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-14T22:33:33.159749] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-14T22:33:33.161969] [INFO ] [MAIN ] Derivative Progress: 96/1812 symbols completed. ANF took 1.2s. Estimated remaining: 10m 51s. Rate: 158.1 symbols/min [2025-10-14T22:33:33.162158] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:33.163196] [DEBUG] [LOCAL ] AOMR: Loaded 16470 existing records from primary storage. [2025-10-14T22:33:33.171991] [INFO ] [MAIN ] AOMR: Loaded 16470 primary data records. [2025-10-14T22:33:33.196157] [DEBUG] [LOCAL ] AOD: Loaded 30776 existing records from primary storage. [2025-10-14T22:33:33.219849] [INFO ] [MAIN ] AOD: Loaded 30776 primary data records. [2025-10-14T22:33:33.718836] [DEBUG] [LOCAL ] AON: Loaded 45116 existing records from primary storage. [2025-10-14T22:33:33.851313] [INFO ] [MAIN ] AON: Loaded 45116 primary data records. [2025-10-14T22:33:34.219728] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:34.221514] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16470 primary records. [2025-10-14T22:33:34.220596] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:34.222424] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30776 primary records. [2025-10-14T22:33:34.222758] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-14T22:33:34.222684] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-14T22:33:34.249061] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-14T22:33:34.252895] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-14T22:33:34.257028] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-14T22:33:34.259308] [INFO ] [MAIN ] Derivative Progress: 97/1812 symbols completed. AOD took 1.2s. Estimated remaining: 11m 3s. Rate: 155.1 symbols/min [2025-10-14T22:33:34.260103] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:34.259972] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-14T22:33:34.262898] [INFO ] [MAIN ] Derivative Progress: 98/1812 symbols completed. AOMR took 1.2s. Estimated remaining: 10m 56s. Rate: 156.7 symbols/min [2025-10-14T22:33:34.263356] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:34.283083] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:34.283861] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45116 primary records. [2025-10-14T22:33:34.283995] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-14T22:33:34.308909] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-14T22:33:34.309246] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-14T22:33:34.313002] [INFO ] [MAIN ] Derivative Progress: 99/1812 symbols completed. AON took 1.2s. Estimated remaining: 10m 50s. Rate: 158.1 symbols/min [2025-10-14T22:33:34.313321] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:34.328083] [DEBUG] [LOCAL ] AORT: Loaded 29205 existing records from primary storage. [2025-10-14T22:33:34.331044] [INFO ] [MAIN ] AORT: Loaded 29205 primary data records. [2025-10-14T22:33:34.404920] [DEBUG] [LOCAL ] AP: Loaded 7321 existing records from primary storage. [2025-10-14T22:33:34.432603] [INFO ] [MAIN ] AP: Loaded 7321 primary data records. [2025-10-14T22:33:34.558139] [DEBUG] [LOCAL ] AOS: Loaded 48722 existing records from primary storage. [2025-10-14T22:33:34.585627] [INFO ] [MAIN ] AOS: Loaded 48722 primary data records. [2025-10-14T22:33:35.361772] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:35.363970] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29205 primary records. [2025-10-14T22:33:35.364349] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-14T22:33:35.393232] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-14T22:33:35.393531] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:35.393638] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-14T22:33:35.394488] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7321 primary records. [2025-10-14T22:33:35.396525] [INFO ] [MAIN ] Derivative Progress: 100/1812 symbols completed. AORT took 1.1s. Estimated remaining: 11m 2s. Rate: 155.2 symbols/min [2025-10-14T22:33:35.397459] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-14T22:33:35.397631] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:35.427305] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-14T22:33:35.427681] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-14T22:33:35.427613] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:35.429870] [INFO ] [MAIN ] Derivative Progress: 101/1812 symbols completed. AP took 1.1s. Estimated remaining: 10m 56s. Rate: 156.6 symbols/min [2025-10-14T22:33:35.430063] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:35.431289] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48722 primary records. [2025-10-14T22:33:35.431396] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-14T22:33:35.447262] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-14T22:33:35.447474] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-14T22:33:35.449590] [INFO ] [MAIN ] Derivative Progress: 102/1812 symbols completed. AOS took 1.2s. Estimated remaining: 10m 49s. Rate: 158.1 symbols/min [2025-10-14T22:33:35.449838] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:35.477580] [DEBUG] [LOCAL ] APAM: Loaded 36060 existing records from primary storage. [2025-10-14T22:33:35.477989] [INFO ] [MAIN ] APAM: Loaded 36060 primary data records. [2025-10-14T22:33:35.694344] [DEBUG] [LOCAL ] APD: Loaded 45380 existing records from primary storage. [2025-10-14T22:33:35.706791] [INFO ] [MAIN ] APD: Loaded 45380 primary data records. [2025-10-14T22:33:35.894107] [DEBUG] [LOCAL ] APG: Loaded 50586 existing records from primary storage. [2025-10-14T22:33:35.907368] [INFO ] [MAIN ] APG: Loaded 50586 primary data records. [2025-10-14T22:33:36.494074] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:36.496419] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36060 primary records. [2025-10-14T22:33:36.496812] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-14T22:33:36.515314] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-10-14T22:33:36.516729] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-14T22:33:36.519052] [INFO ] [MAIN ] Derivative Progress: 103/1812 symbols completed. APAM took 1.1s. Estimated remaining: 11m 0s. Rate: 155.3 symbols/min [2025-10-14T22:33:36.537017] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:36.538168] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45380 primary records. [2025-10-14T22:33:36.538345] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-14T22:33:36.551630] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:36.553220] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50586 primary records. [2025-10-14T22:33:36.553582] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-14T22:33:36.578356] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-14T22:33:36.585824] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-14T22:33:36.586894] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-14T22:33:36.590516] [INFO ] [MAIN ] Derivative Progress: 104/1812 symbols completed. APD took 1.2s. Estimated remaining: 10m 55s. Rate: 156.6 symbols/min [2025-10-14T22:33:36.590838] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-14T22:33:36.593279] [INFO ] [MAIN ] Derivative Progress: 105/1812 symbols completed. APG took 1.1s. Estimated remaining: 10m 48s. Rate: 158.1 symbols/min [2025-10-14T22:33:36.593639] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:36.594132] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:36.594279] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:36.692227] [DEBUG] [LOCAL ] APLE: Loaded 51970 existing records from primary storage. [2025-10-14T22:33:36.692872] [DEBUG] [LOCAL ] APTV: Loaded 51980 existing records from primary storage. [2025-10-14T22:33:36.693134] [INFO ] [MAIN ] APTV: Loaded 51980 primary data records. [2025-10-14T22:33:36.693215] [INFO ] [MAIN ] APLE: Loaded 51970 primary data records. [2025-10-14T22:33:36.923686] [DEBUG] [LOCAL ] APO: Loaded 53390 existing records from primary storage. [2025-10-14T22:33:36.927471] [INFO ] [MAIN ] APO: Loaded 53390 primary data records. [2025-10-14T22:33:37.722586] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:37.728907] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 51970 primary records. [2025-10-14T22:33:37.729270] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:37.729431] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-14T22:33:37.731181] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 51980 primary records. [2025-10-14T22:33:37.732064] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-14T22:33:37.748052] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-10-14T22:33:37.757511] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-14T22:33:37.761383] [INFO ] [MAIN ] Derivative Progress: 106/1812 symbols completed. APLE took 1.2s. Estimated remaining: 11m 0s. Rate: 155.0 symbols/min [2025-10-14T22:33:37.776077] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-14T22:33:37.781771] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:37.782509] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53390 primary records. [2025-10-14T22:33:37.782614] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-14T22:33:37.780865] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:37.784269] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-14T22:33:37.786561] [INFO ] [MAIN ] Derivative Progress: 107/1812 symbols completed. APTV took 1.2s. Estimated remaining: 10m 54s. Rate: 156.4 symbols/min [2025-10-14T22:33:37.798861] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:37.807826] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-14T22:33:37.808771] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-14T22:33:37.811075] [INFO ] [MAIN ] Derivative Progress: 108/1812 symbols completed. APO took 1.2s. Estimated remaining: 10m 48s. Rate: 157.8 symbols/min [2025-10-14T22:33:37.808451] [DEBUG] [LOCAL ] AQNB: Loaded 4087 existing records from primary storage. [2025-10-14T22:33:37.811252] [INFO ] [MAIN ] AQNB: Loaded 4087 primary data records. [2025-10-14T22:33:37.811354] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:38.160757] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-14T22:33:38.174471] [INFO ] [MAIN ] AR: Loaded 53587 primary data records. [2025-10-14T22:33:38.175985] [DEBUG] [LOCAL ] ARCO: Loaded 44536 existing records from primary storage. [2025-10-14T22:33:38.197748] [INFO ] [MAIN ] ARCO: Loaded 44536 primary data records. [2025-10-14T22:33:38.824019] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:38.826200] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4087 primary records. [2025-10-14T22:33:38.827971] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-14T22:33:38.850782] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-14T22:33:38.851134] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-14T22:33:38.854043] [INFO ] [MAIN ] Derivative Progress: 109/1812 symbols completed. AQNB took 1.1s. Estimated remaining: 10m 58s. Rate: 155.3 symbols/min [2025-10-14T22:33:38.854514] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:38.879525] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:38.884961] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44536 primary records. [2025-10-14T22:33:38.897731] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-14T22:33:38.898218] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:38.900269] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53587 primary records. [2025-10-14T22:33:38.913930] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-14T22:33:38.919277] [DEBUG] [LOCAL ] ARDC: Loaded 15257 existing records from primary storage. [2025-10-14T22:33:38.919830] [INFO ] [MAIN ] ARDC: Loaded 15257 primary data records. [2025-10-14T22:33:38.991703] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-10-14T22:33:39.015944] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-14T22:33:39.054199] [INFO ] [MAIN ] Derivative Progress: 110/1812 symbols completed. ARCO took 1.2s. Estimated remaining: 10m 55s. Rate: 156.0 symbols/min [2025-10-14T22:33:39.060411] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:39.059906] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-14T22:33:39.082977] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-14T22:33:39.159179] [INFO ] [MAIN ] Derivative Progress: 111/1812 symbols completed. AR took 1.4s. Estimated remaining: 10m 50s. Rate: 157.0 symbols/min [2025-10-14T22:33:39.197826] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:39.404412] [DEBUG] [LOCAL ] ARDT: Loaded 27735 existing records from primary storage. [2025-10-14T22:33:39.404834] [INFO ] [MAIN ] ARDT: Loaded 27735 primary data records. [2025-10-14T22:33:39.747842] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:39.756077] [DEBUG] [LOCAL ] ARE: Loaded 50917 existing records from primary storage. [2025-10-14T22:33:39.880698] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 15257 primary records. [2025-10-14T22:33:39.894697] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-14T22:33:39.894592] [INFO ] [MAIN ] ARE: Loaded 50917 primary data records. [2025-10-14T22:33:40.018151] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-14T22:33:40.040032] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-14T22:33:40.052673] [INFO ] [MAIN ] Derivative Progress: 112/1812 symbols completed. ARDC took 1.2s. Estimated remaining: 10m 58s. Rate: 155.1 symbols/min [2025-10-14T22:33:40.053458] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:40.288816] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:40.289880] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27735 primary records. [2025-10-14T22:33:40.290223] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-14T22:33:40.318863] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-14T22:33:40.319002] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-14T22:33:40.321138] [INFO ] [MAIN ] Derivative Progress: 113/1812 symbols completed. ARDT took 1.3s. Estimated remaining: 10m 55s. Rate: 155.5 symbols/min [2025-10-14T22:33:40.321312] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:40.342143] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:40.343176] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50917 primary records. [2025-10-14T22:33:40.356337] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-14T22:33:40.358591] [DEBUG] [LOCAL ] ARES: Loaded 49704 existing records from primary storage. [2025-10-14T22:33:40.358992] [INFO ] [MAIN ] ARES: Loaded 49704 primary data records. [2025-10-14T22:33:40.466630] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-14T22:33:40.486365] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-14T22:33:40.504088] [INFO ] [MAIN ] Derivative Progress: 114/1812 symbols completed. ARE took 1.3s. Estimated remaining: 10m 52s. Rate: 156.3 symbols/min [2025-10-14T22:33:40.520273] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:40.553353] [DEBUG] [LOCAL ] ARI: Loaded 43778 existing records from primary storage. [2025-10-14T22:33:40.562772] [INFO ] [MAIN ] ARI: Loaded 43778 primary data records. [2025-10-14T22:33:41.041791] [DEBUG] [LOCAL ] ARIS: Loaded 42574 existing records from primary storage. [2025-10-14T22:33:41.042234] [INFO ] [MAIN ] ARIS: Loaded 42574 primary data records. [2025-10-14T22:33:41.364950] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:41.366116] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49704 primary records. [2025-10-14T22:33:41.366272] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-14T22:33:41.384050] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-10-14T22:33:41.385255] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-14T22:33:41.387632] [INFO ] [MAIN ] Derivative Progress: 115/1812 symbols completed. ARES took 1.3s. Estimated remaining: 10m 59s. Rate: 154.5 symbols/min [2025-10-14T22:33:41.388223] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:41.407042] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:41.408344] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43778 primary records. [2025-10-14T22:33:41.408582] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-14T22:33:41.426737] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-10-14T22:33:41.429295] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-14T22:33:41.431358] [INFO ] [MAIN ] Derivative Progress: 116/1812 symbols completed. ARI took 1.1s. Estimated remaining: 10m 54s. Rate: 155.7 symbols/min [2025-10-14T22:33:41.431564] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:41.445468] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:41.446148] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42574 primary records. [2025-10-14T22:33:41.456071] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-14T22:33:41.471922] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-10-14T22:33:41.472052] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-14T22:33:41.474114] [INFO ] [MAIN ] Derivative Progress: 117/1812 symbols completed. ARIS took 1.0s. Estimated remaining: 10m 48s. Rate: 156.9 symbols/min [2025-10-14T22:33:41.474855] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:41.488436] [DEBUG] [LOCAL ] ARLO: Loaded 43765 existing records from primary storage. [2025-10-14T22:33:41.488674] [INFO ] [MAIN ] ARLO: Loaded 43765 primary data records. [2025-10-14T22:33:41.746500] [DEBUG] [LOCAL ] ARMK: Loaded 50356 existing records from primary storage. [2025-10-14T22:33:41.851803] [INFO ] [MAIN ] ARMK: Loaded 50356 primary data records. [2025-10-14T22:33:41.957399] [DEBUG] [LOCAL ] AROC: Loaded 49037 existing records from primary storage. [2025-10-14T22:33:41.979930] [INFO ] [MAIN ] AROC: Loaded 49037 primary data records. [2025-10-14T22:33:42.520547] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:42.522297] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43765 primary records. [2025-10-14T22:33:42.522701] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-14T22:33:42.541192] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-14T22:33:42.541301] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-14T22:33:42.543356] [INFO ] [MAIN ] Derivative Progress: 118/1812 symbols completed. ARLO took 1.2s. Estimated remaining: 10m 58s. Rate: 154.6 symbols/min [2025-10-14T22:33:42.561857] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:42.562609] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50356 primary records. [2025-10-14T22:33:42.562887] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-14T22:33:42.587474] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-14T22:33:42.587678] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-14T22:33:42.590242] [INFO ] [MAIN ] Derivative Progress: 119/1812 symbols completed. ARMK took 1.2s. Estimated remaining: 10m 52s. Rate: 155.7 symbols/min [2025-10-14T22:33:42.603467] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:42.604394] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 49037 primary records. [2025-10-14T22:33:42.604461] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-14T22:33:42.620541] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-14T22:33:42.620611] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-14T22:33:42.623333] [INFO ] [MAIN ] Derivative Progress: 120/1812 symbols completed. AROC took 1.1s. Estimated remaining: 10m 47s. Rate: 156.9 symbols/min [2025-10-14T22:33:42.624099] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:42.624042] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:42.623911] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:42.659638] [DEBUG] [LOCAL ] ARW: Loaded 33043 existing records from primary storage. [2025-10-14T22:33:42.675881] [INFO ] [MAIN ] ARW: Loaded 33043 primary data records. [2025-10-14T22:33:42.854367] [DEBUG] [LOCAL ] AS: Loaded 53174 existing records from primary storage. [2025-10-14T22:33:42.866957] [INFO ] [MAIN ] AS: Loaded 53174 primary data records. [2025-10-14T22:33:42.867097] [DEBUG] [LOCAL ] ARR: Loaded 52116 existing records from primary storage. [2025-10-14T22:33:42.913775] [INFO ] [MAIN ] ARR: Loaded 52116 primary data records. [2025-10-14T22:33:43.755313] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:43.757037] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33043 primary records. [2025-10-14T22:33:43.757400] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-14T22:33:43.808877] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-14T22:33:43.803265] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:43.809622] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-14T22:33:43.809332] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:43.810434] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52116 primary records. [2025-10-14T22:33:43.813251] [INFO ] [MAIN ] Derivative Progress: 121/1812 symbols completed. ARW took 1.2s. Estimated remaining: 10m 58s. Rate: 154.2 symbols/min [2025-10-14T22:33:43.813468] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-14T22:33:43.811274] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53174 primary records. [2025-10-14T22:33:43.814127] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:43.814559] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-14T22:33:43.848159] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-14T22:33:43.848369] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-14T22:33:43.851905] [INFO ] [MAIN ] Derivative Progress: 122/1812 symbols completed. ARR took 1.2s. Estimated remaining: 10m 53s. Rate: 155.4 symbols/min [2025-10-14T22:33:43.852823] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:43.857693] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-10-14T22:33:43.857954] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-14T22:33:43.860561] [INFO ] [MAIN ] Derivative Progress: 123/1812 symbols completed. AS took 1.2s. Estimated remaining: 10m 47s. Rate: 156.6 symbols/min [2025-10-14T22:33:43.860990] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:43.869299] [DEBUG] [LOCAL ] ASA: Loaded 15119 existing records from primary storage. [2025-10-14T22:33:43.869528] [INFO ] [MAIN ] ASA: Loaded 15119 primary data records. [2025-10-14T22:33:43.909719] [DEBUG] [LOCAL ] ASBA: Loaded 3448 existing records from primary storage. [2025-10-14T22:33:43.928949] [INFO ] [MAIN ] ASBA: Loaded 3448 primary data records. [2025-10-14T22:33:44.513777] [DEBUG] [LOCAL ] ASB: Loaded 49600 existing records from primary storage. [2025-10-14T22:33:44.514231] [INFO ] [MAIN ] ASB: Loaded 49600 primary data records. [2025-10-14T22:33:44.851547] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:44.854261] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 15119 primary records. [2025-10-14T22:33:44.855242] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-14T22:33:44.882241] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:44.893756] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3448 primary records. [2025-10-14T22:33:44.894064] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-14T22:33:44.892398] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-14T22:33:44.894199] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-14T22:33:44.897181] [INFO ] [MAIN ] Derivative Progress: 124/1812 symbols completed. ASA took 1.1s. Estimated remaining: 10m 56s. Rate: 154.5 symbols/min [2025-10-14T22:33:44.897996] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:44.913941] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-14T22:33:44.914374] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-14T22:33:44.916696] [INFO ] [MAIN ] Derivative Progress: 125/1812 symbols completed. ASBA took 1.1s. Estimated remaining: 10m 50s. Rate: 155.7 symbols/min [2025-10-14T22:33:44.917193] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:44.934156] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:44.934953] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49600 primary records. [2025-10-14T22:33:44.935111] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-14T22:33:44.965326] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-14T22:33:44.965493] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-14T22:33:44.967710] [INFO ] [MAIN ] Derivative Progress: 126/1812 symbols completed. ASB took 1.1s. Estimated remaining: 10m 45s. Rate: 156.7 symbols/min [2025-10-14T22:33:44.974724] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:44.974942] [DEBUG] [LOCAL ] ASG: Loaded 19552 existing records from primary storage. [2025-10-14T22:33:44.975508] [INFO ] [MAIN ] ASG: Loaded 19552 primary data records. [2025-10-14T22:33:45.096779] [DEBUG] [LOCAL ] ASC: Loaded 37331 existing records from primary storage. [2025-10-14T22:33:45.103027] [INFO ] [MAIN ] ASC: Loaded 37331 primary data records. [2025-10-14T22:33:45.232428] [DEBUG] [LOCAL ] ASGI: Loaded 22862 existing records from primary storage. [2025-10-14T22:33:45.292768] [INFO ] [MAIN ] ASGI: Loaded 22862 primary data records. [2025-10-14T22:33:45.996565] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:45.998954] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19552 primary records. [2025-10-14T22:33:45.999372] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-14T22:33:46.015959] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-14T22:33:46.016069] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-14T22:33:46.018010] [INFO ] [MAIN ] Derivative Progress: 127/1812 symbols completed. ASG took 1.1s. Estimated remaining: 10m 54s. Rate: 154.6 symbols/min [2025-10-14T22:33:46.018201] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:46.037972] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:46.038767] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37331 primary records. [2025-10-14T22:33:46.038981] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-14T22:33:46.067396] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-14T22:33:46.067800] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-14T22:33:46.070124] [INFO ] [MAIN ] Derivative Progress: 128/1812 symbols completed. ASC took 1.2s. Estimated remaining: 10m 49s. Rate: 155.7 symbols/min [2025-10-14T22:33:46.070340] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:46.084318] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:46.085190] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22862 primary records. [2025-10-14T22:33:46.094946] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-14T22:33:46.113681] [DEBUG] [LOCAL ] ASGN: Loaded 36558 existing records from primary storage. [2025-10-14T22:33:46.114722] [INFO ] [MAIN ] ASGN: Loaded 36558 primary data records. [2025-10-14T22:33:46.175212] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-14T22:33:46.195203] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-14T22:33:46.210315] [INFO ] [MAIN ] Derivative Progress: 129/1812 symbols completed. ASGI took 1.2s. Estimated remaining: 10m 45s. Rate: 156.4 symbols/min [2025-10-14T22:33:46.210550] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:46.280125] [DEBUG] [LOCAL ] ASH: Loaded 37552 existing records from primary storage. [2025-10-14T22:33:46.298911] [INFO ] [MAIN ] ASH: Loaded 37552 primary data records. [2025-10-14T22:33:46.799554] [DEBUG] [LOCAL ] ASPN: Loaded 49874 existing records from primary storage. [2025-10-14T22:33:46.800343] [INFO ] [MAIN ] ASPN: Loaded 49874 primary data records. [2025-10-14T22:33:46.969439] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:47.007849] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36558 primary records. [2025-10-14T22:33:47.010419] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-14T22:33:47.172309] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-14T22:33:47.186356] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-14T22:33:47.185949] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:47.189702] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37552 primary records. [2025-10-14T22:33:47.188460] [INFO ] [MAIN ] Derivative Progress: 130/1812 symbols completed. ASGN took 1.2s. Estimated remaining: 10m 53s. Rate: 154.6 symbols/min [2025-10-14T22:33:47.190118] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-14T22:33:47.190633] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:47.208430] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-14T22:33:47.210443] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-14T22:33:47.216027] [DEBUG] [LOCAL ] ASR: Loaded 9384 existing records from primary storage. [2025-10-14T22:33:47.220254] [INFO ] [MAIN ] ASR: Loaded 9384 primary data records. [2025-10-14T22:33:47.220044] [INFO ] [MAIN ] Derivative Progress: 131/1812 symbols completed. ASH took 1.1s. Estimated remaining: 10m 48s. Rate: 155.7 symbols/min [2025-10-14T22:33:47.232013] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:47.545853] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:47.547229] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49874 primary records. [2025-10-14T22:33:47.547968] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-14T22:33:47.582181] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-14T22:33:47.583396] [DEBUG] [LOCAL ] ASX: Loaded 52873 existing records from primary storage. [2025-10-14T22:33:47.583768] [INFO ] [MAIN ] ASX: Loaded 52873 primary data records. [2025-10-14T22:33:47.582624] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-14T22:33:47.586340] [INFO ] [MAIN ] Derivative Progress: 132/1812 symbols completed. ASPN took 1.4s. Estimated remaining: 10m 47s. Rate: 155.7 symbols/min [2025-10-14T22:33:47.598040] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:47.833540] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:47.947740] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9384 primary records. [2025-10-14T22:33:47.947955] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-14T22:33:47.978943] [DEBUG] [LOCAL ] ATEN: Loaded 38394 existing records from primary storage. [2025-10-14T22:33:47.977553] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-14T22:33:47.979145] [INFO ] [MAIN ] ATEN: Loaded 38394 primary data records. [2025-10-14T22:33:47.979222] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-14T22:33:48.031271] [INFO ] [MAIN ] Derivative Progress: 133/1812 symbols completed. ASR took 0.8s. Estimated remaining: 10m 48s. Rate: 155.6 symbols/min [2025-10-14T22:33:48.294119] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:48.294807] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52873 primary records. [2025-10-14T22:33:48.295281] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-14T22:33:48.312487] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-14T22:33:48.312823] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-14T22:33:48.314796] [INFO ] [MAIN ] Derivative Progress: 134/1812 symbols completed. ASX took 1.1s. Estimated remaining: 10m 46s. Rate: 155.9 symbols/min [2025-10-14T22:33:48.334103] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:48.334629] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 38394 primary records. [2025-10-14T22:33:48.334711] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-14T22:33:48.349796] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-14T22:33:48.349851] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-14T22:33:48.351888] [INFO ] [MAIN ] Derivative Progress: 135/1812 symbols completed. ATEN took 0.8s. Estimated remaining: 10m 41s. Rate: 156.9 symbols/min [2025-10-14T22:33:48.352490] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:48.352579] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:48.352687] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:48.362108] [DEBUG] [LOCAL ] ATHS: Loaded 6717 existing records from primary storage. [2025-10-14T22:33:48.362397] [INFO ] [MAIN ] ATHS: Loaded 6717 primary data records. [2025-10-14T22:33:48.577141] [DEBUG] [LOCAL ] ATGE: Loaded 31110 existing records from primary storage. [2025-10-14T22:33:48.677738] [INFO ] [MAIN ] ATGE: Loaded 31110 primary data records. [2025-10-14T22:33:48.695668] [DEBUG] [LOCAL ] ATHM: Loaded 31560 existing records from primary storage. [2025-10-14T22:33:48.707343] [INFO ] [MAIN ] ATHM: Loaded 31560 primary data records. [2025-10-14T22:33:49.308374] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:49.309290] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6717 primary records. [2025-10-14T22:33:49.310498] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-14T22:33:49.328072] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-14T22:33:49.328234] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-14T22:33:49.330311] [INFO ] [MAIN ] Derivative Progress: 136/1812 symbols completed. ATHS took 1.0s. Estimated remaining: 10m 48s. Rate: 155.1 symbols/min [2025-10-14T22:33:49.330566] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:49.348742] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:49.356878] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31110 primary records. [2025-10-14T22:33:49.357011] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-14T22:33:49.362856] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:49.376855] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 31560 primary records. [2025-10-14T22:33:49.378475] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-14T22:33:49.378410] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-14T22:33:49.378667] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-14T22:33:49.381264] [INFO ] [MAIN ] Derivative Progress: 137/1812 symbols completed. ATGE took 1.0s. Estimated remaining: 10m 44s. Rate: 156.1 symbols/min [2025-10-14T22:33:49.381596] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:49.397870] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-14T22:33:49.398057] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-14T22:33:49.400205] [INFO ] [MAIN ] Derivative Progress: 138/1812 symbols completed. ATHM took 1.0s. Estimated remaining: 10m 39s. Rate: 157.2 symbols/min [2025-10-14T22:33:49.400458] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:49.442003] [DEBUG] [LOCAL ] ATI: Loaded 51381 existing records from primary storage. [2025-10-14T22:33:49.442284] [INFO ] [MAIN ] ATI: Loaded 51381 primary data records. [2025-10-14T22:33:49.552918] [DEBUG] [LOCAL ] ATKR: Loaded 35205 existing records from primary storage. [2025-10-14T22:33:49.565232] [INFO ] [MAIN ] ATKR: Loaded 35205 primary data records. [2025-10-14T22:33:49.884784] [DEBUG] [LOCAL ] ATMU: Loaded 38890 existing records from primary storage. [2025-10-14T22:33:49.919117] [INFO ] [MAIN ] ATMU: Loaded 38890 primary data records. [2025-10-14T22:33:50.425352] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:50.426550] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51381 primary records. [2025-10-14T22:33:50.427107] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-14T22:33:50.449557] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-14T22:33:50.449915] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-14T22:33:50.452013] [INFO ] [MAIN ] Derivative Progress: 139/1812 symbols completed. ATI took 1.1s. Estimated remaining: 10m 47s. Rate: 155.3 symbols/min [2025-10-14T22:33:50.452273] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:50.466361] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:50.467384] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35205 primary records. [2025-10-14T22:33:50.467625] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-14T22:33:50.489455] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-14T22:33:50.489781] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-14T22:33:50.492741] [INFO ] [MAIN ] Derivative Progress: 140/1812 symbols completed. ATKR took 1.1s. Estimated remaining: 10m 42s. Rate: 156.3 symbols/min [2025-10-14T22:33:50.505548] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:50.506703] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:50.507383] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 38890 primary records. [2025-10-14T22:33:50.507521] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-14T22:33:50.535535] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-14T22:33:50.535788] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-14T22:33:50.537896] [INFO ] [MAIN ] Derivative Progress: 141/1812 symbols completed. ATMU took 1.1s. Estimated remaining: 10m 38s. Rate: 157.2 symbols/min [2025-10-14T22:33:50.538102] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:50.567551] [DEBUG] [LOCAL ] ATO: Loaded 41812 existing records from primary storage. [2025-10-14T22:33:50.567840] [INFO ] [MAIN ] ATO: Loaded 41812 primary data records. [2025-10-14T22:33:50.613367] [DEBUG] [LOCAL ] ATS: Loaded 17644 existing records from primary storage. [2025-10-14T22:33:50.641914] [DEBUG] [LOCAL ] ATR: Loaded 30558 existing records from primary storage. [2025-10-14T22:33:50.641231] [INFO ] [MAIN ] ATS: Loaded 17644 primary data records. [2025-10-14T22:33:50.651180] [INFO ] [MAIN ] ATR: Loaded 30558 primary data records. [2025-10-14T22:33:51.567715] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:51.568844] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17644 primary records. [2025-10-14T22:33:51.568946] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-14T22:33:51.605755] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-14T22:33:51.605675] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:51.605988] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-14T22:33:51.615774] [INFO ] [MAIN ] Derivative Progress: 142/1812 symbols completed. ATS took 1.1s. Estimated remaining: 10m 45s. Rate: 155.2 symbols/min [2025-10-14T22:33:51.615991] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:51.621705] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41812 primary records. [2025-10-14T22:33:51.622468] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:51.623106] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30558 primary records. [2025-10-14T22:33:51.623247] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-14T22:33:51.623194] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-14T22:33:51.651235] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-14T22:33:51.655539] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-14T22:33:51.655946] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-14T22:33:51.655883] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-14T22:33:51.658510] [INFO ] [MAIN ] Derivative Progress: 143/1812 symbols completed. ATO took 1.2s. Estimated remaining: 10m 41s. Rate: 156.2 symbols/min [2025-10-14T22:33:51.661280] [INFO ] [MAIN ] Derivative Progress: 144/1812 symbols completed. ATR took 1.2s. Estimated remaining: 10m 36s. Rate: 157.3 symbols/min [2025-10-14T22:33:51.661198] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:51.661612] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:51.670277] [DEBUG] [LOCAL ] AUNA: Loaded 5113 existing records from primary storage. [2025-10-14T22:33:51.670508] [INFO ] [MAIN ] AUNA: Loaded 5113 primary data records. [2025-10-14T22:33:51.813348] [DEBUG] [LOCAL ] ATUS: Loaded 49800 existing records from primary storage. [2025-10-14T22:33:51.861800] [INFO ] [MAIN ] ATUS: Loaded 49800 primary data records. [2025-10-14T22:33:52.124407] [DEBUG] [LOCAL ] AUB: Loaded 46046 existing records from primary storage. [2025-10-14T22:33:52.141191] [INFO ] [MAIN ] AUB: Loaded 46046 primary data records. [2025-10-14T22:33:52.635727] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:33:52.637618] [INFO ] [MAIN ] AUNA: Generated 1793 derivative records from 5113 primary records. [2025-10-14T22:33:52.638220] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-14T22:33:52.654811] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1793 records). [2025-10-14T22:33:52.655901] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-14T22:33:52.659776] [INFO ] [MAIN ] Derivative Progress: 145/1812 symbols completed. AUNA took 1.0s. Estimated remaining: 10m 43s. Rate: 155.6 symbols/min [2025-10-14T22:33:52.660500] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:52.674347] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:52.675157] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49800 primary records. [2025-10-14T22:33:52.675318] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-14T22:33:52.694061] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-14T22:33:52.694408] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-14T22:33:52.696622] [INFO ] [MAIN ] Derivative Progress: 146/1812 symbols completed. ATUS took 1.1s. Estimated remaining: 10m 39s. Rate: 156.5 symbols/min [2025-10-14T22:33:52.696960] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:52.718692] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:52.719559] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46046 primary records. [2025-10-14T22:33:52.719742] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-14T22:33:52.733623] [DEBUG] [LOCAL ] AVAL: Loaded 8611 existing records from primary storage. [2025-10-14T22:33:52.742810] [INFO ] [MAIN ] AVAL: Loaded 8611 primary data records. [2025-10-14T22:33:52.794211] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-14T22:33:52.817788] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-14T22:33:52.864558] [INFO ] [MAIN ] Derivative Progress: 147/1812 symbols completed. AUB took 1.2s. Estimated remaining: 10m 36s. Rate: 157.1 symbols/min [2025-10-14T22:33:52.886856] [DEBUG] [LOCAL ] AVA: Loaded 38899 existing records from primary storage. [2025-10-14T22:33:52.886979] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:52.887257] [INFO ] [MAIN ] AVA: Loaded 38899 primary data records. [2025-10-14T22:33:53.415059] [DEBUG] [LOCAL ] AVB: Loaded 42213 existing records from primary storage. [2025-10-14T22:33:53.416314] [INFO ] [MAIN ] AVB: Loaded 42213 primary data records. [2025-10-14T22:33:53.556384] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:53.593412] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8611 primary records. [2025-10-14T22:33:53.605839] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-14T22:33:53.821853] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-10-14T22:33:53.822269] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-14T22:33:53.824354] [INFO ] [MAIN ] Derivative Progress: 148/1812 symbols completed. AVAL took 1.1s. Estimated remaining: 10m 42s. Rate: 155.5 symbols/min [2025-10-14T22:33:53.841781] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:53.843602] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 38899 primary records. [2025-10-14T22:33:53.843932] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-14T22:33:53.862040] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-14T22:33:53.862715] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-14T22:33:53.865153] [INFO ] [MAIN ] Derivative Progress: 149/1812 symbols completed. AVA took 1.2s. Estimated remaining: 10m 38s. Rate: 156.5 symbols/min [2025-10-14T22:33:53.882676] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:53.883282] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42213 primary records. [2025-10-14T22:33:53.883341] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-14T22:33:53.898539] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-14T22:33:53.898595] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-14T22:33:53.901796] [INFO ] [MAIN ] Derivative Progress: 150/1812 symbols completed. AVB took 1.0s. Estimated remaining: 10m 33s. Rate: 157.4 symbols/min [2025-10-14T22:33:53.902193] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:53.902295] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:53.902794] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:53.943725] [DEBUG] [LOCAL ] AVK: Loaded 18602 existing records from primary storage. [2025-10-14T22:33:53.944164] [DEBUG] [LOCAL ] AVD: Loaded 21954 existing records from primary storage. [2025-10-14T22:33:53.944402] [INFO ] [MAIN ] AVK: Loaded 18602 primary data records. [2025-10-14T22:33:53.944509] [INFO ] [MAIN ] AVD: Loaded 21954 primary data records. [2025-10-14T22:33:54.027301] [DEBUG] [LOCAL ] AVNS: Loaded 33614 existing records from primary storage. [2025-10-14T22:33:54.076198] [INFO ] [MAIN ] AVNS: Loaded 33614 primary data records. [2025-10-14T22:33:54.902002] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:54.901579] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:54.910931] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 21954 primary records. [2025-10-14T22:33:54.910322] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18602 primary records. [2025-10-14T22:33:54.911067] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-14T22:33:54.915871] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-14T22:33:54.916916] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:54.925215] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33614 primary records. [2025-10-14T22:33:54.933861] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-14T22:33:54.946845] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-14T22:33:54.946951] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-14T22:33:54.949273] [INFO ] [MAIN ] Derivative Progress: 151/1812 symbols completed. AVK took 1.0s. Estimated remaining: 10m 40s. Rate: 155.6 symbols/min [2025-10-14T22:33:54.952178] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-14T22:33:54.967274] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-14T22:33:54.960619] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:54.960503] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-14T22:33:54.967825] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-14T22:33:54.970067] [INFO ] [MAIN ] Derivative Progress: 152/1812 symbols completed. AVD took 1.1s. Estimated remaining: 10m 36s. Rate: 156.6 symbols/min [2025-10-14T22:33:54.972762] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:54.972860] [INFO ] [MAIN ] Derivative Progress: 153/1812 symbols completed. AVNS took 1.1s. Estimated remaining: 10m 31s. Rate: 157.6 symbols/min [2025-10-14T22:33:54.973454] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:55.023965] [DEBUG] [LOCAL ] AWF: Loaded 23950 existing records from primary storage. [2025-10-14T22:33:55.024129] [INFO ] [MAIN ] AWF: Loaded 23950 primary data records. [2025-10-14T22:33:55.139418] [DEBUG] [LOCAL ] AVNT: Loaded 39087 existing records from primary storage. [2025-10-14T22:33:55.153593] [INFO ] [MAIN ] AVNT: Loaded 39087 primary data records. [2025-10-14T22:33:55.164976] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-14T22:33:55.175464] [INFO ] [MAIN ] AVTR: Loaded 53571 primary data records. [2025-10-14T22:33:56.024578] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:56.024944] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:56.025892] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 23950 primary records. [2025-10-14T22:33:56.026094] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-14T22:33:56.026879] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53571 primary records. [2025-10-14T22:33:56.039016] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-14T22:33:56.040684] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:56.041476] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39087 primary records. [2025-10-14T22:33:56.048889] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-14T22:33:56.073775] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-14T22:33:56.076403] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-14T22:33:56.084581] [INFO ] [MAIN ] Derivative Progress: 154/1812 symbols completed. AWF took 1.1s. Estimated remaining: 10m 39s. Rate: 155.7 symbols/min [2025-10-14T22:33:56.085277] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:56.086453] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-14T22:33:56.089307] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-14T22:33:56.092510] [INFO ] [MAIN ] Derivative Progress: 155/1812 symbols completed. AVNT took 1.1s. Estimated remaining: 10m 35s. Rate: 156.7 symbols/min [2025-10-14T22:33:56.093879] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:56.094976] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-14T22:33:56.095052] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-14T22:33:56.097633] [INFO ] [MAIN ] Derivative Progress: 156/1812 symbols completed. AVTR took 1.1s. Estimated remaining: 10m 30s. Rate: 157.7 symbols/min [2025-10-14T22:33:56.098100] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:56.128632] [DEBUG] [LOCAL ] AWP: Loaded 21577 existing records from primary storage. [2025-10-14T22:33:56.136405] [INFO ] [MAIN ] AWP: Loaded 21577 primary data records. [2025-10-14T22:33:56.148330] [DEBUG] [LOCAL ] AWI: Loaded 25384 existing records from primary storage. [2025-10-14T22:33:56.158495] [INFO ] [MAIN ] AWI: Loaded 25384 primary data records. [2025-10-14T22:33:56.645360] [DEBUG] [LOCAL ] AWK: Loaded 48593 existing records from primary storage. [2025-10-14T22:33:56.753517] [INFO ] [MAIN ] AWK: Loaded 48593 primary data records. [2025-10-14T22:33:57.103451] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:57.104713] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21577 primary records. [2025-10-14T22:33:57.104945] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-14T22:33:57.119194] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:57.120766] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25384 primary records. [2025-10-14T22:33:57.131488] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-14T22:33:57.151922] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-10-14T22:33:57.152084] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-14T22:33:57.154622] [INFO ] [MAIN ] Derivative Progress: 157/1812 symbols completed. AWI took 1.1s. Estimated remaining: 10m 37s. Rate: 155.9 symbols/min [2025-10-14T22:33:57.155174] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:57.156971] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-14T22:33:57.157124] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-14T22:33:57.159198] [INFO ] [MAIN ] Derivative Progress: 158/1812 symbols completed. AWP took 1.1s. Estimated remaining: 10m 33s. Rate: 156.9 symbols/min [2025-10-14T22:33:57.159588] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:57.178962] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:57.179798] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48593 primary records. [2025-10-14T22:33:57.179938] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-14T22:33:57.203228] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-14T22:33:57.203669] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-14T22:33:57.206056] [INFO ] [MAIN ] Derivative Progress: 159/1812 symbols completed. AWK took 1.1s. Estimated remaining: 10m 29s. Rate: 157.8 symbols/min [2025-10-14T22:33:57.206311] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:57.223680] [DEBUG] [LOCAL ] AWR: Loaded 22835 existing records from primary storage. [2025-10-14T22:33:57.223985] [INFO ] [MAIN ] AWR: Loaded 22835 primary data records. [2025-10-14T22:33:57.330330] [DEBUG] [LOCAL ] AX: Loaded 28003 existing records from primary storage. [2025-10-14T22:33:57.350982] [INFO ] [MAIN ] AX: Loaded 28003 primary data records. [2025-10-14T22:33:57.761027] [DEBUG] [LOCAL ] AXL: Loaded 50552 existing records from primary storage. [2025-10-14T22:33:57.780689] [INFO ] [MAIN ] AXL: Loaded 50552 primary data records. [2025-10-14T22:33:58.268962] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:58.283865] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22835 primary records. [2025-10-14T22:33:58.285024] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-14T22:33:58.285408] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:58.287480] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28003 primary records. [2025-10-14T22:33:58.287740] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-14T22:33:58.305212] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-14T22:33:58.312621] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-14T22:33:58.315458] [INFO ] [MAIN ] Derivative Progress: 160/1812 symbols completed. AWR took 1.2s. Estimated remaining: 10m 36s. Rate: 155.9 symbols/min [2025-10-14T22:33:58.322223] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:58.325614] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-14T22:33:58.325982] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-14T22:33:58.328680] [INFO ] [MAIN ] Derivative Progress: 161/1812 symbols completed. AX took 1.2s. Estimated remaining: 10m 32s. Rate: 156.8 symbols/min [2025-10-14T22:33:58.330961] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:58.346584] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:58.348365] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50552 primary records. [2025-10-14T22:33:58.348481] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-14T22:33:58.360624] [DEBUG] [LOCAL ] AXR: Loaded 2948 existing records from primary storage. [2025-10-14T22:33:58.360906] [INFO ] [MAIN ] AXR: Loaded 2948 primary data records. [2025-10-14T22:33:58.401514] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-14T22:33:58.406986] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-14T22:33:58.427815] [INFO ] [MAIN ] Derivative Progress: 162/1812 symbols completed. AXL took 1.2s. Estimated remaining: 10m 28s. Rate: 157.6 symbols/min [2025-10-14T22:33:58.453864] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:58.713921] [DEBUG] [LOCAL ] AXP: Loaded 53167 existing records from primary storage. [2025-10-14T22:33:58.714531] [INFO ] [MAIN ] AXP: Loaded 53167 primary data records. [2025-10-14T22:33:58.821127] [DEBUG] [LOCAL ] AXS: Loaded 38625 existing records from primary storage. [2025-10-14T22:33:58.843904] [INFO ] [MAIN ] AXS: Loaded 38625 primary data records. [2025-10-14T22:33:59.162553] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:59.169549] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 2948 primary records. [2025-10-14T22:33:59.400453] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-14T22:33:59.430506] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-10-14T22:33:59.430823] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-14T22:33:59.433033] [INFO ] [MAIN ] Derivative Progress: 163/1812 symbols completed. AXR took 1.1s. Estimated remaining: 10m 34s. Rate: 156.0 symbols/min [2025-10-14T22:33:59.452135] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:59.453020] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53167 primary records. [2025-10-14T22:33:59.453178] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-14T22:33:59.469574] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-14T22:33:59.469813] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-14T22:33:59.474279] [INFO ] [MAIN ] Derivative Progress: 164/1812 symbols completed. AXP took 1.2s. Estimated remaining: 10m 30s. Rate: 156.8 symbols/min [2025-10-14T22:33:59.487753] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:33:59.488331] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38625 primary records. [2025-10-14T22:33:59.488392] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-14T22:33:59.503077] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-14T22:33:59.503136] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-14T22:33:59.505280] [INFO ] [MAIN ] Derivative Progress: 165/1812 symbols completed. AXS took 1.1s. Estimated remaining: 10m 27s. Rate: 157.7 symbols/min [2025-10-14T22:33:59.505629] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:59.505783] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:59.505881] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:33:59.529014] [DEBUG] [LOCAL ] AZO: Loaded 11054 existing records from primary storage. [2025-10-14T22:33:59.529209] [INFO ] [MAIN ] AZO: Loaded 11054 primary data records. [2025-10-14T22:33:59.616723] [DEBUG] [LOCAL ] AYI: Loaded 25008 existing records from primary storage. [2025-10-14T22:33:59.622165] [INFO ] [MAIN ] AYI: Loaded 25008 primary data records. [2025-10-14T22:34:00.044827] [DEBUG] [LOCAL ] AXTA: Loaded 52240 existing records from primary storage. [2025-10-14T22:34:00.070280] [INFO ] [MAIN ] AXTA: Loaded 52240 primary data records. [2025-10-14T22:34:00.551350] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:00.554141] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11054 primary records. [2025-10-14T22:34:00.555309] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-14T22:34:00.587425] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-14T22:34:00.588028] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-14T22:34:00.587897] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:00.590565] [INFO ] [MAIN ] Derivative Progress: 166/1812 symbols completed. AZO took 1.1s. Estimated remaining: 10m 33s. Rate: 156.0 symbols/min [2025-10-14T22:34:00.591762] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25008 primary records. [2025-10-14T22:34:00.590943] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:00.592411] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-14T22:34:00.609207] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-10-14T22:34:00.609525] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-14T22:34:00.611680] [INFO ] [MAIN ] Derivative Progress: 167/1812 symbols completed. AYI took 1.1s. Estimated remaining: 10m 29s. Rate: 156.9 symbols/min [2025-10-14T22:34:00.612138] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:00.634452] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:00.635456] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52240 primary records. [2025-10-14T22:34:00.635594] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-14T22:34:00.658961] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-14T22:34:00.660373] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-14T22:34:00.661221] [DEBUG] [LOCAL ] AZZ: Loaded 22646 existing records from primary storage. [2025-10-14T22:34:00.663951] [INFO ] [MAIN ] AZZ: Loaded 22646 primary data records. [2025-10-14T22:34:00.663799] [INFO ] [MAIN ] Derivative Progress: 168/1812 symbols completed. AXTA took 1.2s. Estimated remaining: 10m 26s. Rate: 157.7 symbols/min [2025-10-14T22:34:00.664332] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:00.914459] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-14T22:34:00.915393] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-14T22:34:01.228953] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-14T22:34:01.279035] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-14T22:34:01.791616] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:01.792709] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22646 primary records. [2025-10-14T22:34:01.792977] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-14T22:34:01.815380] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-14T22:34:01.815808] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-14T22:34:01.818050] [INFO ] [MAIN ] Derivative Progress: 169/1812 symbols completed. AZZ took 1.2s. Estimated remaining: 10m 33s. Rate: 155.8 symbols/min [2025-10-14T22:34:01.831231] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:01.832822] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:01.834088] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-14T22:34:01.834183] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-14T22:34:01.852154] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-14T22:34:01.852526] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-14T22:34:01.854864] [INFO ] [MAIN ] Derivative Progress: 170/1812 symbols completed. BA took 1.2s. Estimated remaining: 10m 29s. Rate: 156.6 symbols/min [2025-10-14T22:34:01.855025] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:01.873957] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:01.874756] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-14T22:34:01.874932] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-14T22:34:01.893133] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-14T22:34:01.893690] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-14T22:34:01.896379] [INFO ] [MAIN ] Derivative Progress: 171/1812 symbols completed. BABA took 1.2s. Estimated remaining: 10m 25s. Rate: 157.5 symbols/min [2025-10-14T22:34:01.896896] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:01.960053] [DEBUG] [LOCAL ] BAH: Loaded 51734 existing records from primary storage. [2025-10-14T22:34:01.960370] [INFO ] [MAIN ] BAH: Loaded 51734 primary data records. [2025-10-14T22:34:02.020508] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-14T22:34:02.034756] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-14T22:34:02.128101] [DEBUG] [LOCAL ] BAK: Loaded 39300 existing records from primary storage. [2025-10-14T22:34:02.163826] [INFO ] [MAIN ] BAK: Loaded 39300 primary data records. [2025-10-14T22:34:02.959090] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:02.964611] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:02.965403] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51734 primary records. [2025-10-14T22:34:02.966058] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-14T22:34:02.966231] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-14T22:34:02.966272] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-14T22:34:02.991432] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-14T22:34:02.992379] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-14T22:34:02.998084] [INFO ] [MAIN ] Derivative Progress: 172/1812 symbols completed. BAC took 1.2s. Estimated remaining: 10m 32s. Rate: 155.7 symbols/min [2025-10-14T22:34:02.998476] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:03.004165] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-10-14T22:34:03.005203] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-14T22:34:03.007829] [INFO ] [MAIN ] Derivative Progress: 173/1812 symbols completed. BAH took 1.2s. Estimated remaining: 10m 28s. Rate: 156.6 symbols/min [2025-10-14T22:34:03.008070] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:03.022415] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:03.023325] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39300 primary records. [2025-10-14T22:34:03.023543] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-14T22:34:03.042455] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-14T22:34:03.042723] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-14T22:34:03.046012] [INFO ] [MAIN ] Derivative Progress: 174/1812 symbols completed. BAK took 1.1s. Estimated remaining: 10m 24s. Rate: 157.4 symbols/min [2025-10-14T22:34:03.046422] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:03.096512] [DEBUG] [LOCAL ] BALL: Loaded 51865 existing records from primary storage. [2025-10-14T22:34:03.097290] [INFO ] [MAIN ] BALL: Loaded 51865 primary data records. [2025-10-14T22:34:03.188199] [DEBUG] [LOCAL ] BAM: Loaded 52087 existing records from primary storage. [2025-10-14T22:34:03.219019] [INFO ] [MAIN ] BAM: Loaded 52087 primary data records. [2025-10-14T22:34:03.411013] [DEBUG] [LOCAL ] BANC: Loaded 51342 existing records from primary storage. [2025-10-14T22:34:03.558077] [INFO ] [MAIN ] BANC: Loaded 51342 primary data records. [2025-10-14T22:34:04.191985] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:04.192863] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51865 primary records. [2025-10-14T22:34:04.193114] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-14T22:34:04.211449] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-14T22:34:04.211759] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-14T22:34:04.213762] [INFO ] [MAIN ] Derivative Progress: 175/1812 symbols completed. BALL took 1.2s. Estimated remaining: 10m 31s. Rate: 155.6 symbols/min [2025-10-14T22:34:04.215232] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:04.232511] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:04.233401] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52087 primary records. [2025-10-14T22:34:04.233761] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-14T22:34:04.253545] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-14T22:34:04.254551] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-14T22:34:04.257329] [INFO ] [MAIN ] Derivative Progress: 176/1812 symbols completed. BAM took 1.2s. Estimated remaining: 10m 28s. Rate: 156.4 symbols/min [2025-10-14T22:34:04.257673] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:04.271288] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:04.272073] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51342 primary records. [2025-10-14T22:34:04.272265] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-14T22:34:04.303429] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-14T22:34:04.312732] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-14T22:34:04.315150] [INFO ] [MAIN ] Derivative Progress: 177/1812 symbols completed. BANC took 1.3s. Estimated remaining: 10m 24s. Rate: 157.1 symbols/min [2025-10-14T22:34:04.315362] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:04.316995] [DEBUG] [LOCAL ] BAP: Loaded 25720 existing records from primary storage. [2025-10-14T22:34:04.317242] [INFO ] [MAIN ] BAP: Loaded 25720 primary data records. [2025-10-14T22:34:04.504674] [DEBUG] [LOCAL ] BARK: Loaded 38229 existing records from primary storage. [2025-10-14T22:34:04.572352] [INFO ] [MAIN ] BARK: Loaded 38229 primary data records. [2025-10-14T22:34:04.839405] [DEBUG] [LOCAL ] BAX: Loaded 53525 existing records from primary storage. [2025-10-14T22:34:04.862447] [INFO ] [MAIN ] BAX: Loaded 53525 primary data records. [2025-10-14T22:34:05.352585] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:05.354099] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 25720 primary records. [2025-10-14T22:34:05.354201] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-14T22:34:05.372610] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-14T22:34:05.374103] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-14T22:34:05.376835] [INFO ] [MAIN ] Derivative Progress: 178/1812 symbols completed. BAP took 1.2s. Estimated remaining: 10m 30s. Rate: 155.6 symbols/min [2025-10-14T22:34:05.393502] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:05.394228] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38229 primary records. [2025-10-14T22:34:05.394367] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-14T22:34:05.421482] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:05.424363] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53525 primary records. [2025-10-14T22:34:05.425268] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-14T22:34:05.424450] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-14T22:34:05.425400] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-14T22:34:05.428623] [INFO ] [MAIN ] Derivative Progress: 179/1812 symbols completed. BARK took 1.2s. Estimated remaining: 10m 27s. Rate: 156.3 symbols/min [2025-10-14T22:34:05.444501] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-14T22:34:05.444631] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-14T22:34:05.446773] [INFO ] [MAIN ] Derivative Progress: 180/1812 symbols completed. BAX took 1.1s. Estimated remaining: 10m 23s. Rate: 157.2 symbols/min [2025-10-14T22:34:05.447254] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:05.447193] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:05.447740] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:05.514400] [DEBUG] [LOCAL ] BBAR: Loaded 42247 existing records from primary storage. [2025-10-14T22:34:05.529717] [INFO ] [MAIN ] BBAR: Loaded 42247 primary data records. [2025-10-14T22:34:05.530835] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-14T22:34:05.581552] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-14T22:34:05.588965] [DEBUG] [LOCAL ] BB: Loaded 52924 existing records from primary storage. [2025-10-14T22:34:05.614901] [INFO ] [MAIN ] BB: Loaded 52924 primary data records. [2025-10-14T22:34:06.577168] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:06.591528] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 42247 primary records. [2025-10-14T22:34:06.592602] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:06.592902] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-14T22:34:06.595970] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52924 primary records. [2025-10-14T22:34:06.604489] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-14T22:34:06.623511] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-14T22:34:06.627684] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-14T22:34:06.629698] [INFO ] [MAIN ] Derivative Progress: 181/1812 symbols completed. BBAR took 1.2s. Estimated remaining: 10m 30s. Rate: 155.4 symbols/min [2025-10-14T22:34:06.640767] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-14T22:34:06.640964] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:06.646081] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-14T22:34:06.647102] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:06.650919] [INFO ] [MAIN ] Derivative Progress: 182/1812 symbols completed. BB took 1.2s. Estimated remaining: 10m 26s. Rate: 156.2 symbols/min [2025-10-14T22:34:06.651162] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:06.652609] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-14T22:34:06.652850] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-14T22:34:06.669864] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-14T22:34:06.670235] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-14T22:34:06.672383] [INFO ] [MAIN ] Derivative Progress: 183/1812 symbols completed. BBAI took 1.2s. Estimated remaining: 10m 23s. Rate: 157.0 symbols/min [2025-10-14T22:34:06.672731] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:06.691702] [DEBUG] [LOCAL ] BBDO: Loaded 5044 existing records from primary storage. [2025-10-14T22:34:06.692063] [INFO ] [MAIN ] BBDO: Loaded 5044 primary data records. [2025-10-14T22:34:06.872917] [DEBUG] [LOCAL ] BBDC: Loaded 33129 existing records from primary storage. [2025-10-14T22:34:06.897477] [INFO ] [MAIN ] BBDC: Loaded 33129 primary data records. [2025-10-14T22:34:07.029169] [DEBUG] [LOCAL ] BBD: Loaded 53260 existing records from primary storage. [2025-10-14T22:34:07.065219] [INFO ] [MAIN ] BBD: Loaded 53260 primary data records. [2025-10-14T22:34:07.683405] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:07.684331] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5044 primary records. [2025-10-14T22:34:07.684618] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-14T22:34:07.699506] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-14T22:34:07.699777] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-14T22:34:07.701846] [INFO ] [MAIN ] Derivative Progress: 184/1812 symbols completed. BBDO took 1.0s. Estimated remaining: 10m 28s. Rate: 155.6 symbols/min [2025-10-14T22:34:07.702181] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:07.722175] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:07.735219] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33129 primary records. [2025-10-14T22:34:07.739633] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-14T22:34:07.740442] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:07.741266] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53260 primary records. [2025-10-14T22:34:07.741677] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-14T22:34:07.769801] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-14T22:34:07.771184] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-14T22:34:07.773659] [INFO ] [MAIN ] Derivative Progress: 185/1812 symbols completed. BBDC took 1.1s. Estimated remaining: 10m 25s. Rate: 156.3 symbols/min [2025-10-14T22:34:07.776714] [DEBUG] [LOCAL ] BBN: Loaded 18085 existing records from primary storage. [2025-10-14T22:34:07.780249] [INFO ] [MAIN ] BBN: Loaded 18085 primary data records. [2025-10-14T22:34:07.786494] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-14T22:34:07.780918] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:07.792503] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-14T22:34:07.794505] [INFO ] [MAIN ] Derivative Progress: 186/1812 symbols completed. BBD took 1.2s. Estimated remaining: 10m 21s. Rate: 157.0 symbols/min [2025-10-14T22:34:07.827142] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:07.980154] [DEBUG] [LOCAL ] BBUC: Loaded 13635 existing records from primary storage. [2025-10-14T22:34:08.103784] [INFO ] [MAIN ] BBUC: Loaded 13635 primary data records. [2025-10-14T22:34:08.288758] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-14T22:34:08.306367] [INFO ] [MAIN ] BBVA: Loaded 49107 primary data records. [2025-10-14T22:34:08.682897] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:08.800186] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18085 primary records. [2025-10-14T22:34:08.800470] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-14T22:34:08.828556] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-14T22:34:08.828755] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-14T22:34:08.831417] [INFO ] [MAIN ] Derivative Progress: 187/1812 symbols completed. BBN took 1.1s. Estimated remaining: 10m 27s. Rate: 155.6 symbols/min [2025-10-14T22:34:08.831637] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:08.849351] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:08.850114] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13635 primary records. [2025-10-14T22:34:08.850238] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-14T22:34:08.866853] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-14T22:34:08.867291] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-14T22:34:08.869524] [INFO ] [MAIN ] Derivative Progress: 188/1812 symbols completed. BBUC took 1.1s. Estimated remaining: 10m 23s. Rate: 156.4 symbols/min [2025-10-14T22:34:08.869715] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:08.895436] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:08.896290] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49107 primary records. [2025-10-14T22:34:08.896362] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-14T22:34:08.928514] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-14T22:34:08.927710] [DEBUG] [LOCAL ] BBW: Loaded 27403 existing records from primary storage. [2025-10-14T22:34:08.928789] [INFO ] [MAIN ] BBW: Loaded 27403 primary data records. [2025-10-14T22:34:08.928890] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-14T22:34:08.931034] [INFO ] [MAIN ] Derivative Progress: 189/1812 symbols completed. BBVA took 1.1s. Estimated remaining: 10m 20s. Rate: 157.1 symbols/min [2025-10-14T22:34:08.960959] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:09.156525] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-14T22:34:09.161435] [INFO ] [MAIN ] BBWI: Loaded 53584 primary data records. [2025-10-14T22:34:09.414806] [DEBUG] [LOCAL ] BC: Loaded 44123 existing records from primary storage. [2025-10-14T22:34:09.430832] [INFO ] [MAIN ] BC: Loaded 44123 primary data records. [2025-10-14T22:34:09.958435] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:09.959794] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 27403 primary records. [2025-10-14T22:34:09.959896] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-14T22:34:09.977327] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-14T22:34:09.977581] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-14T22:34:09.979599] [INFO ] [MAIN ] Derivative Progress: 190/1812 symbols completed. BBW took 1.1s. Estimated remaining: 10m 25s. Rate: 155.6 symbols/min [2025-10-14T22:34:09.979875] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:09.997418] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:09.999501] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53584 primary records. [2025-10-14T22:34:09.999605] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-14T22:34:10.013118] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:10.022006] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44123 primary records. [2025-10-14T22:34:10.024875] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-14T22:34:10.051196] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-14T22:34:10.052280] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-14T22:34:10.055310] [INFO ] [MAIN ] Derivative Progress: 191/1812 symbols completed. BBWI took 1.2s. Estimated remaining: 10m 22s. Rate: 156.3 symbols/min [2025-10-14T22:34:10.055543] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-14T22:34:10.055996] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-14T22:34:10.056184] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:10.066986] [INFO ] [MAIN ] Derivative Progress: 192/1812 symbols completed. BC took 1.1s. Estimated remaining: 10m 19s. Rate: 157.1 symbols/min [2025-10-14T22:34:10.068455] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:10.069570] [DEBUG] [LOCAL ] BCAT: Loaded 34173 existing records from primary storage. [2025-10-14T22:34:10.069830] [INFO ] [MAIN ] BCAT: Loaded 34173 primary data records. [2025-10-14T22:34:10.365094] [DEBUG] [LOCAL ] BCC: Loaded 28478 existing records from primary storage. [2025-10-14T22:34:10.378540] [INFO ] [MAIN ] BCC: Loaded 28478 primary data records. [2025-10-14T22:34:10.515603] [DEBUG] [LOCAL ] BCE: Loaded 52241 existing records from primary storage. [2025-10-14T22:34:10.564750] [INFO ] [MAIN ] BCE: Loaded 52241 primary data records. [2025-10-14T22:34:11.013113] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:11.014388] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34173 primary records. [2025-10-14T22:34:11.014546] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-14T22:34:11.036807] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-14T22:34:11.037337] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-14T22:34:11.039426] [INFO ] [MAIN ] Derivative Progress: 193/1812 symbols completed. BCAT took 1.1s. Estimated remaining: 10m 23s. Rate: 155.8 symbols/min [2025-10-14T22:34:11.053585] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:11.054306] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28478 primary records. [2025-10-14T22:34:11.054468] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-14T22:34:11.074161] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-10-14T22:34:11.074432] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-14T22:34:11.076526] [INFO ] [MAIN ] Derivative Progress: 194/1812 symbols completed. BCC took 1.0s. Estimated remaining: 10m 20s. Rate: 156.6 symbols/min [2025-10-14T22:34:11.089191] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:11.089789] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52241 primary records. [2025-10-14T22:34:11.089893] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-14T22:34:11.106261] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-14T22:34:11.106398] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-14T22:34:11.108699] [INFO ] [MAIN ] Derivative Progress: 195/1812 symbols completed. BCE took 1.0s. Estimated remaining: 10m 17s. Rate: 157.3 symbols/min [2025-10-14T22:34:11.109296] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:11.109234] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:11.110177] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:11.144349] [DEBUG] [LOCAL ] BCO: Loaded 25488 existing records from primary storage. [2025-10-14T22:34:11.144538] [INFO ] [MAIN ] BCO: Loaded 25488 primary data records. [2025-10-14T22:34:11.280716] [DEBUG] [LOCAL ] BCH: Loaded 30171 existing records from primary storage. [2025-10-14T22:34:11.280972] [INFO ] [MAIN ] BCH: Loaded 30171 primary data records. [2025-10-14T22:34:11.493187] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-14T22:34:11.610086] [INFO ] [MAIN ] BCS: Loaded 53441 primary data records. [2025-10-14T22:34:12.179442] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:12.180803] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 25488 primary records. [2025-10-14T22:34:12.181061] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-14T22:34:12.214394] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:12.215944] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-14T22:34:12.216825] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-14T22:34:12.216678] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 30171 primary records. [2025-10-14T22:34:12.218767] [INFO ] [MAIN ] Derivative Progress: 196/1812 symbols completed. BCO took 1.1s. Estimated remaining: 10m 22s. Rate: 155.8 symbols/min [2025-10-14T22:34:12.218973] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-14T22:34:12.218922] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:12.246476] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-14T22:34:12.251496] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-14T22:34:12.253969] [INFO ] [MAIN ] Derivative Progress: 197/1812 symbols completed. BCH took 1.1s. Estimated remaining: 10m 19s. Rate: 156.5 symbols/min [2025-10-14T22:34:12.254168] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:12.251734] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:12.255455] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53441 primary records. [2025-10-14T22:34:12.255534] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-14T22:34:12.283570] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-14T22:34:12.283674] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-14T22:34:12.286697] [INFO ] [MAIN ] Derivative Progress: 198/1812 symbols completed. BCS took 1.2s. Estimated remaining: 10m 16s. Rate: 157.2 symbols/min [2025-10-14T22:34:12.286855] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:12.304560] [DEBUG] [LOCAL ] BCX: Loaded 21952 existing records from primary storage. [2025-10-14T22:34:12.304232] [DEBUG] [LOCAL ] BCSF: Loaded 28261 existing records from primary storage. [2025-10-14T22:34:12.304757] [INFO ] [MAIN ] BCSF: Loaded 28261 primary data records. [2025-10-14T22:34:12.304849] [INFO ] [MAIN ] BCX: Loaded 21952 primary data records. [2025-10-14T22:34:12.662526] [DEBUG] [LOCAL ] BDC: Loaded 24554 existing records from primary storage. [2025-10-14T22:34:12.790912] [INFO ] [MAIN ] BDC: Loaded 24554 primary data records. [2025-10-14T22:34:13.265752] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:13.271786] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:13.273144] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 28261 primary records. [2025-10-14T22:34:13.274345] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21952 primary records. [2025-10-14T22:34:13.274860] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-14T22:34:13.274441] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-14T22:34:13.308892] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-14T22:34:13.310403] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-14T22:34:13.313380] [INFO ] [MAIN ] Derivative Progress: 199/1812 symbols completed. BCSF took 1.1s. Estimated remaining: 10m 21s. Rate: 155.9 symbols/min [2025-10-14T22:34:13.313939] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:13.317032] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-14T22:34:13.317531] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-14T22:34:13.320915] [INFO ] [MAIN ] Derivative Progress: 200/1812 symbols completed. BCX took 1.1s. Estimated remaining: 10m 17s. Rate: 156.7 symbols/min [2025-10-14T22:34:13.321740] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:13.339143] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:13.339907] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24554 primary records. [2025-10-14T22:34:13.340108] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-14T22:34:13.369970] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-14T22:34:13.370087] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-14T22:34:13.372428] [INFO ] [MAIN ] Derivative Progress: 201/1812 symbols completed. BDC took 1.1s. Estimated remaining: 10m 14s. Rate: 157.4 symbols/min [2025-10-14T22:34:13.372847] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:13.394698] [DEBUG] [LOCAL ] BDJ: Loaded 29403 existing records from primary storage. [2025-10-14T22:34:13.394974] [INFO ] [MAIN ] BDJ: Loaded 29403 primary data records. [2025-10-14T22:34:13.594909] [DEBUG] [LOCAL ] BDN: Loaded 47627 existing records from primary storage. [2025-10-14T22:34:13.704436] [INFO ] [MAIN ] BDN: Loaded 47627 primary data records. [2025-10-14T22:34:13.857326] [DEBUG] [LOCAL ] BDX: Loaded 52180 existing records from primary storage. [2025-10-14T22:34:13.857568] [INFO ] [MAIN ] BDX: Loaded 52180 primary data records. [2025-10-14T22:34:14.418822] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:14.419627] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29403 primary records. [2025-10-14T22:34:14.419758] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-14T22:34:14.443049] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-14T22:34:14.443480] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-14T22:34:14.445837] [INFO ] [MAIN ] Derivative Progress: 202/1812 symbols completed. BDJ took 1.1s. Estimated remaining: 10m 19s. Rate: 156.0 symbols/min [2025-10-14T22:34:14.445994] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:14.464546] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:14.465528] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47627 primary records. [2025-10-14T22:34:14.465961] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-14T22:34:14.485896] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-14T22:34:14.485988] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-14T22:34:14.488285] [INFO ] [MAIN ] Derivative Progress: 203/1812 symbols completed. BDN took 1.2s. Estimated remaining: 10m 16s. Rate: 156.6 symbols/min [2025-10-14T22:34:14.488742] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:14.503875] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:14.504544] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52180 primary records. [2025-10-14T22:34:14.504804] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-14T22:34:14.534925] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-14T22:34:14.535103] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-14T22:34:14.538186] [INFO ] [MAIN ] Derivative Progress: 204/1812 symbols completed. BDX took 1.2s. Estimated remaining: 10m 13s. Rate: 157.3 symbols/min [2025-10-14T22:34:14.538480] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:14.571951] [DEBUG] [LOCAL ] BEKE: Loaded 53218 existing records from primary storage. [2025-10-14T22:34:14.572283] [INFO ] [MAIN ] BEKE: Loaded 53218 primary data records. [2025-10-14T22:34:14.702562] [DEBUG] [LOCAL ] BEN: Loaded 53122 existing records from primary storage. [2025-10-14T22:34:14.708508] [INFO ] [MAIN ] BEN: Loaded 53122 primary data records. [2025-10-14T22:34:14.853742] [DEBUG] [LOCAL ] BEP: Loaded 38935 existing records from primary storage. [2025-10-14T22:34:14.987579] [INFO ] [MAIN ] BEP: Loaded 38935 primary data records. [2025-10-14T22:34:15.525797] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:15.526986] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53218 primary records. [2025-10-14T22:34:15.528175] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-14T22:34:15.559010] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:15.561676] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-14T22:34:15.560666] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53122 primary records. [2025-10-14T22:34:15.561762] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-14T22:34:15.563889] [INFO ] [MAIN ] Derivative Progress: 205/1812 symbols completed. BEKE took 1.1s. Estimated remaining: 10m 18s. Rate: 156.0 symbols/min [2025-10-14T22:34:15.564401] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-14T22:34:15.564708] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:15.583042] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-14T22:34:15.584796] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-14T22:34:15.587894] [INFO ] [MAIN ] Derivative Progress: 206/1812 symbols completed. BEN took 1.1s. Estimated remaining: 10m 15s. Rate: 156.7 symbols/min [2025-10-14T22:34:15.588112] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:15.604674] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:15.607151] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38935 primary records. [2025-10-14T22:34:15.607407] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-14T22:34:15.611832] [DEBUG] [LOCAL ] BEPH: Loaded 5235 existing records from primary storage. [2025-10-14T22:34:15.612309] [INFO ] [MAIN ] BEPH: Loaded 5235 primary data records. [2025-10-14T22:34:15.764486] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-14T22:34:15.790098] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-14T22:34:15.829163] [INFO ] [MAIN ] Derivative Progress: 207/1812 symbols completed. BEP took 1.3s. Estimated remaining: 10m 13s. Rate: 157.0 symbols/min [2025-10-14T22:34:15.850318] [DEBUG] [LOCAL ] BEPC: Loaded 46493 existing records from primary storage. [2025-10-14T22:34:15.935795] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:15.993188] [INFO ] [MAIN ] BEPC: Loaded 46493 primary data records. [2025-10-14T22:34:16.082018] [DEBUG] [LOCAL ] BEPI: Loaded 3611 existing records from primary storage. [2025-10-14T22:34:16.105637] [INFO ] [MAIN ] BEPI: Loaded 3611 primary data records. [2025-10-14T22:34:16.617233] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:16.618460] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5235 primary records. [2025-10-14T22:34:16.618679] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-14T22:34:16.634387] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-14T22:34:16.634583] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-14T22:34:16.636627] [INFO ] [MAIN ] Derivative Progress: 208/1812 symbols completed. BEPH took 1.0s. Estimated remaining: 10m 16s. Rate: 156.2 symbols/min [2025-10-14T22:34:16.654295] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:16.655038] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46493 primary records. [2025-10-14T22:34:16.655179] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-14T22:34:16.672865] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-14T22:34:16.673047] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-14T22:34:16.675386] [INFO ] [MAIN ] Derivative Progress: 209/1812 symbols completed. BEPC took 1.1s. Estimated remaining: 10m 13s. Rate: 156.9 symbols/min [2025-10-14T22:34:16.688325] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:16.688921] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3611 primary records. [2025-10-14T22:34:16.688981] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-14T22:34:16.702252] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-14T22:34:16.702307] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-14T22:34:16.704306] [INFO ] [MAIN ] Derivative Progress: 210/1812 symbols completed. BEPI took 0.8s. Estimated remaining: 10m 10s. Rate: 157.6 symbols/min [2025-10-14T22:34:16.704774] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:16.704856] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:16.704909] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:16.710939] [DEBUG] [LOCAL ] BEPJ: Loaded 3116 existing records from primary storage. [2025-10-14T22:34:16.711138] [INFO ] [MAIN ] BEPJ: Loaded 3116 primary data records. [2025-10-14T22:34:16.770290] [DEBUG] [LOCAL ] BFS: Loaded 9545 existing records from primary storage. [2025-10-14T22:34:16.794194] [INFO ] [MAIN ] BFS: Loaded 9545 primary data records. [2025-10-14T22:34:17.011182] [DEBUG] [LOCAL ] BFAM: Loaded 33752 existing records from primary storage. [2025-10-14T22:34:17.165876] [INFO ] [MAIN ] BFAM: Loaded 33752 primary data records. [2025-10-14T22:34:17.768492] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:17.770129] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3116 primary records. [2025-10-14T22:34:17.771507] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-14T22:34:17.799096] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:17.800741] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9545 primary records. [2025-10-14T22:34:17.801942] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-14T22:34:17.813694] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-10-14T22:34:17.820820] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-14T22:34:17.820945] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-14T22:34:17.823075] [INFO ] [MAIN ] Derivative Progress: 211/1812 symbols completed. BEPJ took 1.1s. Estimated remaining: 10m 15s. Rate: 156.1 symbols/min [2025-10-14T22:34:17.823261] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:17.823665] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-14T22:34:17.826403] [INFO ] [MAIN ] Derivative Progress: 212/1812 symbols completed. BFS took 1.1s. Estimated remaining: 10m 12s. Rate: 156.9 symbols/min [2025-10-14T22:34:17.826897] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:17.844006] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:17.844896] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33752 primary records. [2025-10-14T22:34:17.845003] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-14T22:34:17.864406] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-14T22:34:17.864735] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-14T22:34:17.866866] [INFO ] [MAIN ] Derivative Progress: 213/1812 symbols completed. BFAM took 1.2s. Estimated remaining: 10m 9s. Rate: 157.5 symbols/min [2025-10-14T22:34:17.867059] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:17.872572] [DEBUG] [LOCAL ] BFZ: Loaded 11900 existing records from primary storage. [2025-10-14T22:34:17.872858] [INFO ] [MAIN ] BFZ: Loaded 11900 primary data records. [2025-10-14T22:34:17.988512] [DEBUG] [LOCAL ] BGB: Loaded 17991 existing records from primary storage. [2025-10-14T22:34:17.994374] [INFO ] [MAIN ] BGB: Loaded 17991 primary data records. [2025-10-14T22:34:18.319100] [DEBUG] [LOCAL ] BG: Loaded 50480 existing records from primary storage. [2025-10-14T22:34:18.325935] [INFO ] [MAIN ] BG: Loaded 50480 primary data records. [2025-10-14T22:34:18.839945] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:18.841017] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11900 primary records. [2025-10-14T22:34:18.844025] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-14T22:34:18.870339] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:18.871746] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17991 primary records. [2025-10-14T22:34:18.872008] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-14T22:34:18.890806] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-14T22:34:18.890949] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-14T22:34:18.893525] [INFO ] [MAIN ] Derivative Progress: 214/1812 symbols completed. BGB took 1.0s. Estimated remaining: 10m 14s. Rate: 156.3 symbols/min [2025-10-14T22:34:18.893724] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:18.895339] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-14T22:34:18.895797] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-14T22:34:18.898089] [INFO ] [MAIN ] Derivative Progress: 215/1812 symbols completed. BFZ took 1.1s. Estimated remaining: 10m 10s. Rate: 157.0 symbols/min [2025-10-14T22:34:18.900274] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:18.915029] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:18.915937] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50480 primary records. [2025-10-14T22:34:18.916139] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-14T22:34:18.942118] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-14T22:34:18.946749] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-14T22:34:18.946620] [DEBUG] [LOCAL ] BGH: Loaded 17259 existing records from primary storage. [2025-10-14T22:34:18.949135] [INFO ] [MAIN ] Derivative Progress: 216/1812 symbols completed. BG took 1.1s. Estimated remaining: 10m 7s. Rate: 157.6 symbols/min [2025-10-14T22:34:18.949458] [INFO ] [MAIN ] BGH: Loaded 17259 primary data records. [2025-10-14T22:34:18.949601] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:18.998677] [DEBUG] [LOCAL ] BGR: Loaded 13590 existing records from primary storage. [2025-10-14T22:34:19.024974] [INFO ] [MAIN ] BGR: Loaded 13590 primary data records. [2025-10-14T22:34:19.475118] [DEBUG] [LOCAL ] BGS: Loaded 50514 existing records from primary storage. [2025-10-14T22:34:19.565733] [INFO ] [MAIN ] BGS: Loaded 50514 primary data records. [2025-10-14T22:34:19.960850] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:19.962166] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17259 primary records. [2025-10-14T22:34:19.962436] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-14T22:34:19.988607] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:19.993549] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13590 primary records. [2025-10-14T22:34:19.993802] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-14T22:34:19.994455] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-14T22:34:19.995085] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-14T22:34:19.997229] [INFO ] [MAIN ] Derivative Progress: 217/1812 symbols completed. BGH took 1.1s. Estimated remaining: 10m 12s. Rate: 156.4 symbols/min [2025-10-14T22:34:19.997484] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:20.014296] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-14T22:34:20.014667] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-14T22:34:20.016969] [INFO ] [MAIN ] Derivative Progress: 218/1812 symbols completed. BGR took 1.1s. Estimated remaining: 10m 9s. Rate: 157.1 symbols/min [2025-10-14T22:34:20.019114] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:20.025264] [DEBUG] [LOCAL ] BGSF: Loaded 7899 existing records from primary storage. [2025-10-14T22:34:20.025617] [INFO ] [MAIN ] BGSF: Loaded 7899 primary data records. [2025-10-14T22:34:20.049764] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:20.059873] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50514 primary records. [2025-10-14T22:34:20.070202] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-14T22:34:20.190202] [DEBUG] [LOCAL ] BGT: Loaded 16483 existing records from primary storage. [2025-10-14T22:34:20.211088] [INFO ] [MAIN ] BGT: Loaded 16483 primary data records. [2025-10-14T22:34:20.397183] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-14T22:34:20.407057] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-14T22:34:20.410034] [INFO ] [MAIN ] Derivative Progress: 219/1812 symbols completed. BGS took 1.5s. Estimated remaining: 10m 9s. Rate: 157.0 symbols/min [2025-10-14T22:34:20.467715] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:20.677978] [DEBUG] [LOCAL ] BGX: Loaded 11165 existing records from primary storage. [2025-10-14T22:34:20.678249] [INFO ] [MAIN ] BGX: Loaded 11165 primary data records. [2025-10-14T22:34:21.008897] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:34:21.010735] [INFO ] [MAIN ] BGSF: Generated 1793 derivative records from 7899 primary records. [2025-10-14T22:34:21.010937] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-14T22:34:21.039091] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1793 records). [2025-10-14T22:34:21.039196] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-14T22:34:21.046065] [INFO ] [MAIN ] Derivative Progress: 220/1812 symbols completed. BGSF took 1.0s. Estimated remaining: 10m 10s. Rate: 156.6 symbols/min [2025-10-14T22:34:21.046716] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:21.046545] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:21.049061] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16483 primary records. [2025-10-14T22:34:21.049409] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-14T22:34:21.073002] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-14T22:34:21.073203] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-14T22:34:21.078084] [INFO ] [MAIN ] Derivative Progress: 221/1812 symbols completed. BGT took 1.1s. Estimated remaining: 10m 7s. Rate: 157.2 symbols/min [2025-10-14T22:34:21.078703] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:21.085985] [DEBUG] [LOCAL ] BGY: Loaded 21940 existing records from primary storage. [2025-10-14T22:34:21.086614] [INFO ] [MAIN ] BGY: Loaded 21940 primary data records. [2025-10-14T22:34:21.143782] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:21.170890] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11165 primary records. [2025-10-14T22:34:21.188459] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-14T22:34:21.257336] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-14T22:34:21.285150] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-14T22:34:21.285057] [DEBUG] [LOCAL ] BH: Loaded 16212 existing records from primary storage. [2025-10-14T22:34:21.315443] [INFO ] [MAIN ] BH: Loaded 16212 primary data records. [2025-10-14T22:34:21.311092] [INFO ] [MAIN ] Derivative Progress: 222/1812 symbols completed. BGX took 0.8s. Estimated remaining: 10m 6s. Rate: 157.5 symbols/min [2025-10-14T22:34:21.419158] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:21.815702] [DEBUG] [LOCAL ] BHC: Loaded 46658 existing records from primary storage. [2025-10-14T22:34:21.829121] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:21.829260] [INFO ] [MAIN ] BHC: Loaded 46658 primary data records. [2025-10-14T22:34:21.830429] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 21940 primary records. [2025-10-14T22:34:21.830531] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-14T22:34:21.929193] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-14T22:34:21.954674] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-14T22:34:21.961064] [INFO ] [MAIN ] Derivative Progress: 223/1812 symbols completed. BGY took 0.9s. Estimated remaining: 10m 7s. Rate: 157.0 symbols/min [2025-10-14T22:34:22.164107] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:22.164857] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 16212 primary records. [2025-10-14T22:34:22.165009] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-14T22:34:22.181810] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-14T22:34:22.182056] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-14T22:34:22.184434] [INFO ] [MAIN ] Derivative Progress: 224/1812 symbols completed. BH took 1.1s. Estimated remaining: 10m 6s. Rate: 157.3 symbols/min [2025-10-14T22:34:22.203505] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:22.204079] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46658 primary records. [2025-10-14T22:34:22.204143] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-14T22:34:22.218575] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-14T22:34:22.218632] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-14T22:34:22.220623] [INFO ] [MAIN ] Derivative Progress: 225/1812 symbols completed. BHC took 0.8s. Estimated remaining: 10m 3s. Rate: 157.9 symbols/min [2025-10-14T22:34:22.221036] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:22.221187] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:22.221119] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:22.251284] [DEBUG] [LOCAL ] BHE: Loaded 23832 existing records from primary storage. [2025-10-14T22:34:22.251427] [INFO ] [MAIN ] BHE: Loaded 23832 primary data records. [2025-10-14T22:34:22.338793] [DEBUG] [LOCAL ] BHK: Loaded 23624 existing records from primary storage. [2025-10-14T22:34:22.366312] [INFO ] [MAIN ] BHK: Loaded 23624 primary data records. [2025-10-14T22:34:22.692499] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-14T22:34:22.698553] [INFO ] [MAIN ] BHP: Loaded 53373 primary data records. [2025-10-14T22:34:23.204144] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:23.205155] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 23832 primary records. [2025-10-14T22:34:23.205336] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-14T22:34:23.235281] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:23.237968] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23624 primary records. [2025-10-14T22:34:23.238234] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-14T22:34:23.238370] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-14T22:34:23.238446] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-14T22:34:23.240845] [INFO ] [MAIN ] Derivative Progress: 226/1812 symbols completed. BHE took 1.0s. Estimated remaining: 10m 7s. Rate: 156.8 symbols/min [2025-10-14T22:34:23.242165] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:23.275831] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-14T22:34:23.274353] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:23.282441] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-14T22:34:23.282302] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53373 primary records. [2025-10-14T22:34:23.282575] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-14T22:34:23.284875] [INFO ] [MAIN ] Derivative Progress: 227/1812 symbols completed. BHK took 1.1s. Estimated remaining: 10m 4s. Rate: 157.4 symbols/min [2025-10-14T22:34:23.285622] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:23.308682] [DEBUG] [LOCAL ] BHR: Loaded 22078 existing records from primary storage. [2025-10-14T22:34:23.309324] [INFO ] [MAIN ] BHR: Loaded 22078 primary data records. [2025-10-14T22:34:23.349373] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-14T22:34:23.368059] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-14T22:34:23.412406] [INFO ] [MAIN ] Derivative Progress: 228/1812 symbols completed. BHP took 1.2s. Estimated remaining: 10m 2s. Rate: 157.8 symbols/min [2025-10-14T22:34:23.428587] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:23.683992] [DEBUG] [LOCAL ] BHVN: Loaded 50511 existing records from primary storage. [2025-10-14T22:34:23.685578] [INFO ] [MAIN ] BHVN: Loaded 50511 primary data records. [2025-10-14T22:34:23.871714] [DEBUG] [LOCAL ] BILL: Loaded 52469 existing records from primary storage. [2025-10-14T22:34:23.900992] [INFO ] [MAIN ] BILL: Loaded 52469 primary data records. [2025-10-14T22:34:24.161864] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:24.178777] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 22078 primary records. [2025-10-14T22:34:24.232916] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-14T22:34:24.368431] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-14T22:34:24.368727] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-14T22:34:24.371675] [INFO ] [MAIN ] Derivative Progress: 229/1812 symbols completed. BHR took 1.1s. Estimated remaining: 10m 6s. Rate: 156.8 symbols/min [2025-10-14T22:34:24.372663] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:24.393635] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:24.394505] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50511 primary records. [2025-10-14T22:34:24.394764] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-14T22:34:24.429125] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-14T22:34:24.429309] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-14T22:34:24.428521] [DEBUG] [LOCAL ] BIO: Loaded 24138 existing records from primary storage. [2025-10-14T22:34:24.431579] [INFO ] [MAIN ] Derivative Progress: 230/1812 symbols completed. BHVN took 1.1s. Estimated remaining: 10m 3s. Rate: 157.4 symbols/min [2025-10-14T22:34:24.431971] [INFO ] [MAIN ] BIO: Loaded 24138 primary data records. [2025-10-14T22:34:24.443897] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:24.466903] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:24.492022] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52469 primary records. [2025-10-14T22:34:24.497252] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-14T22:34:24.673577] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-14T22:34:24.791400] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-14T22:34:24.804594] [INFO ] [MAIN ] Derivative Progress: 231/1812 symbols completed. BILL took 1.4s. Estimated remaining: 10m 3s. Rate: 157.4 symbols/min [2025-10-14T22:34:24.805032] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:24.806984] [DEBUG] [LOCAL ] BIP: Loaded 39214 existing records from primary storage. [2025-10-14T22:34:24.807182] [INFO ] [MAIN ] BIP: Loaded 39214 primary data records. [2025-10-14T22:34:25.144023] [DEBUG] [LOCAL ] BIPC: Loaded 41199 existing records from primary storage. [2025-10-14T22:34:25.144457] [INFO ] [MAIN ] BIPC: Loaded 41199 primary data records. [2025-10-14T22:34:25.351458] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:25.352235] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24138 primary records. [2025-10-14T22:34:25.456419] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-14T22:34:25.482589] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-14T22:34:25.483041] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-14T22:34:25.485364] [INFO ] [MAIN ] Derivative Progress: 232/1812 symbols completed. BIO took 1.1s. Estimated remaining: 10m 4s. Rate: 156.8 symbols/min [2025-10-14T22:34:25.486385] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:25.510514] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:25.510173] [DEBUG] [LOCAL ] BIPH: Loaded 2528 existing records from primary storage. [2025-10-14T22:34:25.510895] [INFO ] [MAIN ] BIPH: Loaded 2528 primary data records. [2025-10-14T22:34:25.511853] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39214 primary records. [2025-10-14T22:34:25.523192] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-14T22:34:25.683246] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-14T22:34:25.766040] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-14T22:34:25.872054] [INFO ] [MAIN ] Derivative Progress: 233/1812 symbols completed. BIP took 1.4s. Estimated remaining: 10m 4s. Rate: 156.8 symbols/min [2025-10-14T22:34:25.872347] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:25.897409] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:25.898244] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41199 primary records. [2025-10-14T22:34:25.898472] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-14T22:34:25.901504] [DEBUG] [LOCAL ] BIPI: Loaded 3072 existing records from primary storage. [2025-10-14T22:34:25.909154] [INFO ] [MAIN ] BIPI: Loaded 3072 primary data records. [2025-10-14T22:34:26.021217] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-14T22:34:26.022054] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-14T22:34:26.024550] [INFO ] [MAIN ] Derivative Progress: 234/1812 symbols completed. BIPC took 1.2s. Estimated remaining: 10m 2s. Rate: 157.2 symbols/min [2025-10-14T22:34:26.040741] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:26.118805] [DEBUG] [LOCAL ] BIPJ: Loaded 3176 existing records from primary storage. [2025-10-14T22:34:26.233118] [INFO ] [MAIN ] BIPJ: Loaded 3176 primary data records. [2025-10-14T22:34:26.371740] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:26.404005] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2528 primary records. [2025-10-14T22:34:26.423854] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-14T22:34:26.587103] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-14T22:34:26.589885] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-14T22:34:26.592728] [INFO ] [MAIN ] Derivative Progress: 235/1812 symbols completed. BIPH took 1.1s. Estimated remaining: 10m 3s. Rate: 156.9 symbols/min [2025-10-14T22:34:26.592934] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:26.606212] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:26.607445] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3072 primary records. [2025-10-14T22:34:26.607698] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-14T22:34:26.623443] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-14T22:34:26.623676] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-14T22:34:26.626222] [INFO ] [MAIN ] Derivative Progress: 236/1812 symbols completed. BIPI took 0.8s. Estimated remaining: 10m 0s. Rate: 157.5 symbols/min [2025-10-14T22:34:26.626784] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:26.649505] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:26.650227] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3176 primary records. [2025-10-14T22:34:26.650413] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-14T22:34:26.678790] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-14T22:34:26.683310] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-14T22:34:26.685372] [INFO ] [MAIN ] Derivative Progress: 237/1812 symbols completed. BIPJ took 0.6s. Estimated remaining: 9m 58s. Rate: 158.1 symbols/min [2025-10-14T22:34:26.685669] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:26.697198] [DEBUG] [LOCAL ] BIT: Loaded 23575 existing records from primary storage. [2025-10-14T22:34:26.710523] [INFO ] [MAIN ] BIT: Loaded 23575 primary data records. [2025-10-14T22:34:26.748484] [DEBUG] [LOCAL ] BIRK: Loaded 51059 existing records from primary storage. [2025-10-14T22:34:26.798517] [INFO ] [MAIN ] BIRK: Loaded 51059 primary data records. [2025-10-14T22:34:27.238430] [DEBUG] [LOCAL ] BJ: Loaded 51583 existing records from primary storage. [2025-10-14T22:34:27.352265] [INFO ] [MAIN ] BJ: Loaded 51583 primary data records. [2025-10-14T22:34:27.732188] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:27.733400] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23575 primary records. [2025-10-14T22:34:27.733973] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-14T22:34:27.751397] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-14T22:34:27.751738] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-14T22:34:27.754170] [INFO ] [MAIN ] Derivative Progress: 238/1812 symbols completed. BIT took 1.1s. Estimated remaining: 10m 2s. Rate: 156.9 symbols/min [2025-10-14T22:34:27.773550] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:34:27.774422] [INFO ] [MAIN ] BIRK: Generated 1793 derivative records from 51059 primary records. [2025-10-14T22:34:27.774763] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-14T22:34:27.792614] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1793 records). [2025-10-14T22:34:27.792728] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-14T22:34:27.795120] [INFO ] [MAIN ] Derivative Progress: 239/1812 symbols completed. BIRK took 1.2s. Estimated remaining: 9m 59s. Rate: 157.5 symbols/min [2025-10-14T22:34:27.811459] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:27.812135] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51583 primary records. [2025-10-14T22:34:27.812199] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-14T22:34:27.828379] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-14T22:34:27.828451] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-14T22:34:27.830734] [INFO ] [MAIN ] Derivative Progress: 240/1812 symbols completed. BJ took 1.1s. Estimated remaining: 9m 57s. Rate: 158.1 symbols/min [2025-10-14T22:34:27.831128] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:27.831237] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:27.831411] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:27.891142] [DEBUG] [LOCAL ] BKE: Loaded 33992 existing records from primary storage. [2025-10-14T22:34:27.891387] [INFO ] [MAIN ] BKE: Loaded 33992 primary data records. [2025-10-14T22:34:28.023706] [DEBUG] [LOCAL ] BKD: Loaded 50449 existing records from primary storage. [2025-10-14T22:34:28.024834] [DEBUG] [LOCAL ] BK: Loaded 53536 existing records from primary storage. [2025-10-14T22:34:28.024944] [INFO ] [MAIN ] BK: Loaded 53536 primary data records. [2025-10-14T22:34:28.030331] [INFO ] [MAIN ] BKD: Loaded 50449 primary data records. [2025-10-14T22:34:28.860389] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:28.861602] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 33992 primary records. [2025-10-14T22:34:28.861776] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-14T22:34:28.882634] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-14T22:34:28.882959] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-14T22:34:28.885195] [INFO ] [MAIN ] Derivative Progress: 241/1812 symbols completed. BKE took 1.1s. Estimated remaining: 10m 1s. Rate: 156.9 symbols/min [2025-10-14T22:34:28.897950] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:28.898952] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:28.899799] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53536 primary records. [2025-10-14T22:34:28.900493] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-14T22:34:28.934626] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-14T22:34:28.934510] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:28.935775] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-14T22:34:28.938876] [INFO ] [MAIN ] Derivative Progress: 242/1812 symbols completed. BK took 1.1s. Estimated remaining: 9m 58s. Rate: 157.5 symbols/min [2025-10-14T22:34:28.935676] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50449 primary records. [2025-10-14T22:34:28.939081] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-14T22:34:28.939327] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:28.965152] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-14T22:34:28.965371] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-14T22:34:28.967772] [INFO ] [MAIN ] Derivative Progress: 243/1812 symbols completed. BKD took 1.1s. Estimated remaining: 9m 56s. Rate: 158.1 symbols/min [2025-10-14T22:34:28.968635] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:28.981670] [DEBUG] [LOCAL ] BKH: Loaded 37028 existing records from primary storage. [2025-10-14T22:34:28.981890] [INFO ] [MAIN ] BKH: Loaded 37028 primary data records. [2025-10-14T22:34:29.066416] [DEBUG] [LOCAL ] BKN: Loaded 7362 existing records from primary storage. [2025-10-14T22:34:29.091541] [INFO ] [MAIN ] BKN: Loaded 7362 primary data records. [2025-10-14T22:34:29.297932] [DEBUG] [LOCAL ] BKKT: Loaded 36403 existing records from primary storage. [2025-10-14T22:34:29.298211] [INFO ] [MAIN ] BKKT: Loaded 36403 primary data records. [2025-10-14T22:34:29.993673] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:29.994083] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:29.994989] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7362 primary records. [2025-10-14T22:34:29.995311] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-14T22:34:29.996193] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 37028 primary records. [2025-10-14T22:34:29.996409] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-14T22:34:30.025900] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-14T22:34:30.026600] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-14T22:34:30.030074] [INFO ] [MAIN ] Derivative Progress: 244/1812 symbols completed. BKN took 1.1s. Estimated remaining: 9m 60s. Rate: 156.9 symbols/min [2025-10-14T22:34:30.030309] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:30.033900] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-14T22:34:30.035053] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-14T22:34:30.037142] [INFO ] [MAIN ] Derivative Progress: 245/1812 symbols completed. BKH took 1.1s. Estimated remaining: 9m 57s. Rate: 157.6 symbols/min [2025-10-14T22:34:30.037508] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:30.051044] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:30.051868] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 36403 primary records. [2025-10-14T22:34:30.051987] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-14T22:34:30.071014] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-14T22:34:30.071170] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-14T22:34:30.073473] [INFO ] [MAIN ] Derivative Progress: 246/1812 symbols completed. BKKT took 1.1s. Estimated remaining: 9m 54s. Rate: 158.1 symbols/min [2025-10-14T22:34:30.073714] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:30.080205] [DEBUG] [LOCAL ] BKT: Loaded 12331 existing records from primary storage. [2025-10-14T22:34:30.080438] [INFO ] [MAIN ] BKT: Loaded 12331 primary data records. [2025-10-14T22:34:30.395698] [DEBUG] [LOCAL ] BKSY: Loaded 48676 existing records from primary storage. [2025-10-14T22:34:30.404858] [INFO ] [MAIN ] BKSY: Loaded 48676 primary data records. [2025-10-14T22:34:30.525266] [DEBUG] [LOCAL ] BKU: Loaded 42065 existing records from primary storage. [2025-10-14T22:34:30.531593] [INFO ] [MAIN ] BKU: Loaded 42065 primary data records. [2025-10-14T22:34:31.051393] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:31.053008] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 12331 primary records. [2025-10-14T22:34:31.053611] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-14T22:34:31.071687] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-14T22:34:31.071781] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-14T22:34:31.074389] [INFO ] [MAIN ] Derivative Progress: 247/1812 symbols completed. BKT took 1.0s. Estimated remaining: 9m 58s. Rate: 157.1 symbols/min [2025-10-14T22:34:31.074541] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:31.095772] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:31.096727] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48676 primary records. [2025-10-14T22:34:31.096877] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-14T22:34:31.136130] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:31.135844] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-14T22:34:31.136321] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-14T22:34:31.138998] [INFO ] [MAIN ] Derivative Progress: 248/1812 symbols completed. BKSY took 1.1s. Estimated remaining: 9m 55s. Rate: 157.6 symbols/min [2025-10-14T22:34:31.137002] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42065 primary records. [2025-10-14T22:34:31.139169] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-14T22:34:31.140087] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:31.166578] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-14T22:34:31.165617] [DEBUG] [LOCAL ] BKV: Loaded 29704 existing records from primary storage. [2025-10-14T22:34:31.166838] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-14T22:34:31.169393] [INFO ] [MAIN ] Derivative Progress: 249/1812 symbols completed. BKU took 1.1s. Estimated remaining: 9m 53s. Rate: 158.2 symbols/min [2025-10-14T22:34:31.169593] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:31.166774] [INFO ] [MAIN ] BKV: Loaded 29704 primary data records. [2025-10-14T22:34:31.312107] [DEBUG] [LOCAL ] BLCO: Loaded 35353 existing records from primary storage. [2025-10-14T22:34:31.344340] [INFO ] [MAIN ] BLCO: Loaded 35353 primary data records. [2025-10-14T22:34:31.442774] [DEBUG] [LOCAL ] BLD: Loaded 27592 existing records from primary storage. [2025-10-14T22:34:31.609179] [INFO ] [MAIN ] BLD: Loaded 27592 primary data records. [2025-10-14T22:34:32.205560] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:32.206580] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29704 primary records. [2025-10-14T22:34:32.206798] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-14T22:34:32.239605] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-14T22:34:32.240317] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-14T22:34:32.240082] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:32.243425] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35353 primary records. [2025-10-14T22:34:32.242559] [INFO ] [MAIN ] Derivative Progress: 250/1812 symbols completed. BKV took 1.2s. Estimated remaining: 9m 57s. Rate: 157.1 symbols/min [2025-10-14T22:34:32.243803] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-14T22:34:32.244674] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:32.277062] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-14T22:34:32.277378] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:32.277600] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-14T22:34:32.280446] [INFO ] [MAIN ] Derivative Progress: 251/1812 symbols completed. BLCO took 1.1s. Estimated remaining: 9m 54s. Rate: 157.6 symbols/min [2025-10-14T22:34:32.281425] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27592 primary records. [2025-10-14T22:34:32.281600] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-14T22:34:32.280634] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:32.302380] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-10-14T22:34:32.302623] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-14T22:34:32.305028] [INFO ] [MAIN ] Derivative Progress: 252/1812 symbols completed. BLD took 1.1s. Estimated remaining: 9m 52s. Rate: 158.2 symbols/min [2025-10-14T22:34:32.305285] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:32.324020] [DEBUG] [LOCAL ] BLE: Loaded 13853 existing records from primary storage. [2025-10-14T22:34:32.324167] [INFO ] [MAIN ] BLE: Loaded 13853 primary data records. [2025-10-14T22:34:32.454349] [DEBUG] [LOCAL ] BLDR: Loaded 51879 existing records from primary storage. [2025-10-14T22:34:32.489682] [INFO ] [MAIN ] BLDR: Loaded 51879 primary data records. [2025-10-14T22:34:32.776629] [DEBUG] [LOCAL ] BLK: Loaded 34255 existing records from primary storage. [2025-10-14T22:34:32.794312] [INFO ] [MAIN ] BLK: Loaded 34255 primary data records. [2025-10-14T22:34:33.305030] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:33.306434] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 13853 primary records. [2025-10-14T22:34:33.307316] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-14T22:34:33.328109] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-14T22:34:33.329008] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-14T22:34:33.331380] [INFO ] [MAIN ] Derivative Progress: 253/1812 symbols completed. BLE took 1.1s. Estimated remaining: 9m 55s. Rate: 157.1 symbols/min [2025-10-14T22:34:33.344605] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:33.345414] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51879 primary records. [2025-10-14T22:34:33.345596] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-14T22:34:33.374807] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:33.376133] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34255 primary records. [2025-10-14T22:34:33.376446] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-14T22:34:33.377918] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-14T22:34:33.378015] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-14T22:34:33.380565] [INFO ] [MAIN ] Derivative Progress: 254/1812 symbols completed. BLDR took 1.1s. Estimated remaining: 9m 53s. Rate: 157.7 symbols/min [2025-10-14T22:34:33.396021] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-14T22:34:33.396088] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-14T22:34:33.398824] [INFO ] [MAIN ] Derivative Progress: 255/1812 symbols completed. BLK took 1.1s. Estimated remaining: 9m 50s. Rate: 158.3 symbols/min [2025-10-14T22:34:33.399217] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:33.399339] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:33.399453] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:33.415637] [DEBUG] [LOCAL ] BLW: Loaded 13213 existing records from primary storage. [2025-10-14T22:34:33.415766] [INFO ] [MAIN ] BLW: Loaded 13213 primary data records. [2025-10-14T22:34:33.785198] [DEBUG] [LOCAL ] BLND: Loaded 49272 existing records from primary storage. [2025-10-14T22:34:33.785994] [DEBUG] [LOCAL ] BMA: Loaded 36025 existing records from primary storage. [2025-10-14T22:34:33.786167] [INFO ] [MAIN ] BLND: Loaded 49272 primary data records. [2025-10-14T22:34:33.786309] [INFO ] [MAIN ] BMA: Loaded 36025 primary data records. [2025-10-14T22:34:34.421970] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:34.423270] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13213 primary records. [2025-10-14T22:34:34.423468] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-14T22:34:34.440950] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-14T22:34:34.441329] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-14T22:34:34.444213] [INFO ] [MAIN ] Derivative Progress: 256/1812 symbols completed. BLW took 1.0s. Estimated remaining: 9m 54s. Rate: 157.2 symbols/min [2025-10-14T22:34:34.444472] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:34.467155] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:34.468096] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49272 primary records. [2025-10-14T22:34:34.484510] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-14T22:34:34.484435] [DEBUG] [LOCAL ] BME: Loaded 11234 existing records from primary storage. [2025-10-14T22:34:34.485255] [INFO ] [MAIN ] BME: Loaded 11234 primary data records. [2025-10-14T22:34:34.507531] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:34.528197] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 36025 primary records. [2025-10-14T22:34:34.545741] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-14T22:34:34.583505] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-14T22:34:34.583947] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-14T22:34:34.586267] [INFO ] [MAIN ] Derivative Progress: 257/1812 symbols completed. BLND took 1.2s. Estimated remaining: 9m 52s. Rate: 157.6 symbols/min [2025-10-14T22:34:34.586422] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:34.828676] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-14T22:34:34.829019] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-14T22:34:34.831239] [INFO ] [MAIN ] Derivative Progress: 258/1812 symbols completed. BMA took 1.4s. Estimated remaining: 9m 51s. Rate: 157.8 symbols/min [2025-10-14T22:34:34.831496] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:34.844575] [DEBUG] [LOCAL ] BMEZ: Loaded 26013 existing records from primary storage. [2025-10-14T22:34:34.844945] [INFO ] [MAIN ] BMEZ: Loaded 26013 primary data records. [2025-10-14T22:34:35.040284] [DEBUG] [LOCAL ] BMI: Loaded 24471 existing records from primary storage. [2025-10-14T22:34:35.146706] [INFO ] [MAIN ] BMI: Loaded 24471 primary data records. [2025-10-14T22:34:35.307094] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:35.352482] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11234 primary records. [2025-10-14T22:34:35.498468] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-14T22:34:35.535256] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-14T22:34:35.537237] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-14T22:34:35.541518] [INFO ] [MAIN ] Derivative Progress: 259/1812 symbols completed. BME took 1.1s. Estimated remaining: 9m 52s. Rate: 157.3 symbols/min [2025-10-14T22:34:35.554583] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:35.554291] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:35.555446] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26013 primary records. [2025-10-14T22:34:35.555837] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-14T22:34:35.572820] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-14T22:34:35.575377] [DEBUG] [LOCAL ] BMN: Loaded 2585 existing records from primary storage. [2025-10-14T22:34:35.572959] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-14T22:34:35.575521] [INFO ] [MAIN ] BMN: Loaded 2585 primary data records. [2025-10-14T22:34:35.589102] [INFO ] [MAIN ] Derivative Progress: 260/1812 symbols completed. BMEZ took 1.0s. Estimated remaining: 9m 50s. Rate: 157.8 symbols/min [2025-10-14T22:34:35.615399] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:35.842146] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:35.910717] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24471 primary records. [2025-10-14T22:34:35.911000] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-14T22:34:35.942108] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-14T22:34:35.942325] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-14T22:34:35.942934] [DEBUG] [LOCAL ] BMO: Loaded 41163 existing records from primary storage. [2025-10-14T22:34:35.945695] [INFO ] [MAIN ] Derivative Progress: 261/1812 symbols completed. BMI took 1.1s. Estimated remaining: 9m 50s. Rate: 157.8 symbols/min [2025-10-14T22:34:35.946511] [INFO ] [MAIN ] BMO: Loaded 41163 primary data records. [2025-10-14T22:34:35.946366] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:36.280635] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:34:36.281700] [INFO ] [MAIN ] BMN: Generated 1792 derivative records from 2585 primary records. [2025-10-14T22:34:36.282250] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-14T22:34:36.298243] [DEBUG] [LOCAL ] BMN: Derivative data saved (1792 records). [2025-10-14T22:34:36.298689] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-14T22:34:36.301617] [INFO ] [MAIN ] Derivative Progress: 262/1812 symbols completed. BMN took 0.7s. Estimated remaining: 9m 49s. Rate: 157.9 symbols/min [2025-10-14T22:34:36.302166] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:36.318111] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-14T22:34:36.318319] [INFO ] [MAIN ] BN: Loaded 52993 primary data records. [2025-10-14T22:34:36.650179] [DEBUG] [LOCAL ] BNED: Loaded 28733 existing records from primary storage. [2025-10-14T22:34:36.540176] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:36.665156] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41163 primary records. [2025-10-14T22:34:36.665384] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-14T22:34:36.664275] [INFO ] [MAIN ] BNED: Loaded 28733 primary data records. [2025-10-14T22:34:36.957732] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-14T22:34:36.988102] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-14T22:34:36.990850] [INFO ] [MAIN ] Derivative Progress: 263/1812 symbols completed. BMO took 1.4s. Estimated remaining: 9m 50s. Rate: 157.4 symbols/min [2025-10-14T22:34:36.991263] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:37.017526] [DEBUG] [LOCAL ] BNH: Loaded 5072 existing records from primary storage. [2025-10-14T22:34:37.018151] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:37.018282] [INFO ] [MAIN ] BNH: Loaded 5072 primary data records. [2025-10-14T22:34:37.051030] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52993 primary records. [2025-10-14T22:34:37.085166] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-14T22:34:37.153202] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-14T22:34:37.215675] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-14T22:34:37.340402] [INFO ] [MAIN ] Derivative Progress: 264/1812 symbols completed. BN took 1.4s. Estimated remaining: 9m 50s. Rate: 157.4 symbols/min [2025-10-14T22:34:37.340733] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:37.362816] [DEBUG] [LOCAL ] BNJ: Loaded 2629 existing records from primary storage. [2025-10-14T22:34:37.363467] [INFO ] [MAIN ] BNJ: Loaded 2629 primary data records. [2025-10-14T22:34:37.363380] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:37.364604] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 28733 primary records. [2025-10-14T22:34:37.364753] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-14T22:34:37.566823] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-14T22:34:37.623707] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-14T22:34:37.719251] [INFO ] [MAIN ] Derivative Progress: 265/1812 symbols completed. BNED took 1.4s. Estimated remaining: 9m 50s. Rate: 157.4 symbols/min [2025-10-14T22:34:37.728687] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:37.750506] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:37.751404] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5072 primary records. [2025-10-14T22:34:37.751595] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-14T22:34:37.769729] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-14T22:34:37.770072] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-14T22:34:37.772351] [INFO ] [MAIN ] Derivative Progress: 266/1812 symbols completed. BNH took 0.8s. Estimated remaining: 9m 47s. Rate: 158.0 symbols/min [2025-10-14T22:34:37.772571] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:37.802040] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:37.802886] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2629 primary records. [2025-10-14T22:34:37.802955] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-14T22:34:37.817575] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-14T22:34:37.818423] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-14T22:34:37.820932] [INFO ] [MAIN ] Derivative Progress: 267/1812 symbols completed. BNJ took 0.5s. Estimated remaining: 9m 45s. Rate: 158.5 symbols/min [2025-10-14T22:34:37.834867] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:37.836159] [DEBUG] [LOCAL ] BNL: Loaded 47213 existing records from primary storage. [2025-10-14T22:34:37.836262] [INFO ] [MAIN ] BNL: Loaded 47213 primary data records. [2025-10-14T22:34:37.945934] [DEBUG] [LOCAL ] BNT: Loaded 3459 existing records from primary storage. [2025-10-14T22:34:37.966106] [INFO ] [MAIN ] BNT: Loaded 3459 primary data records. [2025-10-14T22:34:38.278438] [DEBUG] [LOCAL ] BNS: Loaded 51485 existing records from primary storage. [2025-10-14T22:34:38.287913] [INFO ] [MAIN ] BNS: Loaded 51485 primary data records. [2025-10-14T22:34:38.829990] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:38.831157] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47213 primary records. [2025-10-14T22:34:38.831331] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-14T22:34:38.845854] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:34:38.846832] [INFO ] [MAIN ] BNT: Generated 1793 derivative records from 3459 primary records. [2025-10-14T22:34:38.847026] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-14T22:34:38.885725] [DEBUG] [LOCAL ] BNT: Derivative data saved (1793 records). [2025-10-14T22:34:38.884848] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-14T22:34:38.885955] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-14T22:34:38.888692] [INFO ] [MAIN ] Derivative Progress: 268/1812 symbols completed. BNL took 1.2s. Estimated remaining: 9m 49s. Rate: 157.4 symbols/min [2025-10-14T22:34:38.885890] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-14T22:34:38.891450] [INFO ] [MAIN ] Derivative Progress: 269/1812 symbols completed. BNT took 1.1s. Estimated remaining: 9m 46s. Rate: 158.0 symbols/min [2025-10-14T22:34:38.907332] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:38.908056] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51485 primary records. [2025-10-14T22:34:38.908130] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-14T22:34:38.923164] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-14T22:34:38.923224] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-14T22:34:38.925494] [INFO ] [MAIN ] Derivative Progress: 270/1812 symbols completed. BNS took 1.2s. Estimated remaining: 9m 44s. Rate: 158.5 symbols/min [2025-10-14T22:34:38.925954] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:38.926195] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:38.926112] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:38.944314] [DEBUG] [LOCAL ] BNY: Loaded 7171 existing records from primary storage. [2025-10-14T22:34:38.944583] [INFO ] [MAIN ] BNY: Loaded 7171 primary data records. [2025-10-14T22:34:39.034996] [DEBUG] [LOCAL ] BOE: Loaded 18298 existing records from primary storage. [2025-10-14T22:34:39.049701] [DEBUG] [LOCAL ] BOC: Loaded 18632 existing records from primary storage. [2025-10-14T22:34:39.055005] [INFO ] [MAIN ] BOC: Loaded 18632 primary data records. [2025-10-14T22:34:39.055244] [INFO ] [MAIN ] BOE: Loaded 18298 primary data records. [2025-10-14T22:34:39.945104] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:39.946138] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7171 primary records. [2025-10-14T22:34:39.947319] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-14T22:34:39.966620] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-14T22:34:39.966823] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-14T22:34:39.993770] [INFO ] [MAIN ] Derivative Progress: 271/1812 symbols completed. BNY took 1.1s. Estimated remaining: 9m 47s. Rate: 157.5 symbols/min [2025-10-14T22:34:39.994388] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:39.994277] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:39.995163] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:39.996134] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18632 primary records. [2025-10-14T22:34:39.996406] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-14T22:34:39.997228] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 18298 primary records. [2025-10-14T22:34:39.997421] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-14T22:34:40.030891] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-14T22:34:40.031136] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-14T22:34:40.033782] [INFO ] [MAIN ] Derivative Progress: 272/1812 symbols completed. BOC took 1.1s. Estimated remaining: 9m 45s. Rate: 158.0 symbols/min [2025-10-14T22:34:40.030786] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-14T22:34:40.034287] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:40.034085] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-14T22:34:40.036822] [INFO ] [MAIN ] Derivative Progress: 273/1812 symbols completed. BOE took 1.1s. Estimated remaining: 9m 42s. Rate: 158.6 symbols/min [2025-10-14T22:34:40.037049] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:40.061226] [DEBUG] [LOCAL ] BOH: Loaded 30552 existing records from primary storage. [2025-10-14T22:34:40.061498] [INFO ] [MAIN ] BOH: Loaded 30552 primary data records. [2025-10-14T22:34:40.203445] [DEBUG] [LOCAL ] BOND: Loaded 32377 existing records from primary storage. [2025-10-14T22:34:40.214595] [INFO ] [MAIN ] BOND: Loaded 32377 primary data records. [2025-10-14T22:34:40.510786] [DEBUG] [LOCAL ] BOOT: Loaded 39842 existing records from primary storage. [2025-10-14T22:34:40.514711] [INFO ] [MAIN ] BOOT: Loaded 39842 primary data records. [2025-10-14T22:34:41.032298] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:41.033298] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30552 primary records. [2025-10-14T22:34:41.034438] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-14T22:34:41.066193] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-14T22:34:41.066670] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-14T22:34:41.068944] [INFO ] [MAIN ] Derivative Progress: 274/1812 symbols completed. BOH took 1.1s. Estimated remaining: 9m 46s. Rate: 157.6 symbols/min [2025-10-14T22:34:41.069234] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:41.069637] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:41.070966] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32377 primary records. [2025-10-14T22:34:41.071052] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-14T22:34:41.105967] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-10-14T22:34:41.106748] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-14T22:34:41.109019] [INFO ] [MAIN ] Derivative Progress: 275/1812 symbols completed. BOND took 1.1s. Estimated remaining: 9m 43s. Rate: 158.1 symbols/min [2025-10-14T22:34:41.106619] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:41.109273] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:41.110460] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 39842 primary records. [2025-10-14T22:34:41.110623] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-14T22:34:41.128433] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-14T22:34:41.128681] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-14T22:34:41.130867] [INFO ] [MAIN ] Derivative Progress: 276/1812 symbols completed. BOOT took 1.1s. Estimated remaining: 9m 41s. Rate: 158.6 symbols/min [2025-10-14T22:34:41.131048] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:41.163775] [DEBUG] [LOCAL ] BOW: Loaded 23426 existing records from primary storage. [2025-10-14T22:34:41.164129] [INFO ] [MAIN ] BOW: Loaded 23426 primary data records. [2025-10-14T22:34:41.215986] [DEBUG] [LOCAL ] BORR: Loaded 51146 existing records from primary storage. [2025-10-14T22:34:41.235984] [INFO ] [MAIN ] BORR: Loaded 51146 primary data records. [2025-10-14T22:34:41.573249] [DEBUG] [LOCAL ] BP: Loaded 53708 existing records from primary storage. [2025-10-14T22:34:41.709865] [INFO ] [MAIN ] BP: Loaded 53708 primary data records. [2025-10-14T22:34:42.160547] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:42.161869] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23426 primary records. [2025-10-14T22:34:42.162122] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-14T22:34:42.174896] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:42.176946] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51146 primary records. [2025-10-14T22:34:42.177043] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-14T22:34:42.211833] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-10-14T22:34:42.211944] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-14T22:34:42.214193] [INFO ] [MAIN ] Derivative Progress: 277/1812 symbols completed. BORR took 1.1s. Estimated remaining: 9m 45s. Rate: 157.6 symbols/min [2025-10-14T22:34:42.210747] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-14T22:34:42.214436] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:42.214988] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-14T22:34:42.217257] [INFO ] [MAIN ] Derivative Progress: 278/1812 symbols completed. BOW took 1.1s. Estimated remaining: 9m 42s. Rate: 158.1 symbols/min [2025-10-14T22:34:42.217685] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:42.232135] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:42.232982] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53708 primary records. [2025-10-14T22:34:42.233200] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-14T22:34:42.256974] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-14T22:34:42.257127] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-14T22:34:42.267423] [INFO ] [MAIN ] Derivative Progress: 279/1812 symbols completed. BP took 1.1s. Estimated remaining: 9m 40s. Rate: 158.6 symbols/min [2025-10-14T22:34:42.267683] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:42.275817] [DEBUG] [LOCAL ] BRC: Loaded 18597 existing records from primary storage. [2025-10-14T22:34:42.276016] [INFO ] [MAIN ] BRC: Loaded 18597 primary data records. [2025-10-14T22:34:42.392337] [DEBUG] [LOCAL ] BR: Loaded 34787 existing records from primary storage. [2025-10-14T22:34:42.396536] [INFO ] [MAIN ] BR: Loaded 34787 primary data records. [2025-10-14T22:34:42.824116] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-14T22:34:42.935561] [INFO ] [MAIN ] BROS: Loaded 53300 primary data records. [2025-10-14T22:34:43.268945] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:43.269897] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18597 primary records. [2025-10-14T22:34:43.270037] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-14T22:34:43.302689] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:43.303958] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34787 primary records. [2025-10-14T22:34:43.304581] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-14T22:34:43.304517] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-14T22:34:43.304792] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-14T22:34:43.307834] [INFO ] [MAIN ] Derivative Progress: 280/1812 symbols completed. BRC took 1.1s. Estimated remaining: 9m 43s. Rate: 157.6 symbols/min [2025-10-14T22:34:43.308562] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:43.325341] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-14T22:34:43.325740] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-14T22:34:43.328639] [INFO ] [MAIN ] Derivative Progress: 281/1812 symbols completed. BR took 1.1s. Estimated remaining: 9m 41s. Rate: 158.2 symbols/min [2025-10-14T22:34:43.329907] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:43.346682] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:43.347547] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53300 primary records. [2025-10-14T22:34:43.347726] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-14T22:34:43.380109] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-14T22:34:43.380254] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-14T22:34:43.382633] [INFO ] [MAIN ] Derivative Progress: 282/1812 symbols completed. BROS took 1.1s. Estimated remaining: 9m 39s. Rate: 158.7 symbols/min [2025-10-14T22:34:43.390356] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:43.401008] [DEBUG] [LOCAL ] BRW: Loaded 21043 existing records from primary storage. [2025-10-14T22:34:43.401145] [INFO ] [MAIN ] BRW: Loaded 21043 primary data records. [2025-10-14T22:34:43.402028] [DEBUG] [LOCAL ] BRSP: Loaded 36881 existing records from primary storage. [2025-10-14T22:34:43.402219] [INFO ] [MAIN ] BRSP: Loaded 36881 primary data records. [2025-10-14T22:34:44.061379] [DEBUG] [LOCAL ] BRX: Loaded 51776 existing records from primary storage. [2025-10-14T22:34:44.062682] [INFO ] [MAIN ] BRX: Loaded 51776 primary data records. [2025-10-14T22:34:44.391389] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:44.392993] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 21043 primary records. [2025-10-14T22:34:44.393676] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-14T22:34:44.411468] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-10-14T22:34:44.411673] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-14T22:34:44.413938] [INFO ] [MAIN ] Derivative Progress: 283/1812 symbols completed. BRW took 1.1s. Estimated remaining: 9m 42s. Rate: 157.7 symbols/min [2025-10-14T22:34:44.428073] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:44.428819] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36881 primary records. [2025-10-14T22:34:44.428975] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-14T22:34:44.446208] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-14T22:34:44.446930] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-14T22:34:44.449210] [INFO ] [MAIN ] Derivative Progress: 284/1812 symbols completed. BRSP took 1.1s. Estimated remaining: 9m 40s. Rate: 158.2 symbols/min [2025-10-14T22:34:44.462563] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:44.463113] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51776 primary records. [2025-10-14T22:34:44.463171] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-14T22:34:44.478436] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-14T22:34:44.478493] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-14T22:34:44.480686] [INFO ] [MAIN ] Derivative Progress: 285/1812 symbols completed. BRX took 1.1s. Estimated remaining: 9m 37s. Rate: 158.7 symbols/min [2025-10-14T22:34:44.481217] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:44.481422] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:44.481307] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:44.497777] [DEBUG] [LOCAL ] BSL: Loaded 8184 existing records from primary storage. [2025-10-14T22:34:44.498127] [INFO ] [MAIN ] BSL: Loaded 8184 primary data records. [2025-10-14T22:34:44.662250] [DEBUG] [LOCAL ] BSBR: Loaded 35663 existing records from primary storage. [2025-10-14T22:34:44.699620] [INFO ] [MAIN ] BSBR: Loaded 35663 primary data records. [2025-10-14T22:34:44.716355] [DEBUG] [LOCAL ] BSAC: Loaded 32899 existing records from primary storage. [2025-10-14T22:34:44.720496] [INFO ] [MAIN ] BSAC: Loaded 32899 primary data records. [2025-10-14T22:34:45.566764] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:45.568381] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8184 primary records. [2025-10-14T22:34:45.568774] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-14T22:34:45.603429] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:45.605708] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-14T22:34:45.608747] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-14T22:34:45.610957] [INFO ] [MAIN ] Derivative Progress: 286/1812 symbols completed. BSL took 1.1s. Estimated remaining: 9m 41s. Rate: 157.6 symbols/min [2025-10-14T22:34:45.607911] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35663 primary records. [2025-10-14T22:34:45.611281] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-14T22:34:45.611508] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:45.638334] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:45.641812] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32899 primary records. [2025-10-14T22:34:45.642275] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-14T22:34:45.652512] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-14T22:34:45.652818] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-14T22:34:45.656567] [INFO ] [MAIN ] Derivative Progress: 287/1812 symbols completed. BSBR took 1.2s. Estimated remaining: 9m 39s. Rate: 158.1 symbols/min [2025-10-14T22:34:45.656755] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:45.665258] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-10-14T22:34:45.665355] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-14T22:34:45.668633] [INFO ] [MAIN ] Derivative Progress: 288/1812 symbols completed. BSAC took 1.2s. Estimated remaining: 9m 36s. Rate: 158.6 symbols/min [2025-10-14T22:34:45.668888] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:45.709667] [DEBUG] [LOCAL ] BST: Loaded 18922 existing records from primary storage. [2025-10-14T22:34:45.710501] [DEBUG] [LOCAL ] BSM: Loaded 32337 existing records from primary storage. [2025-10-14T22:34:45.709838] [INFO ] [MAIN ] BST: Loaded 18922 primary data records. [2025-10-14T22:34:45.716207] [INFO ] [MAIN ] BSM: Loaded 32337 primary data records. [2025-10-14T22:34:45.882442] [DEBUG] [LOCAL ] BSTZ: Loaded 25010 existing records from primary storage. [2025-10-14T22:34:45.892850] [INFO ] [MAIN ] BSTZ: Loaded 25010 primary data records. [2025-10-14T22:34:46.647161] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:46.647964] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32337 primary records. [2025-10-14T22:34:46.648070] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-14T22:34:46.666116] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-14T22:34:46.666464] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-14T22:34:46.668609] [INFO ] [MAIN ] Derivative Progress: 289/1812 symbols completed. BSM took 1.1s. Estimated remaining: 9m 39s. Rate: 157.7 symbols/min [2025-10-14T22:34:46.669091] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:46.685387] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:46.686269] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18922 primary records. [2025-10-14T22:34:46.698634] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-14T22:34:46.699414] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:46.701739] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 25010 primary records. [2025-10-14T22:34:46.712438] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-14T22:34:46.725050] [DEBUG] [LOCAL ] BTA: Loaded 5627 existing records from primary storage. [2025-10-14T22:34:46.734577] [INFO ] [MAIN ] BTA: Loaded 5627 primary data records. [2025-10-14T22:34:46.734194] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-14T22:34:46.772322] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-14T22:34:46.790966] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-14T22:34:46.790834] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-14T22:34:46.801869] [INFO ] [MAIN ] Derivative Progress: 290/1812 symbols completed. BST took 1.1s. Estimated remaining: 9m 38s. Rate: 158.1 symbols/min [2025-10-14T22:34:46.833311] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:46.840292] [INFO ] [MAIN ] Derivative Progress: 291/1812 symbols completed. BSTZ took 1.1s. Estimated remaining: 9m 36s. Rate: 158.6 symbols/min [2025-10-14T22:34:46.844065] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:47.049523] [DEBUG] [LOCAL ] BTCM: Loaded 16664 existing records from primary storage. [2025-10-14T22:34:47.050011] [INFO ] [MAIN ] BTCM: Loaded 16664 primary data records. [2025-10-14T22:34:47.426506] [DEBUG] [LOCAL ] BTI: Loaded 53590 existing records from primary storage. [2025-10-14T22:34:47.428296] [INFO ] [MAIN ] BTI: Loaded 53590 primary data records. [2025-10-14T22:34:47.529066] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:47.571945] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5627 primary records. [2025-10-14T22:34:47.582638] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-14T22:34:47.795766] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-14T22:34:47.796173] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-14T22:34:47.798288] [INFO ] [MAIN ] Derivative Progress: 292/1812 symbols completed. BTA took 1.1s. Estimated remaining: 9m 38s. Rate: 157.7 symbols/min [2025-10-14T22:34:47.798740] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:47.821734] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:47.822551] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 16664 primary records. [2025-10-14T22:34:47.822752] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-14T22:34:47.828198] [DEBUG] [LOCAL ] BTO: Loaded 8779 existing records from primary storage. [2025-10-14T22:34:47.828791] [INFO ] [MAIN ] BTO: Loaded 8779 primary data records. [2025-10-14T22:34:47.955901] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-10-14T22:34:47.966579] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-14T22:34:47.993325] [INFO ] [MAIN ] Derivative Progress: 293/1812 symbols completed. BTCM took 1.2s. Estimated remaining: 9m 37s. Rate: 158.0 symbols/min [2025-10-14T22:34:48.144245] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:48.175734] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:48.177081] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53590 primary records. [2025-10-14T22:34:48.178484] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-14T22:34:48.217306] [DEBUG] [LOCAL ] BTT: Loaded 15724 existing records from primary storage. [2025-10-14T22:34:48.220060] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-14T22:34:48.220307] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-14T22:34:48.223499] [INFO ] [MAIN ] Derivative Progress: 294/1812 symbols completed. BTI took 1.4s. Estimated remaining: 9m 36s. Rate: 158.2 symbols/min [2025-10-14T22:34:48.220407] [INFO ] [MAIN ] BTT: Loaded 15724 primary data records. [2025-10-14T22:34:48.223933] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:48.410702] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:48.422629] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8779 primary records. [2025-10-14T22:34:48.422785] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-14T22:34:48.736330] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-14T22:34:48.737252] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-14T22:34:48.741261] [DEBUG] [LOCAL ] BTU: Loaded 53323 existing records from primary storage. [2025-10-14T22:34:48.741529] [INFO ] [MAIN ] BTU: Loaded 53323 primary data records. [2025-10-14T22:34:48.739882] [INFO ] [MAIN ] Derivative Progress: 295/1812 symbols completed. BTO took 0.9s. Estimated remaining: 9m 36s. Rate: 158.0 symbols/min [2025-10-14T22:34:48.742637] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:48.932902] [DEBUG] [LOCAL ] BTZ: Loaded 22641 existing records from primary storage. [2025-10-14T22:34:48.958024] [INFO ] [MAIN ] BTZ: Loaded 22641 primary data records. [2025-10-14T22:34:49.268820] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:49.297237] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15724 primary records. [2025-10-14T22:34:49.329012] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-14T22:34:49.507007] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-14T22:34:49.508386] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-14T22:34:49.511880] [INFO ] [MAIN ] Derivative Progress: 296/1812 symbols completed. BTT took 1.4s. Estimated remaining: 9m 38s. Rate: 157.5 symbols/min [2025-10-14T22:34:49.513152] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:49.528954] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:49.530553] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53323 primary records. [2025-10-14T22:34:49.530678] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-14T22:34:49.549685] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-14T22:34:49.550547] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-14T22:34:49.553336] [INFO ] [MAIN ] Derivative Progress: 297/1812 symbols completed. BTU took 1.3s. Estimated remaining: 9m 35s. Rate: 158.0 symbols/min [2025-10-14T22:34:49.553600] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:49.567672] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:49.568365] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22641 primary records. [2025-10-14T22:34:49.568534] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-14T22:34:49.591547] [DEBUG] [LOCAL ] BUI: Loaded 11942 existing records from primary storage. [2025-10-14T22:34:49.608839] [INFO ] [MAIN ] BUI: Loaded 11942 primary data records. [2025-10-14T22:34:49.616273] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-14T22:34:49.637901] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-14T22:34:49.640217] [INFO ] [MAIN ] Derivative Progress: 298/1812 symbols completed. BTZ took 0.9s. Estimated remaining: 9m 34s. Rate: 158.4 symbols/min [2025-10-14T22:34:49.765172] [DEBUG] [LOCAL ] BUD: Loaded 52625 existing records from primary storage. [2025-10-14T22:34:49.794900] [INFO ] [MAIN ] BUD: Loaded 52625 primary data records. [2025-10-14T22:34:50.346623] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:50.348050] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11942 primary records. [2025-10-14T22:34:50.348295] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-14T22:34:50.379484] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:50.383165] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52625 primary records. [2025-10-14T22:34:50.383697] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-14T22:34:50.383813] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-14T22:34:50.384578] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-14T22:34:50.386707] [INFO ] [MAIN ] Derivative Progress: 299/1812 symbols completed. BUI took 0.8s. Estimated remaining: 9m 35s. Rate: 157.8 symbols/min [2025-10-14T22:34:50.401902] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-14T22:34:50.401975] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-14T22:34:50.404159] [INFO ] [MAIN ] Derivative Progress: 300/1812 symbols completed. BUD took 0.9s. Estimated remaining: 9m 33s. Rate: 158.4 symbols/min [2025-10-14T22:34:50.404620] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:50.404748] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:50.404559] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:50.459482] [DEBUG] [LOCAL ] BV: Loaded 38559 existing records from primary storage. [2025-10-14T22:34:50.460251] [INFO ] [MAIN ] BV: Loaded 38559 primary data records. [2025-10-14T22:34:50.529588] [DEBUG] [LOCAL ] BUR: Loaded 45343 existing records from primary storage. [2025-10-14T22:34:50.557782] [INFO ] [MAIN ] BUR: Loaded 45343 primary data records. [2025-10-14T22:34:50.571286] [DEBUG] [LOCAL ] BURL: Loaded 45744 existing records from primary storage. [2025-10-14T22:34:50.583895] [INFO ] [MAIN ] BURL: Loaded 45744 primary data records. [2025-10-14T22:34:51.457134] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:51.458327] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38559 primary records. [2025-10-14T22:34:51.458820] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-14T22:34:51.509375] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-10-14T22:34:51.510422] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-14T22:34:51.510314] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:51.511476] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45343 primary records. [2025-10-14T22:34:51.513274] [INFO ] [MAIN ] Derivative Progress: 301/1812 symbols completed. BV took 1.1s. Estimated remaining: 9m 36s. Rate: 157.3 symbols/min [2025-10-14T22:34:51.513771] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:51.514860] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45744 primary records. [2025-10-14T22:34:51.513945] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:51.515037] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-14T22:34:51.515166] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-14T22:34:51.552517] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-14T22:34:51.553682] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-14T22:34:51.555959] [INFO ] [MAIN ] Derivative Progress: 302/1812 symbols completed. BUR took 1.2s. Estimated remaining: 9m 34s. Rate: 157.8 symbols/min [2025-10-14T22:34:51.556770] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-14T22:34:51.556919] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:51.557622] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-14T22:34:51.560482] [INFO ] [MAIN ] Derivative Progress: 303/1812 symbols completed. BURL took 1.2s. Estimated remaining: 9m 32s. Rate: 158.3 symbols/min [2025-10-14T22:34:51.561037] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:51.597462] [DEBUG] [LOCAL ] BVN: Loaded 44242 existing records from primary storage. [2025-10-14T22:34:51.597764] [INFO ] [MAIN ] BVN: Loaded 44242 primary data records. [2025-10-14T22:34:51.784785] [DEBUG] [LOCAL ] BW: Loaded 40458 existing records from primary storage. [2025-10-14T22:34:51.839062] [DEBUG] [LOCAL ] BWA: Loaded 52150 existing records from primary storage. [2025-10-14T22:34:51.904240] [INFO ] [MAIN ] BW: Loaded 40458 primary data records. [2025-10-14T22:34:51.944818] [INFO ] [MAIN ] BWA: Loaded 52150 primary data records. [2025-10-14T22:34:52.619201] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:52.620580] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44242 primary records. [2025-10-14T22:34:52.621380] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-14T22:34:52.641581] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-14T22:34:52.642131] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-14T22:34:52.644235] [INFO ] [MAIN ] Derivative Progress: 304/1812 symbols completed. BVN took 1.1s. Estimated remaining: 9m 35s. Rate: 157.4 symbols/min [2025-10-14T22:34:52.645030] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:52.668910] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:52.670015] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 40458 primary records. [2025-10-14T22:34:52.683769] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-14T22:34:52.684128] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:52.698349] [DEBUG] [LOCAL ] BWG: Loaded 12616 existing records from primary storage. [2025-10-14T22:34:52.697947] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52150 primary records. [2025-10-14T22:34:52.702056] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-14T22:34:52.702677] [INFO ] [MAIN ] BWG: Loaded 12616 primary data records. [2025-10-14T22:34:52.797556] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-14T22:34:52.811085] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-14T22:34:52.818461] [INFO ] [MAIN ] Derivative Progress: 305/1812 symbols completed. BWA took 1.3s. Estimated remaining: 9m 34s. Rate: 157.6 symbols/min [2025-10-14T22:34:52.818927] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:52.852556] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-14T22:34:52.873742] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-14T22:34:52.924398] [INFO ] [MAIN ] Derivative Progress: 306/1812 symbols completed. BW took 1.4s. Estimated remaining: 9m 32s. Rate: 158.0 symbols/min [2025-10-14T22:34:53.041600] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:53.060325] [DEBUG] [LOCAL ] BWMX: Loaded 7777 existing records from primary storage. [2025-10-14T22:34:53.060596] [INFO ] [MAIN ] BWMX: Loaded 7777 primary data records. [2025-10-14T22:34:53.152489] [DEBUG] [LOCAL ] BWLP: Loaded 32295 existing records from primary storage. [2025-10-14T22:34:53.170252] [INFO ] [MAIN ] BWLP: Loaded 32295 primary data records. [2025-10-14T22:34:53.618089] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:53.618803] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12616 primary records. [2025-10-14T22:34:53.618877] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-14T22:34:53.805348] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-14T22:34:53.806073] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-14T22:34:53.808031] [INFO ] [MAIN ] Derivative Progress: 307/1812 symbols completed. BWG took 1.2s. Estimated remaining: 9m 34s. Rate: 157.3 symbols/min [2025-10-14T22:34:53.808305] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:53.826511] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:53.827300] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7777 primary records. [2025-10-14T22:34:53.829919] [DEBUG] [LOCAL ] BWNB: Loaded 4215 existing records from primary storage. [2025-10-14T22:34:53.827501] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-14T22:34:53.830874] [INFO ] [MAIN ] BWNB: Loaded 4215 primary data records. [2025-10-14T22:34:53.912267] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-14T22:34:53.934856] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-14T22:34:53.937118] [INFO ] [MAIN ] Derivative Progress: 308/1812 symbols completed. BWMX took 0.9s. Estimated remaining: 9m 32s. Rate: 157.7 symbols/min [2025-10-14T22:34:53.951224] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:54.161164] [DEBUG] [LOCAL ] BWSN: Loaded 5143 existing records from primary storage. [2025-10-14T22:34:54.161992] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:54.162861] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32295 primary records. [2025-10-14T22:34:54.163493] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-14T22:34:54.162063] [INFO ] [MAIN ] BWSN: Loaded 5143 primary data records. [2025-10-14T22:34:54.278375] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-14T22:34:54.287480] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-14T22:34:54.294798] [INFO ] [MAIN ] Derivative Progress: 309/1812 symbols completed. BWLP took 1.5s. Estimated remaining: 9m 32s. Rate: 157.7 symbols/min [2025-10-14T22:34:54.300082] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:54.501940] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:54.502832] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4215 primary records. [2025-10-14T22:34:54.503118] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-14T22:34:54.527831] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-14T22:34:54.527972] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-14T22:34:54.529937] [INFO ] [MAIN ] Derivative Progress: 310/1812 symbols completed. BWNB took 0.7s. Estimated remaining: 9m 31s. Rate: 157.9 symbols/min [2025-10-14T22:34:54.530312] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:54.547984] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:54.549016] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5143 primary records. [2025-10-14T22:34:54.560816] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-14T22:34:54.563282] [DEBUG] [LOCAL ] BWXT: Loaded 47039 existing records from primary storage. [2025-10-14T22:34:54.563425] [INFO ] [MAIN ] BWXT: Loaded 47039 primary data records. [2025-10-14T22:34:54.669669] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-14T22:34:54.701040] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-14T22:34:54.714027] [INFO ] [MAIN ] Derivative Progress: 311/1812 symbols completed. BWSN took 0.8s. Estimated remaining: 9m 29s. Rate: 158.2 symbols/min [2025-10-14T22:34:54.729699] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:54.920128] [DEBUG] [LOCAL ] BX: Loaded 53484 existing records from primary storage. [2025-10-14T22:34:54.926793] [INFO ] [MAIN ] BX: Loaded 53484 primary data records. [2025-10-14T22:34:54.926681] [DEBUG] [LOCAL ] BXC: Loaded 13691 existing records from primary storage. [2025-10-14T22:34:54.927066] [INFO ] [MAIN ] BXC: Loaded 13691 primary data records. [2025-10-14T22:34:55.586413] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:55.587449] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 47039 primary records. [2025-10-14T22:34:55.587549] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-14T22:34:55.606537] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-14T22:34:55.606760] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-14T22:34:55.609504] [INFO ] [MAIN ] Derivative Progress: 312/1812 symbols completed. BWXT took 1.3s. Estimated remaining: 9m 32s. Rate: 157.5 symbols/min [2025-10-14T22:34:55.610183] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:55.643124] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:55.643943] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:55.644934] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13691 primary records. [2025-10-14T22:34:55.645703] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53484 primary records. [2025-10-14T22:34:55.645840] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-14T22:34:55.645927] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-14T22:34:55.675811] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-14T22:34:55.676448] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-14T22:34:55.688356] [INFO ] [MAIN ] Derivative Progress: 313/1812 symbols completed. BXC took 1.0s. Estimated remaining: 9m 30s. Rate: 157.9 symbols/min [2025-10-14T22:34:55.691292] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-14T22:34:55.691412] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-14T22:34:55.693438] [INFO ] [MAIN ] Derivative Progress: 314/1812 symbols completed. BX took 1.2s. Estimated remaining: 9m 28s. Rate: 158.4 symbols/min [2025-10-14T22:34:55.710043] [DEBUG] [LOCAL ] BXMT: Loaded 47304 existing records from primary storage. [2025-10-14T22:34:55.710162] [INFO ] [MAIN ] BXMT: Loaded 47304 primary data records. [2025-10-14T22:34:56.050264] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:56.050921] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47304 primary records. [2025-10-14T22:34:56.050984] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-14T22:34:56.065967] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-14T22:34:56.066023] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-14T22:34:56.067847] [INFO ] [MAIN ] Derivative Progress: 315/1812 symbols completed. BXMT took 0.5s. Estimated remaining: 9m 27s. Rate: 158.4 symbols/min [2025-10-14T22:34:56.068435] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:56.068334] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:56.068949] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:56.090820] [DEBUG] [LOCAL ] BXMX: Loaded 19577 existing records from primary storage. [2025-10-14T22:34:56.090959] [INFO ] [MAIN ] BXMX: Loaded 19577 primary data records. [2025-10-14T22:34:56.288451] [DEBUG] [LOCAL ] BXSL: Loaded 48094 existing records from primary storage. [2025-10-14T22:34:56.329008] [INFO ] [MAIN ] BXSL: Loaded 48094 primary data records. [2025-10-14T22:34:56.445603] [DEBUG] [LOCAL ] BXP: Loaded 49862 existing records from primary storage. [2025-10-14T22:34:56.472413] [INFO ] [MAIN ] BXP: Loaded 49862 primary data records. [2025-10-14T22:34:57.064843] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:57.066712] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19577 primary records. [2025-10-14T22:34:57.067379] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-14T22:34:57.087007] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-14T22:34:57.088934] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-14T22:34:57.091457] [INFO ] [MAIN ] Derivative Progress: 316/1812 symbols completed. BXMX took 1.0s. Estimated remaining: 9m 30s. Rate: 157.5 symbols/min [2025-10-14T22:34:57.091893] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:57.105814] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:57.108920] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49862 primary records. [2025-10-14T22:34:57.109105] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-14T22:34:57.138779] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:57.140268] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 48094 primary records. [2025-10-14T22:34:57.140590] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-14T22:34:57.142978] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-14T22:34:57.143700] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-14T22:34:57.156967] [INFO ] [MAIN ] Derivative Progress: 317/1812 symbols completed. BXP took 1.1s. Estimated remaining: 9m 28s. Rate: 157.9 symbols/min [2025-10-14T22:34:57.158776] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:57.161974] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-14T22:34:57.162156] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-14T22:34:57.164848] [INFO ] [MAIN ] Derivative Progress: 318/1812 symbols completed. BXSL took 1.1s. Estimated remaining: 9m 26s. Rate: 158.4 symbols/min [2025-10-14T22:34:57.165121] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:57.185826] [DEBUG] [LOCAL ] BYM: Loaded 11730 existing records from primary storage. [2025-10-14T22:34:57.186043] [INFO ] [MAIN ] BYM: Loaded 11730 primary data records. [2025-10-14T22:34:57.289126] [DEBUG] [LOCAL ] BYD: Loaded 44865 existing records from primary storage. [2025-10-14T22:34:57.314564] [INFO ] [MAIN ] BYD: Loaded 44865 primary data records. [2025-10-14T22:34:57.620803] [DEBUG] [LOCAL ] BZH: Loaded 32491 existing records from primary storage. [2025-10-14T22:34:57.627162] [INFO ] [MAIN ] BZH: Loaded 32491 primary data records. [2025-10-14T22:34:58.185597] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:58.186606] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11730 primary records. [2025-10-14T22:34:58.194416] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-14T22:34:58.201325] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:58.213051] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44865 primary records. [2025-10-14T22:34:58.213384] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-14T22:34:58.230203] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-14T22:34:58.234387] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-14T22:34:58.234134] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-14T22:34:58.236895] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-14T22:34:58.236539] [INFO ] [MAIN ] Derivative Progress: 319/1812 symbols completed. BYM took 1.1s. Estimated remaining: 9m 29s. Rate: 157.5 symbols/min [2025-10-14T22:34:58.239492] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:58.239600] [INFO ] [MAIN ] Derivative Progress: 320/1812 symbols completed. BYD took 1.1s. Estimated remaining: 9m 27s. Rate: 158.0 symbols/min [2025-10-14T22:34:58.240224] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:58.257053] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:58.257752] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32491 primary records. [2025-10-14T22:34:58.257849] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-14T22:34:58.280011] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-14T22:34:58.280163] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-14T22:34:58.282345] [INFO ] [MAIN ] Derivative Progress: 321/1812 symbols completed. BZH took 1.1s. Estimated remaining: 9m 25s. Rate: 158.5 symbols/min [2025-10-14T22:34:58.282563] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:58.290160] [DEBUG] [LOCAL ] CAAP: Loaded 19791 existing records from primary storage. [2025-10-14T22:34:58.290275] [INFO ] [MAIN ] CAAP: Loaded 19791 primary data records. [2025-10-14T22:34:58.515788] [DEBUG] [LOCAL ] CABO: Loaded 16823 existing records from primary storage. [2025-10-14T22:34:58.636167] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-14T22:34:58.626707] [INFO ] [MAIN ] CABO: Loaded 16823 primary data records. [2025-10-14T22:34:58.642260] [INFO ] [MAIN ] C: Loaded 53740 primary data records. [2025-10-14T22:34:59.295974] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:59.298128] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19791 primary records. [2025-10-14T22:34:59.298568] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-14T22:34:59.316560] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-14T22:34:59.317030] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-14T22:34:59.319194] [INFO ] [MAIN ] Derivative Progress: 322/1812 symbols completed. CAAP took 1.1s. Estimated remaining: 9m 27s. Rate: 157.6 symbols/min [2025-10-14T22:34:59.319482] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:59.338740] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:59.339759] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16823 primary records. [2025-10-14T22:34:59.340282] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-14T22:34:59.375297] [DEBUG] [LOCAL ] CACI: Loaded 23249 existing records from primary storage. [2025-10-14T22:34:59.375810] [INFO ] [MAIN ] CACI: Loaded 23249 primary data records. [2025-10-14T22:34:59.376487] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-14T22:34:59.376598] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-14T22:34:59.411903] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:59.436284] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53740 primary records. [2025-10-14T22:34:59.459624] [INFO ] [MAIN ] Derivative Progress: 323/1812 symbols completed. CABO took 1.2s. Estimated remaining: 9m 26s. Rate: 157.9 symbols/min [2025-10-14T22:34:59.471595] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:59.482404] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-14T22:34:59.751414] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-14T22:34:59.752412] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-14T22:34:59.755631] [INFO ] [MAIN ] Derivative Progress: 324/1812 symbols completed. C took 1.5s. Estimated remaining: 9m 25s. Rate: 158.0 symbols/min [2025-10-14T22:34:59.756128] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:34:59.799140] [DEBUG] [LOCAL ] CADE: Loaded 49416 existing records from primary storage. [2025-10-14T22:34:59.809309] [INFO ] [MAIN ] CADE: Loaded 49416 primary data records. [2025-10-14T22:34:59.859523] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:34:59.866680] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 23249 primary records. [2025-10-14T22:34:59.892617] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-14T22:34:59.952418] [DEBUG] [LOCAL ] CAE: Loaded 39218 existing records from primary storage. [2025-10-14T22:34:59.972253] [INFO ] [MAIN ] CAE: Loaded 39218 primary data records. [2025-10-14T22:34:59.972357] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-14T22:35:00.007316] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-14T22:35:00.065732] [INFO ] [MAIN ] Derivative Progress: 325/1812 symbols completed. CACI took 0.7s. Estimated remaining: 9m 24s. Rate: 158.1 symbols/min [2025-10-14T22:35:00.195312] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:00.287097] [DEBUG] [LOCAL ] CAF: Loaded 3450 existing records from primary storage. [2025-10-14T22:35:00.345160] [INFO ] [MAIN ] CAF: Loaded 3450 primary data records. [2025-10-14T22:35:00.789304] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:00.806046] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49416 primary records. [2025-10-14T22:35:00.806138] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-14T22:35:00.843268] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-14T22:35:00.843753] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-14T22:35:00.845913] [INFO ] [MAIN ] Derivative Progress: 326/1812 symbols completed. CADE took 1.4s. Estimated remaining: 9m 26s. Rate: 157.6 symbols/min [2025-10-14T22:35:00.843574] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:00.847245] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39218 primary records. [2025-10-14T22:35:00.846164] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:00.847394] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-14T22:35:00.866422] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-14T22:35:00.866625] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-14T22:35:00.868983] [INFO ] [MAIN ] Derivative Progress: 327/1812 symbols completed. CAE took 1.1s. Estimated remaining: 9m 24s. Rate: 158.1 symbols/min [2025-10-14T22:35:00.869353] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:00.888376] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:00.889082] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3450 primary records. [2025-10-14T22:35:00.889162] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-14T22:35:00.904380] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-14T22:35:00.904537] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-14T22:35:00.907043] [INFO ] [MAIN ] Derivative Progress: 328/1812 symbols completed. CAF took 0.7s. Estimated remaining: 9m 22s. Rate: 158.5 symbols/min [2025-10-14T22:35:00.963037] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-14T22:35:00.976368] [INFO ] [MAIN ] CAG: Loaded 53665 primary data records. [2025-10-14T22:35:01.024425] [DEBUG] [LOCAL ] CAH: Loaded 51482 existing records from primary storage. [2025-10-14T22:35:01.051898] [INFO ] [MAIN ] CAH: Loaded 51482 primary data records. [2025-10-14T22:35:01.727697] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:01.728542] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51482 primary records. [2025-10-14T22:35:01.728625] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-14T22:35:01.745999] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-14T22:35:01.746067] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-14T22:35:01.748607] [INFO ] [MAIN ] Derivative Progress: 329/1812 symbols completed. CAH took 0.9s. Estimated remaining: 9m 24s. Rate: 157.9 symbols/min [2025-10-14T22:35:01.769334] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:01.770292] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53665 primary records. [2025-10-14T22:35:01.770378] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-14T22:35:01.789082] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-14T22:35:01.789291] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-14T22:35:01.792540] [INFO ] [MAIN ] Derivative Progress: 330/1812 symbols completed. CAG took 0.9s. Estimated remaining: 9m 22s. Rate: 158.3 symbols/min [2025-10-14T22:35:01.793329] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:01.793414] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:01.793230] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:01.802889] [DEBUG] [LOCAL ] CAPL: Loaded 5645 existing records from primary storage. [2025-10-14T22:35:01.803150] [INFO ] [MAIN ] CAPL: Loaded 5645 primary data records. [2025-10-14T22:35:02.148868] [DEBUG] [LOCAL ] CALX: Loaded 37675 existing records from primary storage. [2025-10-14T22:35:02.149517] [INFO ] [MAIN ] CALX: Loaded 37675 primary data records. [2025-10-14T22:35:02.240229] [DEBUG] [LOCAL ] CAL: Loaded 43003 existing records from primary storage. [2025-10-14T22:35:02.269032] [INFO ] [MAIN ] CAL: Loaded 43003 primary data records. [2025-10-14T22:35:02.812589] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:02.813974] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5645 primary records. [2025-10-14T22:35:02.814531] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-14T22:35:02.840817] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-14T22:35:02.841300] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-14T22:35:02.843923] [INFO ] [MAIN ] Derivative Progress: 331/1812 symbols completed. CAPL took 1.1s. Estimated remaining: 9m 24s. Rate: 157.5 symbols/min [2025-10-14T22:35:02.852038] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:02.859188] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:02.860275] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37675 primary records. [2025-10-14T22:35:02.860611] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-14T22:35:02.886903] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-14T22:35:02.891955] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-14T22:35:02.891900] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:02.895224] [INFO ] [MAIN ] Derivative Progress: 332/1812 symbols completed. CALX took 1.1s. Estimated remaining: 9m 22s. Rate: 157.9 symbols/min [2025-10-14T22:35:02.896211] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43003 primary records. [2025-10-14T22:35:02.896335] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:02.896929] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-14T22:35:02.915405] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-14T22:35:02.915814] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-14T22:35:02.919369] [INFO ] [MAIN ] Derivative Progress: 333/1812 symbols completed. CAL took 1.1s. Estimated remaining: 9m 20s. Rate: 158.3 symbols/min [2025-10-14T22:35:02.919866] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:02.970686] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-14T22:35:02.970871] [INFO ] [MAIN ] CARR: Loaded 53602 primary data records. [2025-10-14T22:35:03.079638] [DEBUG] [LOCAL ] CARS: Loaded 39798 existing records from primary storage. [2025-10-14T22:35:03.107147] [INFO ] [MAIN ] CARS: Loaded 39798 primary data records. [2025-10-14T22:35:03.488700] [DEBUG] [LOCAL ] CAT: Loaded 52943 existing records from primary storage. [2025-10-14T22:35:03.513543] [INFO ] [MAIN ] CAT: Loaded 52943 primary data records. [2025-10-14T22:35:04.133602] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:04.135829] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39798 primary records. [2025-10-14T22:35:04.137448] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-14T22:35:04.158967] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:04.163608] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53602 primary records. [2025-10-14T22:35:04.164438] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-14T22:35:04.179775] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-14T22:35:04.180389] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-14T22:35:04.182734] [INFO ] [MAIN ] Derivative Progress: 334/1812 symbols completed. CARS took 1.3s. Estimated remaining: 9m 24s. Rate: 157.2 symbols/min [2025-10-14T22:35:04.183126] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:04.192233] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-14T22:35:04.193302] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-14T22:35:04.195369] [INFO ] [MAIN ] Derivative Progress: 335/1812 symbols completed. CARR took 1.3s. Estimated remaining: 9m 22s. Rate: 157.7 symbols/min [2025-10-14T22:35:04.195614] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:04.200858] [DEBUG] [LOCAL ] CATO: Loaded 6737 existing records from primary storage. [2025-10-14T22:35:04.213576] [INFO ] [MAIN ] CATO: Loaded 6737 primary data records. [2025-10-14T22:35:04.219193] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:04.232969] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52943 primary records. [2025-10-14T22:35:04.240072] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-14T22:35:04.345896] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-14T22:35:04.360225] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-14T22:35:04.363078] [INFO ] [MAIN ] Derivative Progress: 336/1812 symbols completed. CAT took 1.4s. Estimated remaining: 9m 21s. Rate: 158.0 symbols/min [2025-10-14T22:35:04.368558] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:04.603424] [DEBUG] [LOCAL ] CBAN: Loaded 10508 existing records from primary storage. [2025-10-14T22:35:04.603837] [INFO ] [MAIN ] CBAN: Loaded 10508 primary data records. [2025-10-14T22:35:04.702067] [DEBUG] [LOCAL ] CB: Loaded 49935 existing records from primary storage. [2025-10-14T22:35:04.713830] [INFO ] [MAIN ] CB: Loaded 49935 primary data records. [2025-10-14T22:35:05.225614] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:05.227441] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 6737 primary records. [2025-10-14T22:35:05.227885] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-14T22:35:05.245081] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-14T22:35:05.246149] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-14T22:35:05.248435] [INFO ] [MAIN ] Derivative Progress: 337/1812 symbols completed. CATO took 1.1s. Estimated remaining: 9m 22s. Rate: 157.3 symbols/min [2025-10-14T22:35:05.249502] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:05.267037] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:05.267894] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10508 primary records. [2025-10-14T22:35:05.268062] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-14T22:35:05.284836] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-14T22:35:05.291592] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-14T22:35:05.294554] [INFO ] [MAIN ] Derivative Progress: 338/1812 symbols completed. CBAN took 0.9s. Estimated remaining: 9m 21s. Rate: 157.7 symbols/min [2025-10-14T22:35:05.294827] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:05.314424] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:05.316187] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49935 primary records. [2025-10-14T22:35:05.316327] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-14T22:35:05.321266] [DEBUG] [LOCAL ] CBNA: Loaded 2912 existing records from primary storage. [2025-10-14T22:35:05.329388] [DEBUG] [LOCAL ] CBL: Loaded 16285 existing records from primary storage. [2025-10-14T22:35:05.333729] [INFO ] [MAIN ] CBNA: Loaded 2912 primary data records. [2025-10-14T22:35:05.334363] [INFO ] [MAIN ] CBL: Loaded 16285 primary data records. [2025-10-14T22:35:05.409748] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-14T22:35:05.438043] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-14T22:35:05.462077] [INFO ] [MAIN ] Derivative Progress: 339/1812 symbols completed. CB took 1.3s. Estimated remaining: 9m 19s. Rate: 158.0 symbols/min [2025-10-14T22:35:05.525419] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:06.017508] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-14T22:35:06.020450] [INFO ] [MAIN ] CBNA: Generated 1791 derivative records from 2912 primary records. [2025-10-14T22:35:06.020560] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-14T22:35:06.065341] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:06.066805] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16285 primary records. [2025-10-14T22:35:06.070518] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-14T22:35:06.072809] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1791 records). [2025-10-14T22:35:06.080189] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-14T22:35:06.070129] [DEBUG] [LOCAL ] CBRE: Loaded 50370 existing records from primary storage. [2025-10-14T22:35:06.083788] [INFO ] [MAIN ] Derivative Progress: 340/1812 symbols completed. CBNA took 0.8s. Estimated remaining: 9m 20s. Rate: 157.7 symbols/min [2025-10-14T22:35:06.086918] [INFO ] [MAIN ] CBRE: Loaded 50370 primary data records. [2025-10-14T22:35:06.086811] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:06.137466] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-14T22:35:06.171994] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-14T22:35:06.179721] [INFO ] [MAIN ] Derivative Progress: 341/1812 symbols completed. CBL took 0.9s. Estimated remaining: 9m 18s. Rate: 158.1 symbols/min [2025-10-14T22:35:06.179949] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:06.453689] [DEBUG] [LOCAL ] CBT: Loaded 31069 existing records from primary storage. [2025-10-14T22:35:06.471835] [DEBUG] [LOCAL ] CBU: Loaded 22672 existing records from primary storage. [2025-10-14T22:35:06.471332] [INFO ] [MAIN ] CBT: Loaded 31069 primary data records. [2025-10-14T22:35:06.472165] [INFO ] [MAIN ] CBU: Loaded 22672 primary data records. [2025-10-14T22:35:07.121854] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:07.124380] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50370 primary records. [2025-10-14T22:35:07.125062] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-14T22:35:07.151212] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-14T22:35:07.152143] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-14T22:35:07.154446] [INFO ] [MAIN ] Derivative Progress: 342/1812 symbols completed. CBRE took 1.6s. Estimated remaining: 9m 21s. Rate: 157.3 symbols/min [2025-10-14T22:35:07.154749] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:07.170479] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:07.171433] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31069 primary records. [2025-10-14T22:35:07.171874] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-14T22:35:07.202677] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:07.216124] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22672 primary records. [2025-10-14T22:35:07.216306] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-14T22:35:07.215188] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-14T22:35:07.216679] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-14T22:35:07.218990] [INFO ] [MAIN ] Derivative Progress: 343/1812 symbols completed. CBT took 1.1s. Estimated remaining: 9m 19s. Rate: 157.7 symbols/min [2025-10-14T22:35:07.248237] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-14T22:35:07.249079] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-14T22:35:07.252015] [INFO ] [MAIN ] Derivative Progress: 344/1812 symbols completed. CBU took 1.1s. Estimated remaining: 9m 17s. Rate: 158.1 symbols/min [2025-10-14T22:35:07.248877] [DEBUG] [LOCAL ] CBZ: Loaded 34151 existing records from primary storage. [2025-10-14T22:35:07.252458] [INFO ] [MAIN ] CBZ: Loaded 34151 primary data records. [2025-10-14T22:35:07.554524] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:07.555179] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 34151 primary records. [2025-10-14T22:35:07.555243] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-14T22:35:07.570421] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-14T22:35:07.570476] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-14T22:35:07.572475] [INFO ] [MAIN ] Derivative Progress: 345/1812 symbols completed. CBZ took 0.4s. Estimated remaining: 9m 16s. Rate: 158.2 symbols/min [2025-10-14T22:35:07.573082] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:07.573007] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:07.573560] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:07.648983] [DEBUG] [LOCAL ] CCJ: Loaded 53686 existing records from primary storage. [2025-10-14T22:35:07.676337] [INFO ] [MAIN ] CCJ: Loaded 53686 primary data records. [2025-10-14T22:35:07.677237] [DEBUG] [LOCAL ] CCI: Loaded 53124 existing records from primary storage. [2025-10-14T22:35:07.677357] [INFO ] [MAIN ] CCI: Loaded 53124 primary data records. [2025-10-14T22:35:07.677996] [DEBUG] [LOCAL ] CC: Loaded 53008 existing records from primary storage. [2025-10-14T22:35:07.709575] [INFO ] [MAIN ] CC: Loaded 53008 primary data records. [2025-10-14T22:35:08.616399] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:08.641126] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53686 primary records. [2025-10-14T22:35:08.641266] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-14T22:35:08.649522] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:08.656934] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53124 primary records. [2025-10-14T22:35:08.653745] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:08.657034] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-14T22:35:08.658465] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53008 primary records. [2025-10-14T22:35:08.659273] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-14T22:35:08.659321] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-14T22:35:08.660052] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-14T22:35:08.662048] [INFO ] [MAIN ] Derivative Progress: 346/1812 symbols completed. CCJ took 1.1s. Estimated remaining: 9m 19s. Rate: 157.4 symbols/min [2025-10-14T22:35:08.669343] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:08.688320] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-14T22:35:08.688622] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-14T22:35:08.691905] [INFO ] [MAIN ] Derivative Progress: 347/1812 symbols completed. CCI took 1.1s. Estimated remaining: 9m 17s. Rate: 157.8 symbols/min [2025-10-14T22:35:08.692057] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:08.696135] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-14T22:35:08.696310] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-14T22:35:08.698606] [INFO ] [MAIN ] Derivative Progress: 348/1812 symbols completed. CC took 1.1s. Estimated remaining: 9m 15s. Rate: 158.2 symbols/min [2025-10-14T22:35:08.698921] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:08.760151] [DEBUG] [LOCAL ] CCK: Loaded 46416 existing records from primary storage. [2025-10-14T22:35:08.760410] [INFO ] [MAIN ] CCK: Loaded 46416 primary data records. [2025-10-14T22:35:08.863833] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-14T22:35:08.892565] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-14T22:35:08.929480] [DEBUG] [LOCAL ] CCO: Loaded 48290 existing records from primary storage. [2025-10-14T22:35:08.956850] [INFO ] [MAIN ] CCO: Loaded 48290 primary data records. [2025-10-14T22:35:09.767364] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:09.768347] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46416 primary records. [2025-10-14T22:35:09.768591] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-14T22:35:09.784910] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-14T22:35:09.785076] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-14T22:35:09.787676] [INFO ] [MAIN ] Derivative Progress: 349/1812 symbols completed. CCK took 1.1s. Estimated remaining: 9m 18s. Rate: 157.4 symbols/min [2025-10-14T22:35:09.787980] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:09.808617] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:09.821320] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-14T22:35:09.821476] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-14T22:35:09.821856] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:09.826038] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48290 primary records. [2025-10-14T22:35:09.826926] [DEBUG] [LOCAL ] CCRD: Loaded 9483 existing records from primary storage. [2025-10-14T22:35:09.827023] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-14T22:35:09.827088] [INFO ] [MAIN ] CCRD: Loaded 9483 primary data records. [2025-10-14T22:35:09.919531] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-14T22:35:09.925004] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-14T22:35:09.934562] [INFO ] [MAIN ] Derivative Progress: 350/1812 symbols completed. CCO took 1.2s. Estimated remaining: 9m 16s. Rate: 157.7 symbols/min [2025-10-14T22:35:09.935487] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-14T22:35:09.959395] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-14T22:35:09.961492] [INFO ] [MAIN ] Derivative Progress: 351/1812 symbols completed. CCL took 1.3s. Estimated remaining: 9m 15s. Rate: 158.1 symbols/min [2025-10-14T22:35:09.945951] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:09.965006] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:10.199939] [DEBUG] [LOCAL ] CCU: Loaded 22426 existing records from primary storage. [2025-10-14T22:35:10.200211] [INFO ] [MAIN ] CCU: Loaded 22426 primary data records. [2025-10-14T22:35:10.274867] [DEBUG] [LOCAL ] CCS: Loaded 30327 existing records from primary storage. [2025-10-14T22:35:10.287077] [INFO ] [MAIN ] CCS: Loaded 30327 primary data records. [2025-10-14T22:35:10.815392] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:10.816565] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9483 primary records. [2025-10-14T22:35:10.816707] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-14T22:35:10.838087] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-14T22:35:10.838707] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-14T22:35:10.840828] [INFO ] [MAIN ] Derivative Progress: 352/1812 symbols completed. CCRD took 1.1s. Estimated remaining: 9m 16s. Rate: 157.5 symbols/min [2025-10-14T22:35:10.841523] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:10.860114] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:10.860845] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 22426 primary records. [2025-10-14T22:35:10.860996] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-14T22:35:10.891037] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:10.892767] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-14T22:35:10.891929] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30327 primary records. [2025-10-14T22:35:10.892996] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-14T22:35:10.896029] [INFO ] [MAIN ] Derivative Progress: 353/1812 symbols completed. CCU took 0.9s. Estimated remaining: 9m 15s. Rate: 157.9 symbols/min [2025-10-14T22:35:10.893067] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-14T22:35:10.896250] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:10.917777] [DEBUG] [LOCAL ] CDLR: Loaded 10012 existing records from primary storage. [2025-10-14T22:35:10.918199] [INFO ] [MAIN ] CDLR: Loaded 10012 primary data records. [2025-10-14T22:35:10.965307] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-14T22:35:10.971257] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-14T22:35:10.979369] [INFO ] [MAIN ] Derivative Progress: 354/1812 symbols completed. CCS took 1.0s. Estimated remaining: 9m 13s. Rate: 158.2 symbols/min [2025-10-14T22:35:11.000263] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:11.095766] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-14T22:35:11.104503] [INFO ] [MAIN ] CDE: Loaded 53643 primary data records. [2025-10-14T22:35:11.560805] [DEBUG] [LOCAL ] CDP: Loaded 42524 existing records from primary storage. [2025-10-14T22:35:11.561319] [INFO ] [MAIN ] CDP: Loaded 42524 primary data records. [2025-10-14T22:35:11.762263] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:11.762939] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 10012 primary records. [2025-10-14T22:35:11.855111] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-14T22:35:11.939161] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-14T22:35:11.939551] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-14T22:35:11.942330] [INFO ] [MAIN ] Derivative Progress: 355/1812 symbols completed. CDLR took 1.0s. Estimated remaining: 9m 15s. Rate: 157.5 symbols/min [2025-10-14T22:35:11.942574] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:11.959812] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:11.960902] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53643 primary records. [2025-10-14T22:35:11.961073] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-14T22:35:11.986836] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-14T22:35:11.987157] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-14T22:35:11.989224] [INFO ] [MAIN ] Derivative Progress: 356/1812 symbols completed. CDE took 1.1s. Estimated remaining: 9m 13s. Rate: 157.9 symbols/min [2025-10-14T22:35:11.996186] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:12.010199] [DEBUG] [LOCAL ] CDRE: Loaded 24873 existing records from primary storage. [2025-10-14T22:35:12.010519] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:12.010710] [INFO ] [MAIN ] CDRE: Loaded 24873 primary data records. [2025-10-14T22:35:12.011484] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42524 primary records. [2025-10-14T22:35:12.031989] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-14T22:35:12.125870] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-14T22:35:12.129192] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-14T22:35:12.137184] [INFO ] [MAIN ] Derivative Progress: 357/1812 symbols completed. CDP took 1.1s. Estimated remaining: 9m 12s. Rate: 158.2 symbols/min [2025-10-14T22:35:12.147757] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:12.339398] [DEBUG] [LOCAL ] CEE: Loaded 5395 existing records from primary storage. [2025-10-14T22:35:12.339639] [INFO ] [MAIN ] CEE: Loaded 5395 primary data records. [2025-10-14T22:35:12.484438] [DEBUG] [LOCAL ] CE: Loaded 51362 existing records from primary storage. [2025-10-14T22:35:12.516792] [INFO ] [MAIN ] CE: Loaded 51362 primary data records. [2025-10-14T22:35:12.987687] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:12.988926] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24873 primary records. [2025-10-14T22:35:12.989542] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-14T22:35:13.012424] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-14T22:35:13.014287] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-14T22:35:13.016506] [INFO ] [MAIN ] Derivative Progress: 358/1812 symbols completed. CDRE took 1.1s. Estimated remaining: 9m 14s. Rate: 157.6 symbols/min [2025-10-14T22:35:13.030309] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:13.030938] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5395 primary records. [2025-10-14T22:35:13.031082] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-14T22:35:13.058722] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:13.060124] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51362 primary records. [2025-10-14T22:35:13.060424] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-14T22:35:13.061540] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-14T22:35:13.061845] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-14T22:35:13.063903] [INFO ] [MAIN ] Derivative Progress: 359/1812 symbols completed. CEE took 0.9s. Estimated remaining: 9m 12s. Rate: 158.0 symbols/min [2025-10-14T22:35:13.078474] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-14T22:35:13.078534] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-14T22:35:13.080627] [INFO ] [MAIN ] Derivative Progress: 360/1812 symbols completed. CE took 1.1s. Estimated remaining: 9m 10s. Rate: 158.4 symbols/min [2025-10-14T22:35:13.080986] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:13.081129] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:13.081395] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:13.115203] [DEBUG] [LOCAL ] CEPU: Loaded 26472 existing records from primary storage. [2025-10-14T22:35:13.115374] [INFO ] [MAIN ] CEPU: Loaded 26472 primary data records. [2025-10-14T22:35:13.281806] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-14T22:35:13.298547] [INFO ] [MAIN ] CFG: Loaded 53622 primary data records. [2025-10-14T22:35:13.373670] [DEBUG] [LOCAL ] CF: Loaded 52133 existing records from primary storage. [2025-10-14T22:35:13.526179] [INFO ] [MAIN ] CF: Loaded 52133 primary data records. [2025-10-14T22:35:14.184141] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:14.185057] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 26472 primary records. [2025-10-14T22:35:14.185337] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-14T22:35:14.233778] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:14.234475] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52133 primary records. [2025-10-14T22:35:14.232668] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:14.235142] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53622 primary records. [2025-10-14T22:35:14.233492] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-14T22:35:14.235233] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-14T22:35:14.235317] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-14T22:35:14.236003] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-14T22:35:14.237946] [INFO ] [MAIN ] Derivative Progress: 361/1812 symbols completed. CEPU took 1.2s. Estimated remaining: 9m 13s. Rate: 157.5 symbols/min [2025-10-14T22:35:14.246832] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:14.271543] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-14T22:35:14.272362] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-14T22:35:14.272103] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-14T22:35:14.275082] [INFO ] [MAIN ] Derivative Progress: 362/1812 symbols completed. CF took 1.2s. Estimated remaining: 9m 11s. Rate: 157.9 symbols/min [2025-10-14T22:35:14.275336] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:14.275248] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-14T22:35:14.278275] [INFO ] [MAIN ] Derivative Progress: 363/1812 symbols completed. CFG took 1.2s. Estimated remaining: 9m 9s. Rate: 158.3 symbols/min [2025-10-14T22:35:14.278544] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:14.284432] [DEBUG] [LOCAL ] CGV: Loaded 1397 existing records from primary storage. [2025-10-14T22:35:14.284596] [INFO ] [MAIN ] CGV: Loaded 1397 primary data records. [2025-10-14T22:35:14.441844] [DEBUG] [LOCAL ] CFR: Loaded 32654 existing records from primary storage. [2025-10-14T22:35:14.448121] [INFO ] [MAIN ] CFR: Loaded 32654 primary data records. [2025-10-14T22:35:14.760165] [DEBUG] [LOCAL ] CGAU: Loaded 43482 existing records from primary storage. [2025-10-14T22:35:14.774824] [INFO ] [MAIN ] CGAU: Loaded 43482 primary data records. [2025-10-14T22:35:15.282334] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:35:15.283365] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1397 primary records. [2025-10-14T22:35:15.283594] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-14T22:35:15.299757] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-14T22:35:15.300495] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-14T22:35:15.303320] [INFO ] [MAIN ] Derivative Progress: 364/1812 symbols completed. CGV took 1.0s. Estimated remaining: 9m 11s. Rate: 157.6 symbols/min [2025-10-14T22:35:15.304426] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:15.319246] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:15.320110] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 32654 primary records. [2025-10-14T22:35:15.320380] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-14T22:35:15.346867] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-14T22:35:15.354766] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-14T22:35:15.368876] [INFO ] [MAIN ] Derivative Progress: 365/1812 symbols completed. CFR took 1.1s. Estimated remaining: 9m 10s. Rate: 158.0 symbols/min [2025-10-14T22:35:15.370294] [DEBUG] [LOCAL ] CHCT: Loaded 24137 existing records from primary storage. [2025-10-14T22:35:15.370892] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:15.370987] [INFO ] [MAIN ] CHCT: Loaded 24137 primary data records. [2025-10-14T22:35:15.370759] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:15.371931] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 43482 primary records. [2025-10-14T22:35:15.385480] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-14T22:35:15.518221] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-14T22:35:15.518343] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-14T22:35:15.520858] [INFO ] [MAIN ] Derivative Progress: 366/1812 symbols completed. CGAU took 1.2s. Estimated remaining: 9m 8s. Rate: 158.2 symbols/min [2025-10-14T22:35:15.521459] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:15.765241] [DEBUG] [LOCAL ] CHE: Loaded 15380 existing records from primary storage. [2025-10-14T22:35:15.779911] [INFO ] [MAIN ] CHE: Loaded 15380 primary data records. [2025-10-14T22:35:15.827664] [DEBUG] [LOCAL ] CHD: Loaded 52310 existing records from primary storage. [2025-10-14T22:35:15.854348] [INFO ] [MAIN ] CHD: Loaded 52310 primary data records. [2025-10-14T22:35:16.450297] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:16.453109] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24137 primary records. [2025-10-14T22:35:16.453676] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-14T22:35:16.473908] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-14T22:35:16.474283] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-14T22:35:16.476700] [INFO ] [MAIN ] Derivative Progress: 367/1812 symbols completed. CHCT took 1.2s. Estimated remaining: 9m 10s. Rate: 157.6 symbols/min [2025-10-14T22:35:16.476911] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:16.494428] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:16.495170] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15380 primary records. [2025-10-14T22:35:16.495323] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-14T22:35:16.514638] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-14T22:35:16.528226] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-14T22:35:16.530337] [INFO ] [MAIN ] Derivative Progress: 368/1812 symbols completed. CHE took 1.0s. Estimated remaining: 9m 9s. Rate: 157.9 symbols/min [2025-10-14T22:35:16.530951] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:16.531883] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52310 primary records. [2025-10-14T22:35:16.530572] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:16.542950] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-14T22:35:16.574561] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-14T22:35:16.575013] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-14T22:35:16.577638] [INFO ] [MAIN ] Derivative Progress: 369/1812 symbols completed. CHD took 1.2s. Estimated remaining: 9m 7s. Rate: 158.3 symbols/min [2025-10-14T22:35:16.578094] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:16.579729] [DEBUG] [LOCAL ] CHGG: Loaded 47711 existing records from primary storage. [2025-10-14T22:35:16.586626] [INFO ] [MAIN ] CHGG: Loaded 47711 primary data records. [2025-10-14T22:35:16.679981] [DEBUG] [LOCAL ] CHH: Loaded 32451 existing records from primary storage. [2025-10-14T22:35:16.713202] [INFO ] [MAIN ] CHH: Loaded 32451 primary data records. [2025-10-14T22:35:16.810081] [DEBUG] [LOCAL ] CHMI: Loaded 21630 existing records from primary storage. [2025-10-14T22:35:16.826425] [INFO ] [MAIN ] CHMI: Loaded 21630 primary data records. [2025-10-14T22:35:17.579315] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:17.580279] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32451 primary records. [2025-10-14T22:35:17.580727] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:17.581488] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47711 primary records. [2025-10-14T22:35:17.581912] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-14T22:35:17.582038] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-14T22:35:17.615320] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-14T22:35:17.617356] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-14T22:35:17.617595] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-14T22:35:17.617673] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-14T22:35:17.619608] [INFO ] [MAIN ] Derivative Progress: 370/1812 symbols completed. CHH took 1.1s. Estimated remaining: 9m 9s. Rate: 157.6 symbols/min [2025-10-14T22:35:17.619819] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:17.622703] [INFO ] [MAIN ] Derivative Progress: 371/1812 symbols completed. CHGG took 1.1s. Estimated remaining: 9m 7s. Rate: 158.0 symbols/min [2025-10-14T22:35:17.622981] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:17.636692] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:17.637421] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21630 primary records. [2025-10-14T22:35:17.637707] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-14T22:35:17.661756] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-14T22:35:17.668468] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-14T22:35:17.668971] [DEBUG] [LOCAL ] CHT: Loaded 19461 existing records from primary storage. [2025-10-14T22:35:17.669154] [INFO ] [MAIN ] CHT: Loaded 19461 primary data records. [2025-10-14T22:35:17.671624] [INFO ] [MAIN ] Derivative Progress: 372/1812 symbols completed. CHMI took 1.1s. Estimated remaining: 9m 6s. Rate: 158.4 symbols/min [2025-10-14T22:35:17.672018] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:18.050695] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-14T22:35:18.060010] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-10-14T22:35:18.208609] [DEBUG] [LOCAL ] CI: Loaded 49778 existing records from primary storage. [2025-10-14T22:35:18.255479] [INFO ] [MAIN ] CI: Loaded 49778 primary data records. [2025-10-14T22:35:18.693325] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:18.694484] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19461 primary records. [2025-10-14T22:35:18.694808] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-14T22:35:18.717638] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-10-14T22:35:18.717997] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-14T22:35:18.720514] [INFO ] [MAIN ] Derivative Progress: 373/1812 symbols completed. CHT took 1.1s. Estimated remaining: 9m 8s. Rate: 157.6 symbols/min [2025-10-14T22:35:18.734464] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:18.735330] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-10-14T22:35:18.735517] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-14T22:35:18.753787] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-14T22:35:18.753933] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-14T22:35:18.756519] [INFO ] [MAIN ] Derivative Progress: 374/1812 symbols completed. CHWY took 1.1s. Estimated remaining: 9m 6s. Rate: 158.0 symbols/min [2025-10-14T22:35:18.769270] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:18.769865] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49778 primary records. [2025-10-14T22:35:18.769924] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-14T22:35:18.784869] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-14T22:35:18.784926] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-14T22:35:18.787794] [INFO ] [MAIN ] Derivative Progress: 375/1812 symbols completed. CI took 1.1s. Estimated remaining: 9m 4s. Rate: 158.4 symbols/min [2025-10-14T22:35:18.788222] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:18.788159] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:18.788834] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:18.811286] [DEBUG] [LOCAL ] CIA: Loaded 16701 existing records from primary storage. [2025-10-14T22:35:18.819036] [INFO ] [MAIN ] CIA: Loaded 16701 primary data records. [2025-10-14T22:35:18.911908] [DEBUG] [LOCAL ] CIB: Loaded 30546 existing records from primary storage. [2025-10-14T22:35:18.946509] [INFO ] [MAIN ] CIB: Loaded 30546 primary data records. [2025-10-14T22:35:19.181881] [DEBUG] [LOCAL ] CIEN: Loaded 52153 existing records from primary storage. [2025-10-14T22:35:19.277268] [INFO ] [MAIN ] CIEN: Loaded 52153 primary data records. [2025-10-14T22:35:19.827492] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:19.828430] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16701 primary records. [2025-10-14T22:35:19.828620] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-14T22:35:19.858451] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:19.860036] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30546 primary records. [2025-10-14T22:35:19.860913] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-14T22:35:19.861417] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-14T22:35:19.861916] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-14T22:35:19.864387] [INFO ] [MAIN ] Derivative Progress: 376/1812 symbols completed. CIA took 1.1s. Estimated remaining: 9m 7s. Rate: 157.6 symbols/min [2025-10-14T22:35:19.864534] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:19.884618] [DEBUG] [LOCAL ] CIF: Loaded 4046 existing records from primary storage. [2025-10-14T22:35:19.897267] [INFO ] [MAIN ] CIF: Loaded 4046 primary data records. [2025-10-14T22:35:19.897530] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:19.898265] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52153 primary records. [2025-10-14T22:35:19.899080] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-14T22:35:19.921162] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-14T22:35:19.944384] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-14T22:35:19.967955] [INFO ] [MAIN ] Derivative Progress: 377/1812 symbols completed. CIB took 1.2s. Estimated remaining: 9m 5s. Rate: 157.9 symbols/min [2025-10-14T22:35:19.988111] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:20.013409] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-14T22:35:20.025352] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-14T22:35:20.027994] [INFO ] [MAIN ] Derivative Progress: 378/1812 symbols completed. CIEN took 1.2s. Estimated remaining: 9m 4s. Rate: 158.3 symbols/min [2025-10-14T22:35:20.044629] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:20.265113] [DEBUG] [LOCAL ] CIG: Loaded 44270 existing records from primary storage. [2025-10-14T22:35:20.265534] [INFO ] [MAIN ] CIG: Loaded 44270 primary data records. [2025-10-14T22:35:20.368188] [DEBUG] [LOCAL ] CIM: Loaded 37747 existing records from primary storage. [2025-10-14T22:35:20.373778] [INFO ] [MAIN ] CIM: Loaded 37747 primary data records. [2025-10-14T22:35:20.415745] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:20.434327] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4046 primary records. [2025-10-14T22:35:20.487412] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-14T22:35:20.728085] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-14T22:35:20.738800] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-14T22:35:20.752373] [INFO ] [MAIN ] Derivative Progress: 379/1812 symbols completed. CIF took 0.9s. Estimated remaining: 9m 5s. Rate: 157.9 symbols/min [2025-10-14T22:35:20.752888] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:20.937088] [DEBUG] [LOCAL ] CIMN: Loaded 2750 existing records from primary storage. [2025-10-14T22:35:20.937277] [INFO ] [MAIN ] CIMN: Loaded 2750 primary data records. [2025-10-14T22:35:21.282253] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:21.283466] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 44270 primary records. [2025-10-14T22:35:21.287174] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-14T22:35:21.314221] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:21.316413] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37747 primary records. [2025-10-14T22:35:21.317986] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-14T22:35:21.329827] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-14T22:35:21.332670] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-14T22:35:21.334836] [INFO ] [MAIN ] Derivative Progress: 380/1812 symbols completed. CIG took 1.3s. Estimated remaining: 9m 5s. Rate: 157.7 symbols/min [2025-10-14T22:35:21.335723] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:21.341883] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-14T22:35:21.342827] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-14T22:35:21.345499] [INFO ] [MAIN ] Derivative Progress: 381/1812 symbols completed. CIM took 1.3s. Estimated remaining: 9m 3s. Rate: 158.1 symbols/min [2025-10-14T22:35:21.345686] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:21.359259] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:21.360068] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2750 primary records. [2025-10-14T22:35:21.365382] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-14T22:35:21.389931] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-10-14T22:35:21.397135] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-14T22:35:21.401093] [INFO ] [MAIN ] Derivative Progress: 382/1812 symbols completed. CIMN took 0.6s. Estimated remaining: 9m 2s. Rate: 158.4 symbols/min [2025-10-14T22:35:21.401574] [DEBUG] [LOCAL ] CIO: Loaded 20780 existing records from primary storage. [2025-10-14T22:35:21.401714] [INFO ] [MAIN ] CIO: Loaded 20780 primary data records. [2025-10-14T22:35:21.398700] [DEBUG] [LOCAL ] CINT: Loaded 19941 existing records from primary storage. [2025-10-14T22:35:21.413160] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:21.433160] [INFO ] [MAIN ] CINT: Loaded 19941 primary data records. [2025-10-14T22:35:22.096387] [DEBUG] [LOCAL ] CIVI: Loaded 52673 existing records from primary storage. [2025-10-14T22:35:22.097183] [INFO ] [MAIN ] CIVI: Loaded 52673 primary data records. [2025-10-14T22:35:22.426872] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:22.428927] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20780 primary records. [2025-10-14T22:35:22.429127] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-14T22:35:22.451279] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:22.452532] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 19941 primary records. [2025-10-14T22:35:22.460768] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-14T22:35:22.461069] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-14T22:35:22.461618] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-14T22:35:22.465026] [INFO ] [MAIN ] Derivative Progress: 383/1812 symbols completed. CIO took 1.1s. Estimated remaining: 9m 4s. Rate: 157.7 symbols/min [2025-10-14T22:35:22.476185] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:22.484523] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-10-14T22:35:22.485051] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-14T22:35:22.487760] [INFO ] [MAIN ] Derivative Progress: 384/1812 symbols completed. CINT took 1.2s. Estimated remaining: 9m 2s. Rate: 158.1 symbols/min [2025-10-14T22:35:22.488410] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:22.509441] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:22.518864] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52673 primary records. [2025-10-14T22:35:22.519189] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-14T22:35:22.550697] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-14T22:35:22.560134] [DEBUG] [LOCAL ] CLDT: Loaded 25439 existing records from primary storage. [2025-10-14T22:35:22.559715] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-14T22:35:22.561105] [DEBUG] [LOCAL ] CLB: Loaded 33361 existing records from primary storage. [2025-10-14T22:35:22.561482] [INFO ] [MAIN ] CLB: Loaded 33361 primary data records. [2025-10-14T22:35:22.563725] [INFO ] [MAIN ] Derivative Progress: 385/1812 symbols completed. CIVI took 1.2s. Estimated remaining: 9m 1s. Rate: 158.4 symbols/min [2025-10-14T22:35:22.561280] [INFO ] [MAIN ] CLDT: Loaded 25439 primary data records. [2025-10-14T22:35:22.596903] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:23.214126] [DEBUG] [LOCAL ] CLS: Loaded 53583 existing records from primary storage. [2025-10-14T22:35:23.216239] [INFO ] [MAIN ] CLS: Loaded 53583 primary data records. [2025-10-14T22:35:23.566673] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:23.567003] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:23.568070] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33361 primary records. [2025-10-14T22:35:23.568469] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-14T22:35:23.569974] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25439 primary records. [2025-10-14T22:35:23.570209] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-14T22:35:23.605611] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-14T22:35:23.605825] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-14T22:35:23.607046] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-14T22:35:23.607317] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-14T22:35:23.609785] [INFO ] [MAIN ] Derivative Progress: 386/1812 symbols completed. CLB took 1.1s. Estimated remaining: 9m 3s. Rate: 157.7 symbols/min [2025-10-14T22:35:23.612287] [INFO ] [MAIN ] Derivative Progress: 387/1812 symbols completed. CLDT took 1.1s. Estimated remaining: 9m 1s. Rate: 158.1 symbols/min [2025-10-14T22:35:23.612582] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:23.610083] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:23.632051] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:23.632845] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53583 primary records. [2025-10-14T22:35:23.633077] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-14T22:35:23.655401] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-14T22:35:23.655494] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-14T22:35:23.657687] [INFO ] [MAIN ] Derivative Progress: 388/1812 symbols completed. CLS took 1.1s. Estimated remaining: 8m 59s. Rate: 158.4 symbols/min [2025-10-14T22:35:23.680291] [DEBUG] [LOCAL ] CLW: Loaded 21558 existing records from primary storage. [2025-10-14T22:35:23.680414] [INFO ] [MAIN ] CLW: Loaded 21558 primary data records. [2025-10-14T22:35:23.798093] [DEBUG] [LOCAL ] CLVT: Loaded 51954 existing records from primary storage. [2025-10-14T22:35:23.809562] [INFO ] [MAIN ] CLVT: Loaded 51954 primary data records. [2025-10-14T22:35:24.390850] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:24.391803] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21558 primary records. [2025-10-14T22:35:24.392695] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-14T22:35:24.422014] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-14T22:35:24.422294] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:24.422458] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-14T22:35:24.423179] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51954 primary records. [2025-10-14T22:35:24.423275] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-14T22:35:24.425565] [INFO ] [MAIN ] Derivative Progress: 389/1812 symbols completed. CLW took 0.8s. Estimated remaining: 9m 0s. Rate: 158.0 symbols/min [2025-10-14T22:35:24.440376] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-14T22:35:24.440481] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-14T22:35:24.442521] [INFO ] [MAIN ] Derivative Progress: 390/1812 symbols completed. CLVT took 0.8s. Estimated remaining: 8m 59s. Rate: 158.4 symbols/min [2025-10-14T22:35:24.443027] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:24.442955] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:24.443172] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:24.470210] [DEBUG] [LOCAL ] CMBT: Loaded 25911 existing records from primary storage. [2025-10-14T22:35:24.470417] [INFO ] [MAIN ] CMBT: Loaded 25911 primary data records. [2025-10-14T22:35:24.822101] [DEBUG] [LOCAL ] CLX: Loaded 51660 existing records from primary storage. [2025-10-14T22:35:24.822743] [INFO ] [MAIN ] CLX: Loaded 51660 primary data records. [2025-10-14T22:35:24.813057] [DEBUG] [LOCAL ] CM: Loaded 48743 existing records from primary storage. [2025-10-14T22:35:24.822950] [INFO ] [MAIN ] CM: Loaded 48743 primary data records. [2025-10-14T22:35:25.436879] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:25.437761] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 25911 primary records. [2025-10-14T22:35:25.439613] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-14T22:35:25.458472] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-14T22:35:25.458811] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-14T22:35:25.461163] [INFO ] [MAIN ] Derivative Progress: 391/1812 symbols completed. CMBT took 1.0s. Estimated remaining: 9m 1s. Rate: 157.7 symbols/min [2025-10-14T22:35:25.461587] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:25.479908] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:25.492847] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51660 primary records. [2025-10-14T22:35:25.492194] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:25.493507] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48743 primary records. [2025-10-14T22:35:25.493609] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-14T22:35:25.494332] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-14T22:35:25.523484] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-14T22:35:25.524104] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-14T22:35:25.526061] [INFO ] [MAIN ] Derivative Progress: 392/1812 symbols completed. CLX took 1.1s. Estimated remaining: 8m 59s. Rate: 158.1 symbols/min [2025-10-14T22:35:25.537843] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:25.539726] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-14T22:35:25.539791] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-14T22:35:25.543514] [INFO ] [MAIN ] Derivative Progress: 393/1812 symbols completed. CM took 1.1s. Estimated remaining: 8m 57s. Rate: 158.5 symbols/min [2025-10-14T22:35:25.543917] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:25.549398] [DEBUG] [LOCAL ] CMCM: Loaded 4866 existing records from primary storage. [2025-10-14T22:35:25.562370] [INFO ] [MAIN ] CMCM: Loaded 4866 primary data records. [2025-10-14T22:35:25.601544] [DEBUG] [LOCAL ] CMC: Loaded 45430 existing records from primary storage. [2025-10-14T22:35:25.619818] [INFO ] [MAIN ] CMC: Loaded 45430 primary data records. [2025-10-14T22:35:26.241819] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-10-14T22:35:26.242814] [INFO ] [MAIN ] CMG: Loaded 53720 primary data records. [2025-10-14T22:35:26.556141] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:26.557670] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4866 primary records. [2025-10-14T22:35:26.557880] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-14T22:35:26.575802] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-14T22:35:26.575973] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-14T22:35:26.578952] [INFO ] [MAIN ] Derivative Progress: 394/1812 symbols completed. CMCM took 1.0s. Estimated remaining: 8m 59s. Rate: 157.8 symbols/min [2025-10-14T22:35:26.579270] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:26.592543] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:26.593553] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45430 primary records. [2025-10-14T22:35:26.593664] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-14T22:35:26.610950] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-14T22:35:26.611384] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-14T22:35:26.614251] [INFO ] [MAIN ] Derivative Progress: 395/1812 symbols completed. CMC took 1.2s. Estimated remaining: 8m 58s. Rate: 158.1 symbols/min [2025-10-14T22:35:26.614609] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:26.630350] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:35:26.631070] [INFO ] [MAIN ] CMG: Generated 1793 derivative records from 53720 primary records. [2025-10-14T22:35:26.631183] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-14T22:35:26.657604] [DEBUG] [LOCAL ] CMG: Derivative data saved (1793 records). [2025-10-14T22:35:26.657940] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-14T22:35:26.660066] [INFO ] [MAIN ] Derivative Progress: 396/1812 symbols completed. CMG took 1.1s. Estimated remaining: 8m 56s. Rate: 158.5 symbols/min [2025-10-14T22:35:26.660596] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:26.682253] [DEBUG] [LOCAL ] CMI: Loaded 41661 existing records from primary storage. [2025-10-14T22:35:26.682528] [INFO ] [MAIN ] CMI: Loaded 41661 primary data records. [2025-10-14T22:35:26.795602] [DEBUG] [LOCAL ] CMP: Loaded 35866 existing records from primary storage. [2025-10-14T22:35:26.811157] [INFO ] [MAIN ] CMP: Loaded 35866 primary data records. [2025-10-14T22:35:27.127487] [DEBUG] [LOCAL ] CMPO: Loaded 38842 existing records from primary storage. [2025-10-14T22:35:27.139600] [INFO ] [MAIN ] CMPO: Loaded 38842 primary data records. [2025-10-14T22:35:27.721738] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:27.724042] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41661 primary records. [2025-10-14T22:35:27.724396] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-14T22:35:27.746636] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:27.752735] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 35866 primary records. [2025-10-14T22:35:27.755836] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-14T22:35:27.755708] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-14T22:35:27.756852] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-14T22:35:27.759025] [INFO ] [MAIN ] Derivative Progress: 397/1812 symbols completed. CMI took 1.2s. Estimated remaining: 8m 58s. Rate: 157.7 symbols/min [2025-10-14T22:35:27.766765] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:27.791295] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-14T22:35:27.791529] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-14T22:35:27.794028] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:27.793722] [INFO ] [MAIN ] Derivative Progress: 398/1812 symbols completed. CMP took 1.2s. Estimated remaining: 8m 57s. Rate: 158.1 symbols/min [2025-10-14T22:35:27.794331] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:27.795101] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 38842 primary records. [2025-10-14T22:35:27.795539] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-14T22:35:27.814755] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-14T22:35:27.814930] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-14T22:35:27.817829] [INFO ] [MAIN ] Derivative Progress: 399/1812 symbols completed. CMPO took 1.2s. Estimated remaining: 8m 55s. Rate: 158.5 symbols/min [2025-10-14T22:35:27.826562] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:27.844559] [DEBUG] [LOCAL ] CMSC: Loaded 4884 existing records from primary storage. [2025-10-14T22:35:27.842030] [DEBUG] [LOCAL ] CMRE: Loaded 35862 existing records from primary storage. [2025-10-14T22:35:27.844777] [INFO ] [MAIN ] CMSC: Loaded 4884 primary data records. [2025-10-14T22:35:27.844861] [INFO ] [MAIN ] CMRE: Loaded 35862 primary data records. [2025-10-14T22:35:28.242703] [DEBUG] [LOCAL ] CMS: Loaded 52623 existing records from primary storage. [2025-10-14T22:35:28.355419] [INFO ] [MAIN ] CMS: Loaded 52623 primary data records. [2025-10-14T22:35:28.827373] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:28.841547] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35862 primary records. [2025-10-14T22:35:28.842223] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-14T22:35:28.843230] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:28.855134] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 4884 primary records. [2025-10-14T22:35:28.856112] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-14T22:35:28.874338] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-14T22:35:28.875602] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-14T22:35:28.877891] [INFO ] [MAIN ] Derivative Progress: 400/1812 symbols completed. CMSC took 1.1s. Estimated remaining: 8m 57s. Rate: 157.7 symbols/min [2025-10-14T22:35:28.875510] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-14T22:35:28.878106] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-14T22:35:28.880182] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:28.880413] [INFO ] [MAIN ] Derivative Progress: 401/1812 symbols completed. CMRE took 1.1s. Estimated remaining: 8m 55s. Rate: 158.1 symbols/min [2025-10-14T22:35:28.881953] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:28.897290] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:28.897984] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52623 primary records. [2025-10-14T22:35:28.900477] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-14T22:35:28.916165] [DEBUG] [LOCAL ] CMSD: Loaded 7911 existing records from primary storage. [2025-10-14T22:35:28.916348] [INFO ] [MAIN ] CMSD: Loaded 7911 primary data records. [2025-10-14T22:35:29.010621] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-14T22:35:29.016538] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-14T22:35:29.035683] [INFO ] [MAIN ] Derivative Progress: 402/1812 symbols completed. CMS took 1.2s. Estimated remaining: 8m 54s. Rate: 158.4 symbols/min [2025-10-14T22:35:29.052533] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:29.125679] [DEBUG] [LOCAL ] CMTG: Loaded 35934 existing records from primary storage. [2025-10-14T22:35:29.240345] [INFO ] [MAIN ] CMTG: Loaded 35934 primary data records. [2025-10-14T22:35:29.308413] [DEBUG] [LOCAL ] CMU: Loaded 6338 existing records from primary storage. [2025-10-14T22:35:29.314280] [INFO ] [MAIN ] CMU: Loaded 6338 primary data records. [2025-10-14T22:35:29.919822] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:35:29.923931] [INFO ] [MAIN ] CMSD: Generated 1793 derivative records from 7911 primary records. [2025-10-14T22:35:29.924606] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-14T22:35:29.954752] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1793 records). [2025-10-14T22:35:29.955030] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-14T22:35:29.957027] [INFO ] [MAIN ] Derivative Progress: 403/1812 symbols completed. CMSD took 1.1s. Estimated remaining: 8m 56s. Rate: 157.8 symbols/min [2025-10-14T22:35:29.953743] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:29.958215] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 35934 primary records. [2025-10-14T22:35:29.959279] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-14T22:35:29.986441] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:29.988036] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6338 primary records. [2025-10-14T22:35:29.988135] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-14T22:35:30.003999] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-14T22:35:30.004104] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-14T22:35:30.007889] [INFO ] [MAIN ] Derivative Progress: 404/1812 symbols completed. CMTG took 1.1s. Estimated remaining: 8m 54s. Rate: 158.1 symbols/min [2025-10-14T22:35:30.008951] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-14T22:35:30.009009] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-14T22:35:30.011348] [INFO ] [MAIN ] Derivative Progress: 405/1812 symbols completed. CMU took 1.0s. Estimated remaining: 8m 52s. Rate: 158.5 symbols/min [2025-10-14T22:35:30.011915] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:30.011796] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:30.011712] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:30.024616] [DEBUG] [LOCAL ] CNF: Loaded 10639 existing records from primary storage. [2025-10-14T22:35:30.024788] [INFO ] [MAIN ] CNF: Loaded 10639 primary data records. [2025-10-14T22:35:30.339005] [DEBUG] [LOCAL ] CNA: Loaded 32938 existing records from primary storage. [2025-10-14T22:35:30.347188] [INFO ] [MAIN ] CNA: Loaded 32938 primary data records. [2025-10-14T22:35:30.439957] [DEBUG] [LOCAL ] CNC: Loaded 53767 existing records from primary storage. [2025-10-14T22:35:30.483217] [INFO ] [MAIN ] CNC: Loaded 53767 primary data records. [2025-10-14T22:35:30.996306] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:35:30.998490] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10639 primary records. [2025-10-14T22:35:30.999680] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-14T22:35:31.019143] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-10-14T22:35:31.019789] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-14T22:35:31.022254] [INFO ] [MAIN ] Derivative Progress: 406/1812 symbols completed. CNF took 1.0s. Estimated remaining: 8m 54s. Rate: 157.9 symbols/min [2025-10-14T22:35:31.022523] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:31.040286] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:31.041371] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32938 primary records. [2025-10-14T22:35:31.041535] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-14T22:35:31.068585] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-14T22:35:31.068799] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-14T22:35:31.075453] [INFO ] [MAIN ] Derivative Progress: 407/1812 symbols completed. CNA took 1.1s. Estimated remaining: 8m 53s. Rate: 158.2 symbols/min [2025-10-14T22:35:31.076438] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:31.076316] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:31.077786] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53767 primary records. [2025-10-14T22:35:31.077852] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-14T22:35:31.094324] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-14T22:35:31.094400] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-14T22:35:31.096720] [INFO ] [MAIN ] Derivative Progress: 408/1812 symbols completed. CNC took 1.1s. Estimated remaining: 8m 51s. Rate: 158.6 symbols/min [2025-10-14T22:35:31.097061] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:31.138719] [DEBUG] [LOCAL ] CNH: Loaded 53552 existing records from primary storage. [2025-10-14T22:35:31.139174] [INFO ] [MAIN ] CNH: Loaded 53552 primary data records. [2025-10-14T22:35:31.381042] [DEBUG] [LOCAL ] CNI: Loaded 51687 existing records from primary storage. [2025-10-14T22:35:31.483814] [INFO ] [MAIN ] CNI: Loaded 51687 primary data records. [2025-10-14T22:35:31.501284] [DEBUG] [LOCAL ] CNK: Loaded 52891 existing records from primary storage. [2025-10-14T22:35:31.536742] [INFO ] [MAIN ] CNK: Loaded 52891 primary data records. [2025-10-14T22:35:32.147759] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:32.149082] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53552 primary records. [2025-10-14T22:35:32.149816] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-14T22:35:32.169035] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-14T22:35:32.169433] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-14T22:35:32.171703] [INFO ] [MAIN ] Derivative Progress: 409/1812 symbols completed. CNH took 1.1s. Estimated remaining: 8m 53s. Rate: 157.9 symbols/min [2025-10-14T22:35:32.171944] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:32.185838] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:32.186543] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51687 primary records. [2025-10-14T22:35:32.186707] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-14T22:35:32.216909] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-14T22:35:32.217199] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-14T22:35:32.219638] [INFO ] [MAIN ] Derivative Progress: 410/1812 symbols completed. CNI took 1.1s. Estimated remaining: 8m 52s. Rate: 158.2 symbols/min [2025-10-14T22:35:32.217504] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:32.220978] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52891 primary records. [2025-10-14T22:35:32.219899] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:32.221355] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-14T22:35:32.250437] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-14T22:35:32.250588] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-14T22:35:32.252769] [INFO ] [MAIN ] Derivative Progress: 411/1812 symbols completed. CNK took 1.2s. Estimated remaining: 8m 50s. Rate: 158.6 symbols/min [2025-10-14T22:35:32.253044] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:32.279607] [DEBUG] [LOCAL ] CNM: Loaded 51023 existing records from primary storage. [2025-10-14T22:35:32.279923] [INFO ] [MAIN ] CNM: Loaded 51023 primary data records. [2025-10-14T22:35:32.405726] [DEBUG] [LOCAL ] CNMD: Loaded 32167 existing records from primary storage. [2025-10-14T22:35:32.405898] [INFO ] [MAIN ] CNMD: Loaded 32167 primary data records. [2025-10-14T22:35:32.487135] [DEBUG] [LOCAL ] CNNE: Loaded 36021 existing records from primary storage. [2025-10-14T22:35:32.542707] [INFO ] [MAIN ] CNNE: Loaded 36021 primary data records. [2025-10-14T22:35:33.229831] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:33.230778] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 51023 primary records. [2025-10-14T22:35:33.230980] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-14T22:35:33.264607] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:33.265391] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32167 primary records. [2025-10-14T22:35:33.265561] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-14T22:35:33.274358] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-14T22:35:33.282103] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-14T22:35:33.285118] [INFO ] [MAIN ] Derivative Progress: 412/1812 symbols completed. CNM took 1.1s. Estimated remaining: 8m 52s. Rate: 157.9 symbols/min [2025-10-14T22:35:33.285464] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:33.286177] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:33.297906] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36021 primary records. [2025-10-14T22:35:33.299181] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-14T22:35:33.311580] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-14T22:35:33.314199] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-14T22:35:33.317744] [INFO ] [MAIN ] Derivative Progress: 413/1812 symbols completed. CNMD took 1.1s. Estimated remaining: 8m 50s. Rate: 158.3 symbols/min [2025-10-14T22:35:33.317937] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:33.325877] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-14T22:35:33.326168] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-14T22:35:33.328275] [INFO ] [MAIN ] Derivative Progress: 414/1812 symbols completed. CNNE took 1.1s. Estimated remaining: 8m 49s. Rate: 158.6 symbols/min [2025-10-14T22:35:33.329160] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:33.358963] [DEBUG] [LOCAL ] CNO: Loaded 40696 existing records from primary storage. [2025-10-14T22:35:33.359122] [INFO ] [MAIN ] CNO: Loaded 40696 primary data records. [2025-10-14T22:35:33.588086] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-14T22:35:33.599704] [INFO ] [MAIN ] CNP: Loaded 53480 primary data records. [2025-10-14T22:35:33.776994] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-14T22:35:33.803478] [INFO ] [MAIN ] CNQ: Loaded 53583 primary data records. [2025-10-14T22:35:34.379705] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:34.380370] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40696 primary records. [2025-10-14T22:35:34.380610] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-14T22:35:34.413188] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-14T22:35:34.414730] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-14T22:35:34.417742] [INFO ] [MAIN ] Derivative Progress: 415/1812 symbols completed. CNO took 1.1s. Estimated remaining: 8m 51s. Rate: 157.9 symbols/min [2025-10-14T22:35:34.418436] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:34.418073] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:34.419305] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53480 primary records. [2025-10-14T22:35:34.419892] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-14T22:35:34.432870] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:34.434239] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53583 primary records. [2025-10-14T22:35:34.434557] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-14T22:35:34.468277] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-14T22:35:34.468830] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-14T22:35:34.471043] [INFO ] [MAIN ] Derivative Progress: 416/1812 symbols completed. CNP took 1.2s. Estimated remaining: 8m 49s. Rate: 158.2 symbols/min [2025-10-14T22:35:34.471206] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:34.478066] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-14T22:35:34.479511] [DEBUG] [LOCAL ] CNS: Loaded 21073 existing records from primary storage. [2025-10-14T22:35:34.478166] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-14T22:35:34.482086] [INFO ] [MAIN ] Derivative Progress: 417/1812 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 48s. Rate: 158.6 symbols/min [2025-10-14T22:35:34.482327] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:34.482896] [INFO ] [MAIN ] CNS: Loaded 21073 primary data records. [2025-10-14T22:35:34.830608] [DEBUG] [LOCAL ] CNX: Loaded 51365 existing records from primary storage. [2025-10-14T22:35:34.832347] [INFO ] [MAIN ] CNX: Loaded 51365 primary data records. [2025-10-14T22:35:34.951300] [DEBUG] [LOCAL ] COF: Loaded 53619 existing records from primary storage. [2025-10-14T22:35:34.952667] [INFO ] [MAIN ] COF: Loaded 53619 primary data records. [2025-10-14T22:35:35.284901] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:35.304001] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 21073 primary records. [2025-10-14T22:35:35.320638] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-14T22:35:35.523919] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-10-14T22:35:35.524139] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-14T22:35:35.526318] [INFO ] [MAIN ] Derivative Progress: 418/1812 symbols completed. CNS took 1.1s. Estimated remaining: 8m 50s. Rate: 157.9 symbols/min [2025-10-14T22:35:35.545331] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:35.546058] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51365 primary records. [2025-10-14T22:35:35.546201] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-14T22:35:35.562099] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-14T22:35:35.562247] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-14T22:35:35.564416] [INFO ] [MAIN ] Derivative Progress: 419/1812 symbols completed. CNX took 1.1s. Estimated remaining: 8m 48s. Rate: 158.3 symbols/min [2025-10-14T22:35:35.579191] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:35.579734] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53619 primary records. [2025-10-14T22:35:35.579807] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-14T22:35:35.595498] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-14T22:35:35.595563] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-14T22:35:35.597576] [INFO ] [MAIN ] Derivative Progress: 420/1812 symbols completed. COF took 1.1s. Estimated remaining: 8m 47s. Rate: 158.6 symbols/min [2025-10-14T22:35:35.598151] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:35.598267] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:35.598335] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:35.674164] [DEBUG] [LOCAL ] COHR: Loaded 53376 existing records from primary storage. [2025-10-14T22:35:35.674380] [INFO ] [MAIN ] COHR: Loaded 53376 primary data records. [2025-10-14T22:35:35.803929] [DEBUG] [LOCAL ] COMP: Loaded 53405 existing records from primary storage. [2025-10-14T22:35:35.814303] [DEBUG] [LOCAL ] COLD: Loaded 52370 existing records from primary storage. [2025-10-14T22:35:35.830031] [INFO ] [MAIN ] COLD: Loaded 52370 primary data records. [2025-10-14T22:35:35.807499] [INFO ] [MAIN ] COMP: Loaded 53405 primary data records. [2025-10-14T22:35:36.634212] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:36.635323] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53376 primary records. [2025-10-14T22:35:36.635534] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-14T22:35:36.671738] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-10-14T22:35:36.671950] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-14T22:35:36.674015] [INFO ] [MAIN ] Derivative Progress: 421/1812 symbols completed. COHR took 1.1s. Estimated remaining: 8m 48s. Rate: 157.9 symbols/min [2025-10-14T22:35:36.674288] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:36.672212] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:36.683168] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52370 primary records. [2025-10-14T22:35:36.688009] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-14T22:35:36.688252] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:36.689707] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53405 primary records. [2025-10-14T22:35:36.689867] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-14T22:35:36.716580] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-14T22:35:36.718974] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-14T22:35:36.720762] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-14T22:35:36.720894] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-14T22:35:36.722944] [INFO ] [MAIN ] Derivative Progress: 422/1812 symbols completed. COLD took 1.1s. Estimated remaining: 8m 47s. Rate: 158.3 symbols/min [2025-10-14T22:35:36.725252] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:36.725800] [INFO ] [MAIN ] Derivative Progress: 423/1812 symbols completed. COMP took 1.1s. Estimated remaining: 8m 45s. Rate: 158.6 symbols/min [2025-10-14T22:35:36.725910] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:36.768554] [DEBUG] [LOCAL ] CON: Loaded 38883 existing records from primary storage. [2025-10-14T22:35:36.769054] [DEBUG] [LOCAL ] COOK: Loaded 24891 existing records from primary storage. [2025-10-14T22:35:36.769226] [INFO ] [MAIN ] COOK: Loaded 24891 primary data records. [2025-10-14T22:35:36.769312] [INFO ] [MAIN ] CON: Loaded 38883 primary data records. [2025-10-14T22:35:37.407856] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-14T22:35:37.408206] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-14T22:35:37.785339] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:37.787324] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38883 primary records. [2025-10-14T22:35:37.799679] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-14T22:35:37.800065] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:37.801628] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24891 primary records. [2025-10-14T22:35:37.814277] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-14T22:35:37.817607] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-10-14T22:35:37.818509] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-14T22:35:37.827439] [INFO ] [MAIN ] Derivative Progress: 424/1812 symbols completed. CON took 1.2s. Estimated remaining: 8m 47s. Rate: 157.9 symbols/min [2025-10-14T22:35:37.827729] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:37.837411] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-14T22:35:37.837624] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-14T22:35:37.839489] [INFO ] [MAIN ] Derivative Progress: 425/1812 symbols completed. COOK took 1.1s. Estimated remaining: 8m 46s. Rate: 158.3 symbols/min [2025-10-14T22:35:37.839893] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:37.858863] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:37.859603] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-14T22:35:37.859752] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-14T22:35:37.886833] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-14T22:35:37.887068] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-14T22:35:37.889182] [INFO ] [MAIN ] Derivative Progress: 426/1812 symbols completed. COP took 1.2s. Estimated remaining: 8m 44s. Rate: 158.6 symbols/min [2025-10-14T22:35:37.889447] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:37.917331] [DEBUG] [LOCAL ] COR: Loaded 46682 existing records from primary storage. [2025-10-14T22:35:37.917688] [INFO ] [MAIN ] COR: Loaded 46682 primary data records. [2025-10-14T22:35:38.054807] [DEBUG] [LOCAL ] COTY: Loaded 53268 existing records from primary storage. [2025-10-14T22:35:38.095766] [INFO ] [MAIN ] COTY: Loaded 53268 primary data records. [2025-10-14T22:35:38.333035] [DEBUG] [LOCAL ] COUR: Loaded 49240 existing records from primary storage. [2025-10-14T22:35:38.345982] [INFO ] [MAIN ] COUR: Loaded 49240 primary data records. [2025-10-14T22:35:38.872230] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:38.873164] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 46682 primary records. [2025-10-14T22:35:38.873374] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-14T22:35:38.891110] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-14T22:35:38.891234] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-14T22:35:38.893173] [INFO ] [MAIN ] Derivative Progress: 427/1812 symbols completed. COR took 1.1s. Estimated remaining: 8m 46s. Rate: 158.0 symbols/min [2025-10-14T22:35:38.893814] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:38.912909] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:38.925103] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:38.925829] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53268 primary records. [2025-10-14T22:35:38.925987] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-14T22:35:38.926528] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 49240 primary records. [2025-10-14T22:35:38.927274] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-14T22:35:38.957801] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-14T22:35:38.957951] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-14T22:35:38.960092] [INFO ] [MAIN ] Derivative Progress: 428/1812 symbols completed. COUR took 1.1s. Estimated remaining: 8m 45s. Rate: 158.3 symbols/min [2025-10-14T22:35:38.961568] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:38.977017] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-10-14T22:35:38.977124] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-14T22:35:38.979079] [INFO ] [MAIN ] Derivative Progress: 429/1812 symbols completed. COTY took 1.1s. Estimated remaining: 8m 43s. Rate: 158.6 symbols/min [2025-10-14T22:35:38.979322] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:39.006941] [DEBUG] [LOCAL ] CP: Loaded 53250 existing records from primary storage. [2025-10-14T22:35:39.010391] [INFO ] [MAIN ] CP: Loaded 53250 primary data records. [2025-10-14T22:35:39.114469] [DEBUG] [LOCAL ] CPA: Loaded 28481 existing records from primary storage. [2025-10-14T22:35:39.129835] [INFO ] [MAIN ] CPA: Loaded 28481 primary data records. [2025-10-14T22:35:39.121826] [DEBUG] [LOCAL ] CPK: Loaded 13850 existing records from primary storage. [2025-10-14T22:35:39.159733] [INFO ] [MAIN ] CPK: Loaded 13850 primary data records. [2025-10-14T22:35:39.987050] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:39.988152] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53250 primary records. [2025-10-14T22:35:39.988611] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-14T22:35:40.020256] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-14T22:35:40.021795] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-14T22:35:40.021709] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:40.023832] [INFO ] [MAIN ] Derivative Progress: 430/1812 symbols completed. CP took 1.1s. Estimated remaining: 8m 45s. Rate: 158.0 symbols/min [2025-10-14T22:35:40.025235] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28481 primary records. [2025-10-14T22:35:40.026135] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:40.026027] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-14T22:35:40.050991] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:40.053797] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13850 primary records. [2025-10-14T22:35:40.053925] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-14T22:35:40.055994] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-14T22:35:40.056674] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-14T22:35:40.058808] [INFO ] [MAIN ] Derivative Progress: 431/1812 symbols completed. CPA took 1.1s. Estimated remaining: 8m 43s. Rate: 158.3 symbols/min [2025-10-14T22:35:40.059224] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:40.074898] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-14T22:35:40.075002] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-14T22:35:40.077052] [INFO ] [MAIN ] Derivative Progress: 432/1812 symbols completed. CPK took 1.1s. Estimated remaining: 8m 42s. Rate: 158.7 symbols/min [2025-10-14T22:35:40.077253] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:40.141315] [DEBUG] [LOCAL ] CPS: Loaded 25324 existing records from primary storage. [2025-10-14T22:35:40.141511] [INFO ] [MAIN ] CPS: Loaded 25324 primary data records. [2025-10-14T22:35:40.142325] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-14T22:35:40.165001] [INFO ] [MAIN ] CPNG: Loaded 53679 primary data records. [2025-10-14T22:35:40.363378] [DEBUG] [LOCAL ] CPRI: Loaded 52473 existing records from primary storage. [2025-10-14T22:35:40.367013] [INFO ] [MAIN ] CPRI: Loaded 52473 primary data records. [2025-10-14T22:35:41.207564] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:41.208109] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:41.209281] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53679 primary records. [2025-10-14T22:35:41.210566] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25324 primary records. [2025-10-14T22:35:41.209502] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-14T22:35:41.210765] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-14T22:35:41.238994] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-14T22:35:41.255015] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-14T22:35:41.263271] [INFO ] [MAIN ] Derivative Progress: 433/1812 symbols completed. CPNG took 1.2s. Estimated remaining: 8m 44s. Rate: 157.9 symbols/min [2025-10-14T22:35:41.272625] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-14T22:35:41.278073] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-14T22:35:41.280974] [INFO ] [MAIN ] Derivative Progress: 434/1812 symbols completed. CPS took 1.2s. Estimated remaining: 8m 42s. Rate: 158.3 symbols/min [2025-10-14T22:35:41.278768] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:41.282020] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52473 primary records. [2025-10-14T22:35:41.282181] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-14T22:35:41.299997] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-14T22:35:41.300159] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-14T22:35:41.302403] [INFO ] [MAIN ] Derivative Progress: 435/1812 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 41s. Rate: 158.6 symbols/min [2025-10-14T22:35:41.303123] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:41.303023] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:41.303810] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:41.350039] [DEBUG] [LOCAL ] CQP: Loaded 18820 existing records from primary storage. [2025-10-14T22:35:41.350344] [INFO ] [MAIN ] CQP: Loaded 18820 primary data records. [2025-10-14T22:35:41.417365] [DEBUG] [LOCAL ] CR: Loaded 24122 existing records from primary storage. [2025-10-14T22:35:41.482873] [INFO ] [MAIN ] CR: Loaded 24122 primary data records. [2025-10-14T22:35:41.665363] [DEBUG] [LOCAL ] CPT: Loaded 44529 existing records from primary storage. [2025-10-14T22:35:41.733495] [INFO ] [MAIN ] CPT: Loaded 44529 primary data records. [2025-10-14T22:35:42.499868] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:42.501534] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 18820 primary records. [2025-10-14T22:35:42.502191] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-14T22:35:42.536212] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:42.537355] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-14T22:35:42.538613] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-14T22:35:42.541386] [INFO ] [MAIN ] Derivative Progress: 436/1812 symbols completed. CQP took 1.2s. Estimated remaining: 8m 43s. Rate: 157.8 symbols/min [2025-10-14T22:35:42.543194] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:42.542918] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24122 primary records. [2025-10-14T22:35:42.544033] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-14T22:35:42.567991] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:42.571699] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44529 primary records. [2025-10-14T22:35:42.572063] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-14T22:35:42.578570] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-14T22:35:42.579689] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-14T22:35:42.581894] [INFO ] [MAIN ] Derivative Progress: 437/1812 symbols completed. CR took 1.3s. Estimated remaining: 8m 42s. Rate: 158.1 symbols/min [2025-10-14T22:35:42.589441] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:42.594666] [DEBUG] [LOCAL ] CRBD: Loaded 8944 existing records from primary storage. [2025-10-14T22:35:42.601548] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-14T22:35:42.602055] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-14T22:35:42.604162] [INFO ] [MAIN ] Derivative Progress: 438/1812 symbols completed. CPT took 1.3s. Estimated remaining: 8m 40s. Rate: 158.4 symbols/min [2025-10-14T22:35:42.604354] [INFO ] [MAIN ] CRBD: Loaded 8944 primary data records. [2025-10-14T22:35:42.616376] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:42.945954] [DEBUG] [LOCAL ] CRC: Loaded 44076 existing records from primary storage. [2025-10-14T22:35:42.946383] [INFO ] [MAIN ] CRC: Loaded 44076 primary data records. [2025-10-14T22:35:43.053907] [DEBUG] [LOCAL ] CRBG: Loaded 52568 existing records from primary storage. [2025-10-14T22:35:43.086395] [INFO ] [MAIN ] CRBG: Loaded 52568 primary data records. [2025-10-14T22:35:43.253792] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:43.400908] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8944 primary records. [2025-10-14T22:35:43.404473] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-14T22:35:43.610511] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-14T22:35:43.610732] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-14T22:35:43.612681] [INFO ] [MAIN ] Derivative Progress: 439/1812 symbols completed. CRBD took 1.1s. Estimated remaining: 8m 42s. Rate: 157.8 symbols/min [2025-10-14T22:35:43.612822] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:43.674765] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:43.676325] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44076 primary records. [2025-10-14T22:35:43.676437] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-14T22:35:43.689474] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:43.690243] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52568 primary records. [2025-10-14T22:35:43.697309] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-14T22:35:43.727076] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-14T22:35:43.730678] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-14T22:35:43.734634] [INFO ] [MAIN ] Derivative Progress: 440/1812 symbols completed. CRC took 1.1s. Estimated remaining: 8m 41s. Rate: 158.1 symbols/min [2025-10-14T22:35:43.736635] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-14T22:35:43.735745] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:43.736908] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-14T22:35:43.753037] [INFO ] [MAIN ] Derivative Progress: 441/1812 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 39s. Rate: 158.4 symbols/min [2025-10-14T22:35:43.753404] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:43.755402] [DEBUG] [LOCAL ] CRGY: Loaded 52500 existing records from primary storage. [2025-10-14T22:35:43.755707] [INFO ] [MAIN ] CRGY: Loaded 52500 primary data records. [2025-10-14T22:35:44.147010] [DEBUG] [LOCAL ] CRI: Loaded 49699 existing records from primary storage. [2025-10-14T22:35:44.147395] [INFO ] [MAIN ] CRI: Loaded 49699 primary data records. [2025-10-14T22:35:44.247253] [DEBUG] [LOCAL ] CRH: Loaded 53443 existing records from primary storage. [2025-10-14T22:35:44.258515] [INFO ] [MAIN ] CRH: Loaded 53443 primary data records. [2025-10-14T22:35:44.782347] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:44.783779] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52500 primary records. [2025-10-14T22:35:44.784077] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-14T22:35:44.805126] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-14T22:35:44.805608] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-14T22:35:44.808055] [INFO ] [MAIN ] Derivative Progress: 442/1812 symbols completed. CRGY took 1.2s. Estimated remaining: 8m 41s. Rate: 157.8 symbols/min [2025-10-14T22:35:44.808398] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:44.825039] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:44.825712] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49699 primary records. [2025-10-14T22:35:44.825782] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-14T22:35:44.857911] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-14T22:35:44.858033] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-14T22:35:44.857808] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:44.859838] [INFO ] [MAIN ] Derivative Progress: 443/1812 symbols completed. CRI took 1.1s. Estimated remaining: 8m 40s. Rate: 158.1 symbols/min [2025-10-14T22:35:44.860769] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53443 primary records. [2025-10-14T22:35:44.860976] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-14T22:35:44.861966] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:44.879555] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-14T22:35:44.879718] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-14T22:35:44.882763] [INFO ] [MAIN ] Derivative Progress: 444/1812 symbols completed. CRH took 1.1s. Estimated remaining: 8m 38s. Rate: 158.4 symbols/min [2025-10-14T22:35:44.883073] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:44.917259] [DEBUG] [LOCAL ] CRL: Loaded 42908 existing records from primary storage. [2025-10-14T22:35:44.917559] [INFO ] [MAIN ] CRL: Loaded 42908 primary data records. [2025-10-14T22:35:45.083636] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-14T22:35:45.083901] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-14T22:35:45.183620] [DEBUG] [LOCAL ] CRS: Loaded 43223 existing records from primary storage. [2025-10-14T22:35:45.214616] [INFO ] [MAIN ] CRS: Loaded 43223 primary data records. [2025-10-14T22:35:45.990151] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:45.991106] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42908 primary records. [2025-10-14T22:35:45.991211] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-14T22:35:46.020390] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:46.027392] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-14T22:35:46.030351] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-14T22:35:46.034019] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-14T22:35:46.034705] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-14T22:35:46.044018] [INFO ] [MAIN ] Derivative Progress: 445/1812 symbols completed. CRL took 1.2s. Estimated remaining: 8m 40s. Rate: 157.7 symbols/min [2025-10-14T22:35:46.053060] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:46.052917] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-14T22:35:46.056034] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-14T22:35:46.058246] [INFO ] [MAIN ] Derivative Progress: 446/1812 symbols completed. CRM took 1.2s. Estimated remaining: 8m 39s. Rate: 158.0 symbols/min [2025-10-14T22:35:46.058575] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:46.081272] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:46.085250] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43223 primary records. [2025-10-14T22:35:46.085750] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-14T22:35:46.085513] [DEBUG] [LOCAL ] CRT: Loaded 4916 existing records from primary storage. [2025-10-14T22:35:46.085910] [INFO ] [MAIN ] CRT: Loaded 4916 primary data records. [2025-10-14T22:35:46.192738] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-14T22:35:46.217485] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-14T22:35:46.223268] [INFO ] [MAIN ] Derivative Progress: 447/1812 symbols completed. CRS took 1.3s. Estimated remaining: 8m 38s. Rate: 158.2 symbols/min [2025-10-14T22:35:46.239672] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:46.429755] [DEBUG] [LOCAL ] CSAN: Loaded 42149 existing records from primary storage. [2025-10-14T22:35:46.430030] [INFO ] [MAIN ] CSAN: Loaded 42149 primary data records. [2025-10-14T22:35:46.606540] [DEBUG] [LOCAL ] CSL: Loaded 31497 existing records from primary storage. [2025-10-14T22:35:46.630289] [INFO ] [MAIN ] CSL: Loaded 31497 primary data records. [2025-10-14T22:35:47.070825] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:47.071627] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4916 primary records. [2025-10-14T22:35:47.072550] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-14T22:35:47.109548] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:47.109265] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-14T22:35:47.110600] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42149 primary records. [2025-10-14T22:35:47.111034] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-14T22:35:47.110768] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-14T22:35:47.114001] [INFO ] [MAIN ] Derivative Progress: 448/1812 symbols completed. CRT took 1.1s. Estimated remaining: 8m 39s. Rate: 157.8 symbols/min [2025-10-14T22:35:47.129563] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-14T22:35:47.129852] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-14T22:35:47.131752] [INFO ] [MAIN ] Derivative Progress: 449/1812 symbols completed. CSAN took 1.1s. Estimated remaining: 8m 37s. Rate: 158.1 symbols/min [2025-10-14T22:35:47.146874] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:47.147566] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31497 primary records. [2025-10-14T22:35:47.147677] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-14T22:35:47.164017] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-10-14T22:35:47.164146] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-14T22:35:47.166429] [INFO ] [MAIN ] Derivative Progress: 450/1812 symbols completed. CSL took 0.9s. Estimated remaining: 8m 36s. Rate: 158.4 symbols/min [2025-10-14T22:35:47.166853] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:47.167026] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:47.166953] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:47.190604] [DEBUG] [LOCAL ] CSV: Loaded 12742 existing records from primary storage. [2025-10-14T22:35:47.190758] [INFO ] [MAIN ] CSV: Loaded 12742 primary data records. [2025-10-14T22:35:47.202901] [DEBUG] [LOCAL ] CSR: Loaded 13282 existing records from primary storage. [2025-10-14T22:35:47.238503] [INFO ] [MAIN ] CSR: Loaded 13282 primary data records. [2025-10-14T22:35:47.547394] [DEBUG] [LOCAL ] CSTM: Loaded 47568 existing records from primary storage. [2025-10-14T22:35:47.847801] [INFO ] [MAIN ] CSTM: Loaded 47568 primary data records. [2025-10-14T22:35:48.188714] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:48.190009] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12742 primary records. [2025-10-14T22:35:48.190278] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-14T22:35:48.215020] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:48.217985] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 13282 primary records. [2025-10-14T22:35:48.218095] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-14T22:35:48.234374] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-14T22:35:48.234575] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-14T22:35:48.238140] [INFO ] [MAIN ] Derivative Progress: 451/1812 symbols completed. CSV took 1.1s. Estimated remaining: 8m 38s. Rate: 157.8 symbols/min [2025-10-14T22:35:48.238560] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:48.241063] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-14T22:35:48.241257] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-14T22:35:48.243588] [INFO ] [MAIN ] Derivative Progress: 452/1812 symbols completed. CSR took 1.1s. Estimated remaining: 8m 36s. Rate: 158.1 symbols/min [2025-10-14T22:35:48.243887] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:48.264792] [DEBUG] [LOCAL ] CTBB: Loaded 6891 existing records from primary storage. [2025-10-14T22:35:48.265087] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:48.265231] [INFO ] [MAIN ] CTBB: Loaded 6891 primary data records. [2025-10-14T22:35:48.265879] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47568 primary records. [2025-10-14T22:35:48.296691] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-14T22:35:48.416208] [DEBUG] [LOCAL ] CTO: Loaded 27742 existing records from primary storage. [2025-10-14T22:35:48.437808] [INFO ] [MAIN ] CTO: Loaded 27742 primary data records. [2025-10-14T22:35:48.495111] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-14T22:35:48.642591] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-14T22:35:48.666603] [INFO ] [MAIN ] Derivative Progress: 453/1812 symbols completed. CSTM took 1.5s. Estimated remaining: 8m 36s. Rate: 158.1 symbols/min [2025-10-14T22:35:48.688931] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:48.971103] [DEBUG] [LOCAL ] CTOS: Loaded 37068 existing records from primary storage. [2025-10-14T22:35:48.971611] [INFO ] [MAIN ] CTOS: Loaded 37068 primary data records. [2025-10-14T22:35:49.092424] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:49.103690] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 6891 primary records. [2025-10-14T22:35:49.114178] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-14T22:35:49.299841] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-14T22:35:49.300836] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-14T22:35:49.303216] [INFO ] [MAIN ] Derivative Progress: 454/1812 symbols completed. CTBB took 1.1s. Estimated remaining: 8m 36s. Rate: 157.8 symbols/min [2025-10-14T22:35:49.303722] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:49.323242] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:49.324132] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27742 primary records. [2025-10-14T22:35:49.324998] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-14T22:35:49.344616] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-14T22:35:49.345196] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-14T22:35:49.347493] [INFO ] [MAIN ] Derivative Progress: 455/1812 symbols completed. CTO took 1.1s. Estimated remaining: 8m 35s. Rate: 158.2 symbols/min [2025-10-14T22:35:49.347985] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:49.365235] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:49.366172] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 37068 primary records. [2025-10-14T22:35:49.366375] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-14T22:35:49.383247] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-14T22:35:49.383487] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-14T22:35:49.399039] [INFO ] [MAIN ] Derivative Progress: 456/1812 symbols completed. CTOS took 0.7s. Estimated remaining: 8m 33s. Rate: 158.5 symbols/min [2025-10-14T22:35:49.399505] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:49.420306] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-14T22:35:49.420451] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-14T22:35:49.766354] [DEBUG] [LOCAL ] CTRE: Loaded 49413 existing records from primary storage. [2025-10-14T22:35:49.766678] [INFO ] [MAIN ] CTRE: Loaded 49413 primary data records. [2025-10-14T22:35:49.767974] [DEBUG] [LOCAL ] CTRI: Loaded 39942 existing records from primary storage. [2025-10-14T22:35:49.789135] [INFO ] [MAIN ] CTRI: Loaded 39942 primary data records. [2025-10-14T22:35:50.467474] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:50.468728] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53647 primary records. [2025-10-14T22:35:50.469203] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-14T22:35:50.490808] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-14T22:35:50.491234] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-14T22:35:50.493981] [INFO ] [MAIN ] Derivative Progress: 457/1812 symbols completed. CTRA took 1.2s. Estimated remaining: 8m 35s. Rate: 157.8 symbols/min [2025-10-14T22:35:50.494638] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:50.526144] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:50.537229] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 39942 primary records. [2025-10-14T22:35:50.538049] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-14T22:35:50.537974] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:50.539109] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49413 primary records. [2025-10-14T22:35:50.539893] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-14T22:35:50.569176] [DEBUG] [LOCAL ] CTS: Loaded 19598 existing records from primary storage. [2025-10-14T22:35:50.576450] [INFO ] [MAIN ] CTS: Loaded 19598 primary data records. [2025-10-14T22:35:50.632523] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-14T22:35:50.633086] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-10-14T22:35:50.648823] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-14T22:35:50.648999] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-14T22:35:50.651414] [INFO ] [MAIN ] Derivative Progress: 458/1812 symbols completed. CTRE took 1.3s. Estimated remaining: 8m 34s. Rate: 158.0 symbols/min [2025-10-14T22:35:50.665631] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:50.676994] [INFO ] [MAIN ] Derivative Progress: 459/1812 symbols completed. CTRI took 1.3s. Estimated remaining: 8m 33s. Rate: 158.3 symbols/min [2025-10-14T22:35:50.695058] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:50.980324] [DEBUG] [LOCAL ] CTVA: Loaded 53288 existing records from primary storage. [2025-10-14T22:35:50.981779] [INFO ] [MAIN ] CTVA: Loaded 53288 primary data records. [2025-10-14T22:35:51.107399] [DEBUG] [LOCAL ] CUBE: Loaded 50859 existing records from primary storage. [2025-10-14T22:35:51.107835] [INFO ] [MAIN ] CUBE: Loaded 50859 primary data records. [2025-10-14T22:35:51.442709] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:51.484398] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19598 primary records. [2025-10-14T22:35:51.493349] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-14T22:35:51.653545] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-14T22:35:51.653923] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-14T22:35:51.655922] [INFO ] [MAIN ] Derivative Progress: 460/1812 symbols completed. CTS took 1.2s. Estimated remaining: 8m 34s. Rate: 157.8 symbols/min [2025-10-14T22:35:51.656758] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:51.688847] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:51.689730] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53288 primary records. [2025-10-14T22:35:51.689948] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-14T22:35:51.724732] [DEBUG] [LOCAL ] CUBI: Loaded 27208 existing records from primary storage. [2025-10-14T22:35:51.729498] [INFO ] [MAIN ] CUBI: Loaded 27208 primary data records. [2025-10-14T22:35:51.724136] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-14T22:35:51.729908] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-14T22:35:51.731814] [INFO ] [MAIN ] Derivative Progress: 461/1812 symbols completed. CTVA took 1.1s. Estimated remaining: 8m 33s. Rate: 158.1 symbols/min [2025-10-14T22:35:51.743410] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:51.752987] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:51.768232] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50859 primary records. [2025-10-14T22:35:51.777445] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-14T22:35:51.883270] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-14T22:35:51.935806] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-14T22:35:51.938117] [INFO ] [MAIN ] Derivative Progress: 462/1812 symbols completed. CUBE took 1.2s. Estimated remaining: 8m 32s. Rate: 158.2 symbols/min [2025-10-14T22:35:51.938324] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:52.108872] [DEBUG] [LOCAL ] CUK: Loaded 51044 existing records from primary storage. [2025-10-14T22:35:52.109236] [INFO ] [MAIN ] CUK: Loaded 51044 primary data records. [2025-10-14T22:35:52.282409] [DEBUG] [LOCAL ] CURV: Loaded 26882 existing records from primary storage. [2025-10-14T22:35:52.311049] [INFO ] [MAIN ] CURV: Loaded 26882 primary data records. [2025-10-14T22:35:52.733607] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:52.734344] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27208 primary records. [2025-10-14T22:35:52.734506] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-14T22:35:52.751805] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-14T22:35:52.752407] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-14T22:35:52.754828] [INFO ] [MAIN ] Derivative Progress: 463/1812 symbols completed. CUBI took 1.1s. Estimated remaining: 8m 33s. Rate: 157.8 symbols/min [2025-10-14T22:35:52.771859] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:52.772458] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51044 primary records. [2025-10-14T22:35:52.772612] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-14T22:35:52.788754] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-14T22:35:52.788913] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-14T22:35:52.790884] [INFO ] [MAIN ] Derivative Progress: 464/1812 symbols completed. CUK took 1.0s. Estimated remaining: 8m 31s. Rate: 158.1 symbols/min [2025-10-14T22:35:52.805279] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:52.805808] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26882 primary records. [2025-10-14T22:35:52.805866] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-14T22:35:52.820212] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-14T22:35:52.820267] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-14T22:35:52.822469] [INFO ] [MAIN ] Derivative Progress: 465/1812 symbols completed. CURV took 0.9s. Estimated remaining: 8m 30s. Rate: 158.4 symbols/min [2025-10-14T22:35:52.822855] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:52.822926] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:52.822996] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:52.841805] [DEBUG] [LOCAL ] CVEO: Loaded 15396 existing records from primary storage. [2025-10-14T22:35:52.841935] [INFO ] [MAIN ] CVEO: Loaded 15396 primary data records. [2025-10-14T22:35:53.187548] [DEBUG] [LOCAL ] CVE: Loaded 53562 existing records from primary storage. [2025-10-14T22:35:53.187794] [INFO ] [MAIN ] CVE: Loaded 53562 primary data records. [2025-10-14T22:35:53.188396] [DEBUG] [LOCAL ] CUZ: Loaded 49608 existing records from primary storage. [2025-10-14T22:35:53.188690] [INFO ] [MAIN ] CUZ: Loaded 49608 primary data records. [2025-10-14T22:35:53.856079] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:53.857237] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15396 primary records. [2025-10-14T22:35:53.857356] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-14T22:35:53.875052] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-10-14T22:35:53.875239] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-14T22:35:53.877311] [INFO ] [MAIN ] Derivative Progress: 466/1812 symbols completed. CVEO took 1.1s. Estimated remaining: 8m 32s. Rate: 157.8 symbols/min [2025-10-14T22:35:53.877619] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:53.921214] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:53.922160] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:53.923051] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53562 primary records. [2025-10-14T22:35:53.923414] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-14T22:35:53.924415] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49608 primary records. [2025-10-14T22:35:53.937704] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-14T22:35:53.942390] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-14T22:35:53.954296] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-14T22:35:53.956792] [INFO ] [MAIN ] Derivative Progress: 467/1812 symbols completed. CVE took 1.1s. Estimated remaining: 8m 30s. Rate: 158.1 symbols/min [2025-10-14T22:35:53.956963] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:53.979088] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-14T22:35:53.979525] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-14T22:35:53.981496] [INFO ] [MAIN ] Derivative Progress: 468/1812 symbols completed. CUZ took 1.2s. Estimated remaining: 8m 29s. Rate: 158.4 symbols/min [2025-10-14T22:35:53.994608] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:54.001002] [DEBUG] [LOCAL ] CVLG: Loaded 15571 existing records from primary storage. [2025-10-14T22:35:54.001534] [INFO ] [MAIN ] CVLG: Loaded 15571 primary data records. [2025-10-14T22:35:54.000743] [DEBUG] [LOCAL ] CVI: Loaded 46631 existing records from primary storage. [2025-10-14T22:35:54.001746] [INFO ] [MAIN ] CVI: Loaded 46631 primary data records. [2025-10-14T22:35:54.652074] [DEBUG] [LOCAL ] CVNA: Loaded 52872 existing records from primary storage. [2025-10-14T22:35:54.653872] [INFO ] [MAIN ] CVNA: Loaded 52872 primary data records. [2025-10-14T22:35:55.012524] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:55.011490] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:55.013556] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15571 primary records. [2025-10-14T22:35:55.014216] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46631 primary records. [2025-10-14T22:35:55.014315] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-14T22:35:55.014699] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-14T22:35:55.045883] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-14T22:35:55.046918] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-10-14T22:35:55.047221] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-14T22:35:55.047175] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-14T22:35:55.049324] [INFO ] [MAIN ] Derivative Progress: 469/1812 symbols completed. CVLG took 1.1s. Estimated remaining: 8m 31s. Rate: 157.8 symbols/min [2025-10-14T22:35:55.049502] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:55.051333] [INFO ] [MAIN ] Derivative Progress: 470/1812 symbols completed. CVI took 1.2s. Estimated remaining: 8m 29s. Rate: 158.1 symbols/min [2025-10-14T22:35:55.053280] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:55.078632] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:55.079546] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52872 primary records. [2025-10-14T22:35:55.079802] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-14T22:35:55.115685] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-14T22:35:55.115836] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-14T22:35:55.118337] [INFO ] [MAIN ] Derivative Progress: 471/1812 symbols completed. CVNA took 1.1s. Estimated remaining: 8m 28s. Rate: 158.4 symbols/min [2025-10-14T22:35:55.118726] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:55.153782] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-14T22:35:55.154132] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-14T22:35:55.253784] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-14T22:35:55.261260] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-14T22:35:55.320942] [DEBUG] [LOCAL ] CW: Loaded 22123 existing records from primary storage. [2025-10-14T22:35:55.365525] [INFO ] [MAIN ] CW: Loaded 22123 primary data records. [2025-10-14T22:35:56.210955] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:56.227903] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-10-14T22:35:56.229050] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-14T22:35:56.230914] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:56.257273] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53694 primary records. [2025-10-14T22:35:56.253373] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:56.258309] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-14T22:35:56.262240] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22123 primary records. [2025-10-14T22:35:56.263520] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-14T22:35:56.290592] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-14T22:35:56.294634] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-14T22:35:56.295040] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-14T22:35:56.295113] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-14T22:35:56.299298] [INFO ] [MAIN ] Derivative Progress: 472/1812 symbols completed. CVX took 1.2s. Estimated remaining: 8m 30s. Rate: 157.7 symbols/min [2025-10-14T22:35:56.302812] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:56.306121] [INFO ] [MAIN ] Derivative Progress: 473/1812 symbols completed. CVS took 1.3s. Estimated remaining: 8m 28s. Rate: 158.0 symbols/min [2025-10-14T22:35:56.307878] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-10-14T22:35:56.307783] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:56.308703] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-14T22:35:56.311739] [INFO ] [MAIN ] Derivative Progress: 474/1812 symbols completed. CW took 1.2s. Estimated remaining: 8m 27s. Rate: 158.4 symbols/min [2025-10-14T22:35:56.312256] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:56.361541] [DEBUG] [LOCAL ] CWT: Loaded 28136 existing records from primary storage. [2025-10-14T22:35:56.361931] [INFO ] [MAIN ] CWT: Loaded 28136 primary data records. [2025-10-14T22:35:56.503847] [DEBUG] [LOCAL ] CWAN: Loaded 52586 existing records from primary storage. [2025-10-14T22:35:56.523572] [INFO ] [MAIN ] CWAN: Loaded 52586 primary data records. [2025-10-14T22:35:56.580161] [DEBUG] [LOCAL ] CX: Loaded 52837 existing records from primary storage. [2025-10-14T22:35:56.668459] [INFO ] [MAIN ] CX: Loaded 52837 primary data records. [2025-10-14T22:35:57.404524] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:57.413937] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 28136 primary records. [2025-10-14T22:35:57.418357] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-14T22:35:57.428135] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:57.433568] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52586 primary records. [2025-10-14T22:35:57.436338] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-14T22:35:57.438910] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-14T22:35:57.439939] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-14T22:35:57.442402] [INFO ] [MAIN ] Derivative Progress: 475/1812 symbols completed. CWT took 1.1s. Estimated remaining: 8m 29s. Rate: 157.7 symbols/min [2025-10-14T22:35:57.451693] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:57.474050] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-14T22:35:57.474430] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:57.475260] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52837 primary records. [2025-10-14T22:35:57.474590] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-14T22:35:57.477622] [INFO ] [MAIN ] Derivative Progress: 476/1812 symbols completed. CWAN took 1.2s. Estimated remaining: 8m 27s. Rate: 158.0 symbols/min [2025-10-14T22:35:57.479771] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-14T22:35:57.479593] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:57.501010] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-14T22:35:57.501165] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-14T22:35:57.504123] [INFO ] [MAIN ] Derivative Progress: 477/1812 symbols completed. CX took 1.2s. Estimated remaining: 8m 26s. Rate: 158.3 symbols/min [2025-10-14T22:35:57.496382] [DEBUG] [LOCAL ] CXE: Loaded 6134 existing records from primary storage. [2025-10-14T22:35:57.505737] [INFO ] [MAIN ] CXE: Loaded 6134 primary data records. [2025-10-14T22:35:57.505392] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:57.543500] [DEBUG] [LOCAL ] CXH: Loaded 4435 existing records from primary storage. [2025-10-14T22:35:57.556611] [INFO ] [MAIN ] CXH: Loaded 4435 primary data records. [2025-10-14T22:35:58.142874] [DEBUG] [LOCAL ] CXM: Loaded 47569 existing records from primary storage. [2025-10-14T22:35:58.173171] [INFO ] [MAIN ] CXM: Loaded 47569 primary data records. [2025-10-14T22:35:58.512035] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:58.514976] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6134 primary records. [2025-10-14T22:35:58.515362] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-14T22:35:58.541896] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:58.546294] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-14T22:35:58.547233] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4435 primary records. [2025-10-14T22:35:58.547520] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-14T22:35:58.547710] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-14T22:35:58.550500] [INFO ] [MAIN ] Derivative Progress: 478/1812 symbols completed. CXE took 1.1s. Estimated remaining: 8m 27s. Rate: 157.7 symbols/min [2025-10-14T22:35:58.568110] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-10-14T22:35:58.568335] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-14T22:35:58.570589] [INFO ] [MAIN ] Derivative Progress: 479/1812 symbols completed. CXH took 1.1s. Estimated remaining: 8m 26s. Rate: 158.1 symbols/min [2025-10-14T22:35:58.583280] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:58.583996] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47569 primary records. [2025-10-14T22:35:58.584060] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-14T22:35:58.599328] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-14T22:35:58.599386] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-14T22:35:58.601474] [INFO ] [MAIN ] Derivative Progress: 480/1812 symbols completed. CXM took 1.1s. Estimated remaining: 8m 25s. Rate: 158.4 symbols/min [2025-10-14T22:35:58.601918] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:58.602184] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:58.602027] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:58.658688] [DEBUG] [LOCAL ] CYD: Loaded 26757 existing records from primary storage. [2025-10-14T22:35:58.660190] [INFO ] [MAIN ] CYD: Loaded 26757 primary data records. [2025-10-14T22:35:58.682237] [DEBUG] [LOCAL ] CXT: Loaded 31022 existing records from primary storage. [2025-10-14T22:35:58.699284] [INFO ] [MAIN ] CXT: Loaded 31022 primary data records. [2025-10-14T22:35:58.749783] [DEBUG] [LOCAL ] CYH: Loaded 47721 existing records from primary storage. [2025-10-14T22:35:58.773301] [INFO ] [MAIN ] CYH: Loaded 47721 primary data records. [2025-10-14T22:35:59.658862] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:59.659969] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26757 primary records. [2025-10-14T22:35:59.660239] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-14T22:35:59.696859] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-14T22:35:59.698380] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-14T22:35:59.700627] [INFO ] [MAIN ] Derivative Progress: 481/1812 symbols completed. CYD took 1.1s. Estimated remaining: 8m 26s. Rate: 157.7 symbols/min [2025-10-14T22:35:59.701136] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:59.701470] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:59.702854] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 31022 primary records. [2025-10-14T22:35:59.711237] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-14T22:35:59.717896] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:35:59.726533] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47721 primary records. [2025-10-14T22:35:59.731249] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-14T22:35:59.737637] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-14T22:35:59.738335] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-14T22:35:59.740467] [INFO ] [MAIN ] Derivative Progress: 482/1812 symbols completed. CXT took 1.1s. Estimated remaining: 8m 25s. Rate: 158.0 symbols/min [2025-10-14T22:35:59.740713] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:59.759894] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-14T22:35:59.760334] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-14T22:35:59.763253] [INFO ] [MAIN ] Derivative Progress: 483/1812 symbols completed. CYH took 1.2s. Estimated remaining: 8m 24s. Rate: 158.3 symbols/min [2025-10-14T22:35:59.763521] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:35:59.795262] [DEBUG] [LOCAL ] DAO: Loaded 19845 existing records from primary storage. [2025-10-14T22:35:59.795561] [INFO ] [MAIN ] DAO: Loaded 19845 primary data records. [2025-10-14T22:35:59.943035] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-10-14T22:35:59.975230] [INFO ] [MAIN ] D: Loaded 53647 primary data records. [2025-10-14T22:36:00.280993] [DEBUG] [LOCAL ] DAR: Loaded 51977 existing records from primary storage. [2025-10-14T22:36:00.295309] [INFO ] [MAIN ] DAR: Loaded 51977 primary data records. [2025-10-14T22:36:00.815320] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:00.816607] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 19845 primary records. [2025-10-14T22:36:00.817141] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-14T22:36:00.834187] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-14T22:36:00.835388] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-14T22:36:00.837479] [INFO ] [MAIN ] Derivative Progress: 484/1812 symbols completed. DAO took 1.1s. Estimated remaining: 8m 25s. Rate: 157.7 symbols/min [2025-10-14T22:36:00.838120] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:00.860363] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:00.864076] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53647 primary records. [2025-10-14T22:36:00.864261] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-14T22:36:00.887222] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:00.890794] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51977 primary records. [2025-10-14T22:36:00.892202] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-14T22:36:00.905160] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-14T22:36:00.905771] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-14T22:36:00.907717] [INFO ] [MAIN ] Derivative Progress: 485/1812 symbols completed. D took 1.2s. Estimated remaining: 8m 24s. Rate: 158.0 symbols/min [2025-10-14T22:36:00.915051] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:00.924997] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-14T22:36:00.925097] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-14T22:36:00.927513] [INFO ] [MAIN ] Derivative Progress: 486/1812 symbols completed. DAR took 1.2s. Estimated remaining: 8m 23s. Rate: 158.3 symbols/min [2025-10-14T22:36:00.939551] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:00.940990] [DEBUG] [LOCAL ] DAVA: Loaded 41776 existing records from primary storage. [2025-10-14T22:36:00.941304] [INFO ] [MAIN ] DAVA: Loaded 41776 primary data records. [2025-10-14T22:36:01.051467] [DEBUG] [LOCAL ] DBL: Loaded 9380 existing records from primary storage. [2025-10-14T22:36:01.056151] [INFO ] [MAIN ] DBL: Loaded 9380 primary data records. [2025-10-14T22:36:01.388594] [DEBUG] [LOCAL ] DB: Loaded 52500 existing records from primary storage. [2025-10-14T22:36:01.389186] [INFO ] [MAIN ] DB: Loaded 52500 primary data records. [2025-10-14T22:36:01.972497] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:01.974208] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41776 primary records. [2025-10-14T22:36:01.975321] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-14T22:36:02.007390] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:02.009470] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9380 primary records. [2025-10-14T22:36:02.009694] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-14T22:36:02.025745] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-14T22:36:02.032757] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-14T22:36:02.032911] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-14T22:36:02.043047] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-14T22:36:02.035317] [INFO ] [MAIN ] Derivative Progress: 487/1812 symbols completed. DAVA took 1.2s. Estimated remaining: 8m 24s. Rate: 157.7 symbols/min [2025-10-14T22:36:02.050330] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:02.050727] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:02.051603] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52500 primary records. [2025-10-14T22:36:02.051671] [INFO ] [MAIN ] Derivative Progress: 488/1812 symbols completed. DBL took 1.1s. Estimated remaining: 8m 23s. Rate: 158.0 symbols/min [2025-10-14T22:36:02.051930] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:02.051834] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-14T22:36:02.070572] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-14T22:36:02.070785] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-14T22:36:02.072991] [INFO ] [MAIN ] Derivative Progress: 489/1812 symbols completed. DB took 1.2s. Estimated remaining: 8m 21s. Rate: 158.3 symbols/min [2025-10-14T22:36:02.073423] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:02.100223] [DEBUG] [LOCAL ] DCI: Loaded 37060 existing records from primary storage. [2025-10-14T22:36:02.100378] [INFO ] [MAIN ] DCI: Loaded 37060 primary data records. [2025-10-14T22:36:02.294216] [DEBUG] [LOCAL ] DBRG: Loaded 49878 existing records from primary storage. [2025-10-14T22:36:02.351366] [INFO ] [MAIN ] DBRG: Loaded 49878 primary data records. [2025-10-14T22:36:02.351269] [DEBUG] [LOCAL ] DDL: Loaded 36889 existing records from primary storage. [2025-10-14T22:36:02.462709] [INFO ] [MAIN ] DDL: Loaded 36889 primary data records. [2025-10-14T22:36:03.112476] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:03.114632] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37060 primary records. [2025-10-14T22:36:03.114961] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-14T22:36:03.132498] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-14T22:36:03.132760] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-14T22:36:03.135486] [INFO ] [MAIN ] Derivative Progress: 490/1812 symbols completed. DCI took 1.1s. Estimated remaining: 8m 23s. Rate: 157.7 symbols/min [2025-10-14T22:36:03.138518] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:03.155971] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:03.158008] [DEBUG] [LOCAL ] DDT: Loaded 2089 existing records from primary storage. [2025-10-14T22:36:03.158185] [INFO ] [MAIN ] DDT: Loaded 2089 primary data records. [2025-10-14T22:36:03.158935] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49878 primary records. [2025-10-14T22:36:03.192295] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-14T22:36:03.216604] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:03.232280] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36889 primary records. [2025-10-14T22:36:03.259688] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-14T22:36:03.283825] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-14T22:36:03.283930] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-14T22:36:03.299206] [INFO ] [MAIN ] Derivative Progress: 491/1812 symbols completed. DBRG took 1.2s. Estimated remaining: 8m 22s. Rate: 157.9 symbols/min [2025-10-14T22:36:03.299603] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:03.331600] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-14T22:36:03.354493] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-14T22:36:03.500015] [INFO ] [MAIN ] Derivative Progress: 492/1812 symbols completed. DDL took 1.4s. Estimated remaining: 8m 21s. Rate: 158.1 symbols/min [2025-10-14T22:36:03.508957] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:03.553179] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:03.554358] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2089 primary records. [2025-10-14T22:36:03.554674] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-14T22:36:03.586531] [DEBUG] [LOCAL ] DE: Loaded 47686 existing records from primary storage. [2025-10-14T22:36:03.590458] [INFO ] [MAIN ] DE: Loaded 47686 primary data records. [2025-10-14T22:36:03.594712] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-10-14T22:36:03.599954] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-14T22:36:03.608554] [INFO ] [MAIN ] Derivative Progress: 493/1812 symbols completed. DDT took 0.5s. Estimated remaining: 8m 20s. Rate: 158.3 symbols/min [2025-10-14T22:36:03.693065] [DEBUG] [LOCAL ] DEA: Loaded 40455 existing records from primary storage. [2025-10-14T22:36:03.712012] [INFO ] [MAIN ] DEA: Loaded 40455 primary data records. [2025-10-14T22:36:04.267601] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:04.268554] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47686 primary records. [2025-10-14T22:36:04.268776] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-14T22:36:04.298321] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:04.299031] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-14T22:36:04.299115] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-14T22:36:04.299775] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40455 primary records. [2025-10-14T22:36:04.301717] [INFO ] [MAIN ] Derivative Progress: 494/1812 symbols completed. DE took 1.0s. Estimated remaining: 8m 20s. Rate: 158.0 symbols/min [2025-10-14T22:36:04.301819] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-14T22:36:04.317287] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-10-14T22:36:04.317361] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-14T22:36:04.319228] [INFO ] [MAIN ] Derivative Progress: 495/1812 symbols completed. DEA took 0.8s. Estimated remaining: 8m 19s. Rate: 158.3 symbols/min [2025-10-14T22:36:04.319670] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:04.319776] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:04.319607] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:04.362088] [DEBUG] [LOCAL ] DEC: Loaded 30408 existing records from primary storage. [2025-10-14T22:36:04.362295] [INFO ] [MAIN ] DEC: Loaded 30408 primary data records. [2025-10-14T22:36:04.524023] [DEBUG] [LOCAL ] DEI: Loaded 48296 existing records from primary storage. [2025-10-14T22:36:04.580061] [DEBUG] [LOCAL ] DECK: Loaded 53293 existing records from primary storage. [2025-10-14T22:36:04.585154] [INFO ] [MAIN ] DECK: Loaded 53293 primary data records. [2025-10-14T22:36:04.585264] [INFO ] [MAIN ] DEI: Loaded 48296 primary data records. [2025-10-14T22:36:05.356517] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:05.357731] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30408 primary records. [2025-10-14T22:36:05.357903] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-14T22:36:05.380667] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-10-14T22:36:05.381370] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-14T22:36:05.383458] [INFO ] [MAIN ] Derivative Progress: 496/1812 symbols completed. DEC took 1.1s. Estimated remaining: 8m 21s. Rate: 157.8 symbols/min [2025-10-14T22:36:05.383633] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:05.400979] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:05.402112] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48296 primary records. [2025-10-14T22:36:05.402254] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-14T22:36:05.424348] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-10-14T22:36:05.438192] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-14T22:36:05.441228] [INFO ] [MAIN ] Derivative Progress: 497/1812 symbols completed. DEI took 1.1s. Estimated remaining: 8m 19s. Rate: 158.0 symbols/min [2025-10-14T22:36:05.441935] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:05.441521] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:05.443442] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53293 primary records. [2025-10-14T22:36:05.443543] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-14T22:36:05.487454] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-14T22:36:05.487852] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-14T22:36:05.490702] [INFO ] [MAIN ] Derivative Progress: 498/1812 symbols completed. DECK took 1.2s. Estimated remaining: 8m 18s. Rate: 158.3 symbols/min [2025-10-14T22:36:05.491574] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:05.513768] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-14T22:36:05.526329] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-14T22:36:05.671704] [DEBUG] [LOCAL ] DFIN: Loaded 22636 existing records from primary storage. [2025-10-14T22:36:05.677672] [INFO ] [MAIN ] DFIN: Loaded 22636 primary data records. [2025-10-14T22:36:05.694310] [DEBUG] [LOCAL ] DEO: Loaded 49214 existing records from primary storage. [2025-10-14T22:36:05.709626] [INFO ] [MAIN ] DEO: Loaded 49214 primary data records. [2025-10-14T22:36:06.554572] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:06.557450] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-10-14T22:36:06.557983] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-14T22:36:06.579919] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-14T22:36:06.580296] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-14T22:36:06.582963] [INFO ] [MAIN ] Derivative Progress: 499/1812 symbols completed. DELL took 1.2s. Estimated remaining: 8m 20s. Rate: 157.7 symbols/min [2025-10-14T22:36:06.584101] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:06.600177] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:06.602065] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 22636 primary records. [2025-10-14T22:36:06.602923] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-14T22:36:06.629823] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-14T22:36:06.644803] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:06.643988] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-14T22:36:06.651330] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49214 primary records. [2025-10-14T22:36:06.651490] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-14T22:36:06.654390] [INFO ] [MAIN ] Derivative Progress: 500/1812 symbols completed. DFIN took 1.2s. Estimated remaining: 8m 18s. Rate: 158.0 symbols/min [2025-10-14T22:36:06.654873] [DEBUG] [LOCAL ] DFP: Loaded 11209 existing records from primary storage. [2025-10-14T22:36:06.656056] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:06.656219] [INFO ] [MAIN ] DFP: Loaded 11209 primary data records. [2025-10-14T22:36:06.747540] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-10-14T22:36:06.771704] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-14T22:36:06.791553] [INFO ] [MAIN ] Derivative Progress: 501/1812 symbols completed. DEO took 1.3s. Estimated remaining: 8m 17s. Rate: 158.2 symbols/min [2025-10-14T22:36:06.792167] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:07.009590] [DEBUG] [LOCAL ] DHF: Loaded 21165 existing records from primary storage. [2025-10-14T22:36:07.009868] [INFO ] [MAIN ] DHF: Loaded 21165 primary data records. [2025-10-14T22:36:07.133416] [DEBUG] [LOCAL ] DG: Loaded 53278 existing records from primary storage. [2025-10-14T22:36:07.154894] [INFO ] [MAIN ] DG: Loaded 53278 primary data records. [2025-10-14T22:36:07.650773] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:07.651927] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11209 primary records. [2025-10-14T22:36:07.652268] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-14T22:36:07.670890] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-14T22:36:07.671226] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-14T22:36:07.673403] [INFO ] [MAIN ] Derivative Progress: 502/1812 symbols completed. DFP took 1.1s. Estimated remaining: 8m 18s. Rate: 157.7 symbols/min [2025-10-14T22:36:07.674941] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:07.692264] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:07.693075] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 21165 primary records. [2025-10-14T22:36:07.693241] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-14T22:36:07.715029] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-10-14T22:36:07.715414] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-14T22:36:07.717831] [INFO ] [MAIN ] Derivative Progress: 503/1812 symbols completed. DHF took 0.9s. Estimated remaining: 8m 17s. Rate: 158.0 symbols/min [2025-10-14T22:36:07.726273] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:07.731944] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:07.732899] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53278 primary records. [2025-10-14T22:36:07.732962] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-14T22:36:07.763513] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-10-14T22:36:07.763779] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-14T22:36:07.766450] [INFO ] [MAIN ] Derivative Progress: 504/1812 symbols completed. DG took 1.1s. Estimated remaining: 8m 16s. Rate: 158.3 symbols/min [2025-10-14T22:36:07.766745] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:07.792455] [DEBUG] [LOCAL ] DHI: Loaded 53364 existing records from primary storage. [2025-10-14T22:36:07.802881] [INFO ] [MAIN ] DHI: Loaded 53364 primary data records. [2025-10-14T22:36:07.838478] [DEBUG] [LOCAL ] DHX: Loaded 13307 existing records from primary storage. [2025-10-14T22:36:07.863871] [INFO ] [MAIN ] DHX: Loaded 13307 primary data records. [2025-10-14T22:36:07.973071] [DEBUG] [LOCAL ] DHT: Loaded 47891 existing records from primary storage. [2025-10-14T22:36:08.003563] [INFO ] [MAIN ] DHT: Loaded 47891 primary data records. [2025-10-14T22:36:08.869239] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:08.867662] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:08.870098] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53364 primary records. [2025-10-14T22:36:08.871850] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-14T22:36:08.871975] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13307 primary records. [2025-10-14T22:36:08.872066] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-14T22:36:08.918169] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-14T22:36:08.919755] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-14T22:36:08.919820] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-14T22:36:08.920639] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-14T22:36:08.920541] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:08.922672] [INFO ] [MAIN ] Derivative Progress: 505/1812 symbols completed. DHX took 1.2s. Estimated remaining: 8m 17s. Rate: 157.7 symbols/min [2025-10-14T22:36:08.924918] [INFO ] [MAIN ] Derivative Progress: 506/1812 symbols completed. DHI took 1.2s. Estimated remaining: 8m 16s. Rate: 158.0 symbols/min [2025-10-14T22:36:08.924849] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:08.925123] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:08.926426] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47891 primary records. [2025-10-14T22:36:08.926622] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-14T22:36:08.947835] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-14T22:36:08.947989] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-14T22:36:08.950003] [INFO ] [MAIN ] Derivative Progress: 507/1812 symbols completed. DHT took 1.2s. Estimated remaining: 8m 15s. Rate: 158.3 symbols/min [2025-10-14T22:36:08.950231] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:08.956733] [DEBUG] [LOCAL ] DIAX: Loaded 13088 existing records from primary storage. [2025-10-14T22:36:08.957423] [INFO ] [MAIN ] DIAX: Loaded 13088 primary data records. [2025-10-14T22:36:09.275007] [DEBUG] [LOCAL ] DIN: Loaded 37391 existing records from primary storage. [2025-10-14T22:36:09.288705] [INFO ] [MAIN ] DIN: Loaded 37391 primary data records. [2025-10-14T22:36:09.416753] [DEBUG] [LOCAL ] DINO: Loaded 52845 existing records from primary storage. [2025-10-14T22:36:09.432892] [INFO ] [MAIN ] DINO: Loaded 52845 primary data records. [2025-10-14T22:36:09.939387] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:09.940740] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 13088 primary records. [2025-10-14T22:36:09.940890] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-14T22:36:09.959675] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-14T22:36:09.961751] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-14T22:36:09.964270] [INFO ] [MAIN ] Derivative Progress: 508/1812 symbols completed. DIAX took 1.0s. Estimated remaining: 8m 16s. Rate: 157.7 symbols/min [2025-10-14T22:36:09.977311] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:09.978861] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37391 primary records. [2025-10-14T22:36:09.979116] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-14T22:36:09.995181] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-14T22:36:09.995366] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-14T22:36:09.997715] [INFO ] [MAIN ] Derivative Progress: 509/1812 symbols completed. DIN took 1.1s. Estimated remaining: 8m 15s. Rate: 158.0 symbols/min [2025-10-14T22:36:10.012322] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:10.012903] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52845 primary records. [2025-10-14T22:36:10.012964] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-14T22:36:10.027623] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-14T22:36:10.027723] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-14T22:36:10.029823] [INFO ] [MAIN ] Derivative Progress: 510/1812 symbols completed. DINO took 1.1s. Estimated remaining: 8m 13s. Rate: 158.3 symbols/min [2025-10-14T22:36:10.030284] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:10.030222] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:10.030616] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:10.054303] [DEBUG] [LOCAL ] DKL: Loaded 17667 existing records from primary storage. [2025-10-14T22:36:10.054484] [INFO ] [MAIN ] DKL: Loaded 17667 primary data records. [2025-10-14T22:36:10.279127] [DEBUG] [LOCAL ] DKS: Loaded 49710 existing records from primary storage. [2025-10-14T22:36:10.407027] [INFO ] [MAIN ] DKS: Loaded 49710 primary data records. [2025-10-14T22:36:10.505214] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-14T22:36:10.517184] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-14T22:36:11.070142] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:11.073309] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 17667 primary records. [2025-10-14T22:36:11.074013] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-14T22:36:11.103983] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:11.106602] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-14T22:36:11.106933] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-14T22:36:11.109589] [INFO ] [MAIN ] Derivative Progress: 511/1812 symbols completed. DKL took 1.1s. Estimated remaining: 8m 15s. Rate: 157.7 symbols/min [2025-10-14T22:36:11.109907] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:11.111710] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49710 primary records. [2025-10-14T22:36:11.112328] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-14T22:36:11.146633] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-14T22:36:11.146768] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-14T22:36:11.152523] [INFO ] [MAIN ] Derivative Progress: 512/1812 symbols completed. DKS took 1.1s. Estimated remaining: 8m 14s. Rate: 158.0 symbols/min [2025-10-14T22:36:11.153030] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:11.152798] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:11.150344] [DEBUG] [LOCAL ] DLNG: Loaded 6189 existing records from primary storage. [2025-10-14T22:36:11.154376] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-14T22:36:11.153726] [INFO ] [MAIN ] DLNG: Loaded 6189 primary data records. [2025-10-14T22:36:11.154501] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-14T22:36:11.502493] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-14T22:36:11.502904] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-14T22:36:11.505151] [INFO ] [MAIN ] Derivative Progress: 513/1812 symbols completed. DIS took 1.5s. Estimated remaining: 8m 13s. Rate: 158.0 symbols/min [2025-10-14T22:36:11.505453] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:11.524600] [DEBUG] [LOCAL ] DLR: Loaded 50730 existing records from primary storage. [2025-10-14T22:36:11.525370] [INFO ] [MAIN ] DLR: Loaded 50730 primary data records. [2025-10-14T22:36:11.843477] [DEBUG] [LOCAL ] DLX: Loaded 28438 existing records from primary storage. [2025-10-14T22:36:11.843899] [INFO ] [MAIN ] DLX: Loaded 28438 primary data records. [2025-10-14T22:36:11.956970] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:11.968605] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6189 primary records. [2025-10-14T22:36:11.968725] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-14T22:36:12.233537] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-10-14T22:36:12.234533] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-14T22:36:12.236561] [INFO ] [MAIN ] Derivative Progress: 514/1812 symbols completed. DLNG took 1.1s. Estimated remaining: 8m 14s. Rate: 157.7 symbols/min [2025-10-14T22:36:12.236735] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:12.257341] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:12.258241] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50730 primary records. [2025-10-14T22:36:12.258752] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-14T22:36:12.289092] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-14T22:36:12.290953] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-14T22:36:12.293532] [INFO ] [MAIN ] Derivative Progress: 515/1812 symbols completed. DLR took 1.1s. Estimated remaining: 8m 13s. Rate: 158.0 symbols/min [2025-10-14T22:36:12.293853] [DEBUG] [LOCAL ] DLY: Loaded 20477 existing records from primary storage. [2025-10-14T22:36:12.294169] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:12.294390] [INFO ] [MAIN ] DLY: Loaded 20477 primary data records. [2025-10-14T22:36:12.403181] [DEBUG] [LOCAL ] DMA: Loaded 4725 existing records from primary storage. [2025-10-14T22:36:12.429396] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:12.430560] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28438 primary records. [2025-10-14T22:36:12.428949] [INFO ] [MAIN ] DMA: Loaded 4725 primary data records. [2025-10-14T22:36:12.444028] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-14T22:36:12.782700] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-14T22:36:12.834793] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-14T22:36:12.855339] [INFO ] [MAIN ] Derivative Progress: 516/1812 symbols completed. DLX took 1.3s. Estimated remaining: 8m 13s. Rate: 157.9 symbols/min [2025-10-14T22:36:12.976733] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:13.000817] [DEBUG] [LOCAL ] DMO: Loaded 9973 existing records from primary storage. [2025-10-14T22:36:13.001104] [INFO ] [MAIN ] DMO: Loaded 9973 primary data records. [2025-10-14T22:36:13.121770] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:13.122751] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 20477 primary records. [2025-10-14T22:36:13.123510] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-14T22:36:13.350388] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-14T22:36:13.348142] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:36:13.350571] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-14T22:36:13.353860] [INFO ] [MAIN ] Derivative Progress: 517/1812 symbols completed. DLY took 1.1s. Estimated remaining: 8m 13s. Rate: 157.8 symbols/min [2025-10-14T22:36:13.354102] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:13.351842] [INFO ] [MAIN ] DMA: Generated 1793 derivative records from 4725 primary records. [2025-10-14T22:36:13.355124] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-14T22:36:13.374168] [DEBUG] [LOCAL ] DMA: Derivative data saved (1793 records). [2025-10-14T22:36:13.374665] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-14T22:36:13.377215] [INFO ] [MAIN ] Derivative Progress: 518/1812 symbols completed. DMA took 1.1s. Estimated remaining: 8m 11s. Rate: 158.1 symbols/min [2025-10-14T22:36:13.377720] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:13.395551] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:13.396338] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9973 primary records. [2025-10-14T22:36:13.396412] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-14T22:36:13.422267] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-10-14T22:36:13.422336] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-14T22:36:13.424383] [INFO ] [MAIN ] Derivative Progress: 519/1812 symbols completed. DMO took 0.4s. Estimated remaining: 8m 10s. Rate: 158.3 symbols/min [2025-10-14T22:36:13.424602] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:13.454719] [DEBUG] [LOCAL ] DNA: Loaded 48569 existing records from primary storage. [2025-10-14T22:36:13.454888] [INFO ] [MAIN ] DNA: Loaded 48569 primary data records. [2025-10-14T22:36:13.587175] [DEBUG] [LOCAL ] DNOW: Loaded 43649 existing records from primary storage. [2025-10-14T22:36:13.608702] [INFO ] [MAIN ] DNOW: Loaded 43649 primary data records. [2025-10-14T22:36:13.804380] [DEBUG] [LOCAL ] DNP: Loaded 33224 existing records from primary storage. [2025-10-14T22:36:13.818275] [INFO ] [MAIN ] DNP: Loaded 33224 primary data records. [2025-10-14T22:36:14.479376] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:14.480423] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48569 primary records. [2025-10-14T22:36:14.480624] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-14T22:36:14.501387] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-10-14T22:36:14.502172] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-14T22:36:14.504892] [INFO ] [MAIN ] Derivative Progress: 520/1812 symbols completed. DNA took 1.2s. Estimated remaining: 8m 11s. Rate: 157.8 symbols/min [2025-10-14T22:36:14.505193] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:14.526112] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:14.532393] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43649 primary records. [2025-10-14T22:36:14.531576] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:14.533262] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33224 primary records. [2025-10-14T22:36:14.533492] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-14T22:36:14.533440] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-14T22:36:14.567825] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-14T22:36:14.568079] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-14T22:36:14.571486] [INFO ] [MAIN ] Derivative Progress: 521/1812 symbols completed. DNOW took 1.2s. Estimated remaining: 8m 10s. Rate: 158.0 symbols/min [2025-10-14T22:36:14.572261] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:14.575207] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-14T22:36:14.575347] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-14T22:36:14.578694] [INFO ] [MAIN ] Derivative Progress: 522/1812 symbols completed. DNP took 1.2s. Estimated remaining: 8m 9s. Rate: 158.3 symbols/min [2025-10-14T22:36:14.579100] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:14.646318] [DEBUG] [LOCAL ] DOC: Loaded 53552 existing records from primary storage. [2025-10-14T22:36:14.646717] [INFO ] [MAIN ] DOC: Loaded 53552 primary data records. [2025-10-14T22:36:14.721447] [DEBUG] [LOCAL ] DOCN: Loaded 50992 existing records from primary storage. [2025-10-14T22:36:14.760560] [INFO ] [MAIN ] DOCN: Loaded 50992 primary data records. [2025-10-14T22:36:15.076600] [DEBUG] [LOCAL ] DOCS: Loaded 50810 existing records from primary storage. [2025-10-14T22:36:15.089790] [INFO ] [MAIN ] DOCS: Loaded 50810 primary data records. [2025-10-14T22:36:15.625539] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:15.627634] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53552 primary records. [2025-10-14T22:36:15.627828] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-14T22:36:15.643067] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:15.652051] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50992 primary records. [2025-10-14T22:36:15.653283] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-14T22:36:15.670158] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-14T22:36:15.673964] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-14T22:36:15.676015] [INFO ] [MAIN ] Derivative Progress: 523/1812 symbols completed. DOC took 1.2s. Estimated remaining: 8m 10s. Rate: 157.7 symbols/min [2025-10-14T22:36:15.680775] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-14T22:36:15.680917] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-14T22:36:15.683727] [INFO ] [MAIN ] Derivative Progress: 524/1812 symbols completed. DOCN took 1.1s. Estimated remaining: 8m 9s. Rate: 158.0 symbols/min [2025-10-14T22:36:15.697996] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:15.698684] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 50810 primary records. [2025-10-14T22:36:15.698747] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-14T22:36:15.714515] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-14T22:36:15.714659] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-14T22:36:15.716517] [INFO ] [MAIN ] Derivative Progress: 525/1812 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 8s. Rate: 158.3 symbols/min [2025-10-14T22:36:15.716932] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:15.717082] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:15.717034] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:15.769353] [DEBUG] [LOCAL ] DOUG: Loaded 34291 existing records from primary storage. [2025-10-14T22:36:15.769548] [INFO ] [MAIN ] DOUG: Loaded 34291 primary data records. [2025-10-14T22:36:15.885968] [DEBUG] [LOCAL ] DOLE: Loaded 39166 existing records from primary storage. [2025-10-14T22:36:15.903308] [DEBUG] [LOCAL ] DOV: Loaded 45600 existing records from primary storage. [2025-10-14T22:36:15.903507] [INFO ] [MAIN ] DOLE: Loaded 39166 primary data records. [2025-10-14T22:36:15.919497] [INFO ] [MAIN ] DOV: Loaded 45600 primary data records. [2025-10-14T22:36:16.791695] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:36:16.797803] [INFO ] [MAIN ] DOUG: Generated 1793 derivative records from 34291 primary records. [2025-10-14T22:36:16.796938] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:16.798459] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45600 primary records. [2025-10-14T22:36:16.798803] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-14T22:36:16.798629] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-14T22:36:16.831351] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1793 records). [2025-10-14T22:36:16.844125] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-14T22:36:16.846250] [INFO ] [MAIN ] Derivative Progress: 526/1812 symbols completed. DOUG took 1.1s. Estimated remaining: 8m 9s. Rate: 157.7 symbols/min [2025-10-14T22:36:16.847573] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:16.847213] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:16.848737] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 39166 primary records. [2025-10-14T22:36:16.849673] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-14T22:36:16.850542] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-14T22:36:16.850680] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-14T22:36:16.853369] [INFO ] [MAIN ] Derivative Progress: 527/1812 symbols completed. DOV took 1.1s. Estimated remaining: 8m 8s. Rate: 158.0 symbols/min [2025-10-14T22:36:16.854167] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:16.871685] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-14T22:36:16.871906] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-14T22:36:16.873803] [INFO ] [MAIN ] Derivative Progress: 528/1812 symbols completed. DOLE took 1.2s. Estimated remaining: 8m 7s. Rate: 158.3 symbols/min [2025-10-14T22:36:16.877981] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:16.887221] [DEBUG] [LOCAL ] DPG: Loaded 13595 existing records from primary storage. [2025-10-14T22:36:16.887356] [INFO ] [MAIN ] DPG: Loaded 13595 primary data records. [2025-10-14T22:36:17.125023] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-14T22:36:17.243493] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-14T22:36:17.312483] [DEBUG] [LOCAL ] DQ: Loaded 43704 existing records from primary storage. [2025-10-14T22:36:17.334518] [INFO ] [MAIN ] DQ: Loaded 43704 primary data records. [2025-10-14T22:36:17.891345] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:17.893880] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13595 primary records. [2025-10-14T22:36:17.894291] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-14T22:36:17.912240] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-14T22:36:17.912538] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-14T22:36:17.914529] [INFO ] [MAIN ] Derivative Progress: 529/1812 symbols completed. DPG took 1.1s. Estimated remaining: 8m 8s. Rate: 157.8 symbols/min [2025-10-14T22:36:17.916685] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:17.935811] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:17.936721] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-14T22:36:17.936967] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-14T22:36:17.980881] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-14T22:36:17.981511] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-14T22:36:17.981368] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:17.983517] [INFO ] [MAIN ] Derivative Progress: 530/1812 symbols completed. DOW took 1.1s. Estimated remaining: 8m 7s. Rate: 158.0 symbols/min [2025-10-14T22:36:17.984884] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:17.984678] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43704 primary records. [2025-10-14T22:36:17.996373] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-14T22:36:18.015804] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-14T22:36:18.016917] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-14T22:36:18.032391] [INFO ] [MAIN ] Derivative Progress: 531/1812 symbols completed. DQ took 1.2s. Estimated remaining: 8m 6s. Rate: 158.3 symbols/min [2025-10-14T22:36:18.034176] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:18.035877] [DEBUG] [LOCAL ] DRD: Loaded 37699 existing records from primary storage. [2025-10-14T22:36:18.036310] [INFO ] [MAIN ] DRD: Loaded 37699 primary data records. [2025-10-14T22:36:18.164870] [DEBUG] [LOCAL ] DRLL: Loaded 9185 existing records from primary storage. [2025-10-14T22:36:18.170787] [INFO ] [MAIN ] DRLL: Loaded 9185 primary data records. [2025-10-14T22:36:18.418007] [DEBUG] [LOCAL ] DRH: Loaded 50409 existing records from primary storage. [2025-10-14T22:36:18.477440] [INFO ] [MAIN ] DRH: Loaded 50409 primary data records. [2025-10-14T22:36:19.032586] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:19.034086] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37699 primary records. [2025-10-14T22:36:19.034361] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-14T22:36:19.077766] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:36:19.079248] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-14T22:36:19.080412] [INFO ] [MAIN ] DRLL: Generated 1793 derivative records from 9185 primary records. [2025-10-14T22:36:19.079420] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-14T22:36:19.080574] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-14T22:36:19.082511] [INFO ] [MAIN ] Derivative Progress: 532/1812 symbols completed. DRD took 1.2s. Estimated remaining: 8m 7s. Rate: 157.7 symbols/min [2025-10-14T22:36:19.084070] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:19.103837] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1793 records). [2025-10-14T22:36:19.116537] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-14T22:36:19.119561] [INFO ] [MAIN ] Derivative Progress: 533/1812 symbols completed. DRLL took 1.1s. Estimated remaining: 8m 6s. Rate: 158.0 symbols/min [2025-10-14T22:36:19.117046] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:19.120519] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50409 primary records. [2025-10-14T22:36:19.120762] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:19.121411] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-14T22:36:19.138011] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-14T22:36:19.138351] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-14T22:36:19.140246] [INFO ] [MAIN ] Derivative Progress: 534/1812 symbols completed. DRH took 1.2s. Estimated remaining: 8m 4s. Rate: 158.3 symbols/min [2025-10-14T22:36:19.148418] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:19.160813] [DEBUG] [LOCAL ] DSM: Loaded 14198 existing records from primary storage. [2025-10-14T22:36:19.160968] [INFO ] [MAIN ] DSM: Loaded 14198 primary data records. [2025-10-14T22:36:19.296042] [DEBUG] [LOCAL ] DSL: Loaded 28774 existing records from primary storage. [2025-10-14T22:36:19.321081] [INFO ] [MAIN ] DSL: Loaded 28774 primary data records. [2025-10-14T22:36:19.650300] [DEBUG] [LOCAL ] DTE: Loaded 47472 existing records from primary storage. [2025-10-14T22:36:19.661985] [INFO ] [MAIN ] DTE: Loaded 47472 primary data records. [2025-10-14T22:36:20.346841] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:20.348532] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14198 primary records. [2025-10-14T22:36:20.349548] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-14T22:36:20.385230] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:20.384929] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-14T22:36:20.385805] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-14T22:36:20.388932] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28774 primary records. [2025-10-14T22:36:20.388059] [INFO ] [MAIN ] Derivative Progress: 535/1812 symbols completed. DSM took 1.3s. Estimated remaining: 8m 6s. Rate: 157.6 symbols/min [2025-10-14T22:36:20.389230] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:20.389371] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-14T22:36:20.409918] [DEBUG] [LOCAL ] DTG: Loaded 5793 existing records from primary storage. [2025-10-14T22:36:20.411135] [INFO ] [MAIN ] DTG: Loaded 5793 primary data records. [2025-10-14T22:36:20.435088] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-14T22:36:20.450381] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-14T22:36:20.461155] [INFO ] [MAIN ] Derivative Progress: 536/1812 symbols completed. DSL took 1.4s. Estimated remaining: 8m 5s. Rate: 157.9 symbols/min [2025-10-14T22:36:20.466741] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:20.535461] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:20.547102] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47472 primary records. [2025-10-14T22:36:20.565016] [DEBUG] [LOCAL ] DTW: Loaded 4895 existing records from primary storage. [2025-10-14T22:36:20.577711] [INFO ] [MAIN ] DTW: Loaded 4895 primary data records. [2025-10-14T22:36:20.577798] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-14T22:36:20.853216] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-14T22:36:20.859047] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-14T22:36:20.871673] [INFO ] [MAIN ] Derivative Progress: 537/1812 symbols completed. DTE took 1.7s. Estimated remaining: 8m 5s. Rate: 157.8 symbols/min [2025-10-14T22:36:20.877375] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:21.058827] [DEBUG] [LOCAL ] DUKB: Loaded 6297 existing records from primary storage. [2025-10-14T22:36:21.060979] [INFO ] [MAIN ] DUKB: Loaded 6297 primary data records. [2025-10-14T22:36:21.264592] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:21.381330] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5793 primary records. [2025-10-14T22:36:21.382197] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-14T22:36:21.415094] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-14T22:36:21.415561] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-14T22:36:21.414671] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:21.417717] [INFO ] [MAIN ] Derivative Progress: 538/1812 symbols completed. DTG took 1.0s. Estimated remaining: 8m 5s. Rate: 157.7 symbols/min [2025-10-14T22:36:21.418698] [INFO ] [MAIN ] DTW: Generated 1794 derivative records from 4895 primary records. [2025-10-14T22:36:21.418792] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-14T22:36:21.434821] [DEBUG] [LOCAL ] DTW: Derivative data saved (1794 records). [2025-10-14T22:36:21.434908] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-14T22:36:21.437199] [INFO ] [MAIN ] Derivative Progress: 539/1812 symbols completed. DTW took 1.0s. Estimated remaining: 8m 3s. Rate: 158.0 symbols/min [2025-10-14T22:36:21.453110] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:21.453634] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6297 primary records. [2025-10-14T22:36:21.453718] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-14T22:36:21.468170] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-10-14T22:36:21.468229] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-14T22:36:21.470246] [INFO ] [MAIN ] Derivative Progress: 540/1812 symbols completed. DUKB took 0.6s. Estimated remaining: 8m 2s. Rate: 158.3 symbols/min [2025-10-14T22:36:21.470602] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:21.470769] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:21.470711] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:21.551818] [DEBUG] [LOCAL ] DX: Loaded 52505 existing records from primary storage. [2025-10-14T22:36:21.551921] [INFO ] [MAIN ] DX: Loaded 52505 primary data records. [2025-10-14T22:36:21.549558] [DEBUG] [LOCAL ] DVA: Loaded 40980 existing records from primary storage. [2025-10-14T22:36:21.589719] [INFO ] [MAIN ] DVA: Loaded 40980 primary data records. [2025-10-14T22:36:21.727893] [DEBUG] [LOCAL ] DV: Loaded 51304 existing records from primary storage. [2025-10-14T22:36:21.752692] [INFO ] [MAIN ] DV: Loaded 51304 primary data records. [2025-10-14T22:36:22.521969] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:22.522729] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52505 primary records. [2025-10-14T22:36:22.522986] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-14T22:36:22.553599] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:22.556768] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 40980 primary records. [2025-10-14T22:36:22.555376] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-10-14T22:36:22.556974] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-14T22:36:22.557136] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-14T22:36:22.558838] [INFO ] [MAIN ] Derivative Progress: 541/1812 symbols completed. DX took 1.1s. Estimated remaining: 8m 4s. Rate: 157.7 symbols/min [2025-10-14T22:36:22.567060] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:22.584008] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:22.585520] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51304 primary records. [2025-10-14T22:36:22.585624] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-14T22:36:22.602759] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-14T22:36:22.603297] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-14T22:36:22.605899] [INFO ] [MAIN ] Derivative Progress: 542/1812 symbols completed. DVA took 1.1s. Estimated remaining: 8m 2s. Rate: 158.0 symbols/min [2025-10-14T22:36:22.606288] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:22.610151] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-14T22:36:22.610283] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-14T22:36:22.612924] [INFO ] [MAIN ] Derivative Progress: 543/1812 symbols completed. DV took 1.1s. Estimated remaining: 8m 1s. Rate: 158.2 symbols/min [2025-10-14T22:36:22.613253] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:22.644607] [DEBUG] [LOCAL ] DXYZ: Loaded 37165 existing records from primary storage. [2025-10-14T22:36:22.644805] [INFO ] [MAIN ] DXYZ: Loaded 37165 primary data records. [2025-10-14T22:36:22.763854] [DEBUG] [LOCAL ] DY: Loaded 28437 existing records from primary storage. [2025-10-14T22:36:22.783481] [INFO ] [MAIN ] DY: Loaded 28437 primary data records. [2025-10-14T22:36:22.897520] [DEBUG] [LOCAL ] E: Loaded 33236 existing records from primary storage. [2025-10-14T22:36:22.933562] [INFO ] [MAIN ] E: Loaded 33236 primary data records. [2025-10-14T22:36:23.578661] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:23.580320] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 37165 primary records. [2025-10-14T22:36:23.592606] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-14T22:36:23.593861] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:23.594797] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28437 primary records. [2025-10-14T22:36:23.601900] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-14T22:36:23.624285] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-10-14T22:36:23.624603] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-14T22:36:23.626806] [INFO ] [MAIN ] Derivative Progress: 544/1812 symbols completed. DXYZ took 1.1s. Estimated remaining: 8m 2s. Rate: 157.8 symbols/min [2025-10-14T22:36:23.627130] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:23.628493] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-14T22:36:23.628736] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-14T22:36:23.630944] [INFO ] [MAIN ] Derivative Progress: 545/1812 symbols completed. DY took 1.0s. Estimated remaining: 8m 1s. Rate: 158.0 symbols/min [2025-10-14T22:36:23.631158] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:23.650410] [DEBUG] [LOCAL ] EAI: Loaded 3991 existing records from primary storage. [2025-10-14T22:36:23.650737] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:23.650874] [INFO ] [MAIN ] EAI: Loaded 3991 primary data records. [2025-10-14T22:36:23.651471] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33236 primary records. [2025-10-14T22:36:23.662634] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-14T22:36:23.869103] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-14T22:36:23.971370] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-14T22:36:23.982307] [DEBUG] [LOCAL ] EAF: Loaded 41759 existing records from primary storage. [2025-10-14T22:36:23.984915] [INFO ] [MAIN ] Derivative Progress: 546/1812 symbols completed. E took 1.4s. Estimated remaining: 8m 1s. Rate: 158.1 symbols/min [2025-10-14T22:36:23.985944] [INFO ] [MAIN ] EAF: Loaded 41759 primary data records. [2025-10-14T22:36:23.986221] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:24.214829] [DEBUG] [LOCAL ] EARN: Loaded 28749 existing records from primary storage. [2025-10-14T22:36:24.335412] [INFO ] [MAIN ] EARN: Loaded 28749 primary data records. [2025-10-14T22:36:24.544256] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:24.600320] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3991 primary records. [2025-10-14T22:36:24.601526] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-14T22:36:24.796460] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-10-14T22:36:24.799087] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-14T22:36:24.813929] [INFO ] [MAIN ] Derivative Progress: 547/1812 symbols completed. EAI took 1.2s. Estimated remaining: 8m 1s. Rate: 157.7 symbols/min [2025-10-14T22:36:24.814718] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:24.814915] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:24.816356] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 41759 primary records. [2025-10-14T22:36:24.816610] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-14T22:36:24.836748] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-10-14T22:36:24.838467] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-14T22:36:24.840943] [INFO ] [MAIN ] Derivative Progress: 548/1812 symbols completed. EAF took 1.2s. Estimated remaining: 8m 0s. Rate: 158.0 symbols/min [2025-10-14T22:36:24.841191] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:24.854740] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:24.855477] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 28749 primary records. [2025-10-14T22:36:24.855538] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-14T22:36:24.882395] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-10-14T22:36:24.882457] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-14T22:36:24.884431] [INFO ] [MAIN ] Derivative Progress: 549/1812 symbols completed. EARN took 0.9s. Estimated remaining: 7m 59s. Rate: 158.3 symbols/min [2025-10-14T22:36:24.884638] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:24.933860] [DEBUG] [LOCAL ] EB: Loaded 36591 existing records from primary storage. [2025-10-14T22:36:24.935825] [DEBUG] [LOCAL ] EAT: Loaded 49892 existing records from primary storage. [2025-10-14T22:36:24.936013] [INFO ] [MAIN ] EAT: Loaded 49892 primary data records. [2025-10-14T22:36:24.935958] [INFO ] [MAIN ] EB: Loaded 36591 primary data records. [2025-10-14T22:36:24.936547] [DEBUG] [LOCAL ] EBF: Loaded 18912 existing records from primary storage. [2025-10-14T22:36:24.948153] [INFO ] [MAIN ] EBF: Loaded 18912 primary data records. [2025-10-14T22:36:25.860429] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:25.873122] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49892 primary records. [2025-10-14T22:36:25.880993] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:25.880690] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-14T22:36:25.886019] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 18912 primary records. [2025-10-14T22:36:25.886763] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-14T22:36:25.887179] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:25.888403] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 36591 primary records. [2025-10-14T22:36:25.888857] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-14T22:36:25.924338] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-14T22:36:25.928682] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-14T22:36:25.931764] [INFO ] [MAIN ] Derivative Progress: 550/1812 symbols completed. EAT took 1.1s. Estimated remaining: 8m 0s. Rate: 157.7 symbols/min [2025-10-14T22:36:25.932187] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:25.939090] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-10-14T22:36:25.939667] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-14T22:36:25.941596] [INFO ] [MAIN ] Derivative Progress: 551/1812 symbols completed. EB took 1.1s. Estimated remaining: 7m 59s. Rate: 158.0 symbols/min [2025-10-14T22:36:25.941800] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:25.942990] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-14T22:36:25.943153] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-14T22:36:25.945495] [INFO ] [MAIN ] Derivative Progress: 552/1812 symbols completed. EBF took 1.1s. Estimated remaining: 7m 58s. Rate: 158.3 symbols/min [2025-10-14T22:36:25.945819] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:26.014476] [DEBUG] [LOCAL ] EBR: Loaded 43246 existing records from primary storage. [2025-10-14T22:36:26.015226] [INFO ] [MAIN ] EBR: Loaded 43246 primary data records. [2025-10-14T22:36:26.098139] [DEBUG] [LOCAL ] EC: Loaded 49029 existing records from primary storage. [2025-10-14T22:36:26.078563] [DEBUG] [LOCAL ] EBS: Loaded 46752 existing records from primary storage. [2025-10-14T22:36:26.107066] [INFO ] [MAIN ] EC: Loaded 49029 primary data records. [2025-10-14T22:36:26.126234] [INFO ] [MAIN ] EBS: Loaded 46752 primary data records. [2025-10-14T22:36:27.048068] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:27.035170] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:27.049523] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49029 primary records. [2025-10-14T22:36:27.049826] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-14T22:36:27.050904] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43246 primary records. [2025-10-14T22:36:27.050092] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:27.051070] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-14T22:36:27.053091] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46752 primary records. [2025-10-14T22:36:27.053182] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-14T22:36:27.096097] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-10-14T22:36:27.096220] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-14T22:36:27.099317] [INFO ] [MAIN ] Derivative Progress: 553/1812 symbols completed. EBS took 1.2s. Estimated remaining: 7m 59s. Rate: 157.7 symbols/min [2025-10-14T22:36:27.100855] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-14T22:36:27.101184] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-14T22:36:27.103075] [INFO ] [MAIN ] Derivative Progress: 554/1812 symbols completed. EBR took 1.2s. Estimated remaining: 7m 58s. Rate: 158.0 symbols/min [2025-10-14T22:36:27.104097] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-10-14T22:36:27.104158] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-14T22:36:27.106274] [INFO ] [MAIN ] Derivative Progress: 555/1812 symbols completed. EC took 1.2s. Estimated remaining: 7m 56s. Rate: 158.3 symbols/min [2025-10-14T22:36:27.106729] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:27.106677] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:27.107065] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:27.112199] [DEBUG] [LOCAL ] ECCU: Loaded 2215 existing records from primary storage. [2025-10-14T22:36:27.112403] [INFO ] [MAIN ] ECCU: Loaded 2215 primary data records. [2025-10-14T22:36:27.437390] [DEBUG] [LOCAL ] ECAT: Loaded 29496 existing records from primary storage. [2025-10-14T22:36:27.445828] [INFO ] [MAIN ] ECAT: Loaded 29496 primary data records. [2025-10-14T22:36:27.446455] [DEBUG] [LOCAL ] ECC: Loaded 43220 existing records from primary storage. [2025-10-14T22:36:27.446570] [INFO ] [MAIN ] ECC: Loaded 43220 primary data records. [2025-10-14T22:36:28.098169] [DEBUG] [MAIN ] ECCU: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-14T22:36:28.099280] [INFO ] [MAIN ] ECCU: Generated 1790 derivative records from 2215 primary records. [2025-10-14T22:36:28.099763] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-14T22:36:28.118508] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1790 records). [2025-10-14T22:36:28.118623] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-14T22:36:28.120687] [INFO ] [MAIN ] Derivative Progress: 556/1812 symbols completed. ECCU took 1.0s. Estimated remaining: 7m 58s. Rate: 157.8 symbols/min [2025-10-14T22:36:28.121035] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:28.140118] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:28.142137] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43220 primary records. [2025-10-14T22:36:28.142999] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-14T22:36:28.171606] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:28.182228] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29496 primary records. [2025-10-14T22:36:28.182897] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-14T22:36:28.183579] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-14T22:36:28.184288] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-14T22:36:28.186813] [INFO ] [MAIN ] Derivative Progress: 557/1812 symbols completed. ECC took 1.1s. Estimated remaining: 7m 56s. Rate: 158.0 symbols/min [2025-10-14T22:36:28.205320] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:28.212431] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-14T22:36:28.213320] [DEBUG] [LOCAL ] ECG: Loaded 33259 existing records from primary storage. [2025-10-14T22:36:28.212674] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-14T22:36:28.215492] [INFO ] [MAIN ] Derivative Progress: 558/1812 symbols completed. ECAT took 1.1s. Estimated remaining: 7m 55s. Rate: 158.3 symbols/min [2025-10-14T22:36:28.215631] [INFO ] [MAIN ] ECG: Loaded 33259 primary data records. [2025-10-14T22:36:28.215878] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:28.537788] [DEBUG] [LOCAL ] ECO: Loaded 18316 existing records from primary storage. [2025-10-14T22:36:28.547234] [INFO ] [MAIN ] ECO: Loaded 18316 primary data records. [2025-10-14T22:36:28.762698] [DEBUG] [LOCAL ] ECL: Loaded 46660 existing records from primary storage. [2025-10-14T22:36:28.887175] [INFO ] [MAIN ] ECL: Loaded 46660 primary data records. [2025-10-14T22:36:29.216564] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:29.218300] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33259 primary records. [2025-10-14T22:36:29.218845] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-14T22:36:29.241284] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-14T22:36:29.241683] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-14T22:36:29.243596] [INFO ] [MAIN ] Derivative Progress: 559/1812 symbols completed. ECG took 1.1s. Estimated remaining: 7m 56s. Rate: 157.8 symbols/min [2025-10-14T22:36:29.244033] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:29.257706] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:29.259254] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18316 primary records. [2025-10-14T22:36:29.259559] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-14T22:36:29.278245] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-14T22:36:29.279164] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-14T22:36:29.281400] [INFO ] [MAIN ] Derivative Progress: 560/1812 symbols completed. ECO took 1.1s. Estimated remaining: 7m 55s. Rate: 158.1 symbols/min [2025-10-14T22:36:29.281691] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:29.295614] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:29.296226] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46660 primary records. [2025-10-14T22:36:29.296327] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-14T22:36:29.313922] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-14T22:36:29.314101] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-14T22:36:29.326072] [INFO ] [MAIN ] Derivative Progress: 561/1812 symbols completed. ECL took 1.1s. Estimated remaining: 7m 54s. Rate: 158.3 symbols/min [2025-10-14T22:36:29.326314] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:29.345197] [DEBUG] [LOCAL ] ECVT: Loaded 43323 existing records from primary storage. [2025-10-14T22:36:29.345357] [INFO ] [MAIN ] ECVT: Loaded 43323 primary data records. [2025-10-14T22:36:29.482482] [DEBUG] [LOCAL ] EDD: Loaded 26812 existing records from primary storage. [2025-10-14T22:36:29.483911] [INFO ] [MAIN ] EDD: Loaded 26812 primary data records. [2025-10-14T22:36:29.569002] [DEBUG] [LOCAL ] ED: Loaded 52685 existing records from primary storage. [2025-10-14T22:36:29.579255] [INFO ] [MAIN ] ED: Loaded 52685 primary data records. [2025-10-14T22:36:30.388391] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:30.390042] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43323 primary records. [2025-10-14T22:36:30.390259] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-14T22:36:30.413148] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-14T22:36:30.414253] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-14T22:36:30.417020] [INFO ] [MAIN ] Derivative Progress: 562/1812 symbols completed. ECVT took 1.2s. Estimated remaining: 7m 55s. Rate: 157.8 symbols/min [2025-10-14T22:36:30.417517] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:30.432089] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:30.435267] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 26812 primary records. [2025-10-14T22:36:30.435429] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-14T22:36:30.465195] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:30.466875] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52685 primary records. [2025-10-14T22:36:30.467836] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-14T22:36:30.475970] [DEBUG] [LOCAL ] EDF: Loaded 13096 existing records from primary storage. [2025-10-14T22:36:30.476568] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-14T22:36:30.484300] [INFO ] [MAIN ] EDF: Loaded 13096 primary data records. [2025-10-14T22:36:30.477066] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-14T22:36:30.487692] [INFO ] [MAIN ] Derivative Progress: 563/1812 symbols completed. EDD took 1.2s. Estimated remaining: 7m 54s. Rate: 158.0 symbols/min [2025-10-14T22:36:30.502330] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:30.541234] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-14T22:36:30.546624] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-14T22:36:30.566140] [INFO ] [MAIN ] Derivative Progress: 564/1812 symbols completed. ED took 1.3s. Estimated remaining: 7m 53s. Rate: 158.3 symbols/min [2025-10-14T22:36:30.578518] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:30.707006] [DEBUG] [LOCAL ] EDN: Loaded 18885 existing records from primary storage. [2025-10-14T22:36:30.707289] [INFO ] [MAIN ] EDN: Loaded 18885 primary data records. [2025-10-14T22:36:31.020686] [DEBUG] [LOCAL ] EDU: Loaded 44755 existing records from primary storage. [2025-10-14T22:36:31.043620] [INFO ] [MAIN ] EDU: Loaded 44755 primary data records. [2025-10-14T22:36:31.481540] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:31.483228] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13096 primary records. [2025-10-14T22:36:31.483583] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-14T22:36:31.507771] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-14T22:36:31.520377] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-14T22:36:31.521104] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:31.521954] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18885 primary records. [2025-10-14T22:36:31.524177] [INFO ] [MAIN ] Derivative Progress: 565/1812 symbols completed. EDF took 1.1s. Estimated remaining: 7m 54s. Rate: 157.8 symbols/min [2025-10-14T22:36:31.522063] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-14T22:36:31.524513] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:31.557903] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-14T22:36:31.558805] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-14T22:36:31.560874] [INFO ] [MAIN ] Derivative Progress: 566/1812 symbols completed. EDN took 1.1s. Estimated remaining: 7m 53s. Rate: 158.1 symbols/min [2025-10-14T22:36:31.558606] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:31.561087] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:31.570468] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44755 primary records. [2025-10-14T22:36:31.571169] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-14T22:36:31.599719] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-14T22:36:31.599930] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-14T22:36:31.602141] [INFO ] [MAIN ] Derivative Progress: 567/1812 symbols completed. EDU took 1.0s. Estimated remaining: 7m 52s. Rate: 158.3 symbols/min [2025-10-14T22:36:31.602356] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:31.603575] [DEBUG] [LOCAL ] EE: Loaded 32960 existing records from primary storage. [2025-10-14T22:36:31.604046] [INFO ] [MAIN ] EE: Loaded 32960 primary data records. [2025-10-14T22:36:31.630597] [DEBUG] [LOCAL ] EEX: Loaded 10260 existing records from primary storage. [2025-10-14T22:36:31.659089] [INFO ] [MAIN ] EEX: Loaded 10260 primary data records. [2025-10-14T22:36:31.778633] [DEBUG] [LOCAL ] EFR: Loaded 15055 existing records from primary storage. [2025-10-14T22:36:31.815760] [INFO ] [MAIN ] EFR: Loaded 15055 primary data records. [2025-10-14T22:36:32.621759] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:32.622239] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:32.623327] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 10260 primary records. [2025-10-14T22:36:32.624222] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32960 primary records. [2025-10-14T22:36:32.624332] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-14T22:36:32.637179] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-14T22:36:32.639557] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:32.657156] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 15055 primary records. [2025-10-14T22:36:32.659895] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-14T22:36:32.663704] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-14T22:36:32.667166] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-14T22:36:32.677129] [INFO ] [MAIN ] Derivative Progress: 568/1812 symbols completed. EEX took 1.1s. Estimated remaining: 7m 53s. Rate: 157.8 symbols/min [2025-10-14T22:36:32.686605] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-14T22:36:32.687272] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-14T22:36:32.689703] [INFO ] [MAIN ] Derivative Progress: 569/1812 symbols completed. EE took 1.2s. Estimated remaining: 7m 52s. Rate: 158.1 symbols/min [2025-10-14T22:36:32.691324] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-14T22:36:32.691388] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-14T22:36:32.693320] [INFO ] [MAIN ] Derivative Progress: 570/1812 symbols completed. EFR took 1.1s. Estimated remaining: 7m 51s. Rate: 158.4 symbols/min [2025-10-14T22:36:32.693728] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:32.693890] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:32.693781] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:32.708773] [DEBUG] [LOCAL ] EFT: Loaded 13142 existing records from primary storage. [2025-10-14T22:36:32.709319] [INFO ] [MAIN ] EFT: Loaded 13142 primary data records. [2025-10-14T22:36:32.842369] [DEBUG] [LOCAL ] EFXT: Loaded 29628 existing records from primary storage. [2025-10-14T22:36:32.848420] [INFO ] [MAIN ] EFXT: Loaded 29628 primary data records. [2025-10-14T22:36:33.131057] [DEBUG] [LOCAL ] EFX: Loaded 44621 existing records from primary storage. [2025-10-14T22:36:33.143907] [INFO ] [MAIN ] EFX: Loaded 44621 primary data records. [2025-10-14T22:36:33.756435] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:33.758073] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 13142 primary records. [2025-10-14T22:36:33.760504] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-14T22:36:33.809467] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:33.811218] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29628 primary records. [2025-10-14T22:36:33.812311] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-14T22:36:33.815328] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-14T22:36:33.815918] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-14T22:36:33.819010] [INFO ] [MAIN ] Derivative Progress: 571/1812 symbols completed. EFT took 1.1s. Estimated remaining: 7m 52s. Rate: 157.8 symbols/min [2025-10-14T22:36:33.830984] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:33.836863] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-14T22:36:33.837210] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-14T22:36:33.841038] [INFO ] [MAIN ] Derivative Progress: 572/1812 symbols completed. EFXT took 1.1s. Estimated remaining: 7m 51s. Rate: 158.1 symbols/min [2025-10-14T22:36:33.843848] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:33.865468] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:33.866330] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44621 primary records. [2025-10-14T22:36:33.866464] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-14T22:36:33.890225] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-14T22:36:33.890670] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-14T22:36:33.893441] [INFO ] [MAIN ] Derivative Progress: 573/1812 symbols completed. EFX took 1.2s. Estimated remaining: 7m 50s. Rate: 158.3 symbols/min [2025-10-14T22:36:33.903354] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:33.923052] [DEBUG] [LOCAL ] EG: Loaded 27796 existing records from primary storage. [2025-10-14T22:36:33.923497] [INFO ] [MAIN ] EG: Loaded 27796 primary data records. [2025-10-14T22:36:34.148894] [DEBUG] [LOCAL ] EGO: Loaded 51710 existing records from primary storage. [2025-10-14T22:36:34.155526] [DEBUG] [LOCAL ] EGP: Loaded 30391 existing records from primary storage. [2025-10-14T22:36:34.216137] [INFO ] [MAIN ] EGP: Loaded 30391 primary data records. [2025-10-14T22:36:34.216020] [INFO ] [MAIN ] EGO: Loaded 51710 primary data records. [2025-10-14T22:36:35.145058] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:35.146267] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27796 primary records. [2025-10-14T22:36:35.146394] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-14T22:36:35.164416] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-14T22:36:35.164835] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-14T22:36:35.168222] [INFO ] [MAIN ] Derivative Progress: 574/1812 symbols completed. EG took 1.3s. Estimated remaining: 7m 51s. Rate: 157.7 symbols/min [2025-10-14T22:36:35.168697] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:35.185598] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:35.186612] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51710 primary records. [2025-10-14T22:36:35.186767] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-14T22:36:35.207594] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:35.209484] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30391 primary records. [2025-10-14T22:36:35.216209] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-14T22:36:35.216300] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-14T22:36:35.218533] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-14T22:36:35.218469] [INFO ] [MAIN ] Derivative Progress: 575/1812 symbols completed. EGO took 1.4s. Estimated remaining: 7m 50s. Rate: 157.9 symbols/min [2025-10-14T22:36:35.218736] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:35.238817] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-14T22:36:35.239167] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-14T22:36:35.241442] [INFO ] [MAIN ] Derivative Progress: 576/1812 symbols completed. EGP took 1.3s. Estimated remaining: 7m 49s. Rate: 158.2 symbols/min [2025-10-14T22:36:35.241685] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:35.272603] [DEBUG] [LOCAL ] EHAB: Loaded 29326 existing records from primary storage. [2025-10-14T22:36:35.285632] [INFO ] [MAIN ] EHAB: Loaded 29326 primary data records. [2025-10-14T22:36:35.286240] [DEBUG] [LOCAL ] EGY: Loaded 41537 existing records from primary storage. [2025-10-14T22:36:35.286422] [INFO ] [MAIN ] EGY: Loaded 41537 primary data records. [2025-10-14T22:36:35.660499] [DEBUG] [LOCAL ] EHC: Loaded 40988 existing records from primary storage. [2025-10-14T22:36:35.880383] [INFO ] [MAIN ] EHC: Loaded 40988 primary data records. [2025-10-14T22:36:36.216510] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:36.218877] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41537 primary records. [2025-10-14T22:36:36.219133] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-14T22:36:36.242118] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:36.248940] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-14T22:36:36.249890] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29326 primary records. [2025-10-14T22:36:36.249160] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-14T22:36:36.252010] [INFO ] [MAIN ] Derivative Progress: 577/1812 symbols completed. EGY took 1.1s. Estimated remaining: 7m 50s. Rate: 157.7 symbols/min [2025-10-14T22:36:36.252287] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-14T22:36:36.252437] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:36.272499] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-14T22:36:36.272847] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-14T22:36:36.275212] [INFO ] [MAIN ] Derivative Progress: 578/1812 symbols completed. EHAB took 1.1s. Estimated remaining: 7m 49s. Rate: 158.0 symbols/min [2025-10-14T22:36:36.275601] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:36.282722] [DEBUG] [LOCAL ] EHI: Loaded 10642 existing records from primary storage. [2025-10-14T22:36:36.283578] [INFO ] [MAIN ] EHI: Loaded 10642 primary data records. [2025-10-14T22:36:36.373779] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:36.403961] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 40988 primary records. [2025-10-14T22:36:36.407903] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-14T22:36:36.507415] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-14T22:36:36.508256] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-14T22:36:36.578575] [INFO ] [MAIN ] Derivative Progress: 579/1812 symbols completed. EHC took 1.3s. Estimated remaining: 7m 48s. Rate: 158.0 symbols/min [2025-10-14T22:36:36.620732] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:36.508176] [DEBUG] [LOCAL ] EIC: Loaded 22893 existing records from primary storage. [2025-10-14T22:36:36.658155] [INFO ] [MAIN ] EIC: Loaded 22893 primary data records. [2025-10-14T22:36:36.761457] [DEBUG] [LOCAL ] EIG: Loaded 20149 existing records from primary storage. [2025-10-14T22:36:36.772356] [INFO ] [MAIN ] EIG: Loaded 20149 primary data records. [2025-10-14T22:36:37.290973] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:37.292755] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10642 primary records. [2025-10-14T22:36:37.293047] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-14T22:36:37.311869] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-14T22:36:37.312621] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-14T22:36:37.314705] [INFO ] [MAIN ] Derivative Progress: 580/1812 symbols completed. EHI took 1.1s. Estimated remaining: 7m 49s. Rate: 157.8 symbols/min [2025-10-14T22:36:37.314999] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:37.333981] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:37.334845] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 22893 primary records. [2025-10-14T22:36:37.334917] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-14T22:36:37.352788] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-14T22:36:37.354083] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-14T22:36:37.357253] [INFO ] [MAIN ] Derivative Progress: 581/1812 symbols completed. EIC took 1.1s. Estimated remaining: 7m 47s. Rate: 158.0 symbols/min [2025-10-14T22:36:37.357499] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:37.371074] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:37.371766] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20149 primary records. [2025-10-14T22:36:37.371950] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-14T22:36:37.403860] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-14T22:36:37.404059] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-14T22:36:37.406371] [INFO ] [MAIN ] Derivative Progress: 582/1812 symbols completed. EIG took 0.8s. Estimated remaining: 7m 46s. Rate: 158.2 symbols/min [2025-10-14T22:36:37.407739] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:37.423808] [DEBUG] [LOCAL ] EIX: Loaded 53370 existing records from primary storage. [2025-10-14T22:36:37.424203] [INFO ] [MAIN ] EIX: Loaded 53370 primary data records. [2025-10-14T22:36:37.545019] [DEBUG] [LOCAL ] ELC: Loaded 3486 existing records from primary storage. [2025-10-14T22:36:37.554413] [INFO ] [MAIN ] ELC: Loaded 3486 primary data records. [2025-10-14T22:36:37.638613] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-14T22:36:37.720221] [INFO ] [MAIN ] EL: Loaded 53376 primary data records. [2025-10-14T22:36:38.464466] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:38.466484] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53370 primary records. [2025-10-14T22:36:38.467596] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-14T22:36:38.496477] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-14T22:36:38.495461] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:38.496589] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-14T22:36:38.499468] [INFO ] [MAIN ] Derivative Progress: 583/1812 symbols completed. EIX took 1.2s. Estimated remaining: 7m 47s. Rate: 157.7 symbols/min [2025-10-14T22:36:38.500235] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3486 primary records. [2025-10-14T22:36:38.500469] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-14T22:36:38.524776] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:38.526064] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53376 primary records. [2025-10-14T22:36:38.527014] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-14T22:36:38.541219] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-14T22:36:38.541508] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-14T22:36:38.543989] [INFO ] [MAIN ] Derivative Progress: 584/1812 symbols completed. ELC took 1.1s. Estimated remaining: 7m 46s. Rate: 158.0 symbols/min [2025-10-14T22:36:38.547784] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-14T22:36:38.547844] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-14T22:36:38.550046] [INFO ] [MAIN ] Derivative Progress: 585/1812 symbols completed. EL took 1.2s. Estimated remaining: 7m 45s. Rate: 158.2 symbols/min [2025-10-14T22:36:38.550449] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:38.550507] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:38.550394] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:38.577931] [DEBUG] [LOCAL ] ELP: Loaded 25653 existing records from primary storage. [2025-10-14T22:36:38.578097] [INFO ] [MAIN ] ELP: Loaded 25653 primary data records. [2025-10-14T22:36:38.915144] [DEBUG] [LOCAL ] ELME: Loaded 39385 existing records from primary storage. [2025-10-14T22:36:38.916056] [INFO ] [MAIN ] ELME: Loaded 39385 primary data records. [2025-10-14T22:36:38.915958] [DEBUG] [LOCAL ] ELF: Loaded 52038 existing records from primary storage. [2025-10-14T22:36:38.916399] [INFO ] [MAIN ] ELF: Loaded 52038 primary data records. [2025-10-14T22:36:39.550611] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:39.551545] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25653 primary records. [2025-10-14T22:36:39.551799] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-14T22:36:39.570405] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-14T22:36:39.572545] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-14T22:36:39.575198] [INFO ] [MAIN ] Derivative Progress: 586/1812 symbols completed. ELP took 1.0s. Estimated remaining: 7m 46s. Rate: 157.8 symbols/min [2025-10-14T22:36:39.575361] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:39.593403] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:39.594762] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39385 primary records. [2025-10-14T22:36:39.594957] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-14T22:36:39.630379] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-14T22:36:39.630637] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-14T22:36:39.633105] [INFO ] [MAIN ] Derivative Progress: 587/1812 symbols completed. ELME took 1.1s. Estimated remaining: 7m 45s. Rate: 158.0 symbols/min [2025-10-14T22:36:39.633368] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:39.631126] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:39.634743] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52038 primary records. [2025-10-14T22:36:39.634827] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-14T22:36:39.651446] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-14T22:36:39.651564] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-14T22:36:39.653769] [INFO ] [MAIN ] Derivative Progress: 588/1812 symbols completed. ELF took 1.1s. Estimated remaining: 7m 44s. Rate: 158.3 symbols/min [2025-10-14T22:36:39.664289] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:39.698506] [DEBUG] [LOCAL ] ELS: Loaded 49892 existing records from primary storage. [2025-10-14T22:36:39.702762] [INFO ] [MAIN ] ELS: Loaded 49892 primary data records. [2025-10-14T22:36:39.832034] [DEBUG] [LOCAL ] EMD: Loaded 20965 existing records from primary storage. [2025-10-14T22:36:39.836329] [DEBUG] [LOCAL ] ELV: Loaded 50685 existing records from primary storage. [2025-10-14T22:36:39.836767] [INFO ] [MAIN ] ELV: Loaded 50685 primary data records. [2025-10-14T22:36:39.842082] [INFO ] [MAIN ] EMD: Loaded 20965 primary data records. [2025-10-14T22:36:40.675791] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:40.676506] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49892 primary records. [2025-10-14T22:36:40.676781] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-14T22:36:40.721903] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:40.721418] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:40.722221] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-10-14T22:36:40.723473] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 20965 primary records. [2025-10-14T22:36:40.722906] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50685 primary records. [2025-10-14T22:36:40.723591] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-14T22:36:40.723962] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-14T22:36:40.724335] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-14T22:36:40.733844] [INFO ] [MAIN ] Derivative Progress: 589/1812 symbols completed. ELS took 1.2s. Estimated remaining: 7m 45s. Rate: 157.8 symbols/min [2025-10-14T22:36:40.737684] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:40.754466] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-10-14T22:36:40.755128] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-14T22:36:40.757497] [INFO ] [MAIN ] Derivative Progress: 590/1812 symbols completed. EMD took 1.1s. Estimated remaining: 7m 44s. Rate: 158.0 symbols/min [2025-10-14T22:36:40.759086] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:40.761103] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-14T22:36:40.761250] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-14T22:36:40.763761] [INFO ] [MAIN ] Derivative Progress: 591/1812 symbols completed. ELV took 1.1s. Estimated remaining: 7m 43s. Rate: 158.3 symbols/min [2025-10-14T22:36:40.764051] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:40.768299] [DEBUG] [LOCAL ] EMF: Loaded 3283 existing records from primary storage. [2025-10-14T22:36:40.768518] [INFO ] [MAIN ] EMF: Loaded 3283 primary data records. [2025-10-14T22:36:40.890298] [DEBUG] [LOCAL ] EME: Loaded 30969 existing records from primary storage. [2025-10-14T22:36:40.906165] [INFO ] [MAIN ] EME: Loaded 30969 primary data records. [2025-10-14T22:36:41.290525] [DEBUG] [LOCAL ] EMN: Loaded 50738 existing records from primary storage. [2025-10-14T22:36:41.350824] [INFO ] [MAIN ] EMN: Loaded 50738 primary data records. [2025-10-14T22:36:41.722893] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:41.724210] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3283 primary records. [2025-10-14T22:36:41.724370] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-14T22:36:41.753801] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:41.755246] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 30969 primary records. [2025-10-14T22:36:41.755516] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-14T22:36:41.757857] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-14T22:36:41.766831] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-14T22:36:41.772898] [INFO ] [MAIN ] Derivative Progress: 592/1812 symbols completed. EMF took 1.0s. Estimated remaining: 7m 44s. Rate: 157.8 symbols/min [2025-10-14T22:36:41.773884] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:41.780102] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-14T22:36:41.780278] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-14T22:36:41.782310] [INFO ] [MAIN ] Derivative Progress: 593/1812 symbols completed. EME took 1.0s. Estimated remaining: 7m 43s. Rate: 158.1 symbols/min [2025-10-14T22:36:41.782702] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:41.800019] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:41.800847] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50738 primary records. [2025-10-14T22:36:41.801110] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-14T22:36:41.806986] [DEBUG] [LOCAL ] EMO: Loaded 13223 existing records from primary storage. [2025-10-14T22:36:41.815779] [INFO ] [MAIN ] EMO: Loaded 13223 primary data records. [2025-10-14T22:36:41.867390] [DEBUG] [LOCAL ] EMP: Loaded 3054 existing records from primary storage. [2025-10-14T22:36:41.867507] [INFO ] [MAIN ] EMP: Loaded 3054 primary data records. [2025-10-14T22:36:42.016773] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-14T22:36:42.022811] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-14T22:36:42.037306] [INFO ] [MAIN ] Derivative Progress: 594/1812 symbols completed. EMN took 1.3s. Estimated remaining: 7m 42s. Rate: 158.2 symbols/min [2025-10-14T22:36:42.042858] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:42.492201] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:42.493696] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 13223 primary records. [2025-10-14T22:36:42.494619] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-14T22:36:42.533204] [DEBUG] [LOCAL ] EMR: Loaded 53209 existing records from primary storage. [2025-10-14T22:36:42.533564] [INFO ] [MAIN ] EMR: Loaded 53209 primary data records. [2025-10-14T22:36:42.532142] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:36:42.534973] [INFO ] [MAIN ] EMP: Generated 1792 derivative records from 3054 primary records. [2025-10-14T22:36:42.535069] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-14T22:36:42.607039] [DEBUG] [LOCAL ] EMP: Derivative data saved (1792 records). [2025-10-14T22:36:42.616337] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-14T22:36:42.616444] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-14T22:36:42.635571] [INFO ] [MAIN ] Derivative Progress: 595/1812 symbols completed. EMP took 0.9s. Estimated remaining: 7m 42s. Rate: 158.0 symbols/min [2025-10-14T22:36:42.635680] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-14T22:36:42.659690] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:42.659799] [INFO ] [MAIN ] Derivative Progress: 596/1812 symbols completed. EMO took 0.9s. Estimated remaining: 7m 41s. Rate: 158.3 symbols/min [2025-10-14T22:36:42.660468] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:42.895353] [DEBUG] [LOCAL ] ENIC: Loaded 36677 existing records from primary storage. [2025-10-14T22:36:42.896179] [INFO ] [MAIN ] ENIC: Loaded 36677 primary data records. [2025-10-14T22:36:42.979934] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:42.998328] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53209 primary records. [2025-10-14T22:36:42.998415] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-14T22:36:43.062558] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-14T22:36:43.050862] [DEBUG] [LOCAL ] ENB: Loaded 53512 existing records from primary storage. [2025-10-14T22:36:43.072930] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-14T22:36:43.075110] [INFO ] [MAIN ] Derivative Progress: 597/1812 symbols completed. EMR took 1.0s. Estimated remaining: 7m 41s. Rate: 158.3 symbols/min [2025-10-14T22:36:43.096675] [INFO ] [MAIN ] ENB: Loaded 53512 primary data records. [2025-10-14T22:36:43.124828] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:43.344931] [DEBUG] [LOCAL ] ENO: Loaded 1862 existing records from primary storage. [2025-10-14T22:36:43.350907] [INFO ] [MAIN ] ENO: Loaded 1862 primary data records. [2025-10-14T22:36:43.856874] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:43.859414] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36677 primary records. [2025-10-14T22:36:43.860204] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-14T22:36:43.885103] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:43.886285] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53512 primary records. [2025-10-14T22:36:43.886687] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-14T22:36:43.903179] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-14T22:36:43.903285] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-14T22:36:43.906923] [INFO ] [MAIN ] Derivative Progress: 598/1812 symbols completed. ENIC took 1.2s. Estimated remaining: 7m 41s. Rate: 157.9 symbols/min [2025-10-14T22:36:43.921081] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:36:43.922193] [INFO ] [MAIN ] ENO: Generated 1792 derivative records from 1862 primary records. [2025-10-14T22:36:43.922490] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-14T22:36:43.934176] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-14T22:36:43.934712] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-14T22:36:43.937219] [INFO ] [MAIN ] Derivative Progress: 599/1812 symbols completed. ENB took 1.3s. Estimated remaining: 7m 40s. Rate: 158.2 symbols/min [2025-10-14T22:36:43.939881] [DEBUG] [LOCAL ] ENO: Derivative data saved (1792 records). [2025-10-14T22:36:43.939967] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-14T22:36:43.942017] [INFO ] [MAIN ] Derivative Progress: 600/1812 symbols completed. ENO took 0.8s. Estimated remaining: 7m 39s. Rate: 158.4 symbols/min [2025-10-14T22:36:43.942439] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:43.942382] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:43.942332] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:43.988669] [DEBUG] [LOCAL ] ENS: Loaded 29567 existing records from primary storage. [2025-10-14T22:36:43.988930] [INFO ] [MAIN ] ENS: Loaded 29567 primary data records. [2025-10-14T22:36:44.157160] [DEBUG] [LOCAL ] ENR: Loaded 43622 existing records from primary storage. [2025-10-14T22:36:44.198566] [INFO ] [MAIN ] ENR: Loaded 43622 primary data records. [2025-10-14T22:36:44.225465] [DEBUG] [LOCAL ] ENOV: Loaded 44904 existing records from primary storage. [2025-10-14T22:36:44.383447] [INFO ] [MAIN ] ENOV: Loaded 44904 primary data records. [2025-10-14T22:36:44.951714] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:44.952709] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29567 primary records. [2025-10-14T22:36:44.953968] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-14T22:36:44.972233] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-14T22:36:44.972503] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-14T22:36:44.974553] [INFO ] [MAIN ] Derivative Progress: 601/1812 symbols completed. ENS took 1.0s. Estimated remaining: 7m 40s. Rate: 158.0 symbols/min [2025-10-14T22:36:44.982359] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:44.988024] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:44.989161] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43622 primary records. [2025-10-14T22:36:44.989242] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-14T22:36:45.007714] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-14T22:36:45.007849] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-14T22:36:45.010812] [INFO ] [MAIN ] Derivative Progress: 602/1812 symbols completed. ENR took 1.1s. Estimated remaining: 7m 39s. Rate: 158.2 symbols/min [2025-10-14T22:36:45.011701] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:45.032469] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:45.033268] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44904 primary records. [2025-10-14T22:36:45.033427] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-14T22:36:45.061079] [DEBUG] [LOCAL ] ENVA: Loaded 25448 existing records from primary storage. [2025-10-14T22:36:45.061216] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-14T22:36:45.061497] [INFO ] [MAIN ] ENVA: Loaded 25448 primary data records. [2025-10-14T22:36:45.061589] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-14T22:36:45.064040] [INFO ] [MAIN ] Derivative Progress: 603/1812 symbols completed. ENOV took 1.1s. Estimated remaining: 7m 38s. Rate: 158.5 symbols/min [2025-10-14T22:36:45.069329] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:45.127385] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-10-14T22:36:45.136372] [INFO ] [MAIN ] EOD: Loaded 15024 primary data records. [2025-10-14T22:36:45.691982] [DEBUG] [LOCAL ] EOG: Loaded 53364 existing records from primary storage. [2025-10-14T22:36:45.694135] [INFO ] [MAIN ] EOG: Loaded 53364 primary data records. [2025-10-14T22:36:45.920113] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:46.079469] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25448 primary records. [2025-10-14T22:36:46.091443] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-14T22:36:46.113091] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-14T22:36:46.128378] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-14T22:36:46.128957] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:46.131004] [INFO ] [MAIN ] Derivative Progress: 604/1812 symbols completed. ENVA took 1.1s. Estimated remaining: 7m 39s. Rate: 158.0 symbols/min [2025-10-14T22:36:46.131396] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:46.132973] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 15024 primary records. [2025-10-14T22:36:46.134356] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-14T22:36:46.152195] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-14T22:36:46.152621] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-14T22:36:46.154910] [INFO ] [MAIN ] Derivative Progress: 605/1812 symbols completed. EOD took 1.1s. Estimated remaining: 7m 38s. Rate: 158.2 symbols/min [2025-10-14T22:36:46.155441] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:46.166391] [DEBUG] [LOCAL ] EOI: Loaded 10770 existing records from primary storage. [2025-10-14T22:36:46.178604] [INFO ] [MAIN ] EOI: Loaded 10770 primary data records. [2025-10-14T22:36:46.219552] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:46.226961] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53364 primary records. [2025-10-14T22:36:46.247474] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-14T22:36:46.328238] [DEBUG] [LOCAL ] EOS: Loaded 15287 existing records from primary storage. [2025-10-14T22:36:46.347398] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-14T22:36:46.347496] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-14T22:36:46.358477] [INFO ] [MAIN ] Derivative Progress: 606/1812 symbols completed. EOG took 1.3s. Estimated remaining: 7m 37s. Rate: 158.3 symbols/min [2025-10-14T22:36:46.374722] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:46.356138] [INFO ] [MAIN ] EOS: Loaded 15287 primary data records. [2025-10-14T22:36:46.629492] [DEBUG] [LOCAL ] EOT: Loaded 6895 existing records from primary storage. [2025-10-14T22:36:46.679790] [INFO ] [MAIN ] EOT: Loaded 6895 primary data records. [2025-10-14T22:36:47.113689] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:47.114883] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10770 primary records. [2025-10-14T22:36:47.115053] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-14T22:36:47.147195] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-14T22:36:47.147978] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:47.148351] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-14T22:36:47.150881] [INFO ] [MAIN ] Derivative Progress: 607/1812 symbols completed. EOI took 1.0s. Estimated remaining: 7m 37s. Rate: 158.1 symbols/min [2025-10-14T22:36:47.152003] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15287 primary records. [2025-10-14T22:36:47.152234] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-14T22:36:47.152419] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:47.172360] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-14T22:36:47.172604] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-14T22:36:47.174787] [INFO ] [MAIN ] Derivative Progress: 608/1812 symbols completed. EOS took 1.0s. Estimated remaining: 7m 36s. Rate: 158.3 symbols/min [2025-10-14T22:36:47.174988] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:47.188732] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:47.189929] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6895 primary records. [2025-10-14T22:36:47.190045] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-14T22:36:47.214238] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-14T22:36:47.214381] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-14T22:36:47.216832] [INFO ] [MAIN ] Derivative Progress: 609/1812 symbols completed. EOT took 0.8s. Estimated remaining: 7m 35s. Rate: 158.5 symbols/min [2025-10-14T22:36:47.217125] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:47.227234] [DEBUG] [LOCAL ] EPAC: Loaded 26413 existing records from primary storage. [2025-10-14T22:36:47.227358] [INFO ] [MAIN ] EPAC: Loaded 26413 primary data records. [2025-10-14T22:36:47.575936] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-14T22:36:47.574842] [DEBUG] [LOCAL ] EPR: Loaded 43858 existing records from primary storage. [2025-10-14T22:36:47.576241] [INFO ] [MAIN ] EPR: Loaded 43858 primary data records. [2025-10-14T22:36:47.576314] [INFO ] [MAIN ] EPD: Loaded 53611 primary data records. [2025-10-14T22:36:48.282177] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:48.283292] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26413 primary records. [2025-10-14T22:36:48.283821] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-14T22:36:48.317667] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-14T22:36:48.319102] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-14T22:36:48.321496] [INFO ] [MAIN ] Derivative Progress: 610/1812 symbols completed. EPAC took 1.2s. Estimated remaining: 7m 36s. Rate: 158.0 symbols/min [2025-10-14T22:36:48.322514] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:48.323666] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:48.324501] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43858 primary records. [2025-10-14T22:36:48.337379] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-14T22:36:48.339080] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:48.346975] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53611 primary records. [2025-10-14T22:36:48.348189] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-14T22:36:48.368956] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-14T22:36:48.373753] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-14T22:36:48.373620] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-14T22:36:48.375863] [INFO ] [MAIN ] Derivative Progress: 611/1812 symbols completed. EPR took 1.2s. Estimated remaining: 7m 35s. Rate: 158.3 symbols/min [2025-10-14T22:36:48.376029] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-14T22:36:48.378472] [INFO ] [MAIN ] Derivative Progress: 612/1812 symbols completed. EPD took 1.2s. Estimated remaining: 7m 34s. Rate: 158.5 symbols/min [2025-10-14T22:36:48.378328] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:48.378735] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:48.395384] [DEBUG] [LOCAL ] EQBK: Loaded 11133 existing records from primary storage. [2025-10-14T22:36:48.405879] [INFO ] [MAIN ] EQBK: Loaded 11133 primary data records. [2025-10-14T22:36:48.549274] [DEBUG] [LOCAL ] EPRT: Loaded 48439 existing records from primary storage. [2025-10-14T22:36:48.559854] [INFO ] [MAIN ] EPRT: Loaded 48439 primary data records. [2025-10-14T22:36:48.818692] [DEBUG] [LOCAL ] EQH: Loaded 52687 existing records from primary storage. [2025-10-14T22:36:48.846248] [INFO ] [MAIN ] EQH: Loaded 52687 primary data records. [2025-10-14T22:36:49.415525] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:36:49.416600] [INFO ] [MAIN ] EQBK: Generated 1793 derivative records from 11133 primary records. [2025-10-14T22:36:49.417346] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-14T22:36:49.437071] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1793 records). [2025-10-14T22:36:49.445661] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-14T22:36:49.448027] [INFO ] [MAIN ] Derivative Progress: 613/1812 symbols completed. EQBK took 1.1s. Estimated remaining: 7m 35s. Rate: 158.0 symbols/min [2025-10-14T22:36:49.454068] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:49.455341] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48439 primary records. [2025-10-14T22:36:49.455690] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-14T22:36:49.474838] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-10-14T22:36:49.474963] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-14T22:36:49.476851] [INFO ] [MAIN ] Derivative Progress: 614/1812 symbols completed. EPRT took 1.2s. Estimated remaining: 7m 34s. Rate: 158.3 symbols/min [2025-10-14T22:36:49.491697] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:49.492244] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52687 primary records. [2025-10-14T22:36:49.492303] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-14T22:36:49.507402] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-14T22:36:49.507465] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-14T22:36:49.509696] [INFO ] [MAIN ] Derivative Progress: 615/1812 symbols completed. EQH took 1.1s. Estimated remaining: 7m 33s. Rate: 158.5 symbols/min [2025-10-14T22:36:49.510232] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:49.510329] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:49.510466] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:49.586242] [DEBUG] [LOCAL ] EQR: Loaded 51695 existing records from primary storage. [2025-10-14T22:36:49.600382] [INFO ] [MAIN ] EQR: Loaded 51695 primary data records. [2025-10-14T22:36:49.606966] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-14T22:36:49.649538] [INFO ] [MAIN ] EQT: Loaded 53685 primary data records. [2025-10-14T22:36:49.697235] [DEBUG] [LOCAL ] EQNR: Loaded 53039 existing records from primary storage. [2025-10-14T22:36:49.760978] [INFO ] [MAIN ] EQNR: Loaded 53039 primary data records. [2025-10-14T22:36:50.575225] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:50.589126] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53685 primary records. [2025-10-14T22:36:50.589520] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:50.602353] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-14T22:36:50.603834] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51695 primary records. [2025-10-14T22:36:50.604637] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-14T22:36:50.604555] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:50.606262] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53039 primary records. [2025-10-14T22:36:50.606539] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-14T22:36:50.649918] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-14T22:36:50.650524] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-14T22:36:50.653123] [INFO ] [MAIN ] Derivative Progress: 616/1812 symbols completed. EQT took 1.1s. Estimated remaining: 7m 34s. Rate: 158.0 symbols/min [2025-10-14T22:36:50.653559] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:50.658439] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-14T22:36:50.659008] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-14T22:36:50.663979] [INFO ] [MAIN ] Derivative Progress: 617/1812 symbols completed. EQNR took 1.2s. Estimated remaining: 7m 33s. Rate: 158.3 symbols/min [2025-10-14T22:36:50.664139] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-14T22:36:50.664309] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:50.664600] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-14T22:36:50.667922] [INFO ] [MAIN ] Derivative Progress: 618/1812 symbols completed. EQR took 1.2s. Estimated remaining: 7m 32s. Rate: 158.5 symbols/min [2025-10-14T22:36:50.668209] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:50.671908] [DEBUG] [LOCAL ] EQV: Loaded 2660 existing records from primary storage. [2025-10-14T22:36:50.673247] [INFO ] [MAIN ] EQV: Loaded 2660 primary data records. [2025-10-14T22:36:51.026572] [DEBUG] [LOCAL ] ERO: Loaded 41797 existing records from primary storage. [2025-10-14T22:36:51.027828] [INFO ] [MAIN ] ERO: Loaded 41797 primary data records. [2025-10-14T22:36:51.034014] [DEBUG] [LOCAL ] ERJ: Loaded 50329 existing records from primary storage. [2025-10-14T22:36:51.041368] [INFO ] [MAIN ] ERJ: Loaded 50329 primary data records. [2025-10-14T22:36:51.698781] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:51.699976] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2660 primary records. [2025-10-14T22:36:51.700078] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-14T22:36:51.718629] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-14T22:36:51.718854] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-14T22:36:51.721732] [INFO ] [MAIN ] Derivative Progress: 619/1812 symbols completed. EQV took 1.1s. Estimated remaining: 7m 33s. Rate: 158.1 symbols/min [2025-10-14T22:36:51.722159] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:51.747758] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:51.749183] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41797 primary records. [2025-10-14T22:36:51.749444] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-14T22:36:51.764271] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:51.774576] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50329 primary records. [2025-10-14T22:36:51.774709] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-14T22:36:51.823854] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-14T22:36:51.820575] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-14T22:36:51.824182] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-14T22:36:51.827821] [INFO ] [MAIN ] Derivative Progress: 620/1812 symbols completed. ERJ took 1.2s. Estimated remaining: 7m 32s. Rate: 158.2 symbols/min [2025-10-14T22:36:51.828125] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-14T22:36:51.831316] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:51.831441] [INFO ] [MAIN ] Derivative Progress: 621/1812 symbols completed. ERO took 1.2s. Estimated remaining: 7m 31s. Rate: 158.5 symbols/min [2025-10-14T22:36:51.832470] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:51.854796] [DEBUG] [LOCAL ] ES: Loaded 52697 existing records from primary storage. [2025-10-14T22:36:51.854950] [INFO ] [MAIN ] ES: Loaded 52697 primary data records. [2025-10-14T22:36:51.948150] [DEBUG] [LOCAL ] ESE: Loaded 16489 existing records from primary storage. [2025-10-14T22:36:51.965173] [INFO ] [MAIN ] ESE: Loaded 16489 primary data records. [2025-10-14T22:36:52.304507] [DEBUG] [LOCAL ] ESAB: Loaded 26055 existing records from primary storage. [2025-10-14T22:36:52.315324] [INFO ] [MAIN ] ESAB: Loaded 26055 primary data records. [2025-10-14T22:36:52.853836] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:52.857256] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52697 primary records. [2025-10-14T22:36:52.857386] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-14T22:36:52.879950] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:52.881453] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16489 primary records. [2025-10-14T22:36:52.890875] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-14T22:36:52.917989] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-14T22:36:52.919628] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-14T22:36:52.921090] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-14T22:36:52.925085] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-14T22:36:52.923780] [INFO ] [MAIN ] Derivative Progress: 622/1812 symbols completed. ES took 1.2s. Estimated remaining: 7m 32s. Rate: 158.0 symbols/min [2025-10-14T22:36:52.941695] [INFO ] [MAIN ] Derivative Progress: 623/1812 symbols completed. ESE took 1.1s. Estimated remaining: 7m 31s. Rate: 158.3 symbols/min [2025-10-14T22:36:52.928582] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:52.943038] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:52.943959] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:52.945761] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26055 primary records. [2025-10-14T22:36:52.945889] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-14T22:36:52.963975] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-14T22:36:52.964251] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-14T22:36:52.967841] [INFO ] [MAIN ] Derivative Progress: 624/1812 symbols completed. ESAB took 1.1s. Estimated remaining: 7m 30s. Rate: 158.5 symbols/min [2025-10-14T22:36:52.968195] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:53.014747] [DEBUG] [LOCAL ] ESNT: Loaded 38293 existing records from primary storage. [2025-10-14T22:36:53.015042] [INFO ] [MAIN ] ESNT: Loaded 38293 primary data records. [2025-10-14T22:36:53.150137] [DEBUG] [LOCAL ] ESI: Loaded 50665 existing records from primary storage. [2025-10-14T22:36:53.155104] [INFO ] [MAIN ] ESI: Loaded 50665 primary data records. [2025-10-14T22:36:53.257329] [DEBUG] [LOCAL ] ESRT: Loaded 46416 existing records from primary storage. [2025-10-14T22:36:53.299075] [INFO ] [MAIN ] ESRT: Loaded 46416 primary data records. [2025-10-14T22:36:54.098086] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:54.099292] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38293 primary records. [2025-10-14T22:36:54.100108] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-14T22:36:54.136306] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-14T22:36:54.137424] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-14T22:36:54.137212] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:54.140326] [INFO ] [MAIN ] Derivative Progress: 625/1812 symbols completed. ESNT took 1.2s. Estimated remaining: 7m 31s. Rate: 158.0 symbols/min [2025-10-14T22:36:54.141674] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:54.141463] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50665 primary records. [2025-10-14T22:36:54.141973] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-14T22:36:54.160785] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-14T22:36:54.161123] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-14T22:36:54.165343] [INFO ] [MAIN ] Derivative Progress: 626/1812 symbols completed. ESI took 1.2s. Estimated remaining: 7m 30s. Rate: 158.2 symbols/min [2025-10-14T22:36:54.166744] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:54.182706] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:54.183821] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46416 primary records. [2025-10-14T22:36:54.184072] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-14T22:36:54.211704] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-14T22:36:54.211884] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-14T22:36:54.215123] [INFO ] [MAIN ] Derivative Progress: 627/1812 symbols completed. ESRT took 1.2s. Estimated remaining: 7m 29s. Rate: 158.4 symbols/min [2025-10-14T22:36:54.215431] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:54.231156] [DEBUG] [LOCAL ] ESS: Loaded 29971 existing records from primary storage. [2025-10-14T22:36:54.231620] [INFO ] [MAIN ] ESS: Loaded 29971 primary data records. [2025-10-14T22:36:54.387109] [DEBUG] [LOCAL ] ESTC: Loaded 50322 existing records from primary storage. [2025-10-14T22:36:54.392576] [INFO ] [MAIN ] ESTC: Loaded 50322 primary data records. [2025-10-14T22:36:54.812999] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-14T22:36:54.838922] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-14T22:36:55.340854] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:55.342798] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 29971 primary records. [2025-10-14T22:36:55.343087] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-14T22:36:55.375995] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:55.379547] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50322 primary records. [2025-10-14T22:36:55.380666] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-14T22:36:55.380862] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-14T22:36:55.381150] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-14T22:36:55.384107] [INFO ] [MAIN ] Derivative Progress: 628/1812 symbols completed. ESS took 1.2s. Estimated remaining: 7m 30s. Rate: 157.9 symbols/min [2025-10-14T22:36:55.402123] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-14T22:36:55.402373] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-14T22:36:55.405416] [INFO ] [MAIN ] Derivative Progress: 629/1812 symbols completed. ESTC took 1.2s. Estimated remaining: 7m 29s. Rate: 158.1 symbols/min [2025-10-14T22:36:55.423254] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:55.424022] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-14T22:36:55.424088] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-14T22:36:55.441032] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-14T22:36:55.441214] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-14T22:36:55.445324] [INFO ] [MAIN ] Derivative Progress: 630/1812 symbols completed. ET took 1.2s. Estimated remaining: 7m 28s. Rate: 158.4 symbols/min [2025-10-14T22:36:55.446449] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:55.446352] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:55.446207] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:55.485005] [DEBUG] [LOCAL ] ETB: Loaded 12065 existing records from primary storage. [2025-10-14T22:36:55.486615] [INFO ] [MAIN ] ETB: Loaded 12065 primary data records. [2025-10-14T22:36:55.492443] [DEBUG] [LOCAL ] ETG: Loaded 16697 existing records from primary storage. [2025-10-14T22:36:55.530476] [INFO ] [MAIN ] ETG: Loaded 16697 primary data records. [2025-10-14T22:36:55.549569] [DEBUG] [LOCAL ] ETD: Loaded 27280 existing records from primary storage. [2025-10-14T22:36:55.603227] [INFO ] [MAIN ] ETD: Loaded 27280 primary data records. [2025-10-14T22:36:56.579454] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:56.581260] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12065 primary records. [2025-10-14T22:36:56.581969] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-14T22:36:56.605683] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-14T22:36:56.619852] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-14T22:36:56.635664] [INFO ] [MAIN ] Derivative Progress: 631/1812 symbols completed. ETB took 1.2s. Estimated remaining: 7m 29s. Rate: 157.8 symbols/min [2025-10-14T22:36:56.632925] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:56.636156] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:56.638234] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27280 primary records. [2025-10-14T22:36:56.637133] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:56.638637] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-14T22:36:56.639802] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16697 primary records. [2025-10-14T22:36:56.640476] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-14T22:36:56.682471] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-14T22:36:56.681924] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-14T22:36:56.682904] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-14T22:36:56.686516] [INFO ] [MAIN ] Derivative Progress: 632/1812 symbols completed. ETD took 1.2s. Estimated remaining: 7m 28s. Rate: 158.0 symbols/min [2025-10-14T22:36:56.686967] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-14T22:36:56.686839] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:56.698438] [DEBUG] [LOCAL ] ETJ: Loaded 16926 existing records from primary storage. [2025-10-14T22:36:56.698032] [INFO ] [MAIN ] Derivative Progress: 633/1812 symbols completed. ETG took 1.3s. Estimated remaining: 7m 27s. Rate: 158.3 symbols/min [2025-10-14T22:36:56.699227] [INFO ] [MAIN ] ETJ: Loaded 16926 primary data records. [2025-10-14T22:36:56.699399] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:56.820305] [DEBUG] [LOCAL ] ETO: Loaded 6995 existing records from primary storage. [2025-10-14T22:36:56.826222] [INFO ] [MAIN ] ETO: Loaded 6995 primary data records. [2025-10-14T22:36:57.379363] [DEBUG] [LOCAL ] ETN: Loaded 52656 existing records from primary storage. [2025-10-14T22:36:57.379806] [INFO ] [MAIN ] ETN: Loaded 52656 primary data records. [2025-10-14T22:36:57.726275] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:57.727439] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16926 primary records. [2025-10-14T22:36:57.727633] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-14T22:36:57.764581] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:57.766231] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6995 primary records. [2025-10-14T22:36:57.766491] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-14T22:36:57.765266] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-14T22:36:57.767351] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-14T22:36:57.770283] [INFO ] [MAIN ] Derivative Progress: 634/1812 symbols completed. ETJ took 1.1s. Estimated remaining: 7m 28s. Rate: 157.8 symbols/min [2025-10-14T22:36:57.770576] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:57.786956] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-14T22:36:57.787388] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-14T22:36:57.789814] [INFO ] [MAIN ] Derivative Progress: 635/1812 symbols completed. ETO took 1.1s. Estimated remaining: 7m 27s. Rate: 158.1 symbols/min [2025-10-14T22:36:57.790095] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:57.808075] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:57.809092] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52656 primary records. [2025-10-14T22:36:57.809273] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-14T22:36:57.832566] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-14T22:36:57.832998] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-14T22:36:57.837233] [INFO ] [MAIN ] Derivative Progress: 636/1812 symbols completed. ETN took 1.2s. Estimated remaining: 7m 26s. Rate: 158.3 symbols/min [2025-10-14T22:36:57.837546] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:57.892905] [DEBUG] [LOCAL ] ETR: Loaded 53213 existing records from primary storage. [2025-10-14T22:36:57.893294] [INFO ] [MAIN ] ETR: Loaded 53213 primary data records. [2025-10-14T22:36:57.974510] [DEBUG] [LOCAL ] ETV: Loaded 22316 existing records from primary storage. [2025-10-14T22:36:57.992127] [INFO ] [MAIN ] ETV: Loaded 22316 primary data records. [2025-10-14T22:36:58.073505] [DEBUG] [LOCAL ] ETSY: Loaded 53577 existing records from primary storage. [2025-10-14T22:36:58.153970] [INFO ] [MAIN ] ETSY: Loaded 53577 primary data records. [2025-10-14T22:36:58.996275] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:58.998413] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53213 primary records. [2025-10-14T22:36:58.998716] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-14T22:36:59.021973] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-14T22:36:59.036071] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:59.037369] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 22316 primary records. [2025-10-14T22:36:59.037491] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-14T22:36:59.036507] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-14T22:36:59.040329] [INFO ] [MAIN ] Derivative Progress: 637/1812 symbols completed. ETR took 1.3s. Estimated remaining: 7m 27s. Rate: 157.7 symbols/min [2025-10-14T22:36:59.048906] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:59.060510] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-14T22:36:59.062548] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-14T22:36:59.065973] [INFO ] [MAIN ] Derivative Progress: 638/1812 symbols completed. ETV took 1.2s. Estimated remaining: 7m 26s. Rate: 158.0 symbols/min [2025-10-14T22:36:59.066387] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:59.089526] [DEBUG] [MAIN ] ETSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:36:59.094165] [INFO ] [MAIN ] ETSY: Generated 1794 derivative records from 53577 primary records. [2025-10-14T22:36:59.094415] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-14T22:36:59.111025] [DEBUG] [LOCAL ] ETX: Loaded 5253 existing records from primary storage. [2025-10-14T22:36:59.113541] [INFO ] [MAIN ] ETX: Loaded 5253 primary data records. [2025-10-14T22:36:59.151015] [DEBUG] [LOCAL ] ETW: Loaded 25635 existing records from primary storage. [2025-10-14T22:36:59.175003] [INFO ] [MAIN ] ETW: Loaded 25635 primary data records. [2025-10-14T22:36:59.241947] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1794 records). [2025-10-14T22:36:59.314939] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-14T22:36:59.358160] [INFO ] [MAIN ] Derivative Progress: 639/1812 symbols completed. ETSY took 1.6s. Estimated remaining: 7m 25s. Rate: 158.0 symbols/min [2025-10-14T22:36:59.374805] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:36:59.802389] [DEBUG] [LOCAL ] ETY: Loaded 23026 existing records from primary storage. [2025-10-14T22:36:59.803024] [INFO ] [MAIN ] ETY: Loaded 23026 primary data records. [2025-10-14T22:36:59.979167] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:00.025052] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5253 primary records. [2025-10-14T22:37:00.025520] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-14T22:37:00.182851] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-14T22:37:00.188847] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:00.188961] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-14T22:37:00.192214] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25635 primary records. [2025-10-14T22:37:00.191270] [INFO ] [MAIN ] Derivative Progress: 640/1812 symbols completed. ETX took 1.1s. Estimated remaining: 7m 26s. Rate: 157.7 symbols/min [2025-10-14T22:37:00.192537] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:00.193282] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-14T22:37:00.218905] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-14T22:37:00.219163] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-14T22:37:00.222821] [INFO ] [MAIN ] Derivative Progress: 641/1812 symbols completed. ETW took 1.2s. Estimated remaining: 7m 25s. Rate: 158.0 symbols/min [2025-10-14T22:37:00.223282] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:00.232923] [DEBUG] [LOCAL ] EVC: Loaded 18136 existing records from primary storage. [2025-10-14T22:37:00.233314] [INFO ] [MAIN ] EVC: Loaded 18136 primary data records. [2025-10-14T22:37:00.381281] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:00.386904] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 23026 primary records. [2025-10-14T22:37:00.397415] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-14T22:37:00.429948] [DEBUG] [LOCAL ] EVEX: Loaded 32175 existing records from primary storage. [2025-10-14T22:37:00.480637] [INFO ] [MAIN ] EVEX: Loaded 32175 primary data records. [2025-10-14T22:37:00.645977] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-14T22:37:00.678694] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-14T22:37:00.698729] [INFO ] [MAIN ] Derivative Progress: 642/1812 symbols completed. ETY took 1.3s. Estimated remaining: 7m 25s. Rate: 157.9 symbols/min [2025-10-14T22:37:00.720083] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:00.910244] [DEBUG] [LOCAL ] EVF: Loaded 9853 existing records from primary storage. [2025-10-14T22:37:01.035397] [INFO ] [MAIN ] EVF: Loaded 9853 primary data records. [2025-10-14T22:37:01.285870] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:01.415107] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18136 primary records. [2025-10-14T22:37:01.415355] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-14T22:37:01.435833] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-14T22:37:01.437787] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-14T22:37:01.440991] [INFO ] [MAIN ] Derivative Progress: 643/1812 symbols completed. EVC took 1.2s. Estimated remaining: 7m 25s. Rate: 157.7 symbols/min [2025-10-14T22:37:01.460810] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:01.462283] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 32175 primary records. [2025-10-14T22:37:01.462544] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-14T22:37:01.480907] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-14T22:37:01.481267] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-14T22:37:01.485463] [INFO ] [MAIN ] Derivative Progress: 644/1812 symbols completed. EVEX took 1.3s. Estimated remaining: 7m 24s. Rate: 157.9 symbols/min [2025-10-14T22:37:01.500364] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:01.501175] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9853 primary records. [2025-10-14T22:37:01.501245] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-14T22:37:01.515743] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-14T22:37:01.515819] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-14T22:37:01.519468] [INFO ] [MAIN ] Derivative Progress: 645/1812 symbols completed. EVF took 0.8s. Estimated remaining: 7m 23s. Rate: 158.1 symbols/min [2025-10-14T22:37:01.520247] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:01.520115] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:01.520402] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:01.543552] [DEBUG] [LOCAL ] EVN: Loaded 10794 existing records from primary storage. [2025-10-14T22:37:01.544111] [DEBUG] [LOCAL ] EVG: Loaded 5939 existing records from primary storage. [2025-10-14T22:37:01.544458] [INFO ] [MAIN ] EVN: Loaded 10794 primary data records. [2025-10-14T22:37:01.544596] [INFO ] [MAIN ] EVG: Loaded 5939 primary data records. [2025-10-14T22:37:01.967445] [DEBUG] [LOCAL ] EVH: Loaded 49624 existing records from primary storage. [2025-10-14T22:37:02.126527] [INFO ] [MAIN ] EVH: Loaded 49624 primary data records. [2025-10-14T22:37:02.599361] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:02.601695] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5939 primary records. [2025-10-14T22:37:02.602620] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-14T22:37:02.623897] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-14T22:37:02.626423] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-14T22:37:02.629755] [INFO ] [MAIN ] Derivative Progress: 646/1812 symbols completed. EVG took 1.1s. Estimated remaining: 7m 24s. Rate: 157.6 symbols/min [2025-10-14T22:37:02.630398] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:02.645166] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:02.646177] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10794 primary records. [2025-10-14T22:37:02.646359] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-14T22:37:02.666954] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-14T22:37:02.669130] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-14T22:37:02.672603] [INFO ] [MAIN ] Derivative Progress: 647/1812 symbols completed. EVN took 1.2s. Estimated remaining: 7m 23s. Rate: 157.8 symbols/min [2025-10-14T22:37:02.673225] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:02.689799] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:02.691039] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49624 primary records. [2025-10-14T22:37:02.691444] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-14T22:37:02.721063] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-14T22:37:02.724790] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-14T22:37:02.728298] [INFO ] [MAIN ] Derivative Progress: 648/1812 symbols completed. EVH took 1.2s. Estimated remaining: 7m 22s. Rate: 158.1 symbols/min [2025-10-14T22:37:02.728580] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:02.738126] [DEBUG] [LOCAL ] EVT: Loaded 16854 existing records from primary storage. [2025-10-14T22:37:02.748213] [INFO ] [MAIN ] EVT: Loaded 16854 primary data records. [2025-10-14T22:37:02.761154] [DEBUG] [LOCAL ] EVR: Loaded 34470 existing records from primary storage. [2025-10-14T22:37:02.782876] [INFO ] [MAIN ] EVR: Loaded 34470 primary data records. [2025-10-14T22:37:03.385681] [DEBUG] [LOCAL ] EVTC: Loaded 26612 existing records from primary storage. [2025-10-14T22:37:03.410573] [INFO ] [MAIN ] EVTC: Loaded 26612 primary data records. [2025-10-14T22:37:03.786486] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:03.793376] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16854 primary records. [2025-10-14T22:37:03.794136] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-14T22:37:03.792483] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:03.794977] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34470 primary records. [2025-10-14T22:37:03.795082] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-14T22:37:03.827771] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-14T22:37:03.828500] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-14T22:37:03.831679] [INFO ] [MAIN ] Derivative Progress: 649/1812 symbols completed. EVR took 1.2s. Estimated remaining: 7m 23s. Rate: 157.6 symbols/min [2025-10-14T22:37:03.832785] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-14T22:37:03.833074] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-14T22:37:03.833201] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:03.836907] [INFO ] [MAIN ] Derivative Progress: 650/1812 symbols completed. EVT took 1.2s. Estimated remaining: 7m 22s. Rate: 157.8 symbols/min [2025-10-14T22:37:03.837784] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:03.857823] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:03.858803] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26612 primary records. [2025-10-14T22:37:03.858965] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-14T22:37:03.906424] [DEBUG] [LOCAL ] EVTR: Loaded 24584 existing records from primary storage. [2025-10-14T22:37:03.906796] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-14T22:37:03.907003] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-14T22:37:03.911132] [INFO ] [MAIN ] EVTR: Loaded 24584 primary data records. [2025-10-14T22:37:03.910878] [INFO ] [MAIN ] Derivative Progress: 651/1812 symbols completed. EVTC took 1.2s. Estimated remaining: 7m 21s. Rate: 158.0 symbols/min [2025-10-14T22:37:03.911459] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:04.039206] [DEBUG] [LOCAL ] EVTL: Loaded 40083 existing records from primary storage. [2025-10-14T22:37:04.039668] [INFO ] [MAIN ] EVTL: Loaded 40083 primary data records. [2025-10-14T22:37:04.471045] [DEBUG] [LOCAL ] EW: Loaded 53406 existing records from primary storage. [2025-10-14T22:37:04.591074] [INFO ] [MAIN ] EW: Loaded 53406 primary data records. [2025-10-14T22:37:05.008426] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:37:05.010795] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 24584 primary records. [2025-10-14T22:37:05.012320] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-14T22:37:05.050940] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-10-14T22:37:05.049445] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:05.051162] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-14T22:37:05.052001] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 40083 primary records. [2025-10-14T22:37:05.054848] [INFO ] [MAIN ] Derivative Progress: 652/1812 symbols completed. EVTR took 1.2s. Estimated remaining: 7m 22s. Rate: 157.5 symbols/min [2025-10-14T22:37:05.055024] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:05.055102] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-14T22:37:05.074694] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-14T22:37:05.074867] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-14T22:37:05.078076] [INFO ] [MAIN ] Derivative Progress: 653/1812 symbols completed. EVTL took 1.2s. Estimated remaining: 7m 21s. Rate: 157.8 symbols/min [2025-10-14T22:37:05.078247] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:05.096859] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:05.097555] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53406 primary records. [2025-10-14T22:37:05.108626] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-14T22:37:05.138381] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-14T22:37:05.138687] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-14T22:37:05.142079] [DEBUG] [LOCAL ] EXG: Loaded 34136 existing records from primary storage. [2025-10-14T22:37:05.141353] [INFO ] [MAIN ] Derivative Progress: 654/1812 symbols completed. EW took 1.2s. Estimated remaining: 7m 20s. Rate: 158.0 symbols/min [2025-10-14T22:37:05.142297] [INFO ] [MAIN ] EXG: Loaded 34136 primary data records. [2025-10-14T22:37:05.143114] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:05.297068] [DEBUG] [LOCAL ] EXK: Loaded 53169 existing records from primary storage. [2025-10-14T22:37:05.330128] [INFO ] [MAIN ] EXK: Loaded 53169 primary data records. [2025-10-14T22:37:05.624566] [DEBUG] [LOCAL ] EXP: Loaded 29541 existing records from primary storage. [2025-10-14T22:37:05.641896] [INFO ] [MAIN ] EXP: Loaded 29541 primary data records. [2025-10-14T22:37:06.160715] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:06.163097] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34136 primary records. [2025-10-14T22:37:06.164145] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-14T22:37:06.196960] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:06.200120] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53169 primary records. [2025-10-14T22:37:06.201043] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-14T22:37:06.203980] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-14T22:37:06.204229] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-14T22:37:06.215543] [INFO ] [MAIN ] Derivative Progress: 655/1812 symbols completed. EXG took 1.2s. Estimated remaining: 7m 21s. Rate: 157.5 symbols/min [2025-10-14T22:37:06.219046] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:06.229142] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-14T22:37:06.237155] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-14T22:37:06.240790] [INFO ] [MAIN ] Derivative Progress: 656/1812 symbols completed. EXK took 1.2s. Estimated remaining: 7m 20s. Rate: 157.8 symbols/min [2025-10-14T22:37:06.246630] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:06.246831] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:06.247860] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29541 primary records. [2025-10-14T22:37:06.248593] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-14T22:37:06.266170] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-14T22:37:06.266338] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-14T22:37:06.269198] [INFO ] [MAIN ] Derivative Progress: 657/1812 symbols completed. EXP took 1.1s. Estimated remaining: 7m 19s. Rate: 158.0 symbols/min [2025-10-14T22:37:06.269556] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:06.327841] [DEBUG] [LOCAL ] EXPD: Loaded 47953 existing records from primary storage. [2025-10-14T22:37:06.359177] [INFO ] [MAIN ] EXPD: Loaded 47953 primary data records. [2025-10-14T22:37:06.372525] [DEBUG] [LOCAL ] EXR: Loaded 45464 existing records from primary storage. [2025-10-14T22:37:06.402443] [INFO ] [MAIN ] EXR: Loaded 45464 primary data records. [2025-10-14T22:37:06.510101] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-14T22:37:06.531897] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-14T22:37:07.467749] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:07.468862] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47953 primary records. [2025-10-14T22:37:07.469059] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-14T22:37:07.501520] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:07.503394] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45464 primary records. [2025-10-14T22:37:07.503848] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-14T22:37:07.518669] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:07.529037] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-14T22:37:07.528960] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-14T22:37:07.529166] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-14T22:37:07.532527] [INFO ] [MAIN ] Derivative Progress: 658/1812 symbols completed. EXPD took 1.3s. Estimated remaining: 7m 20s. Rate: 157.4 symbols/min [2025-10-14T22:37:07.529302] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-14T22:37:07.559129] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-14T22:37:07.560195] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-14T22:37:07.563722] [INFO ] [MAIN ] Derivative Progress: 659/1812 symbols completed. F took 1.3s. Estimated remaining: 7m 19s. Rate: 157.6 symbols/min [2025-10-14T22:37:07.564948] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-14T22:37:07.565314] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-14T22:37:07.567985] [INFO ] [MAIN ] Derivative Progress: 660/1812 symbols completed. EXR took 1.3s. Estimated remaining: 7m 18s. Rate: 157.9 symbols/min [2025-10-14T22:37:07.568533] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:07.568694] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:07.568479] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:07.602623] [DEBUG] [LOCAL ] FBK: Loaded 27211 existing records from primary storage. [2025-10-14T22:37:07.602806] [INFO ] [MAIN ] FBK: Loaded 27211 primary data records. [2025-10-14T22:37:07.793837] [DEBUG] [LOCAL ] FBIN: Loaded 50395 existing records from primary storage. [2025-10-14T22:37:07.815352] [INFO ] [MAIN ] FBIN: Loaded 50395 primary data records. [2025-10-14T22:37:07.839165] [DEBUG] [LOCAL ] FAF: Loaded 41537 existing records from primary storage. [2025-10-14T22:37:07.922171] [INFO ] [MAIN ] FAF: Loaded 41537 primary data records. [2025-10-14T22:37:08.663558] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:08.665639] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 27211 primary records. [2025-10-14T22:37:08.666123] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-14T22:37:08.690477] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-14T22:37:08.690722] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-14T22:37:08.694496] [INFO ] [MAIN ] Derivative Progress: 661/1812 symbols completed. FBK took 1.1s. Estimated remaining: 7m 19s. Rate: 157.4 symbols/min [2025-10-14T22:37:08.696139] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:08.712079] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:08.713462] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50395 primary records. [2025-10-14T22:37:08.715700] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-14T22:37:08.746955] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:08.749256] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41537 primary records. [2025-10-14T22:37:08.750189] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-14T22:37:08.761339] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-14T22:37:08.766185] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-14T22:37:08.770265] [INFO ] [MAIN ] Derivative Progress: 662/1812 symbols completed. FBIN took 1.2s. Estimated remaining: 7m 18s. Rate: 157.6 symbols/min [2025-10-14T22:37:08.783382] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:08.787593] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-14T22:37:08.787701] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-14T22:37:08.792006] [INFO ] [MAIN ] Derivative Progress: 663/1812 symbols completed. FAF took 1.2s. Estimated remaining: 7m 17s. Rate: 157.8 symbols/min [2025-10-14T22:37:08.792504] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:08.813805] [DEBUG] [LOCAL ] FBP: Loaded 45726 existing records from primary storage. [2025-10-14T22:37:08.814093] [INFO ] [MAIN ] FBP: Loaded 45726 primary data records. [2025-10-14T22:37:08.903502] [DEBUG] [LOCAL ] FC: Loaded 14892 existing records from primary storage. [2025-10-14T22:37:08.914875] [INFO ] [MAIN ] FC: Loaded 14892 primary data records. [2025-10-14T22:37:09.292130] [DEBUG] [LOCAL ] FCF: Loaded 39283 existing records from primary storage. [2025-10-14T22:37:09.303812] [INFO ] [MAIN ] FCF: Loaded 39283 primary data records. [2025-10-14T22:37:09.882991] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:09.884433] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45726 primary records. [2025-10-14T22:37:09.886561] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-14T22:37:09.921040] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-14T22:37:09.922338] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-14T22:37:09.922210] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:09.924520] [INFO ] [MAIN ] Derivative Progress: 664/1812 symbols completed. FBP took 1.2s. Estimated remaining: 7m 18s. Rate: 157.4 symbols/min [2025-10-14T22:37:09.925831] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:09.925625] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 14892 primary records. [2025-10-14T22:37:09.926270] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-14T22:37:09.962875] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:09.964731] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39283 primary records. [2025-10-14T22:37:09.966002] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-14T22:37:09.966171] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-14T22:37:09.967267] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-14T22:37:09.979444] [INFO ] [MAIN ] Derivative Progress: 665/1812 symbols completed. FC took 1.2s. Estimated remaining: 7m 17s. Rate: 157.6 symbols/min [2025-10-14T22:37:09.991464] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:10.006728] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-14T22:37:10.007105] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-14T22:37:10.009616] [INFO ] [MAIN ] Derivative Progress: 666/1812 symbols completed. FCF took 1.2s. Estimated remaining: 7m 16s. Rate: 157.8 symbols/min [2025-10-14T22:37:10.010863] [DEBUG] [LOCAL ] FCN: Loaded 25989 existing records from primary storage. [2025-10-14T22:37:10.010993] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:10.011674] [INFO ] [MAIN ] FCN: Loaded 25989 primary data records. [2025-10-14T22:37:10.154180] [DEBUG] [LOCAL ] FCT: Loaded 14666 existing records from primary storage. [2025-10-14T22:37:10.170033] [INFO ] [MAIN ] FCT: Loaded 14666 primary data records. [2025-10-14T22:37:10.407168] [DEBUG] [LOCAL ] FCPT: Loaded 37291 existing records from primary storage. [2025-10-14T22:37:10.425500] [INFO ] [MAIN ] FCPT: Loaded 37291 primary data records. [2025-10-14T22:37:11.028189] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:11.030159] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 25989 primary records. [2025-10-14T22:37:11.030458] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-14T22:37:11.051421] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-14T22:37:11.054898] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-14T22:37:11.057187] [INFO ] [MAIN ] Derivative Progress: 667/1812 symbols completed. FCN took 1.1s. Estimated remaining: 7m 17s. Rate: 157.4 symbols/min [2025-10-14T22:37:11.070689] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:11.071866] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:11.073000] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14666 primary records. [2025-10-14T22:37:11.073086] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-14T22:37:11.094911] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-14T22:37:11.108118] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-14T22:37:11.110932] [INFO ] [MAIN ] Derivative Progress: 668/1812 symbols completed. FCT took 1.1s. Estimated remaining: 7m 16s. Rate: 157.6 symbols/min [2025-10-14T22:37:11.108464] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:11.111297] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:11.112914] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37291 primary records. [2025-10-14T22:37:11.113069] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-14T22:37:11.130898] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-14T22:37:11.130965] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-14T22:37:11.134340] [INFO ] [MAIN ] Derivative Progress: 669/1812 symbols completed. FCPT took 1.1s. Estimated remaining: 7m 15s. Rate: 157.8 symbols/min [2025-10-14T22:37:11.134587] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:11.195823] [DEBUG] [LOCAL ] FDP: Loaded 29846 existing records from primary storage. [2025-10-14T22:37:11.197521] [INFO ] [MAIN ] FDP: Loaded 29846 primary data records. [2025-10-14T22:37:11.204365] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-14T22:37:11.211904] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-10-14T22:37:11.314988] [DEBUG] [LOCAL ] FDS: Loaded 27588 existing records from primary storage. [2025-10-14T22:37:11.386634] [INFO ] [MAIN ] FDS: Loaded 27588 primary data records. [2025-10-14T22:37:12.232490] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:12.232124] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:12.234337] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-10-14T22:37:12.233428] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 29846 primary records. [2025-10-14T22:37:12.234877] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-14T22:37:12.235004] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-14T22:37:12.276748] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-14T22:37:12.284252] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-14T22:37:12.287134] [INFO ] [MAIN ] Derivative Progress: 670/1812 symbols completed. FDP took 1.2s. Estimated remaining: 7m 16s. Rate: 157.3 symbols/min [2025-10-14T22:37:12.288844] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:12.284503] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:12.289218] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-14T22:37:12.290496] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 27588 primary records. [2025-10-14T22:37:12.290609] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-14T22:37:12.292637] [INFO ] [MAIN ] Derivative Progress: 671/1812 symbols completed. FCX took 1.2s. Estimated remaining: 7m 15s. Rate: 157.5 symbols/min [2025-10-14T22:37:12.292912] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-14T22:37:12.293950] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:12.311002] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-14T22:37:12.311199] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-14T22:37:12.314678] [INFO ] [MAIN ] Derivative Progress: 672/1812 symbols completed. FDS took 1.2s. Estimated remaining: 7m 14s. Rate: 157.8 symbols/min [2025-10-14T22:37:12.315019] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:12.389890] [DEBUG] [LOCAL ] FDX: Loaded 51393 existing records from primary storage. [2025-10-14T22:37:12.390179] [INFO ] [MAIN ] FDX: Loaded 51393 primary data records. [2025-10-14T22:37:12.390849] [DEBUG] [LOCAL ] FE: Loaded 53434 existing records from primary storage. [2025-10-14T22:37:12.390989] [INFO ] [MAIN ] FE: Loaded 53434 primary data records. [2025-10-14T22:37:12.677960] [DEBUG] [LOCAL ] FERG: Loaded 48763 existing records from primary storage. [2025-10-14T22:37:12.720320] [INFO ] [MAIN ] FERG: Loaded 48763 primary data records. [2025-10-14T22:37:13.545054] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:13.547117] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51393 primary records. [2025-10-14T22:37:13.548203] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-14T22:37:13.547689] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:13.550581] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53434 primary records. [2025-10-14T22:37:13.558100] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-14T22:37:13.583136] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-14T22:37:13.583386] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-14T22:37:13.587246] [INFO ] [MAIN ] Derivative Progress: 673/1812 symbols completed. FDX took 1.3s. Estimated remaining: 7m 15s. Rate: 157.2 symbols/min [2025-10-14T22:37:13.591415] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-14T22:37:13.591845] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-14T22:37:13.595421] [INFO ] [MAIN ] Derivative Progress: 674/1812 symbols completed. FE took 1.3s. Estimated remaining: 7m 14s. Rate: 157.4 symbols/min [2025-10-14T22:37:13.616774] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:13.617495] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48763 primary records. [2025-10-14T22:37:13.617560] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-14T22:37:13.635862] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-14T22:37:13.635959] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-14T22:37:13.638760] [INFO ] [MAIN ] Derivative Progress: 675/1812 symbols completed. FERG took 1.3s. Estimated remaining: 7m 13s. Rate: 157.6 symbols/min [2025-10-14T22:37:13.639264] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:13.639546] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:13.639358] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:13.650616] [DEBUG] [LOCAL ] FFA: Loaded 6023 existing records from primary storage. [2025-10-14T22:37:13.651007] [INFO ] [MAIN ] FFA: Loaded 6023 primary data records. [2025-10-14T22:37:13.739039] [DEBUG] [LOCAL ] FET: Loaded 12800 existing records from primary storage. [2025-10-14T22:37:13.755791] [INFO ] [MAIN ] FET: Loaded 12800 primary data records. [2025-10-14T22:37:13.791360] [DEBUG] [LOCAL ] FF: Loaded 24316 existing records from primary storage. [2025-10-14T22:37:13.807373] [INFO ] [MAIN ] FF: Loaded 24316 primary data records. [2025-10-14T22:37:14.664599] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:14.669021] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 6023 primary records. [2025-10-14T22:37:14.669131] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-14T22:37:14.697616] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:14.701572] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24316 primary records. [2025-10-14T22:37:14.702160] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-14T22:37:14.718948] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-14T22:37:14.719377] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-14T22:37:14.728116] [INFO ] [MAIN ] Derivative Progress: 676/1812 symbols completed. FFA took 1.1s. Estimated remaining: 7m 14s. Rate: 157.2 symbols/min [2025-10-14T22:37:14.730018] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:14.730451] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:14.738096] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12800 primary records. [2025-10-14T22:37:14.739815] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-14T22:37:14.741616] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-14T22:37:14.742016] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-14T22:37:14.752077] [INFO ] [MAIN ] Derivative Progress: 677/1812 symbols completed. FF took 1.1s. Estimated remaining: 7m 13s. Rate: 157.4 symbols/min [2025-10-14T22:37:14.752482] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:14.767171] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-14T22:37:14.767329] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-14T22:37:14.769744] [INFO ] [MAIN ] Derivative Progress: 678/1812 symbols completed. FET took 1.1s. Estimated remaining: 7m 12s. Rate: 157.7 symbols/min [2025-10-14T22:37:14.775408] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:14.777267] [DEBUG] [LOCAL ] FFC: Loaded 16759 existing records from primary storage. [2025-10-14T22:37:14.777454] [INFO ] [MAIN ] FFC: Loaded 16759 primary data records. [2025-10-14T22:37:14.983617] [DEBUG] [LOCAL ] FFWM: Loaded 35818 existing records from primary storage. [2025-10-14T22:37:15.005292] [DEBUG] [LOCAL ] FG: Loaded 22259 existing records from primary storage. [2025-10-14T22:37:15.119429] [INFO ] [MAIN ] FG: Loaded 22259 primary data records. [2025-10-14T22:37:15.011587] [INFO ] [MAIN ] FFWM: Loaded 35818 primary data records. [2025-10-14T22:37:15.906457] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:15.908019] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16759 primary records. [2025-10-14T22:37:15.908944] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-14T22:37:15.931185] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-14T22:37:15.932217] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-14T22:37:15.935008] [INFO ] [MAIN ] Derivative Progress: 679/1812 symbols completed. FFC took 1.2s. Estimated remaining: 7m 13s. Rate: 157.2 symbols/min [2025-10-14T22:37:15.935586] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:15.960172] [DEBUG] [LOCAL ] FGN: Loaded 3718 existing records from primary storage. [2025-10-14T22:37:15.961738] [INFO ] [MAIN ] FGN: Loaded 3718 primary data records. [2025-10-14T22:37:15.967964] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:15.983138] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22259 primary records. [2025-10-14T22:37:15.999527] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-14T22:37:16.064844] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:16.090611] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35818 primary records. [2025-10-14T22:37:16.115365] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-14T22:37:16.125106] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-14T22:37:16.137698] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-14T22:37:16.155624] [INFO ] [MAIN ] Derivative Progress: 680/1812 symbols completed. FG took 1.4s. Estimated remaining: 7m 12s. Rate: 157.3 symbols/min [2025-10-14T22:37:16.161387] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:16.347306] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-14T22:37:16.347818] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-14T22:37:16.350752] [INFO ] [MAIN ] Derivative Progress: 681/1812 symbols completed. FFWM took 1.6s. Estimated remaining: 7m 11s. Rate: 157.4 symbols/min [2025-10-14T22:37:16.351205] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:16.389979] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:16.390868] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3718 primary records. [2025-10-14T22:37:16.391102] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-14T22:37:16.408111] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-14T22:37:16.420396] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-14T22:37:16.423242] [INFO ] [MAIN ] Derivative Progress: 682/1812 symbols completed. FGN took 0.5s. Estimated remaining: 7m 10s. Rate: 157.6 symbols/min [2025-10-14T22:37:16.423572] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:16.425509] [DEBUG] [LOCAL ] FHI: Loaded 39897 existing records from primary storage. [2025-10-14T22:37:16.425998] [INFO ] [MAIN ] FHI: Loaded 39897 primary data records. [2025-10-14T22:37:16.626410] [DEBUG] [LOCAL ] FHN: Loaded 53391 existing records from primary storage. [2025-10-14T22:37:16.673506] [INFO ] [MAIN ] FHN: Loaded 53391 primary data records. [2025-10-14T22:37:16.925979] [DEBUG] [LOCAL ] FI: Loaded 53575 existing records from primary storage. [2025-10-14T22:37:16.926805] [INFO ] [MAIN ] FI: Loaded 53575 primary data records. [2025-10-14T22:37:17.484540] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:17.489108] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 39897 primary records. [2025-10-14T22:37:17.489445] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-14T22:37:17.518317] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:17.520264] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53391 primary records. [2025-10-14T22:37:17.520675] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-14T22:37:17.540271] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-14T22:37:17.540574] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-14T22:37:17.543812] [INFO ] [MAIN ] Derivative Progress: 683/1812 symbols completed. FHI took 1.4s. Estimated remaining: 7m 11s. Rate: 157.1 symbols/min [2025-10-14T22:37:17.548308] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-14T22:37:17.548555] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-14T22:37:17.548221] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:17.551899] [INFO ] [MAIN ] Derivative Progress: 684/1812 symbols completed. FHN took 1.2s. Estimated remaining: 7m 10s. Rate: 157.4 symbols/min [2025-10-14T22:37:17.552145] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:17.566379] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:17.567265] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53575 primary records. [2025-10-14T22:37:17.567692] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-14T22:37:17.584809] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-14T22:37:17.585077] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-14T22:37:17.587972] [INFO ] [MAIN ] Derivative Progress: 685/1812 symbols completed. FI took 1.2s. Estimated remaining: 7m 9s. Rate: 157.6 symbols/min [2025-10-14T22:37:17.588407] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:17.618157] [DEBUG] [LOCAL ] FICO: Loaded 21736 existing records from primary storage. [2025-10-14T22:37:17.618402] [INFO ] [MAIN ] FICO: Loaded 21736 primary data records. [2025-10-14T22:37:17.720300] [DEBUG] [LOCAL ] FIGS: Loaded 48563 existing records from primary storage. [2025-10-14T22:37:17.746178] [INFO ] [MAIN ] FIGS: Loaded 48563 primary data records. [2025-10-14T22:37:18.025182] [DEBUG] [LOCAL ] FIHL: Loaded 39429 existing records from primary storage. [2025-10-14T22:37:18.133981] [INFO ] [MAIN ] FIHL: Loaded 39429 primary data records. [2025-10-14T22:37:18.646174] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:18.647308] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 21736 primary records. [2025-10-14T22:37:18.647843] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-14T22:37:18.679906] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-10-14T22:37:18.685853] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-14T22:37:18.685592] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:18.688252] [INFO ] [MAIN ] Derivative Progress: 686/1812 symbols completed. FICO took 1.1s. Estimated remaining: 7m 10s. Rate: 157.1 symbols/min [2025-10-14T22:37:18.689562] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48563 primary records. [2025-10-14T22:37:18.690163] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-14T22:37:18.690045] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:18.717241] [DEBUG] [LOCAL ] FINS: Loaded 8322 existing records from primary storage. [2025-10-14T22:37:18.717561] [INFO ] [MAIN ] FINS: Loaded 8322 primary data records. [2025-10-14T22:37:18.771964] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-14T22:37:18.772437] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:18.792019] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-14T22:37:18.803022] [INFO ] [MAIN ] Derivative Progress: 687/1812 symbols completed. FIGS took 1.3s. Estimated remaining: 7m 9s. Rate: 157.3 symbols/min [2025-10-14T22:37:18.809314] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39429 primary records. [2025-10-14T22:37:18.809515] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:18.826879] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-14T22:37:19.066491] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-14T22:37:19.067264] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-14T22:37:19.069666] [INFO ] [MAIN ] Derivative Progress: 688/1812 symbols completed. FIHL took 1.5s. Estimated remaining: 7m 9s. Rate: 157.4 symbols/min [2025-10-14T22:37:19.105798] [DEBUG] [LOCAL ] FINV: Loaded 45286 existing records from primary storage. [2025-10-14T22:37:19.106205] [INFO ] [MAIN ] FINV: Loaded 45286 primary data records. [2025-10-14T22:37:19.240129] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:19.247087] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8322 primary records. [2025-10-14T22:37:19.252355] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-14T22:37:19.322308] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-14T22:37:19.323543] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-14T22:37:19.327060] [INFO ] [MAIN ] Derivative Progress: 689/1812 symbols completed. FINS took 0.6s. Estimated remaining: 7m 8s. Rate: 157.4 symbols/min [2025-10-14T22:37:19.497636] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:19.498345] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45286 primary records. [2025-10-14T22:37:19.498412] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-14T22:37:19.514609] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-14T22:37:19.514706] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-14T22:37:19.516794] [INFO ] [MAIN ] Derivative Progress: 690/1812 symbols completed. FINV took 0.7s. Estimated remaining: 7m 7s. Rate: 157.5 symbols/min [2025-10-14T22:37:19.517564] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:19.517441] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:19.517754] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:19.527509] [DEBUG] [LOCAL ] FLC: Loaded 5437 existing records from primary storage. [2025-10-14T22:37:19.527723] [INFO ] [MAIN ] FLC: Loaded 5437 primary data records. [2025-10-14T22:37:19.694145] [DEBUG] [LOCAL ] FIX: Loaded 28900 existing records from primary storage. [2025-10-14T22:37:19.715150] [INFO ] [MAIN ] FIX: Loaded 28900 primary data records. [2025-10-14T22:37:20.064457] [DEBUG] [LOCAL ] FIS: Loaded 53343 existing records from primary storage. [2025-10-14T22:37:20.075306] [INFO ] [MAIN ] FIS: Loaded 53343 primary data records. [2025-10-14T22:37:20.573348] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:20.574282] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5437 primary records. [2025-10-14T22:37:20.574430] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-14T22:37:20.598844] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-14T22:37:20.601596] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-14T22:37:20.603902] [INFO ] [MAIN ] Derivative Progress: 691/1812 symbols completed. FLC took 1.1s. Estimated remaining: 7m 8s. Rate: 157.1 symbols/min [2025-10-14T22:37:20.604185] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:20.619435] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:20.620458] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 28900 primary records. [2025-10-14T22:37:20.620740] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-14T22:37:20.654349] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-10-14T22:37:20.655544] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:20.656539] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53343 primary records. [2025-10-14T22:37:20.656767] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-14T22:37:20.660070] [INFO ] [MAIN ] Derivative Progress: 692/1812 symbols completed. FIX took 1.1s. Estimated remaining: 7m 7s. Rate: 157.3 symbols/min [2025-10-14T22:37:20.660428] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:20.660276] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-14T22:37:20.692813] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-14T22:37:20.693149] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-14T22:37:20.695714] [INFO ] [MAIN ] Derivative Progress: 693/1812 symbols completed. FIS took 1.2s. Estimated remaining: 7m 6s. Rate: 157.5 symbols/min [2025-10-14T22:37:20.696136] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:20.717157] [DEBUG] [LOCAL ] FLG: Loaded 53324 existing records from primary storage. [2025-10-14T22:37:20.717550] [INFO ] [MAIN ] FLG: Loaded 53324 primary data records. [2025-10-14T22:37:20.886859] [DEBUG] [LOCAL ] FLNG: Loaded 33716 existing records from primary storage. [2025-10-14T22:37:20.922127] [INFO ] [MAIN ] FLNG: Loaded 33716 primary data records. [2025-10-14T22:37:21.188525] [DEBUG] [LOCAL ] FLO: Loaded 52059 existing records from primary storage. [2025-10-14T22:37:21.194619] [INFO ] [MAIN ] FLO: Loaded 52059 primary data records. [2025-10-14T22:37:21.729314] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:21.731723] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53324 primary records. [2025-10-14T22:37:21.732174] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-14T22:37:21.753319] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-14T22:37:21.753785] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-14T22:37:21.757125] [INFO ] [MAIN ] Derivative Progress: 694/1812 symbols completed. FLG took 1.2s. Estimated remaining: 7m 7s. Rate: 157.1 symbols/min [2025-10-14T22:37:21.763256] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:21.795077] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:21.796784] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 52059 primary records. [2025-10-14T22:37:21.797599] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-14T22:37:21.797490] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:21.799561] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33716 primary records. [2025-10-14T22:37:21.807304] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-14T22:37:21.816542] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-14T22:37:21.817883] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-14T22:37:21.820288] [INFO ] [MAIN ] Derivative Progress: 695/1812 symbols completed. FLO took 1.1s. Estimated remaining: 7m 6s. Rate: 157.3 symbols/min [2025-10-14T22:37:21.832140] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:21.847045] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-14T22:37:21.847246] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-14T22:37:21.850143] [INFO ] [MAIN ] Derivative Progress: 696/1812 symbols completed. FLNG took 1.2s. Estimated remaining: 7m 5s. Rate: 157.5 symbols/min [2025-10-14T22:37:21.850597] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:21.904537] [DEBUG] [LOCAL ] FLR: Loaded 53229 existing records from primary storage. [2025-10-14T22:37:21.905332] [INFO ] [MAIN ] FLR: Loaded 53229 primary data records. [2025-10-14T22:37:22.021588] [DEBUG] [LOCAL ] FLS: Loaded 50337 existing records from primary storage. [2025-10-14T22:37:22.044690] [INFO ] [MAIN ] FLS: Loaded 50337 primary data records. [2025-10-14T22:37:22.184295] [DEBUG] [LOCAL ] FLUT: Loaded 50767 existing records from primary storage. [2025-10-14T22:37:22.247292] [INFO ] [MAIN ] FLUT: Loaded 50767 primary data records. [2025-10-14T22:37:22.969145] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:22.971995] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53229 primary records. [2025-10-14T22:37:22.972401] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-14T22:37:23.007416] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:23.007546] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-14T22:37:23.009321] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-14T22:37:23.010269] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50337 primary records. [2025-10-14T22:37:23.010393] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-14T22:37:23.023059] [INFO ] [MAIN ] Derivative Progress: 697/1812 symbols completed. FLR took 1.3s. Estimated remaining: 7m 6s. Rate: 157.0 symbols/min [2025-10-14T22:37:23.023438] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:23.032524] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-14T22:37:23.040845] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-14T22:37:23.043080] [INFO ] [MAIN ] Derivative Progress: 698/1812 symbols completed. FLS took 1.2s. Estimated remaining: 7m 5s. Rate: 157.3 symbols/min [2025-10-14T22:37:23.048534] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:23.049557] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:23.050495] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50767 primary records. [2025-10-14T22:37:23.050733] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-14T22:37:23.075062] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-14T22:37:23.082678] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-14T22:37:23.086029] [INFO ] [MAIN ] Derivative Progress: 699/1812 symbols completed. FLUT took 1.2s. Estimated remaining: 7m 4s. Rate: 157.5 symbols/min [2025-10-14T22:37:23.086875] [DEBUG] [LOCAL ] FLXR: Loaded 20956 existing records from primary storage. [2025-10-14T22:37:23.087129] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:23.087323] [INFO ] [MAIN ] FLXR: Loaded 20956 primary data records. [2025-10-14T22:37:23.225831] [DEBUG] [LOCAL ] FMN: Loaded 5384 existing records from primary storage. [2025-10-14T22:37:23.242289] [INFO ] [MAIN ] FMN: Loaded 5384 primary data records. [2025-10-14T22:37:23.326294] [DEBUG] [LOCAL ] FMC: Loaded 51832 existing records from primary storage. [2025-10-14T22:37:23.476121] [INFO ] [MAIN ] FMC: Loaded 51832 primary data records. [2025-10-14T22:37:24.176425] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:24.177380] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20956 primary records. [2025-10-14T22:37:24.177541] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-14T22:37:24.195580] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-14T22:37:24.196612] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-14T22:37:24.198526] [INFO ] [MAIN ] Derivative Progress: 700/1812 symbols completed. FLXR took 1.2s. Estimated remaining: 7m 5s. Rate: 157.0 symbols/min [2025-10-14T22:37:24.198950] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:24.212818] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:24.215143] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5384 primary records. [2025-10-14T22:37:24.215265] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-14T22:37:24.234732] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-14T22:37:24.251506] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-14T22:37:24.262812] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:24.267398] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51832 primary records. [2025-10-14T22:37:24.267566] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-14T22:37:24.266190] [INFO ] [MAIN ] Derivative Progress: 701/1812 symbols completed. FMN took 1.2s. Estimated remaining: 7m 4s. Rate: 157.2 symbols/min [2025-10-14T22:37:24.268524] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:24.294314] [DEBUG] [LOCAL ] FMS: Loaded 30222 existing records from primary storage. [2025-10-14T22:37:24.295198] [INFO ] [MAIN ] FMS: Loaded 30222 primary data records. [2025-10-14T22:37:24.312164] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-14T22:37:24.317568] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-14T22:37:24.326994] [INFO ] [MAIN ] Derivative Progress: 702/1812 symbols completed. FMC took 1.3s. Estimated remaining: 7m 3s. Rate: 157.4 symbols/min [2025-10-14T22:37:24.327258] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:24.392156] [DEBUG] [LOCAL ] FMY: Loaded 1390 existing records from primary storage. [2025-10-14T22:37:24.420409] [INFO ] [MAIN ] FMY: Loaded 1390 primary data records. [2025-10-14T22:37:24.600434] [DEBUG] [LOCAL ] FMX: Loaded 40494 existing records from primary storage. [2025-10-14T22:37:24.636838] [INFO ] [MAIN ] FMX: Loaded 40494 primary data records. [2025-10-14T22:37:25.305052] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:25.306856] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30222 primary records. [2025-10-14T22:37:25.307510] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-14T22:37:25.330323] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-14T22:37:25.330615] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-14T22:37:25.340146] [INFO ] [MAIN ] Derivative Progress: 703/1812 symbols completed. FMS took 1.1s. Estimated remaining: 7m 4s. Rate: 157.0 symbols/min [2025-10-14T22:37:25.345577] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-14T22:37:25.346552] [INFO ] [MAIN ] FMY: Generated 1789 derivative records from 1390 primary records. [2025-10-14T22:37:25.346785] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-14T22:37:25.367430] [DEBUG] [LOCAL ] FMY: Derivative data saved (1789 records). [2025-10-14T22:37:25.379946] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-14T22:37:25.383708] [INFO ] [MAIN ] Derivative Progress: 704/1812 symbols completed. FMY took 1.1s. Estimated remaining: 7m 3s. Rate: 157.2 symbols/min [2025-10-14T22:37:25.383962] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:25.385322] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40494 primary records. [2025-10-14T22:37:25.385415] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-14T22:37:25.401431] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-14T22:37:25.401509] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-14T22:37:25.403764] [INFO ] [MAIN ] Derivative Progress: 705/1812 symbols completed. FMX took 1.1s. Estimated remaining: 7m 2s. Rate: 157.4 symbols/min [2025-10-14T22:37:25.404205] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:25.404362] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:25.405025] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:25.474422] [DEBUG] [LOCAL ] FN: Loaded 37848 existing records from primary storage. [2025-10-14T22:37:25.474676] [INFO ] [MAIN ] FN: Loaded 37848 primary data records. [2025-10-14T22:37:25.617242] [DEBUG] [LOCAL ] FNB: Loaded 52591 existing records from primary storage. [2025-10-14T22:37:25.634278] [INFO ] [MAIN ] FNB: Loaded 52591 primary data records. [2025-10-14T22:37:25.618536] [DEBUG] [LOCAL ] FND: Loaded 52153 existing records from primary storage. [2025-10-14T22:37:25.687062] [INFO ] [MAIN ] FND: Loaded 52153 primary data records. [2025-10-14T22:37:26.571050] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:26.572517] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 37848 primary records. [2025-10-14T22:37:26.573097] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-14T22:37:26.598451] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-14T22:37:26.604758] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-14T22:37:26.621437] [INFO ] [MAIN ] Derivative Progress: 706/1812 symbols completed. FN took 1.2s. Estimated remaining: 7m 3s. Rate: 157.0 symbols/min [2025-10-14T22:37:26.622389] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:26.625189] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52591 primary records. [2025-10-14T22:37:26.623911] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:26.626966] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-14T22:37:26.667486] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:26.669839] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52153 primary records. [2025-10-14T22:37:26.670067] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-14T22:37:26.690257] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-14T22:37:26.694890] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-14T22:37:26.699078] [INFO ] [MAIN ] Derivative Progress: 707/1812 symbols completed. FNB took 1.3s. Estimated remaining: 7m 2s. Rate: 157.1 symbols/min [2025-10-14T22:37:26.696620] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-14T22:37:26.699477] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-14T22:37:26.699601] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:26.703310] [INFO ] [MAIN ] Derivative Progress: 708/1812 symbols completed. FND took 1.3s. Estimated remaining: 7m 1s. Rate: 157.4 symbols/min [2025-10-14T22:37:26.703778] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:26.735965] [DEBUG] [LOCAL ] FOA: Loaded 13105 existing records from primary storage. [2025-10-14T22:37:26.736142] [INFO ] [MAIN ] FOA: Loaded 13105 primary data records. [2025-10-14T22:37:26.892844] [DEBUG] [LOCAL ] FNF: Loaded 48980 existing records from primary storage. [2025-10-14T22:37:26.952252] [INFO ] [MAIN ] FNF: Loaded 48980 primary data records. [2025-10-14T22:37:26.955401] [DEBUG] [LOCAL ] FNV: Loaded 46127 existing records from primary storage. [2025-10-14T22:37:27.022414] [INFO ] [MAIN ] FNV: Loaded 46127 primary data records. [2025-10-14T22:37:27.896138] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:27.900429] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13105 primary records. [2025-10-14T22:37:27.900942] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-14T22:37:27.936237] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-14T22:37:27.936995] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:27.938313] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48980 primary records. [2025-10-14T22:37:27.939334] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-14T22:37:27.942627] [INFO ] [MAIN ] Derivative Progress: 709/1812 symbols completed. FOA took 1.2s. Estimated remaining: 7m 2s. Rate: 156.9 symbols/min [2025-10-14T22:37:27.939444] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-14T22:37:27.943018] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:27.969883] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:27.974111] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46127 primary records. [2025-10-14T22:37:27.974245] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-14T22:37:27.996860] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-14T22:37:27.989833] [DEBUG] [LOCAL ] FOF: Loaded 8607 existing records from primary storage. [2025-10-14T22:37:27.997382] [INFO ] [MAIN ] FOF: Loaded 8607 primary data records. [2025-10-14T22:37:27.997513] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-14T22:37:27.997271] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-14T22:37:28.005212] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-14T22:37:27.999919] [INFO ] [MAIN ] Derivative Progress: 710/1812 symbols completed. FNV took 1.3s. Estimated remaining: 7m 1s. Rate: 157.0 symbols/min [2025-10-14T22:37:28.039216] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:28.039471] [INFO ] [MAIN ] Derivative Progress: 711/1812 symbols completed. FNF took 1.4s. Estimated remaining: 7m 0s. Rate: 157.2 symbols/min [2025-10-14T22:37:28.046706] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:28.328185] [DEBUG] [LOCAL ] FOR: Loaded 19838 existing records from primary storage. [2025-10-14T22:37:28.328395] [INFO ] [MAIN ] FOR: Loaded 19838 primary data records. [2025-10-14T22:37:28.465289] [DEBUG] [LOCAL ] FOUR: Loaded 49680 existing records from primary storage. [2025-10-14T22:37:28.513373] [INFO ] [MAIN ] FOUR: Loaded 49680 primary data records. [2025-10-14T22:37:29.053593] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:29.054626] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8607 primary records. [2025-10-14T22:37:29.054766] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-14T22:37:29.077427] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-14T22:37:29.077887] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-14T22:37:29.080104] [INFO ] [MAIN ] Derivative Progress: 712/1812 symbols completed. FOF took 1.1s. Estimated remaining: 7m 1s. Rate: 156.9 symbols/min [2025-10-14T22:37:29.080401] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:29.118850] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:29.125738] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:29.125473] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19838 primary records. [2025-10-14T22:37:29.126705] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49680 primary records. [2025-10-14T22:37:29.126887] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-14T22:37:29.127554] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-14T22:37:29.155850] [DEBUG] [LOCAL ] FPF: Loaded 18807 existing records from primary storage. [2025-10-14T22:37:29.159753] [INFO ] [MAIN ] FPF: Loaded 18807 primary data records. [2025-10-14T22:37:29.243137] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-14T22:37:29.275325] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-14T22:37:29.275875] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-14T22:37:29.291036] [INFO ] [MAIN ] Derivative Progress: 713/1812 symbols completed. FOR took 1.3s. Estimated remaining: 7m 0s. Rate: 157.0 symbols/min [2025-10-14T22:37:29.291210] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-14T22:37:29.293388] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:29.293504] [INFO ] [MAIN ] Derivative Progress: 714/1812 symbols completed. FOUR took 1.2s. Estimated remaining: 6m 59s. Rate: 157.2 symbols/min [2025-10-14T22:37:29.300128] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:29.515913] [DEBUG] [LOCAL ] FPH: Loaded 19342 existing records from primary storage. [2025-10-14T22:37:29.516313] [INFO ] [MAIN ] FPH: Loaded 19342 primary data records. [2025-10-14T22:37:29.651487] [DEBUG] [LOCAL ] FPI: Loaded 31275 existing records from primary storage. [2025-10-14T22:37:29.652548] [INFO ] [MAIN ] FPI: Loaded 31275 primary data records. [2025-10-14T22:37:30.198295] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:30.199195] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18807 primary records. [2025-10-14T22:37:30.199311] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-14T22:37:30.221790] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-14T22:37:30.223021] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-14T22:37:30.226988] [INFO ] [MAIN ] Derivative Progress: 715/1812 symbols completed. FPF took 1.1s. Estimated remaining: 6m 60s. Rate: 156.9 symbols/min [2025-10-14T22:37:30.228147] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:30.243216] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:30.244267] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19342 primary records. [2025-10-14T22:37:30.244527] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-14T22:37:30.262794] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-14T22:37:30.263046] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-14T22:37:30.265199] [INFO ] [MAIN ] Derivative Progress: 716/1812 symbols completed. FPH took 1.0s. Estimated remaining: 6m 59s. Rate: 157.1 symbols/min [2025-10-14T22:37:30.265729] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:30.285035] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:30.285894] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31275 primary records. [2025-10-14T22:37:30.286176] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-14T22:37:30.319115] [DEBUG] [LOCAL ] FRA: Loaded 14371 existing records from primary storage. [2025-10-14T22:37:30.320473] [INFO ] [MAIN ] FRA: Loaded 14371 primary data records. [2025-10-14T22:37:30.384967] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-14T22:37:30.415377] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-14T22:37:30.440860] [DEBUG] [LOCAL ] FR: Loaded 46500 existing records from primary storage. [2025-10-14T22:37:30.447056] [INFO ] [MAIN ] FR: Loaded 46500 primary data records. [2025-10-14T22:37:30.446780] [INFO ] [MAIN ] Derivative Progress: 717/1812 symbols completed. FPI took 1.1s. Estimated remaining: 6m 58s. Rate: 157.2 symbols/min [2025-10-14T22:37:30.501040] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:30.859871] [DEBUG] [LOCAL ] FRGE: Loaded 16201 existing records from primary storage. [2025-10-14T22:37:30.972153] [INFO ] [MAIN ] FRGE: Loaded 16201 primary data records. [2025-10-14T22:37:31.306089] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:31.308584] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14371 primary records. [2025-10-14T22:37:31.309953] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-14T22:37:31.331420] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:31.337409] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46500 primary records. [2025-10-14T22:37:31.340484] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-14T22:37:31.340815] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-14T22:37:31.340978] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-14T22:37:31.342985] [INFO ] [MAIN ] Derivative Progress: 718/1812 symbols completed. FRA took 1.1s. Estimated remaining: 6m 58s. Rate: 156.9 symbols/min [2025-10-14T22:37:31.375036] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:31.374765] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-14T22:37:31.375791] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 16201 primary records. [2025-10-14T22:37:31.375852] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-14T22:37:31.376194] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-14T22:37:31.378386] [INFO ] [MAIN ] Derivative Progress: 719/1812 symbols completed. FR took 1.2s. Estimated remaining: 6m 58s. Rate: 157.1 symbols/min [2025-10-14T22:37:31.394517] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-14T22:37:31.394618] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-14T22:37:31.396589] [INFO ] [MAIN ] Derivative Progress: 720/1812 symbols completed. FRGE took 0.9s. Estimated remaining: 6m 57s. Rate: 157.3 symbols/min [2025-10-14T22:37:31.397058] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:31.396981] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:31.397841] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:31.455406] [DEBUG] [LOCAL ] FSCO: Loaded 38493 existing records from primary storage. [2025-10-14T22:37:31.455711] [INFO ] [MAIN ] FSCO: Loaded 38493 primary data records. [2025-10-14T22:37:31.550968] [DEBUG] [LOCAL ] FRT: Loaded 41743 existing records from primary storage. [2025-10-14T22:37:31.587784] [INFO ] [MAIN ] FRT: Loaded 41743 primary data records. [2025-10-14T22:37:31.594416] [DEBUG] [LOCAL ] FRO: Loaded 51699 existing records from primary storage. [2025-10-14T22:37:31.606290] [INFO ] [MAIN ] FRO: Loaded 51699 primary data records. [2025-10-14T22:37:32.501397] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:32.502509] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 38493 primary records. [2025-10-14T22:37:32.502717] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-14T22:37:32.531205] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-14T22:37:32.558245] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:32.552554] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-14T22:37:32.559669] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41743 primary records. [2025-10-14T22:37:32.559881] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-14T22:37:32.558897] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:32.562199] [INFO ] [MAIN ] Derivative Progress: 721/1812 symbols completed. FSCO took 1.2s. Estimated remaining: 6m 57s. Rate: 156.8 symbols/min [2025-10-14T22:37:32.563768] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51699 primary records. [2025-10-14T22:37:32.564306] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:32.564591] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-14T22:37:32.594406] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-14T22:37:32.594805] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-14T22:37:32.598040] [INFO ] [MAIN ] Derivative Progress: 722/1812 symbols completed. FRO took 1.2s. Estimated remaining: 6m 56s. Rate: 157.0 symbols/min [2025-10-14T22:37:32.598703] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:32.600202] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-14T22:37:32.600387] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-14T22:37:32.603677] [INFO ] [MAIN ] Derivative Progress: 723/1812 symbols completed. FRT took 1.2s. Estimated remaining: 6m 56s. Rate: 157.2 symbols/min [2025-10-14T22:37:32.603940] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:32.661437] [DEBUG] [LOCAL ] FSK: Loaded 49496 existing records from primary storage. [2025-10-14T22:37:32.661744] [INFO ] [MAIN ] FSK: Loaded 49496 primary data records. [2025-10-14T22:37:32.797036] [DEBUG] [LOCAL ] FSLY: Loaded 51306 existing records from primary storage. [2025-10-14T22:37:32.811323] [INFO ] [MAIN ] FSLY: Loaded 51306 primary data records. [2025-10-14T22:37:32.877349] [DEBUG] [LOCAL ] FSM: Loaded 53300 existing records from primary storage. [2025-10-14T22:37:32.931370] [INFO ] [MAIN ] FSM: Loaded 53300 primary data records. [2025-10-14T22:37:33.682002] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:33.683495] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49496 primary records. [2025-10-14T22:37:33.684440] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-14T22:37:33.720618] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:33.725926] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-14T22:37:33.727609] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51306 primary records. [2025-10-14T22:37:33.728140] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-14T22:37:33.727727] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-14T22:37:33.730205] [INFO ] [MAIN ] Derivative Progress: 724/1812 symbols completed. FSK took 1.2s. Estimated remaining: 6m 56s. Rate: 156.8 symbols/min [2025-10-14T22:37:33.738761] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:33.755894] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:33.760614] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53300 primary records. [2025-10-14T22:37:33.760726] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-14T22:37:33.767816] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-14T22:37:33.768379] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-14T22:37:33.777823] [INFO ] [MAIN ] Derivative Progress: 725/1812 symbols completed. FSLY took 1.2s. Estimated remaining: 6m 55s. Rate: 157.0 symbols/min [2025-10-14T22:37:33.783619] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:33.788843] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-14T22:37:33.789001] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-14T22:37:33.791230] [INFO ] [MAIN ] Derivative Progress: 726/1812 symbols completed. FSM took 1.2s. Estimated remaining: 6m 54s. Rate: 157.2 symbols/min [2025-10-14T22:37:33.791438] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:33.808910] [DEBUG] [LOCAL ] FT: Loaded 6802 existing records from primary storage. [2025-10-14T22:37:33.809142] [INFO ] [MAIN ] FT: Loaded 6802 primary data records. [2025-10-14T22:37:33.935869] [DEBUG] [LOCAL ] FTHY: Loaded 12287 existing records from primary storage. [2025-10-14T22:37:33.955291] [INFO ] [MAIN ] FTHY: Loaded 12287 primary data records. [2025-10-14T22:37:33.917152] [DEBUG] [LOCAL ] FSS: Loaded 33656 existing records from primary storage. [2025-10-14T22:37:33.968158] [INFO ] [MAIN ] FSS: Loaded 33656 primary data records. [2025-10-14T22:37:34.888437] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:34.889962] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6802 primary records. [2025-10-14T22:37:34.890128] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-14T22:37:34.927249] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-14T22:37:34.928505] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:34.929924] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12287 primary records. [2025-10-14T22:37:34.938351] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-14T22:37:34.930023] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-14T22:37:34.946673] [INFO ] [MAIN ] Derivative Progress: 727/1812 symbols completed. FT took 1.2s. Estimated remaining: 6m 55s. Rate: 156.8 symbols/min [2025-10-14T22:37:34.947945] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:34.947799] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:34.949829] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33656 primary records. [2025-10-14T22:37:34.956878] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-14T22:37:34.980395] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-14T22:37:34.980924] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-14T22:37:34.985953] [INFO ] [MAIN ] Derivative Progress: 728/1812 symbols completed. FTHY took 1.2s. Estimated remaining: 6m 54s. Rate: 157.0 symbols/min [2025-10-14T22:37:34.987780] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:34.990019] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-14T22:37:34.990259] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-14T22:37:34.993236] [INFO ] [MAIN ] Derivative Progress: 729/1812 symbols completed. FSS took 1.3s. Estimated remaining: 6m 53s. Rate: 157.2 symbols/min [2025-10-14T22:37:34.993618] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:35.045525] [DEBUG] [LOCAL ] FTI: Loaded 53300 existing records from primary storage. [2025-10-14T22:37:35.045866] [INFO ] [MAIN ] FTI: Loaded 53300 primary data records. [2025-10-14T22:37:35.210344] [DEBUG] [LOCAL ] FTS: Loaded 42555 existing records from primary storage. [2025-10-14T22:37:35.203907] [DEBUG] [LOCAL ] FTK: Loaded 32864 existing records from primary storage. [2025-10-14T22:37:35.215615] [INFO ] [MAIN ] FTS: Loaded 42555 primary data records. [2025-10-14T22:37:35.215751] [INFO ] [MAIN ] FTK: Loaded 32864 primary data records. [2025-10-14T22:37:36.021268] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:36.022192] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53300 primary records. [2025-10-14T22:37:36.022443] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-14T22:37:36.054297] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:36.056255] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32864 primary records. [2025-10-14T22:37:36.056523] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-14T22:37:36.056571] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-14T22:37:36.057139] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-14T22:37:36.059555] [INFO ] [MAIN ] Derivative Progress: 730/1812 symbols completed. FTI took 1.1s. Estimated remaining: 6m 54s. Rate: 156.8 symbols/min [2025-10-14T22:37:36.067774] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:36.091024] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-14T22:37:36.090923] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:36.091973] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42555 primary records. [2025-10-14T22:37:36.091320] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-14T22:37:36.095710] [INFO ] [MAIN ] Derivative Progress: 731/1812 symbols completed. FTK took 1.1s. Estimated remaining: 6m 53s. Rate: 157.0 symbols/min [2025-10-14T22:37:36.095953] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:36.095852] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-14T22:37:36.119667] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-14T22:37:36.117736] [DEBUG] [LOCAL ] FTWO: Loaded 1904 existing records from primary storage. [2025-10-14T22:37:36.120030] [INFO ] [MAIN ] FTWO: Loaded 1904 primary data records. [2025-10-14T22:37:36.120137] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-14T22:37:36.142884] [INFO ] [MAIN ] Derivative Progress: 732/1812 symbols completed. FTS took 1.1s. Estimated remaining: 6m 52s. Rate: 157.2 symbols/min [2025-10-14T22:37:36.165114] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:36.452893] [DEBUG] [LOCAL ] FTV: Loaded 53038 existing records from primary storage. [2025-10-14T22:37:36.453231] [INFO ] [MAIN ] FTV: Loaded 53038 primary data records. [2025-10-14T22:37:36.655774] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-14T22:37:36.807590] [INFO ] [MAIN ] FUBO: Loaded 53718 primary data records. [2025-10-14T22:37:36.974258] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:37:37.022335] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1904 primary records. [2025-10-14T22:37:37.144147] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-14T22:37:37.159830] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-14T22:37:37.160471] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-14T22:37:37.162789] [INFO ] [MAIN ] Derivative Progress: 733/1812 symbols completed. FTWO took 1.1s. Estimated remaining: 6m 53s. Rate: 156.8 symbols/min [2025-10-14T22:37:37.181604] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:37.182425] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 53038 primary records. [2025-10-14T22:37:37.182619] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-14T22:37:37.199940] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-14T22:37:37.200161] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-14T22:37:37.202431] [INFO ] [MAIN ] Derivative Progress: 734/1812 symbols completed. FTV took 1.1s. Estimated remaining: 6m 52s. Rate: 157.0 symbols/min [2025-10-14T22:37:37.217630] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:37.218235] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53718 primary records. [2025-10-14T22:37:37.218295] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-14T22:37:37.232801] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-14T22:37:37.232855] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-14T22:37:37.234876] [INFO ] [MAIN ] Derivative Progress: 735/1812 symbols completed. FUBO took 1.1s. Estimated remaining: 6m 51s. Rate: 157.2 symbols/min [2025-10-14T22:37:37.235289] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:37.235228] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:37.235421] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:37.260437] [DEBUG] [LOCAL ] FVR: Loaded 21188 existing records from primary storage. [2025-10-14T22:37:37.260564] [INFO ] [MAIN ] FVR: Loaded 21188 primary data records. [2025-10-14T22:37:37.492793] [DEBUG] [LOCAL ] FUL: Loaded 32507 existing records from primary storage. [2025-10-14T22:37:37.492993] [INFO ] [MAIN ] FUL: Loaded 32507 primary data records. [2025-10-14T22:37:37.493672] [DEBUG] [LOCAL ] FUN: Loaded 51869 existing records from primary storage. [2025-10-14T22:37:37.571758] [INFO ] [MAIN ] FUN: Loaded 51869 primary data records. [2025-10-14T22:37:38.216450] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:38.217221] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21188 primary records. [2025-10-14T22:37:38.217483] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-14T22:37:38.234790] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-14T22:37:38.235772] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-14T22:37:38.238388] [INFO ] [MAIN ] Derivative Progress: 736/1812 symbols completed. FVR took 1.0s. Estimated remaining: 6m 52s. Rate: 156.9 symbols/min [2025-10-14T22:37:38.238551] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:38.254512] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:38.267438] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:38.271202] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51869 primary records. [2025-10-14T22:37:38.271397] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-14T22:37:38.267165] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32507 primary records. [2025-10-14T22:37:38.271510] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-14T22:37:38.301044] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-14T22:37:38.302200] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-14T22:37:38.304863] [INFO ] [MAIN ] Derivative Progress: 737/1812 symbols completed. FUN took 1.1s. Estimated remaining: 6m 51s. Rate: 157.0 symbols/min [2025-10-14T22:37:38.314442] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:38.317223] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-14T22:37:38.317708] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-14T22:37:38.319771] [INFO ] [MAIN ] Derivative Progress: 738/1812 symbols completed. FUL took 1.1s. Estimated remaining: 6m 50s. Rate: 157.3 symbols/min [2025-10-14T22:37:38.320048] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:38.322838] [DEBUG] [LOCAL ] FXED: Loaded 1253 existing records from primary storage. [2025-10-14T22:37:38.322975] [INFO ] [MAIN ] FXED: Loaded 1253 primary data records. [2025-10-14T22:37:38.389584] [DEBUG] [LOCAL ] FVRR: Loaded 40624 existing records from primary storage. [2025-10-14T22:37:38.410399] [INFO ] [MAIN ] FVRR: Loaded 40624 primary data records. [2025-10-14T22:37:39.006901] [DEBUG] [LOCAL ] G: Loaded 50036 existing records from primary storage. [2025-10-14T22:37:39.007199] [INFO ] [MAIN ] G: Loaded 50036 primary data records. [2025-10-14T22:37:39.331404] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:37:39.333103] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1253 primary records. [2025-10-14T22:37:39.335091] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-14T22:37:39.355522] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:39.357564] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40624 primary records. [2025-10-14T22:37:39.360335] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-14T22:37:39.377508] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-10-14T22:37:39.378252] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-14T22:37:39.382987] [INFO ] [MAIN ] Derivative Progress: 739/1812 symbols completed. FXED took 1.1s. Estimated remaining: 6m 50s. Rate: 156.9 symbols/min [2025-10-14T22:37:39.380625] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-14T22:37:39.383137] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-14T22:37:39.385727] [INFO ] [MAIN ] Derivative Progress: 740/1812 symbols completed. FVRR took 1.1s. Estimated remaining: 6m 49s. Rate: 157.1 symbols/min [2025-10-14T22:37:39.385552] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:39.386514] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:39.396199] [DEBUG] [LOCAL ] GAM: Loaded 3927 existing records from primary storage. [2025-10-14T22:37:39.409079] [INFO ] [MAIN ] GAM: Loaded 3927 primary data records. [2025-10-14T22:37:39.409005] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:39.421138] [INFO ] [MAIN ] G: Generated 1794 derivative records from 50036 primary records. [2025-10-14T22:37:39.441213] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-14T22:37:39.519008] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-14T22:37:39.533674] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-14T22:37:39.548155] [DEBUG] [LOCAL ] GAB: Loaded 27719 existing records from primary storage. [2025-10-14T22:37:39.547469] [INFO ] [MAIN ] Derivative Progress: 741/1812 symbols completed. G took 1.2s. Estimated remaining: 6m 49s. Rate: 157.2 symbols/min [2025-10-14T22:37:39.548348] [INFO ] [MAIN ] GAB: Loaded 27719 primary data records. [2025-10-14T22:37:39.548953] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:40.086908] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-14T22:37:40.088443] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-14T22:37:40.135462] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:40.141730] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 3927 primary records. [2025-10-14T22:37:40.148549] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-14T22:37:40.207792] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-14T22:37:40.214055] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-14T22:37:40.227192] [INFO ] [MAIN ] Derivative Progress: 742/1812 symbols completed. GAM took 0.8s. Estimated remaining: 6m 49s. Rate: 157.0 symbols/min [2025-10-14T22:37:40.227568] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:40.482410] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:40.483199] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27719 primary records. [2025-10-14T22:37:40.483346] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-14T22:37:40.506205] [DEBUG] [LOCAL ] GATX: Loaded 18097 existing records from primary storage. [2025-10-14T22:37:40.509105] [INFO ] [MAIN ] GATX: Loaded 18097 primary data records. [2025-10-14T22:37:40.517197] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-14T22:37:40.517481] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-14T22:37:40.527373] [INFO ] [MAIN ] Derivative Progress: 743/1812 symbols completed. GAB took 1.1s. Estimated remaining: 6m 48s. Rate: 157.1 symbols/min [2025-10-14T22:37:40.527532] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:40.688606] [DEBUG] [LOCAL ] GBAB: Loaded 12962 existing records from primary storage. [2025-10-14T22:37:40.725482] [INFO ] [MAIN ] GBAB: Loaded 12962 primary data records. [2025-10-14T22:37:40.978027] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:41.028004] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-14T22:37:41.058053] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-14T22:37:41.190350] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-14T22:37:41.191066] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-14T22:37:41.193041] [INFO ] [MAIN ] Derivative Progress: 744/1812 symbols completed. GAP took 1.6s. Estimated remaining: 6m 48s. Rate: 156.9 symbols/min [2025-10-14T22:37:41.193366] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:41.213163] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:41.214200] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18097 primary records. [2025-10-14T22:37:41.214443] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-14T22:37:41.233994] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-14T22:37:41.234744] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-14T22:37:41.237020] [INFO ] [MAIN ] Derivative Progress: 745/1812 symbols completed. GATX took 1.0s. Estimated remaining: 6m 47s. Rate: 157.1 symbols/min [2025-10-14T22:37:41.237273] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:41.251861] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:41.252517] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 12962 primary records. [2025-10-14T22:37:41.252670] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-14T22:37:41.279164] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-14T22:37:41.290593] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-14T22:37:41.292864] [INFO ] [MAIN ] Derivative Progress: 746/1812 symbols completed. GBAB took 0.8s. Estimated remaining: 6m 47s. Rate: 157.3 symbols/min [2025-10-14T22:37:41.293042] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:41.293752] [DEBUG] [LOCAL ] GBCI: Loaded 40713 existing records from primary storage. [2025-10-14T22:37:41.304148] [INFO ] [MAIN ] GBCI: Loaded 40713 primary data records. [2025-10-14T22:37:41.432276] [DEBUG] [LOCAL ] GBTG: Loaded 40171 existing records from primary storage. [2025-10-14T22:37:41.449006] [INFO ] [MAIN ] GBTG: Loaded 40171 primary data records. [2025-10-14T22:37:41.704774] [DEBUG] [LOCAL ] GBX: Loaded 28986 existing records from primary storage. [2025-10-14T22:37:41.728411] [INFO ] [MAIN ] GBX: Loaded 28986 primary data records. [2025-10-14T22:37:42.253954] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:42.255319] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40713 primary records. [2025-10-14T22:37:42.255561] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-14T22:37:42.273676] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-14T22:37:42.273868] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-14T22:37:42.275990] [INFO ] [MAIN ] Derivative Progress: 747/1812 symbols completed. GBCI took 1.1s. Estimated remaining: 6m 47s. Rate: 157.0 symbols/min [2025-10-14T22:37:42.277316] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:42.295758] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:42.298166] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40171 primary records. [2025-10-14T22:37:42.298566] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-14T22:37:42.323566] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:42.324975] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 28986 primary records. [2025-10-14T22:37:42.325779] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-14T22:37:42.350441] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-14T22:37:42.351839] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-14T22:37:42.355710] [INFO ] [MAIN ] Derivative Progress: 748/1812 symbols completed. GBTG took 1.1s. Estimated remaining: 6m 46s. Rate: 157.1 symbols/min [2025-10-14T22:37:42.357050] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-14T22:37:42.357128] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-14T22:37:42.359264] [INFO ] [MAIN ] Derivative Progress: 749/1812 symbols completed. GBX took 1.1s. Estimated remaining: 6m 45s. Rate: 157.3 symbols/min [2025-10-14T22:37:42.373254] [DEBUG] [LOCAL ] GCI: Loaded 43904 existing records from primary storage. [2025-10-14T22:37:42.373412] [INFO ] [MAIN ] GCI: Loaded 43904 primary data records. [2025-10-14T22:37:42.699467] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:42.700597] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 43904 primary records. [2025-10-14T22:37:42.700684] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-14T22:37:42.716767] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-14T22:37:42.716869] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-14T22:37:42.719039] [INFO ] [MAIN ] Derivative Progress: 750/1812 symbols completed. GCI took 0.4s. Estimated remaining: 6m 45s. Rate: 157.4 symbols/min [2025-10-14T22:37:42.719782] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:42.719680] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:42.720011] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:42.730265] [DEBUG] [LOCAL ] GCV: Loaded 7738 existing records from primary storage. [2025-10-14T22:37:42.730458] [INFO ] [MAIN ] GCV: Loaded 7738 primary data records. [2025-10-14T22:37:42.840796] [DEBUG] [LOCAL ] GCTS: Loaded 20462 existing records from primary storage. [2025-10-14T22:37:42.843953] [INFO ] [MAIN ] GCTS: Loaded 20462 primary data records. [2025-10-14T22:37:43.042448] [DEBUG] [LOCAL ] GD: Loaded 46751 existing records from primary storage. [2025-10-14T22:37:43.161418] [INFO ] [MAIN ] GD: Loaded 46751 primary data records. [2025-10-14T22:37:43.670119] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:43.671077] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7738 primary records. [2025-10-14T22:37:43.671225] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-14T22:37:43.690497] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-14T22:37:43.698513] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-14T22:37:43.705405] [INFO ] [MAIN ] Derivative Progress: 751/1812 symbols completed. GCV took 1.0s. Estimated remaining: 6m 45s. Rate: 157.0 symbols/min [2025-10-14T22:37:43.705901] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:43.705797] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:43.707258] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20462 primary records. [2025-10-14T22:37:43.707448] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-14T22:37:43.738367] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:43.739234] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-14T22:37:43.739352] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-14T22:37:43.742504] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46751 primary records. [2025-10-14T22:37:43.741583] [INFO ] [MAIN ] Derivative Progress: 752/1812 symbols completed. GCTS took 1.0s. Estimated remaining: 6m 45s. Rate: 157.2 symbols/min [2025-10-14T22:37:43.742699] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:43.742820] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-14T22:37:43.771912] [DEBUG] [LOCAL ] GDIV: Loaded 3599 existing records from primary storage. [2025-10-14T22:37:43.772913] [INFO ] [MAIN ] GDIV: Loaded 3599 primary data records. [2025-10-14T22:37:43.784522] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-14T22:37:43.804443] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-14T22:37:43.852675] [INFO ] [MAIN ] Derivative Progress: 753/1812 symbols completed. GD took 1.1s. Estimated remaining: 6m 44s. Rate: 157.4 symbols/min [2025-10-14T22:37:43.877171] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:43.902190] [DEBUG] [LOCAL ] GDDY: Loaded 49797 existing records from primary storage. [2025-10-14T22:37:43.908099] [INFO ] [MAIN ] GDDY: Loaded 49797 primary data records. [2025-10-14T22:37:43.987159] [DEBUG] [LOCAL ] GDL: Loaded 2513 existing records from primary storage. [2025-10-14T22:37:44.058162] [INFO ] [MAIN ] GDL: Loaded 2513 primary data records. [2025-10-14T22:37:44.785930] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:37:44.803185] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:44.802360] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3599 primary records. [2025-10-14T22:37:44.804332] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49797 primary records. [2025-10-14T22:37:44.812135] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-14T22:37:44.817056] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-14T22:37:44.818110] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:37:44.819342] [INFO ] [MAIN ] GDL: Generated 1793 derivative records from 2513 primary records. [2025-10-14T22:37:44.820744] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-14T22:37:44.846978] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-14T22:37:44.851150] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-14T22:37:44.853823] [INFO ] [MAIN ] Derivative Progress: 754/1812 symbols completed. GDDY took 1.1s. Estimated remaining: 6m 44s. Rate: 157.0 symbols/min [2025-10-14T22:37:44.851575] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-10-14T22:37:44.854255] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:44.854928] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-14T22:37:44.857089] [INFO ] [MAIN ] Derivative Progress: 755/1812 symbols completed. GDIV took 1.1s. Estimated remaining: 6m 43s. Rate: 157.2 symbols/min [2025-10-14T22:37:44.862680] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:44.872785] [DEBUG] [LOCAL ] GDL: Derivative data saved (1793 records). [2025-10-14T22:37:44.872982] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-14T22:37:44.875012] [INFO ] [MAIN ] Derivative Progress: 756/1812 symbols completed. GDL took 1.0s. Estimated remaining: 6m 42s. Rate: 157.4 symbols/min [2025-10-14T22:37:44.875154] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:44.880796] [DEBUG] [LOCAL ] GDO: Loaded 5877 existing records from primary storage. [2025-10-14T22:37:44.880956] [INFO ] [MAIN ] GDO: Loaded 5877 primary data records. [2025-10-14T22:37:45.042903] [DEBUG] [LOCAL ] GDV: Loaded 19583 existing records from primary storage. [2025-10-14T22:37:45.048339] [INFO ] [MAIN ] GDV: Loaded 19583 primary data records. [2025-10-14T22:37:45.141922] [DEBUG] [LOCAL ] GDOT: Loaded 37743 existing records from primary storage. [2025-10-14T22:37:45.166615] [INFO ] [MAIN ] GDOT: Loaded 37743 primary data records. [2025-10-14T22:37:45.886609] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:45.887810] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5877 primary records. [2025-10-14T22:37:45.888226] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-14T22:37:45.906745] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-14T22:37:45.907501] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-14T22:37:45.909798] [INFO ] [MAIN ] Derivative Progress: 757/1812 symbols completed. GDO took 1.1s. Estimated remaining: 6m 43s. Rate: 157.1 symbols/min [2025-10-14T22:37:45.912629] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:45.927517] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:45.941044] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37743 primary records. [2025-10-14T22:37:45.941292] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-14T22:37:45.942026] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:45.943205] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19583 primary records. [2025-10-14T22:37:45.943535] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-14T22:37:45.967672] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-14T22:37:45.970619] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-14T22:37:45.974358] [INFO ] [MAIN ] Derivative Progress: 758/1812 symbols completed. GDOT took 1.1s. Estimated remaining: 6m 42s. Rate: 157.2 symbols/min [2025-10-14T22:37:45.974797] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:45.979857] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-14T22:37:45.980072] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-14T22:37:45.982252] [INFO ] [MAIN ] Derivative Progress: 759/1812 symbols completed. GDV took 1.1s. Estimated remaining: 6m 41s. Rate: 157.4 symbols/min [2025-10-14T22:37:45.982502] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:46.034068] [DEBUG] [LOCAL ] GEF: Loaded 20792 existing records from primary storage. [2025-10-14T22:37:46.041952] [INFO ] [MAIN ] GEF: Loaded 20792 primary data records. [2025-10-14T22:37:46.041843] [DEBUG] [LOCAL ] GE: Loaded 53701 existing records from primary storage. [2025-10-14T22:37:46.094278] [INFO ] [MAIN ] GE: Loaded 53701 primary data records. [2025-10-14T22:37:46.149056] [DEBUG] [LOCAL ] GEL: Loaded 31852 existing records from primary storage. [2025-10-14T22:37:46.197059] [INFO ] [MAIN ] GEL: Loaded 31852 primary data records. [2025-10-14T22:37:47.083574] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:47.089074] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:47.089870] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20792 primary records. [2025-10-14T22:37:47.090161] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-14T22:37:47.091837] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53701 primary records. [2025-10-14T22:37:47.091931] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-14T22:37:47.136460] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-14T22:37:47.136772] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-14T22:37:47.139467] [INFO ] [MAIN ] Derivative Progress: 760/1812 symbols completed. GE took 1.2s. Estimated remaining: 6m 42s. Rate: 157.0 symbols/min [2025-10-14T22:37:47.141810] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:47.141701] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-14T22:37:47.142831] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-14T22:37:47.142619] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:47.146241] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 31852 primary records. [2025-10-14T22:37:47.145296] [INFO ] [MAIN ] Derivative Progress: 761/1812 symbols completed. GEF took 1.2s. Estimated remaining: 6m 41s. Rate: 157.2 symbols/min [2025-10-14T22:37:47.146474] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:47.146627] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-14T22:37:47.163735] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-14T22:37:47.163979] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-14T22:37:47.166461] [INFO ] [MAIN ] Derivative Progress: 762/1812 symbols completed. GEL took 1.2s. Estimated remaining: 6m 40s. Rate: 157.4 symbols/min [2025-10-14T22:37:47.166771] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:47.244374] [DEBUG] [LOCAL ] GENI: Loaded 52934 existing records from primary storage. [2025-10-14T22:37:47.255345] [INFO ] [MAIN ] GENI: Loaded 52934 primary data records. [2025-10-14T22:37:47.261330] [DEBUG] [LOCAL ] GEO: Loaded 51866 existing records from primary storage. [2025-10-14T22:37:47.261483] [INFO ] [MAIN ] GEO: Loaded 51866 primary data records. [2025-10-14T22:37:47.262086] [DEBUG] [LOCAL ] GES: Loaded 38327 existing records from primary storage. [2025-10-14T22:37:47.270978] [INFO ] [MAIN ] GES: Loaded 38327 primary data records. [2025-10-14T22:37:48.229885] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:48.245860] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:48.246558] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52934 primary records. [2025-10-14T22:37:48.254144] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-14T22:37:48.245562] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 38327 primary records. [2025-10-14T22:37:48.259923] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:48.259422] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-14T22:37:48.260548] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51866 primary records. [2025-10-14T22:37:48.261017] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-14T22:37:48.301861] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-14T22:37:48.302845] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-14T22:37:48.305769] [INFO ] [MAIN ] Derivative Progress: 763/1812 symbols completed. GENI took 1.2s. Estimated remaining: 6m 41s. Rate: 157.0 symbols/min [2025-10-14T22:37:48.306765] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-14T22:37:48.310755] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-14T22:37:48.312732] [INFO ] [MAIN ] Derivative Progress: 764/1812 symbols completed. GEO took 1.2s. Estimated remaining: 6m 40s. Rate: 157.2 symbols/min [2025-10-14T22:37:48.310632] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-14T22:37:48.312970] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-14T22:37:48.314797] [INFO ] [MAIN ] Derivative Progress: 765/1812 symbols completed. GES took 1.1s. Estimated remaining: 6m 39s. Rate: 157.4 symbols/min [2025-10-14T22:37:48.315244] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:48.315338] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:48.315190] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:48.321089] [DEBUG] [LOCAL ] GF: Loaded 2706 existing records from primary storage. [2025-10-14T22:37:48.321333] [INFO ] [MAIN ] GF: Loaded 2706 primary data records. [2025-10-14T22:37:48.660201] [DEBUG] [LOCAL ] GETY: Loaded 35043 existing records from primary storage. [2025-10-14T22:37:48.660522] [INFO ] [MAIN ] GETY: Loaded 35043 primary data records. [2025-10-14T22:37:48.815446] [DEBUG] [LOCAL ] GEV: Loaded 52998 existing records from primary storage. [2025-10-14T22:37:48.826336] [INFO ] [MAIN ] GEV: Loaded 52998 primary data records. [2025-10-14T22:37:49.316675] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:49.317459] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2706 primary records. [2025-10-14T22:37:49.317703] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-14T22:37:49.334882] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-14T22:37:49.335101] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-14T22:37:49.337319] [INFO ] [MAIN ] Derivative Progress: 766/1812 symbols completed. GF took 1.0s. Estimated remaining: 6m 40s. Rate: 157.1 symbols/min [2025-10-14T22:37:49.337694] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:49.355913] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:49.356712] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35043 primary records. [2025-10-14T22:37:49.356874] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-14T22:37:49.397902] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:49.397703] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-14T22:37:49.398041] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-14T22:37:49.400718] [INFO ] [MAIN ] Derivative Progress: 767/1812 symbols completed. GETY took 1.1s. Estimated remaining: 6m 39s. Rate: 157.2 symbols/min [2025-10-14T22:37:49.398684] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 52998 primary records. [2025-10-14T22:37:49.401055] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:49.400965] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-14T22:37:49.427154] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-14T22:37:49.427986] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-14T22:37:49.427899] [DEBUG] [LOCAL ] GFF: Loaded 30024 existing records from primary storage. [2025-10-14T22:37:49.431253] [INFO ] [MAIN ] GFF: Loaded 30024 primary data records. [2025-10-14T22:37:49.431060] [INFO ] [MAIN ] Derivative Progress: 768/1812 symbols completed. GEV took 1.1s. Estimated remaining: 6m 38s. Rate: 157.4 symbols/min [2025-10-14T22:37:49.431516] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:49.800892] [DEBUG] [LOCAL ] GFI: Loaded 53117 existing records from primary storage. [2025-10-14T22:37:49.801697] [DEBUG] [LOCAL ] GFL: Loaded 47717 existing records from primary storage. [2025-10-14T22:37:49.803156] [INFO ] [MAIN ] GFL: Loaded 47717 primary data records. [2025-10-14T22:37:49.803285] [INFO ] [MAIN ] GFI: Loaded 53117 primary data records. [2025-10-14T22:37:50.462671] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:50.464155] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30024 primary records. [2025-10-14T22:37:50.464255] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-14T22:37:50.485442] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-14T22:37:50.485639] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-14T22:37:50.487738] [INFO ] [MAIN ] Derivative Progress: 769/1812 symbols completed. GFF took 1.2s. Estimated remaining: 6m 38s. Rate: 157.1 symbols/min [2025-10-14T22:37:50.488220] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:50.508905] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:50.509759] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47717 primary records. [2025-10-14T22:37:50.509919] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-14T22:37:50.514390] [DEBUG] [LOCAL ] GFR: Loaded 7814 existing records from primary storage. [2025-10-14T22:37:50.515680] [INFO ] [MAIN ] GFR: Loaded 7814 primary data records. [2025-10-14T22:37:50.589584] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-14T22:37:50.644804] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:50.644935] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-14T22:37:50.663133] [INFO ] [MAIN ] Derivative Progress: 770/1812 symbols completed. GFL took 1.2s. Estimated remaining: 6m 38s. Rate: 157.2 symbols/min [2025-10-14T22:37:50.660897] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53117 primary records. [2025-10-14T22:37:50.669126] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:50.680199] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-14T22:37:50.893430] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-14T22:37:50.893686] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-14T22:37:50.895734] [INFO ] [MAIN ] Derivative Progress: 771/1812 symbols completed. GFI took 1.5s. Estimated remaining: 6m 37s. Rate: 157.3 symbols/min [2025-10-14T22:37:50.896004] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:50.945508] [DEBUG] [LOCAL ] GGB: Loaded 51393 existing records from primary storage. [2025-10-14T22:37:50.946374] [INFO ] [MAIN ] GGB: Loaded 51393 primary data records. [2025-10-14T22:37:51.085939] [DEBUG] [LOCAL ] GGG: Loaded 40713 existing records from primary storage. [2025-10-14T22:37:51.103577] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:51.103136] [INFO ] [MAIN ] GGG: Loaded 40713 primary data records. [2025-10-14T22:37:51.104427] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 7814 primary records. [2025-10-14T22:37:51.104712] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-14T22:37:51.471782] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-14T22:37:51.484917] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-14T22:37:51.495727] [INFO ] [MAIN ] Derivative Progress: 772/1812 symbols completed. GFR took 1.0s. Estimated remaining: 6m 37s. Rate: 157.1 symbols/min [2025-10-14T22:37:51.496568] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:51.663740] [DEBUG] [LOCAL ] GGT: Loaded 14418 existing records from primary storage. [2025-10-14T22:37:51.664160] [INFO ] [MAIN ] GGT: Loaded 14418 primary data records. [2025-10-14T22:37:52.002162] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:52.003452] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51393 primary records. [2025-10-14T22:37:52.003942] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-14T22:37:52.024283] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-14T22:37:52.025232] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-14T22:37:52.027409] [INFO ] [MAIN ] Derivative Progress: 773/1812 symbols completed. GGB took 1.4s. Estimated remaining: 6m 37s. Rate: 157.1 symbols/min [2025-10-14T22:37:52.028133] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:52.045063] [DEBUG] [LOCAL ] GGZ: Loaded 2407 existing records from primary storage. [2025-10-14T22:37:52.050602] [INFO ] [MAIN ] GGZ: Loaded 2407 primary data records. [2025-10-14T22:37:52.050529] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:52.063374] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40713 primary records. [2025-10-14T22:37:52.083220] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-14T22:37:52.201050] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-14T22:37:52.214948] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-14T22:37:52.233738] [INFO ] [MAIN ] Derivative Progress: 774/1812 symbols completed. GGG took 1.3s. Estimated remaining: 6m 36s. Rate: 157.2 symbols/min [2025-10-14T22:37:52.239577] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:52.429669] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:52.430639] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14418 primary records. [2025-10-14T22:37:52.433030] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-14T22:37:52.432801] [DEBUG] [LOCAL ] GHC: Loaded 2917 existing records from primary storage. [2025-10-14T22:37:52.433123] [INFO ] [MAIN ] GHC: Loaded 2917 primary data records. [2025-10-14T22:37:52.565400] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-14T22:37:52.571256] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-14T22:37:52.585090] [INFO ] [MAIN ] Derivative Progress: 775/1812 symbols completed. GGT took 1.1s. Estimated remaining: 6m 36s. Rate: 157.2 symbols/min [2025-10-14T22:37:52.590744] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:52.765538] [DEBUG] [LOCAL ] GHG: Loaded 3280 existing records from primary storage. [2025-10-14T22:37:52.765934] [INFO ] [MAIN ] GHG: Loaded 3280 primary data records. [2025-10-14T22:37:52.971961] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:53.003635] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2407 primary records. [2025-10-14T22:37:53.078130] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-14T22:37:53.107151] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-14T22:37:53.107946] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-14T22:37:53.110331] [INFO ] [MAIN ] Derivative Progress: 776/1812 symbols completed. GGZ took 1.1s. Estimated remaining: 6m 36s. Rate: 157.1 symbols/min [2025-10-14T22:37:53.110798] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:53.123953] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7830 incomplete bins [2025-10-14T22:37:53.124730] [INFO ] [MAIN ] GHC: Generated 1784 derivative records from 2917 primary records. [2025-10-14T22:37:53.125391] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-14T22:37:53.146992] [DEBUG] [LOCAL ] GHI: Loaded 7296 existing records from primary storage. [2025-10-14T22:37:53.148036] [INFO ] [MAIN ] GHI: Loaded 7296 primary data records. [2025-10-14T22:37:53.149037] [DEBUG] [LOCAL ] GHC: Derivative data saved (1784 records). [2025-10-14T22:37:53.161449] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-14T22:37:53.184769] [INFO ] [MAIN ] Derivative Progress: 777/1812 symbols completed. GHC took 0.9s. Estimated remaining: 6m 35s. Rate: 157.3 symbols/min [2025-10-14T22:37:53.203356] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:53.292266] [DEBUG] [LOCAL ] GHLD: Loaded 4238 existing records from primary storage. [2025-10-14T22:37:53.310368] [INFO ] [MAIN ] GHLD: Loaded 4238 primary data records. [2025-10-14T22:37:53.386020] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:37:53.537550] [INFO ] [MAIN ] GHG: Generated 1793 derivative records from 3280 primary records. [2025-10-14T22:37:53.555454] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-14T22:37:53.682740] [DEBUG] [LOCAL ] GHG: Derivative data saved (1793 records). [2025-10-14T22:37:53.702471] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-14T22:37:53.722103] [INFO ] [MAIN ] Derivative Progress: 778/1812 symbols completed. GHG took 1.1s. Estimated remaining: 6m 35s. Rate: 157.2 symbols/min [2025-10-14T22:37:53.913780] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:53.914699] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7296 primary records. [2025-10-14T22:37:53.915020] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-14T22:37:53.932136] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-14T22:37:53.932350] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-14T22:37:53.934428] [INFO ] [MAIN ] Derivative Progress: 779/1812 symbols completed. GHI took 0.8s. Estimated remaining: 6m 34s. Rate: 157.3 symbols/min [2025-10-14T22:37:53.953700] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:37:53.954378] [INFO ] [MAIN ] GHLD: Generated 1792 derivative records from 4238 primary records. [2025-10-14T22:37:53.954442] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-14T22:37:53.971048] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1792 records). [2025-10-14T22:37:53.971122] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-14T22:37:53.973179] [INFO ] [MAIN ] Derivative Progress: 780/1812 symbols completed. GHLD took 0.8s. Estimated remaining: 6m 33s. Rate: 157.4 symbols/min [2025-10-14T22:37:53.973564] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:53.973750] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:53.973676] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:53.995543] [DEBUG] [LOCAL ] GHM: Loaded 14325 existing records from primary storage. [2025-10-14T22:37:53.995697] [INFO ] [MAIN ] GHM: Loaded 14325 primary data records. [2025-10-14T22:37:54.093379] [DEBUG] [LOCAL ] GHY: Loaded 20943 existing records from primary storage. [2025-10-14T22:37:54.112185] [INFO ] [MAIN ] GHY: Loaded 20943 primary data records. [2025-10-14T22:37:54.415565] [DEBUG] [LOCAL ] GIB: Loaded 31638 existing records from primary storage. [2025-10-14T22:37:54.419904] [INFO ] [MAIN ] GIB: Loaded 31638 primary data records. [2025-10-14T22:37:54.992068] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:54.993305] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14325 primary records. [2025-10-14T22:37:54.993529] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-14T22:37:55.015331] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-14T22:37:55.015728] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-14T22:37:55.018256] [INFO ] [MAIN ] Derivative Progress: 781/1812 symbols completed. GHM took 1.0s. Estimated remaining: 6m 34s. Rate: 157.1 symbols/min [2025-10-14T22:37:55.018674] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:55.032895] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:55.033574] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20943 primary records. [2025-10-14T22:37:55.033820] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-14T22:37:55.070232] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:55.071534] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-14T22:37:55.071977] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-14T22:37:55.079465] [INFO ] [MAIN ] Derivative Progress: 782/1812 symbols completed. GHY took 1.1s. Estimated remaining: 6m 33s. Rate: 157.3 symbols/min [2025-10-14T22:37:55.079896] [DEBUG] [LOCAL ] GIC: Loaded 13431 existing records from primary storage. [2025-10-14T22:37:55.080045] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:55.077254] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31638 primary records. [2025-10-14T22:37:55.080429] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-14T22:37:55.081184] [INFO ] [MAIN ] GIC: Loaded 13431 primary data records. [2025-10-14T22:37:55.207156] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-14T22:37:55.213276] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-14T22:37:55.220556] [INFO ] [MAIN ] Derivative Progress: 783/1812 symbols completed. GIB took 1.2s. Estimated remaining: 6m 32s. Rate: 157.4 symbols/min [2025-10-14T22:37:55.258900] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:55.436901] [DEBUG] [LOCAL ] GIL: Loaded 43802 existing records from primary storage. [2025-10-14T22:37:55.437251] [INFO ] [MAIN ] GIL: Loaded 43802 primary data records. [2025-10-14T22:37:55.800594] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:55.802611] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13431 primary records. [2025-10-14T22:37:55.802976] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-14T22:37:55.822249] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-10-14T22:37:55.831324] [INFO ] [MAIN ] GIS: Loaded 53673 primary data records. [2025-10-14T22:37:55.949136] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-14T22:37:55.949447] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-14T22:37:55.951982] [INFO ] [MAIN ] Derivative Progress: 784/1812 symbols completed. GIC took 0.9s. Estimated remaining: 6m 32s. Rate: 157.2 symbols/min [2025-10-14T22:37:55.957419] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:56.163785] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:56.164710] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43802 primary records. [2025-10-14T22:37:56.164836] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-14T22:37:56.198046] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-14T22:37:56.198422] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-14T22:37:56.200886] [INFO ] [MAIN ] Derivative Progress: 785/1812 symbols completed. GIL took 1.1s. Estimated remaining: 6m 32s. Rate: 157.3 symbols/min [2025-10-14T22:37:56.201383] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:56.219796] [DEBUG] [LOCAL ] GKOS: Loaded 42609 existing records from primary storage. [2025-10-14T22:37:56.220921] [INFO ] [MAIN ] GKOS: Loaded 42609 primary data records. [2025-10-14T22:37:56.320055] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:56.338789] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53673 primary records. [2025-10-14T22:37:56.373528] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-14T22:37:56.600195] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-14T22:37:56.600784] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-14T22:37:56.599032] [DEBUG] [LOCAL ] GL: Loaded 37678 existing records from primary storage. [2025-10-14T22:37:56.602878] [INFO ] [MAIN ] Derivative Progress: 786/1812 symbols completed. GIS took 1.3s. Estimated remaining: 6m 31s. Rate: 157.3 symbols/min [2025-10-14T22:37:56.603589] [INFO ] [MAIN ] GL: Loaded 37678 primary data records. [2025-10-14T22:37:56.603779] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:56.939789] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:56.941033] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42609 primary records. [2025-10-14T22:37:56.953700] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-14T22:37:56.955359] [DEBUG] [LOCAL ] GLOB: Loaded 47979 existing records from primary storage. [2025-10-14T22:37:56.955910] [INFO ] [MAIN ] GLOB: Loaded 47979 primary data records. [2025-10-14T22:37:57.007707] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-14T22:37:57.027313] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-14T22:37:57.056013] [INFO ] [MAIN ] Derivative Progress: 787/1812 symbols completed. GKOS took 1.1s. Estimated remaining: 6m 31s. Rate: 157.2 symbols/min [2025-10-14T22:37:57.061906] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:57.277000] [DEBUG] [LOCAL ] GLP: Loaded 9246 existing records from primary storage. [2025-10-14T22:37:57.277287] [INFO ] [MAIN ] GLP: Loaded 9246 primary data records. [2025-10-14T22:37:57.337484] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:57.344142] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37678 primary records. [2025-10-14T22:37:57.368042] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-14T22:37:57.618478] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-14T22:37:57.619466] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-14T22:37:57.621659] [INFO ] [MAIN ] Derivative Progress: 788/1812 symbols completed. GL took 1.4s. Estimated remaining: 6m 31s. Rate: 157.1 symbols/min [2025-10-14T22:37:57.621906] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:57.642911] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:57.643597] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47979 primary records. [2025-10-14T22:37:57.643889] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-14T22:37:57.663865] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-14T22:37:57.663986] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-14T22:37:57.666555] [INFO ] [MAIN ] Derivative Progress: 789/1812 symbols completed. GLOB took 1.1s. Estimated remaining: 6m 30s. Rate: 157.3 symbols/min [2025-10-14T22:37:57.666815] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:57.693568] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:57.694322] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9246 primary records. [2025-10-14T22:37:57.694488] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-14T22:37:57.725216] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-14T22:37:57.725486] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-14T22:37:57.727425] [INFO ] [MAIN ] Derivative Progress: 790/1812 symbols completed. GLP took 0.7s. Estimated remaining: 6m 29s. Rate: 157.5 symbols/min [2025-10-14T22:37:57.727612] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:57.728927] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-14T22:37:57.729503] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-14T22:37:58.054909] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-14T22:37:58.055226] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-14T22:37:58.194576] [DEBUG] [LOCAL ] GME: Loaded 53782 existing records from primary storage. [2025-10-14T22:37:58.194949] [INFO ] [MAIN ] GME: Loaded 53782 primary data records. [2025-10-14T22:37:58.753498] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:58.754834] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-14T22:37:58.755192] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-14T22:37:58.777909] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-14T22:37:58.790409] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-14T22:37:58.791244] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:58.791986] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-14T22:37:58.794309] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-14T22:37:58.794234] [INFO ] [MAIN ] Derivative Progress: 791/1812 symbols completed. GLW took 1.2s. Estimated remaining: 6m 30s. Rate: 157.1 symbols/min [2025-10-14T22:37:58.803684] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:58.824700] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:58.826070] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53782 primary records. [2025-10-14T22:37:58.826665] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-14T22:37:58.827542] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-14T22:37:58.828245] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-14T22:37:58.830512] [INFO ] [MAIN ] Derivative Progress: 792/1812 symbols completed. GM took 1.2s. Estimated remaining: 6m 29s. Rate: 157.3 symbols/min [2025-10-14T22:37:58.839016] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:58.846793] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-14T22:37:58.847026] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-14T22:37:58.849137] [INFO ] [MAIN ] Derivative Progress: 793/1812 symbols completed. GME took 1.1s. Estimated remaining: 6m 28s. Rate: 157.5 symbols/min [2025-10-14T22:37:58.907819] [DEBUG] [LOCAL ] GMED: Loaded 48308 existing records from primary storage. [2025-10-14T22:37:58.906676] [DEBUG] [LOCAL ] GMRE: Loaded 37032 existing records from primary storage. [2025-10-14T22:37:58.908021] [INFO ] [MAIN ] GMED: Loaded 48308 primary data records. [2025-10-14T22:37:58.908183] [INFO ] [MAIN ] GMRE: Loaded 37032 primary data records. [2025-10-14T22:37:59.528591] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:59.541793] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48308 primary records. [2025-10-14T22:37:59.541958] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-14T22:37:59.542695] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:37:59.543902] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37032 primary records. [2025-10-14T22:37:59.543993] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-14T22:37:59.567729] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-14T22:37:59.572046] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-14T22:37:59.573924] [INFO ] [MAIN ] Derivative Progress: 794/1812 symbols completed. GMED took 0.8s. Estimated remaining: 6m 28s. Rate: 157.3 symbols/min [2025-10-14T22:37:59.576791] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-14T22:37:59.576875] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-14T22:37:59.578834] [INFO ] [MAIN ] Derivative Progress: 795/1812 symbols completed. GMRE took 0.7s. Estimated remaining: 6m 27s. Rate: 157.5 symbols/min [2025-10-14T22:37:59.579380] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:59.579226] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:59.579297] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:37:59.600025] [DEBUG] [LOCAL ] GNE: Loaded 17991 existing records from primary storage. [2025-10-14T22:37:59.600178] [INFO ] [MAIN ] GNE: Loaded 17991 primary data records. [2025-10-14T22:37:59.803990] [DEBUG] [LOCAL ] GNK: Loaded 40176 existing records from primary storage. [2025-10-14T22:37:59.852633] [INFO ] [MAIN ] GNK: Loaded 40176 primary data records. [2025-10-14T22:37:59.852519] [DEBUG] [LOCAL ] GNL: Loaded 46702 existing records from primary storage. [2025-10-14T22:37:59.967441] [INFO ] [MAIN ] GNL: Loaded 46702 primary data records. [2025-10-14T22:38:00.697833] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:00.699125] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17991 primary records. [2025-10-14T22:38:00.699349] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-14T22:38:00.718167] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-14T22:38:00.718631] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-14T22:38:00.720956] [INFO ] [MAIN ] Derivative Progress: 796/1812 symbols completed. GNE took 1.1s. Estimated remaining: 6m 28s. Rate: 157.1 symbols/min [2025-10-14T22:38:00.721321] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:00.744635] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:00.760523] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40176 primary records. [2025-10-14T22:38:00.761190] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-14T22:38:00.761069] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:00.763455] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46702 primary records. [2025-10-14T22:38:00.774836] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-14T22:38:00.804486] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-14T22:38:00.805192] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-14T22:38:00.807384] [INFO ] [MAIN ] Derivative Progress: 797/1812 symbols completed. GNK took 1.2s. Estimated remaining: 6m 27s. Rate: 157.3 symbols/min [2025-10-14T22:38:00.808578] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:00.810962] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-14T22:38:00.824019] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-14T22:38:00.826747] [INFO ] [MAIN ] Derivative Progress: 798/1812 symbols completed. GNL took 1.2s. Estimated remaining: 6m 26s. Rate: 157.5 symbols/min [2025-10-14T22:38:00.827159] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:00.828593] [DEBUG] [LOCAL ] GNRC: Loaded 45433 existing records from primary storage. [2025-10-14T22:38:00.828820] [INFO ] [MAIN ] GNRC: Loaded 45433 primary data records. [2025-10-14T22:38:00.911477] [DEBUG] [LOCAL ] GNT: Loaded 8422 existing records from primary storage. [2025-10-14T22:38:00.918002] [INFO ] [MAIN ] GNT: Loaded 8422 primary data records. [2025-10-14T22:38:01.468290] [DEBUG] [LOCAL ] GNW: Loaded 51401 existing records from primary storage. [2025-10-14T22:38:01.474062] [INFO ] [MAIN ] GNW: Loaded 51401 primary data records. [2025-10-14T22:38:01.887541] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:01.889514] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45433 primary records. [2025-10-14T22:38:01.898571] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-14T22:38:01.904765] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:01.907942] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8422 primary records. [2025-10-14T22:38:01.908058] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-14T22:38:01.944883] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-14T22:38:01.947010] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-14T22:38:01.946727] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-14T22:38:01.950084] [INFO ] [MAIN ] Derivative Progress: 799/1812 symbols completed. GNRC took 1.2s. Estimated remaining: 6m 27s. Rate: 157.1 symbols/min [2025-10-14T22:38:01.950358] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:01.950601] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-14T22:38:01.953737] [INFO ] [MAIN ] Derivative Progress: 800/1812 symbols completed. GNT took 1.1s. Estimated remaining: 6m 26s. Rate: 157.3 symbols/min [2025-10-14T22:38:01.954148] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:01.976082] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:01.976951] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51401 primary records. [2025-10-14T22:38:01.977219] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-14T22:38:02.014745] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-14T22:38:02.014979] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-14T22:38:02.017318] [INFO ] [MAIN ] Derivative Progress: 801/1812 symbols completed. GNW took 1.2s. Estimated remaining: 6m 25s. Rate: 157.4 symbols/min [2025-10-14T22:38:02.017753] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:02.031563] [DEBUG] [LOCAL ] GOLF: Loaded 30957 existing records from primary storage. [2025-10-14T22:38:02.031990] [INFO ] [MAIN ] GOLF: Loaded 30957 primary data records. [2025-10-14T22:38:02.128093] [DEBUG] [LOCAL ] GOF: Loaded 42601 existing records from primary storage. [2025-10-14T22:38:02.149834] [INFO ] [MAIN ] GOF: Loaded 42601 primary data records. [2025-10-14T22:38:02.411759] [DEBUG] [LOCAL ] GOOS: Loaded 44689 existing records from primary storage. [2025-10-14T22:38:02.523467] [INFO ] [MAIN ] GOOS: Loaded 44689 primary data records. [2025-10-14T22:38:03.137159] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:03.139239] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 30957 primary records. [2025-10-14T22:38:03.139595] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-14T22:38:03.172175] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:03.174441] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42601 primary records. [2025-10-14T22:38:03.175588] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-14T22:38:03.175502] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-14T22:38:03.176763] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-14T22:38:03.178828] [INFO ] [MAIN ] Derivative Progress: 802/1812 symbols completed. GOLF took 1.2s. Estimated remaining: 6m 26s. Rate: 157.0 symbols/min [2025-10-14T22:38:03.179260] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:03.199255] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-14T22:38:03.200055] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-14T22:38:03.202731] [INFO ] [MAIN ] Derivative Progress: 803/1812 symbols completed. GOF took 1.3s. Estimated remaining: 6m 25s. Rate: 157.2 symbols/min [2025-10-14T22:38:03.202993] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:03.217043] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:03.218117] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44689 primary records. [2025-10-14T22:38:03.218189] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-14T22:38:03.266108] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-14T22:38:03.265698] [DEBUG] [LOCAL ] GPI: Loaded 14831 existing records from primary storage. [2025-10-14T22:38:03.266474] [INFO ] [MAIN ] GPI: Loaded 14831 primary data records. [2025-10-14T22:38:03.266674] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-14T22:38:03.269552] [INFO ] [MAIN ] Derivative Progress: 804/1812 symbols completed. GOOS took 1.3s. Estimated remaining: 6m 24s. Rate: 157.4 symbols/min [2025-10-14T22:38:03.275480] [DEBUG] [LOCAL ] GOTU: Loaded 37406 existing records from primary storage. [2025-10-14T22:38:03.300962] [INFO ] [MAIN ] GOTU: Loaded 37406 primary data records. [2025-10-14T22:38:03.292170] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:03.498711] [DEBUG] [LOCAL ] GPJA: Loaded 4241 existing records from primary storage. [2025-10-14T22:38:03.530239] [INFO ] [MAIN ] GPJA: Loaded 4241 primary data records. [2025-10-14T22:38:04.245345] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:04.246836] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14831 primary records. [2025-10-14T22:38:04.247173] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:04.247350] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-14T22:38:04.247959] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 37406 primary records. [2025-10-14T22:38:04.249017] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-14T22:38:04.281455] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-10-14T22:38:04.282462] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-14T22:38:04.285252] [INFO ] [MAIN ] Derivative Progress: 805/1812 symbols completed. GPI took 1.1s. Estimated remaining: 6m 25s. Rate: 157.0 symbols/min [2025-10-14T22:38:04.286631] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:04.287845] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-14T22:38:04.288441] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-14T22:38:04.298362] [INFO ] [MAIN ] Derivative Progress: 806/1812 symbols completed. GOTU took 1.1s. Estimated remaining: 6m 24s. Rate: 157.2 symbols/min [2025-10-14T22:38:04.298623] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:04.304384] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:04.305434] [INFO ] [MAIN ] GPJA: Generated 1794 derivative records from 4241 primary records. [2025-10-14T22:38:04.305569] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-14T22:38:04.321288] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1794 records). [2025-10-14T22:38:04.321428] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-14T22:38:04.323619] [INFO ] [MAIN ] Derivative Progress: 807/1812 symbols completed. GPJA took 1.0s. Estimated remaining: 6m 23s. Rate: 157.4 symbols/min [2025-10-14T22:38:04.324010] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:04.357267] [DEBUG] [LOCAL ] GPMT: Loaded 25901 existing records from primary storage. [2025-10-14T22:38:04.357568] [INFO ] [MAIN ] GPMT: Loaded 25901 primary data records. [2025-10-14T22:38:04.491810] [DEBUG] [LOCAL ] GPK: Loaded 52763 existing records from primary storage. [2025-10-14T22:38:04.503015] [INFO ] [MAIN ] GPK: Loaded 52763 primary data records. [2025-10-14T22:38:04.908275] [DEBUG] [LOCAL ] GPN: Loaded 52040 existing records from primary storage. [2025-10-14T22:38:04.938567] [INFO ] [MAIN ] GPN: Loaded 52040 primary data records. [2025-10-14T22:38:05.426248] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:05.429036] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25901 primary records. [2025-10-14T22:38:05.429830] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-14T22:38:05.451203] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-14T22:38:05.452278] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-14T22:38:05.454559] [INFO ] [MAIN ] Derivative Progress: 808/1812 symbols completed. GPMT took 1.2s. Estimated remaining: 6m 24s. Rate: 157.0 symbols/min [2025-10-14T22:38:05.469088] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:05.470304] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52763 primary records. [2025-10-14T22:38:05.470671] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-14T22:38:05.491376] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-14T22:38:05.491502] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-14T22:38:05.496988] [INFO ] [MAIN ] Derivative Progress: 809/1812 symbols completed. GPK took 1.2s. Estimated remaining: 6m 23s. Rate: 157.2 symbols/min [2025-10-14T22:38:05.510573] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:05.511385] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52040 primary records. [2025-10-14T22:38:05.511454] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-14T22:38:05.528156] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-14T22:38:05.528217] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-14T22:38:05.530679] [INFO ] [MAIN ] Derivative Progress: 810/1812 symbols completed. GPN took 1.2s. Estimated remaining: 6m 22s. Rate: 157.4 symbols/min [2025-10-14T22:38:05.531250] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:05.531358] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:05.531502] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:05.576526] [DEBUG] [LOCAL ] GPOR: Loaded 23269 existing records from primary storage. [2025-10-14T22:38:05.577181] [DEBUG] [LOCAL ] GRBK: Loaded 27177 existing records from primary storage. [2025-10-14T22:38:05.577457] [INFO ] [MAIN ] GPOR: Loaded 23269 primary data records. [2025-10-14T22:38:05.577833] [INFO ] [MAIN ] GRBK: Loaded 27177 primary data records. [2025-10-14T22:38:05.839547] [DEBUG] [LOCAL ] GPRK: Loaded 39628 existing records from primary storage. [2025-10-14T22:38:05.938704] [INFO ] [MAIN ] GPRK: Loaded 39628 primary data records. [2025-10-14T22:38:06.624413] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:06.628182] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23269 primary records. [2025-10-14T22:38:06.643793] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:06.643916] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-14T22:38:06.645989] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27177 primary records. [2025-10-14T22:38:06.646618] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-14T22:38:06.680750] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-14T22:38:06.681709] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-14T22:38:06.685258] [INFO ] [MAIN ] Derivative Progress: 811/1812 symbols completed. GRBK took 1.2s. Estimated remaining: 6m 23s. Rate: 157.0 symbols/min [2025-10-14T22:38:06.687561] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:06.691314] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-14T22:38:06.691618] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-14T22:38:06.693801] [INFO ] [MAIN ] Derivative Progress: 812/1812 symbols completed. GPOR took 1.2s. Estimated remaining: 6m 22s. Rate: 157.2 symbols/min [2025-10-14T22:38:06.702033] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:06.710328] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:06.711674] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39628 primary records. [2025-10-14T22:38:06.711766] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-14T22:38:06.724707] [DEBUG] [LOCAL ] GRC: Loaded 9280 existing records from primary storage. [2025-10-14T22:38:06.730708] [INFO ] [MAIN ] GRC: Loaded 9280 primary data records. [2025-10-14T22:38:06.812960] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-14T22:38:06.837015] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-14T22:38:06.840589] [INFO ] [MAIN ] Derivative Progress: 813/1812 symbols completed. GPRK took 1.3s. Estimated remaining: 6m 21s. Rate: 157.3 symbols/min [2025-10-14T22:38:06.861825] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:06.846457] [DEBUG] [LOCAL ] GRDN: Loaded 20872 existing records from primary storage. [2025-10-14T22:38:06.862212] [INFO ] [MAIN ] GRDN: Loaded 20872 primary data records. [2025-10-14T22:38:07.399940] [DEBUG] [LOCAL ] GRMN: Loaded 40470 existing records from primary storage. [2025-10-14T22:38:07.401581] [INFO ] [MAIN ] GRMN: Loaded 40470 primary data records. [2025-10-14T22:38:07.728981] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:07.731913] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9280 primary records. [2025-10-14T22:38:07.732208] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-14T22:38:07.746332] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:07.755278] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20872 primary records. [2025-10-14T22:38:07.759715] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-14T22:38:07.780625] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-14T22:38:07.779878] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-14T22:38:07.781741] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-14T22:38:07.784075] [INFO ] [MAIN ] Derivative Progress: 814/1812 symbols completed. GRC took 1.1s. Estimated remaining: 6m 21s. Rate: 157.0 symbols/min [2025-10-14T22:38:07.782010] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-14T22:38:07.786723] [INFO ] [MAIN ] Derivative Progress: 815/1812 symbols completed. GRDN took 1.1s. Estimated remaining: 6m 21s. Rate: 157.2 symbols/min [2025-10-14T22:38:07.786577] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:07.787047] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:07.806532] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:07.807287] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 40470 primary records. [2025-10-14T22:38:07.807491] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-14T22:38:07.845186] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-14T22:38:07.845324] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-14T22:38:07.848289] [DEBUG] [LOCAL ] GRNT: Loaded 33969 existing records from primary storage. [2025-10-14T22:38:07.847483] [INFO ] [MAIN ] Derivative Progress: 816/1812 symbols completed. GRMN took 1.0s. Estimated remaining: 6m 20s. Rate: 157.4 symbols/min [2025-10-14T22:38:07.858224] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:07.858397] [INFO ] [MAIN ] GRNT: Loaded 33969 primary data records. [2025-10-14T22:38:07.982852] [DEBUG] [LOCAL ] GROV: Loaded 8717 existing records from primary storage. [2025-10-14T22:38:07.985245] [DEBUG] [LOCAL ] GRND: Loaded 50090 existing records from primary storage. [2025-10-14T22:38:07.985440] [INFO ] [MAIN ] GROV: Loaded 8717 primary data records. [2025-10-14T22:38:07.985366] [INFO ] [MAIN ] GRND: Loaded 50090 primary data records. [2025-10-14T22:38:08.865007] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:08.866173] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33969 primary records. [2025-10-14T22:38:08.869441] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-14T22:38:08.909851] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:08.911117] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8717 primary records. [2025-10-14T22:38:08.910385] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:08.911782] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-14T22:38:08.913380] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50090 primary records. [2025-10-14T22:38:08.913743] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-14T22:38:08.937183] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-14T22:38:08.937293] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-14T22:38:08.943732] [INFO ] [MAIN ] Derivative Progress: 817/1812 symbols completed. GROV took 1.1s. Estimated remaining: 6m 20s. Rate: 157.0 symbols/min [2025-10-14T22:38:08.939153] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-14T22:38:08.944623] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:08.944819] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-14T22:38:08.947684] [INFO ] [MAIN ] Derivative Progress: 818/1812 symbols completed. GRNT took 1.2s. Estimated remaining: 6m 19s. Rate: 157.2 symbols/min [2025-10-14T22:38:08.949180] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:08.956211] [DEBUG] [LOCAL ] GRX: Loaded 4788 existing records from primary storage. [2025-10-14T22:38:08.956930] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-14T22:38:08.957129] [INFO ] [MAIN ] GRX: Loaded 4788 primary data records. [2025-10-14T22:38:08.962395] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-14T22:38:08.971051] [INFO ] [MAIN ] Derivative Progress: 819/1812 symbols completed. GRND took 1.2s. Estimated remaining: 6m 19s. Rate: 157.4 symbols/min [2025-10-14T22:38:08.992118] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:09.315965] [DEBUG] [LOCAL ] GS: Loaded 51784 existing records from primary storage. [2025-10-14T22:38:09.316821] [INFO ] [MAIN ] GS: Loaded 51784 primary data records. [2025-10-14T22:38:09.317493] [DEBUG] [LOCAL ] GSBD: Loaded 39648 existing records from primary storage. [2025-10-14T22:38:09.317830] [INFO ] [MAIN ] GSBD: Loaded 39648 primary data records. [2025-10-14T22:38:09.496842] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:09.534965] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4788 primary records. [2025-10-14T22:38:09.535076] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-14T22:38:09.805749] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-14T22:38:09.839715] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-14T22:38:09.962506] [INFO ] [MAIN ] Derivative Progress: 820/1812 symbols completed. GRX took 1.0s. Estimated remaining: 6m 19s. Rate: 157.1 symbols/min [2025-10-14T22:38:09.964537] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:09.996718] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:10.011488] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51784 primary records. [2025-10-14T22:38:10.012631] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-14T22:38:10.040181] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:10.059428] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39648 primary records. [2025-10-14T22:38:10.060097] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-14T22:38:10.063062] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-14T22:38:10.071331] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-14T22:38:10.077763] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-14T22:38:10.073450] [INFO ] [MAIN ] Derivative Progress: 821/1812 symbols completed. GS took 1.1s. Estimated remaining: 6m 18s. Rate: 157.2 symbols/min [2025-10-14T22:38:10.079541] [INFO ] [MAIN ] GSK: Loaded 53502 primary data records. [2025-10-14T22:38:10.079931] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:10.150373] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-14T22:38:10.162214] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-14T22:38:10.169858] [INFO ] [MAIN ] Derivative Progress: 822/1812 symbols completed. GSBD took 1.2s. Estimated remaining: 6m 17s. Rate: 157.4 symbols/min [2025-10-14T22:38:10.188795] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:10.410507] [DEBUG] [LOCAL ] GSL: Loaded 33267 existing records from primary storage. [2025-10-14T22:38:10.410673] [INFO ] [MAIN ] GSL: Loaded 33267 primary data records. [2025-10-14T22:38:10.650388] [DEBUG] [LOCAL ] GTES: Loaded 50384 existing records from primary storage. [2025-10-14T22:38:10.780172] [INFO ] [MAIN ] GTES: Loaded 50384 primary data records. [2025-10-14T22:38:10.909152] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:10.913876] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53502 primary records. [2025-10-14T22:38:10.952492] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-14T22:38:11.122013] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-14T22:38:11.122514] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-14T22:38:11.125152] [INFO ] [MAIN ] Derivative Progress: 823/1812 symbols completed. GSK took 1.2s. Estimated remaining: 6m 18s. Rate: 157.1 symbols/min [2025-10-14T22:38:11.144995] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:11.145941] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33267 primary records. [2025-10-14T22:38:11.146145] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-14T22:38:11.163419] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-14T22:38:11.165909] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-14T22:38:11.168334] [INFO ] [MAIN ] Derivative Progress: 824/1812 symbols completed. GSL took 1.1s. Estimated remaining: 6m 17s. Rate: 157.2 symbols/min [2025-10-14T22:38:11.181071] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:11.181796] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50384 primary records. [2025-10-14T22:38:11.181861] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-14T22:38:11.197030] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-14T22:38:11.197085] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-14T22:38:11.199379] [INFO ] [MAIN ] Derivative Progress: 825/1812 symbols completed. GTES took 1.0s. Estimated remaining: 6m 16s. Rate: 157.4 symbols/min [2025-10-14T22:38:11.199887] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:11.200010] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:11.199818] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:11.247405] [DEBUG] [LOCAL ] GTY: Loaded 30186 existing records from primary storage. [2025-10-14T22:38:11.247535] [INFO ] [MAIN ] GTY: Loaded 30186 primary data records. [2025-10-14T22:38:11.369737] [DEBUG] [LOCAL ] GTLS: Loaded 43298 existing records from primary storage. [2025-10-14T22:38:11.382902] [INFO ] [MAIN ] GTLS: Loaded 43298 primary data records. [2025-10-14T22:38:11.383037] [DEBUG] [LOCAL ] GTN: Loaded 45235 existing records from primary storage. [2025-10-14T22:38:11.466317] [INFO ] [MAIN ] GTN: Loaded 45235 primary data records. [2025-10-14T22:38:12.192709] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:12.193890] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30186 primary records. [2025-10-14T22:38:12.194230] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-14T22:38:12.213017] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-14T22:38:12.213147] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-14T22:38:12.215210] [INFO ] [MAIN ] Derivative Progress: 826/1812 symbols completed. GTY took 1.0s. Estimated remaining: 6m 17s. Rate: 157.1 symbols/min [2025-10-14T22:38:12.215796] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:12.229955] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:12.231606] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45235 primary records. [2025-10-14T22:38:12.231898] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-14T22:38:12.255840] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:12.259293] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43298 primary records. [2025-10-14T22:38:12.260871] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-14T22:38:12.260819] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-14T22:38:12.260962] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-14T22:38:12.263021] [INFO ] [MAIN ] Derivative Progress: 827/1812 symbols completed. GTN took 1.1s. Estimated remaining: 6m 16s. Rate: 157.3 symbols/min [2025-10-14T22:38:12.267199] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:12.287828] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-10-14T22:38:12.288429] [INFO ] [MAIN ] GUG: Loaded 12212 primary data records. [2025-10-14T22:38:12.288249] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-14T22:38:12.293934] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-14T22:38:12.311792] [INFO ] [MAIN ] Derivative Progress: 828/1812 symbols completed. GTLS took 1.1s. Estimated remaining: 6m 15s. Rate: 157.4 symbols/min [2025-10-14T22:38:12.333977] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:12.442896] [DEBUG] [LOCAL ] GUT: Loaded 15591 existing records from primary storage. [2025-10-14T22:38:12.459137] [INFO ] [MAIN ] GUT: Loaded 15591 primary data records. [2025-10-14T22:38:12.749967] [DEBUG] [LOCAL ] GVA: Loaded 32725 existing records from primary storage. [2025-10-14T22:38:12.771873] [INFO ] [MAIN ] GVA: Loaded 32725 primary data records. [2025-10-14T22:38:13.262881] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:38:13.264414] [INFO ] [MAIN ] GUG: Generated 1793 derivative records from 12212 primary records. [2025-10-14T22:38:13.264540] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-14T22:38:13.282455] [DEBUG] [LOCAL ] GUG: Derivative data saved (1793 records). [2025-10-14T22:38:13.282604] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-14T22:38:13.284625] [INFO ] [MAIN ] Derivative Progress: 829/1812 symbols completed. GUG took 1.1s. Estimated remaining: 6m 15s. Rate: 157.1 symbols/min [2025-10-14T22:38:13.285018] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:13.301804] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:13.302553] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15591 primary records. [2025-10-14T22:38:13.302820] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-14T22:38:13.331849] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-14T22:38:13.333258] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-14T22:38:13.333603] [DEBUG] [LOCAL ] GWH: Loaded 18271 existing records from primary storage. [2025-10-14T22:38:13.341520] [INFO ] [MAIN ] GWH: Loaded 18271 primary data records. [2025-10-14T22:38:13.348219] [INFO ] [MAIN ] Derivative Progress: 830/1812 symbols completed. GUT took 1.1s. Estimated remaining: 6m 15s. Rate: 157.3 symbols/min [2025-10-14T22:38:13.348808] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:13.354829] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:13.362828] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 32725 primary records. [2025-10-14T22:38:13.368203] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-14T22:38:13.473881] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-14T22:38:13.477395] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-14T22:38:13.479886] [INFO ] [MAIN ] Derivative Progress: 831/1812 symbols completed. GVA took 1.1s. Estimated remaining: 6m 14s. Rate: 157.4 symbols/min [2025-10-14T22:38:13.536498] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:13.690581] [DEBUG] [LOCAL ] GWRE: Loaded 39976 existing records from primary storage. [2025-10-14T22:38:13.690858] [INFO ] [MAIN ] GWRE: Loaded 39976 primary data records. [2025-10-14T22:38:13.855828] [DEBUG] [LOCAL ] GWW: Loaded 19603 existing records from primary storage. [2025-10-14T22:38:13.983003] [INFO ] [MAIN ] GWW: Loaded 19603 primary data records. [2025-10-14T22:38:14.318377] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:14.320120] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 18271 primary records. [2025-10-14T22:38:14.320534] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-14T22:38:14.356511] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-14T22:38:14.356322] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:14.357635] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 39976 primary records. [2025-10-14T22:38:14.357770] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-14T22:38:14.360115] [INFO ] [MAIN ] Derivative Progress: 832/1812 symbols completed. GWH took 1.1s. Estimated remaining: 6m 14s. Rate: 157.2 symbols/min [2025-10-14T22:38:14.360369] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-14T22:38:14.360806] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:14.387821] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-14T22:38:14.401791] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-14T22:38:14.407412] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:14.406915] [INFO ] [MAIN ] Derivative Progress: 833/1812 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 13s. Rate: 157.3 symbols/min [2025-10-14T22:38:14.408743] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19603 primary records. [2025-10-14T22:38:14.407739] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:14.408851] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-14T22:38:14.426344] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-14T22:38:14.436397] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-14T22:38:14.438846] [INFO ] [MAIN ] Derivative Progress: 834/1812 symbols completed. GWW took 0.9s. Estimated remaining: 6m 13s. Rate: 157.5 symbols/min [2025-10-14T22:38:14.439187] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:14.441437] [DEBUG] [LOCAL ] GYLD: Loaded 1542 existing records from primary storage. [2025-10-14T22:38:14.442018] [INFO ] [MAIN ] GYLD: Loaded 1542 primary data records. [2025-10-14T22:38:14.571416] [DEBUG] [LOCAL ] GXO: Loaded 46833 existing records from primary storage. [2025-10-14T22:38:14.571707] [INFO ] [MAIN ] GXO: Loaded 46833 primary data records. [2025-10-14T22:38:15.102756] [DEBUG] [LOCAL ] H: Loaded 44431 existing records from primary storage. [2025-10-14T22:38:15.108557] [INFO ] [MAIN ] H: Loaded 44431 primary data records. [2025-10-14T22:38:15.434455] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:38:15.436091] [INFO ] [MAIN ] GYLD: Generated 1792 derivative records from 1542 primary records. [2025-10-14T22:38:15.436292] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-14T22:38:15.453093] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1792 records). [2025-10-14T22:38:15.453374] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-14T22:38:15.455530] [INFO ] [MAIN ] Derivative Progress: 835/1812 symbols completed. GYLD took 1.0s. Estimated remaining: 6m 13s. Rate: 157.2 symbols/min [2025-10-14T22:38:15.455938] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:15.472463] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:15.473230] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 46833 primary records. [2025-10-14T22:38:15.473396] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-14T22:38:15.490508] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-14T22:38:15.491952] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-14T22:38:15.494260] [INFO ] [MAIN ] Derivative Progress: 836/1812 symbols completed. GXO took 1.1s. Estimated remaining: 6m 12s. Rate: 157.4 symbols/min [2025-10-14T22:38:15.494571] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:15.508057] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:15.508875] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44431 primary records. [2025-10-14T22:38:15.509063] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-14T22:38:15.535052] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-14T22:38:15.546345] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-14T22:38:15.548404] [INFO ] [MAIN ] Derivative Progress: 837/1812 symbols completed. H took 1.1s. Estimated remaining: 6m 11s. Rate: 157.5 symbols/min [2025-10-14T22:38:15.548608] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:15.550298] [DEBUG] [LOCAL ] HAE: Loaded 39414 existing records from primary storage. [2025-10-14T22:38:15.550526] [INFO ] [MAIN ] HAE: Loaded 39414 primary data records. [2025-10-14T22:38:15.685043] [DEBUG] [LOCAL ] HAFN: Loaded 43050 existing records from primary storage. [2025-10-14T22:38:15.685476] [INFO ] [MAIN ] HAFN: Loaded 43050 primary data records. [2025-10-14T22:38:16.073664] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-14T22:38:16.097927] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-14T22:38:16.568634] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:16.570864] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39414 primary records. [2025-10-14T22:38:16.571610] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-14T22:38:16.601492] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-14T22:38:16.601602] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-14T22:38:16.600544] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:16.603709] [INFO ] [MAIN ] Derivative Progress: 838/1812 symbols completed. HAE took 1.1s. Estimated remaining: 6m 12s. Rate: 157.2 symbols/min [2025-10-14T22:38:16.604889] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43050 primary records. [2025-10-14T22:38:16.605010] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-14T22:38:16.623434] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-14T22:38:16.624218] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-14T22:38:16.626937] [INFO ] [MAIN ] Derivative Progress: 839/1812 symbols completed. HAFN took 1.1s. Estimated remaining: 6m 11s. Rate: 157.4 symbols/min [2025-10-14T22:38:16.639481] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:16.640044] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-14T22:38:16.640102] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-14T22:38:16.655214] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-14T22:38:16.655273] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-14T22:38:16.658796] [INFO ] [MAIN ] Derivative Progress: 840/1812 symbols completed. HAL took 1.1s. Estimated remaining: 6m 10s. Rate: 157.5 symbols/min [2025-10-14T22:38:16.659150] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:16.659284] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:16.659246] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:16.668964] [DEBUG] [LOCAL ] HBB: Loaded 6478 existing records from primary storage. [2025-10-14T22:38:16.669100] [INFO ] [MAIN ] HBB: Loaded 6478 primary data records. [2025-10-14T22:38:17.002677] [DEBUG] [LOCAL ] HASI: Loaded 47577 existing records from primary storage. [2025-10-14T22:38:17.003522] [INFO ] [MAIN ] HASI: Loaded 47577 primary data records. [2025-10-14T22:38:17.126981] [DEBUG] [LOCAL ] HAYW: Loaded 48878 existing records from primary storage. [2025-10-14T22:38:17.127232] [INFO ] [MAIN ] HAYW: Loaded 48878 primary data records. [2025-10-14T22:38:17.525004] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:17.624182] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6478 primary records. [2025-10-14T22:38:17.637770] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-14T22:38:17.656692] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-10-14T22:38:17.657529] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-14T22:38:17.660191] [INFO ] [MAIN ] Derivative Progress: 841/1812 symbols completed. HBB took 1.0s. Estimated remaining: 6m 11s. Rate: 157.2 symbols/min [2025-10-14T22:38:17.660557] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:17.680904] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:17.681571] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47577 primary records. [2025-10-14T22:38:17.681744] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-14T22:38:17.711800] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:17.713785] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48878 primary records. [2025-10-14T22:38:17.714728] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-14T22:38:17.714636] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-14T22:38:17.715468] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-14T22:38:17.717357] [INFO ] [MAIN ] Derivative Progress: 842/1812 symbols completed. HASI took 1.1s. Estimated remaining: 6m 10s. Rate: 157.4 symbols/min [2025-10-14T22:38:17.724897] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:17.746812] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-14T22:38:17.746936] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-14T22:38:17.749046] [INFO ] [MAIN ] Derivative Progress: 843/1812 symbols completed. HAYW took 1.1s. Estimated remaining: 6m 9s. Rate: 157.6 symbols/min [2025-10-14T22:38:17.749274] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:17.767568] [DEBUG] [LOCAL ] HBI: Loaded 52982 existing records from primary storage. [2025-10-14T22:38:17.767961] [INFO ] [MAIN ] HBI: Loaded 52982 primary data records. [2025-10-14T22:38:18.107390] [DEBUG] [LOCAL ] HBM: Loaded 52944 existing records from primary storage. [2025-10-14T22:38:18.107620] [INFO ] [MAIN ] HBM: Loaded 52944 primary data records. [2025-10-14T22:38:18.210550] [DEBUG] [LOCAL ] HCA: Loaded 46950 existing records from primary storage. [2025-10-14T22:38:18.227790] [INFO ] [MAIN ] HCA: Loaded 46950 primary data records. [2025-10-14T22:38:18.770129] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:18.771151] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52982 primary records. [2025-10-14T22:38:18.771242] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-14T22:38:18.790035] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-14T22:38:18.791809] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-14T22:38:18.795055] [INFO ] [MAIN ] Derivative Progress: 844/1812 symbols completed. HBI took 1.1s. Estimated remaining: 6m 9s. Rate: 157.2 symbols/min [2025-10-14T22:38:18.795404] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:18.809308] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:18.809971] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52944 primary records. [2025-10-14T22:38:18.810141] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-14T22:38:18.842204] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:18.843039] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46950 primary records. [2025-10-14T22:38:18.843358] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-14T22:38:18.843787] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-14T22:38:18.844536] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-14T22:38:18.846613] [INFO ] [MAIN ] Derivative Progress: 845/1812 symbols completed. HBM took 1.1s. Estimated remaining: 6m 9s. Rate: 157.4 symbols/min [2025-10-14T22:38:18.846965] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:18.872408] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-14T22:38:18.872632] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-14T22:38:18.874755] [INFO ] [MAIN ] Derivative Progress: 846/1812 symbols completed. HCA took 1.1s. Estimated remaining: 6m 8s. Rate: 157.6 symbols/min [2025-10-14T22:38:18.875079] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:18.894088] [DEBUG] [LOCAL ] HCC: Loaded 45223 existing records from primary storage. [2025-10-14T22:38:18.894301] [INFO ] [MAIN ] HCC: Loaded 45223 primary data records. [2025-10-14T22:38:18.945861] [DEBUG] [LOCAL ] HCI: Loaded 14096 existing records from primary storage. [2025-10-14T22:38:19.003588] [INFO ] [MAIN ] HCI: Loaded 14096 primary data records. [2025-10-14T22:38:19.536283] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-14T22:38:19.537017] [INFO ] [MAIN ] HD: Loaded 53493 primary data records. [2025-10-14T22:38:19.872415] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:19.873289] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45223 primary records. [2025-10-14T22:38:19.873775] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-14T22:38:19.911124] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:19.912886] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14096 primary records. [2025-10-14T22:38:19.913315] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-14T22:38:19.913224] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-14T22:38:19.913427] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-14T22:38:19.916620] [INFO ] [MAIN ] Derivative Progress: 847/1812 symbols completed. HCC took 1.1s. Estimated remaining: 6m 8s. Rate: 157.2 symbols/min [2025-10-14T22:38:19.917810] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:19.936011] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-14T22:38:19.937039] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-14T22:38:19.939941] [INFO ] [MAIN ] Derivative Progress: 848/1812 symbols completed. HCI took 1.1s. Estimated remaining: 6m 7s. Rate: 157.4 symbols/min [2025-10-14T22:38:19.940175] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:19.955079] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:19.956040] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53493 primary records. [2025-10-14T22:38:19.956169] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-14T22:38:19.974206] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-14T22:38:19.974346] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-14T22:38:19.976399] [INFO ] [MAIN ] Derivative Progress: 849/1812 symbols completed. HD took 1.1s. Estimated remaining: 6m 7s. Rate: 157.6 symbols/min [2025-10-14T22:38:19.976625] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:20.031355] [DEBUG] [LOCAL ] HDB: Loaded 51927 existing records from primary storage. [2025-10-14T22:38:20.031755] [INFO ] [MAIN ] HDB: Loaded 51927 primary data records. [2025-10-14T22:38:20.086188] [DEBUG] [LOCAL ] HE: Loaded 48972 existing records from primary storage. [2025-10-14T22:38:20.111352] [INFO ] [MAIN ] HE: Loaded 48972 primary data records. [2025-10-14T22:38:20.111837] [DEBUG] [LOCAL ] HEI: Loaded 31298 existing records from primary storage. [2025-10-14T22:38:20.175739] [INFO ] [MAIN ] HEI: Loaded 31298 primary data records. [2025-10-14T22:38:21.103943] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:21.104899] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51927 primary records. [2025-10-14T22:38:21.105122] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-14T22:38:21.138280] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:21.153019] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48972 primary records. [2025-10-14T22:38:21.154252] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-14T22:38:21.156086] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:21.155597] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-14T22:38:21.163560] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-14T22:38:21.164281] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 31298 primary records. [2025-10-14T22:38:21.166083] [INFO ] [MAIN ] Derivative Progress: 850/1812 symbols completed. HDB took 1.2s. Estimated remaining: 6m 7s. Rate: 157.2 symbols/min [2025-10-14T22:38:21.170541] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:21.170378] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-14T22:38:21.176672] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-14T22:38:21.185178] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-14T22:38:21.187538] [INFO ] [MAIN ] Derivative Progress: 851/1812 symbols completed. HE took 1.2s. Estimated remaining: 6m 6s. Rate: 157.4 symbols/min [2025-10-14T22:38:21.187747] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:21.199157] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-14T22:38:21.202755] [DEBUG] [LOCAL ] HEQ: Loaded 6781 existing records from primary storage. [2025-10-14T22:38:21.202921] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-14T22:38:21.206158] [INFO ] [MAIN ] Derivative Progress: 852/1812 symbols completed. HEI took 1.2s. Estimated remaining: 6m 6s. Rate: 157.5 symbols/min [2025-10-14T22:38:21.206378] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:21.206473] [INFO ] [MAIN ] HEQ: Loaded 6781 primary data records. [2025-10-14T22:38:21.408576] [DEBUG] [LOCAL ] HFRO: Loaded 17027 existing records from primary storage. [2025-10-14T22:38:21.412602] [INFO ] [MAIN ] HFRO: Loaded 17027 primary data records. [2025-10-14T22:38:21.574196] [DEBUG] [LOCAL ] HESM: Loaded 48462 existing records from primary storage. [2025-10-14T22:38:21.588621] [INFO ] [MAIN ] HESM: Loaded 48462 primary data records. [2025-10-14T22:38:22.211312] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:22.212714] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6781 primary records. [2025-10-14T22:38:22.212815] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-14T22:38:22.244549] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:22.246706] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17027 primary records. [2025-10-14T22:38:22.246810] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-14T22:38:22.267285] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-14T22:38:22.267847] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-14T22:38:22.268514] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-14T22:38:22.268423] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-14T22:38:22.270629] [INFO ] [MAIN ] Derivative Progress: 853/1812 symbols completed. HEQ took 1.1s. Estimated remaining: 6m 6s. Rate: 157.2 symbols/min [2025-10-14T22:38:22.273162] [INFO ] [MAIN ] Derivative Progress: 854/1812 symbols completed. HFRO took 1.1s. Estimated remaining: 6m 5s. Rate: 157.4 symbols/min [2025-10-14T22:38:22.289380] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:22.290204] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48462 primary records. [2025-10-14T22:38:22.290273] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-14T22:38:22.306757] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-14T22:38:22.306856] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-14T22:38:22.310175] [INFO ] [MAIN ] Derivative Progress: 855/1812 symbols completed. HESM took 1.1s. Estimated remaining: 6m 4s. Rate: 157.6 symbols/min [2025-10-14T22:38:22.310777] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:22.311101] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:22.310903] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:22.348103] [DEBUG] [LOCAL ] HGTY: Loaded 13282 existing records from primary storage. [2025-10-14T22:38:22.347471] [DEBUG] [LOCAL ] HGLB: Loaded 9621 existing records from primary storage. [2025-10-14T22:38:22.348986] [INFO ] [MAIN ] HGLB: Loaded 9621 primary data records. [2025-10-14T22:38:22.348463] [DEBUG] [LOCAL ] HGER: Loaded 14809 existing records from primary storage. [2025-10-14T22:38:22.348754] [INFO ] [MAIN ] HGTY: Loaded 13282 primary data records. [2025-10-14T22:38:22.359636] [INFO ] [MAIN ] HGER: Loaded 14809 primary data records. [2025-10-14T22:38:23.358236] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:38:23.360471] [INFO ] [MAIN ] HGTY: Generated 1793 derivative records from 13282 primary records. [2025-10-14T22:38:23.360702] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-14T22:38:23.376403] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:23.385417] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 14809 primary records. [2025-10-14T22:38:23.387360] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-14T22:38:23.409290] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1793 records). [2025-10-14T22:38:23.416867] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-14T22:38:23.419055] [INFO ] [MAIN ] Derivative Progress: 856/1812 symbols completed. HGTY took 1.1s. Estimated remaining: 6m 5s. Rate: 157.2 symbols/min [2025-10-14T22:38:23.423320] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:23.423562] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:23.429969] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-14T22:38:23.424678] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9621 primary records. [2025-10-14T22:38:23.430093] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-14T22:38:23.430183] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-14T22:38:23.433133] [INFO ] [MAIN ] Derivative Progress: 857/1812 symbols completed. HGER took 1.1s. Estimated remaining: 6m 4s. Rate: 157.4 symbols/min [2025-10-14T22:38:23.433379] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:23.450092] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-14T22:38:23.450171] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-14T22:38:23.452106] [INFO ] [MAIN ] Derivative Progress: 858/1812 symbols completed. HGLB took 1.1s. Estimated remaining: 6m 3s. Rate: 157.6 symbols/min [2025-10-14T22:38:23.452361] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:23.493347] [DEBUG] [LOCAL ] HHH: Loaded 33198 existing records from primary storage. [2025-10-14T22:38:23.493514] [INFO ] [MAIN ] HHH: Loaded 33198 primary data records. [2025-10-14T22:38:23.600680] [DEBUG] [LOCAL ] HGV: Loaded 46382 existing records from primary storage. [2025-10-14T22:38:23.624776] [INFO ] [MAIN ] HGV: Loaded 46382 primary data records. [2025-10-14T22:38:23.760228] [DEBUG] [LOCAL ] HI: Loaded 35603 existing records from primary storage. [2025-10-14T22:38:23.791600] [INFO ] [MAIN ] HI: Loaded 35603 primary data records. [2025-10-14T22:38:24.595519] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:24.596800] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 33198 primary records. [2025-10-14T22:38:24.597001] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-14T22:38:24.596012] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:24.597785] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46382 primary records. [2025-10-14T22:38:24.599119] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-14T22:38:24.635158] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-14T22:38:24.635639] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-14T22:38:24.640436] [INFO ] [MAIN ] Derivative Progress: 859/1812 symbols completed. HHH took 1.2s. Estimated remaining: 6m 4s. Rate: 157.2 symbols/min [2025-10-14T22:38:24.641168] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:24.642779] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-14T22:38:24.643894] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-14T22:38:24.647142] [INFO ] [MAIN ] Derivative Progress: 860/1812 symbols completed. HGV took 1.2s. Estimated remaining: 6m 3s. Rate: 157.4 symbols/min [2025-10-14T22:38:24.647418] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:24.660845] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:24.661524] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35603 primary records. [2025-10-14T22:38:24.662823] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-14T22:38:24.685604] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-14T22:38:24.685785] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-14T22:38:24.688381] [INFO ] [MAIN ] Derivative Progress: 861/1812 symbols completed. HI took 1.2s. Estimated remaining: 6m 2s. Rate: 157.5 symbols/min [2025-10-14T22:38:24.688708] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:24.729282] [DEBUG] [LOCAL ] HII: Loaded 33836 existing records from primary storage. [2025-10-14T22:38:24.729476] [INFO ] [MAIN ] HII: Loaded 33836 primary data records. [2025-10-14T22:38:24.886016] [DEBUG] [LOCAL ] HIG: Loaded 51171 existing records from primary storage. [2025-10-14T22:38:24.886193] [INFO ] [MAIN ] HIG: Loaded 51171 primary data records. [2025-10-14T22:38:25.121267] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-14T22:38:25.244397] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-14T22:38:25.837799] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:25.840025] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 33836 primary records. [2025-10-14T22:38:25.840151] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-14T22:38:25.877570] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-14T22:38:25.878413] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-14T22:38:25.878217] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:25.880515] [INFO ] [MAIN ] Derivative Progress: 862/1812 symbols completed. HII took 1.2s. Estimated remaining: 6m 3s. Rate: 157.1 symbols/min [2025-10-14T22:38:25.880712] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:25.882313] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51171 primary records. [2025-10-14T22:38:25.882587] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-14T22:38:25.904152] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-14T22:38:25.904403] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-14T22:38:25.907345] [INFO ] [MAIN ] Derivative Progress: 863/1812 symbols completed. HIG took 1.3s. Estimated remaining: 6m 2s. Rate: 157.3 symbols/min [2025-10-14T22:38:25.907944] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:25.932369] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:25.933468] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-14T22:38:25.933637] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-14T22:38:25.962554] [DEBUG] [LOCAL ] HIO: Loaded 24147 existing records from primary storage. [2025-10-14T22:38:25.964313] [INFO ] [MAIN ] HIO: Loaded 24147 primary data records. [2025-10-14T22:38:25.985494] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-14T22:38:25.995446] [DEBUG] [LOCAL ] HIPO: Loaded 21934 existing records from primary storage. [2025-10-14T22:38:26.011421] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-14T22:38:26.020970] [INFO ] [MAIN ] Derivative Progress: 864/1812 symbols completed. HIMS took 1.3s. Estimated remaining: 6m 1s. Rate: 157.4 symbols/min [2025-10-14T22:38:26.011587] [INFO ] [MAIN ] HIPO: Loaded 21934 primary data records. [2025-10-14T22:38:26.084593] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:26.624285] [DEBUG] [LOCAL ] HIW: Loaded 44584 existing records from primary storage. [2025-10-14T22:38:26.625627] [INFO ] [MAIN ] HIW: Loaded 44584 primary data records. [2025-10-14T22:38:26.762982] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:26.786924] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24147 primary records. [2025-10-14T22:38:26.796046] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-14T22:38:27.003761] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-14T22:38:27.005610] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-14T22:38:27.008118] [INFO ] [MAIN ] Derivative Progress: 865/1812 symbols completed. HIO took 1.1s. Estimated remaining: 6m 2s. Rate: 157.1 symbols/min [2025-10-14T22:38:27.009220] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:27.025210] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:27.026700] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 21934 primary records. [2025-10-14T22:38:27.027245] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-14T22:38:27.054019] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-14T22:38:27.054273] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-14T22:38:27.056515] [INFO ] [MAIN ] Derivative Progress: 866/1812 symbols completed. HIPO took 1.1s. Estimated remaining: 6m 1s. Rate: 157.3 symbols/min [2025-10-14T22:38:27.056870] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:27.071861] [DEBUG] [LOCAL ] HIX: Loaded 20500 existing records from primary storage. [2025-10-14T22:38:27.072144] [INFO ] [MAIN ] HIX: Loaded 20500 primary data records. [2025-10-14T22:38:27.196116] [DEBUG] [LOCAL ] HKD: Loaded 18591 existing records from primary storage. [2025-10-14T22:38:27.215302] [INFO ] [MAIN ] HKD: Loaded 18591 primary data records. [2025-10-14T22:38:27.221610] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:27.317966] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44584 primary records. [2025-10-14T22:38:27.378875] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-14T22:38:27.758773] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-14T22:38:27.759064] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-14T22:38:27.761442] [INFO ] [MAIN ] Derivative Progress: 867/1812 symbols completed. HIW took 1.7s. Estimated remaining: 6m 1s. Rate: 157.1 symbols/min [2025-10-14T22:38:27.762628] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:27.787357] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:27.789515] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20500 primary records. [2025-10-14T22:38:27.789760] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-14T22:38:27.820263] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-14T22:38:27.820580] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:27.820812] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-14T22:38:27.822871] [INFO ] [MAIN ] Derivative Progress: 868/1812 symbols completed. HIX took 0.8s. Estimated remaining: 6m 0s. Rate: 157.3 symbols/min [2025-10-14T22:38:27.823639] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18591 primary records. [2025-10-14T22:38:27.823786] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-14T22:38:27.853419] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-14T22:38:27.853595] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-14T22:38:27.855816] [INFO ] [MAIN ] Derivative Progress: 869/1812 symbols completed. HKD took 0.8s. Estimated remaining: 5m 59s. Rate: 157.5 symbols/min [2025-10-14T22:38:27.874136] [DEBUG] [LOCAL ] HL: Loaded 53673 existing records from primary storage. [2025-10-14T22:38:27.874273] [INFO ] [MAIN ] HL: Loaded 53673 primary data records. [2025-10-14T22:38:28.177302] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:28.177991] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53673 primary records. [2025-10-14T22:38:28.178055] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-14T22:38:28.192555] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-14T22:38:28.192614] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-14T22:38:28.194451] [INFO ] [MAIN ] Derivative Progress: 870/1812 symbols completed. HL took 0.4s. Estimated remaining: 5m 59s. Rate: 157.5 symbols/min [2025-10-14T22:38:28.195092] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:28.195191] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:28.195291] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:28.248257] [DEBUG] [LOCAL ] HLIO: Loaded 28076 existing records from primary storage. [2025-10-14T22:38:28.248416] [INFO ] [MAIN ] HLIO: Loaded 28076 primary data records. [2025-10-14T22:38:28.368063] [DEBUG] [LOCAL ] HLI: Loaded 30898 existing records from primary storage. [2025-10-14T22:38:28.376126] [INFO ] [MAIN ] HLI: Loaded 30898 primary data records. [2025-10-14T22:38:28.377066] [DEBUG] [LOCAL ] HLF: Loaded 48505 existing records from primary storage. [2025-10-14T22:38:28.407959] [INFO ] [MAIN ] HLF: Loaded 48505 primary data records. [2025-10-14T22:38:29.220659] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:29.221531] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28076 primary records. [2025-10-14T22:38:29.221865] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-14T22:38:29.244449] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-14T22:38:29.244722] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-14T22:38:29.247298] [INFO ] [MAIN ] Derivative Progress: 871/1812 symbols completed. HLIO took 1.1s. Estimated remaining: 5m 59s. Rate: 157.2 symbols/min [2025-10-14T22:38:29.247610] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:29.272891] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:29.273891] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30898 primary records. [2025-10-14T22:38:29.274278] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-14T22:38:29.274140] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:29.288676] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48505 primary records. [2025-10-14T22:38:29.289078] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-14T22:38:29.292349] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-14T22:38:29.292751] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-14T22:38:29.294914] [INFO ] [MAIN ] Derivative Progress: 872/1812 symbols completed. HLI took 1.1s. Estimated remaining: 5m 58s. Rate: 157.3 symbols/min [2025-10-14T22:38:29.295315] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:29.320094] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-14T22:38:29.320271] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-14T22:38:29.322460] [INFO ] [MAIN ] Derivative Progress: 873/1812 symbols completed. HLF took 1.1s. Estimated remaining: 5m 58s. Rate: 157.5 symbols/min [2025-10-14T22:38:29.322620] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:29.335675] [DEBUG] [LOCAL ] HLLY: Loaded 33534 existing records from primary storage. [2025-10-14T22:38:29.335878] [INFO ] [MAIN ] HLLY: Loaded 33534 primary data records. [2025-10-14T22:38:29.674923] [DEBUG] [LOCAL ] HLN: Loaded 53117 existing records from primary storage. [2025-10-14T22:38:29.675242] [INFO ] [MAIN ] HLN: Loaded 53117 primary data records. [2025-10-14T22:38:29.781008] [DEBUG] [LOCAL ] HLT: Loaded 50550 existing records from primary storage. [2025-10-14T22:38:29.801678] [INFO ] [MAIN ] HLT: Loaded 50550 primary data records. [2025-10-14T22:38:30.320621] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:30.321412] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33534 primary records. [2025-10-14T22:38:30.323058] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-14T22:38:30.340025] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-14T22:38:30.340320] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-14T22:38:30.342921] [INFO ] [MAIN ] Derivative Progress: 874/1812 symbols completed. HLLY took 1.1s. Estimated remaining: 5m 58s. Rate: 157.2 symbols/min [2025-10-14T22:38:30.343167] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:30.364522] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:30.365377] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53117 primary records. [2025-10-14T22:38:30.365583] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-14T22:38:30.406159] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:30.407751] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50550 primary records. [2025-10-14T22:38:30.408168] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-14T22:38:30.419212] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-14T22:38:30.421935] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-14T22:38:30.426548] [INFO ] [MAIN ] Derivative Progress: 875/1812 symbols completed. HLN took 1.1s. Estimated remaining: 5m 57s. Rate: 157.3 symbols/min [2025-10-14T22:38:30.428439] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:30.443746] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-14T22:38:30.443902] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-14T22:38:30.445929] [INFO ] [MAIN ] Derivative Progress: 876/1812 symbols completed. HLT took 1.1s. Estimated remaining: 5m 57s. Rate: 157.5 symbols/min [2025-10-14T22:38:30.446914] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:30.446807] [DEBUG] [LOCAL ] HLX: Loaded 47440 existing records from primary storage. [2025-10-14T22:38:30.447493] [INFO ] [MAIN ] HLX: Loaded 47440 primary data records. [2025-10-14T22:38:30.640697] [DEBUG] [LOCAL ] HMN: Loaded 23474 existing records from primary storage. [2025-10-14T22:38:30.775529] [INFO ] [MAIN ] HMN: Loaded 23474 primary data records. [2025-10-14T22:38:30.886449] [DEBUG] [LOCAL ] HMC: Loaded 46526 existing records from primary storage. [2025-10-14T22:38:30.904487] [INFO ] [MAIN ] HMC: Loaded 46526 primary data records. [2025-10-14T22:38:31.443178] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:31.444345] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47440 primary records. [2025-10-14T22:38:31.444616] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-14T22:38:31.463151] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-14T22:38:31.465026] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-14T22:38:31.467036] [INFO ] [MAIN ] Derivative Progress: 877/1812 symbols completed. HLX took 1.1s. Estimated remaining: 5m 57s. Rate: 157.2 symbols/min [2025-10-14T22:38:31.467283] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:31.481400] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:31.482110] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23474 primary records. [2025-10-14T22:38:31.482306] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-14T22:38:31.514416] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:31.514511] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-14T22:38:31.514764] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-14T22:38:31.515498] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46526 primary records. [2025-10-14T22:38:31.517609] [INFO ] [MAIN ] Derivative Progress: 878/1812 symbols completed. HMN took 1.1s. Estimated remaining: 5m 56s. Rate: 157.4 symbols/min [2025-10-14T22:38:31.517778] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:31.518332] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-14T22:38:31.535552] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-14T22:38:31.535727] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-14T22:38:31.537959] [INFO ] [MAIN ] Derivative Progress: 879/1812 symbols completed. HMC took 1.1s. Estimated remaining: 5m 55s. Rate: 157.5 symbols/min [2025-10-14T22:38:31.538250] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:31.573141] [DEBUG] [LOCAL ] HNI: Loaded 29528 existing records from primary storage. [2025-10-14T22:38:31.573951] [INFO ] [MAIN ] HNI: Loaded 29528 primary data records. [2025-10-14T22:38:31.666991] [DEBUG] [LOCAL ] HMY: Loaded 53167 existing records from primary storage. [2025-10-14T22:38:31.691426] [INFO ] [MAIN ] HMY: Loaded 53167 primary data records. [2025-10-14T22:38:32.052880] [DEBUG] [LOCAL ] HOG: Loaded 50858 existing records from primary storage. [2025-10-14T22:38:32.079056] [INFO ] [MAIN ] HOG: Loaded 50858 primary data records. [2025-10-14T22:38:32.553105] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:32.553914] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29528 primary records. [2025-10-14T22:38:32.554115] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-14T22:38:32.573462] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-14T22:38:32.586159] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:32.587173] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53167 primary records. [2025-10-14T22:38:32.586484] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-14T22:38:32.589458] [INFO ] [MAIN ] Derivative Progress: 880/1812 symbols completed. HNI took 1.1s. Estimated remaining: 5m 56s. Rate: 157.2 symbols/min [2025-10-14T22:38:32.589531] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-14T22:38:32.589850] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:32.618146] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:32.619715] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 50858 primary records. [2025-10-14T22:38:32.620728] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-14T22:38:32.634047] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-14T22:38:32.637191] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-14T22:38:32.640469] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-14T22:38:32.640622] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-14T22:38:32.639247] [INFO ] [MAIN ] Derivative Progress: 881/1812 symbols completed. HMY took 1.2s. Estimated remaining: 5m 55s. Rate: 157.4 symbols/min [2025-10-14T22:38:32.643780] [INFO ] [MAIN ] Derivative Progress: 882/1812 symbols completed. HOG took 1.1s. Estimated remaining: 5m 54s. Rate: 157.5 symbols/min [2025-10-14T22:38:32.644072] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:32.643713] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:32.670142] [DEBUG] [LOCAL ] HOV: Loaded 14015 existing records from primary storage. [2025-10-14T22:38:32.670550] [INFO ] [MAIN ] HOV: Loaded 14015 primary data records. [2025-10-14T22:38:32.747847] [DEBUG] [LOCAL ] HOMB: Loaded 43570 existing records from primary storage. [2025-10-14T22:38:32.753688] [INFO ] [MAIN ] HOMB: Loaded 43570 primary data records. [2025-10-14T22:38:32.950211] [DEBUG] [LOCAL ] HOUS: Loaded 45217 existing records from primary storage. [2025-10-14T22:38:32.965872] [INFO ] [MAIN ] HOUS: Loaded 45217 primary data records. [2025-10-14T22:38:33.709581] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:33.717978] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 14015 primary records. [2025-10-14T22:38:33.722611] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-14T22:38:33.723957] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:33.724568] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43570 primary records. [2025-10-14T22:38:33.731521] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-14T22:38:33.752030] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-10-14T22:38:33.755334] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-14T22:38:33.755127] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-14T22:38:33.757423] [INFO ] [MAIN ] Derivative Progress: 883/1812 symbols completed. HOV took 1.1s. Estimated remaining: 5m 55s. Rate: 157.2 symbols/min [2025-10-14T22:38:33.755460] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-14T22:38:33.759935] [INFO ] [MAIN ] Derivative Progress: 884/1812 symbols completed. HOMB took 1.2s. Estimated remaining: 5m 54s. Rate: 157.4 symbols/min [2025-10-14T22:38:33.775103] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:33.775668] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 45217 primary records. [2025-10-14T22:38:33.775733] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-14T22:38:33.790826] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-14T22:38:33.790886] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-14T22:38:33.793158] [INFO ] [MAIN ] Derivative Progress: 885/1812 symbols completed. HOUS took 1.1s. Estimated remaining: 5m 53s. Rate: 157.5 symbols/min [2025-10-14T22:38:33.793524] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:33.793714] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:33.793580] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:33.805895] [DEBUG] [LOCAL ] HPF: Loaded 7523 existing records from primary storage. [2025-10-14T22:38:33.806155] [INFO ] [MAIN ] HPF: Loaded 7523 primary data records. [2025-10-14T22:38:34.177510] [DEBUG] [LOCAL ] HP: Loaded 51534 existing records from primary storage. [2025-10-14T22:38:34.192143] [INFO ] [MAIN ] HP: Loaded 51534 primary data records. [2025-10-14T22:38:34.230488] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-14T22:38:34.249903] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-14T22:38:34.860164] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:34.861517] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7523 primary records. [2025-10-14T22:38:34.861824] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-14T22:38:34.879324] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-14T22:38:34.879580] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-14T22:38:34.882099] [INFO ] [MAIN ] Derivative Progress: 886/1812 symbols completed. HPF took 1.1s. Estimated remaining: 5m 53s. Rate: 157.2 symbols/min [2025-10-14T22:38:34.882328] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:34.909209] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:34.909467] [DEBUG] [LOCAL ] HPI: Loaded 10657 existing records from primary storage. [2025-10-14T22:38:34.910794] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51534 primary records. [2025-10-14T22:38:34.910004] [INFO ] [MAIN ] HPI: Loaded 10657 primary data records. [2025-10-14T22:38:34.910969] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-14T22:38:35.012201] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-14T22:38:35.046815] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-14T22:38:35.047102] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:35.049301] [INFO ] [MAIN ] Derivative Progress: 887/1812 symbols completed. HP took 1.3s. Estimated remaining: 5m 53s. Rate: 157.3 symbols/min [2025-10-14T22:38:35.049497] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:35.050722] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-14T22:38:35.056628] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-14T22:38:35.145984] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-14T22:38:35.146205] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-14T22:38:35.250959] [INFO ] [MAIN ] Derivative Progress: 888/1812 symbols completed. HPE took 1.5s. Estimated remaining: 5m 52s. Rate: 157.4 symbols/min [2025-10-14T22:38:35.264909] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:35.310520] [DEBUG] [LOCAL ] HPP: Loaded 51172 existing records from primary storage. [2025-10-14T22:38:35.311018] [INFO ] [MAIN ] HPP: Loaded 51172 primary data records. [2025-10-14T22:38:35.447707] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:35.448501] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10657 primary records. [2025-10-14T22:38:35.460194] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-14T22:38:35.519252] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-14T22:38:35.529684] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-10-14T22:38:35.592369] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-14T22:38:35.697107] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-14T22:38:35.720989] [INFO ] [MAIN ] Derivative Progress: 889/1812 symbols completed. HPI took 0.8s. Estimated remaining: 5m 52s. Rate: 157.4 symbols/min [2025-10-14T22:38:35.747862] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:35.876042] [DEBUG] [LOCAL ] HPS: Loaded 10340 existing records from primary storage. [2025-10-14T22:38:35.995981] [INFO ] [MAIN ] HPS: Loaded 10340 primary data records. [2025-10-14T22:38:36.319638] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:36.320620] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51172 primary records. [2025-10-14T22:38:36.320847] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-14T22:38:36.339366] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-14T22:38:36.339728] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-14T22:38:36.341909] [INFO ] [MAIN ] Derivative Progress: 890/1812 symbols completed. HPP took 1.3s. Estimated remaining: 5m 52s. Rate: 157.2 symbols/min [2025-10-14T22:38:36.342235] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:36.364021] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:36.365244] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-10-14T22:38:36.365593] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-14T22:38:36.392154] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-14T22:38:36.400785] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-14T22:38:36.403015] [INFO ] [MAIN ] Derivative Progress: 891/1812 symbols completed. HPQ took 1.1s. Estimated remaining: 5m 51s. Rate: 157.4 symbols/min [2025-10-14T22:38:36.406002] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:36.406529] [DEBUG] [LOCAL ] HQH: Loaded 25740 existing records from primary storage. [2025-10-14T22:38:36.407482] [INFO ] [MAIN ] HQH: Loaded 25740 primary data records. [2025-10-14T22:38:36.468277] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:36.495820] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10340 primary records. [2025-10-14T22:38:36.524956] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-14T22:38:36.545354] [DEBUG] [LOCAL ] HQL: Loaded 16824 existing records from primary storage. [2025-10-14T22:38:36.567079] [INFO ] [MAIN ] HQL: Loaded 16824 primary data records. [2025-10-14T22:38:36.571112] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-14T22:38:36.581592] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-14T22:38:36.600411] [INFO ] [MAIN ] Derivative Progress: 892/1812 symbols completed. HPS took 0.9s. Estimated remaining: 5m 51s. Rate: 157.5 symbols/min [2025-10-14T22:38:36.614665] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:37.151838] [DEBUG] [LOCAL ] HR: Loaded 52103 existing records from primary storage. [2025-10-14T22:38:37.154015] [INFO ] [MAIN ] HR: Loaded 52103 primary data records. [2025-10-14T22:38:37.238202] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:37.250988] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25740 primary records. [2025-10-14T22:38:37.261995] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-14T22:38:37.464789] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-14T22:38:37.477831] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-14T22:38:37.480346] [INFO ] [MAIN ] Derivative Progress: 893/1812 symbols completed. HQH took 1.1s. Estimated remaining: 5m 51s. Rate: 157.2 symbols/min [2025-10-14T22:38:37.480802] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:37.494875] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:37.495735] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16824 primary records. [2025-10-14T22:38:37.496113] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-14T22:38:37.513382] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-14T22:38:37.514050] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-14T22:38:37.516437] [INFO ] [MAIN ] Derivative Progress: 894/1812 symbols completed. HQL took 1.1s. Estimated remaining: 5m 50s. Rate: 157.4 symbols/min [2025-10-14T22:38:37.516584] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:37.551770] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:37.562201] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 52103 primary records. [2025-10-14T22:38:37.562378] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-14T22:38:37.588893] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-14T22:38:37.589507] [DEBUG] [LOCAL ] HRI: Loaded 32458 existing records from primary storage. [2025-10-14T22:38:37.589601] [INFO ] [MAIN ] HRI: Loaded 32458 primary data records. [2025-10-14T22:38:37.589778] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-14T22:38:37.612886] [INFO ] [MAIN ] Derivative Progress: 895/1812 symbols completed. HR took 1.0s. Estimated remaining: 5m 49s. Rate: 157.5 symbols/min [2025-10-14T22:38:37.641196] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:37.716173] [DEBUG] [LOCAL ] HRB: Loaded 48355 existing records from primary storage. [2025-10-14T22:38:37.732580] [INFO ] [MAIN ] HRB: Loaded 48355 primary data records. [2025-10-14T22:38:38.246193] [DEBUG] [LOCAL ] HRL: Loaded 53119 existing records from primary storage. [2025-10-14T22:38:38.248112] [INFO ] [MAIN ] HRL: Loaded 53119 primary data records. [2025-10-14T22:38:38.559512] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:38.573996] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32458 primary records. [2025-10-14T22:38:38.574441] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-14T22:38:38.609181] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-10-14T22:38:38.608775] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:38.610214] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48355 primary records. [2025-10-14T22:38:38.610636] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-14T22:38:38.611275] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-14T22:38:38.613730] [INFO ] [MAIN ] Derivative Progress: 896/1812 symbols completed. HRI took 1.1s. Estimated remaining: 5m 50s. Rate: 157.2 symbols/min [2025-10-14T22:38:38.613880] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:38.630316] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-14T22:38:38.630825] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-14T22:38:38.633146] [INFO ] [MAIN ] Derivative Progress: 897/1812 symbols completed. HRB took 1.2s. Estimated remaining: 5m 49s. Rate: 157.4 symbols/min [2025-10-14T22:38:38.633378] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:38.654043] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:38.654794] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53119 primary records. [2025-10-14T22:38:38.663341] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-14T22:38:38.680143] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-14T22:38:38.680312] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-14T22:38:38.683107] [INFO ] [MAIN ] Derivative Progress: 898/1812 symbols completed. HRL took 1.0s. Estimated remaining: 5m 48s. Rate: 157.6 symbols/min [2025-10-14T22:38:38.694011] [DEBUG] [LOCAL ] HRTG: Loaded 34286 existing records from primary storage. [2025-10-14T22:38:38.708028] [INFO ] [MAIN ] HRTG: Loaded 34286 primary data records. [2025-10-14T22:38:38.848490] [DEBUG] [LOCAL ] HSBC: Loaded 50997 existing records from primary storage. [2025-10-14T22:38:38.866784] [INFO ] [MAIN ] HSBC: Loaded 50997 primary data records. [2025-10-14T22:38:39.358985] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:39.359758] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 34286 primary records. [2025-10-14T22:38:39.360042] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-14T22:38:39.377820] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-14T22:38:39.377923] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-14T22:38:39.380476] [INFO ] [MAIN ] Derivative Progress: 899/1812 symbols completed. HRTG took 0.8s. Estimated remaining: 5m 48s. Rate: 157.4 symbols/min [2025-10-14T22:38:39.393133] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:39.393755] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 50997 primary records. [2025-10-14T22:38:39.393816] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-14T22:38:39.408637] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-14T22:38:39.408724] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-14T22:38:39.410907] [INFO ] [MAIN ] Derivative Progress: 900/1812 symbols completed. HSBC took 0.8s. Estimated remaining: 5m 47s. Rate: 157.6 symbols/min [2025-10-14T22:38:39.411302] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:39.411444] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:39.411586] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:39.438446] [DEBUG] [LOCAL ] HTD: Loaded 14145 existing records from primary storage. [2025-10-14T22:38:39.438146] [DEBUG] [LOCAL ] HSHP: Loaded 14927 existing records from primary storage. [2025-10-14T22:38:39.438749] [INFO ] [MAIN ] HTD: Loaded 14145 primary data records. [2025-10-14T22:38:39.459622] [INFO ] [MAIN ] HSHP: Loaded 14927 primary data records. [2025-10-14T22:38:39.953562] [DEBUG] [LOCAL ] HSY: Loaded 50417 existing records from primary storage. [2025-10-14T22:38:40.054129] [INFO ] [MAIN ] HSY: Loaded 50417 primary data records. [2025-10-14T22:38:40.405055] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:40.419399] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 14145 primary records. [2025-10-14T22:38:40.419969] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-14T22:38:40.419728] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:40.421864] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 14927 primary records. [2025-10-14T22:38:40.433058] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-14T22:38:40.452696] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-14T22:38:40.453590] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-14T22:38:40.453757] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-14T22:38:40.453813] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-14T22:38:40.456076] [INFO ] [MAIN ] Derivative Progress: 901/1812 symbols completed. HTD took 1.0s. Estimated remaining: 5m 48s. Rate: 157.3 symbols/min [2025-10-14T22:38:40.457189] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:40.460355] [INFO ] [MAIN ] Derivative Progress: 902/1812 symbols completed. HSHP took 1.0s. Estimated remaining: 5m 47s. Rate: 157.5 symbols/min [2025-10-14T22:38:40.461403] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:40.475210] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:40.476011] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50417 primary records. [2025-10-14T22:38:40.476141] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-14T22:38:40.492390] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-14T22:38:40.492564] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-14T22:38:40.495281] [INFO ] [MAIN ] Derivative Progress: 903/1812 symbols completed. HSY took 1.1s. Estimated remaining: 5m 46s. Rate: 157.6 symbols/min [2025-10-14T22:38:40.502076] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:40.538780] [DEBUG] [LOCAL ] HTH: Loaded 32540 existing records from primary storage. [2025-10-14T22:38:40.538982] [INFO ] [MAIN ] HTH: Loaded 32540 primary data records. [2025-10-14T22:38:40.653153] [DEBUG] [LOCAL ] HTGC: Loaded 47691 existing records from primary storage. [2025-10-14T22:38:40.661028] [INFO ] [MAIN ] HTGC: Loaded 47691 primary data records. [2025-10-14T22:38:40.772191] [DEBUG] [LOCAL ] HUBB: Loaded 36488 existing records from primary storage. [2025-10-14T22:38:40.926902] [INFO ] [MAIN ] HUBB: Loaded 36488 primary data records. [2025-10-14T22:38:41.530194] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:41.530993] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32540 primary records. [2025-10-14T22:38:41.531084] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-14T22:38:41.551343] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-14T22:38:41.551437] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-14T22:38:41.554394] [INFO ] [MAIN ] Derivative Progress: 904/1812 symbols completed. HTH took 1.1s. Estimated remaining: 5m 46s. Rate: 157.3 symbols/min [2025-10-14T22:38:41.554849] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:41.569188] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:41.570130] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47691 primary records. [2025-10-14T22:38:41.570409] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-14T22:38:41.587378] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-14T22:38:41.587539] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-14T22:38:41.591425] [INFO ] [MAIN ] Derivative Progress: 905/1812 symbols completed. HTGC took 1.1s. Estimated remaining: 5m 46s. Rate: 157.5 symbols/min [2025-10-14T22:38:41.591667] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:41.607389] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:41.608158] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36488 primary records. [2025-10-14T22:38:41.608317] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-14T22:38:41.633514] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-14T22:38:41.633773] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-14T22:38:41.636175] [INFO ] [MAIN ] Derivative Progress: 906/1812 symbols completed. HUBB took 1.1s. Estimated remaining: 5m 45s. Rate: 157.6 symbols/min [2025-10-14T22:38:41.636433] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:41.651796] [DEBUG] [LOCAL ] HUBS: Loaded 40047 existing records from primary storage. [2025-10-14T22:38:41.651986] [INFO ] [MAIN ] HUBS: Loaded 40047 primary data records. [2025-10-14T22:38:41.962289] [DEBUG] [LOCAL ] HUM: Loaded 49228 existing records from primary storage. [2025-10-14T22:38:41.989499] [INFO ] [MAIN ] HUM: Loaded 49228 primary data records. [2025-10-14T22:38:42.113373] [DEBUG] [LOCAL ] HUN: Loaded 53215 existing records from primary storage. [2025-10-14T22:38:42.113743] [INFO ] [MAIN ] HUN: Loaded 53215 primary data records. [2025-10-14T22:38:42.677051] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:42.678465] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 40047 primary records. [2025-10-14T22:38:42.678743] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-14T22:38:42.696081] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-10-14T22:38:42.696606] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-14T22:38:42.698764] [INFO ] [MAIN ] Derivative Progress: 907/1812 symbols completed. HUBS took 1.1s. Estimated remaining: 5m 45s. Rate: 157.3 symbols/min [2025-10-14T22:38:42.699157] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:42.716461] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:42.717209] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 49228 primary records. [2025-10-14T22:38:42.717352] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-14T22:38:42.752533] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-10-14T22:38:42.753479] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-14T22:38:42.757225] [INFO ] [MAIN ] Derivative Progress: 908/1812 symbols completed. HUM took 1.2s. Estimated remaining: 5m 44s. Rate: 157.4 symbols/min [2025-10-14T22:38:42.757663] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:42.757966] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:42.759176] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53215 primary records. [2025-10-14T22:38:42.759333] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-14T22:38:42.803852] [DEBUG] [LOCAL ] HUYA: Loaded 43846 existing records from primary storage. [2025-10-14T22:38:42.804356] [INFO ] [MAIN ] HUYA: Loaded 43846 primary data records. [2025-10-14T22:38:42.804428] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-14T22:38:42.841407] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-14T22:38:42.878197] [INFO ] [MAIN ] Derivative Progress: 909/1812 symbols completed. HUN took 1.2s. Estimated remaining: 5m 44s. Rate: 157.6 symbols/min [2025-10-14T22:38:42.853676] [DEBUG] [LOCAL ] HVT: Loaded 15153 existing records from primary storage. [2025-10-14T22:38:42.878434] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:42.884071] [INFO ] [MAIN ] HVT: Loaded 15153 primary data records. [2025-10-14T22:38:43.432352] [DEBUG] [LOCAL ] HWM: Loaded 52852 existing records from primary storage. [2025-10-14T22:38:43.434140] [INFO ] [MAIN ] HWM: Loaded 52852 primary data records. [2025-10-14T22:38:43.784960] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:43.787274] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43846 primary records. [2025-10-14T22:38:43.788957] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-14T22:38:43.840325] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:43.843560] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15153 primary records. [2025-10-14T22:38:43.842537] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-14T22:38:43.844470] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-14T22:38:43.847004] [INFO ] [MAIN ] Derivative Progress: 910/1812 symbols completed. HUYA took 1.1s. Estimated remaining: 5m 44s. Rate: 157.3 symbols/min [2025-10-14T22:38:43.847385] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:43.847497] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-14T22:38:43.894731] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-14T22:38:43.895402] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-14T22:38:43.895150] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:43.898398] [INFO ] [MAIN ] Derivative Progress: 911/1812 symbols completed. HVT took 1.1s. Estimated remaining: 5m 43s. Rate: 157.4 symbols/min [2025-10-14T22:38:43.899787] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52852 primary records. [2025-10-14T22:38:43.899894] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-14T22:38:43.900719] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:43.944403] [DEBUG] [LOCAL ] HY: Loaded 10030 existing records from primary storage. [2025-10-14T22:38:43.966121] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-14T22:38:43.966414] [INFO ] [MAIN ] HY: Loaded 10030 primary data records. [2025-10-14T22:38:43.980994] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-14T22:38:43.985619] [DEBUG] [LOCAL ] HXL: Loaded 45870 existing records from primary storage. [2025-10-14T22:38:43.984155] [INFO ] [MAIN ] Derivative Progress: 912/1812 symbols completed. HWM took 1.1s. Estimated remaining: 5m 43s. Rate: 157.6 symbols/min [2025-10-14T22:38:43.997765] [INFO ] [MAIN ] HXL: Loaded 45870 primary data records. [2025-10-14T22:38:44.027048] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:44.234317] [DEBUG] [LOCAL ] HYI: Loaded 9904 existing records from primary storage. [2025-10-14T22:38:44.289466] [INFO ] [MAIN ] HYI: Loaded 9904 primary data records. [2025-10-14T22:38:45.148945] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:45.164232] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:45.166749] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45870 primary records. [2025-10-14T22:38:45.167965] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10030 primary records. [2025-10-14T22:38:45.168150] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-14T22:38:45.168457] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-14T22:38:45.197679] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:45.211730] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9904 primary records. [2025-10-14T22:38:45.213052] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-14T22:38:45.214816] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-14T22:38:45.215859] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-14T22:38:45.218235] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-14T22:38:45.220489] [INFO ] [MAIN ] Derivative Progress: 913/1812 symbols completed. HXL took 1.4s. Estimated remaining: 5m 43s. Rate: 157.2 symbols/min [2025-10-14T22:38:45.221259] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-14T22:38:45.223405] [INFO ] [MAIN ] Derivative Progress: 914/1812 symbols completed. HY took 1.3s. Estimated remaining: 5m 42s. Rate: 157.4 symbols/min [2025-10-14T22:38:45.238086] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-14T22:38:45.238153] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-14T22:38:45.240591] [INFO ] [MAIN ] Derivative Progress: 915/1812 symbols completed. HYI took 1.2s. Estimated remaining: 5m 42s. Rate: 157.5 symbols/min [2025-10-14T22:38:45.240990] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:45.241112] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:45.241520] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:45.248479] [DEBUG] [LOCAL ] HYTR: Loaded 3124 existing records from primary storage. [2025-10-14T22:38:45.248662] [INFO ] [MAIN ] HYTR: Loaded 3124 primary data records. [2025-10-14T22:38:45.579545] [DEBUG] [LOCAL ] HYT: Loaded 33676 existing records from primary storage. [2025-10-14T22:38:45.581052] [INFO ] [MAIN ] HYT: Loaded 33676 primary data records. [2025-10-14T22:38:45.580946] [DEBUG] [LOCAL ] HZO: Loaded 29123 existing records from primary storage. [2025-10-14T22:38:45.581286] [INFO ] [MAIN ] HZO: Loaded 29123 primary data records. [2025-10-14T22:38:46.217811] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:38:46.219393] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3124 primary records. [2025-10-14T22:38:46.219637] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-14T22:38:46.239516] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-14T22:38:46.239779] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-14T22:38:46.242184] [INFO ] [MAIN ] Derivative Progress: 916/1812 symbols completed. HYTR took 1.0s. Estimated remaining: 5m 42s. Rate: 157.2 symbols/min [2025-10-14T22:38:46.243163] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:46.262254] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:46.263526] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29123 primary records. [2025-10-14T22:38:46.264017] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-14T22:38:46.268119] [DEBUG] [LOCAL ] IAE: Loaded 6255 existing records from primary storage. [2025-10-14T22:38:46.268971] [INFO ] [MAIN ] IAE: Loaded 6255 primary data records. [2025-10-14T22:38:46.353078] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-14T22:38:46.373332] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-14T22:38:46.386197] [INFO ] [MAIN ] Derivative Progress: 917/1812 symbols completed. HZO took 1.1s. Estimated remaining: 5m 41s. Rate: 157.4 symbols/min [2025-10-14T22:38:46.392133] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:46.410180] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:46.409964] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33676 primary records. [2025-10-14T22:38:46.411275] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-14T22:38:46.622633] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-14T22:38:46.622962] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-14T22:38:46.625242] [INFO ] [MAIN ] Derivative Progress: 918/1812 symbols completed. HYT took 1.4s. Estimated remaining: 5m 41s. Rate: 157.4 symbols/min [2025-10-14T22:38:46.625703] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:46.664164] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:46.679342] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6255 primary records. [2025-10-14T22:38:46.679479] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-14T22:38:46.682374] [DEBUG] [LOCAL ] IAG: Loaded 53488 existing records from primary storage. [2025-10-14T22:38:46.688841] [INFO ] [MAIN ] IAG: Loaded 53488 primary data records. [2025-10-14T22:38:46.820514] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-14T22:38:46.821205] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-14T22:38:46.823593] [INFO ] [MAIN ] Derivative Progress: 919/1812 symbols completed. IAE took 0.6s. Estimated remaining: 5m 40s. Rate: 157.5 symbols/min [2025-10-14T22:38:46.834144] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:46.918153] [DEBUG] [LOCAL ] IBM: Loaded 53632 existing records from primary storage. [2025-10-14T22:38:47.049599] [INFO ] [MAIN ] IBM: Loaded 53632 primary data records. [2025-10-14T22:38:47.389859] [DEBUG] [LOCAL ] IBN: Loaded 52809 existing records from primary storage. [2025-10-14T22:38:47.390369] [INFO ] [MAIN ] IBN: Loaded 52809 primary data records. [2025-10-14T22:38:47.535156] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:47.552043] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53488 primary records. [2025-10-14T22:38:47.574802] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-14T22:38:47.751898] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-14T22:38:47.752726] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-14T22:38:47.755629] [INFO ] [MAIN ] Derivative Progress: 920/1812 symbols completed. IAG took 1.3s. Estimated remaining: 5m 40s. Rate: 157.3 symbols/min [2025-10-14T22:38:47.755978] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:47.773954] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:47.774869] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53632 primary records. [2025-10-14T22:38:47.774969] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-14T22:38:47.800128] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-14T22:38:47.800344] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-14T22:38:47.802718] [INFO ] [MAIN ] Derivative Progress: 921/1812 symbols completed. IBM took 1.2s. Estimated remaining: 5m 40s. Rate: 157.4 symbols/min [2025-10-14T22:38:47.802878] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:47.815908] [DEBUG] [LOCAL ] IBP: Loaded 28892 existing records from primary storage. [2025-10-14T22:38:47.816201] [INFO ] [MAIN ] IBP: Loaded 28892 primary data records. [2025-10-14T22:38:47.866013] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:47.885130] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52809 primary records. [2025-10-14T22:38:47.899797] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-14T22:38:48.056968] [DEBUG] [LOCAL ] IBTA: Loaded 36746 existing records from primary storage. [2025-10-14T22:38:48.177437] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-14T22:38:48.177110] [INFO ] [MAIN ] IBTA: Loaded 36746 primary data records. [2025-10-14T22:38:48.178255] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-14T22:38:48.180547] [INFO ] [MAIN ] Derivative Progress: 922/1812 symbols completed. IBN took 1.3s. Estimated remaining: 5m 39s. Rate: 157.4 symbols/min [2025-10-14T22:38:48.180787] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:48.530845] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:48.531933] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28892 primary records. [2025-10-14T22:38:48.532034] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-14T22:38:48.547218] [DEBUG] [LOCAL ] ICE: Loaded 53017 existing records from primary storage. [2025-10-14T22:38:48.549113] [INFO ] [MAIN ] ICE: Loaded 53017 primary data records. [2025-10-14T22:38:48.586026] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-14T22:38:48.597892] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-14T22:38:48.613313] [INFO ] [MAIN ] Derivative Progress: 923/1812 symbols completed. IBP took 0.9s. Estimated remaining: 5m 39s. Rate: 157.4 symbols/min [2025-10-14T22:38:48.619525] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:48.950808] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:48.951952] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 36746 primary records. [2025-10-14T22:38:48.952201] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-14T22:38:48.972250] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-14T22:38:48.985526] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-14T22:38:48.988282] [INFO ] [MAIN ] Derivative Progress: 924/1812 symbols completed. IBTA took 1.2s. Estimated remaining: 5m 39s. Rate: 157.4 symbols/min [2025-10-14T22:38:48.990054] [DEBUG] [LOCAL ] ICL: Loaded 38549 existing records from primary storage. [2025-10-14T22:38:48.990198] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:48.990975] [INFO ] [MAIN ] ICL: Loaded 38549 primary data records. [2025-10-14T22:38:49.313703] [DEBUG] [LOCAL ] IDA: Loaded 32789 existing records from primary storage. [2025-10-14T22:38:49.327337] [INFO ] [MAIN ] IDA: Loaded 32789 primary data records. [2025-10-14T22:38:49.361893] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:49.391014] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53017 primary records. [2025-10-14T22:38:49.400677] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-14T22:38:49.634718] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-14T22:38:49.661098] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-14T22:38:49.663597] [INFO ] [MAIN ] Derivative Progress: 925/1812 symbols completed. ICE took 1.5s. Estimated remaining: 5m 38s. Rate: 157.3 symbols/min [2025-10-14T22:38:49.664069] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:49.692037] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:49.691593] [DEBUG] [LOCAL ] IDE: Loaded 9113 existing records from primary storage. [2025-10-14T22:38:49.692758] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38549 primary records. [2025-10-14T22:38:49.692842] [INFO ] [MAIN ] IDE: Loaded 9113 primary data records. [2025-10-14T22:38:49.693025] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-14T22:38:49.809684] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-14T22:38:49.822248] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-14T22:38:49.824551] [INFO ] [MAIN ] Derivative Progress: 926/1812 symbols completed. ICL took 1.2s. Estimated remaining: 5m 38s. Rate: 157.4 symbols/min [2025-10-14T22:38:49.832250] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:49.914096] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:50.031972] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32789 primary records. [2025-10-14T22:38:50.032301] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-14T22:38:50.053833] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-14T22:38:50.054763] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-14T22:38:50.058331] [INFO ] [MAIN ] Derivative Progress: 927/1812 symbols completed. IDA took 1.1s. Estimated remaining: 5m 37s. Rate: 157.4 symbols/min [2025-10-14T22:38:50.059186] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:50.066703] [DEBUG] [LOCAL ] IDT: Loaded 18405 existing records from primary storage. [2025-10-14T22:38:50.067076] [INFO ] [MAIN ] IDT: Loaded 18405 primary data records. [2025-10-14T22:38:50.342067] [DEBUG] [LOCAL ] IEX: Loaded 38366 existing records from primary storage. [2025-10-14T22:38:50.387217] [INFO ] [MAIN ] IEX: Loaded 38366 primary data records. [2025-10-14T22:38:50.443902] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:50.478611] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 9113 primary records. [2025-10-14T22:38:50.503291] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-14T22:38:50.778060] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-14T22:38:50.778815] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-14T22:38:50.781285] [INFO ] [MAIN ] Derivative Progress: 928/1812 symbols completed. IDE took 1.1s. Estimated remaining: 5m 37s. Rate: 157.3 symbols/min [2025-10-14T22:38:50.800259] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:50.800991] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18405 primary records. [2025-10-14T22:38:50.801350] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-14T22:38:50.817692] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-14T22:38:50.817904] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-14T22:38:50.820054] [INFO ] [MAIN ] Derivative Progress: 929/1812 symbols completed. IDT took 1.0s. Estimated remaining: 5m 37s. Rate: 157.4 symbols/min [2025-10-14T22:38:50.836489] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:50.837032] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38366 primary records. [2025-10-14T22:38:50.837092] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-14T22:38:50.852142] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-14T22:38:50.852198] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-14T22:38:50.854237] [INFO ] [MAIN ] Derivative Progress: 930/1812 symbols completed. IEX took 0.8s. Estimated remaining: 5m 36s. Rate: 157.6 symbols/min [2025-10-14T22:38:50.854818] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:50.854898] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:50.854639] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:50.881270] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-10-14T22:38:50.881402] [INFO ] [MAIN ] IFN: Loaded 18475 primary data records. [2025-10-14T22:38:50.966549] [DEBUG] [LOCAL ] IFS: Loaded 22683 existing records from primary storage. [2025-10-14T22:38:50.996290] [INFO ] [MAIN ] IFS: Loaded 22683 primary data records. [2025-10-14T22:38:51.189213] [DEBUG] [LOCAL ] IFF: Loaded 51103 existing records from primary storage. [2025-10-14T22:38:51.235144] [INFO ] [MAIN ] IFF: Loaded 51103 primary data records. [2025-10-14T22:38:51.871135] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:51.871577] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:51.872296] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22683 primary records. [2025-10-14T22:38:51.872994] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18475 primary records. [2025-10-14T22:38:51.873423] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-14T22:38:51.873215] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-14T22:38:51.901977] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-14T22:38:51.904707] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-14T22:38:51.907772] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-14T22:38:51.906884] [INFO ] [MAIN ] Derivative Progress: 931/1812 symbols completed. IFN took 1.1s. Estimated remaining: 5m 36s. Rate: 157.3 symbols/min [2025-10-14T22:38:51.908090] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-14T22:38:51.908167] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:51.910451] [INFO ] [MAIN ] Derivative Progress: 932/1812 symbols completed. IFS took 1.1s. Estimated remaining: 5m 35s. Rate: 157.4 symbols/min [2025-10-14T22:38:51.910920] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:51.927378] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:51.928238] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51103 primary records. [2025-10-14T22:38:51.930793] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-14T22:38:51.955468] [DEBUG] [LOCAL ] IGA: Loaded 10185 existing records from primary storage. [2025-10-14T22:38:51.955229] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-14T22:38:51.955704] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-14T22:38:51.955619] [INFO ] [MAIN ] IGA: Loaded 10185 primary data records. [2025-10-14T22:38:51.958010] [INFO ] [MAIN ] Derivative Progress: 933/1812 symbols completed. IFF took 1.1s. Estimated remaining: 5m 35s. Rate: 157.6 symbols/min [2025-10-14T22:38:51.963770] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:51.970321] [DEBUG] [LOCAL ] IGD: Loaded 19411 existing records from primary storage. [2025-10-14T22:38:51.996783] [INFO ] [MAIN ] IGD: Loaded 19411 primary data records. [2025-10-14T22:38:52.143266] [DEBUG] [LOCAL ] IGI: Loaded 3934 existing records from primary storage. [2025-10-14T22:38:52.173042] [INFO ] [MAIN ] IGI: Loaded 3934 primary data records. [2025-10-14T22:38:52.966804] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:52.980635] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3934 primary records. [2025-10-14T22:38:52.986082] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:52.986432] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-14T22:38:52.988071] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19411 primary records. [2025-10-14T22:38:52.988224] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-14T22:38:52.986379] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:52.997340] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 10185 primary records. [2025-10-14T22:38:53.013263] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-14T22:38:53.012164] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-14T22:38:53.019152] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-14T22:38:53.020181] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-14T22:38:53.023060] [INFO ] [MAIN ] Derivative Progress: 934/1812 symbols completed. IGI took 1.1s. Estimated remaining: 5m 35s. Rate: 157.3 symbols/min [2025-10-14T22:38:53.023577] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:53.023944] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-14T22:38:53.026849] [INFO ] [MAIN ] Derivative Progress: 935/1812 symbols completed. IGD took 1.1s. Estimated remaining: 5m 34s. Rate: 157.5 symbols/min [2025-10-14T22:38:53.027344] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:53.043269] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-14T22:38:53.043538] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-14T22:38:53.045767] [INFO ] [MAIN ] Derivative Progress: 936/1812 symbols completed. IGA took 1.1s. Estimated remaining: 5m 33s. Rate: 157.6 symbols/min [2025-10-14T22:38:53.048770] [DEBUG] [LOCAL ] IH: Loaded 2794 existing records from primary storage. [2025-10-14T22:38:53.045996] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:53.049141] [INFO ] [MAIN ] IH: Loaded 2794 primary data records. [2025-10-14T22:38:53.174566] [DEBUG] [LOCAL ] IHD: Loaded 7305 existing records from primary storage. [2025-10-14T22:38:53.195225] [INFO ] [MAIN ] IHD: Loaded 7305 primary data records. [2025-10-14T22:38:53.211723] [DEBUG] [LOCAL ] IGR: Loaded 30377 existing records from primary storage. [2025-10-14T22:38:53.291178] [INFO ] [MAIN ] IGR: Loaded 30377 primary data records. [2025-10-14T22:38:54.065175] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:38:54.067231] [INFO ] [MAIN ] IH: Generated 1793 derivative records from 2794 primary records. [2025-10-14T22:38:54.067737] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-14T22:38:54.082059] [DEBUG] [LOCAL ] IH: Derivative data saved (1793 records). [2025-10-14T22:38:54.082297] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-14T22:38:54.084537] [INFO ] [MAIN ] Derivative Progress: 937/1812 symbols completed. IH took 1.1s. Estimated remaining: 5m 34s. Rate: 157.3 symbols/min [2025-10-14T22:38:54.085901] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:54.105147] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:54.106162] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7305 primary records. [2025-10-14T22:38:54.106316] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-14T22:38:54.129763] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-14T22:38:54.137488] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-14T22:38:54.144293] [INFO ] [MAIN ] Derivative Progress: 938/1812 symbols completed. IHD took 1.1s. Estimated remaining: 5m 33s. Rate: 157.5 symbols/min [2025-10-14T22:38:54.144567] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:54.145277] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:54.155004] [DEBUG] [LOCAL ] IHG: Loaded 24262 existing records from primary storage. [2025-10-14T22:38:54.155212] [INFO ] [MAIN ] IHG: Loaded 24262 primary data records. [2025-10-14T22:38:54.154481] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30377 primary records. [2025-10-14T22:38:54.155382] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-14T22:38:54.244235] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-14T22:38:54.293008] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-14T22:38:54.312751] [INFO ] [MAIN ] Derivative Progress: 939/1812 symbols completed. IGR took 1.3s. Estimated remaining: 5m 32s. Rate: 157.6 symbols/min [2025-10-14T22:38:54.340196] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:54.380963] [DEBUG] [LOCAL ] IHS: Loaded 37773 existing records from primary storage. [2025-10-14T22:38:54.404161] [INFO ] [MAIN ] IHS: Loaded 37773 primary data records. [2025-10-14T22:38:54.603685] [DEBUG] [LOCAL ] IIF: Loaded 5596 existing records from primary storage. [2025-10-14T22:38:54.628247] [INFO ] [MAIN ] IIF: Loaded 5596 primary data records. [2025-10-14T22:38:55.185169] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:55.186995] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24262 primary records. [2025-10-14T22:38:55.188187] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-14T22:38:55.206386] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-14T22:38:55.206625] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-14T22:38:55.208839] [INFO ] [MAIN ] Derivative Progress: 940/1812 symbols completed. IHG took 1.1s. Estimated remaining: 5m 33s. Rate: 157.3 symbols/min [2025-10-14T22:38:55.209120] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:55.247103] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:55.253558] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 37773 primary records. [2025-10-14T22:38:55.252819] [DEBUG] [LOCAL ] IIIN: Loaded 15969 existing records from primary storage. [2025-10-14T22:38:55.253742] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-14T22:38:55.254109] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:55.254892] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5596 primary records. [2025-10-14T22:38:55.254945] [INFO ] [MAIN ] IIIN: Loaded 15969 primary data records. [2025-10-14T22:38:55.255828] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-14T22:38:55.356724] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-14T22:38:55.383505] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-14T22:38:55.398494] [INFO ] [MAIN ] Derivative Progress: 941/1812 symbols completed. IHS took 1.3s. Estimated remaining: 5m 32s. Rate: 157.4 symbols/min [2025-10-14T22:38:55.398787] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:55.392447] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-14T22:38:55.415585] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-14T22:38:55.440972] [INFO ] [MAIN ] Derivative Progress: 942/1812 symbols completed. IIF took 1.1s. Estimated remaining: 5m 31s. Rate: 157.6 symbols/min [2025-10-14T22:38:55.449672] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:55.601055] [DEBUG] [LOCAL ] IIM: Loaded 15708 existing records from primary storage. [2025-10-14T22:38:55.601812] [INFO ] [MAIN ] IIM: Loaded 15708 primary data records. [2025-10-14T22:38:55.766700] [DEBUG] [LOCAL ] IIPR: Loaded 29452 existing records from primary storage. [2025-10-14T22:38:55.805750] [INFO ] [MAIN ] IIPR: Loaded 29452 primary data records. [2025-10-14T22:38:56.132128] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:56.246277] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 15969 primary records. [2025-10-14T22:38:56.246805] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-14T22:38:56.265415] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-14T22:38:56.268218] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-14T22:38:56.271165] [INFO ] [MAIN ] Derivative Progress: 943/1812 symbols completed. IIIN took 1.1s. Estimated remaining: 5m 31s. Rate: 157.4 symbols/min [2025-10-14T22:38:56.288174] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:56.289028] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15708 primary records. [2025-10-14T22:38:56.289204] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-14T22:38:56.305500] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-14T22:38:56.305718] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-14T22:38:56.307799] [INFO ] [MAIN ] Derivative Progress: 944/1812 symbols completed. IIM took 0.9s. Estimated remaining: 5m 31s. Rate: 157.5 symbols/min [2025-10-14T22:38:56.322743] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:56.323412] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29452 primary records. [2025-10-14T22:38:56.323475] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-14T22:38:56.338466] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-14T22:38:56.338523] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-14T22:38:56.340781] [INFO ] [MAIN ] Derivative Progress: 945/1812 symbols completed. IIPR took 0.9s. Estimated remaining: 5m 30s. Rate: 157.7 symbols/min [2025-10-14T22:38:56.341545] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:56.341380] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:56.341478] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:56.409229] [DEBUG] [LOCAL ] IMAX: Loaded 43182 existing records from primary storage. [2025-10-14T22:38:56.409545] [INFO ] [MAIN ] IMAX: Loaded 43182 primary data records. [2025-10-14T22:38:56.488331] [DEBUG] [LOCAL ] INFA: Loaded 49048 existing records from primary storage. [2025-10-14T22:38:56.539007] [INFO ] [MAIN ] INFA: Loaded 49048 primary data records. [2025-10-14T22:38:56.543378] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-14T22:38:56.576493] [INFO ] [MAIN ] INFY: Loaded 53596 primary data records. [2025-10-14T22:38:57.460046] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:57.461232] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 43182 primary records. [2025-10-14T22:38:57.461455] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-14T22:38:57.503414] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-14T22:38:57.509406] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-14T22:38:57.512462] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:57.512750] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:57.512116] [INFO ] [MAIN ] Derivative Progress: 946/1812 symbols completed. IMAX took 1.2s. Estimated remaining: 5m 30s. Rate: 157.3 symbols/min [2025-10-14T22:38:57.513910] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:57.513790] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49048 primary records. [2025-10-14T22:38:57.514072] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-14T22:38:57.515669] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53596 primary records. [2025-10-14T22:38:57.515854] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-14T22:38:57.545067] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-14T22:38:57.545630] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-14T22:38:57.548024] [INFO ] [MAIN ] Derivative Progress: 947/1812 symbols completed. INFA took 1.2s. Estimated remaining: 5m 30s. Rate: 157.5 symbols/min [2025-10-14T22:38:57.548167] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:57.553067] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-14T22:38:57.553161] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-14T22:38:57.555369] [INFO ] [MAIN ] Derivative Progress: 948/1812 symbols completed. INFY took 1.2s. Estimated remaining: 5m 29s. Rate: 157.6 symbols/min [2025-10-14T22:38:57.555613] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:57.596025] [DEBUG] [LOCAL ] INGM: Loaded 28445 existing records from primary storage. [2025-10-14T22:38:57.596975] [INFO ] [MAIN ] INGM: Loaded 28445 primary data records. [2025-10-14T22:38:57.684937] [DEBUG] [LOCAL ] ING: Loaded 50723 existing records from primary storage. [2025-10-14T22:38:57.697012] [INFO ] [MAIN ] ING: Loaded 50723 primary data records. [2025-10-14T22:38:57.736124] [DEBUG] [LOCAL ] INGR: Loaded 33861 existing records from primary storage. [2025-10-14T22:38:57.748456] [INFO ] [MAIN ] INGR: Loaded 33861 primary data records. [2025-10-14T22:38:58.556338] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:58.557461] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28445 primary records. [2025-10-14T22:38:58.558692] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-14T22:38:58.591146] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-14T22:38:58.592350] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-14T22:38:58.592261] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:58.593418] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50723 primary records. [2025-10-14T22:38:58.595228] [INFO ] [MAIN ] Derivative Progress: 949/1812 symbols completed. INGM took 1.0s. Estimated remaining: 5m 29s. Rate: 157.4 symbols/min [2025-10-14T22:38:58.595694] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:58.595763] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-14T22:38:58.611138] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:58.611996] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33861 primary records. [2025-10-14T22:38:58.612362] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-14T22:38:58.628824] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-14T22:38:58.628972] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-14T22:38:58.631450] [INFO ] [MAIN ] Derivative Progress: 950/1812 symbols completed. ING took 1.1s. Estimated remaining: 5m 28s. Rate: 157.5 symbols/min [2025-10-14T22:38:58.631670] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:58.647599] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-14T22:38:58.647713] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-14T22:38:58.649993] [INFO ] [MAIN ] Derivative Progress: 951/1812 symbols completed. INGR took 1.1s. Estimated remaining: 5m 28s. Rate: 157.7 symbols/min [2025-10-14T22:38:58.650243] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:58.688571] [DEBUG] [LOCAL ] INN: Loaded 41782 existing records from primary storage. [2025-10-14T22:38:58.688907] [INFO ] [MAIN ] INN: Loaded 41782 primary data records. [2025-10-14T22:38:58.811821] [DEBUG] [LOCAL ] INSP: Loaded 38215 existing records from primary storage. [2025-10-14T22:38:58.843950] [INFO ] [MAIN ] INSP: Loaded 38215 primary data records. [2025-10-14T22:38:58.964534] [DEBUG] [LOCAL ] INSW: Loaded 39628 existing records from primary storage. [2025-10-14T22:38:59.067433] [INFO ] [MAIN ] INSW: Loaded 39628 primary data records. [2025-10-14T22:38:59.721095] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:59.722423] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41782 primary records. [2025-10-14T22:38:59.723044] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-14T22:38:59.741137] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-14T22:38:59.741527] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-14T22:38:59.743511] [INFO ] [MAIN ] Derivative Progress: 952/1812 symbols completed. INN took 1.1s. Estimated remaining: 5m 28s. Rate: 157.4 symbols/min [2025-10-14T22:38:59.743955] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:59.778084] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:59.779412] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39628 primary records. [2025-10-14T22:38:59.779839] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:38:59.779971] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-14T22:38:59.782613] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 38215 primary records. [2025-10-14T22:38:59.783111] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-14T22:38:59.813504] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-14T22:38:59.813890] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-14T22:38:59.817182] [INFO ] [MAIN ] Derivative Progress: 953/1812 symbols completed. INSP took 1.2s. Estimated remaining: 5m 27s. Rate: 157.5 symbols/min [2025-10-14T22:38:59.817358] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:59.818258] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-14T22:38:59.818355] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-14T22:38:59.820536] [INFO ] [MAIN ] Derivative Progress: 954/1812 symbols completed. INSW took 1.2s. Estimated remaining: 5m 27s. Rate: 157.6 symbols/min [2025-10-14T22:38:59.834586] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:38:59.864149] [DEBUG] [LOCAL ] INVH: Loaded 53185 existing records from primary storage. [2025-10-14T22:38:59.864338] [INFO ] [MAIN ] INVH: Loaded 53185 primary data records. [2025-10-14T22:38:59.960934] [DEBUG] [LOCAL ] INVX: Loaded 29342 existing records from primary storage. [2025-10-14T22:38:59.977555] [INFO ] [MAIN ] INVX: Loaded 29342 primary data records. [2025-10-14T22:39:00.150190] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-14T22:39:00.294566] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-14T22:39:00.913616] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:00.915547] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53185 primary records. [2025-10-14T22:39:00.915871] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-14T22:39:00.937313] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-14T22:39:00.937919] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-14T22:39:00.951928] [INFO ] [MAIN ] Derivative Progress: 955/1812 symbols completed. INVH took 1.2s. Estimated remaining: 5m 27s. Rate: 157.3 symbols/min [2025-10-14T22:39:00.952402] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:00.953231] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:00.956636] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29342 primary records. [2025-10-14T22:39:00.958032] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-14T22:39:00.984923] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:00.986879] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-14T22:39:00.987024] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-14T22:39:01.001360] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-14T22:39:01.004279] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-14T22:39:01.009920] [INFO ] [MAIN ] Derivative Progress: 956/1812 symbols completed. INVX took 1.2s. Estimated remaining: 5m 26s. Rate: 157.5 symbols/min [2025-10-14T22:39:01.010730] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:01.011572] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-14T22:39:01.011808] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-14T22:39:01.016011] [INFO ] [MAIN ] Derivative Progress: 957/1812 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 25s. Rate: 157.6 symbols/min [2025-10-14T22:39:01.016288] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:01.056954] [DEBUG] [LOCAL ] IOT: Loaded 53480 existing records from primary storage. [2025-10-14T22:39:01.057166] [INFO ] [MAIN ] IOT: Loaded 53480 primary data records. [2025-10-14T22:39:01.256023] [DEBUG] [LOCAL ] IP: Loaded 53311 existing records from primary storage. [2025-10-14T22:39:01.297306] [INFO ] [MAIN ] IP: Loaded 53311 primary data records. [2025-10-14T22:39:01.353332] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-10-14T22:39:01.436740] [INFO ] [MAIN ] IPG: Loaded 53331 primary data records. [2025-10-14T22:39:02.085387] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:02.087332] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53480 primary records. [2025-10-14T22:39:02.087801] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-14T22:39:02.110411] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-14T22:39:02.110940] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-14T22:39:02.113031] [INFO ] [MAIN ] Derivative Progress: 958/1812 symbols completed. IOT took 1.2s. Estimated remaining: 5m 26s. Rate: 157.3 symbols/min [2025-10-14T22:39:02.135449] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:02.136611] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53331 primary records. [2025-10-14T22:39:02.151187] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-14T22:39:02.151470] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:02.153275] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53311 primary records. [2025-10-14T22:39:02.153563] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-14T22:39:02.181814] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-14T22:39:02.184132] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-14T22:39:02.190451] [INFO ] [MAIN ] Derivative Progress: 959/1812 symbols completed. IPG took 1.2s. Estimated remaining: 5m 25s. Rate: 157.4 symbols/min [2025-10-14T22:39:02.195581] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-14T22:39:02.195806] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-14T22:39:02.198635] [INFO ] [MAIN ] Derivative Progress: 960/1812 symbols completed. IP took 1.2s. Estimated remaining: 5m 24s. Rate: 157.6 symbols/min [2025-10-14T22:39:02.199243] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:02.199162] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:02.199685] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:02.239875] [DEBUG] [LOCAL ] IPI: Loaded 21301 existing records from primary storage. [2025-10-14T22:39:02.240352] [DEBUG] [LOCAL ] IQI: Loaded 17823 existing records from primary storage. [2025-10-14T22:39:02.240692] [INFO ] [MAIN ] IQI: Loaded 17823 primary data records. [2025-10-14T22:39:02.240606] [INFO ] [MAIN ] IPI: Loaded 21301 primary data records. [2025-10-14T22:39:02.521990] [DEBUG] [LOCAL ] IQV: Loaded 50084 existing records from primary storage. [2025-10-14T22:39:02.554039] [INFO ] [MAIN ] IQV: Loaded 50084 primary data records. [2025-10-14T22:39:03.413473] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:03.416605] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17823 primary records. [2025-10-14T22:39:03.418878] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-14T22:39:03.463343] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-14T22:39:03.463611] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:03.464439] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:03.464956] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-14T22:39:03.465989] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50084 primary records. [2025-10-14T22:39:03.467466] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21301 primary records. [2025-10-14T22:39:03.467672] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-14T22:39:03.470441] [INFO ] [MAIN ] Derivative Progress: 961/1812 symbols completed. IQI took 1.3s. Estimated remaining: 5m 25s. Rate: 157.2 symbols/min [2025-10-14T22:39:03.471043] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-14T22:39:03.471851] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:03.513251] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-14T22:39:03.514417] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-14T22:39:03.518834] [INFO ] [MAIN ] Derivative Progress: 962/1812 symbols completed. IPI took 1.3s. Estimated remaining: 5m 24s. Rate: 157.4 symbols/min [2025-10-14T22:39:03.521979] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-14T22:39:03.522192] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-14T22:39:03.524701] [INFO ] [MAIN ] Derivative Progress: 963/1812 symbols completed. IQV took 1.3s. Estimated remaining: 5m 23s. Rate: 157.5 symbols/min [2025-10-14T22:39:03.524953] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:03.519974] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:03.567767] [DEBUG] [LOCAL ] IRS: Loaded 22985 existing records from primary storage. [2025-10-14T22:39:03.583052] [INFO ] [MAIN ] IRS: Loaded 22985 primary data records. [2025-10-14T22:39:03.616853] [DEBUG] [LOCAL ] IR: Loaded 52781 existing records from primary storage. [2025-10-14T22:39:03.642368] [INFO ] [MAIN ] IR: Loaded 52781 primary data records. [2025-10-14T22:39:04.163224] [DEBUG] [LOCAL ] IRM: Loaded 49163 existing records from primary storage. [2025-10-14T22:39:04.170880] [INFO ] [MAIN ] IRM: Loaded 49163 primary data records. [2025-10-14T22:39:04.642729] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:04.645288] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 22985 primary records. [2025-10-14T22:39:04.646668] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-14T22:39:04.662534] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:04.672331] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52781 primary records. [2025-10-14T22:39:04.672601] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-14T22:39:04.694179] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-14T22:39:04.694405] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-14T22:39:04.697045] [INFO ] [MAIN ] Derivative Progress: 964/1812 symbols completed. IR took 1.2s. Estimated remaining: 5m 24s. Rate: 157.2 symbols/min [2025-10-14T22:39:04.697765] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:04.704876] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-14T22:39:04.717575] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-14T22:39:04.717936] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:04.720784] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49163 primary records. [2025-10-14T22:39:04.720986] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-14T22:39:04.720033] [INFO ] [MAIN ] Derivative Progress: 965/1812 symbols completed. IRS took 1.2s. Estimated remaining: 5m 23s. Rate: 157.3 symbols/min [2025-10-14T22:39:04.721948] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:04.738348] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-14T22:39:04.738518] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-14T22:39:04.740991] [INFO ] [MAIN ] Derivative Progress: 966/1812 symbols completed. IRM took 1.2s. Estimated remaining: 5m 22s. Rate: 157.5 symbols/min [2025-10-14T22:39:04.741254] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:04.754096] [DEBUG] [LOCAL ] ISD: Loaded 15926 existing records from primary storage. [2025-10-14T22:39:04.769529] [INFO ] [MAIN ] ISD: Loaded 15926 primary data records. [2025-10-14T22:39:04.906189] [DEBUG] [LOCAL ] IRT: Loaded 50569 existing records from primary storage. [2025-10-14T22:39:04.942933] [INFO ] [MAIN ] IRT: Loaded 50569 primary data records. [2025-10-14T22:39:05.170117] [DEBUG] [LOCAL ] IT: Loaded 42200 existing records from primary storage. [2025-10-14T22:39:05.188168] [INFO ] [MAIN ] IT: Loaded 42200 primary data records. [2025-10-14T22:39:05.773789] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:05.775276] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15926 primary records. [2025-10-14T22:39:05.775957] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-14T22:39:05.794746] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-14T22:39:05.796049] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-14T22:39:05.798122] [INFO ] [MAIN ] Derivative Progress: 967/1812 symbols completed. ISD took 1.1s. Estimated remaining: 5m 23s. Rate: 157.2 symbols/min [2025-10-14T22:39:05.799544] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:05.816914] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:05.817991] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50569 primary records. [2025-10-14T22:39:05.818093] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-14T22:39:05.835002] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-14T22:39:05.835157] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-14T22:39:05.837214] [INFO ] [MAIN ] Derivative Progress: 968/1812 symbols completed. IRT took 1.1s. Estimated remaining: 5m 22s. Rate: 157.4 symbols/min [2025-10-14T22:39:05.837442] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:05.864831] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:05.865692] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 42200 primary records. [2025-10-14T22:39:05.865973] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-14T22:39:05.894972] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-10-14T22:39:05.895219] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-14T22:39:05.897727] [INFO ] [MAIN ] Derivative Progress: 969/1812 symbols completed. IT took 1.2s. Estimated remaining: 5m 21s. Rate: 157.5 symbols/min [2025-10-14T22:39:05.895118] [DEBUG] [LOCAL ] ITGR: Loaded 31233 existing records from primary storage. [2025-10-14T22:39:05.898018] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:05.898364] [INFO ] [MAIN ] ITGR: Loaded 31233 primary data records. [2025-10-14T22:39:06.019929] [DEBUG] [LOCAL ] ITT: Loaded 32739 existing records from primary storage. [2025-10-14T22:39:06.023620] [INFO ] [MAIN ] ITT: Loaded 32739 primary data records. [2025-10-14T22:39:06.604224] [DEBUG] [LOCAL ] ITUB: Loaded 53330 existing records from primary storage. [2025-10-14T22:39:06.604587] [INFO ] [MAIN ] ITUB: Loaded 53330 primary data records. [2025-10-14T22:39:06.941344] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:06.942710] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31233 primary records. [2025-10-14T22:39:06.942897] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-14T22:39:06.964156] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-14T22:39:06.965871] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-14T22:39:06.967919] [INFO ] [MAIN ] Derivative Progress: 970/1812 symbols completed. ITGR took 1.2s. Estimated remaining: 5m 21s. Rate: 157.2 symbols/min [2025-10-14T22:39:06.968982] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:06.984825] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:06.985977] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32739 primary records. [2025-10-14T22:39:06.986280] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-14T22:39:07.007530] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-14T22:39:07.013899] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-14T22:39:07.039996] [INFO ] [MAIN ] Derivative Progress: 971/1812 symbols completed. ITT took 1.2s. Estimated remaining: 5m 21s. Rate: 157.3 symbols/min [2025-10-14T22:39:07.040543] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:07.041066] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:07.042566] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53330 primary records. [2025-10-14T22:39:07.043018] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-14T22:39:07.080778] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-14T22:39:07.081008] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-14T22:39:07.083678] [INFO ] [MAIN ] Derivative Progress: 972/1812 symbols completed. ITUB took 1.2s. Estimated remaining: 5m 20s. Rate: 157.5 symbols/min [2025-10-14T22:39:07.084577] [DEBUG] [LOCAL ] ITW: Loaded 45801 existing records from primary storage. [2025-10-14T22:39:07.084778] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:07.085123] [INFO ] [MAIN ] ITW: Loaded 45801 primary data records. [2025-10-14T22:39:07.443672] [DEBUG] [LOCAL ] IVR: Loaded 48130 existing records from primary storage. [2025-10-14T22:39:07.457321] [DEBUG] [LOCAL ] IVT: Loaded 31274 existing records from primary storage. [2025-10-14T22:39:07.457904] [INFO ] [MAIN ] IVT: Loaded 31274 primary data records. [2025-10-14T22:39:07.457787] [INFO ] [MAIN ] IVR: Loaded 48130 primary data records. [2025-10-14T22:39:08.114260] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:08.115105] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45801 primary records. [2025-10-14T22:39:08.115414] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-14T22:39:08.139155] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-14T22:39:08.139338] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-14T22:39:08.141689] [INFO ] [MAIN ] Derivative Progress: 973/1812 symbols completed. ITW took 1.2s. Estimated remaining: 5m 20s. Rate: 157.2 symbols/min [2025-10-14T22:39:08.157663] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:08.158677] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31274 primary records. [2025-10-14T22:39:08.172141] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-14T22:39:08.172401] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:08.173939] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 48130 primary records. [2025-10-14T22:39:08.174235] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-14T22:39:08.190263] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-14T22:39:08.190359] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-14T22:39:08.199454] [INFO ] [MAIN ] Derivative Progress: 974/1812 symbols completed. IVT took 1.1s. Estimated remaining: 5m 20s. Rate: 157.3 symbols/min [2025-10-14T22:39:08.207428] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-14T22:39:08.207545] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-14T22:39:08.209860] [INFO ] [MAIN ] Derivative Progress: 975/1812 symbols completed. IVR took 1.2s. Estimated remaining: 5m 19s. Rate: 157.5 symbols/min [2025-10-14T22:39:08.210315] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:08.210246] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:08.211307] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:08.233983] [DEBUG] [LOCAL ] IX: Loaded 22281 existing records from primary storage. [2025-10-14T22:39:08.234118] [INFO ] [MAIN ] IX: Loaded 22281 primary data records. [2025-10-14T22:39:08.593427] [DEBUG] [LOCAL ] J: Loaded 40309 existing records from primary storage. [2025-10-14T22:39:08.605896] [INFO ] [MAIN ] J: Loaded 40309 primary data records. [2025-10-14T22:39:08.606572] [DEBUG] [LOCAL ] IVZ: Loaded 53118 existing records from primary storage. [2025-10-14T22:39:08.606867] [INFO ] [MAIN ] IVZ: Loaded 53118 primary data records. [2025-10-14T22:39:09.292344] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:09.294162] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22281 primary records. [2025-10-14T22:39:09.294439] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-14T22:39:09.313004] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-14T22:39:09.314592] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-14T22:39:09.317152] [INFO ] [MAIN ] Derivative Progress: 976/1812 symbols completed. IX took 1.1s. Estimated remaining: 5m 19s. Rate: 157.2 symbols/min [2025-10-14T22:39:09.317810] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:09.354272] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:09.354508] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:09.355402] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53118 primary records. [2025-10-14T22:39:09.356390] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40309 primary records. [2025-10-14T22:39:09.358823] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-14T22:39:09.359320] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-14T22:39:09.400162] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-14T22:39:09.401998] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-14T22:39:09.404411] [INFO ] [MAIN ] Derivative Progress: 977/1812 symbols completed. IVZ took 1.2s. Estimated remaining: 5m 19s. Rate: 157.3 symbols/min [2025-10-14T22:39:09.405068] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:09.406111] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-14T22:39:09.406415] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-14T22:39:09.419993] [INFO ] [MAIN ] Derivative Progress: 978/1812 symbols completed. J took 1.2s. Estimated remaining: 5m 18s. Rate: 157.5 symbols/min [2025-10-14T22:39:09.420323] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:09.421305] [DEBUG] [LOCAL ] JBGS: Loaded 42182 existing records from primary storage. [2025-10-14T22:39:09.421677] [INFO ] [MAIN ] JBGS: Loaded 42182 primary data records. [2025-10-14T22:39:09.780609] [DEBUG] [LOCAL ] JBI: Loaded 43014 existing records from primary storage. [2025-10-14T22:39:09.780973] [INFO ] [MAIN ] JBI: Loaded 43014 primary data records. [2025-10-14T22:39:09.874089] [DEBUG] [LOCAL ] JBL: Loaded 48360 existing records from primary storage. [2025-10-14T22:39:09.887152] [INFO ] [MAIN ] JBL: Loaded 48360 primary data records. [2025-10-14T22:39:10.423772] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:10.425330] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42182 primary records. [2025-10-14T22:39:10.425688] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-14T22:39:10.446779] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-14T22:39:10.447721] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-14T22:39:10.450736] [INFO ] [MAIN ] Derivative Progress: 979/1812 symbols completed. JBGS took 1.1s. Estimated remaining: 5m 18s. Rate: 157.2 symbols/min [2025-10-14T22:39:10.464270] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:10.465250] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43014 primary records. [2025-10-14T22:39:10.463493] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:10.465730] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-14T22:39:10.497571] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-14T22:39:10.497805] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:10.498003] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-14T22:39:10.498753] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48360 primary records. [2025-10-14T22:39:10.507784] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-14T22:39:10.507584] [INFO ] [MAIN ] Derivative Progress: 980/1812 symbols completed. JBI took 1.1s. Estimated remaining: 5m 17s. Rate: 157.3 symbols/min [2025-10-14T22:39:10.508443] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:10.530315] [DEBUG] [LOCAL ] JBND: Loaded 26794 existing records from primary storage. [2025-10-14T22:39:10.533504] [INFO ] [MAIN ] JBND: Loaded 26794 primary data records. [2025-10-14T22:39:10.571053] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-14T22:39:10.576386] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-14T22:39:10.586301] [INFO ] [MAIN ] Derivative Progress: 981/1812 symbols completed. JBL took 1.2s. Estimated remaining: 5m 17s. Rate: 157.4 symbols/min [2025-10-14T22:39:10.559848] [DEBUG] [LOCAL ] JCE: Loaded 7424 existing records from primary storage. [2025-10-14T22:39:10.607589] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:10.607469] [INFO ] [MAIN ] JCE: Loaded 7424 primary data records. [2025-10-14T22:39:11.179635] [DEBUG] [LOCAL ] JCI: Loaded 53530 existing records from primary storage. [2025-10-14T22:39:11.180264] [INFO ] [MAIN ] JCI: Loaded 53530 primary data records. [2025-10-14T22:39:11.318695] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:11.330145] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26794 primary records. [2025-10-14T22:39:11.353281] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-14T22:39:11.560021] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-14T22:39:11.560342] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-14T22:39:11.562202] [INFO ] [MAIN ] Derivative Progress: 982/1812 symbols completed. JBND took 1.1s. Estimated remaining: 5m 17s. Rate: 157.2 symbols/min [2025-10-14T22:39:11.570173] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:11.576898] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:11.578832] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7424 primary records. [2025-10-14T22:39:11.579138] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-14T22:39:11.596316] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-14T22:39:11.596528] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-14T22:39:11.598705] [INFO ] [MAIN ] Derivative Progress: 983/1812 symbols completed. JCE took 1.1s. Estimated remaining: 5m 16s. Rate: 157.3 symbols/min [2025-10-14T22:39:11.599298] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:11.631111] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:11.631769] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53530 primary records. [2025-10-14T22:39:11.631913] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-14T22:39:11.671238] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-14T22:39:11.671360] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-14T22:39:11.674346] [INFO ] [MAIN ] Derivative Progress: 984/1812 symbols completed. JCI took 1.1s. Estimated remaining: 5m 15s. Rate: 157.5 symbols/min [2025-10-14T22:39:11.672144] [DEBUG] [LOCAL ] JEF: Loaded 50173 existing records from primary storage. [2025-10-14T22:39:11.674610] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:11.674824] [INFO ] [MAIN ] JEF: Loaded 50173 primary data records. [2025-10-14T22:39:11.798882] [DEBUG] [LOCAL ] JELD: Loaded 46081 existing records from primary storage. [2025-10-14T22:39:11.810285] [INFO ] [MAIN ] JELD: Loaded 46081 primary data records. [2025-10-14T22:39:11.926074] [DEBUG] [LOCAL ] JFR: Loaded 30884 existing records from primary storage. [2025-10-14T22:39:12.076762] [INFO ] [MAIN ] JFR: Loaded 30884 primary data records. [2025-10-14T22:39:12.641847] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:12.642960] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50173 primary records. [2025-10-14T22:39:12.643203] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-14T22:39:12.664365] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-14T22:39:12.664880] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-14T22:39:12.666736] [INFO ] [MAIN ] Derivative Progress: 985/1812 symbols completed. JEF took 1.1s. Estimated remaining: 5m 16s. Rate: 157.2 symbols/min [2025-10-14T22:39:12.679942] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:12.680998] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:12.682055] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46081 primary records. [2025-10-14T22:39:12.682191] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-14T22:39:12.707261] [DEBUG] [LOCAL ] JGH: Loaded 12243 existing records from primary storage. [2025-10-14T22:39:12.708254] [INFO ] [MAIN ] JGH: Loaded 12243 primary data records. [2025-10-14T22:39:12.747914] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-14T22:39:12.756036] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-14T22:39:12.783918] [INFO ] [MAIN ] Derivative Progress: 986/1812 symbols completed. JELD took 1.2s. Estimated remaining: 5m 15s. Rate: 157.3 symbols/min [2025-10-14T22:39:12.793461] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:12.793313] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:12.801010] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30884 primary records. [2025-10-14T22:39:12.812028] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-14T22:39:12.892454] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-14T22:39:12.924794] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-14T22:39:12.927172] [INFO ] [MAIN ] Derivative Progress: 987/1812 symbols completed. JFR took 1.3s. Estimated remaining: 5m 14s. Rate: 157.4 symbols/min [2025-10-14T22:39:12.927373] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:13.060311] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-14T22:39:13.060519] [INFO ] [MAIN ] JHS: Loaded 2944 primary data records. [2025-10-14T22:39:13.182786] [DEBUG] [LOCAL ] JHG: Loaded 47608 existing records from primary storage. [2025-10-14T22:39:13.210447] [INFO ] [MAIN ] JHG: Loaded 47608 primary data records. [2025-10-14T22:39:13.725381] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:13.726146] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 12243 primary records. [2025-10-14T22:39:13.726307] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-14T22:39:13.746252] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-14T22:39:13.747039] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-14T22:39:13.749673] [INFO ] [MAIN ] Derivative Progress: 988/1812 symbols completed. JGH took 1.1s. Estimated remaining: 5m 14s. Rate: 157.2 symbols/min [2025-10-14T22:39:13.769775] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:13.770478] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2944 primary records. [2025-10-14T22:39:13.770787] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-14T22:39:13.786175] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-14T22:39:13.786467] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-14T22:39:13.788430] [INFO ] [MAIN ] Derivative Progress: 989/1812 symbols completed. JHS took 0.9s. Estimated remaining: 5m 14s. Rate: 157.4 symbols/min [2025-10-14T22:39:13.803623] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:13.804278] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47608 primary records. [2025-10-14T22:39:13.804341] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-14T22:39:13.819898] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-14T22:39:13.820003] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-14T22:39:13.822218] [INFO ] [MAIN ] Derivative Progress: 990/1812 symbols completed. JHG took 1.0s. Estimated remaining: 5m 13s. Rate: 157.5 symbols/min [2025-10-14T22:39:13.822638] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:13.822809] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:13.822885] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:13.842485] [DEBUG] [LOCAL ] JILL: Loaded 16017 existing records from primary storage. [2025-10-14T22:39:13.842731] [INFO ] [MAIN ] JILL: Loaded 16017 primary data records. [2025-10-14T22:39:13.986344] [DEBUG] [LOCAL ] JKS: Loaded 39715 existing records from primary storage. [2025-10-14T22:39:13.996950] [INFO ] [MAIN ] JKS: Loaded 39715 primary data records. [2025-10-14T22:39:14.108891] [DEBUG] [LOCAL ] JHX: Loaded 53155 existing records from primary storage. [2025-10-14T22:39:14.271101] [INFO ] [MAIN ] JHX: Loaded 53155 primary data records. [2025-10-14T22:39:14.829987] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:14.830950] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16017 primary records. [2025-10-14T22:39:14.831315] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-14T22:39:14.847827] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-14T22:39:14.848134] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-14T22:39:14.850174] [INFO ] [MAIN ] Derivative Progress: 991/1812 symbols completed. JILL took 1.0s. Estimated remaining: 5m 13s. Rate: 157.3 symbols/min [2025-10-14T22:39:14.851514] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:14.869749] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:14.883105] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39715 primary records. [2025-10-14T22:39:14.883537] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-14T22:39:14.883351] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:14.885035] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 53155 primary records. [2025-10-14T22:39:14.885181] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-14T22:39:14.916406] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-14T22:39:14.916984] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-14T22:39:14.927736] [INFO ] [MAIN ] Derivative Progress: 992/1812 symbols completed. JHX took 1.1s. Estimated remaining: 5m 13s. Rate: 157.4 symbols/min [2025-10-14T22:39:14.929146] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-14T22:39:14.929337] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:14.929516] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-14T22:39:14.931691] [INFO ] [MAIN ] Derivative Progress: 993/1812 symbols completed. JKS took 1.1s. Estimated remaining: 5m 12s. Rate: 157.5 symbols/min [2025-10-14T22:39:14.932240] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:14.945178] [DEBUG] [LOCAL ] JLL: Loaded 31732 existing records from primary storage. [2025-10-14T22:39:14.945366] [INFO ] [MAIN ] JLL: Loaded 31732 primary data records. [2025-10-14T22:39:14.959551] [DEBUG] [LOCAL ] JLS: Loaded 4203 existing records from primary storage. [2025-10-14T22:39:14.979279] [INFO ] [MAIN ] JLS: Loaded 4203 primary data records. [2025-10-14T22:39:15.595230] [DEBUG] [LOCAL ] JMIA: Loaded 51026 existing records from primary storage. [2025-10-14T22:39:15.595492] [INFO ] [MAIN ] JMIA: Loaded 51026 primary data records. [2025-10-14T22:39:15.937765] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:15.943446] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:15.944905] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4203 primary records. [2025-10-14T22:39:15.944299] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31732 primary records. [2025-10-14T22:39:15.945034] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-14T22:39:15.945158] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-14T22:39:15.969899] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-14T22:39:15.972538] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-14T22:39:15.976846] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-14T22:39:15.979043] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-14T22:39:15.978976] [INFO ] [MAIN ] Derivative Progress: 994/1812 symbols completed. JLS took 1.0s. Estimated remaining: 5m 12s. Rate: 157.3 symbols/min [2025-10-14T22:39:15.979214] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:15.981688] [INFO ] [MAIN ] Derivative Progress: 995/1812 symbols completed. JLL took 1.1s. Estimated remaining: 5m 11s. Rate: 157.4 symbols/min [2025-10-14T22:39:15.982186] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:16.002079] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:16.003012] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 51026 primary records. [2025-10-14T22:39:16.003226] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-14T22:39:16.020038] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-14T22:39:16.020436] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-14T22:39:16.023376] [INFO ] [MAIN ] Derivative Progress: 996/1812 symbols completed. JMIA took 1.1s. Estimated remaining: 5m 11s. Rate: 157.6 symbols/min [2025-10-14T22:39:16.024221] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:16.072873] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-14T22:39:16.077416] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-14T22:39:16.205708] [DEBUG] [LOCAL ] JOBY: Loaded 53808 existing records from primary storage. [2025-10-14T22:39:16.209372] [INFO ] [MAIN ] JOBY: Loaded 53808 primary data records. [2025-10-14T22:39:16.191980] [DEBUG] [LOCAL ] JOE: Loaded 23904 existing records from primary storage. [2025-10-14T22:39:16.209812] [INFO ] [MAIN ] JOE: Loaded 23904 primary data records. [2025-10-14T22:39:17.095635] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:17.097030] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-14T22:39:17.098694] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-14T22:39:17.129565] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:17.131036] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23904 primary records. [2025-10-14T22:39:17.131666] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-14T22:39:17.142212] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-14T22:39:17.155205] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-14T22:39:17.157027] [INFO ] [MAIN ] Derivative Progress: 997/1812 symbols completed. JNJ took 1.2s. Estimated remaining: 5m 11s. Rate: 157.2 symbols/min [2025-10-14T22:39:17.160103] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:17.157370] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:17.162003] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53808 primary records. [2025-10-14T22:39:17.162802] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-14T22:39:17.182388] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-14T22:39:17.183505] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-14T22:39:17.189776] [INFO ] [MAIN ] Derivative Progress: 998/1812 symbols completed. JOE took 1.2s. Estimated remaining: 5m 10s. Rate: 157.4 symbols/min [2025-10-14T22:39:17.191022] [DEBUG] [LOCAL ] JOF: Loaded 6886 existing records from primary storage. [2025-10-14T22:39:17.192367] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:17.192257] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-14T22:39:17.192441] [INFO ] [MAIN ] JOF: Loaded 6886 primary data records. [2025-10-14T22:39:17.203992] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-14T22:39:17.215733] [INFO ] [MAIN ] Derivative Progress: 999/1812 symbols completed. JOBY took 1.2s. Estimated remaining: 5m 10s. Rate: 157.5 symbols/min [2025-10-14T22:39:17.250843] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:17.508305] [DEBUG] [LOCAL ] JPC: Loaded 37244 existing records from primary storage. [2025-10-14T22:39:17.509196] [INFO ] [MAIN ] JPC: Loaded 37244 primary data records. [2025-10-14T22:39:17.839785] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-14T22:39:17.853419] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-14T22:39:18.049167] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:18.169754] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6886 primary records. [2025-10-14T22:39:18.170159] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-14T22:39:18.192411] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-14T22:39:18.193482] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-14T22:39:18.195818] [INFO ] [MAIN ] Derivative Progress: 1000/1812 symbols completed. JOF took 1.0s. Estimated remaining: 5m 10s. Rate: 157.3 symbols/min [2025-10-14T22:39:18.196037] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:18.211140] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:18.212163] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37244 primary records. [2025-10-14T22:39:18.212381] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-14T22:39:18.229860] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-14T22:39:18.231781] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-14T22:39:18.234962] [INFO ] [MAIN ] Derivative Progress: 1001/1812 symbols completed. JPC took 1.0s. Estimated remaining: 5m 9s. Rate: 157.4 symbols/min [2025-10-14T22:39:18.243731] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:18.257833] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:18.258698] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-14T22:39:18.258869] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-14T22:39:18.287805] [DEBUG] [LOCAL ] JQC: Loaded 33824 existing records from primary storage. [2025-10-14T22:39:18.288473] [INFO ] [MAIN ] JQC: Loaded 33824 primary data records. [2025-10-14T22:39:18.342858] [DEBUG] [LOCAL ] JRI: Loaded 15431 existing records from primary storage. [2025-10-14T22:39:18.357036] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-14T22:39:18.366526] [INFO ] [MAIN ] JRI: Loaded 15431 primary data records. [2025-10-14T22:39:18.379368] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-14T22:39:18.391833] [INFO ] [MAIN ] Derivative Progress: 1002/1812 symbols completed. JPM took 1.1s. Estimated remaining: 5m 9s. Rate: 157.5 symbols/min [2025-10-14T22:39:18.403417] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:18.744229] [DEBUG] [LOCAL ] JRS: Loaded 11664 existing records from primary storage. [2025-10-14T22:39:18.781499] [INFO ] [MAIN ] JRS: Loaded 11664 primary data records. [2025-10-14T22:39:19.286832] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:19.288821] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33824 primary records. [2025-10-14T22:39:19.289602] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-14T22:39:19.326174] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-14T22:39:19.325406] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:19.326354] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-14T22:39:19.329164] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15431 primary records. [2025-10-14T22:39:19.328255] [INFO ] [MAIN ] Derivative Progress: 1003/1812 symbols completed. JQC took 1.1s. Estimated remaining: 5m 9s. Rate: 157.3 symbols/min [2025-10-14T22:39:19.329453] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-14T22:39:19.359141] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:19.360923] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11664 primary records. [2025-10-14T22:39:19.361244] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-14T22:39:19.362719] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-14T22:39:19.362826] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-14T22:39:19.365160] [INFO ] [MAIN ] Derivative Progress: 1004/1812 symbols completed. JRI took 1.1s. Estimated remaining: 5m 8s. Rate: 157.4 symbols/min [2025-10-14T22:39:19.379750] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-14T22:39:19.379822] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-14T22:39:19.382014] [INFO ] [MAIN ] Derivative Progress: 1005/1812 symbols completed. JRS took 1.0s. Estimated remaining: 5m 7s. Rate: 157.6 symbols/min [2025-10-14T22:39:19.382360] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:19.382452] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:19.382904] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:19.401948] [DEBUG] [LOCAL ] KAI: Loaded 13548 existing records from primary storage. [2025-10-14T22:39:19.402129] [INFO ] [MAIN ] KAI: Loaded 13548 primary data records. [2025-10-14T22:39:19.727132] [DEBUG] [LOCAL ] JXN: Loaded 44808 existing records from primary storage. [2025-10-14T22:39:19.741228] [INFO ] [MAIN ] JXN: Loaded 44808 primary data records. [2025-10-14T22:39:19.754907] [DEBUG] [LOCAL ] K: Loaded 50400 existing records from primary storage. [2025-10-14T22:39:19.778064] [INFO ] [MAIN ] K: Loaded 50400 primary data records. [2025-10-14T22:39:20.365426] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:20.366286] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13548 primary records. [2025-10-14T22:39:20.366708] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-14T22:39:20.387008] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-14T22:39:20.387342] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-14T22:39:20.389729] [INFO ] [MAIN ] Derivative Progress: 1006/1812 symbols completed. KAI took 1.0s. Estimated remaining: 5m 7s. Rate: 157.3 symbols/min [2025-10-14T22:39:20.390976] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:20.407062] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:20.409163] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50400 primary records. [2025-10-14T22:39:20.409367] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-14T22:39:20.434998] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:20.436197] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 44808 primary records. [2025-10-14T22:39:20.436678] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-14T22:39:20.453064] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-14T22:39:20.461872] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-14T22:39:20.464590] [INFO ] [MAIN ] Derivative Progress: 1007/1812 symbols completed. K took 1.1s. Estimated remaining: 5m 7s. Rate: 157.5 symbols/min [2025-10-14T22:39:20.465176] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:20.467370] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-14T22:39:20.467484] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-14T22:39:20.469626] [INFO ] [MAIN ] Derivative Progress: 1008/1812 symbols completed. JXN took 1.1s. Estimated remaining: 5m 6s. Rate: 157.6 symbols/min [2025-10-14T22:39:20.469813] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:20.484607] [DEBUG] [LOCAL ] KAR: Loaded 40095 existing records from primary storage. [2025-10-14T22:39:20.484781] [INFO ] [MAIN ] KAR: Loaded 40095 primary data records. [2025-10-14T22:39:20.602868] [DEBUG] [LOCAL ] KBDC: Loaded 22139 existing records from primary storage. [2025-10-14T22:39:20.606230] [INFO ] [MAIN ] KBDC: Loaded 22139 primary data records. [2025-10-14T22:39:20.634682] [DEBUG] [LOCAL ] KB: Loaded 23417 existing records from primary storage. [2025-10-14T22:39:20.640020] [INFO ] [MAIN ] KB: Loaded 23417 primary data records. [2025-10-14T22:39:21.453586] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:21.454299] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40095 primary records. [2025-10-14T22:39:21.454554] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-14T22:39:21.489271] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:21.490331] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 22139 primary records. [2025-10-14T22:39:21.490711] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-14T22:39:21.498489] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-14T22:39:21.503767] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-14T22:39:21.504047] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:21.512133] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23417 primary records. [2025-10-14T22:39:21.514990] [INFO ] [MAIN ] Derivative Progress: 1009/1812 symbols completed. KAR took 1.1s. Estimated remaining: 5m 6s. Rate: 157.3 symbols/min [2025-10-14T22:39:21.513035] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-14T22:39:21.521374] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:21.523374] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-14T22:39:21.523624] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-14T22:39:21.532988] [INFO ] [MAIN ] Derivative Progress: 1010/1812 symbols completed. KBDC took 1.1s. Estimated remaining: 5m 6s. Rate: 157.5 symbols/min [2025-10-14T22:39:21.534024] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:21.541256] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-14T22:39:21.541351] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-14T22:39:21.543520] [INFO ] [MAIN ] Derivative Progress: 1011/1812 symbols completed. KB took 1.1s. Estimated remaining: 5m 5s. Rate: 157.6 symbols/min [2025-10-14T22:39:21.544094] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:21.621791] [DEBUG] [LOCAL ] KBH: Loaded 48836 existing records from primary storage. [2025-10-14T22:39:21.623495] [INFO ] [MAIN ] KBH: Loaded 48836 primary data records. [2025-10-14T22:39:21.624301] [DEBUG] [LOCAL ] KBR: Loaded 48037 existing records from primary storage. [2025-10-14T22:39:21.668917] [INFO ] [MAIN ] KBR: Loaded 48037 primary data records. [2025-10-14T22:39:21.750450] [DEBUG] [LOCAL ] KD: Loaded 52358 existing records from primary storage. [2025-10-14T22:39:21.777018] [INFO ] [MAIN ] KD: Loaded 52358 primary data records. [2025-10-14T22:39:22.573440] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:22.574255] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48836 primary records. [2025-10-14T22:39:22.574491] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-14T22:39:22.607097] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:22.608350] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48037 primary records. [2025-10-14T22:39:22.608962] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-14T22:39:22.609015] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-14T22:39:22.609885] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-14T22:39:22.630596] [INFO ] [MAIN ] Derivative Progress: 1012/1812 symbols completed. KBH took 1.1s. Estimated remaining: 5m 5s. Rate: 157.3 symbols/min [2025-10-14T22:39:22.634820] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:22.634474] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:22.635829] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52358 primary records. [2025-10-14T22:39:22.636882] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-14T22:39:22.656992] [DEBUG] [LOCAL ] KEN: Loaded 4689 existing records from primary storage. [2025-10-14T22:39:22.654361] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-14T22:39:22.657123] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-14T22:39:22.657790] [INFO ] [MAIN ] KEN: Loaded 4689 primary data records. [2025-10-14T22:39:22.660847] [INFO ] [MAIN ] Derivative Progress: 1013/1812 symbols completed. KBR took 1.1s. Estimated remaining: 5m 4s. Rate: 157.5 symbols/min [2025-10-14T22:39:22.661684] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:22.696617] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-14T22:39:22.709493] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-14T22:39:22.738864] [INFO ] [MAIN ] Derivative Progress: 1014/1812 symbols completed. KD took 1.2s. Estimated remaining: 5m 4s. Rate: 157.6 symbols/min [2025-10-14T22:39:22.757237] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:23.021733] [DEBUG] [LOCAL ] KEP: Loaded 31864 existing records from primary storage. [2025-10-14T22:39:23.021944] [INFO ] [MAIN ] KEP: Loaded 31864 primary data records. [2025-10-14T22:39:23.130630] [DEBUG] [LOCAL ] KEX: Loaded 38548 existing records from primary storage. [2025-10-14T22:39:23.142418] [INFO ] [MAIN ] KEX: Loaded 38548 primary data records. [2025-10-14T22:39:23.657827] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:23.658791] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4689 primary records. [2025-10-14T22:39:23.660112] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-14T22:39:23.677803] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-14T22:39:23.678332] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-14T22:39:23.680774] [INFO ] [MAIN ] Derivative Progress: 1015/1812 symbols completed. KEN took 1.0s. Estimated remaining: 5m 4s. Rate: 157.4 symbols/min [2025-10-14T22:39:23.681223] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:23.704188] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:23.705185] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31864 primary records. [2025-10-14T22:39:23.707162] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-14T22:39:23.736140] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:23.747576] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38548 primary records. [2025-10-14T22:39:23.749382] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-14T22:39:23.749496] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-14T22:39:23.750504] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-14T22:39:23.752608] [INFO ] [MAIN ] Derivative Progress: 1016/1812 symbols completed. KEP took 1.1s. Estimated remaining: 5m 3s. Rate: 157.5 symbols/min [2025-10-14T22:39:23.760441] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:23.770149] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-14T22:39:23.781017] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-14T22:39:23.786042] [DEBUG] [LOCAL ] KEYS: Loaded 43320 existing records from primary storage. [2025-10-14T22:39:23.784966] [INFO ] [MAIN ] Derivative Progress: 1017/1812 symbols completed. KEX took 1.0s. Estimated remaining: 5m 3s. Rate: 157.7 symbols/min [2025-10-14T22:39:23.786313] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:23.786481] [INFO ] [MAIN ] KEYS: Loaded 43320 primary data records. [2025-10-14T22:39:23.788727] [DEBUG] [LOCAL ] KF: Loaded 2339 existing records from primary storage. [2025-10-14T22:39:23.789066] [INFO ] [MAIN ] KF: Loaded 2339 primary data records. [2025-10-14T22:39:24.011605] [DEBUG] [LOCAL ] KFRC: Loaded 20396 existing records from primary storage. [2025-10-14T22:39:24.043168] [INFO ] [MAIN ] KFRC: Loaded 20396 primary data records. [2025-10-14T22:39:24.732037] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:24.731536] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:24.732767] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2339 primary records. [2025-10-14T22:39:24.733432] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43320 primary records. [2025-10-14T22:39:24.733674] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-14T22:39:24.733824] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-14T22:39:24.758738] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-14T22:39:24.759398] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-14T22:39:24.762194] [INFO ] [MAIN ] Derivative Progress: 1018/1812 symbols completed. KF took 1.0s. Estimated remaining: 5m 3s. Rate: 157.4 symbols/min [2025-10-14T22:39:24.767270] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-14T22:39:24.768094] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-14T22:39:24.769920] [INFO ] [MAIN ] Derivative Progress: 1019/1812 symbols completed. KEYS took 1.1s. Estimated remaining: 5m 2s. Rate: 157.6 symbols/min [2025-10-14T22:39:24.783232] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:24.783789] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 20396 primary records. [2025-10-14T22:39:24.783848] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-14T22:39:24.798509] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-14T22:39:24.798566] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-14T22:39:24.800697] [INFO ] [MAIN ] Derivative Progress: 1020/1812 symbols completed. KFRC took 1.0s. Estimated remaining: 5m 1s. Rate: 157.7 symbols/min [2025-10-14T22:39:24.801133] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:24.801072] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:24.802121] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:24.814921] [DEBUG] [LOCAL ] KFS: Loaded 8695 existing records from primary storage. [2025-10-14T22:39:24.815453] [INFO ] [MAIN ] KFS: Loaded 8695 primary data records. [2025-10-14T22:39:24.946497] [DEBUG] [LOCAL ] KFY: Loaded 29975 existing records from primary storage. [2025-10-14T22:39:24.957412] [INFO ] [MAIN ] KFY: Loaded 29975 primary data records. [2025-10-14T22:39:25.303738] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-14T22:39:25.337519] [INFO ] [MAIN ] KGC: Loaded 53700 primary data records. [2025-10-14T22:39:25.821827] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:25.825139] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8695 primary records. [2025-10-14T22:39:25.825446] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-14T22:39:25.850905] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:25.851892] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 29975 primary records. [2025-10-14T22:39:25.852779] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-14T22:39:25.869111] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-10-14T22:39:25.870077] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-14T22:39:25.872532] [INFO ] [MAIN ] Derivative Progress: 1021/1812 symbols completed. KFS took 1.1s. Estimated remaining: 5m 1s. Rate: 157.4 symbols/min [2025-10-14T22:39:25.873885] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:25.879692] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-14T22:39:25.879933] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-14T22:39:25.882200] [INFO ] [MAIN ] Derivative Progress: 1022/1812 symbols completed. KFY took 1.1s. Estimated remaining: 5m 1s. Rate: 157.6 symbols/min [2025-10-14T22:39:25.882433] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:25.896879] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:25.897702] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53700 primary records. [2025-10-14T22:39:25.897840] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-14T22:39:25.917736] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-14T22:39:25.918006] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-14T22:39:25.921053] [INFO ] [MAIN ] Derivative Progress: 1023/1812 symbols completed. KGC took 1.1s. Estimated remaining: 5m 0s. Rate: 157.7 symbols/min [2025-10-14T22:39:25.921319] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:25.982311] [DEBUG] [LOCAL ] KGS: Loaded 46153 existing records from primary storage. [2025-10-14T22:39:25.983585] [INFO ] [MAIN ] KGS: Loaded 46153 primary data records. [2025-10-14T22:39:26.005351] [DEBUG] [LOCAL ] KIM: Loaded 52997 existing records from primary storage. [2025-10-14T22:39:26.048316] [INFO ] [MAIN ] KIM: Loaded 52997 primary data records. [2025-10-14T22:39:26.135753] [DEBUG] [LOCAL ] KIO: Loaded 21606 existing records from primary storage. [2025-10-14T22:39:26.151867] [INFO ] [MAIN ] KIO: Loaded 21606 primary data records. [2025-10-14T22:39:27.000288] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:27.003224] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 46153 primary records. [2025-10-14T22:39:27.003399] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-14T22:39:27.039415] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-14T22:39:27.039594] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-14T22:39:27.035180] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:27.052524] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 52997 primary records. [2025-10-14T22:39:27.054319] [INFO ] [MAIN ] Derivative Progress: 1024/1812 symbols completed. KGS took 1.2s. Estimated remaining: 5m 0s. Rate: 157.4 symbols/min [2025-10-14T22:39:27.054691] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:27.055461] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-14T22:39:27.055408] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:27.056736] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21606 primary records. [2025-10-14T22:39:27.057398] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-14T22:39:27.085838] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-14T22:39:27.086624] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-14T22:39:27.090909] [DEBUG] [LOCAL ] KKRS: Loaded 5647 existing records from primary storage. [2025-10-14T22:39:27.093576] [INFO ] [MAIN ] KKRS: Loaded 5647 primary data records. [2025-10-14T22:39:27.093472] [INFO ] [MAIN ] Derivative Progress: 1025/1812 symbols completed. KIM took 1.2s. Estimated remaining: 4m 60s. Rate: 157.5 symbols/min [2025-10-14T22:39:27.106364] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:27.140635] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-14T22:39:27.152849] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-14T22:39:27.163905] [INFO ] [MAIN ] Derivative Progress: 1026/1812 symbols completed. KIO took 1.2s. Estimated remaining: 4m 59s. Rate: 157.7 symbols/min [2025-10-14T22:39:27.164106] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:27.424105] [DEBUG] [LOCAL ] KLC: Loaded 36536 existing records from primary storage. [2025-10-14T22:39:27.424504] [INFO ] [MAIN ] KLC: Loaded 36536 primary data records. [2025-10-14T22:39:27.646505] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-14T22:39:27.757329] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-14T22:39:27.820511] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:27.860700] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5647 primary records. [2025-10-14T22:39:27.874369] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-14T22:39:27.942564] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-14T22:39:27.978198] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-14T22:39:28.006954] [INFO ] [MAIN ] Derivative Progress: 1027/1812 symbols completed. KKRS took 1.0s. Estimated remaining: 4m 59s. Rate: 157.5 symbols/min [2025-10-14T22:39:28.014089] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:28.145209] [DEBUG] [LOCAL ] KMPB: Loaded 3693 existing records from primary storage. [2025-10-14T22:39:28.145699] [INFO ] [MAIN ] KMPB: Loaded 3693 primary data records. [2025-10-14T22:39:28.324097] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:28.355280] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36536 primary records. [2025-10-14T22:39:28.469667] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-14T22:39:28.493537] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-14T22:39:28.494150] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-14T22:39:28.496374] [INFO ] [MAIN ] Derivative Progress: 1028/1812 symbols completed. KLC took 1.4s. Estimated remaining: 4m 59s. Rate: 157.4 symbols/min [2025-10-14T22:39:28.496626] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:28.511260] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:28.512122] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-14T22:39:28.512368] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-14T22:39:28.529443] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-14T22:39:28.529616] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-14T22:39:28.532680] [INFO ] [MAIN ] Derivative Progress: 1029/1812 symbols completed. KMI took 1.4s. Estimated remaining: 4m 58s. Rate: 157.6 symbols/min [2025-10-14T22:39:28.533267] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:28.551782] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:39:28.552546] [INFO ] [MAIN ] KMPB: Generated 1792 derivative records from 3693 primary records. [2025-10-14T22:39:28.552725] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-14T22:39:28.578220] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1792 records). [2025-10-14T22:39:28.588926] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-14T22:39:28.592299] [INFO ] [MAIN ] Derivative Progress: 1030/1812 symbols completed. KMPB took 0.6s. Estimated remaining: 4m 58s. Rate: 157.7 symbols/min [2025-10-14T22:39:28.592528] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:28.594261] [DEBUG] [LOCAL ] KMPR: Loaded 39849 existing records from primary storage. [2025-10-14T22:39:28.594399] [INFO ] [MAIN ] KMPR: Loaded 39849 primary data records. [2025-10-14T22:39:28.735785] [DEBUG] [LOCAL ] KMT: Loaded 42914 existing records from primary storage. [2025-10-14T22:39:28.747091] [INFO ] [MAIN ] KMT: Loaded 42914 primary data records. [2025-10-14T22:39:29.308980] [DEBUG] [LOCAL ] KMX: Loaded 53268 existing records from primary storage. [2025-10-14T22:39:29.309495] [INFO ] [MAIN ] KMX: Loaded 53268 primary data records. [2025-10-14T22:39:29.651182] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:29.652989] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 39849 primary records. [2025-10-14T22:39:29.653592] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-14T22:39:29.673952] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-14T22:39:29.674708] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-14T22:39:29.677596] [INFO ] [MAIN ] Derivative Progress: 1031/1812 symbols completed. KMPR took 1.2s. Estimated remaining: 4m 58s. Rate: 157.4 symbols/min [2025-10-14T22:39:29.678277] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:29.693165] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:29.694110] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42914 primary records. [2025-10-14T22:39:29.694329] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-14T22:39:29.711454] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-14T22:39:29.711693] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-14T22:39:29.714129] [INFO ] [MAIN ] Derivative Progress: 1032/1812 symbols completed. KMT took 1.2s. Estimated remaining: 4m 57s. Rate: 157.6 symbols/min [2025-10-14T22:39:29.714352] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:29.731859] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:29.743997] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53268 primary records. [2025-10-14T22:39:29.744174] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-14T22:39:29.781789] [DEBUG] [LOCAL ] KN: Loaded 38607 existing records from primary storage. [2025-10-14T22:39:29.782385] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-14T22:39:29.782725] [INFO ] [MAIN ] KN: Loaded 38607 primary data records. [2025-10-14T22:39:29.782844] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-14T22:39:29.790527] [INFO ] [MAIN ] Derivative Progress: 1033/1812 symbols completed. KMX took 1.2s. Estimated remaining: 4m 56s. Rate: 157.7 symbols/min [2025-10-14T22:39:29.882466] [DEBUG] [LOCAL ] KNF: Loaded 36549 existing records from primary storage. [2025-10-14T22:39:29.899450] [INFO ] [MAIN ] KNF: Loaded 36549 primary data records. [2025-10-14T22:39:30.442206] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:30.442968] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38607 primary records. [2025-10-14T22:39:30.443122] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-14T22:39:30.474136] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:30.474639] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-14T22:39:30.474801] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-14T22:39:30.475431] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36549 primary records. [2025-10-14T22:39:30.477213] [INFO ] [MAIN ] Derivative Progress: 1034/1812 symbols completed. KN took 0.8s. Estimated remaining: 4m 56s. Rate: 157.6 symbols/min [2025-10-14T22:39:30.477297] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-14T22:39:30.492394] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-14T22:39:30.492451] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-14T22:39:30.494741] [INFO ] [MAIN ] Derivative Progress: 1035/1812 symbols completed. KNF took 0.8s. Estimated remaining: 4m 56s. Rate: 157.7 symbols/min [2025-10-14T22:39:30.495277] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:30.495584] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:30.495438] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:30.509133] [DEBUG] [LOCAL ] KNOP: Loaded 10475 existing records from primary storage. [2025-10-14T22:39:30.509331] [INFO ] [MAIN ] KNOP: Loaded 10475 primary data records. [2025-10-14T22:39:30.626350] [DEBUG] [LOCAL ] KNSL: Loaded 18386 existing records from primary storage. [2025-10-14T22:39:30.641947] [INFO ] [MAIN ] KNSL: Loaded 18386 primary data records. [2025-10-14T22:39:30.846871] [DEBUG] [LOCAL ] KNTK: Loaded 46985 existing records from primary storage. [2025-10-14T22:39:30.974400] [INFO ] [MAIN ] KNTK: Loaded 46985 primary data records. [2025-10-14T22:39:31.513621] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:31.516357] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10475 primary records. [2025-10-14T22:39:31.516946] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-14T22:39:31.532402] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:31.534178] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18386 primary records. [2025-10-14T22:39:31.534623] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-14T22:39:31.563031] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-14T22:39:31.563847] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-14T22:39:31.566315] [INFO ] [MAIN ] Derivative Progress: 1036/1812 symbols completed. KNSL took 1.1s. Estimated remaining: 4m 56s. Rate: 157.4 symbols/min [2025-10-14T22:39:31.566877] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:31.575480] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-14T22:39:31.575786] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-14T22:39:31.577907] [INFO ] [MAIN ] Derivative Progress: 1037/1812 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 55s. Rate: 157.6 symbols/min [2025-10-14T22:39:31.591145] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:31.591554] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:31.592772] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46985 primary records. [2025-10-14T22:39:31.593372] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-14T22:39:31.614530] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-14T22:39:31.614733] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-14T22:39:31.617293] [INFO ] [MAIN ] Derivative Progress: 1038/1812 symbols completed. KNTK took 1.1s. Estimated remaining: 4m 54s. Rate: 157.7 symbols/min [2025-10-14T22:39:31.617469] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:31.677089] [DEBUG] [LOCAL ] KNX: Loaded 52607 existing records from primary storage. [2025-10-14T22:39:31.677374] [INFO ] [MAIN ] KNX: Loaded 52607 primary data records. [2025-10-14T22:39:31.799593] [DEBUG] [LOCAL ] KOF: Loaded 26602 existing records from primary storage. [2025-10-14T22:39:31.821154] [INFO ] [MAIN ] KOF: Loaded 26602 primary data records. [2025-10-14T22:39:31.810790] [DEBUG] [LOCAL ] KODK: Loaded 43707 existing records from primary storage. [2025-10-14T22:39:31.869585] [INFO ] [MAIN ] KODK: Loaded 43707 primary data records. [2025-10-14T22:39:32.721491] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:32.722138] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:32.723136] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26602 primary records. [2025-10-14T22:39:32.724265] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-14T22:39:32.725853] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52607 primary records. [2025-10-14T22:39:32.727558] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-14T22:39:32.745370] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-14T22:39:32.767412] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-14T22:39:32.770118] [INFO ] [MAIN ] Derivative Progress: 1039/1812 symbols completed. KOF took 1.2s. Estimated remaining: 4m 55s. Rate: 157.4 symbols/min [2025-10-14T22:39:32.775133] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:32.774994] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:32.777521] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43707 primary records. [2025-10-14T22:39:32.778356] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-14T22:39:32.803011] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-14T22:39:32.804220] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-14T22:39:32.803522] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-14T22:39:32.804460] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-14T22:39:32.808301] [INFO ] [MAIN ] Derivative Progress: 1040/1812 symbols completed. KODK took 1.2s. Estimated remaining: 4m 54s. Rate: 157.5 symbols/min [2025-10-14T22:39:32.810593] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:32.816276] [INFO ] [MAIN ] Derivative Progress: 1041/1812 symbols completed. KNX took 1.2s. Estimated remaining: 4m 53s. Rate: 157.7 symbols/min [2025-10-14T22:39:32.818175] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:32.818008] [DEBUG] [LOCAL ] KOP: Loaded 17462 existing records from primary storage. [2025-10-14T22:39:32.819040] [INFO ] [MAIN ] KOP: Loaded 17462 primary data records. [2025-10-14T22:39:32.892236] [DEBUG] [LOCAL ] KORE: Loaded 2171 existing records from primary storage. [2025-10-14T22:39:32.915263] [INFO ] [MAIN ] KORE: Loaded 2171 primary data records. [2025-10-14T22:39:33.394977] [DEBUG] [LOCAL ] KOS: Loaded 53091 existing records from primary storage. [2025-10-14T22:39:33.508892] [INFO ] [MAIN ] KOS: Loaded 53091 primary data records. [2025-10-14T22:39:33.854372] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:33.855957] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17462 primary records. [2025-10-14T22:39:33.856305] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-14T22:39:33.887071] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-14T22:39:33.893447] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:39:33.893758] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-14T22:39:33.896131] [INFO ] [MAIN ] Derivative Progress: 1042/1812 symbols completed. KOP took 1.1s. Estimated remaining: 4m 53s. Rate: 157.4 symbols/min [2025-10-14T22:39:33.897462] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:33.897190] [INFO ] [MAIN ] KORE: Generated 1792 derivative records from 2171 primary records. [2025-10-14T22:39:33.898460] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-14T22:39:33.917846] [DEBUG] [LOCAL ] KORE: Derivative data saved (1792 records). [2025-10-14T22:39:33.918273] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-14T22:39:33.922202] [INFO ] [MAIN ] Derivative Progress: 1043/1812 symbols completed. KORE took 1.1s. Estimated remaining: 4m 53s. Rate: 157.6 symbols/min [2025-10-14T22:39:33.923208] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:33.937173] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:33.938087] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53091 primary records. [2025-10-14T22:39:33.938250] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-14T22:39:33.972165] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-14T22:39:33.972447] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-14T22:39:33.975052] [INFO ] [MAIN ] Derivative Progress: 1044/1812 symbols completed. KOS took 1.2s. Estimated remaining: 4m 52s. Rate: 157.7 symbols/min [2025-10-14T22:39:33.975323] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:34.008473] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-14T22:39:34.008866] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-14T22:39:34.145890] [DEBUG] [LOCAL ] KRC: Loaded 48299 existing records from primary storage. [2025-10-14T22:39:34.184199] [DEBUG] [LOCAL ] KREF: Loaded 38003 existing records from primary storage. [2025-10-14T22:39:34.198025] [INFO ] [MAIN ] KRC: Loaded 48299 primary data records. [2025-10-14T22:39:34.216689] [INFO ] [MAIN ] KREF: Loaded 38003 primary data records. [2025-10-14T22:39:35.032287] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:35.033599] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-14T22:39:35.033910] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-14T22:39:35.052108] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-14T22:39:35.052375] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-14T22:39:35.061814] [INFO ] [MAIN ] Derivative Progress: 1045/1812 symbols completed. KR took 1.2s. Estimated remaining: 4m 52s. Rate: 157.4 symbols/min [2025-10-14T22:39:35.066933] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:35.067254] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:35.068223] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48299 primary records. [2025-10-14T22:39:35.068425] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-14T22:39:35.086581] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-14T22:39:35.086719] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-14T22:39:35.089139] [INFO ] [MAIN ] Derivative Progress: 1046/1812 symbols completed. KRC took 1.2s. Estimated remaining: 4m 52s. Rate: 157.5 symbols/min [2025-10-14T22:39:35.101810] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:35.102341] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:35.103329] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 38003 primary records. [2025-10-14T22:39:35.103485] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-14T22:39:35.120202] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-14T22:39:35.120348] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-14T22:39:35.123875] [INFO ] [MAIN ] Derivative Progress: 1047/1812 symbols completed. KREF took 1.1s. Estimated remaining: 4m 51s. Rate: 157.7 symbols/min [2025-10-14T22:39:35.124114] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:35.153571] [DEBUG] [LOCAL ] KRO: Loaded 26420 existing records from primary storage. [2025-10-14T22:39:35.153775] [INFO ] [MAIN ] KRO: Loaded 26420 primary data records. [2025-10-14T22:39:35.273901] [DEBUG] [LOCAL ] KRG: Loaded 49267 existing records from primary storage. [2025-10-14T22:39:35.294822] [INFO ] [MAIN ] KRG: Loaded 49267 primary data records. [2025-10-14T22:39:35.601231] [DEBUG] [LOCAL ] KRP: Loaded 36430 existing records from primary storage. [2025-10-14T22:39:35.605949] [INFO ] [MAIN ] KRP: Loaded 36430 primary data records. [2025-10-14T22:39:36.151574] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:36.152477] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26420 primary records. [2025-10-14T22:39:36.154242] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-14T22:39:36.182220] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:36.184057] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49267 primary records. [2025-10-14T22:39:36.184434] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-14T22:39:36.189535] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-14T22:39:36.190019] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-14T22:39:36.192239] [INFO ] [MAIN ] Derivative Progress: 1048/1812 symbols completed. KRO took 1.1s. Estimated remaining: 4m 51s. Rate: 157.4 symbols/min [2025-10-14T22:39:36.209741] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-14T22:39:36.210004] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-14T22:39:36.213870] [INFO ] [MAIN ] Derivative Progress: 1049/1812 symbols completed. KRG took 1.1s. Estimated remaining: 4m 51s. Rate: 157.6 symbols/min [2025-10-14T22:39:36.229674] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:36.230266] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36430 primary records. [2025-10-14T22:39:36.230326] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-14T22:39:36.247383] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-14T22:39:36.247497] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-14T22:39:36.249943] [INFO ] [MAIN ] Derivative Progress: 1050/1812 symbols completed. KRP took 1.1s. Estimated remaining: 4m 50s. Rate: 157.7 symbols/min [2025-10-14T22:39:36.250489] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:36.250425] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:36.250696] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:36.307535] [DEBUG] [LOCAL ] KTB: Loaded 40489 existing records from primary storage. [2025-10-14T22:39:36.323111] [INFO ] [MAIN ] KTB: Loaded 40489 primary data records. [2025-10-14T22:39:36.498795] [DEBUG] [LOCAL ] KT: Loaded 45503 existing records from primary storage. [2025-10-14T22:39:36.506146] [DEBUG] [LOCAL ] KSS: Loaded 53595 existing records from primary storage. [2025-10-14T22:39:36.527356] [INFO ] [MAIN ] KT: Loaded 45503 primary data records. [2025-10-14T22:39:36.569051] [INFO ] [MAIN ] KSS: Loaded 53595 primary data records. [2025-10-14T22:39:37.600705] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:37.601941] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40489 primary records. [2025-10-14T22:39:37.602190] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-14T22:39:37.621524] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-14T22:39:37.622003] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-14T22:39:37.624027] [INFO ] [MAIN ] Derivative Progress: 1051/1812 symbols completed. KTB took 1.4s. Estimated remaining: 4m 50s. Rate: 157.3 symbols/min [2025-10-14T22:39:37.624419] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:37.647572] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:37.654851] [DEBUG] [LOCAL ] KTF: Loaded 11831 existing records from primary storage. [2025-10-14T22:39:37.655617] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45503 primary records. [2025-10-14T22:39:37.655855] [INFO ] [MAIN ] KTF: Loaded 11831 primary data records. [2025-10-14T22:39:37.656075] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-14T22:39:37.704454] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:37.724594] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53595 primary records. [2025-10-14T22:39:37.736819] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-14T22:39:37.736918] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-14T22:39:37.751543] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-14T22:39:37.764837] [INFO ] [MAIN ] Derivative Progress: 1052/1812 symbols completed. KT took 1.5s. Estimated remaining: 4m 50s. Rate: 157.4 symbols/min [2025-10-14T22:39:37.776111] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:37.896108] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-14T22:39:37.921763] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-14T22:39:38.046559] [INFO ] [MAIN ] Derivative Progress: 1053/1812 symbols completed. KSS took 1.8s. Estimated remaining: 4m 49s. Rate: 157.4 symbols/min [2025-10-14T22:39:38.046887] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:38.110051] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:38.111854] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-14T22:39:38.110847] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 11831 primary records. [2025-10-14T22:39:38.112225] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-14T22:39:38.124882] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-14T22:39:38.277703] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-14T22:39:38.298468] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-14T22:39:38.324000] [INFO ] [MAIN ] Derivative Progress: 1054/1812 symbols completed. KTF took 0.7s. Estimated remaining: 4m 49s. Rate: 157.5 symbols/min [2025-10-14T22:39:38.321033] [DEBUG] [LOCAL ] KVYO: Loaded 50745 existing records from primary storage. [2025-10-14T22:39:38.352298] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:38.352183] [INFO ] [MAIN ] KVYO: Loaded 50745 primary data records. [2025-10-14T22:39:38.821865] [DEBUG] [LOCAL ] KW: Loaded 40532 existing records from primary storage. [2025-10-14T22:39:38.822526] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:38.822670] [INFO ] [MAIN ] KW: Loaded 40532 primary data records. [2025-10-14T22:39:38.823750] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-14T22:39:38.855523] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-14T22:39:38.965809] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-14T22:39:38.989625] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-14T22:39:39.000358] [INFO ] [MAIN ] Derivative Progress: 1055/1812 symbols completed. KVUE took 1.2s. Estimated remaining: 4m 49s. Rate: 157.4 symbols/min [2025-10-14T22:39:39.030627] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:39.171725] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:39.176786] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 50745 primary records. [2025-10-14T22:39:39.178378] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-14T22:39:39.201842] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-10-14T22:39:39.200684] [DEBUG] [LOCAL ] KWR: Loaded 16121 existing records from primary storage. [2025-10-14T22:39:39.202176] [INFO ] [MAIN ] KWR: Loaded 16121 primary data records. [2025-10-14T22:39:39.202109] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-14T22:39:39.236552] [INFO ] [MAIN ] Derivative Progress: 1056/1812 symbols completed. KVYO took 1.2s. Estimated remaining: 4m 48s. Rate: 157.4 symbols/min [2025-10-14T22:39:39.249090] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:39.560123] [DEBUG] [LOCAL ] KYN: Loaded 30240 existing records from primary storage. [2025-10-14T22:39:39.562896] [INFO ] [MAIN ] KYN: Loaded 30240 primary data records. [2025-10-14T22:39:39.660470] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:39.683409] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40532 primary records. [2025-10-14T22:39:39.683715] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-14T22:39:39.887502] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-14T22:39:39.888325] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-14T22:39:39.891413] [INFO ] [MAIN ] Derivative Progress: 1057/1812 symbols completed. KW took 1.5s. Estimated remaining: 4m 48s. Rate: 157.3 symbols/min [2025-10-14T22:39:39.891927] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:39.913983] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:39.914941] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16121 primary records. [2025-10-14T22:39:39.915134] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-14T22:39:39.948458] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-14T22:39:39.948718] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-14T22:39:39.951140] [INFO ] [MAIN ] Derivative Progress: 1058/1812 symbols completed. KWR took 0.9s. Estimated remaining: 4m 47s. Rate: 157.4 symbols/min [2025-10-14T22:39:39.951784] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:39.970937] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:39.971945] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30240 primary records. [2025-10-14T22:39:39.985628] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-14T22:39:39.987269] [DEBUG] [LOCAL ] LAC: Loaded 52499 existing records from primary storage. [2025-10-14T22:39:39.987429] [INFO ] [MAIN ] LAC: Loaded 52499 primary data records. [2025-10-14T22:39:40.066126] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-14T22:39:40.100819] [DEBUG] [LOCAL ] LAD: Loaded 23409 existing records from primary storage. [2025-10-14T22:39:40.113519] [INFO ] [MAIN ] LAD: Loaded 23409 primary data records. [2025-10-14T22:39:40.087805] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-14T22:39:40.124150] [INFO ] [MAIN ] Derivative Progress: 1059/1812 symbols completed. KYN took 0.9s. Estimated remaining: 4m 47s. Rate: 157.5 symbols/min [2025-10-14T22:39:40.128127] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:40.638911] [DEBUG] [LOCAL ] LADR: Loaded 39388 existing records from primary storage. [2025-10-14T22:39:40.639516] [INFO ] [MAIN ] LADR: Loaded 39388 primary data records. [2025-10-14T22:39:40.952894] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:40.953630] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52499 primary records. [2025-10-14T22:39:40.953825] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-14T22:39:40.973796] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-14T22:39:40.974221] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-14T22:39:40.983859] [INFO ] [MAIN ] Derivative Progress: 1060/1812 symbols completed. LAC took 1.1s. Estimated remaining: 4m 47s. Rate: 157.3 symbols/min [2025-10-14T22:39:40.984137] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:40.990128] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:40.990915] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23409 primary records. [2025-10-14T22:39:40.991673] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-14T22:39:41.006701] [DEBUG] [LOCAL ] LANV: Loaded 2789 existing records from primary storage. [2025-10-14T22:39:41.007742] [INFO ] [MAIN ] LANV: Loaded 2789 primary data records. [2025-10-14T22:39:41.095736] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-10-14T22:39:41.106827] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-14T22:39:41.121088] [INFO ] [MAIN ] Derivative Progress: 1061/1812 symbols completed. LAD took 1.2s. Estimated remaining: 4m 46s. Rate: 157.4 symbols/min [2025-10-14T22:39:41.128519] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:41.211677] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:41.254302] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39388 primary records. [2025-10-14T22:39:41.351346] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-14T22:39:41.370234] [DEBUG] [LOCAL ] LAW: Loaded 14591 existing records from primary storage. [2025-10-14T22:39:41.371827] [INFO ] [MAIN ] LAW: Loaded 14591 primary data records. [2025-10-14T22:39:41.497679] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-14T22:39:41.502942] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-14T22:39:41.515438] [INFO ] [MAIN ] Derivative Progress: 1062/1812 symbols completed. LADR took 1.4s. Estimated remaining: 4m 46s. Rate: 157.4 symbols/min [2025-10-14T22:39:41.515591] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:41.706814] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:41.720588] [INFO ] [MAIN ] LANV: Generated 1794 derivative records from 2789 primary records. [2025-10-14T22:39:41.720822] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-14T22:39:41.735485] [DEBUG] [LOCAL ] LANV: Derivative data saved (1794 records). [2025-10-14T22:39:41.735806] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-14T22:39:41.738004] [INFO ] [MAIN ] Derivative Progress: 1063/1812 symbols completed. LANV took 0.8s. Estimated remaining: 4m 45s. Rate: 157.5 symbols/min [2025-10-14T22:39:41.753144] [DEBUG] [LOCAL ] LAZ: Loaded 44781 existing records from primary storage. [2025-10-14T22:39:41.753544] [INFO ] [MAIN ] LAZ: Loaded 44781 primary data records. [2025-10-14T22:39:41.877147] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:41.893380] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14591 primary records. [2025-10-14T22:39:41.898589] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-14T22:39:41.968154] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-14T22:39:41.968252] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-14T22:39:42.074813] [INFO ] [MAIN ] Derivative Progress: 1064/1812 symbols completed. LAW took 0.9s. Estimated remaining: 4m 45s. Rate: 157.5 symbols/min [2025-10-14T22:39:42.107529] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:42.108271] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44781 primary records. [2025-10-14T22:39:42.108347] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-14T22:39:42.123864] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-14T22:39:42.123919] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-14T22:39:42.126187] [INFO ] [MAIN ] Derivative Progress: 1065/1812 symbols completed. LAZ took 0.6s. Estimated remaining: 4m 44s. Rate: 157.6 symbols/min [2025-10-14T22:39:42.126870] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:42.126736] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:42.126607] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:42.204935] [DEBUG] [LOCAL ] LB: Loaded 37450 existing records from primary storage. [2025-10-14T22:39:42.205252] [INFO ] [MAIN ] LB: Loaded 37450 primary data records. [2025-10-14T22:39:42.252006] [DEBUG] [LOCAL ] LC: Loaded 48108 existing records from primary storage. [2025-10-14T22:39:42.291686] [INFO ] [MAIN ] LC: Loaded 48108 primary data records. [2025-10-14T22:39:42.362514] [DEBUG] [LOCAL ] LBRT: Loaded 52954 existing records from primary storage. [2025-10-14T22:39:42.386985] [INFO ] [MAIN ] LBRT: Loaded 52954 primary data records. [2025-10-14T22:39:43.215766] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:43.222133] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:43.224450] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37450 primary records. [2025-10-14T22:39:43.225610] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-14T22:39:43.225291] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48108 primary records. [2025-10-14T22:39:43.234243] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-14T22:39:43.263529] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:43.266592] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52954 primary records. [2025-10-14T22:39:43.268019] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-14T22:39:43.288489] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-14T22:39:43.288896] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-14T22:39:43.292316] [INFO ] [MAIN ] Derivative Progress: 1066/1812 symbols completed. LBRT took 1.2s. Estimated remaining: 4m 45s. Rate: 157.3 symbols/min [2025-10-14T22:39:43.292952] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-14T22:39:43.294010] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-14T22:39:43.296738] [INFO ] [MAIN ] Derivative Progress: 1067/1812 symbols completed. LC took 1.2s. Estimated remaining: 4m 44s. Rate: 157.5 symbols/min [2025-10-14T22:39:43.296913] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:43.297101] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-14T22:39:43.293098] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:43.297828] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-14T22:39:43.301115] [INFO ] [MAIN ] Derivative Progress: 1068/1812 symbols completed. LB took 1.2s. Estimated remaining: 4m 43s. Rate: 157.6 symbols/min [2025-10-14T22:39:43.301687] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:43.343904] [DEBUG] [LOCAL ] LCII: Loaded 27499 existing records from primary storage. [2025-10-14T22:39:43.354010] [INFO ] [MAIN ] LCII: Loaded 27499 primary data records. [2025-10-14T22:39:43.440048] [DEBUG] [LOCAL ] LDI: Loaded 44773 existing records from primary storage. [2025-10-14T22:39:43.493008] [INFO ] [MAIN ] LDI: Loaded 44773 primary data records. [2025-10-14T22:39:43.488978] [DEBUG] [LOCAL ] LDOS: Loaded 45119 existing records from primary storage. [2025-10-14T22:39:43.505970] [INFO ] [MAIN ] LDOS: Loaded 45119 primary data records. [2025-10-14T22:39:44.328673] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:44.330300] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 27499 primary records. [2025-10-14T22:39:44.343151] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-14T22:39:44.344612] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:44.345677] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44773 primary records. [2025-10-14T22:39:44.345863] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-14T22:39:44.377615] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-14T22:39:44.378179] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-14T22:39:44.380793] [INFO ] [MAIN ] Derivative Progress: 1069/1812 symbols completed. LCII took 1.1s. Estimated remaining: 4m 43s. Rate: 157.3 symbols/min [2025-10-14T22:39:44.380934] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:44.383445] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-14T22:39:44.384224] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-14T22:39:44.386790] [INFO ] [MAIN ] Derivative Progress: 1070/1812 symbols completed. LDI took 1.1s. Estimated remaining: 4m 43s. Rate: 157.5 symbols/min [2025-10-14T22:39:44.387370] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:44.400712] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:44.401444] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45119 primary records. [2025-10-14T22:39:44.401707] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-14T22:39:44.427188] [DEBUG] [LOCAL ] LDP: Loaded 12849 existing records from primary storage. [2025-10-14T22:39:44.428879] [INFO ] [MAIN ] LDP: Loaded 12849 primary data records. [2025-10-14T22:39:44.435189] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-14T22:39:44.435281] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-14T22:39:44.460514] [INFO ] [MAIN ] Derivative Progress: 1071/1812 symbols completed. LDOS took 1.2s. Estimated remaining: 4m 42s. Rate: 157.6 symbols/min [2025-10-14T22:39:44.478040] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:44.647868] [DEBUG] [LOCAL ] LEA: Loaded 41400 existing records from primary storage. [2025-10-14T22:39:44.758583] [INFO ] [MAIN ] LEA: Loaded 41400 primary data records. [2025-10-14T22:39:45.088473] [DEBUG] [LOCAL ] LEG: Loaded 50183 existing records from primary storage. [2025-10-14T22:39:45.102034] [INFO ] [MAIN ] LEG: Loaded 50183 primary data records. [2025-10-14T22:39:45.305985] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:45.452967] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12849 primary records. [2025-10-14T22:39:45.466689] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-14T22:39:45.485510] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-14T22:39:45.487981] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-14T22:39:45.490257] [INFO ] [MAIN ] Derivative Progress: 1072/1812 symbols completed. LDP took 1.1s. Estimated remaining: 4m 42s. Rate: 157.4 symbols/min [2025-10-14T22:39:45.491218] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:45.506595] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:45.507437] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41400 primary records. [2025-10-14T22:39:45.507561] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-14T22:39:45.526058] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-14T22:39:45.526429] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-14T22:39:45.529026] [INFO ] [MAIN ] Derivative Progress: 1073/1812 symbols completed. LEA took 1.1s. Estimated remaining: 4m 42s. Rate: 157.5 symbols/min [2025-10-14T22:39:45.529491] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:45.554403] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:45.559764] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50183 primary records. [2025-10-14T22:39:45.560012] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-14T22:39:45.578678] [DEBUG] [LOCAL ] LEO: Loaded 16716 existing records from primary storage. [2025-10-14T22:39:45.580131] [INFO ] [MAIN ] LEO: Loaded 16716 primary data records. [2025-10-14T22:39:45.702851] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-14T22:39:45.722324] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-14T22:39:45.740596] [INFO ] [MAIN ] Derivative Progress: 1074/1812 symbols completed. LEG took 1.3s. Estimated remaining: 4m 41s. Rate: 157.6 symbols/min [2025-10-14T22:39:45.764482] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:45.801328] [DEBUG] [LOCAL ] LEN: Loaded 53192 existing records from primary storage. [2025-10-14T22:39:45.801626] [INFO ] [MAIN ] LEN: Loaded 53192 primary data records. [2025-10-14T22:39:46.292284] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:46.293995] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16716 primary records. [2025-10-14T22:39:46.294101] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-14T22:39:46.293102] [DEBUG] [LOCAL ] LEVI: Loaded 51765 existing records from primary storage. [2025-10-14T22:39:46.294972] [INFO ] [MAIN ] LEVI: Loaded 51765 primary data records. [2025-10-14T22:39:46.413458] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-14T22:39:46.419417] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-14T22:39:46.426825] [INFO ] [MAIN ] Derivative Progress: 1075/1812 symbols completed. LEO took 0.9s. Estimated remaining: 4m 41s. Rate: 157.4 symbols/min [2025-10-14T22:39:46.437522] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:46.626111] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:46.634195] [DEBUG] [LOCAL ] LFT: Loaded 18370 existing records from primary storage. [2025-10-14T22:39:46.633717] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53192 primary records. [2025-10-14T22:39:46.634403] [INFO ] [MAIN ] LFT: Loaded 18370 primary data records. [2025-10-14T22:39:46.634486] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-14T22:39:46.769811] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-14T22:39:46.775951] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-14T22:39:46.778082] [INFO ] [MAIN ] Derivative Progress: 1076/1812 symbols completed. LEN took 1.3s. Estimated remaining: 4m 40s. Rate: 157.4 symbols/min [2025-10-14T22:39:46.819731] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:46.965467] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:46.966305] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51765 primary records. [2025-10-14T22:39:46.966561] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-14T22:39:46.991727] [DEBUG] [LOCAL ] LGI: Loaded 10092 existing records from primary storage. [2025-10-14T22:39:46.992225] [INFO ] [MAIN ] LGI: Loaded 10092 primary data records. [2025-10-14T22:39:47.013807] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-14T22:39:47.030837] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-14T22:39:47.045577] [INFO ] [MAIN ] Derivative Progress: 1077/1812 symbols completed. LEVI took 1.3s. Estimated remaining: 4m 40s. Rate: 157.5 symbols/min [2025-10-14T22:39:47.063042] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:47.395881] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:47.408165] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18370 primary records. [2025-10-14T22:39:47.409252] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-14T22:39:47.411618] [DEBUG] [LOCAL ] LH: Loaded 37606 existing records from primary storage. [2025-10-14T22:39:47.412049] [INFO ] [MAIN ] LH: Loaded 37606 primary data records. [2025-10-14T22:39:47.542176] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-14T22:39:47.552580] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-14T22:39:47.560482] [INFO ] [MAIN ] Derivative Progress: 1078/1812 symbols completed. LFT took 1.1s. Estimated remaining: 4m 40s. Rate: 157.4 symbols/min [2025-10-14T22:39:47.737241] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:47.738078] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10092 primary records. [2025-10-14T22:39:47.738195] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-14T22:39:47.757503] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-14T22:39:47.757663] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-14T22:39:47.759965] [INFO ] [MAIN ] Derivative Progress: 1079/1812 symbols completed. LGI took 0.9s. Estimated remaining: 4m 39s. Rate: 157.5 symbols/min [2025-10-14T22:39:47.779367] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:47.780045] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37606 primary records. [2025-10-14T22:39:47.780108] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-14T22:39:47.795715] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-14T22:39:47.795841] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-14T22:39:47.797865] [INFO ] [MAIN ] Derivative Progress: 1080/1812 symbols completed. LH took 0.7s. Estimated remaining: 4m 39s. Rate: 157.6 symbols/min [2025-10-14T22:39:47.798298] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:47.798392] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:47.799075] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:47.836615] [DEBUG] [LOCAL ] LII: Loaded 27855 existing records from primary storage. [2025-10-14T22:39:47.836779] [INFO ] [MAIN ] LII: Loaded 27855 primary data records. [2025-10-14T22:39:47.969310] [DEBUG] [LOCAL ] LION: Loaded 46175 existing records from primary storage. [2025-10-14T22:39:47.986116] [INFO ] [MAIN ] LION: Loaded 46175 primary data records. [2025-10-14T22:39:48.245482] [DEBUG] [LOCAL ] LHX: Loaded 48594 existing records from primary storage. [2025-10-14T22:39:48.258206] [INFO ] [MAIN ] LHX: Loaded 48594 primary data records. [2025-10-14T22:39:48.821325] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:48.822384] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27855 primary records. [2025-10-14T22:39:48.822838] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-14T22:39:48.856558] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:48.858768] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 46175 primary records. [2025-10-14T22:39:48.859763] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-14T22:39:48.859857] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-14T22:39:48.860185] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-14T22:39:48.888157] [INFO ] [MAIN ] Derivative Progress: 1081/1812 symbols completed. LII took 1.1s. Estimated remaining: 4m 39s. Rate: 157.4 symbols/min [2025-10-14T22:39:48.891370] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:48.892945] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:48.895350] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48594 primary records. [2025-10-14T22:39:48.896083] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-14T22:39:48.897864] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-14T22:39:48.899565] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-14T22:39:48.901913] [INFO ] [MAIN ] Derivative Progress: 1082/1812 symbols completed. LION took 1.1s. Estimated remaining: 4m 38s. Rate: 157.5 symbols/min [2025-10-14T22:39:48.902291] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:48.914548] [DEBUG] [LOCAL ] LITB: Loaded 4160 existing records from primary storage. [2025-10-14T22:39:48.917310] [INFO ] [MAIN ] LITB: Loaded 4160 primary data records. [2025-10-14T22:39:49.025309] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-14T22:39:49.025786] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-14T22:39:49.033448] [INFO ] [MAIN ] Derivative Progress: 1083/1812 symbols completed. LHX took 1.2s. Estimated remaining: 4m 38s. Rate: 157.6 symbols/min [2025-10-14T22:39:49.038915] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:49.280744] [DEBUG] [LOCAL ] LLY: Loaded 53265 existing records from primary storage. [2025-10-14T22:39:49.281501] [INFO ] [MAIN ] LLY: Loaded 53265 primary data records. [2025-10-14T22:39:49.516681] [DEBUG] [LOCAL ] LMND: Loaded 52049 existing records from primary storage. [2025-10-14T22:39:49.593757] [INFO ] [MAIN ] LMND: Loaded 52049 primary data records. [2025-10-14T22:39:49.703070] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:49.721282] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4160 primary records. [2025-10-14T22:39:49.721905] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-14T22:39:49.940916] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-14T22:39:49.941949] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-14T22:39:49.944111] [INFO ] [MAIN ] Derivative Progress: 1084/1812 symbols completed. LITB took 1.1s. Estimated remaining: 4m 38s. Rate: 157.4 symbols/min [2025-10-14T22:39:49.944400] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:49.964439] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:49.965779] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53265 primary records. [2025-10-14T22:39:49.965947] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-14T22:39:49.984299] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-14T22:39:49.985431] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-14T22:39:49.987639] [INFO ] [MAIN ] Derivative Progress: 1085/1812 symbols completed. LLY took 1.1s. Estimated remaining: 4m 37s. Rate: 157.5 symbols/min [2025-10-14T22:39:49.988570] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:50.016301] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:50.017007] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 52049 primary records. [2025-10-14T22:39:50.017160] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-14T22:39:50.036106] [DEBUG] [LOCAL ] LND: Loaded 4953 existing records from primary storage. [2025-10-14T22:39:50.037613] [INFO ] [MAIN ] LND: Loaded 4953 primary data records. [2025-10-14T22:39:50.092521] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-14T22:39:50.137294] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-14T22:39:50.137164] [DEBUG] [LOCAL ] LNC: Loaded 51593 existing records from primary storage. [2025-10-14T22:39:50.152424] [INFO ] [MAIN ] Derivative Progress: 1086/1812 symbols completed. LMND took 1.1s. Estimated remaining: 4m 36s. Rate: 157.6 symbols/min [2025-10-14T22:39:50.157786] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:50.150233] [INFO ] [MAIN ] LNC: Loaded 51593 primary data records. [2025-10-14T22:39:50.710177] [DEBUG] [LOCAL ] LNG: Loaded 51269 existing records from primary storage. [2025-10-14T22:39:50.711176] [INFO ] [MAIN ] LNG: Loaded 51269 primary data records. [2025-10-14T22:39:50.879965] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:39:50.890753] [INFO ] [MAIN ] LND: Generated 1793 derivative records from 4953 primary records. [2025-10-14T22:39:50.909803] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-14T22:39:51.053848] [DEBUG] [LOCAL ] LND: Derivative data saved (1793 records). [2025-10-14T22:39:51.054699] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-14T22:39:51.057695] [INFO ] [MAIN ] Derivative Progress: 1087/1812 symbols completed. LND took 1.1s. Estimated remaining: 4m 36s. Rate: 157.4 symbols/min [2025-10-14T22:39:51.055165] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:51.057983] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:51.059112] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51593 primary records. [2025-10-14T22:39:51.059378] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-14T22:39:51.083876] [DEBUG] [LOCAL ] LNN: Loaded 11373 existing records from primary storage. [2025-10-14T22:39:51.085106] [INFO ] [MAIN ] LNN: Loaded 11373 primary data records. [2025-10-14T22:39:51.124180] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-14T22:39:51.124425] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-14T22:39:51.126949] [INFO ] [MAIN ] Derivative Progress: 1088/1812 symbols completed. LNC took 1.2s. Estimated remaining: 4m 36s. Rate: 157.5 symbols/min [2025-10-14T22:39:51.139101] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:51.214452] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:51.235970] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51269 primary records. [2025-10-14T22:39:51.253876] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-14T22:39:51.465406] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-14T22:39:51.465569] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-14T22:39:51.467670] [INFO ] [MAIN ] Derivative Progress: 1089/1812 symbols completed. LNG took 1.3s. Estimated remaining: 4m 35s. Rate: 157.5 symbols/min [2025-10-14T22:39:51.467973] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:51.483136] [DEBUG] [LOCAL ] LOAR: Loaded 42212 existing records from primary storage. [2025-10-14T22:39:51.483394] [INFO ] [MAIN ] LOAR: Loaded 42212 primary data records. [2025-10-14T22:39:51.684323] [DEBUG] [LOCAL ] LOB: Loaded 26746 existing records from primary storage. [2025-10-14T22:39:51.789466] [INFO ] [MAIN ] LOB: Loaded 26746 primary data records. [2025-10-14T22:39:51.855181] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:51.890621] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11373 primary records. [2025-10-14T22:39:51.908668] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-14T22:39:52.141216] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-14T22:39:52.142326] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-14T22:39:52.144558] [INFO ] [MAIN ] Derivative Progress: 1090/1812 symbols completed. LNN took 1.1s. Estimated remaining: 4m 35s. Rate: 157.4 symbols/min [2025-10-14T22:39:52.145110] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:52.152922] [DEBUG] [LOCAL ] LOCL: Loaded 3701 existing records from primary storage. [2025-10-14T22:39:52.153566] [INFO ] [MAIN ] LOCL: Loaded 3701 primary data records. [2025-10-14T22:39:52.302249] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:52.352196] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42212 primary records. [2025-10-14T22:39:52.352357] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-14T22:39:52.497176] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:52.499087] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 26746 primary records. [2025-10-14T22:39:52.499179] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-14T22:39:52.502188] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-14T22:39:52.509451] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-14T22:39:52.517728] [INFO ] [MAIN ] Derivative Progress: 1091/1812 symbols completed. LOAR took 1.4s. Estimated remaining: 4m 35s. Rate: 157.4 symbols/min [2025-10-14T22:39:52.518949] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:52.523011] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-14T22:39:52.523227] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-14T22:39:52.525690] [INFO ] [MAIN ] Derivative Progress: 1092/1812 symbols completed. LOB took 1.1s. Estimated remaining: 4m 34s. Rate: 157.6 symbols/min [2025-10-14T22:39:52.525899] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:52.544106] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:39:52.544890] [INFO ] [MAIN ] LOCL: Generated 1793 derivative records from 3701 primary records. [2025-10-14T22:39:52.544988] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-14T22:39:52.567240] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1793 records). [2025-10-14T22:39:52.567536] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-14T22:39:52.569735] [INFO ] [MAIN ] Derivative Progress: 1093/1812 symbols completed. LOCL took 0.4s. Estimated remaining: 4m 34s. Rate: 157.7 symbols/min [2025-10-14T22:39:52.582502] [DEBUG] [LOCAL ] LOMA: Loaded 32605 existing records from primary storage. [2025-10-14T22:39:52.582637] [INFO ] [MAIN ] LOMA: Loaded 32605 primary data records. [2025-10-14T22:39:52.790950] [DEBUG] [LOCAL ] LOW: Loaded 52994 existing records from primary storage. [2025-10-14T22:39:52.902998] [INFO ] [MAIN ] LOW: Loaded 52994 primary data records. [2025-10-14T22:39:53.262076] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:53.263143] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32605 primary records. [2025-10-14T22:39:53.263529] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-14T22:39:53.281605] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-14T22:39:53.281906] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-14T22:39:53.283859] [INFO ] [MAIN ] Derivative Progress: 1094/1812 symbols completed. LOMA took 0.8s. Estimated remaining: 4m 33s. Rate: 157.6 symbols/min [2025-10-14T22:39:53.298538] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:53.299127] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52994 primary records. [2025-10-14T22:39:53.299187] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-14T22:39:53.314457] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-14T22:39:53.314513] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-14T22:39:53.316583] [INFO ] [MAIN ] Derivative Progress: 1095/1812 symbols completed. LOW took 0.8s. Estimated remaining: 4m 33s. Rate: 157.7 symbols/min [2025-10-14T22:39:53.317008] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:53.317101] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:53.317165] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:53.366791] [DEBUG] [LOCAL ] LPL: Loaded 28131 existing records from primary storage. [2025-10-14T22:39:53.388634] [INFO ] [MAIN ] LPL: Loaded 28131 primary data records. [2025-10-14T22:39:53.389463] [DEBUG] [LOCAL ] LPG: Loaded 39624 existing records from primary storage. [2025-10-14T22:39:53.401409] [DEBUG] [LOCAL ] LPX: Loaded 40227 existing records from primary storage. [2025-10-14T22:39:53.389785] [INFO ] [MAIN ] LPG: Loaded 39624 primary data records. [2025-10-14T22:39:53.411401] [INFO ] [MAIN ] LPX: Loaded 40227 primary data records. [2025-10-14T22:39:54.364793] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:54.367297] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 28131 primary records. [2025-10-14T22:39:54.368365] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-14T22:39:54.382310] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:54.383143] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 40227 primary records. [2025-10-14T22:39:54.383235] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-14T22:39:54.408076] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:54.417434] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39624 primary records. [2025-10-14T22:39:54.420691] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-14T22:39:54.447808] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-14T22:39:54.446753] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-14T22:39:54.448739] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-14T22:39:54.448670] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-14T22:39:54.452095] [INFO ] [MAIN ] Derivative Progress: 1096/1812 symbols completed. LPX took 1.1s. Estimated remaining: 4m 33s. Rate: 157.4 symbols/min [2025-10-14T22:39:54.454437] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:54.454632] [INFO ] [MAIN ] Derivative Progress: 1097/1812 symbols completed. LPL took 1.1s. Estimated remaining: 4m 32s. Rate: 157.6 symbols/min [2025-10-14T22:39:54.456061] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:54.457354] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-14T22:39:54.457469] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-14T22:39:54.459532] [INFO ] [MAIN ] Derivative Progress: 1098/1812 symbols completed. LPG took 1.1s. Estimated remaining: 4m 32s. Rate: 157.7 symbols/min [2025-10-14T22:39:54.460037] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:54.504099] [DEBUG] [LOCAL ] LTC: Loaded 30571 existing records from primary storage. [2025-10-14T22:39:54.514813] [INFO ] [MAIN ] LTC: Loaded 30571 primary data records. [2025-10-14T22:39:54.553464] [DEBUG] [LOCAL ] LRN: Loaded 39539 existing records from primary storage. [2025-10-14T22:39:54.572314] [INFO ] [MAIN ] LRN: Loaded 39539 primary data records. [2025-10-14T22:39:54.708738] [DEBUG] [LOCAL ] LSPD: Loaded 42628 existing records from primary storage. [2025-10-14T22:39:54.739717] [INFO ] [MAIN ] LSPD: Loaded 42628 primary data records. [2025-10-14T22:39:55.497487] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:55.499207] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30571 primary records. [2025-10-14T22:39:55.499397] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-14T22:39:55.523979] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:55.527838] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-14T22:39:55.528495] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39539 primary records. [2025-10-14T22:39:55.528774] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-14T22:39:55.528683] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-14T22:39:55.530475] [INFO ] [MAIN ] Derivative Progress: 1099/1812 symbols completed. LTC took 1.1s. Estimated remaining: 4m 32s. Rate: 157.5 symbols/min [2025-10-14T22:39:55.530683] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:55.562588] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:55.562975] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-14T22:39:55.563094] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-14T22:39:55.565149] [INFO ] [MAIN ] Derivative Progress: 1100/1812 symbols completed. LRN took 1.1s. Estimated remaining: 4m 31s. Rate: 157.6 symbols/min [2025-10-14T22:39:55.565353] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:55.566119] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42628 primary records. [2025-10-14T22:39:55.566690] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-14T22:39:55.584329] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-14T22:39:55.584505] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-14T22:39:55.586586] [INFO ] [MAIN ] Derivative Progress: 1101/1812 symbols completed. LSPD took 1.1s. Estimated remaining: 4m 30s. Rate: 157.7 symbols/min [2025-10-14T22:39:55.587514] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:55.639174] [DEBUG] [LOCAL ] LTH: Loaded 51750 existing records from primary storage. [2025-10-14T22:39:55.640230] [INFO ] [MAIN ] LTH: Loaded 51750 primary data records. [2025-10-14T22:39:55.641220] [DEBUG] [LOCAL ] LTM: Loaded 38583 existing records from primary storage. [2025-10-14T22:39:55.677318] [INFO ] [MAIN ] LTM: Loaded 38583 primary data records. [2025-10-14T22:39:55.901482] [DEBUG] [LOCAL ] LU: Loaded 49028 existing records from primary storage. [2025-10-14T22:39:55.911919] [INFO ] [MAIN ] LU: Loaded 49028 primary data records. [2025-10-14T22:39:56.570845] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:56.583686] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 38583 primary records. [2025-10-14T22:39:56.584219] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-14T22:39:56.584151] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:56.585680] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51750 primary records. [2025-10-14T22:39:56.592683] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-14T22:39:56.620713] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-14T22:39:56.620832] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-14T22:39:56.620900] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-14T22:39:56.623747] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-14T22:39:56.623677] [INFO ] [MAIN ] Derivative Progress: 1102/1812 symbols completed. LTH took 1.1s. Estimated remaining: 4m 31s. Rate: 157.5 symbols/min [2025-10-14T22:39:56.626511] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:56.626730] [INFO ] [MAIN ] Derivative Progress: 1103/1812 symbols completed. LTM took 1.1s. Estimated remaining: 4m 30s. Rate: 157.6 symbols/min [2025-10-14T22:39:56.639345] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:56.640151] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:56.641358] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 49028 primary records. [2025-10-14T22:39:56.641598] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-14T22:39:56.663963] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-14T22:39:56.664205] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-14T22:39:56.666409] [INFO ] [MAIN ] Derivative Progress: 1104/1812 symbols completed. LU took 1.1s. Estimated remaining: 4m 29s. Rate: 157.7 symbols/min [2025-10-14T22:39:56.666706] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:56.676078] [DEBUG] [LOCAL ] LUCK: Loaded 24199 existing records from primary storage. [2025-10-14T22:39:56.676194] [INFO ] [MAIN ] LUCK: Loaded 24199 primary data records. [2025-10-14T22:39:56.873335] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-14T22:39:57.017783] [INFO ] [MAIN ] LUMN: Loaded 53646 primary data records. [2025-10-14T22:39:57.163850] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-14T22:39:57.164603] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-14T22:39:57.745745] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:57.748390] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24199 primary records. [2025-10-14T22:39:57.749198] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-14T22:39:57.767549] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-14T22:39:57.768043] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-14T22:39:57.770453] [INFO ] [MAIN ] Derivative Progress: 1105/1812 symbols completed. LUCK took 1.1s. Estimated remaining: 4m 29s. Rate: 157.5 symbols/min [2025-10-14T22:39:57.770904] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:57.797055] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:57.797900] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53646 primary records. [2025-10-14T22:39:57.798003] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-14T22:39:57.835150] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:57.837481] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-14T22:39:57.836449] [DEBUG] [LOCAL ] LVWR: Loaded 18450 existing records from primary storage. [2025-10-14T22:39:57.838113] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-14T22:39:57.838547] [INFO ] [MAIN ] LVWR: Loaded 18450 primary data records. [2025-10-14T22:39:57.838377] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-14T22:39:57.841081] [INFO ] [MAIN ] Derivative Progress: 1106/1812 symbols completed. LUMN took 1.2s. Estimated remaining: 4m 29s. Rate: 157.6 symbols/min [2025-10-14T22:39:57.838439] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-14T22:39:57.846392] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:57.930048] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-14T22:39:57.930228] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-14T22:39:57.961983] [INFO ] [MAIN ] Derivative Progress: 1107/1812 symbols completed. LUV took 1.3s. Estimated remaining: 4m 28s. Rate: 157.7 symbols/min [2025-10-14T22:39:57.962132] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:58.122022] [DEBUG] [LOCAL ] LXFR: Loaded 16744 existing records from primary storage. [2025-10-14T22:39:58.129220] [INFO ] [MAIN ] LXFR: Loaded 16744 primary data records. [2025-10-14T22:39:58.312116] [DEBUG] [LOCAL ] LW: Loaded 51232 existing records from primary storage. [2025-10-14T22:39:58.333184] [INFO ] [MAIN ] LW: Loaded 51232 primary data records. [2025-10-14T22:39:58.879773] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:58.880859] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18450 primary records. [2025-10-14T22:39:58.882535] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-14T22:39:58.903828] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-14T22:39:58.904178] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-14T22:39:58.907236] [INFO ] [MAIN ] Derivative Progress: 1108/1812 symbols completed. LVWR took 1.1s. Estimated remaining: 4m 28s. Rate: 157.5 symbols/min [2025-10-14T22:39:58.923800] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:58.926001] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16744 primary records. [2025-10-14T22:39:58.926185] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-14T22:39:58.946204] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:39:58.948379] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51232 primary records. [2025-10-14T22:39:58.951129] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-14T22:39:58.969907] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-14T22:39:58.970473] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-14T22:39:58.970609] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-14T22:39:58.970551] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-14T22:39:58.972770] [INFO ] [MAIN ] Derivative Progress: 1109/1812 symbols completed. LW took 1.1s. Estimated remaining: 4m 28s. Rate: 157.6 symbols/min [2025-10-14T22:39:58.975048] [INFO ] [MAIN ] Derivative Progress: 1110/1812 symbols completed. LXFR took 1.0s. Estimated remaining: 4m 27s. Rate: 157.7 symbols/min [2025-10-14T22:39:58.975443] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:58.975685] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:58.975567] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:39:59.006845] [DEBUG] [LOCAL ] LXU: Loaded 31836 existing records from primary storage. [2025-10-14T22:39:59.022756] [INFO ] [MAIN ] LXU: Loaded 31836 primary data records. [2025-10-14T22:39:59.191163] [DEBUG] [LOCAL ] LYB: Loaded 53613 existing records from primary storage. [2025-10-14T22:39:59.185283] [DEBUG] [LOCAL ] LXP: Loaded 50740 existing records from primary storage. [2025-10-14T22:39:59.201670] [INFO ] [MAIN ] LYB: Loaded 53613 primary data records. [2025-10-14T22:39:59.269374] [INFO ] [MAIN ] LXP: Loaded 50740 primary data records. [2025-10-14T22:40:00.072460] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:00.074851] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31836 primary records. [2025-10-14T22:40:00.077550] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-14T22:40:00.109876] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-14T22:40:00.110423] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-14T22:40:00.111015] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:00.113911] [INFO ] [MAIN ] Derivative Progress: 1111/1812 symbols completed. LXU took 1.1s. Estimated remaining: 4m 27s. Rate: 157.4 symbols/min [2025-10-14T22:40:00.115392] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53613 primary records. [2025-10-14T22:40:00.115599] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:00.115877] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-14T22:40:00.136335] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-14T22:40:00.137299] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-14T22:40:00.139551] [INFO ] [MAIN ] Derivative Progress: 1112/1812 symbols completed. LYB took 1.2s. Estimated remaining: 4m 27s. Rate: 157.6 symbols/min [2025-10-14T22:40:00.139948] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:00.154463] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:00.155163] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50740 primary records. [2025-10-14T22:40:00.155265] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-14T22:40:00.172079] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-14T22:40:00.172319] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-14T22:40:00.174403] [INFO ] [MAIN ] Derivative Progress: 1113/1812 symbols completed. LXP took 1.2s. Estimated remaining: 4m 26s. Rate: 157.7 symbols/min [2025-10-14T22:40:00.174594] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:00.229337] [DEBUG] [LOCAL ] LYG: Loaded 52726 existing records from primary storage. [2025-10-14T22:40:00.229765] [INFO ] [MAIN ] LYG: Loaded 52726 primary data records. [2025-10-14T22:40:00.366687] [DEBUG] [LOCAL ] LYV: Loaded 51134 existing records from primary storage. [2025-10-14T22:40:00.372882] [INFO ] [MAIN ] LYV: Loaded 51134 primary data records. [2025-10-14T22:40:00.386340] [DEBUG] [LOCAL ] LZB: Loaded 35166 existing records from primary storage. [2025-10-14T22:40:00.425324] [INFO ] [MAIN ] LZB: Loaded 35166 primary data records. [2025-10-14T22:40:01.289173] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:01.291319] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52726 primary records. [2025-10-14T22:40:01.291590] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-14T22:40:01.309967] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-14T22:40:01.310066] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-14T22:40:01.313254] [INFO ] [MAIN ] Derivative Progress: 1114/1812 symbols completed. LYG took 1.2s. Estimated remaining: 4m 26s. Rate: 157.4 symbols/min [2025-10-14T22:40:01.315489] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:01.332476] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:01.339844] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35166 primary records. [2025-10-14T22:40:01.340055] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-14T22:40:01.360618] [DEBUG] [LOCAL ] LZM: Loaded 14548 existing records from primary storage. [2025-10-14T22:40:01.368482] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:01.374388] [INFO ] [MAIN ] LZM: Loaded 14548 primary data records. [2025-10-14T22:40:01.374290] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51134 primary records. [2025-10-14T22:40:01.374739] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-14T22:40:01.417831] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-14T22:40:01.468014] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-14T22:40:01.504088] [INFO ] [MAIN ] Derivative Progress: 1115/1812 symbols completed. LZB took 1.3s. Estimated remaining: 4m 26s. Rate: 157.5 symbols/min [2025-10-14T22:40:01.505063] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-14T22:40:01.510451] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:01.526630] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-14T22:40:01.547336] [INFO ] [MAIN ] Derivative Progress: 1116/1812 symbols completed. LYV took 1.4s. Estimated remaining: 4m 25s. Rate: 157.6 symbols/min [2025-10-14T22:40:01.579898] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:01.739494] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:01.740294] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14548 primary records. [2025-10-14T22:40:01.753454] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-14T22:40:01.789263] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-14T22:40:01.789454] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-14T22:40:01.791434] [INFO ] [MAIN ] Derivative Progress: 1117/1812 symbols completed. LZM took 0.5s. Estimated remaining: 4m 24s. Rate: 157.7 symbols/min [2025-10-14T22:40:01.791690] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:01.793845] [DEBUG] [LOCAL ] M: Loaded 53546 existing records from primary storage. [2025-10-14T22:40:01.795671] [INFO ] [MAIN ] M: Loaded 53546 primary data records. [2025-10-14T22:40:01.869309] [DEBUG] [LOCAL ] MA: Loaded 52487 existing records from primary storage. [2025-10-14T22:40:01.895541] [INFO ] [MAIN ] MA: Loaded 52487 primary data records. [2025-10-14T22:40:02.319785] [DEBUG] [LOCAL ] MAA: Loaded 42817 existing records from primary storage. [2025-10-14T22:40:02.437626] [INFO ] [MAIN ] MAA: Loaded 42817 primary data records. [2025-10-14T22:40:02.774702] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:02.775606] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53546 primary records. [2025-10-14T22:40:02.776296] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-14T22:40:02.806232] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:02.808791] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52487 primary records. [2025-10-14T22:40:02.810623] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-14T22:40:02.815344] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-14T22:40:02.815857] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-14T22:40:02.818512] [INFO ] [MAIN ] Derivative Progress: 1118/1812 symbols completed. M took 1.3s. Estimated remaining: 4m 24s. Rate: 157.4 symbols/min [2025-10-14T22:40:02.826162] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:02.838533] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-14T22:40:02.839307] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-14T22:40:02.841127] [INFO ] [MAIN ] Derivative Progress: 1119/1812 symbols completed. MA took 1.3s. Estimated remaining: 4m 24s. Rate: 157.6 symbols/min [2025-10-14T22:40:02.841516] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:02.855771] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:02.856499] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42817 primary records. [2025-10-14T22:40:02.856720] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-14T22:40:02.873761] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-14T22:40:02.873936] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-14T22:40:02.876126] [INFO ] [MAIN ] Derivative Progress: 1120/1812 symbols completed. MAA took 1.1s. Estimated remaining: 4m 23s. Rate: 157.7 symbols/min [2025-10-14T22:40:02.876372] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:02.942309] [DEBUG] [LOCAL ] MAC: Loaded 49712 existing records from primary storage. [2025-10-14T22:40:02.942988] [DEBUG] [LOCAL ] MAGN: Loaded 35969 existing records from primary storage. [2025-10-14T22:40:02.943076] [INFO ] [MAIN ] MAC: Loaded 49712 primary data records. [2025-10-14T22:40:02.943371] [INFO ] [MAIN ] MAGN: Loaded 35969 primary data records. [2025-10-14T22:40:03.176533] [DEBUG] [LOCAL ] MAIN: Loaded 41746 existing records from primary storage. [2025-10-14T22:40:03.202266] [INFO ] [MAIN ] MAIN: Loaded 41746 primary data records. [2025-10-14T22:40:03.946147] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:03.947122] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49712 primary records. [2025-10-14T22:40:03.947470] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-14T22:40:03.975433] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:03.982278] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35969 primary records. [2025-10-14T22:40:03.982389] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-14T22:40:03.981419] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-14T22:40:03.984118] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-14T22:40:03.986182] [INFO ] [MAIN ] Derivative Progress: 1121/1812 symbols completed. MAC took 1.2s. Estimated remaining: 4m 23s. Rate: 157.4 symbols/min [2025-10-14T22:40:03.993745] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:04.015775] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:04.016700] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-14T22:40:04.017798] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-14T22:40:04.017622] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41746 primary records. [2025-10-14T22:40:04.019775] [INFO ] [MAIN ] Derivative Progress: 1122/1812 symbols completed. MAGN took 1.2s. Estimated remaining: 4m 23s. Rate: 157.6 symbols/min [2025-10-14T22:40:04.020019] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:04.020121] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-14T22:40:04.039973] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-14T22:40:04.040225] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-14T22:40:04.043034] [INFO ] [MAIN ] Derivative Progress: 1123/1812 symbols completed. MAIN took 1.2s. Estimated remaining: 4m 22s. Rate: 157.7 symbols/min [2025-10-14T22:40:04.072581] [DEBUG] [LOCAL ] MANU: Loaded 27021 existing records from primary storage. [2025-10-14T22:40:04.072737] [INFO ] [MAIN ] MANU: Loaded 27021 primary data records. [2025-10-14T22:40:04.192502] [DEBUG] [LOCAL ] MAN: Loaded 43935 existing records from primary storage. [2025-10-14T22:40:04.198331] [INFO ] [MAIN ] MAN: Loaded 43935 primary data records. [2025-10-14T22:40:04.759344] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:04.760184] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27021 primary records. [2025-10-14T22:40:04.760463] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-14T22:40:04.779729] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-14T22:40:04.780072] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-14T22:40:04.782331] [INFO ] [MAIN ] Derivative Progress: 1124/1812 symbols completed. MANU took 0.8s. Estimated remaining: 4m 22s. Rate: 157.6 symbols/min [2025-10-14T22:40:04.795058] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:04.795612] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43935 primary records. [2025-10-14T22:40:04.795696] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-14T22:40:04.810795] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-14T22:40:04.810860] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-14T22:40:04.813016] [INFO ] [MAIN ] Derivative Progress: 1125/1812 symbols completed. MAN took 0.8s. Estimated remaining: 4m 21s. Rate: 157.7 symbols/min [2025-10-14T22:40:04.813412] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:04.813512] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:04.813592] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:04.847134] [DEBUG] [LOCAL ] MAX: Loaded 30978 existing records from primary storage. [2025-10-14T22:40:04.847355] [INFO ] [MAIN ] MAX: Loaded 30978 primary data records. [2025-10-14T22:40:05.004303] [DEBUG] [LOCAL ] MATV: Loaded 35662 existing records from primary storage. [2025-10-14T22:40:05.028857] [INFO ] [MAIN ] MATV: Loaded 35662 primary data records. [2025-10-14T22:40:05.168365] [DEBUG] [LOCAL ] MAS: Loaded 52266 existing records from primary storage. [2025-10-14T22:40:05.293446] [INFO ] [MAIN ] MAS: Loaded 52266 primary data records. [2025-10-14T22:40:05.868483] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:05.871334] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30978 primary records. [2025-10-14T22:40:05.872142] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-14T22:40:05.899351] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:05.902890] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 35662 primary records. [2025-10-14T22:40:05.903394] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-14T22:40:05.907069] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-14T22:40:05.914183] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-14T22:40:05.916805] [INFO ] [MAIN ] Derivative Progress: 1126/1812 symbols completed. MAX took 1.1s. Estimated remaining: 4m 21s. Rate: 157.4 symbols/min [2025-10-14T22:40:05.921833] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:05.927010] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-14T22:40:05.927395] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-14T22:40:05.929687] [INFO ] [MAIN ] Derivative Progress: 1127/1812 symbols completed. MATV took 1.1s. Estimated remaining: 4m 21s. Rate: 157.6 symbols/min [2025-10-14T22:40:05.930057] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:05.943870] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:05.944879] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52266 primary records. [2025-10-14T22:40:05.945116] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-14T22:40:05.964195] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-14T22:40:05.964443] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-14T22:40:05.966788] [INFO ] [MAIN ] Derivative Progress: 1128/1812 symbols completed. MAS took 1.2s. Estimated remaining: 4m 20s. Rate: 157.7 symbols/min [2025-10-14T22:40:05.973255] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:05.992631] [DEBUG] [LOCAL ] MBI: Loaded 24329 existing records from primary storage. [2025-10-14T22:40:05.992927] [INFO ] [MAIN ] MBI: Loaded 24329 primary data records. [2025-10-14T22:40:06.098204] [DEBUG] [LOCAL ] MBC: Loaded 43833 existing records from primary storage. [2025-10-14T22:40:06.127857] [INFO ] [MAIN ] MBC: Loaded 43833 primary data records. [2025-10-14T22:40:06.448666] [DEBUG] [LOCAL ] MC: Loaded 43984 existing records from primary storage. [2025-10-14T22:40:06.466589] [INFO ] [MAIN ] MC: Loaded 43984 primary data records. [2025-10-14T22:40:06.976703] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:06.978549] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43833 primary records. [2025-10-14T22:40:06.978664] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-14T22:40:06.978959] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:06.980695] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24329 primary records. [2025-10-14T22:40:06.980930] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-14T22:40:07.011516] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-14T22:40:07.014373] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-14T22:40:07.014065] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-14T22:40:07.014838] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-14T22:40:07.017052] [INFO ] [MAIN ] Derivative Progress: 1129/1812 symbols completed. MBI took 1.1s. Estimated remaining: 4m 20s. Rate: 157.4 symbols/min [2025-10-14T22:40:07.019322] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:07.019406] [INFO ] [MAIN ] Derivative Progress: 1130/1812 symbols completed. MBC took 1.1s. Estimated remaining: 4m 20s. Rate: 157.6 symbols/min [2025-10-14T22:40:07.020276] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:07.048010] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:07.047541] [DEBUG] [LOCAL ] MCI: Loaded 6454 existing records from primary storage. [2025-10-14T22:40:07.048316] [INFO ] [MAIN ] MCI: Loaded 6454 primary data records. [2025-10-14T22:40:07.060572] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 43984 primary records. [2025-10-14T22:40:07.090887] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-14T22:40:07.085623] [DEBUG] [LOCAL ] MCB: Loaded 11326 existing records from primary storage. [2025-10-14T22:40:07.119615] [INFO ] [MAIN ] MCB: Loaded 11326 primary data records. [2025-10-14T22:40:07.378709] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-14T22:40:07.542948] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-14T22:40:07.577580] [INFO ] [MAIN ] Derivative Progress: 1131/1812 symbols completed. MC took 1.6s. Estimated remaining: 4m 19s. Rate: 157.5 symbols/min [2025-10-14T22:40:07.702301] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:07.752056] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:07.753070] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6454 primary records. [2025-10-14T22:40:07.753477] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-14T22:40:07.778927] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-14T22:40:07.780133] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-14T22:40:07.782152] [INFO ] [MAIN ] Derivative Progress: 1132/1812 symbols completed. MCI took 0.8s. Estimated remaining: 4m 19s. Rate: 157.6 symbols/min [2025-10-14T22:40:07.783122] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:07.808971] [DEBUG] [LOCAL ] MCK: Loaded 38649 existing records from primary storage. [2025-10-14T22:40:07.811457] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:07.812557] [INFO ] [MAIN ] MCK: Loaded 38649 primary data records. [2025-10-14T22:40:07.812422] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11326 primary records. [2025-10-14T22:40:07.824075] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-14T22:40:07.874402] [DEBUG] [LOCAL ] MCN: Loaded 8186 existing records from primary storage. [2025-10-14T22:40:07.901769] [INFO ] [MAIN ] MCN: Loaded 8186 primary data records. [2025-10-14T22:40:08.133614] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-14T22:40:08.249711] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-14T22:40:08.281451] [INFO ] [MAIN ] Derivative Progress: 1133/1812 symbols completed. MCB took 1.3s. Estimated remaining: 4m 19s. Rate: 157.5 symbols/min [2025-10-14T22:40:08.308452] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:08.479250] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:08.479952] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38649 primary records. [2025-10-14T22:40:08.480159] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-14T22:40:08.505821] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-14T22:40:08.506068] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-14T22:40:08.522013] [INFO ] [MAIN ] Derivative Progress: 1134/1812 symbols completed. MCK took 0.8s. Estimated remaining: 4m 18s. Rate: 157.6 symbols/min [2025-10-14T22:40:08.523678] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:08.533072] [DEBUG] [LOCAL ] MCO: Loaded 39438 existing records from primary storage. [2025-10-14T22:40:08.538037] [INFO ] [MAIN ] MCO: Loaded 39438 primary data records. [2025-10-14T22:40:08.550494] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:08.561137] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8186 primary records. [2025-10-14T22:40:08.561256] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-14T22:40:08.634340] [DEBUG] [LOCAL ] MCR: Loaded 8859 existing records from primary storage. [2025-10-14T22:40:08.639599] [INFO ] [MAIN ] MCR: Loaded 8859 primary data records. [2025-10-14T22:40:08.695438] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-14T22:40:08.722998] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-14T22:40:08.725006] [INFO ] [MAIN ] Derivative Progress: 1135/1812 symbols completed. MCN took 0.9s. Estimated remaining: 4m 18s. Rate: 157.6 symbols/min [2025-10-14T22:40:08.730257] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:09.057909] [DEBUG] [LOCAL ] MCS: Loaded 21059 existing records from primary storage. [2025-10-14T22:40:09.058150] [INFO ] [MAIN ] MCS: Loaded 21059 primary data records. [2025-10-14T22:40:09.532366] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:09.534294] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39438 primary records. [2025-10-14T22:40:09.534496] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-14T22:40:09.552591] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-14T22:40:09.553706] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-14T22:40:09.555843] [INFO ] [MAIN ] Derivative Progress: 1136/1812 symbols completed. MCO took 1.2s. Estimated remaining: 4m 18s. Rate: 157.5 symbols/min [2025-10-14T22:40:09.569287] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:09.556145] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:09.570964] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8859 primary records. [2025-10-14T22:40:09.571156] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-14T22:40:09.588069] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-14T22:40:09.594149] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-14T22:40:09.597019] [INFO ] [MAIN ] Derivative Progress: 1137/1812 symbols completed. MCR took 1.1s. Estimated remaining: 4m 17s. Rate: 157.6 symbols/min [2025-10-14T22:40:09.597325] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:09.617146] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:09.618523] [DEBUG] [LOCAL ] MCY: Loaded 23899 existing records from primary storage. [2025-10-14T22:40:09.619155] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21059 primary records. [2025-10-14T22:40:09.619260] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-14T22:40:09.619342] [INFO ] [MAIN ] MCY: Loaded 23899 primary data records. [2025-10-14T22:40:09.770388] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-14T22:40:09.805992] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-14T22:40:09.817464] [INFO ] [MAIN ] Derivative Progress: 1138/1812 symbols completed. MCS took 1.1s. Estimated remaining: 4m 17s. Rate: 157.7 symbols/min [2025-10-14T22:40:09.850726] [DEBUG] [LOCAL ] MD: Loaded 38569 existing records from primary storage. [2025-10-14T22:40:09.953768] [INFO ] [MAIN ] MD: Loaded 38569 primary data records. [2025-10-14T22:40:10.286403] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:10.287258] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 23899 primary records. [2025-10-14T22:40:10.287618] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-14T22:40:10.304320] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-14T22:40:10.304381] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-14T22:40:10.306317] [INFO ] [MAIN ] Derivative Progress: 1139/1812 symbols completed. MCY took 0.8s. Estimated remaining: 4m 16s. Rate: 157.6 symbols/min [2025-10-14T22:40:10.322190] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:10.322798] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38569 primary records. [2025-10-14T22:40:10.322859] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-14T22:40:10.338038] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-14T22:40:10.338103] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-14T22:40:10.340203] [INFO ] [MAIN ] Derivative Progress: 1140/1812 symbols completed. MD took 0.7s. Estimated remaining: 4m 16s. Rate: 157.7 symbols/min [2025-10-14T22:40:10.340677] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:10.340597] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:10.341245] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:10.349934] [DEBUG] [LOCAL ] MDST: Loaded 5942 existing records from primary storage. [2025-10-14T22:40:10.350199] [INFO ] [MAIN ] MDST: Loaded 5942 primary data records. [2025-10-14T22:40:10.691188] [DEBUG] [LOCAL ] MDU: Loaded 48090 existing records from primary storage. [2025-10-14T22:40:10.691477] [INFO ] [MAIN ] MDU: Loaded 48090 primary data records. [2025-10-14T22:40:10.777741] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-14T22:40:10.784908] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-14T22:40:11.360005] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:11.361357] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5942 primary records. [2025-10-14T22:40:11.361575] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-14T22:40:11.378454] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-10-14T22:40:11.378727] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-14T22:40:11.380980] [INFO ] [MAIN ] Derivative Progress: 1141/1812 symbols completed. MDST took 1.0s. Estimated remaining: 4m 16s. Rate: 157.5 symbols/min [2025-10-14T22:40:11.381228] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:11.404017] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:11.404964] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 48090 primary records. [2025-10-14T22:40:11.405068] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-14T22:40:11.420784] [DEBUG] [LOCAL ] MDV: Loaded 8484 existing records from primary storage. [2025-10-14T22:40:11.421083] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:11.421755] [INFO ] [MAIN ] MDV: Loaded 8484 primary data records. [2025-10-14T22:40:11.422383] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-14T22:40:11.427800] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-14T22:40:11.538578] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-14T22:40:11.550862] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-14T22:40:11.552958] [INFO ] [MAIN ] Derivative Progress: 1142/1812 symbols completed. MDU took 1.2s. Estimated remaining: 4m 15s. Rate: 157.6 symbols/min [2025-10-14T22:40:11.562535] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:11.651900] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-14T22:40:11.652033] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-14T22:40:11.654253] [INFO ] [MAIN ] Derivative Progress: 1143/1812 symbols completed. MDT took 1.3s. Estimated remaining: 4m 15s. Rate: 157.7 symbols/min [2025-10-14T22:40:11.654437] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:11.784943] [DEBUG] [LOCAL ] MEC: Loaded 16347 existing records from primary storage. [2025-10-14T22:40:11.785272] [INFO ] [MAIN ] MEC: Loaded 16347 primary data records. [2025-10-14T22:40:11.919327] [DEBUG] [LOCAL ] MED: Loaded 21244 existing records from primary storage. [2025-10-14T22:40:11.952004] [INFO ] [MAIN ] MED: Loaded 21244 primary data records. [2025-10-14T22:40:12.400348] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:12.415281] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8484 primary records. [2025-10-14T22:40:12.415463] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-14T22:40:12.432171] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-14T22:40:12.432444] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-14T22:40:12.435947] [INFO ] [MAIN ] Derivative Progress: 1144/1812 symbols completed. MDV took 1.1s. Estimated remaining: 4m 14s. Rate: 157.5 symbols/min [2025-10-14T22:40:12.437018] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:12.455769] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:12.456719] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16347 primary records. [2025-10-14T22:40:12.457056] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-14T22:40:12.474503] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-14T22:40:12.474858] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-14T22:40:12.476963] [INFO ] [MAIN ] Derivative Progress: 1145/1812 symbols completed. MEC took 0.9s. Estimated remaining: 4m 14s. Rate: 157.7 symbols/min [2025-10-14T22:40:12.477095] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:12.503134] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:12.503966] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21244 primary records. [2025-10-14T22:40:12.504177] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-14T22:40:12.539037] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-14T22:40:12.537521] [DEBUG] [LOCAL ] MEG: Loaded 31553 existing records from primary storage. [2025-10-14T22:40:12.539317] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-14T22:40:12.539432] [INFO ] [MAIN ] MEG: Loaded 31553 primary data records. [2025-10-14T22:40:12.541719] [INFO ] [MAIN ] Derivative Progress: 1146/1812 symbols completed. MED took 0.9s. Estimated remaining: 4m 13s. Rate: 157.8 symbols/min [2025-10-14T22:40:12.542038] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:12.581859] [DEBUG] [LOCAL ] MEGI: Loaded 19859 existing records from primary storage. [2025-10-14T22:40:12.604277] [INFO ] [MAIN ] MEGI: Loaded 19859 primary data records. [2025-10-14T22:40:13.016025] [DEBUG] [LOCAL ] MEI: Loaded 31735 existing records from primary storage. [2025-10-14T22:40:13.028952] [INFO ] [MAIN ] MEI: Loaded 31735 primary data records. [2025-10-14T22:40:13.562588] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:13.564221] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31553 primary records. [2025-10-14T22:40:13.565214] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-14T22:40:13.579481] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:13.595221] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-14T22:40:13.595367] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-14T22:40:13.597326] [INFO ] [MAIN ] Derivative Progress: 1147/1812 symbols completed. MEG took 1.2s. Estimated remaining: 4m 13s. Rate: 157.5 symbols/min [2025-10-14T22:40:13.598725] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:13.598231] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19859 primary records. [2025-10-14T22:40:13.599052] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-14T22:40:13.616926] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-14T22:40:13.617250] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-14T22:40:13.619416] [INFO ] [MAIN ] Derivative Progress: 1148/1812 symbols completed. MEGI took 1.1s. Estimated remaining: 4m 13s. Rate: 157.7 symbols/min [2025-10-14T22:40:13.619614] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:13.636123] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:13.636893] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31735 primary records. [2025-10-14T22:40:13.637036] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-14T22:40:13.653571] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-14T22:40:13.667753] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-14T22:40:13.670019] [INFO ] [MAIN ] Derivative Progress: 1149/1812 symbols completed. MEI took 1.1s. Estimated remaining: 4m 12s. Rate: 157.8 symbols/min [2025-10-14T22:40:13.670253] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:13.685153] [DEBUG] [LOCAL ] MFAN: Loaded 4390 existing records from primary storage. [2025-10-14T22:40:13.685306] [INFO ] [MAIN ] MFAN: Loaded 4390 primary data records. [2025-10-14T22:40:13.789348] [DEBUG] [LOCAL ] MET: Loaded 53318 existing records from primary storage. [2025-10-14T22:40:13.799858] [INFO ] [MAIN ] MET: Loaded 53318 primary data records. [2025-10-14T22:40:13.873851] [DEBUG] [LOCAL ] MFA: Loaded 45808 existing records from primary storage. [2025-10-14T22:40:13.906033] [INFO ] [MAIN ] MFA: Loaded 45808 primary data records. [2025-10-14T22:40:14.673219] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-14T22:40:14.673559] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:14.674778] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53318 primary records. [2025-10-14T22:40:14.674919] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-14T22:40:14.675673] [INFO ] [MAIN ] MFAN: Generated 1791 derivative records from 4390 primary records. [2025-10-14T22:40:14.676174] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-14T22:40:14.702565] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-14T22:40:14.705676] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-14T22:40:14.708402] [INFO ] [MAIN ] Derivative Progress: 1150/1812 symbols completed. MET took 1.1s. Estimated remaining: 4m 12s. Rate: 157.5 symbols/min [2025-10-14T22:40:14.709234] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:14.724825] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1791 records). [2025-10-14T22:40:14.725165] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-14T22:40:14.727787] [INFO ] [MAIN ] Derivative Progress: 1151/1812 symbols completed. MFAN took 1.1s. Estimated remaining: 4m 12s. Rate: 157.7 symbols/min [2025-10-14T22:40:14.728030] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:14.725903] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:14.728944] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45808 primary records. [2025-10-14T22:40:14.730754] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-14T22:40:14.742841] [DEBUG] [LOCAL ] MFAO: Loaded 3994 existing records from primary storage. [2025-10-14T22:40:14.742937] [INFO ] [MAIN ] MFAO: Loaded 3994 primary data records. [2025-10-14T22:40:14.851911] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-14T22:40:14.868047] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-14T22:40:14.901474] [INFO ] [MAIN ] Derivative Progress: 1152/1812 symbols completed. MFA took 1.3s. Estimated remaining: 4m 11s. Rate: 157.7 symbols/min [2025-10-14T22:40:14.930340] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:15.111220] [DEBUG] [LOCAL ] MFC: Loaded 51097 existing records from primary storage. [2025-10-14T22:40:15.111891] [INFO ] [MAIN ] MFC: Loaded 51097 primary data records. [2025-10-14T22:40:15.440072] [DEBUG] [LOCAL ] MFG: Loaded 49518 existing records from primary storage. [2025-10-14T22:40:15.440397] [INFO ] [MAIN ] MFG: Loaded 49518 primary data records. [2025-10-14T22:40:15.565234] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:40:15.566042] [INFO ] [MAIN ] MFAO: Generated 1792 derivative records from 3994 primary records. [2025-10-14T22:40:15.566502] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-14T22:40:15.660334] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1792 records). [2025-10-14T22:40:15.767168] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-14T22:40:15.777988] [INFO ] [MAIN ] Derivative Progress: 1153/1812 symbols completed. MFAO took 1.1s. Estimated remaining: 4m 11s. Rate: 157.6 symbols/min [2025-10-14T22:40:15.797802] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:15.798543] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51097 primary records. [2025-10-14T22:40:15.798752] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-14T22:40:15.816468] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-14T22:40:15.816536] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-14T22:40:15.818478] [INFO ] [MAIN ] Derivative Progress: 1154/1812 symbols completed. MFC took 1.1s. Estimated remaining: 4m 10s. Rate: 157.7 symbols/min [2025-10-14T22:40:15.835368] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:15.835991] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49518 primary records. [2025-10-14T22:40:15.836051] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-14T22:40:15.851261] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-14T22:40:15.851326] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-14T22:40:15.853341] [INFO ] [MAIN ] Derivative Progress: 1155/1812 symbols completed. MFG took 0.9s. Estimated remaining: 4m 10s. Rate: 157.8 symbols/min [2025-10-14T22:40:15.853783] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:15.853885] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:15.853980] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:15.862277] [DEBUG] [LOCAL ] MFSG: Loaded 5709 existing records from primary storage. [2025-10-14T22:40:15.869225] [INFO ] [MAIN ] MFSG: Loaded 5709 primary data records. [2025-10-14T22:40:15.959514] [DEBUG] [LOCAL ] MFM: Loaded 14624 existing records from primary storage. [2025-10-14T22:40:15.943273] [DEBUG] [LOCAL ] MFSI: Loaded 12037 existing records from primary storage. [2025-10-14T22:40:15.964997] [INFO ] [MAIN ] MFSI: Loaded 12037 primary data records. [2025-10-14T22:40:15.970917] [INFO ] [MAIN ] MFM: Loaded 14624 primary data records. [2025-10-14T22:40:16.785850] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:16.787375] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5709 primary records. [2025-10-14T22:40:16.787559] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-14T22:40:16.806506] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-10-14T22:40:16.807364] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-14T22:40:16.810061] [INFO ] [MAIN ] Derivative Progress: 1156/1812 symbols completed. MFSG took 1.0s. Estimated remaining: 4m 10s. Rate: 157.6 symbols/min [2025-10-14T22:40:16.811764] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:16.838044] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:16.838294] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:16.840508] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14624 primary records. [2025-10-14T22:40:16.839118] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 12037 primary records. [2025-10-14T22:40:16.840707] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-14T22:40:16.841506] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-14T22:40:16.851076] [DEBUG] [LOCAL ] MFSV: Loaded 2793 existing records from primary storage. [2025-10-14T22:40:16.854934] [INFO ] [MAIN ] MFSV: Loaded 2793 primary data records. [2025-10-14T22:40:16.963280] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-14T22:40:16.951342] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-14T22:40:16.978366] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-14T22:40:16.984012] [INFO ] [MAIN ] Derivative Progress: 1157/1812 symbols completed. MFSI took 1.1s. Estimated remaining: 4m 9s. Rate: 157.7 symbols/min [2025-10-14T22:40:16.970282] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-14T22:40:16.987479] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:16.987693] [INFO ] [MAIN ] Derivative Progress: 1158/1812 symbols completed. MFM took 1.1s. Estimated remaining: 4m 9s. Rate: 157.8 symbols/min [2025-10-14T22:40:16.993623] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:17.220932] [DEBUG] [LOCAL ] MG: Loaded 15911 existing records from primary storage. [2025-10-14T22:40:17.221690] [INFO ] [MAIN ] MG: Loaded 15911 primary data records. [2025-10-14T22:40:17.552030] [DEBUG] [LOCAL ] MGA: Loaded 50617 existing records from primary storage. [2025-10-14T22:40:17.560739] [INFO ] [MAIN ] MGA: Loaded 50617 primary data records. [2025-10-14T22:40:17.734935] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:17.752086] [INFO ] [MAIN ] MFSV: Generated 1793 derivative records from 2793 primary records. [2025-10-14T22:40:17.774114] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-14T22:40:17.906829] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1793 records). [2025-10-14T22:40:17.908522] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-14T22:40:17.910702] [INFO ] [MAIN ] Derivative Progress: 1159/1812 symbols completed. MFSV took 1.1s. Estimated remaining: 4m 9s. Rate: 157.6 symbols/min [2025-10-14T22:40:17.911226] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:17.925597] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:17.926618] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 15911 primary records. [2025-10-14T22:40:17.927838] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-14T22:40:17.940602] [DEBUG] [LOCAL ] MGF: Loaded 4261 existing records from primary storage. [2025-10-14T22:40:17.945267] [INFO ] [MAIN ] MGF: Loaded 4261 primary data records. [2025-10-14T22:40:17.993687] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-14T22:40:18.008632] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-14T22:40:18.010775] [INFO ] [MAIN ] Derivative Progress: 1160/1812 symbols completed. MG took 1.0s. Estimated remaining: 4m 8s. Rate: 157.7 symbols/min [2025-10-14T22:40:18.025574] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:18.283837] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:18.299054] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50617 primary records. [2025-10-14T22:40:18.299559] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-14T22:40:18.319222] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-14T22:40:18.319405] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-14T22:40:18.321822] [INFO ] [MAIN ] Derivative Progress: 1161/1812 symbols completed. MGA took 1.3s. Estimated remaining: 4m 8s. Rate: 157.7 symbols/min [2025-10-14T22:40:18.337346] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:18.339155] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-14T22:40:18.339613] [INFO ] [MAIN ] MGM: Loaded 53607 primary data records. [2025-10-14T22:40:18.426500] [DEBUG] [LOCAL ] MGR: Loaded 5625 existing records from primary storage. [2025-10-14T22:40:18.431862] [INFO ] [MAIN ] MGR: Loaded 5625 primary data records. [2025-10-14T22:40:18.655177] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:18.671287] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4261 primary records. [2025-10-14T22:40:18.786272] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-14T22:40:19.046940] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-10-14T22:40:19.048153] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-14T22:40:19.050490] [INFO ] [MAIN ] Derivative Progress: 1162/1812 symbols completed. MGF took 1.1s. Estimated remaining: 4m 7s. Rate: 157.6 symbols/min [2025-10-14T22:40:19.052339] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:19.059339] [DEBUG] [LOCAL ] MGRB: Loaded 4036 existing records from primary storage. [2025-10-14T22:40:19.060094] [INFO ] [MAIN ] MGRB: Loaded 4036 primary data records. [2025-10-14T22:40:19.191135] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:19.220788] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53607 primary records. [2025-10-14T22:40:19.219797] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:19.231953] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5625 primary records. [2025-10-14T22:40:19.232124] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-14T22:40:19.232061] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-14T22:40:19.435021] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-14T22:40:19.434063] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-14T22:40:19.435226] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-14T22:40:19.435319] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-14T22:40:19.437547] [INFO ] [MAIN ] Derivative Progress: 1163/1812 symbols completed. MGR took 1.1s. Estimated remaining: 4m 7s. Rate: 157.6 symbols/min [2025-10-14T22:40:19.439770] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:19.439899] [INFO ] [MAIN ] Derivative Progress: 1164/1812 symbols completed. MGM took 1.4s. Estimated remaining: 4m 6s. Rate: 157.8 symbols/min [2025-10-14T22:40:19.441226] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:19.448787] [DEBUG] [LOCAL ] MGRD: Loaded 2221 existing records from primary storage. [2025-10-14T22:40:19.449624] [INFO ] [MAIN ] MGRD: Loaded 2221 primary data records. [2025-10-14T22:40:19.496948] [DEBUG] [LOCAL ] MGRE: Loaded 6639 existing records from primary storage. [2025-10-14T22:40:19.542371] [INFO ] [MAIN ] MGRE: Loaded 6639 primary data records. [2025-10-14T22:40:19.923245] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:19.963084] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4036 primary records. [2025-10-14T22:40:19.963193] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-14T22:40:20.099581] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-14T22:40:20.100041] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-14T22:40:20.102140] [INFO ] [MAIN ] Derivative Progress: 1165/1812 symbols completed. MGRB took 1.0s. Estimated remaining: 4m 6s. Rate: 157.7 symbols/min [2025-10-14T22:40:20.103487] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:20.121917] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:20.122854] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2221 primary records. [2025-10-14T22:40:20.123942] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-14T22:40:20.140608] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-14T22:40:20.148594] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-14T22:40:20.150761] [INFO ] [MAIN ] Derivative Progress: 1166/1812 symbols completed. MGRD took 0.7s. Estimated remaining: 4m 6s. Rate: 157.8 symbols/min [2025-10-14T22:40:20.155717] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:20.157113] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:20.158010] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6639 primary records. [2025-10-14T22:40:20.158092] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-14T22:40:20.190237] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-14T22:40:20.190466] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-14T22:40:20.192627] [INFO ] [MAIN ] Derivative Progress: 1167/1812 symbols completed. MGRE took 0.8s. Estimated remaining: 4m 5s. Rate: 157.9 symbols/min [2025-10-14T22:40:20.192978] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:20.214190] [DEBUG] [LOCAL ] MHD: Loaded 12325 existing records from primary storage. [2025-10-14T22:40:20.214447] [INFO ] [MAIN ] MHD: Loaded 12325 primary data records. [2025-10-14T22:40:20.249804] [DEBUG] [LOCAL ] MGY: Loaded 52419 existing records from primary storage. [2025-10-14T22:40:20.274363] [INFO ] [MAIN ] MGY: Loaded 52419 primary data records. [2025-10-14T22:40:20.341067] [DEBUG] [LOCAL ] MHF: Loaded 8845 existing records from primary storage. [2025-10-14T22:40:20.402733] [INFO ] [MAIN ] MHF: Loaded 8845 primary data records. [2025-10-14T22:40:21.212211] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:21.213272] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12325 primary records. [2025-10-14T22:40:21.213725] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-14T22:40:21.213632] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:21.215091] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52419 primary records. [2025-10-14T22:40:21.227282] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-14T22:40:21.228889] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:21.229608] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8845 primary records. [2025-10-14T22:40:21.230046] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-14T22:40:21.264769] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-14T22:40:21.271592] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-14T22:40:21.271219] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-14T22:40:21.274628] [INFO ] [MAIN ] Derivative Progress: 1168/1812 symbols completed. MHD took 1.1s. Estimated remaining: 4m 5s. Rate: 157.6 symbols/min [2025-10-14T22:40:21.275097] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-14T22:40:21.279736] [INFO ] [MAIN ] Derivative Progress: 1169/1812 symbols completed. MHF took 1.1s. Estimated remaining: 4m 5s. Rate: 157.8 symbols/min [2025-10-14T22:40:21.280500] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-14T22:40:21.280562] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-14T22:40:21.282475] [INFO ] [MAIN ] Derivative Progress: 1170/1812 symbols completed. MGY took 1.2s. Estimated remaining: 4m 4s. Rate: 157.9 symbols/min [2025-10-14T22:40:21.282913] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:21.282857] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:21.283055] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:21.292126] [DEBUG] [LOCAL ] MHN: Loaded 7527 existing records from primary storage. [2025-10-14T22:40:21.292552] [INFO ] [MAIN ] MHN: Loaded 7527 primary data records. [2025-10-14T22:40:21.418548] [DEBUG] [LOCAL ] MHO: Loaded 23765 existing records from primary storage. [2025-10-14T22:40:21.448517] [INFO ] [MAIN ] MHO: Loaded 23765 primary data records. [2025-10-14T22:40:21.739277] [DEBUG] [LOCAL ] MHK: Loaded 42126 existing records from primary storage. [2025-10-14T22:40:21.740724] [INFO ] [MAIN ] MHK: Loaded 42126 primary data records. [2025-10-14T22:40:22.263180] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:22.264370] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7527 primary records. [2025-10-14T22:40:22.264665] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-14T22:40:22.281988] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-14T22:40:22.284405] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-14T22:40:22.286632] [INFO ] [MAIN ] Derivative Progress: 1171/1812 symbols completed. MHN took 1.0s. Estimated remaining: 4m 4s. Rate: 157.7 symbols/min [2025-10-14T22:40:22.287016] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:22.301344] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:22.302064] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23765 primary records. [2025-10-14T22:40:22.302255] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-14T22:40:22.335846] [DEBUG] [LOCAL ] MIN: Loaded 13860 existing records from primary storage. [2025-10-14T22:40:22.341762] [INFO ] [MAIN ] MIN: Loaded 13860 primary data records. [2025-10-14T22:40:22.363814] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:22.387402] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42126 primary records. [2025-10-14T22:40:22.400074] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-14T22:40:22.392598] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-14T22:40:22.414917] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-14T22:40:22.431520] [INFO ] [MAIN ] Derivative Progress: 1172/1812 symbols completed. MHO took 1.1s. Estimated remaining: 4m 3s. Rate: 157.8 symbols/min [2025-10-14T22:40:22.464814] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:22.481946] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-14T22:40:22.487171] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-14T22:40:22.541133] [INFO ] [MAIN ] Derivative Progress: 1173/1812 symbols completed. MHK took 1.3s. Estimated remaining: 4m 3s. Rate: 157.9 symbols/min [2025-10-14T22:40:22.649700] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:22.664630] [DEBUG] [LOCAL ] MITP: Loaded 2327 existing records from primary storage. [2025-10-14T22:40:22.665128] [INFO ] [MAIN ] MITP: Loaded 2327 primary data records. [2025-10-14T22:40:23.035143] [DEBUG] [LOCAL ] MIR: Loaded 51242 existing records from primary storage. [2025-10-14T22:40:23.035588] [INFO ] [MAIN ] MIR: Loaded 51242 primary data records. [2025-10-14T22:40:23.165904] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:23.166949] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13860 primary records. [2025-10-14T22:40:23.172266] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-14T22:40:23.375618] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-14T22:40:23.376040] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-14T22:40:23.378196] [INFO ] [MAIN ] Derivative Progress: 1174/1812 symbols completed. MIN took 1.1s. Estimated remaining: 4m 3s. Rate: 157.7 symbols/min [2025-10-14T22:40:23.378440] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:23.398043] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-14T22:40:23.398978] [INFO ] [MAIN ] MITP: Generated 1791 derivative records from 2327 primary records. [2025-10-14T22:40:23.399166] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-14T22:40:23.419878] [DEBUG] [LOCAL ] MITP: Derivative data saved (1791 records). [2025-10-14T22:40:23.420140] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-14T22:40:23.422272] [INFO ] [MAIN ] Derivative Progress: 1175/1812 symbols completed. MITP took 0.8s. Estimated remaining: 4m 2s. Rate: 157.8 symbols/min [2025-10-14T22:40:23.428808] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:23.430918] [DEBUG] [LOCAL ] MITT: Loaded 22725 existing records from primary storage. [2025-10-14T22:40:23.431335] [INFO ] [MAIN ] MITT: Loaded 22725 primary data records. [2025-10-14T22:40:23.491961] [DEBUG] [LOCAL ] MIY: Loaded 6234 existing records from primary storage. [2025-10-14T22:40:23.502720] [INFO ] [MAIN ] MIY: Loaded 6234 primary data records. [2025-10-14T22:40:23.602125] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:23.650151] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51242 primary records. [2025-10-14T22:40:23.662232] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-14T22:40:24.117030] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-14T22:40:24.117336] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-14T22:40:24.119550] [INFO ] [MAIN ] Derivative Progress: 1176/1812 symbols completed. MIR took 1.7s. Estimated remaining: 4m 2s. Rate: 157.7 symbols/min [2025-10-14T22:40:24.119822] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:24.169980] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:24.169717] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:24.185096] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6234 primary records. [2025-10-14T22:40:24.184442] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22725 primary records. [2025-10-14T22:40:24.185249] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-14T22:40:24.185304] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-14T22:40:24.230962] [DEBUG] [LOCAL ] MKC: Loaded 52523 existing records from primary storage. [2025-10-14T22:40:24.232190] [INFO ] [MAIN ] MKC: Loaded 52523 primary data records. [2025-10-14T22:40:24.232117] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-14T22:40:24.232790] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-14T22:40:24.238067] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-14T22:40:24.232711] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-14T22:40:24.240221] [INFO ] [MAIN ] Derivative Progress: 1177/1812 symbols completed. MITT took 0.9s. Estimated remaining: 4m 1s. Rate: 157.8 symbols/min [2025-10-14T22:40:24.242544] [INFO ] [MAIN ] Derivative Progress: 1178/1812 symbols completed. MIY took 0.8s. Estimated remaining: 4m 1s. Rate: 157.9 symbols/min [2025-10-14T22:40:24.242481] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:24.249181] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:24.594286] [DEBUG] [LOCAL ] MKL: Loaded 34026 existing records from primary storage. [2025-10-14T22:40:24.594547] [INFO ] [MAIN ] MKL: Loaded 34026 primary data records. [2025-10-14T22:40:24.715257] [DEBUG] [LOCAL ] MLI: Loaded 43535 existing records from primary storage. [2025-10-14T22:40:24.721555] [INFO ] [MAIN ] MLI: Loaded 43535 primary data records. [2025-10-14T22:40:25.268710] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:25.269607] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52523 primary records. [2025-10-14T22:40:25.269915] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-14T22:40:25.290516] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-14T22:40:25.290904] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-14T22:40:25.293486] [INFO ] [MAIN ] Derivative Progress: 1179/1812 symbols completed. MKC took 1.2s. Estimated remaining: 4m 1s. Rate: 157.7 symbols/min [2025-10-14T22:40:25.294216] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:25.311798] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:25.312497] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34026 primary records. [2025-10-14T22:40:25.312690] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-14T22:40:25.362095] [DEBUG] [LOCAL ] MLM: Loaded 29280 existing records from primary storage. [2025-10-14T22:40:25.362777] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-14T22:40:25.363050] [INFO ] [MAIN ] MLM: Loaded 29280 primary data records. [2025-10-14T22:40:25.363351] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:25.364173] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43535 primary records. [2025-10-14T22:40:25.362877] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-14T22:40:25.365993] [INFO ] [MAIN ] Derivative Progress: 1180/1812 symbols completed. MKL took 1.1s. Estimated remaining: 4m 0s. Rate: 157.8 symbols/min [2025-10-14T22:40:25.371166] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-14T22:40:25.399449] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:25.491084] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-14T22:40:25.544851] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-14T22:40:25.696243] [INFO ] [MAIN ] Derivative Progress: 1181/1812 symbols completed. MLI took 1.4s. Estimated remaining: 3m 60s. Rate: 157.8 symbols/min [2025-10-14T22:40:25.693946] [DEBUG] [LOCAL ] MLNK: Loaded 26497 existing records from primary storage. [2025-10-14T22:40:25.696555] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:25.697083] [INFO ] [MAIN ] MLNK: Loaded 26497 primary data records. [2025-10-14T22:40:25.799971] [DEBUG] [LOCAL ] MLP: Loaded 3066 existing records from primary storage. [2025-10-14T22:40:25.808131] [INFO ] [MAIN ] MLP: Loaded 3066 primary data records. [2025-10-14T22:40:26.333442] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:26.334391] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29280 primary records. [2025-10-14T22:40:26.334473] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-14T22:40:26.359310] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-14T22:40:26.359969] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-14T22:40:26.362359] [INFO ] [MAIN ] Derivative Progress: 1182/1812 symbols completed. MLM took 1.1s. Estimated remaining: 3m 60s. Rate: 157.7 symbols/min [2025-10-14T22:40:26.362706] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:26.391634] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:26.392068] [DEBUG] [LOCAL ] MLR: Loaded 12475 existing records from primary storage. [2025-10-14T22:40:26.392373] [INFO ] [MAIN ] MLR: Loaded 12475 primary data records. [2025-10-14T22:40:26.405151] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 26497 primary records. [2025-10-14T22:40:26.410666] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-14T22:40:26.545353] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:26.547210] [INFO ] [MAIN ] MLP: Generated 1793 derivative records from 3066 primary records. [2025-10-14T22:40:26.547912] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-14T22:40:26.548726] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-14T22:40:26.548834] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-14T22:40:26.551622] [INFO ] [MAIN ] Derivative Progress: 1183/1812 symbols completed. MLNK took 1.2s. Estimated remaining: 3m 59s. Rate: 157.8 symbols/min [2025-10-14T22:40:26.785915] [DEBUG] [LOCAL ] MLP: Derivative data saved (1793 records). [2025-10-14T22:40:26.798994] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-14T22:40:26.801780] [INFO ] [MAIN ] Derivative Progress: 1184/1812 symbols completed. MLP took 1.1s. Estimated remaining: 3m 59s. Rate: 157.8 symbols/min [2025-10-14T22:40:26.826169] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:26.826798] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12475 primary records. [2025-10-14T22:40:26.826878] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-14T22:40:26.841781] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-14T22:40:26.841840] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-14T22:40:26.843998] [INFO ] [MAIN ] Derivative Progress: 1185/1812 symbols completed. MLR took 0.5s. Estimated remaining: 3m 58s. Rate: 158.0 symbols/min [2025-10-14T22:40:26.844431] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:26.844828] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:26.844592] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:26.869393] [DEBUG] [LOCAL ] MMD: Loaded 10886 existing records from primary storage. [2025-10-14T22:40:26.869012] [DEBUG] [LOCAL ] MMI: Loaded 15459 existing records from primary storage. [2025-10-14T22:40:26.869770] [INFO ] [MAIN ] MMD: Loaded 10886 primary data records. [2025-10-14T22:40:26.869624] [INFO ] [MAIN ] MMI: Loaded 15459 primary data records. [2025-10-14T22:40:27.504912] [DEBUG] [LOCAL ] MMC: Loaded 51919 existing records from primary storage. [2025-10-14T22:40:27.505194] [INFO ] [MAIN ] MMC: Loaded 51919 primary data records. [2025-10-14T22:40:27.851419] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:27.852603] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15459 primary records. [2025-10-14T22:40:27.852788] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-14T22:40:27.866572] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:27.875202] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 10886 primary records. [2025-10-14T22:40:27.875382] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-14T22:40:27.914900] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-14T22:40:27.915528] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-14T22:40:27.918134] [INFO ] [MAIN ] Derivative Progress: 1186/1812 symbols completed. MMI took 1.1s. Estimated remaining: 3m 58s. Rate: 157.7 symbols/min [2025-10-14T22:40:27.918840] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:27.919303] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-14T22:40:27.918729] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:27.920901] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51919 primary records. [2025-10-14T22:40:27.921148] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-14T22:40:27.921097] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-14T22:40:27.923563] [INFO ] [MAIN ] Derivative Progress: 1187/1812 symbols completed. MMD took 1.1s. Estimated remaining: 3m 58s. Rate: 157.8 symbols/min [2025-10-14T22:40:27.923913] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:27.940577] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-14T22:40:27.940779] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-14T22:40:27.942842] [INFO ] [MAIN ] Derivative Progress: 1188/1812 symbols completed. MMC took 1.1s. Estimated remaining: 3m 57s. Rate: 158.0 symbols/min [2025-10-14T22:40:27.943097] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:27.954553] [DEBUG] [LOCAL ] MMT: Loaded 10364 existing records from primary storage. [2025-10-14T22:40:27.963204] [INFO ] [MAIN ] MMT: Loaded 10364 primary data records. [2025-10-14T22:40:28.100030] [DEBUG] [LOCAL ] MMS: Loaded 33783 existing records from primary storage. [2025-10-14T22:40:28.105833] [INFO ] [MAIN ] MMS: Loaded 33783 primary data records. [2025-10-14T22:40:28.260002] [DEBUG] [LOCAL ] MMM: Loaded 53116 existing records from primary storage. [2025-10-14T22:40:28.286789] [INFO ] [MAIN ] MMM: Loaded 53116 primary data records. [2025-10-14T22:40:28.990089] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:28.991395] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10364 primary records. [2025-10-14T22:40:28.991722] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-14T22:40:29.023870] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:29.025711] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33783 primary records. [2025-10-14T22:40:29.026072] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-14T22:40:29.041630] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-14T22:40:29.044480] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-14T22:40:29.047660] [INFO ] [MAIN ] Derivative Progress: 1189/1812 symbols completed. MMT took 1.1s. Estimated remaining: 3m 57s. Rate: 157.7 symbols/min [2025-10-14T22:40:29.050535] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:29.051856] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-14T22:40:29.053201] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-14T22:40:29.055843] [INFO ] [MAIN ] Derivative Progress: 1190/1812 symbols completed. MMS took 1.1s. Estimated remaining: 3m 56s. Rate: 157.9 symbols/min [2025-10-14T22:40:29.056268] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:29.070453] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:29.071227] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53116 primary records. [2025-10-14T22:40:29.071338] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-14T22:40:29.109231] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-14T22:40:29.109396] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-14T22:40:29.113474] [INFO ] [MAIN ] Derivative Progress: 1191/1812 symbols completed. MMM took 1.2s. Estimated remaining: 3m 56s. Rate: 158.0 symbols/min [2025-10-14T22:40:29.114541] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:29.125679] [DEBUG] [LOCAL ] MMU: Loaded 16581 existing records from primary storage. [2025-10-14T22:40:29.126428] [INFO ] [MAIN ] MMU: Loaded 16581 primary data records. [2025-10-14T22:40:29.159512] [DEBUG] [LOCAL ] MNR: Loaded 24830 existing records from primary storage. [2025-10-14T22:40:29.193860] [INFO ] [MAIN ] MNR: Loaded 24830 primary data records. [2025-10-14T22:40:29.704202] [DEBUG] [LOCAL ] MNSO: Loaded 44150 existing records from primary storage. [2025-10-14T22:40:29.704519] [INFO ] [MAIN ] MNSO: Loaded 44150 primary data records. [2025-10-14T22:40:30.306855] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:30.308419] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16581 primary records. [2025-10-14T22:40:30.308856] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-14T22:40:30.331237] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-14T22:40:30.339239] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-14T22:40:30.342115] [INFO ] [MAIN ] Derivative Progress: 1192/1812 symbols completed. MMU took 1.3s. Estimated remaining: 3m 56s. Rate: 157.7 symbols/min [2025-10-14T22:40:30.347685] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:30.347818] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:30.348796] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24830 primary records. [2025-10-14T22:40:30.349208] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-14T22:40:30.378415] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-14T22:40:30.383833] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-14T22:40:30.386765] [INFO ] [MAIN ] Derivative Progress: 1193/1812 symbols completed. MNR took 1.3s. Estimated remaining: 3m 55s. Rate: 157.8 symbols/min [2025-10-14T22:40:30.384281] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:30.387836] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44150 primary records. [2025-10-14T22:40:30.388068] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-14T22:40:30.387995] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:30.420776] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-14T22:40:30.421094] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-14T22:40:30.423831] [INFO ] [MAIN ] Derivative Progress: 1194/1812 symbols completed. MNSO took 1.3s. Estimated remaining: 3m 55s. Rate: 157.9 symbols/min [2025-10-14T22:40:30.424251] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:30.445078] [DEBUG] [LOCAL ] MOD: Loaded 44823 existing records from primary storage. [2025-10-14T22:40:30.445403] [INFO ] [MAIN ] MOD: Loaded 44823 primary data records. [2025-10-14T22:40:30.668840] [DEBUG] [LOCAL ] MODG: Loaded 51587 existing records from primary storage. [2025-10-14T22:40:30.778337] [INFO ] [MAIN ] MODG: Loaded 51587 primary data records. [2025-10-14T22:40:30.876029] [DEBUG] [LOCAL ] MOH: Loaded 42497 existing records from primary storage. [2025-10-14T22:40:30.906161] [INFO ] [MAIN ] MOH: Loaded 42497 primary data records. [2025-10-14T22:40:31.470219] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:31.471946] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 44823 primary records. [2025-10-14T22:40:31.472506] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-14T22:40:31.490906] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-14T22:40:31.491117] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-14T22:40:31.493413] [INFO ] [MAIN ] Derivative Progress: 1195/1812 symbols completed. MOD took 1.1s. Estimated remaining: 3m 55s. Rate: 157.7 symbols/min [2025-10-14T22:40:31.493764] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:31.513075] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:31.514170] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51587 primary records. [2025-10-14T22:40:31.514478] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-14T22:40:31.534600] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-14T22:40:31.534901] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-14T22:40:31.537022] [INFO ] [MAIN ] Derivative Progress: 1196/1812 symbols completed. MODG took 1.1s. Estimated remaining: 3m 54s. Rate: 157.8 symbols/min [2025-10-14T22:40:31.537312] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:31.551174] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:31.551970] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 42497 primary records. [2025-10-14T22:40:31.552151] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-14T22:40:31.586512] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-14T22:40:31.587352] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-14T22:40:31.596317] [INFO ] [MAIN ] Derivative Progress: 1197/1812 symbols completed. MOH took 1.2s. Estimated remaining: 3m 54s. Rate: 157.9 symbols/min [2025-10-14T22:40:31.596601] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:31.612153] [DEBUG] [LOCAL ] MOV: Loaded 21725 existing records from primary storage. [2025-10-14T22:40:31.612325] [INFO ] [MAIN ] MOV: Loaded 21725 primary data records. [2025-10-14T22:40:31.613063] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-10-14T22:40:31.624982] [INFO ] [MAIN ] MOS: Loaded 53506 primary data records. [2025-10-14T22:40:32.243631] [DEBUG] [LOCAL ] MP: Loaded 53720 existing records from primary storage. [2025-10-14T22:40:32.245249] [INFO ] [MAIN ] MP: Loaded 53720 primary data records. [2025-10-14T22:40:32.574057] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:32.576474] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21725 primary records. [2025-10-14T22:40:32.577670] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-14T22:40:32.598756] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:32.606175] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53506 primary records. [2025-10-14T22:40:32.606790] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-14T22:40:32.609229] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-14T22:40:32.616541] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-14T22:40:32.619036] [INFO ] [MAIN ] Derivative Progress: 1198/1812 symbols completed. MOV took 1.1s. Estimated remaining: 3m 54s. Rate: 157.7 symbols/min [2025-10-14T22:40:32.629885] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-14T22:40:32.629999] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-14T22:40:32.632773] [INFO ] [MAIN ] Derivative Progress: 1199/1812 symbols completed. MOS took 1.1s. Estimated remaining: 3m 53s. Rate: 157.8 symbols/min [2025-10-14T22:40:32.648934] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:32.649599] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53720 primary records. [2025-10-14T22:40:32.649684] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-14T22:40:32.664764] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-14T22:40:32.664824] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-14T22:40:32.666920] [INFO ] [MAIN ] Derivative Progress: 1200/1812 symbols completed. MP took 1.1s. Estimated remaining: 3m 53s. Rate: 157.9 symbols/min [2025-10-14T22:40:32.667392] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:32.667503] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:32.667317] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:32.676132] [DEBUG] [LOCAL ] MPV: Loaded 4759 existing records from primary storage. [2025-10-14T22:40:32.676325] [INFO ] [MAIN ] MPV: Loaded 4759 primary data records. [2025-10-14T22:40:32.700408] [DEBUG] [LOCAL ] MPA: Loaded 5354 existing records from primary storage. [2025-10-14T22:40:32.725287] [INFO ] [MAIN ] MPA: Loaded 5354 primary data records. [2025-10-14T22:40:33.034964] [DEBUG] [LOCAL ] MPLX: Loaded 50755 existing records from primary storage. [2025-10-14T22:40:33.089162] [INFO ] [MAIN ] MPLX: Loaded 50755 primary data records. [2025-10-14T22:40:33.693766] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:33.708040] [INFO ] [MAIN ] MPA: Generated 1793 derivative records from 5354 primary records. [2025-10-14T22:40:33.709173] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-14T22:40:33.708982] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:33.711427] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4759 primary records. [2025-10-14T22:40:33.727332] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-14T22:40:33.749728] [DEBUG] [LOCAL ] MPA: Derivative data saved (1793 records). [2025-10-14T22:40:33.750857] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-14T22:40:33.753325] [INFO ] [MAIN ] Derivative Progress: 1201/1812 symbols completed. MPA took 1.1s. Estimated remaining: 3m 53s. Rate: 157.7 symbols/min [2025-10-14T22:40:33.769986] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:33.769628] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:33.771509] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50755 primary records. [2025-10-14T22:40:33.771972] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-14T22:40:33.774238] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-14T22:40:33.774395] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-14T22:40:33.776704] [INFO ] [MAIN ] Derivative Progress: 1202/1812 symbols completed. MPV took 1.1s. Estimated remaining: 3m 52s. Rate: 157.8 symbols/min [2025-10-14T22:40:33.787983] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:33.798939] [DEBUG] [LOCAL ] MPX: Loaded 4071 existing records from primary storage. [2025-10-14T22:40:33.799329] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-14T22:40:33.799603] [INFO ] [MAIN ] MPX: Loaded 4071 primary data records. [2025-10-14T22:40:33.799544] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-14T22:40:33.822678] [INFO ] [MAIN ] Derivative Progress: 1203/1812 symbols completed. MPLX took 1.2s. Estimated remaining: 3m 51s. Rate: 157.9 symbols/min [2025-10-14T22:40:33.833569] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:33.946496] [DEBUG] [LOCAL ] MQT: Loaded 8306 existing records from primary storage. [2025-10-14T22:40:33.952449] [INFO ] [MAIN ] MQT: Loaded 8306 primary data records. [2025-10-14T22:40:34.059581] [DEBUG] [LOCAL ] MPW: Loaded 53496 existing records from primary storage. [2025-10-14T22:40:34.098439] [INFO ] [MAIN ] MPW: Loaded 53496 primary data records. [2025-10-14T22:40:34.789963] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:34.791523] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4071 primary records. [2025-10-14T22:40:34.791961] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-14T22:40:34.819754] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-10-14T22:40:34.820837] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:34.822830] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-14T22:40:34.822144] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8306 primary records. [2025-10-14T22:40:34.823034] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-14T22:40:34.826072] [INFO ] [MAIN ] Derivative Progress: 1204/1812 symbols completed. MPX took 1.0s. Estimated remaining: 3m 51s. Rate: 157.7 symbols/min [2025-10-14T22:40:34.840199] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:34.850073] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:34.851408] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53496 primary records. [2025-10-14T22:40:34.851854] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-14T22:40:34.870963] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-14T22:40:34.872113] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-14T22:40:34.874804] [INFO ] [MAIN ] Derivative Progress: 1205/1812 symbols completed. MQT took 1.0s. Estimated remaining: 3m 51s. Rate: 157.8 symbols/min [2025-10-14T22:40:34.879428] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-10-14T22:40:34.879583] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:34.879728] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-14T22:40:34.880288] [DEBUG] [LOCAL ] MSB: Loaded 7777 existing records from primary storage. [2025-10-14T22:40:34.882486] [INFO ] [MAIN ] Derivative Progress: 1206/1812 symbols completed. MPW took 1.1s. Estimated remaining: 3m 50s. Rate: 157.9 symbols/min [2025-10-14T22:40:34.882812] [INFO ] [MAIN ] MSB: Loaded 7777 primary data records. [2025-10-14T22:40:34.882742] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:35.067614] [DEBUG] [LOCAL ] MSD: Loaded 16509 existing records from primary storage. [2025-10-14T22:40:35.087760] [DEBUG] [LOCAL ] MTD: Loaded 15443 existing records from primary storage. [2025-10-14T22:40:35.087899] [INFO ] [MAIN ] MSD: Loaded 16509 primary data records. [2025-10-14T22:40:35.114453] [INFO ] [MAIN ] MTD: Loaded 15443 primary data records. [2025-10-14T22:40:35.844331] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:35.845957] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7777 primary records. [2025-10-14T22:40:35.846210] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-14T22:40:35.862334] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-10-14T22:40:35.862541] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-14T22:40:35.864729] [INFO ] [MAIN ] Derivative Progress: 1207/1812 symbols completed. MSB took 1.0s. Estimated remaining: 3m 50s. Rate: 157.7 symbols/min [2025-10-14T22:40:35.866059] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:35.882684] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:35.883379] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16509 primary records. [2025-10-14T22:40:35.886103] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-14T22:40:35.901589] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-14T22:40:35.906913] [DEBUG] [LOCAL ] MUE: Loaded 11872 existing records from primary storage. [2025-10-14T22:40:35.901789] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-14T22:40:35.910069] [INFO ] [MAIN ] Derivative Progress: 1208/1812 symbols completed. MSD took 1.0s. Estimated remaining: 3m 50s. Rate: 157.8 symbols/min [2025-10-14T22:40:35.907069] [INFO ] [MAIN ] MUE: Loaded 11872 primary data records. [2025-10-14T22:40:35.911190] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:35.970876] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:36.001773] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15443 primary records. [2025-10-14T22:40:36.028532] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-14T22:40:36.101248] [DEBUG] [LOCAL ] MVF: Loaded 12789 existing records from primary storage. [2025-10-14T22:40:36.115633] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-10-14T22:40:36.141303] [INFO ] [MAIN ] MVF: Loaded 12789 primary data records. [2025-10-14T22:40:36.159287] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-14T22:40:36.181088] [INFO ] [MAIN ] Derivative Progress: 1209/1812 symbols completed. MTD took 1.3s. Estimated remaining: 3m 49s. Rate: 157.9 symbols/min [2025-10-14T22:40:36.186347] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:36.402460] [DEBUG] [LOCAL ] MVO: Loaded 8805 existing records from primary storage. [2025-10-14T22:40:36.451520] [INFO ] [MAIN ] MVO: Loaded 8805 primary data records. [2025-10-14T22:40:36.924605] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:36.926195] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11872 primary records. [2025-10-14T22:40:36.926659] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-14T22:40:36.947278] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-14T22:40:36.947755] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-14T22:40:36.957635] [INFO ] [MAIN ] Derivative Progress: 1210/1812 symbols completed. MUE took 1.1s. Estimated remaining: 3m 49s. Rate: 157.7 symbols/min [2025-10-14T22:40:36.962784] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:36.964184] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:36.965256] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12789 primary records. [2025-10-14T22:40:36.965554] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-14T22:40:36.983929] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-14T22:40:36.988222] [DEBUG] [LOCAL ] MVT: Loaded 10023 existing records from primary storage. [2025-10-14T22:40:36.988325] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-14T22:40:36.991478] [INFO ] [MAIN ] Derivative Progress: 1211/1812 symbols completed. MVF took 1.1s. Estimated remaining: 3m 48s. Rate: 157.9 symbols/min [2025-10-14T22:40:36.988415] [INFO ] [MAIN ] MVT: Loaded 10023 primary data records. [2025-10-14T22:40:37.002916] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:37.083238] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:37.115624] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 8805 primary records. [2025-10-14T22:40:37.115818] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-14T22:40:37.191602] [DEBUG] [LOCAL ] MX: Loaded 22352 existing records from primary storage. [2025-10-14T22:40:37.296951] [INFO ] [MAIN ] MX: Loaded 22352 primary data records. [2025-10-14T22:40:37.312330] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-10-14T22:40:37.347418] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-14T22:40:37.366486] [INFO ] [MAIN ] Derivative Progress: 1212/1812 symbols completed. MVO took 1.2s. Estimated remaining: 3m 48s. Rate: 157.9 symbols/min [2025-10-14T22:40:37.396330] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:37.516449] [DEBUG] [LOCAL ] MYN: Loaded 9799 existing records from primary storage. [2025-10-14T22:40:37.542259] [INFO ] [MAIN ] MYN: Loaded 9799 primary data records. [2025-10-14T22:40:37.981932] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:37.982931] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10023 primary records. [2025-10-14T22:40:37.983175] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-14T22:40:38.002718] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-14T22:40:38.003834] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-14T22:40:38.006295] [INFO ] [MAIN ] Derivative Progress: 1213/1812 symbols completed. MVT took 1.0s. Estimated remaining: 3m 48s. Rate: 157.8 symbols/min [2025-10-14T22:40:38.024581] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:38.025281] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22352 primary records. [2025-10-14T22:40:38.025426] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-14T22:40:38.055430] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-10-14T22:40:38.055524] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-14T22:40:38.055374] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:38.058256] [INFO ] [MAIN ] Derivative Progress: 1214/1812 symbols completed. MX took 1.1s. Estimated remaining: 3m 47s. Rate: 157.9 symbols/min [2025-10-14T22:40:38.058993] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9799 primary records. [2025-10-14T22:40:38.059212] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-14T22:40:38.073455] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-14T22:40:38.073543] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-14T22:40:38.075909] [INFO ] [MAIN ] Derivative Progress: 1215/1812 symbols completed. MYN took 0.7s. Estimated remaining: 3m 47s. Rate: 158.0 symbols/min [2025-10-14T22:40:38.076299] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:38.076414] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:38.076475] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:38.082335] [DEBUG] [LOCAL ] NAZ: Loaded 2657 existing records from primary storage. [2025-10-14T22:40:38.084772] [INFO ] [MAIN ] NAZ: Loaded 2657 primary data records. [2025-10-14T22:40:38.158267] [DEBUG] [LOCAL ] NBB: Loaded 9084 existing records from primary storage. [2025-10-14T22:40:38.188669] [INFO ] [MAIN ] NBB: Loaded 9084 primary data records. [2025-10-14T22:40:38.747207] [DEBUG] [LOCAL ] NAT: Loaded 49216 existing records from primary storage. [2025-10-14T22:40:38.757510] [INFO ] [MAIN ] NAT: Loaded 49216 primary data records. [2025-10-14T22:40:39.089086] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:39.090303] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2657 primary records. [2025-10-14T22:40:39.091626] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-14T22:40:39.117450] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-14T22:40:39.124250] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-14T22:40:39.127409] [INFO ] [MAIN ] Derivative Progress: 1216/1812 symbols completed. NAZ took 1.1s. Estimated remaining: 3m 47s. Rate: 157.8 symbols/min [2025-10-14T22:40:39.127922] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:39.128586] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:39.129399] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9084 primary records. [2025-10-14T22:40:39.129630] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-14T22:40:39.147469] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-14T22:40:39.149278] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-14T22:40:39.151563] [INFO ] [MAIN ] Derivative Progress: 1217/1812 symbols completed. NBB took 1.1s. Estimated remaining: 3m 46s. Rate: 157.9 symbols/min [2025-10-14T22:40:39.151857] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:39.154216] [DEBUG] [LOCAL ] NC: Loaded 1957 existing records from primary storage. [2025-10-14T22:40:39.171931] [INFO ] [MAIN ] NC: Loaded 1957 primary data records. [2025-10-14T22:40:39.172212] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:39.184268] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49216 primary records. [2025-10-14T22:40:39.184407] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-14T22:40:39.297554] [DEBUG] [LOCAL ] NCA: Loaded 10006 existing records from primary storage. [2025-10-14T22:40:39.298223] [INFO ] [MAIN ] NCA: Loaded 10006 primary data records. [2025-10-14T22:40:39.402301] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-10-14T22:40:39.409672] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-14T22:40:39.412718] [INFO ] [MAIN ] Derivative Progress: 1218/1812 symbols completed. NAT took 1.3s. Estimated remaining: 3m 46s. Rate: 157.9 symbols/min [2025-10-14T22:40:39.428577] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:39.799560] [DEBUG] [LOCAL ] NCV: Loaded 13971 existing records from primary storage. [2025-10-14T22:40:39.800096] [INFO ] [MAIN ] NCV: Loaded 13971 primary data records. [2025-10-14T22:40:40.126592] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:40.128790] [INFO ] [MAIN ] NC: Generated 1793 derivative records from 1957 primary records. [2025-10-14T22:40:40.129628] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-14T22:40:40.156203] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:40.157484] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10006 primary records. [2025-10-14T22:40:40.158081] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-14T22:40:40.168861] [DEBUG] [LOCAL ] NC: Derivative data saved (1793 records). [2025-10-14T22:40:40.169097] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-14T22:40:40.171284] [INFO ] [MAIN ] Derivative Progress: 1219/1812 symbols completed. NC took 1.0s. Estimated remaining: 3m 45s. Rate: 157.8 symbols/min [2025-10-14T22:40:40.174724] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:40.180260] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-14T22:40:40.180814] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-14T22:40:40.187196] [INFO ] [MAIN ] Derivative Progress: 1220/1812 symbols completed. NCA took 1.0s. Estimated remaining: 3m 45s. Rate: 157.9 symbols/min [2025-10-14T22:40:40.187515] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:40.200792] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:40.206345] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13971 primary records. [2025-10-14T22:40:40.206764] [DEBUG] [LOCAL ] NCZ: Loaded 12381 existing records from primary storage. [2025-10-14T22:40:40.206968] [INFO ] [MAIN ] NCZ: Loaded 12381 primary data records. [2025-10-14T22:40:40.207067] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-14T22:40:40.415684] [DEBUG] [LOCAL ] NGL: Loaded 29950 existing records from primary storage. [2025-10-14T22:40:40.431959] [INFO ] [MAIN ] NGL: Loaded 29950 primary data records. [2025-10-14T22:40:40.416052] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-14T22:40:40.438178] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-14T22:40:40.440389] [INFO ] [MAIN ] Derivative Progress: 1221/1812 symbols completed. NCV took 1.0s. Estimated remaining: 3m 44s. Rate: 158.0 symbols/min [2025-10-14T22:40:40.471162] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:40.733975] [DEBUG] [LOCAL ] NGS: Loaded 11198 existing records from primary storage. [2025-10-14T22:40:40.740292] [INFO ] [MAIN ] NGS: Loaded 11198 primary data records. [2025-10-14T22:40:41.277796] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:41.278891] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12381 primary records. [2025-10-14T22:40:41.279104] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-14T22:40:41.301132] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-14T22:40:41.303025] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-14T22:40:41.306010] [INFO ] [MAIN ] Derivative Progress: 1222/1812 symbols completed. NCZ took 1.1s. Estimated remaining: 3m 44s. Rate: 157.8 symbols/min [2025-10-14T22:40:41.306314] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:41.326217] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:41.326954] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 29950 primary records. [2025-10-14T22:40:41.327286] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-14T22:40:41.352615] [DEBUG] [LOCAL ] NIE: Loaded 11926 existing records from primary storage. [2025-10-14T22:40:41.353595] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-10-14T22:40:41.353923] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-14T22:40:41.353834] [INFO ] [MAIN ] NIE: Loaded 11926 primary data records. [2025-10-14T22:40:41.356340] [INFO ] [MAIN ] Derivative Progress: 1223/1812 symbols completed. NGL took 1.2s. Estimated remaining: 3m 44s. Rate: 157.9 symbols/min [2025-10-14T22:40:41.405943] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:41.425898] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:41.447512] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11198 primary records. [2025-10-14T22:40:41.452850] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-14T22:40:41.495585] [DEBUG] [LOCAL ] NIM: Loaded 3542 existing records from primary storage. [2025-10-14T22:40:41.556704] [INFO ] [MAIN ] NIM: Loaded 3542 primary data records. [2025-10-14T22:40:41.784464] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-10-14T22:40:41.784811] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-14T22:40:41.791101] [INFO ] [MAIN ] Derivative Progress: 1224/1812 symbols completed. NGS took 1.3s. Estimated remaining: 3m 43s. Rate: 157.9 symbols/min [2025-10-14T22:40:41.792191] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:42.007216] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:42.015458] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11926 primary records. [2025-10-14T22:40:42.015839] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-14T22:40:42.038797] [DEBUG] [LOCAL ] NINE: Loaded 28294 existing records from primary storage. [2025-10-14T22:40:42.039526] [INFO ] [MAIN ] NINE: Loaded 28294 primary data records. [2025-10-14T22:40:42.086214] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-14T22:40:42.113128] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-14T22:40:42.127447] [INFO ] [MAIN ] Derivative Progress: 1225/1812 symbols completed. NIE took 0.8s. Estimated remaining: 3m 43s. Rate: 157.9 symbols/min [2025-10-14T22:40:42.132767] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:42.187628] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:42.214823] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 3542 primary records. [2025-10-14T22:40:42.347264] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-14T22:40:42.370817] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-14T22:40:42.372075] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-14T22:40:42.375076] [INFO ] [MAIN ] Derivative Progress: 1226/1812 symbols completed. NIM took 1.0s. Estimated remaining: 3m 43s. Rate: 158.0 symbols/min [2025-10-14T22:40:42.389021] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:42.420330] [DEBUG] [LOCAL ] NKX: Loaded 13596 existing records from primary storage. [2025-10-14T22:40:42.432835] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:42.432551] [INFO ] [MAIN ] NKX: Loaded 13596 primary data records. [2025-10-14T22:40:42.433516] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28294 primary records. [2025-10-14T22:40:42.434574] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-14T22:40:42.434783] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-14T22:40:42.434857] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-14T22:40:42.684052] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-10-14T22:40:42.713214] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-14T22:40:42.750047] [INFO ] [MAIN ] Derivative Progress: 1227/1812 symbols completed. NINE took 1.0s. Estimated remaining: 3m 42s. Rate: 158.0 symbols/min [2025-10-14T22:40:42.892168] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:43.077552] [DEBUG] [LOCAL ] NMAI: Loaded 12852 existing records from primary storage. [2025-10-14T22:40:43.077997] [INFO ] [MAIN ] NMAI: Loaded 12852 primary data records. [2025-10-14T22:40:43.301361] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:43.309383] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13596 primary records. [2025-10-14T22:40:43.434269] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-14T22:40:43.469313] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:43.472234] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-10-14T22:40:43.472328] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-14T22:40:43.474617] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-14T22:40:43.482309] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-14T22:40:43.488807] [INFO ] [MAIN ] Derivative Progress: 1228/1812 symbols completed. NKX took 1.1s. Estimated remaining: 3m 42s. Rate: 157.9 symbols/min [2025-10-14T22:40:43.494501] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-10-14T22:40:43.494740] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-14T22:40:43.497158] [INFO ] [MAIN ] Derivative Progress: 1229/1812 symbols completed. NIO took 1.4s. Estimated remaining: 3m 41s. Rate: 158.0 symbols/min [2025-10-14T22:40:43.513747] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:43.514306] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12852 primary records. [2025-10-14T22:40:43.514367] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-14T22:40:43.529943] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-10-14T22:40:43.530018] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-14T22:40:43.532213] [INFO ] [MAIN ] Derivative Progress: 1230/1812 symbols completed. NMAI took 0.6s. Estimated remaining: 3m 41s. Rate: 158.1 symbols/min [2025-10-14T22:40:43.532573] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:43.533099] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:43.532891] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:43.540931] [DEBUG] [LOCAL ] NMI: Loaded 4060 existing records from primary storage. [2025-10-14T22:40:43.541139] [INFO ] [MAIN ] NMI: Loaded 4060 primary data records. [2025-10-14T22:40:43.653929] [DEBUG] [LOCAL ] NMG: Loaded 10296 existing records from primary storage. [2025-10-14T22:40:43.674109] [INFO ] [MAIN ] NMG: Loaded 10296 primary data records. [2025-10-14T22:40:43.831118] [DEBUG] [LOCAL ] NMR: Loaded 35529 existing records from primary storage. [2025-10-14T22:40:43.870502] [INFO ] [MAIN ] NMR: Loaded 35529 primary data records. [2025-10-14T22:40:44.547461] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:44.548272] [INFO ] [MAIN ] NMI: Generated 1793 derivative records from 4060 primary records. [2025-10-14T22:40:44.548360] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-14T22:40:44.579569] [DEBUG] [LOCAL ] NMI: Derivative data saved (1793 records). [2025-10-14T22:40:44.579804] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:44.580764] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-14T22:40:44.582690] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 10296 primary records. [2025-10-14T22:40:44.585678] [INFO ] [MAIN ] Derivative Progress: 1231/1812 symbols completed. NMI took 1.1s. Estimated remaining: 3m 41s. Rate: 157.9 symbols/min [2025-10-14T22:40:44.593548] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:44.585877] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-14T22:40:44.606968] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:44.609113] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35529 primary records. [2025-10-14T22:40:44.609285] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-14T22:40:44.629605] [DEBUG] [LOCAL ] NMS: Loaded 2907 existing records from primary storage. [2025-10-14T22:40:44.631513] [INFO ] [MAIN ] NMS: Loaded 2907 primary data records. [2025-10-14T22:40:44.653979] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-10-14T22:40:44.670194] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-14T22:40:44.679857] [INFO ] [MAIN ] Derivative Progress: 1232/1812 symbols completed. NMR took 1.1s. Estimated remaining: 3m 40s. Rate: 158.0 symbols/min [2025-10-14T22:40:44.692487] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:44.709479] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-10-14T22:40:44.730245] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-14T22:40:44.739111] [INFO ] [MAIN ] Derivative Progress: 1233/1812 symbols completed. NMG took 1.2s. Estimated remaining: 3m 40s. Rate: 158.1 symbols/min [2025-10-14T22:40:44.751883] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:44.752239] [DEBUG] [LOCAL ] NMT: Loaded 2829 existing records from primary storage. [2025-10-14T22:40:44.768858] [INFO ] [MAIN ] NMT: Loaded 2829 primary data records. [2025-10-14T22:40:45.049440] [DEBUG] [LOCAL ] NNI: Loaded 10427 existing records from primary storage. [2025-10-14T22:40:45.053438] [INFO ] [MAIN ] NNI: Loaded 10427 primary data records. [2025-10-14T22:40:45.579349] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:45.580510] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2907 primary records. [2025-10-14T22:40:45.580778] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-14T22:40:45.611256] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-10-14T22:40:45.611345] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-14T22:40:45.611188] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:45.614376] [INFO ] [MAIN ] NMT: Generated 1793 derivative records from 2829 primary records. [2025-10-14T22:40:45.613538] [INFO ] [MAIN ] Derivative Progress: 1234/1812 symbols completed. NMS took 1.0s. Estimated remaining: 3m 40s. Rate: 157.9 symbols/min [2025-10-14T22:40:45.614570] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-14T22:40:45.615667] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:45.646956] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:45.650407] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10427 primary records. [2025-10-14T22:40:45.641790] [DEBUG] [LOCAL ] NMT: Derivative data saved (1793 records). [2025-10-14T22:40:45.650722] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-14T22:40:45.650609] [DEBUG] [LOCAL ] NNY: Loaded 5641 existing records from primary storage. [2025-10-14T22:40:45.651709] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-14T22:40:45.661099] [INFO ] [MAIN ] Derivative Progress: 1235/1812 symbols completed. NMT took 1.0s. Estimated remaining: 3m 39s. Rate: 158.0 symbols/min [2025-10-14T22:40:45.661252] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:45.651461] [INFO ] [MAIN ] NNY: Loaded 5641 primary data records. [2025-10-14T22:40:45.772825] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-10-14T22:40:45.778414] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-14T22:40:45.791879] [INFO ] [MAIN ] Derivative Progress: 1236/1812 symbols completed. NNI took 1.0s. Estimated remaining: 3m 39s. Rate: 158.1 symbols/min [2025-10-14T22:40:45.814808] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:45.998508] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-14T22:40:46.006988] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-14T22:40:46.135274] [DEBUG] [LOCAL ] NOTE: Loaded 40495 existing records from primary storage. [2025-10-14T22:40:46.156860] [INFO ] [MAIN ] NOTE: Loaded 40495 primary data records. [2025-10-14T22:40:46.485471] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:46.486690] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5641 primary records. [2025-10-14T22:40:46.497462] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-14T22:40:46.696958] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-14T22:40:46.697183] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-14T22:40:46.699421] [INFO ] [MAIN ] Derivative Progress: 1237/1812 symbols completed. NNY took 1.1s. Estimated remaining: 3m 38s. Rate: 157.9 symbols/min [2025-10-14T22:40:46.700262] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:46.727015] [DEBUG] [LOCAL ] NPFD: Loaded 10015 existing records from primary storage. [2025-10-14T22:40:46.726687] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:46.727350] [INFO ] [MAIN ] NPFD: Loaded 10015 primary data records. [2025-10-14T22:40:46.728042] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53622 primary records. [2025-10-14T22:40:46.739354] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-14T22:40:46.838021] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-10-14T22:40:46.845800] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-14T22:40:46.851270] [INFO ] [MAIN ] Derivative Progress: 1238/1812 symbols completed. NOK took 1.2s. Estimated remaining: 3m 38s. Rate: 158.0 symbols/min [2025-10-14T22:40:46.851973] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:47.069294] [DEBUG] [LOCAL ] NPK: Loaded 8333 existing records from primary storage. [2025-10-14T22:40:47.072112] [INFO ] [MAIN ] NPK: Loaded 8333 primary data records. [2025-10-14T22:40:47.072533] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:47.106957] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 40495 primary records. [2025-10-14T22:40:47.134007] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-14T22:40:47.220858] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-10-14T22:40:47.226268] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-14T22:40:47.229713] [INFO ] [MAIN ] Derivative Progress: 1239/1812 symbols completed. NOTE took 1.4s. Estimated remaining: 3m 38s. Rate: 158.0 symbols/min [2025-10-14T22:40:47.251320] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:47.417283] [DEBUG] [LOCAL ] NPV: Loaded 5319 existing records from primary storage. [2025-10-14T22:40:47.418507] [INFO ] [MAIN ] NPV: Loaded 5319 primary data records. [2025-10-14T22:40:47.417614] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:47.430767] [INFO ] [MAIN ] NPFD: Generated 1793 derivative records from 10015 primary records. [2025-10-14T22:40:47.451549] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-14T22:40:47.563322] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1793 records). [2025-10-14T22:40:47.581717] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-14T22:40:47.592855] [INFO ] [MAIN ] Derivative Progress: 1240/1812 symbols completed. NPFD took 0.9s. Estimated remaining: 3m 37s. Rate: 158.0 symbols/min [2025-10-14T22:40:47.618252] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:47.751266] [DEBUG] [LOCAL ] NQP: Loaded 9239 existing records from primary storage. [2025-10-14T22:40:47.752000] [INFO ] [MAIN ] NQP: Loaded 9239 primary data records. [2025-10-14T22:40:47.802981] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:47.822359] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8333 primary records. [2025-10-14T22:40:47.839487] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-14T22:40:47.973739] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-10-14T22:40:47.973868] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-14T22:40:47.976368] [INFO ] [MAIN ] Derivative Progress: 1241/1812 symbols completed. NPK took 1.1s. Estimated remaining: 3m 37s. Rate: 158.0 symbols/min [2025-10-14T22:40:48.088504] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:48.108199] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:48.109383] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5319 primary records. [2025-10-14T22:40:48.109580] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-14T22:40:48.135638] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-14T22:40:48.135983] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-14T22:40:48.138554] [INFO ] [MAIN ] Derivative Progress: 1242/1812 symbols completed. NPV took 0.9s. Estimated remaining: 3m 36s. Rate: 158.1 symbols/min [2025-10-14T22:40:48.138856] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:48.150927] [DEBUG] [LOCAL ] NRDY: Loaded 32673 existing records from primary storage. [2025-10-14T22:40:48.152852] [INFO ] [MAIN ] NRDY: Loaded 32673 primary data records. [2025-10-14T22:40:48.267189] [DEBUG] [LOCAL ] NREF: Loaded 8027 existing records from primary storage. [2025-10-14T22:40:48.274969] [INFO ] [MAIN ] NREF: Loaded 8027 primary data records. [2025-10-14T22:40:48.250256] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:48.312054] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9239 primary records. [2025-10-14T22:40:48.312248] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-14T22:40:48.636258] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-14T22:40:48.674719] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-14T22:40:48.677165] [INFO ] [MAIN ] Derivative Progress: 1243/1812 symbols completed. NQP took 1.1s. Estimated remaining: 3m 36s. Rate: 158.0 symbols/min [2025-10-14T22:40:48.856461] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:48.857296] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32673 primary records. [2025-10-14T22:40:48.857487] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-14T22:40:48.877337] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-10-14T22:40:48.889982] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-14T22:40:48.892373] [INFO ] [MAIN ] Derivative Progress: 1244/1812 symbols completed. NRDY took 0.8s. Estimated remaining: 3m 36s. Rate: 158.1 symbols/min [2025-10-14T22:40:48.890192] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:48.893233] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 8027 primary records. [2025-10-14T22:40:48.893308] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-14T22:40:48.908710] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-10-14T22:40:48.908839] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-14T22:40:48.910975] [INFO ] [MAIN ] Derivative Progress: 1245/1812 symbols completed. NREF took 0.8s. Estimated remaining: 3m 35s. Rate: 158.2 symbols/min [2025-10-14T22:40:48.911682] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:48.911574] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:48.911923] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:48.921449] [DEBUG] [LOCAL ] NRT: Loaded 4888 existing records from primary storage. [2025-10-14T22:40:48.924785] [INFO ] [MAIN ] NRT: Loaded 4888 primary data records. [2025-10-14T22:40:48.924702] [DEBUG] [LOCAL ] NRP: Loaded 4200 existing records from primary storage. [2025-10-14T22:40:48.946289] [INFO ] [MAIN ] NRP: Loaded 4200 primary data records. [2025-10-14T22:40:49.299413] [DEBUG] [LOCAL ] NRGV: Loaded 43667 existing records from primary storage. [2025-10-14T22:40:49.562753] [INFO ] [MAIN ] NRGV: Loaded 43667 primary data records. [2025-10-14T22:40:49.914168] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:49.913811] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:49.914995] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4888 primary records. [2025-10-14T22:40:49.915588] [INFO ] [MAIN ] NRP: Generated 1793 derivative records from 4200 primary records. [2025-10-14T22:40:49.915699] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-14T22:40:49.915769] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-14T22:40:49.944337] [DEBUG] [LOCAL ] NRP: Derivative data saved (1793 records). [2025-10-14T22:40:49.945144] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-14T22:40:49.946135] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-10-14T22:40:49.948382] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-14T22:40:49.948162] [INFO ] [MAIN ] Derivative Progress: 1246/1812 symbols completed. NRP took 1.0s. Estimated remaining: 3m 35s. Rate: 158.0 symbols/min [2025-10-14T22:40:49.950728] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:49.950888] [INFO ] [MAIN ] Derivative Progress: 1247/1812 symbols completed. NRT took 1.0s. Estimated remaining: 3m 34s. Rate: 158.1 symbols/min [2025-10-14T22:40:49.951190] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:49.969002] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:49.969741] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43667 primary records. [2025-10-14T22:40:49.969874] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-14T22:40:49.994247] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-10-14T22:40:49.994411] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-14T22:40:49.996797] [INFO ] [MAIN ] Derivative Progress: 1248/1812 symbols completed. NRGV took 1.1s. Estimated remaining: 3m 34s. Rate: 158.2 symbols/min [2025-10-14T22:40:49.997074] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:50.005847] [DEBUG] [LOCAL ] NUV: Loaded 23639 existing records from primary storage. [2025-10-14T22:40:50.005951] [INFO ] [MAIN ] NUV: Loaded 23639 primary data records. [2025-10-14T22:40:50.123129] [DEBUG] [LOCAL ] NUW: Loaded 6802 existing records from primary storage. [2025-10-14T22:40:50.126790] [INFO ] [MAIN ] NUW: Loaded 6802 primary data records. [2025-10-14T22:40:50.316368] [DEBUG] [LOCAL ] NUVB: Loaded 51542 existing records from primary storage. [2025-10-14T22:40:50.451718] [INFO ] [MAIN ] NUVB: Loaded 51542 primary data records. [2025-10-14T22:40:50.971971] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:50.974199] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23639 primary records. [2025-10-14T22:40:50.974453] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-14T22:40:50.991826] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-14T22:40:50.994830] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-14T22:40:50.997157] [INFO ] [MAIN ] Derivative Progress: 1249/1812 symbols completed. NUV took 1.0s. Estimated remaining: 3m 34s. Rate: 158.0 symbols/min [2025-10-14T22:40:50.997743] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:51.011672] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:51.012998] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 6802 primary records. [2025-10-14T22:40:51.013149] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-14T22:40:51.049251] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:51.051102] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51542 primary records. [2025-10-14T22:40:51.051592] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-14T22:40:51.052343] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-14T22:40:51.052601] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-14T22:40:51.062507] [INFO ] [MAIN ] Derivative Progress: 1250/1812 symbols completed. NUW took 1.1s. Estimated remaining: 3m 33s. Rate: 158.1 symbols/min [2025-10-14T22:40:51.071295] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:51.074239] [DEBUG] [LOCAL ] NVR: Loaded 18538 existing records from primary storage. [2025-10-14T22:40:51.075374] [INFO ] [MAIN ] NVR: Loaded 18538 primary data records. [2025-10-14T22:40:51.117136] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-10-14T22:40:51.162306] [DEBUG] [LOCAL ] NXC: Loaded 4141 existing records from primary storage. [2025-10-14T22:40:51.146752] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-14T22:40:51.169725] [INFO ] [MAIN ] NXC: Loaded 4141 primary data records. [2025-10-14T22:40:51.169579] [INFO ] [MAIN ] Derivative Progress: 1251/1812 symbols completed. NUVB took 1.2s. Estimated remaining: 3m 33s. Rate: 158.2 symbols/min [2025-10-14T22:40:51.201906] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:51.504676] [DEBUG] [LOCAL ] NXDT: Loaded 14998 existing records from primary storage. [2025-10-14T22:40:51.510841] [INFO ] [MAIN ] NXDT: Loaded 14998 primary data records. [2025-10-14T22:40:52.069742] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:52.072132] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 18538 primary records. [2025-10-14T22:40:52.072612] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-14T22:40:52.092177] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-10-14T22:40:52.092530] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-14T22:40:52.107688] [INFO ] [MAIN ] Derivative Progress: 1252/1812 symbols completed. NVR took 1.1s. Estimated remaining: 3m 33s. Rate: 158.0 symbols/min [2025-10-14T22:40:52.108173] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:52.110422] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4141 primary records. [2025-10-14T22:40:52.110537] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:52.111709] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-14T22:40:52.140792] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:52.143067] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-14T22:40:52.144228] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-14T22:40:52.143907] [INFO ] [MAIN ] NXDT: Generated 1793 derivative records from 14998 primary records. [2025-10-14T22:40:52.147102] [INFO ] [MAIN ] Derivative Progress: 1253/1812 symbols completed. NXC took 1.1s. Estimated remaining: 3m 32s. Rate: 158.1 symbols/min [2025-10-14T22:40:52.147465] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-14T22:40:52.148424] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:52.185191] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1793 records). [2025-10-14T22:40:52.190752] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-14T22:40:52.190491] [DEBUG] [LOCAL ] NXG: Loaded 10498 existing records from primary storage. [2025-10-14T22:40:52.193124] [INFO ] [MAIN ] Derivative Progress: 1254/1812 symbols completed. NXDT took 1.0s. Estimated remaining: 3m 32s. Rate: 158.2 symbols/min [2025-10-14T22:40:52.193638] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:52.193525] [INFO ] [MAIN ] NXG: Loaded 10498 primary data records. [2025-10-14T22:40:52.285094] [DEBUG] [LOCAL ] NXN: Loaded 2256 existing records from primary storage. [2025-10-14T22:40:52.309585] [DEBUG] [LOCAL ] NXE: Loaded 53032 existing records from primary storage. [2025-10-14T22:40:52.330516] [INFO ] [MAIN ] NXN: Loaded 2256 primary data records. [2025-10-14T22:40:52.330452] [INFO ] [MAIN ] NXE: Loaded 53032 primary data records. [2025-10-14T22:40:53.167668] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:53.168817] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10498 primary records. [2025-10-14T22:40:53.169749] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-14T22:40:53.200307] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:53.214348] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-14T22:40:53.215449] [INFO ] [MAIN ] NXN: Generated 1789 derivative records from 2256 primary records. [2025-10-14T22:40:53.215542] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-14T22:40:53.216944] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-10-14T22:40:53.213817] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 53032 primary records. [2025-10-14T22:40:53.217372] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-14T22:40:53.217311] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-14T22:40:53.219471] [INFO ] [MAIN ] Derivative Progress: 1255/1812 symbols completed. NXG took 1.1s. Estimated remaining: 3m 31s. Rate: 158.0 symbols/min [2025-10-14T22:40:53.226249] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:53.247540] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-10-14T22:40:53.250223] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-14T22:40:53.252738] [INFO ] [MAIN ] Derivative Progress: 1256/1812 symbols completed. NXE took 1.1s. Estimated remaining: 3m 31s. Rate: 158.1 symbols/min [2025-10-14T22:40:53.256254] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:53.256139] [DEBUG] [LOCAL ] NXN: Derivative data saved (1789 records). [2025-10-14T22:40:53.256546] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-14T22:40:53.258565] [INFO ] [MAIN ] Derivative Progress: 1257/1812 symbols completed. NXN took 1.1s. Estimated remaining: 3m 30s. Rate: 158.3 symbols/min [2025-10-14T22:40:53.258983] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:53.265003] [DEBUG] [LOCAL ] NXP: Loaded 12311 existing records from primary storage. [2025-10-14T22:40:53.265149] [INFO ] [MAIN ] NXP: Loaded 12311 primary data records. [2025-10-14T22:40:53.362590] [DEBUG] [LOCAL ] OCFT: Loaded 7476 existing records from primary storage. [2025-10-14T22:40:53.382933] [DEBUG] [LOCAL ] ODC: Loaded 8510 existing records from primary storage. [2025-10-14T22:40:53.383075] [INFO ] [MAIN ] ODC: Loaded 8510 primary data records. [2025-10-14T22:40:53.383168] [INFO ] [MAIN ] OCFT: Loaded 7476 primary data records. [2025-10-14T22:40:54.253239] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:54.254876] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12311 primary records. [2025-10-14T22:40:54.255753] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-14T22:40:54.280714] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:54.283151] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 7476 primary records. [2025-10-14T22:40:54.286412] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-14T22:40:54.295299] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-14T22:40:54.301561] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-14T22:40:54.304256] [INFO ] [MAIN ] Derivative Progress: 1258/1812 symbols completed. NXP took 1.1s. Estimated remaining: 3m 30s. Rate: 158.0 symbols/min [2025-10-14T22:40:54.304905] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-10-14T22:40:54.305011] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-14T22:40:54.319917] [INFO ] [MAIN ] Derivative Progress: 1259/1812 symbols completed. OCFT took 1.1s. Estimated remaining: 3m 30s. Rate: 158.2 symbols/min [2025-10-14T22:40:54.320462] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:54.321239] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8510 primary records. [2025-10-14T22:40:54.321392] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-14T22:40:54.336288] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-10-14T22:40:54.336387] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-14T22:40:54.338525] [INFO ] [MAIN ] Derivative Progress: 1260/1812 symbols completed. ODC took 1.1s. Estimated remaining: 3m 29s. Rate: 158.3 symbols/min [2025-10-14T22:40:54.339078] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:54.339025] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:54.339204] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:54.354587] [DEBUG] [LOCAL ] OIA: Loaded 13151 existing records from primary storage. [2025-10-14T22:40:54.354952] [INFO ] [MAIN ] OIA: Loaded 13151 primary data records. [2025-10-14T22:40:54.554605] [DEBUG] [LOCAL ] OIS: Loaded 40014 existing records from primary storage. [2025-10-14T22:40:54.591593] [INFO ] [MAIN ] OIS: Loaded 40014 primary data records. [2025-10-14T22:40:54.592042] [DEBUG] [LOCAL ] ODV: Loaded 28719 existing records from primary storage. [2025-10-14T22:40:54.705238] [INFO ] [MAIN ] ODV: Loaded 28719 primary data records. [2025-10-14T22:40:55.352252] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:55.353221] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13151 primary records. [2025-10-14T22:40:55.353311] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-14T22:40:55.372541] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-14T22:40:55.373058] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-14T22:40:55.374979] [INFO ] [MAIN ] Derivative Progress: 1261/1812 symbols completed. OIA took 1.0s. Estimated remaining: 3m 29s. Rate: 158.1 symbols/min [2025-10-14T22:40:55.375422] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:55.395681] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:55.396719] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40014 primary records. [2025-10-14T22:40:55.396846] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-14T22:40:55.414477] [DEBUG] [LOCAL ] OLP: Loaded 10079 existing records from primary storage. [2025-10-14T22:40:55.415233] [INFO ] [MAIN ] OLP: Loaded 10079 primary data records. [2025-10-14T22:40:55.519235] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-10-14T22:40:55.544246] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-14T22:40:55.546684] [INFO ] [MAIN ] Derivative Progress: 1262/1812 symbols completed. OIS took 1.2s. Estimated remaining: 3m 29s. Rate: 158.1 symbols/min [2025-10-14T22:40:55.546834] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:55.547685] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:55.554799] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 28719 primary records. [2025-10-14T22:40:55.560887] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-14T22:40:55.758080] [DEBUG] [LOCAL ] ONIT: Loaded 7643 existing records from primary storage. [2025-10-14T22:40:55.768834] [INFO ] [MAIN ] ONIT: Loaded 7643 primary data records. [2025-10-14T22:40:55.768718] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-10-14T22:40:55.790082] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-14T22:40:55.809224] [INFO ] [MAIN ] Derivative Progress: 1263/1812 symbols completed. ODV took 1.5s. Estimated remaining: 3m 28s. Rate: 158.2 symbols/min [2025-10-14T22:40:55.829194] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:56.121431] [DEBUG] [LOCAL ] ONL: Loaded 29676 existing records from primary storage. [2025-10-14T22:40:56.122002] [INFO ] [MAIN ] ONL: Loaded 29676 primary data records. [2025-10-14T22:40:56.320779] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:56.326912] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 10079 primary records. [2025-10-14T22:40:56.426244] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-14T22:40:56.464994] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-10-14T22:40:56.465226] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-14T22:40:56.478312] [INFO ] [MAIN ] Derivative Progress: 1264/1812 symbols completed. OLP took 1.1s. Estimated remaining: 3m 28s. Rate: 158.1 symbols/min [2025-10-14T22:40:56.485958] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:56.486342] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:56.488597] [INFO ] [MAIN ] ONIT: Generated 1793 derivative records from 7643 primary records. [2025-10-14T22:40:56.488959] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-14T22:40:56.511086] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1793 records). [2025-10-14T22:40:56.516898] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-14T22:40:56.519610] [INFO ] [MAIN ] Derivative Progress: 1265/1812 symbols completed. ONIT took 1.0s. Estimated remaining: 3m 27s. Rate: 158.2 symbols/min [2025-10-14T22:40:56.520768] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:56.544083] [DEBUG] [LOCAL ] ONTF: Loaded 22546 existing records from primary storage. [2025-10-14T22:40:56.543573] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:56.544864] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 29676 primary records. [2025-10-14T22:40:56.544982] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-14T22:40:56.545122] [INFO ] [MAIN ] ONTF: Loaded 22546 primary data records. [2025-10-14T22:40:56.687752] [DEBUG] [LOCAL ] OPAD: Loaded 24780 existing records from primary storage. [2025-10-14T22:40:56.693811] [INFO ] [MAIN ] OPAD: Loaded 24780 primary data records. [2025-10-14T22:40:56.705794] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-10-14T22:40:56.728916] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-14T22:40:56.750050] [INFO ] [MAIN ] Derivative Progress: 1266/1812 symbols completed. ONL took 0.9s. Estimated remaining: 3m 27s. Rate: 158.2 symbols/min [2025-10-14T22:40:56.805771] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:57.089283] [DEBUG] [LOCAL ] OPP: Loaded 12246 existing records from primary storage. [2025-10-14T22:40:57.117100] [INFO ] [MAIN ] OPP: Loaded 12246 primary data records. [2025-10-14T22:40:57.556180] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:57.557765] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22546 primary records. [2025-10-14T22:40:57.558232] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-14T22:40:57.594673] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-10-14T22:40:57.595034] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-14T22:40:57.597563] [INFO ] [MAIN ] Derivative Progress: 1267/1812 symbols completed. ONTF took 1.1s. Estimated remaining: 3m 27s. Rate: 158.1 symbols/min [2025-10-14T22:40:57.597866] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:57.594578] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:57.599072] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 24780 primary records. [2025-10-14T22:40:57.599528] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-14T22:40:57.619732] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-10-14T22:40:57.632603] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-14T22:40:57.635338] [INFO ] [MAIN ] Derivative Progress: 1268/1812 symbols completed. OPAD took 1.1s. Estimated remaining: 3m 26s. Rate: 158.2 symbols/min [2025-10-14T22:40:57.635701] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:57.636719] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 12246 primary records. [2025-10-14T22:40:57.636951] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-14T22:40:57.636839] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:57.653834] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-14T22:40:57.668354] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-14T22:40:57.670528] [INFO ] [MAIN ] Derivative Progress: 1269/1812 symbols completed. OPP took 0.9s. Estimated remaining: 3m 26s. Rate: 158.3 symbols/min [2025-10-14T22:40:57.670778] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:57.682082] [DEBUG] [LOCAL ] OWLT: Loaded 9291 existing records from primary storage. [2025-10-14T22:40:57.682823] [INFO ] [MAIN ] OWLT: Loaded 9291 primary data records. [2025-10-14T22:40:57.779214] [DEBUG] [LOCAL ] ORC: Loaded 52516 existing records from primary storage. [2025-10-14T22:40:57.796260] [INFO ] [MAIN ] ORC: Loaded 52516 primary data records. [2025-10-14T22:40:57.796732] [DEBUG] [LOCAL ] ORN: Loaded 30854 existing records from primary storage. [2025-10-14T22:40:57.807437] [INFO ] [MAIN ] ORN: Loaded 30854 primary data records. [2025-10-14T22:40:58.691506] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:40:58.706147] [INFO ] [MAIN ] OWLT: Generated 1793 derivative records from 9291 primary records. [2025-10-14T22:40:58.706457] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:58.706700] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-14T22:40:58.708297] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52516 primary records. [2025-10-14T22:40:58.709050] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-14T22:40:58.752737] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-10-14T22:40:58.754018] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1793 records). [2025-10-14T22:40:58.753951] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-14T22:40:58.754415] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:58.756552] [INFO ] [MAIN ] Derivative Progress: 1270/1812 symbols completed. ORC took 1.2s. Estimated remaining: 3m 26s. Rate: 158.1 symbols/min [2025-10-14T22:40:58.757589] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 30854 primary records. [2025-10-14T22:40:58.756766] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-14T22:40:58.756907] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:58.760236] [INFO ] [MAIN ] Derivative Progress: 1271/1812 symbols completed. OWLT took 1.1s. Estimated remaining: 3m 25s. Rate: 158.2 symbols/min [2025-10-14T22:40:58.760490] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:58.760627] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-14T22:40:58.776735] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-10-14T22:40:58.777004] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-14T22:40:58.779280] [INFO ] [MAIN ] Derivative Progress: 1272/1812 symbols completed. ORN took 1.1s. Estimated remaining: 3m 25s. Rate: 158.3 symbols/min [2025-10-14T22:40:58.782521] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:58.788774] [DEBUG] [LOCAL ] PAC: Loaded 11692 existing records from primary storage. [2025-10-14T22:40:58.789712] [INFO ] [MAIN ] PAC: Loaded 11692 primary data records. [2025-10-14T22:40:58.842537] [DEBUG] [LOCAL ] PAI: Loaded 2701 existing records from primary storage. [2025-10-14T22:40:58.869366] [INFO ] [MAIN ] PAI: Loaded 2701 primary data records. [2025-10-14T22:40:58.957207] [DEBUG] [LOCAL ] PACK: Loaded 31902 existing records from primary storage. [2025-10-14T22:40:58.993966] [INFO ] [MAIN ] PACK: Loaded 31902 primary data records. [2025-10-14T22:40:59.749612] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:59.750671] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11692 primary records. [2025-10-14T22:40:59.751089] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-14T22:40:59.786717] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-10-14T22:40:59.786863] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-14T22:40:59.786408] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:59.792155] [INFO ] [MAIN ] Derivative Progress: 1273/1812 symbols completed. PAC took 1.0s. Estimated remaining: 3m 25s. Rate: 158.1 symbols/min [2025-10-14T22:40:59.806373] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31902 primary records. [2025-10-14T22:40:59.806896] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-14T22:40:59.807170] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:40:59.807854] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2701 primary records. [2025-10-14T22:40:59.807964] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-14T22:40:59.837508] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-14T22:40:59.839686] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-10-14T22:40:59.839857] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-14T22:40:59.839774] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-14T22:40:59.842172] [INFO ] [MAIN ] Derivative Progress: 1274/1812 symbols completed. PAI took 1.1s. Estimated remaining: 3m 24s. Rate: 158.2 symbols/min [2025-10-14T22:40:59.845058] [INFO ] [MAIN ] Derivative Progress: 1275/1812 symbols completed. PACK took 1.1s. Estimated remaining: 3m 23s. Rate: 158.3 symbols/min [2025-10-14T22:40:59.845569] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:59.846052] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:59.845507] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:40:59.860139] [DEBUG] [LOCAL ] PCM: Loaded 6804 existing records from primary storage. [2025-10-14T22:40:59.860391] [INFO ] [MAIN ] PCM: Loaded 6804 primary data records. [2025-10-14T22:40:59.912000] [DEBUG] [LOCAL ] PCF: Loaded 9078 existing records from primary storage. [2025-10-14T22:40:59.912256] [INFO ] [MAIN ] PCF: Loaded 9078 primary data records. [2025-10-14T22:40:59.945383] [DEBUG] [LOCAL ] PCQ: Loaded 12132 existing records from primary storage. [2025-10-14T22:40:59.957819] [INFO ] [MAIN ] PCQ: Loaded 12132 primary data records. [2025-10-14T22:41:00.858358] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:00.861270] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6804 primary records. [2025-10-14T22:41:00.862304] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-14T22:41:00.877526] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:00.896873] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 9078 primary records. [2025-10-14T22:41:00.898776] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-14T22:41:00.897354] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:00.903370] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12132 primary records. [2025-10-14T22:41:00.903676] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-14T22:41:00.931099] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-14T22:41:00.931670] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-14T22:41:00.933707] [INFO ] [MAIN ] Derivative Progress: 1276/1812 symbols completed. PCM took 1.1s. Estimated remaining: 3m 23s. Rate: 158.1 symbols/min [2025-10-14T22:41:00.937545] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:00.937676] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-14T22:41:00.939035] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-14T22:41:00.942505] [INFO ] [MAIN ] Derivative Progress: 1277/1812 symbols completed. PCQ took 1.1s. Estimated remaining: 3m 23s. Rate: 158.2 symbols/min [2025-10-14T22:41:00.943068] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:00.944997] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-14T22:41:00.945137] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-14T22:41:00.947182] [INFO ] [MAIN ] Derivative Progress: 1278/1812 symbols completed. PCF took 1.1s. Estimated remaining: 3m 22s. Rate: 158.4 symbols/min [2025-10-14T22:41:00.947315] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:00.971008] [DEBUG] [LOCAL ] PDS: Loaded 17289 existing records from primary storage. [2025-10-14T22:41:00.971180] [INFO ] [MAIN ] PDS: Loaded 17289 primary data records. [2025-10-14T22:41:01.011861] [DEBUG] [LOCAL ] PEO: Loaded 11141 existing records from primary storage. [2025-10-14T22:41:01.024508] [INFO ] [MAIN ] PEO: Loaded 11141 primary data records. [2025-10-14T22:41:01.095308] [DEBUG] [LOCAL ] PDT: Loaded 17577 existing records from primary storage. [2025-10-14T22:41:01.115763] [INFO ] [MAIN ] PDT: Loaded 17577 primary data records. [2025-10-14T22:41:02.026482] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:02.027770] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 17289 primary records. [2025-10-14T22:41:02.052103] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-14T22:41:02.053818] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:02.054392] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:02.055436] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11141 primary records. [2025-10-14T22:41:02.063067] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-14T22:41:02.056057] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17577 primary records. [2025-10-14T22:41:02.067031] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-14T22:41:02.081337] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-10-14T22:41:02.088763] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-14T22:41:02.094113] [INFO ] [MAIN ] Derivative Progress: 1279/1812 symbols completed. PDS took 1.2s. Estimated remaining: 3m 22s. Rate: 158.1 symbols/min [2025-10-14T22:41:02.098385] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:02.107713] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-14T22:41:02.107810] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-14T22:41:02.107156] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-14T22:41:02.107977] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-14T22:41:02.110151] [INFO ] [MAIN ] Derivative Progress: 1280/1812 symbols completed. PEO took 1.2s. Estimated remaining: 3m 22s. Rate: 158.2 symbols/min [2025-10-14T22:41:02.110468] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:02.113012] [INFO ] [MAIN ] Derivative Progress: 1281/1812 symbols completed. PDT took 1.2s. Estimated remaining: 3m 21s. Rate: 158.4 symbols/min [2025-10-14T22:41:02.117296] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:02.127350] [DEBUG] [LOCAL ] PERF: Loaded 14374 existing records from primary storage. [2025-10-14T22:41:02.129148] [INFO ] [MAIN ] PERF: Loaded 14374 primary data records. [2025-10-14T22:41:02.183704] [DEBUG] [LOCAL ] PFD: Loaded 5425 existing records from primary storage. [2025-10-14T22:41:02.183945] [DEBUG] [LOCAL ] PFH: Loaded 6751 existing records from primary storage. [2025-10-14T22:41:02.212263] [INFO ] [MAIN ] PFH: Loaded 6751 primary data records. [2025-10-14T22:41:02.205629] [INFO ] [MAIN ] PFD: Loaded 5425 primary data records. [2025-10-14T22:41:03.075993] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:03.090415] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:03.091102] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5425 primary records. [2025-10-14T22:41:03.091194] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-14T22:41:03.090164] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6751 primary records. [2025-10-14T22:41:03.098619] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-14T22:41:03.104601] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:03.111812] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14374 primary records. [2025-10-14T22:41:03.125385] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-14T22:41:03.143326] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-10-14T22:41:03.145212] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-14T22:41:03.147519] [INFO ] [MAIN ] Derivative Progress: 1282/1812 symbols completed. PFH took 1.0s. Estimated remaining: 3m 21s. Rate: 158.1 symbols/min [2025-10-14T22:41:03.149010] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-10-14T22:41:03.148166] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:03.149363] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-14T22:41:03.152141] [INFO ] [MAIN ] Derivative Progress: 1283/1812 symbols completed. PFD took 1.0s. Estimated remaining: 3m 21s. Rate: 158.3 symbols/min [2025-10-14T22:41:03.152952] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:03.155243] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-10-14T22:41:03.155414] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-14T22:41:03.157805] [INFO ] [MAIN ] Derivative Progress: 1284/1812 symbols completed. PERF took 1.1s. Estimated remaining: 3m 20s. Rate: 158.4 symbols/min [2025-10-14T22:41:03.158129] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:03.172410] [DEBUG] [LOCAL ] PFL: Loaded 14241 existing records from primary storage. [2025-10-14T22:41:03.172591] [INFO ] [MAIN ] PFL: Loaded 14241 primary data records. [2025-10-14T22:41:03.223441] [DEBUG] [LOCAL ] PFO: Loaded 6095 existing records from primary storage. [2025-10-14T22:41:03.273250] [INFO ] [MAIN ] PFO: Loaded 6095 primary data records. [2025-10-14T22:41:03.279519] [DEBUG] [LOCAL ] PFN: Loaded 22353 existing records from primary storage. [2025-10-14T22:41:03.311355] [INFO ] [MAIN ] PFN: Loaded 22353 primary data records. [2025-10-14T22:41:04.208448] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:04.209515] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 14241 primary records. [2025-10-14T22:41:04.209725] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-14T22:41:04.230896] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:04.239163] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-14T22:41:04.239596] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-14T22:41:04.241177] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6095 primary records. [2025-10-14T22:41:04.243241] [INFO ] [MAIN ] Derivative Progress: 1285/1812 symbols completed. PFL took 1.1s. Estimated remaining: 3m 20s. Rate: 158.2 symbols/min [2025-10-14T22:41:04.243441] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:04.243718] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-14T22:41:04.258267] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:04.260846] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22353 primary records. [2025-10-14T22:41:04.261028] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-14T22:41:04.282860] [DEBUG] [LOCAL ] PGP: Loaded 5720 existing records from primary storage. [2025-10-14T22:41:04.287383] [INFO ] [MAIN ] PGP: Loaded 5720 primary data records. [2025-10-14T22:41:04.351832] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-14T22:41:04.368544] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-14T22:41:04.380277] [INFO ] [MAIN ] Derivative Progress: 1286/1812 symbols completed. PFO took 1.2s. Estimated remaining: 3m 19s. Rate: 158.2 symbols/min [2025-10-14T22:41:04.385626] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:04.396919] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-14T22:41:04.402310] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-14T22:41:04.410399] [INFO ] [MAIN ] Derivative Progress: 1287/1812 symbols completed. PFN took 1.3s. Estimated remaining: 3m 19s. Rate: 158.3 symbols/min [2025-10-14T22:41:04.432190] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:04.623494] [DEBUG] [LOCAL ] PGZ: Loaded 5516 existing records from primary storage. [2025-10-14T22:41:04.640638] [INFO ] [MAIN ] PGZ: Loaded 5516 primary data records. [2025-10-14T22:41:04.769512] [DEBUG] [LOCAL ] PGRE: Loaded 46956 existing records from primary storage. [2025-10-14T22:41:04.791085] [INFO ] [MAIN ] PGRE: Loaded 46956 primary data records. [2025-10-14T22:41:05.274681] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:05.275562] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5720 primary records. [2025-10-14T22:41:05.276321] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-14T22:41:05.296394] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-14T22:41:05.298000] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-14T22:41:05.300179] [INFO ] [MAIN ] Derivative Progress: 1288/1812 symbols completed. PGP took 1.1s. Estimated remaining: 3m 19s. Rate: 158.2 symbols/min [2025-10-14T22:41:05.313702] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:05.314334] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5516 primary records. [2025-10-14T22:41:05.314476] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-14T22:41:05.332187] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-14T22:41:05.332372] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-14T22:41:05.334377] [INFO ] [MAIN ] Derivative Progress: 1289/1812 symbols completed. PGZ took 0.9s. Estimated remaining: 3m 18s. Rate: 158.3 symbols/min [2025-10-14T22:41:05.346933] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:05.347466] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46956 primary records. [2025-10-14T22:41:05.347523] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-14T22:41:05.362300] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-10-14T22:41:05.362358] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-14T22:41:05.364335] [INFO ] [MAIN ] Derivative Progress: 1290/1812 symbols completed. PGRE took 1.0s. Estimated remaining: 3m 18s. Rate: 158.4 symbols/min [2025-10-14T22:41:05.364765] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:05.364865] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:05.365233] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:05.378452] [DEBUG] [LOCAL ] PIM: Loaded 4836 existing records from primary storage. [2025-10-14T22:41:05.378691] [INFO ] [MAIN ] PIM: Loaded 4836 primary data records. [2025-10-14T22:41:05.497261] [DEBUG] [LOCAL ] PHI: Loaded 15149 existing records from primary storage. [2025-10-14T22:41:05.508262] [INFO ] [MAIN ] PHI: Loaded 15149 primary data records. [2025-10-14T22:41:05.544331] [DEBUG] [LOCAL ] PHK: Loaded 26724 existing records from primary storage. [2025-10-14T22:41:05.552839] [INFO ] [MAIN ] PHK: Loaded 26724 primary data records. [2025-10-14T22:41:06.347802] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:06.348825] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4836 primary records. [2025-10-14T22:41:06.349209] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-14T22:41:06.381674] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-14T22:41:06.393816] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-14T22:41:06.396179] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:06.397131] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 15149 primary records. [2025-10-14T22:41:06.397476] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-14T22:41:06.397380] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:06.395840] [INFO ] [MAIN ] Derivative Progress: 1291/1812 symbols completed. PIM took 1.0s. Estimated remaining: 3m 18s. Rate: 158.2 symbols/min [2025-10-14T22:41:06.398182] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:06.399215] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26724 primary records. [2025-10-14T22:41:06.406136] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-14T22:41:06.427572] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-14T22:41:06.428259] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-14T22:41:06.431374] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-10-14T22:41:06.431511] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-14T22:41:06.430450] [INFO ] [MAIN ] Derivative Progress: 1292/1812 symbols completed. PHK took 1.1s. Estimated remaining: 3m 17s. Rate: 158.3 symbols/min [2025-10-14T22:41:06.433814] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:06.434209] [INFO ] [MAIN ] Derivative Progress: 1293/1812 symbols completed. PHI took 1.1s. Estimated remaining: 3m 17s. Rate: 158.4 symbols/min [2025-10-14T22:41:06.434286] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:06.445599] [DEBUG] [LOCAL ] PINE: Loaded 14382 existing records from primary storage. [2025-10-14T22:41:06.445708] [INFO ] [MAIN ] PINE: Loaded 14382 primary data records. [2025-10-14T22:41:06.591145] [DEBUG] [LOCAL ] PKE: Loaded 14005 existing records from primary storage. [2025-10-14T22:41:06.596616] [DEBUG] [LOCAL ] PML: Loaded 21722 existing records from primary storage. [2025-10-14T22:41:06.642769] [INFO ] [MAIN ] PKE: Loaded 14005 primary data records. [2025-10-14T22:41:06.642698] [INFO ] [MAIN ] PML: Loaded 21722 primary data records. [2025-10-14T22:41:07.393664] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:07.394669] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14382 primary records. [2025-10-14T22:41:07.394954] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-14T22:41:07.412367] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-10-14T22:41:07.412995] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-14T22:41:07.415075] [INFO ] [MAIN ] Derivative Progress: 1294/1812 symbols completed. PINE took 1.0s. Estimated remaining: 3m 16s. Rate: 158.2 symbols/min [2025-10-14T22:41:07.415325] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:07.431749] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:07.432700] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 14005 primary records. [2025-10-14T22:41:07.433530] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-14T22:41:07.462801] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:07.467623] [DEBUG] [LOCAL ] PMM: Loaded 10205 existing records from primary storage. [2025-10-14T22:41:07.468931] [INFO ] [MAIN ] PMM: Loaded 10205 primary data records. [2025-10-14T22:41:07.468863] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21722 primary records. [2025-10-14T22:41:07.469510] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-14T22:41:07.511618] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-10-14T22:41:07.538265] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-14T22:41:07.540363] [INFO ] [MAIN ] Derivative Progress: 1295/1812 symbols completed. PKE took 1.1s. Estimated remaining: 3m 16s. Rate: 158.3 symbols/min [2025-10-14T22:41:07.555541] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:07.597761] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-14T22:41:07.615548] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-14T22:41:07.634809] [INFO ] [MAIN ] Derivative Progress: 1296/1812 symbols completed. PML took 1.2s. Estimated remaining: 3m 15s. Rate: 158.4 symbols/min [2025-10-14T22:41:07.643507] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:07.812000] [DEBUG] [LOCAL ] PMO: Loaded 9904 existing records from primary storage. [2025-10-14T22:41:07.812706] [INFO ] [MAIN ] PMO: Loaded 9904 primary data records. [2025-10-14T22:41:07.895914] [DEBUG] [LOCAL ] PNI: Loaded 6758 existing records from primary storage. [2025-10-14T22:41:07.910847] [INFO ] [MAIN ] PNI: Loaded 6758 primary data records. [2025-10-14T22:41:08.459531] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:08.461764] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10205 primary records. [2025-10-14T22:41:08.462134] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-14T22:41:08.478231] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-14T22:41:08.478555] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-14T22:41:08.480765] [INFO ] [MAIN ] Derivative Progress: 1297/1812 symbols completed. PMM took 1.1s. Estimated remaining: 3m 15s. Rate: 158.3 symbols/min [2025-10-14T22:41:08.481005] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:08.499859] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:08.502036] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 9904 primary records. [2025-10-14T22:41:08.502363] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-14T22:41:08.518836] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:08.529738] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6758 primary records. [2025-10-14T22:41:08.530292] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-14T22:41:08.553712] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-14T22:41:08.554889] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-14T22:41:08.556935] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-14T22:41:08.558866] [INFO ] [MAIN ] Derivative Progress: 1298/1812 symbols completed. PMO took 1.0s. Estimated remaining: 3m 15s. Rate: 158.3 symbols/min [2025-10-14T22:41:08.559035] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:08.559148] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-14T22:41:08.569932] [INFO ] [MAIN ] Derivative Progress: 1299/1812 symbols completed. PNI took 0.9s. Estimated remaining: 3m 14s. Rate: 158.5 symbols/min [2025-10-14T22:41:08.571007] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:08.572106] [DEBUG] [LOCAL ] PNNT: Loaded 33436 existing records from primary storage. [2025-10-14T22:41:08.572175] [INFO ] [MAIN ] PNNT: Loaded 33436 primary data records. [2025-10-14T22:41:08.656168] [DEBUG] [LOCAL ] PRCS: Loaded 2770 existing records from primary storage. [2025-10-14T22:41:08.682299] [INFO ] [MAIN ] PRCS: Loaded 2770 primary data records. [2025-10-14T22:41:08.815938] [DEBUG] [LOCAL ] PPT: Loaded 19920 existing records from primary storage. [2025-10-14T22:41:08.848670] [INFO ] [MAIN ] PPT: Loaded 19920 primary data records. [2025-10-14T22:41:09.521202] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:09.522232] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 33436 primary records. [2025-10-14T22:41:09.522331] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-14T22:41:09.541872] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-10-14T22:41:09.542150] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-14T22:41:09.544368] [INFO ] [MAIN ] Derivative Progress: 1300/1812 symbols completed. PNNT took 1.1s. Estimated remaining: 3m 14s. Rate: 158.3 symbols/min [2025-10-14T22:41:09.558549] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:41:09.559305] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:09.561106] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2770 primary records. [2025-10-14T22:41:09.561242] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-14T22:41:09.585507] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:09.586887] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19920 primary records. [2025-10-14T22:41:09.587425] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-14T22:41:09.591537] [DEBUG] [LOCAL ] PRH: Loaded 4765 existing records from primary storage. [2025-10-14T22:41:09.592446] [INFO ] [MAIN ] PRH: Loaded 4765 primary data records. [2025-10-14T22:41:09.615710] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-14T22:41:09.615808] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-14T22:41:09.627375] [INFO ] [MAIN ] Derivative Progress: 1301/1812 symbols completed. PRCS took 1.1s. Estimated remaining: 3m 14s. Rate: 158.4 symbols/min [2025-10-14T22:41:09.637956] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:09.704023] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-14T22:41:09.714941] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-14T22:41:09.730871] [DEBUG] [LOCAL ] PRT: Loaded 5180 existing records from primary storage. [2025-10-14T22:41:09.723033] [INFO ] [MAIN ] Derivative Progress: 1302/1812 symbols completed. PPT took 1.2s. Estimated remaining: 3m 13s. Rate: 158.5 symbols/min [2025-10-14T22:41:09.736123] [INFO ] [MAIN ] PRT: Loaded 5180 primary data records. [2025-10-14T22:41:09.767150] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:10.037195] [DEBUG] [LOCAL ] PSBD: Loaded 7909 existing records from primary storage. [2025-10-14T22:41:10.072158] [INFO ] [MAIN ] PSBD: Loaded 7909 primary data records. [2025-10-14T22:41:10.557957] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:10.559996] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4765 primary records. [2025-10-14T22:41:10.560534] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-14T22:41:10.590306] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:10.591756] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5180 primary records. [2025-10-14T22:41:10.592807] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-14T22:41:10.601888] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-10-14T22:41:10.604959] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-14T22:41:10.607373] [INFO ] [MAIN ] Derivative Progress: 1303/1812 symbols completed. PRH took 1.0s. Estimated remaining: 3m 13s. Rate: 158.3 symbols/min [2025-10-14T22:41:10.611775] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-10-14T22:41:10.611921] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-14T22:41:10.614089] [INFO ] [MAIN ] Derivative Progress: 1304/1812 symbols completed. PRT took 1.0s. Estimated remaining: 3m 12s. Rate: 158.4 symbols/min [2025-10-14T22:41:10.628674] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:41:10.629191] [INFO ] [MAIN ] PSBD: Generated 1793 derivative records from 7909 primary records. [2025-10-14T22:41:10.629248] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-14T22:41:10.643785] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1793 records). [2025-10-14T22:41:10.643844] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-14T22:41:10.645763] [INFO ] [MAIN ] Derivative Progress: 1305/1812 symbols completed. PSBD took 0.9s. Estimated remaining: 3m 12s. Rate: 158.5 symbols/min [2025-10-14T22:41:10.646258] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:10.646191] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:10.646389] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:10.654059] [DEBUG] [LOCAL ] PVL: Loaded 4715 existing records from primary storage. [2025-10-14T22:41:10.654373] [INFO ] [MAIN ] PVL: Loaded 4715 primary data records. [2025-10-14T22:41:10.769147] [DEBUG] [LOCAL ] PSF: Loaded 7000 existing records from primary storage. [2025-10-14T22:41:10.780034] [INFO ] [MAIN ] PSF: Loaded 7000 primary data records. [2025-10-14T22:41:10.896516] [DEBUG] [LOCAL ] PSQH: Loaded 35507 existing records from primary storage. [2025-10-14T22:41:10.901692] [INFO ] [MAIN ] PSQH: Loaded 35507 primary data records. [2025-10-14T22:41:11.637768] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:11.638559] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4715 primary records. [2025-10-14T22:41:11.638778] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-14T22:41:11.657344] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-10-14T22:41:11.659127] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-14T22:41:11.661914] [INFO ] [MAIN ] Derivative Progress: 1306/1812 symbols completed. PVL took 1.0s. Estimated remaining: 3m 12s. Rate: 158.3 symbols/min [2025-10-14T22:41:11.662140] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:11.676174] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:11.677769] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 7000 primary records. [2025-10-14T22:41:11.679384] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-14T22:41:11.703999] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:11.705260] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 35507 primary records. [2025-10-14T22:41:11.705330] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-14T22:41:11.727386] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-14T22:41:11.729202] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-14T22:41:11.731473] [INFO ] [MAIN ] Derivative Progress: 1307/1812 symbols completed. PSF took 1.1s. Estimated remaining: 3m 11s. Rate: 158.4 symbols/min [2025-10-14T22:41:11.739336] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:11.742918] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-10-14T22:41:11.742579] [DEBUG] [LOCAL ] QD: Loaded 27589 existing records from primary storage. [2025-10-14T22:41:11.743072] [INFO ] [MAIN ] QD: Loaded 27589 primary data records. [2025-10-14T22:41:11.743505] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-14T22:41:11.766775] [INFO ] [MAIN ] Derivative Progress: 1308/1812 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 11s. Rate: 158.5 symbols/min [2025-10-14T22:41:11.789951] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:11.887190] [DEBUG] [LOCAL ] QVCD: Loaded 4713 existing records from primary storage. [2025-10-14T22:41:11.914582] [INFO ] [MAIN ] QVCD: Loaded 4713 primary data records. [2025-10-14T22:41:12.010258] [DEBUG] [LOCAL ] QUAD: Loaded 23359 existing records from primary storage. [2025-10-14T22:41:12.136267] [INFO ] [MAIN ] QUAD: Loaded 23359 primary data records. [2025-10-14T22:41:12.713706] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:12.715354] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27589 primary records. [2025-10-14T22:41:12.715675] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-14T22:41:12.746288] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:12.748956] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4713 primary records. [2025-10-14T22:41:12.749898] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-14T22:41:12.751065] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-10-14T22:41:12.751359] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-14T22:41:12.753779] [INFO ] [MAIN ] Derivative Progress: 1309/1812 symbols completed. QD took 1.1s. Estimated remaining: 3m 11s. Rate: 158.3 symbols/min [2025-10-14T22:41:12.761478] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:12.788094] [DEBUG] [LOCAL ] RBOT: Loaded 6003 existing records from primary storage. [2025-10-14T22:41:12.789208] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-10-14T22:41:12.789293] [INFO ] [MAIN ] RBOT: Loaded 6003 primary data records. [2025-10-14T22:41:12.784622] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:12.810438] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-14T22:41:12.813403] [INFO ] [MAIN ] Derivative Progress: 1310/1812 symbols completed. QVCD took 1.0s. Estimated remaining: 3m 10s. Rate: 158.4 symbols/min [2025-10-14T22:41:12.813533] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:12.811277] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23359 primary records. [2025-10-14T22:41:12.824890] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-14T22:41:12.944035] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-10-14T22:41:12.959837] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-14T22:41:12.962090] [INFO ] [MAIN ] Derivative Progress: 1311/1812 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 10s. Rate: 158.5 symbols/min [2025-10-14T22:41:12.971032] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:13.139862] [DEBUG] [LOCAL ] RCS: Loaded 12206 existing records from primary storage. [2025-10-14T22:41:13.140336] [INFO ] [MAIN ] RCS: Loaded 12206 primary data records. [2025-10-14T22:41:13.268594] [DEBUG] [LOCAL ] RC: Loaded 48924 existing records from primary storage. [2025-10-14T22:41:13.272673] [INFO ] [MAIN ] RC: Loaded 48924 primary data records. [2025-10-14T22:41:13.720359] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:13.819015] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 6003 primary records. [2025-10-14T22:41:13.832522] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-14T22:41:13.851575] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-10-14T22:41:13.852238] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-14T22:41:13.854805] [INFO ] [MAIN ] Derivative Progress: 1312/1812 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 9s. Rate: 158.4 symbols/min [2025-10-14T22:41:13.855003] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:13.872545] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:13.873262] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 12206 primary records. [2025-10-14T22:41:13.873447] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-14T22:41:13.892903] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-14T22:41:13.893110] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-14T22:41:13.916126] [INFO ] [MAIN ] Derivative Progress: 1313/1812 symbols completed. RCS took 0.9s. Estimated remaining: 3m 9s. Rate: 158.5 symbols/min [2025-10-14T22:41:13.917002] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:13.917990] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48924 primary records. [2025-10-14T22:41:13.917102] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:13.918401] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-14T22:41:13.945983] [DEBUG] [LOCAL ] RERE: Loaded 41504 existing records from primary storage. [2025-10-14T22:41:13.946719] [INFO ] [MAIN ] RERE: Loaded 41504 primary data records. [2025-10-14T22:41:13.946888] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-10-14T22:41:13.946965] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-14T22:41:13.949174] [INFO ] [MAIN ] Derivative Progress: 1314/1812 symbols completed. RC took 1.1s. Estimated remaining: 3m 8s. Rate: 158.6 symbols/min [2025-10-14T22:41:13.949369] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:14.082293] [DEBUG] [LOCAL ] RFI: Loaded 10475 existing records from primary storage. [2025-10-14T22:41:14.110250] [INFO ] [MAIN ] RFI: Loaded 10475 primary data records. [2025-10-14T22:41:14.327825] [DEBUG] [LOCAL ] RES: Loaded 46978 existing records from primary storage. [2025-10-14T22:41:14.376742] [INFO ] [MAIN ] RES: Loaded 46978 primary data records. [2025-10-14T22:41:14.920591] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:14.923503] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41504 primary records. [2025-10-14T22:41:14.924362] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-14T22:41:14.952077] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:14.955814] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10475 primary records. [2025-10-14T22:41:14.956122] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-14T22:41:14.973451] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-14T22:41:14.976320] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-14T22:41:14.977072] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-10-14T22:41:14.977172] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-14T22:41:14.979580] [INFO ] [MAIN ] Derivative Progress: 1315/1812 symbols completed. RERE took 1.1s. Estimated remaining: 3m 8s. Rate: 158.4 symbols/min [2025-10-14T22:41:14.982074] [INFO ] [MAIN ] Derivative Progress: 1316/1812 symbols completed. RFI took 1.0s. Estimated remaining: 3m 8s. Rate: 158.5 symbols/min [2025-10-14T22:41:14.981843] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:14.999844] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:14.999944] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:15.000903] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 46978 primary records. [2025-10-14T22:41:15.001292] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-14T22:41:15.023022] [DEBUG] [LOCAL ] RFM: Loaded 4131 existing records from primary storage. [2025-10-14T22:41:15.027710] [INFO ] [MAIN ] RFM: Loaded 4131 primary data records. [2025-10-14T22:41:15.039333] [DEBUG] [LOCAL ] RFL: Loaded 11412 existing records from primary storage. [2025-10-14T22:41:15.049711] [INFO ] [MAIN ] RFL: Loaded 11412 primary data records. [2025-10-14T22:41:15.112821] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-10-14T22:41:15.141551] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-14T22:41:15.149689] [INFO ] [MAIN ] Derivative Progress: 1317/1812 symbols completed. RES took 1.2s. Estimated remaining: 3m 7s. Rate: 158.5 symbols/min [2025-10-14T22:41:15.208683] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:15.567716] [DEBUG] [LOCAL ] RFMZ: Loaded 8668 existing records from primary storage. [2025-10-14T22:41:15.683817] [INFO ] [MAIN ] RFMZ: Loaded 8668 primary data records. [2025-10-14T22:41:16.013564] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:16.019680] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4131 primary records. [2025-10-14T22:41:16.020209] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-14T22:41:16.018841] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:41:16.021694] [INFO ] [MAIN ] RFL: Generated 1793 derivative records from 11412 primary records. [2025-10-14T22:41:16.021971] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-14T22:41:16.047806] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-10-14T22:41:16.049031] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-14T22:41:16.051112] [INFO ] [MAIN ] Derivative Progress: 1318/1812 symbols completed. RFM took 1.1s. Estimated remaining: 3m 7s. Rate: 158.4 symbols/min [2025-10-14T22:41:16.055311] [DEBUG] [LOCAL ] RFL: Derivative data saved (1793 records). [2025-10-14T22:41:16.055489] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-14T22:41:16.057816] [INFO ] [MAIN ] Derivative Progress: 1319/1812 symbols completed. RFL took 1.1s. Estimated remaining: 3m 7s. Rate: 158.5 symbols/min [2025-10-14T22:41:16.072869] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:16.073452] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8668 primary records. [2025-10-14T22:41:16.073533] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-14T22:41:16.088663] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-10-14T22:41:16.088736] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-14T22:41:16.091008] [INFO ] [MAIN ] Derivative Progress: 1320/1812 symbols completed. RFMZ took 0.9s. Estimated remaining: 3m 6s. Rate: 158.6 symbols/min [2025-10-14T22:41:16.091405] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:16.091501] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:16.091601] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:16.098380] [DEBUG] [LOCAL ] RGT: Loaded 2710 existing records from primary storage. [2025-10-14T22:41:16.098635] [INFO ] [MAIN ] RGT: Loaded 2710 primary data records. [2025-10-14T22:41:16.417670] [DEBUG] [LOCAL ] RHP: Loaded 40733 existing records from primary storage. [2025-10-14T22:41:16.443778] [INFO ] [MAIN ] RHP: Loaded 40733 primary data records. [2025-10-14T22:41:16.501800] [DEBUG] [LOCAL ] RIG: Loaded 53674 existing records from primary storage. [2025-10-14T22:41:16.516989] [INFO ] [MAIN ] RIG: Loaded 53674 primary data records. [2025-10-14T22:41:17.130103] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:17.131178] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2710 primary records. [2025-10-14T22:41:17.131305] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-14T22:41:17.149148] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-10-14T22:41:17.149368] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-14T22:41:17.152004] [INFO ] [MAIN ] Derivative Progress: 1321/1812 symbols completed. RGT took 1.1s. Estimated remaining: 3m 6s. Rate: 158.4 symbols/min [2025-10-14T22:41:17.152330] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:17.197510] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:17.197217] [DEBUG] [LOCAL ] RLTY: Loaded 11158 existing records from primary storage. [2025-10-14T22:41:17.197983] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:17.199858] [INFO ] [MAIN ] RLTY: Loaded 11158 primary data records. [2025-10-14T22:41:17.198962] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 40733 primary records. [2025-10-14T22:41:17.199988] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-14T22:41:17.199773] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53674 primary records. [2025-10-14T22:41:17.211933] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-14T22:41:17.325009] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-10-14T22:41:17.337635] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-14T22:41:17.341398] [INFO ] [MAIN ] Derivative Progress: 1322/1812 symbols completed. RHP took 1.2s. Estimated remaining: 3m 6s. Rate: 158.4 symbols/min [2025-10-14T22:41:17.353772] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:17.353550] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-10-14T22:41:17.383863] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-14T22:41:17.394919] [INFO ] [MAIN ] Derivative Progress: 1323/1812 symbols completed. RIG took 1.3s. Estimated remaining: 3m 5s. Rate: 158.6 symbols/min [2025-10-14T22:41:17.404092] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:17.549235] [DEBUG] [LOCAL ] RM: Loaded 7559 existing records from primary storage. [2025-10-14T22:41:17.549540] [INFO ] [MAIN ] RM: Loaded 7559 primary data records. [2025-10-14T22:41:17.757491] [DEBUG] [LOCAL ] RLX: Loaded 48143 existing records from primary storage. [2025-10-14T22:41:17.860768] [INFO ] [MAIN ] RLX: Loaded 48143 primary data records. [2025-10-14T22:41:18.023080] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:18.029419] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11158 primary records. [2025-10-14T22:41:18.066609] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-14T22:41:18.234104] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-10-14T22:41:18.239457] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:18.239193] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-14T22:41:18.241705] [INFO ] [MAIN ] Derivative Progress: 1324/1812 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 5s. Rate: 158.4 symbols/min [2025-10-14T22:41:18.241991] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:18.242904] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7559 primary records. [2025-10-14T22:41:18.243003] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-14T22:41:18.260934] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-10-14T22:41:18.261233] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-14T22:41:18.263274] [INFO ] [MAIN ] Derivative Progress: 1325/1812 symbols completed. RM took 0.9s. Estimated remaining: 3m 4s. Rate: 158.5 symbols/min [2025-10-14T22:41:18.263612] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:18.267163] [DEBUG] [LOCAL ] RMMZ: Loaded 4801 existing records from primary storage. [2025-10-14T22:41:18.267566] [INFO ] [MAIN ] RMMZ: Loaded 4801 primary data records. [2025-10-14T22:41:18.387970] [DEBUG] [LOCAL ] RMT: Loaded 17399 existing records from primary storage. [2025-10-14T22:41:18.398378] [INFO ] [MAIN ] RMT: Loaded 17399 primary data records. [2025-10-14T22:41:18.524449] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:18.619382] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48143 primary records. [2025-10-14T22:41:18.666917] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-14T22:41:18.897094] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-10-14T22:41:18.898312] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-14T22:41:18.900953] [INFO ] [MAIN ] Derivative Progress: 1326/1812 symbols completed. RLX took 1.5s. Estimated remaining: 3m 4s. Rate: 158.4 symbols/min [2025-10-14T22:41:18.902017] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:18.921004] [DEBUG] [LOCAL ] RNP: Loaded 16228 existing records from primary storage. [2025-10-14T22:41:18.921799] [INFO ] [MAIN ] RNP: Loaded 16228 primary data records. [2025-10-14T22:41:18.965030] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:18.977886] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4801 primary records. [2025-10-14T22:41:18.990084] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-14T22:41:19.084677] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:19.136432] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17399 primary records. [2025-10-14T22:41:19.278607] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-14T22:41:19.300305] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-10-14T22:41:19.300514] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-14T22:41:19.306845] [INFO ] [MAIN ] Derivative Progress: 1327/1812 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 4s. Rate: 158.4 symbols/min [2025-10-14T22:41:19.309666] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:19.313272] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-14T22:41:19.313438] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-14T22:41:19.315761] [INFO ] [MAIN ] Derivative Progress: 1328/1812 symbols completed. RMT took 1.1s. Estimated remaining: 3m 3s. Rate: 158.5 symbols/min [2025-10-14T22:41:19.315910] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:19.323157] [DEBUG] [LOCAL ] RSF: Loaded 4325 existing records from primary storage. [2025-10-14T22:41:19.323387] [INFO ] [MAIN ] RSF: Loaded 4325 primary data records. [2025-10-14T22:41:19.405099] [DEBUG] [LOCAL ] RPT: Loaded 19159 existing records from primary storage. [2025-10-14T22:41:19.423072] [INFO ] [MAIN ] RPT: Loaded 19159 primary data records. [2025-10-14T22:41:19.598247] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:19.646223] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 16228 primary records. [2025-10-14T22:41:19.656563] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-14T22:41:19.958705] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-14T22:41:19.959724] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-14T22:41:19.963448] [INFO ] [MAIN ] Derivative Progress: 1329/1812 symbols completed. RNP took 1.1s. Estimated remaining: 3m 3s. Rate: 158.5 symbols/min [2025-10-14T22:41:19.963959] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:20.010283] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:20.010141] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:20.011084] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19159 primary records. [2025-10-14T22:41:20.011726] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4325 primary records. [2025-10-14T22:41:20.011803] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-14T22:41:20.011882] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-14T22:41:20.040612] [DEBUG] [LOCAL ] RSKD: Loaded 33488 existing records from primary storage. [2025-10-14T22:41:20.044059] [INFO ] [MAIN ] RSKD: Loaded 33488 primary data records. [2025-10-14T22:41:20.061280] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-14T22:41:20.081709] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-14T22:41:20.105756] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-10-14T22:41:20.116322] [INFO ] [MAIN ] Derivative Progress: 1330/1812 symbols completed. RSF took 0.8s. Estimated remaining: 3m 2s. Rate: 158.5 symbols/min [2025-10-14T22:41:20.121584] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-14T22:41:20.133688] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:20.141077] [INFO ] [MAIN ] Derivative Progress: 1331/1812 symbols completed. RPT took 0.8s. Estimated remaining: 3m 2s. Rate: 158.6 symbols/min [2025-10-14T22:41:20.155097] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:20.398544] [DEBUG] [LOCAL ] RWT: Loaded 40829 existing records from primary storage. [2025-10-14T22:41:20.399164] [INFO ] [MAIN ] RWT: Loaded 40829 primary data records. [2025-10-14T22:41:20.502295] [DEBUG] [LOCAL ] RYN: Loaded 45455 existing records from primary storage. [2025-10-14T22:41:20.519354] [INFO ] [MAIN ] RYN: Loaded 45455 primary data records. [2025-10-14T22:41:21.048686] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:21.063390] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33488 primary records. [2025-10-14T22:41:21.064210] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-14T22:41:21.085536] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-10-14T22:41:21.085895] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-14T22:41:21.088109] [INFO ] [MAIN ] Derivative Progress: 1332/1812 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 2s. Rate: 158.5 symbols/min [2025-10-14T22:41:21.088474] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:21.113763] [DEBUG] [LOCAL ] RZC: Loaded 6756 existing records from primary storage. [2025-10-14T22:41:21.114566] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:21.114679] [INFO ] [MAIN ] RZC: Loaded 6756 primary data records. [2025-10-14T22:41:21.115362] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40829 primary records. [2025-10-14T22:41:21.126669] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-14T22:41:21.254864] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:21.267515] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45455 primary records. [2025-10-14T22:41:21.268361] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-14T22:41:21.344901] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-14T22:41:21.455791] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-14T22:41:21.463480] [INFO ] [MAIN ] Derivative Progress: 1333/1812 symbols completed. RWT took 1.3s. Estimated remaining: 3m 1s. Rate: 158.5 symbols/min [2025-10-14T22:41:21.478911] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-14T22:41:21.479028] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-14T22:41:21.481444] [INFO ] [MAIN ] Derivative Progress: 1334/1812 symbols completed. RYN took 1.3s. Estimated remaining: 3m 1s. Rate: 158.6 symbols/min [2025-10-14T22:41:21.506175] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:21.506862] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6756 primary records. [2025-10-14T22:41:21.506925] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-14T22:41:21.524269] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-14T22:41:21.524352] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-14T22:41:21.526766] [INFO ] [MAIN ] Derivative Progress: 1335/1812 symbols completed. RZC took 0.4s. Estimated remaining: 3m 0s. Rate: 158.7 symbols/min [2025-10-14T22:41:21.527270] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:21.527375] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:21.527211] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:21.540576] [DEBUG] [LOCAL ] SABA: Loaded 9326 existing records from primary storage. [2025-10-14T22:41:21.540757] [INFO ] [MAIN ] SABA: Loaded 9326 primary data records. [2025-10-14T22:41:21.806306] [DEBUG] [LOCAL ] SA: Loaded 44313 existing records from primary storage. [2025-10-14T22:41:21.871941] [INFO ] [MAIN ] SA: Loaded 44313 primary data records. [2025-10-14T22:41:22.028480] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-14T22:41:22.029863] [INFO ] [MAIN ] S: Loaded 53536 primary data records. [2025-10-14T22:41:22.805517] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:22.807190] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9326 primary records. [2025-10-14T22:41:22.807916] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-14T22:41:22.828541] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-14T22:41:22.828755] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-14T22:41:22.831313] [INFO ] [MAIN ] Derivative Progress: 1336/1812 symbols completed. SABA took 1.3s. Estimated remaining: 3m 0s. Rate: 158.4 symbols/min [2025-10-14T22:41:22.831683] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:22.889626] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:22.889329] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:22.890559] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53536 primary records. [2025-10-14T22:41:22.890759] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-14T22:41:22.891437] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 44313 primary records. [2025-10-14T22:41:22.892092] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-14T22:41:22.935228] [DEBUG] [LOCAL ] SAFE: Loaded 30390 existing records from primary storage. [2025-10-14T22:41:22.935744] [INFO ] [MAIN ] SAFE: Loaded 30390 primary data records. [2025-10-14T22:41:22.934414] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-14T22:41:22.936745] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-14T22:41:22.951212] [INFO ] [MAIN ] Derivative Progress: 1337/1812 symbols completed. SA took 1.4s. Estimated remaining: 2m 60s. Rate: 158.5 symbols/min [2025-10-14T22:41:22.962099] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:23.034427] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-14T22:41:23.053535] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-14T22:41:23.055680] [INFO ] [MAIN ] Derivative Progress: 1338/1812 symbols completed. S took 1.5s. Estimated remaining: 2m 59s. Rate: 158.6 symbols/min [2025-10-14T22:41:23.061490] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:23.119697] [DEBUG] [LOCAL ] SAH: Loaded 21418 existing records from primary storage. [2025-10-14T22:41:23.150745] [INFO ] [MAIN ] SAH: Loaded 21418 primary data records. [2025-10-14T22:41:23.376080] [DEBUG] [LOCAL ] SAM: Loaded 21426 existing records from primary storage. [2025-10-14T22:41:23.389497] [INFO ] [MAIN ] SAM: Loaded 21426 primary data records. [2025-10-14T22:41:23.928479] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:23.929618] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30390 primary records. [2025-10-14T22:41:23.929846] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-14T22:41:23.952309] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-14T22:41:23.952488] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-14T22:41:23.955883] [INFO ] [MAIN ] Derivative Progress: 1339/1812 symbols completed. SAFE took 1.1s. Estimated remaining: 2m 59s. Rate: 158.4 symbols/min [2025-10-14T22:41:23.957414] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:23.972382] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:23.973095] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21418 primary records. [2025-10-14T22:41:23.973376] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-14T22:41:23.992409] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-14T22:41:23.992752] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-14T22:41:23.994730] [INFO ] [MAIN ] Derivative Progress: 1340/1812 symbols completed. SAH took 1.0s. Estimated remaining: 2m 59s. Rate: 158.5 symbols/min [2025-10-14T22:41:23.995028] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:24.010300] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:24.011008] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21426 primary records. [2025-10-14T22:41:24.011170] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-14T22:41:24.042490] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-14T22:41:24.042741] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-14T22:41:24.045029] [INFO ] [MAIN ] Derivative Progress: 1341/1812 symbols completed. SAM took 1.0s. Estimated remaining: 2m 58s. Rate: 158.6 symbols/min [2025-10-14T22:41:24.045309] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:24.077932] [DEBUG] [LOCAL ] SAN: Loaded 52972 existing records from primary storage. [2025-10-14T22:41:24.078187] [INFO ] [MAIN ] SAN: Loaded 52972 primary data records. [2025-10-14T22:41:24.210143] [DEBUG] [LOCAL ] SAND: Loaded 51857 existing records from primary storage. [2025-10-14T22:41:24.226554] [INFO ] [MAIN ] SAND: Loaded 51857 primary data records. [2025-10-14T22:41:24.510147] [DEBUG] [LOCAL ] SAP: Loaded 49909 existing records from primary storage. [2025-10-14T22:41:24.521333] [INFO ] [MAIN ] SAP: Loaded 49909 primary data records. [2025-10-14T22:41:25.079926] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:25.081095] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52972 primary records. [2025-10-14T22:41:25.081191] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-14T22:41:25.101514] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-14T22:41:25.101890] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-14T22:41:25.104044] [INFO ] [MAIN ] Derivative Progress: 1342/1812 symbols completed. SAN took 1.1s. Estimated remaining: 2m 58s. Rate: 158.4 symbols/min [2025-10-14T22:41:25.111833] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:25.116930] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:25.118340] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51857 primary records. [2025-10-14T22:41:25.118755] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-14T22:41:25.138027] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-14T22:41:25.138952] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-14T22:41:25.141095] [INFO ] [MAIN ] Derivative Progress: 1343/1812 symbols completed. SAND took 1.1s. Estimated remaining: 2m 58s. Rate: 158.5 symbols/min [2025-10-14T22:41:25.141282] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:25.159715] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:25.160588] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49909 primary records. [2025-10-14T22:41:25.160729] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-14T22:41:25.180001] [DEBUG] [LOCAL ] SAR: Loaded 17198 existing records from primary storage. [2025-10-14T22:41:25.182079] [INFO ] [MAIN ] SAR: Loaded 17198 primary data records. [2025-10-14T22:41:25.204976] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-14T22:41:25.222755] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-14T22:41:25.237483] [INFO ] [MAIN ] Derivative Progress: 1344/1812 symbols completed. SAP took 1.2s. Estimated remaining: 2m 57s. Rate: 158.6 symbols/min [2025-10-14T22:41:25.259326] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:25.544572] [DEBUG] [LOCAL ] SARO: Loaded 48343 existing records from primary storage. [2025-10-14T22:41:25.544935] [INFO ] [MAIN ] SARO: Loaded 48343 primary data records. [2025-10-14T22:41:25.652972] [DEBUG] [LOCAL ] SB: Loaded 32929 existing records from primary storage. [2025-10-14T22:41:25.663533] [INFO ] [MAIN ] SB: Loaded 32929 primary data records. [2025-10-14T22:41:26.261592] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:26.263539] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 17198 primary records. [2025-10-14T22:41:26.264296] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-14T22:41:26.284258] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-14T22:41:26.284848] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-14T22:41:26.286897] [INFO ] [MAIN ] Derivative Progress: 1345/1812 symbols completed. SAR took 1.2s. Estimated remaining: 2m 57s. Rate: 158.4 symbols/min [2025-10-14T22:41:26.287060] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:26.308260] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:26.309059] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48343 primary records. [2025-10-14T22:41:26.309171] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-14T22:41:26.341055] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:26.342695] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 32929 primary records. [2025-10-14T22:41:26.343049] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-14T22:41:26.354575] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-14T22:41:26.355294] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-14T22:41:26.357350] [INFO ] [MAIN ] Derivative Progress: 1346/1812 symbols completed. SARO took 1.2s. Estimated remaining: 2m 56s. Rate: 158.5 symbols/min [2025-10-14T22:41:26.357561] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:26.374787] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-14T22:41:26.374943] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-14T22:41:26.377061] [INFO ] [MAIN ] Derivative Progress: 1347/1812 symbols completed. SB took 1.1s. Estimated remaining: 2m 56s. Rate: 158.6 symbols/min [2025-10-14T22:41:26.381590] [DEBUG] [LOCAL ] SBI: Loaded 7464 existing records from primary storage. [2025-10-14T22:41:26.381742] [INFO ] [MAIN ] SBI: Loaded 7464 primary data records. [2025-10-14T22:41:26.395356] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:26.427534] [DEBUG] [LOCAL ] SBH: Loaded 49865 existing records from primary storage. [2025-10-14T22:41:26.427911] [INFO ] [MAIN ] SBH: Loaded 49865 primary data records. [2025-10-14T22:41:26.625492] [DEBUG] [LOCAL ] SBR: Loaded 7790 existing records from primary storage. [2025-10-14T22:41:26.656599] [INFO ] [MAIN ] SBR: Loaded 7790 primary data records. [2025-10-14T22:41:27.413620] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:27.414589] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7464 primary records. [2025-10-14T22:41:27.414848] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-14T22:41:27.435603] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-14T22:41:27.443754] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-14T22:41:27.446244] [INFO ] [MAIN ] Derivative Progress: 1348/1812 symbols completed. SBI took 1.1s. Estimated remaining: 2m 56s. Rate: 158.4 symbols/min [2025-10-14T22:41:27.451697] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:27.453583] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49865 primary records. [2025-10-14T22:41:27.454416] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-14T22:41:27.481352] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:27.482973] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7790 primary records. [2025-10-14T22:41:27.483073] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-14T22:41:27.501378] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-14T22:41:27.501738] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-14T22:41:27.505243] [INFO ] [MAIN ] Derivative Progress: 1349/1812 symbols completed. SBR took 1.1s. Estimated remaining: 2m 55s. Rate: 158.5 symbols/min [2025-10-14T22:41:27.505343] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-14T22:41:27.505564] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-14T22:41:27.507904] [INFO ] [MAIN ] Derivative Progress: 1350/1812 symbols completed. SBH took 1.2s. Estimated remaining: 2m 55s. Rate: 158.6 symbols/min [2025-10-14T22:41:27.508626] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:27.508876] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:27.508811] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:27.533854] [DEBUG] [LOCAL ] SBSI: Loaded 14876 existing records from primary storage. [2025-10-14T22:41:27.533994] [INFO ] [MAIN ] SBSI: Loaded 14876 primary data records. [2025-10-14T22:41:27.903799] [DEBUG] [LOCAL ] SBS: Loaded 49325 existing records from primary storage. [2025-10-14T22:41:27.904036] [INFO ] [MAIN ] SBS: Loaded 49325 primary data records. [2025-10-14T22:41:27.904669] [DEBUG] [LOCAL ] SBSW: Loaded 53165 existing records from primary storage. [2025-10-14T22:41:27.904977] [INFO ] [MAIN ] SBSW: Loaded 53165 primary data records. [2025-10-14T22:41:28.541635] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:28.542743] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14876 primary records. [2025-10-14T22:41:28.543217] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-14T22:41:28.563490] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-14T22:41:28.565218] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-14T22:41:28.568391] [INFO ] [MAIN ] Derivative Progress: 1351/1812 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 55s. Rate: 158.4 symbols/min [2025-10-14T22:41:28.568684] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:28.583133] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:28.583856] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49325 primary records. [2025-10-14T22:41:28.584037] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-14T22:41:28.615401] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:28.616895] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53165 primary records. [2025-10-14T22:41:28.618018] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-14T22:41:28.618088] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-14T22:41:28.618895] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-14T22:41:28.620760] [INFO ] [MAIN ] Derivative Progress: 1352/1812 symbols completed. SBS took 1.1s. Estimated remaining: 2m 54s. Rate: 158.5 symbols/min [2025-10-14T22:41:28.627894] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:28.650218] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-14T22:41:28.650457] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-14T22:41:28.652448] [INFO ] [MAIN ] Derivative Progress: 1353/1812 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 54s. Rate: 158.6 symbols/min [2025-10-14T22:41:28.652696] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:28.659622] [DEBUG] [LOCAL ] SCD: Loaded 13173 existing records from primary storage. [2025-10-14T22:41:28.659855] [INFO ] [MAIN ] SCD: Loaded 13173 primary data records. [2025-10-14T22:41:28.795236] [DEBUG] [LOCAL ] SCCO: Loaded 49600 existing records from primary storage. [2025-10-14T22:41:28.808878] [INFO ] [MAIN ] SCCO: Loaded 49600 primary data records. [2025-10-14T22:41:29.366685] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-14T22:41:29.367601] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-14T22:41:29.686017] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:29.687489] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13173 primary records. [2025-10-14T22:41:29.688000] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-14T22:41:29.720840] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:29.720441] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-14T22:41:29.721843] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49600 primary records. [2025-10-14T22:41:29.722006] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-14T22:41:29.721954] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-14T22:41:29.725202] [INFO ] [MAIN ] Derivative Progress: 1354/1812 symbols completed. SCD took 1.1s. Estimated remaining: 2m 54s. Rate: 158.4 symbols/min [2025-10-14T22:41:29.732532] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:29.745060] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-14T22:41:29.745247] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-14T22:41:29.748167] [INFO ] [MAIN ] Derivative Progress: 1355/1812 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 53s. Rate: 158.5 symbols/min [2025-10-14T22:41:29.755992] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:29.761304] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:29.762082] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-14T22:41:29.762529] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-14T22:41:29.779836] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-14T22:41:29.780080] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-14T22:41:29.782137] [INFO ] [MAIN ] Derivative Progress: 1356/1812 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 53s. Rate: 158.6 symbols/min [2025-10-14T22:41:29.785883] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:29.802318] [DEBUG] [LOCAL ] SCL: Loaded 14853 existing records from primary storage. [2025-10-14T22:41:29.802542] [INFO ] [MAIN ] SCL: Loaded 14853 primary data records. [2025-10-14T22:41:29.929728] [DEBUG] [LOCAL ] SCM: Loaded 20160 existing records from primary storage. [2025-10-14T22:41:29.935387] [INFO ] [MAIN ] SCM: Loaded 20160 primary data records. [2025-10-14T22:41:29.962173] [DEBUG] [LOCAL ] SCI: Loaded 46575 existing records from primary storage. [2025-10-14T22:41:30.034450] [INFO ] [MAIN ] SCI: Loaded 46575 primary data records. [2025-10-14T22:41:30.752909] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:30.753828] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14853 primary records. [2025-10-14T22:41:30.754084] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-14T22:41:30.783056] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:30.785425] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 20160 primary records. [2025-10-14T22:41:30.787285] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-14T22:41:30.787115] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-14T22:41:30.789929] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-14T22:41:30.803137] [INFO ] [MAIN ] Derivative Progress: 1357/1812 symbols completed. SCL took 1.0s. Estimated remaining: 2m 52s. Rate: 158.4 symbols/min [2025-10-14T22:41:30.804020] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:30.819263] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:30.820771] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46575 primary records. [2025-10-14T22:41:30.821909] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-14T22:41:30.835678] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-14T22:41:30.839848] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-14T22:41:30.840034] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-14T22:41:30.840149] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-14T22:41:30.844907] [INFO ] [MAIN ] Derivative Progress: 1358/1812 symbols completed. SCM took 1.1s. Estimated remaining: 2m 52s. Rate: 158.5 symbols/min [2025-10-14T22:41:30.845592] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:30.847658] [INFO ] [MAIN ] Derivative Progress: 1359/1812 symbols completed. SCI took 1.1s. Estimated remaining: 2m 51s. Rate: 158.6 symbols/min [2025-10-14T22:41:30.848360] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:30.872973] [DEBUG] [LOCAL ] SDHC: Loaded 10325 existing records from primary storage. [2025-10-14T22:41:30.873304] [INFO ] [MAIN ] SDHC: Loaded 10325 primary data records. [2025-10-14T22:41:30.934044] [DEBUG] [LOCAL ] SCS: Loaded 43528 existing records from primary storage. [2025-10-14T22:41:30.973819] [INFO ] [MAIN ] SCS: Loaded 43528 primary data records. [2025-10-14T22:41:31.057773] [DEBUG] [LOCAL ] SD: Loaded 28747 existing records from primary storage. [2025-10-14T22:41:31.075233] [INFO ] [MAIN ] SD: Loaded 28747 primary data records. [2025-10-14T22:41:31.931810] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:31.939289] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10325 primary records. [2025-10-14T22:41:31.939431] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-14T22:41:31.939925] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:31.941835] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43528 primary records. [2025-10-14T22:41:31.942875] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-14T22:41:31.985681] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:31.990558] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28747 primary records. [2025-10-14T22:41:31.991920] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-14T22:41:31.993121] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-14T22:41:31.994576] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-14T22:41:31.994424] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-14T22:41:31.995178] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-14T22:41:31.997499] [INFO ] [MAIN ] Derivative Progress: 1360/1812 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 51s. Rate: 158.4 symbols/min [2025-10-14T22:41:32.011071] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:32.011587] [INFO ] [MAIN ] Derivative Progress: 1361/1812 symbols completed. SCS took 1.2s. Estimated remaining: 2m 51s. Rate: 158.5 symbols/min [2025-10-14T22:41:32.012201] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:32.020174] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-14T22:41:32.020415] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-14T22:41:32.022340] [INFO ] [MAIN ] Derivative Progress: 1362/1812 symbols completed. SD took 1.2s. Estimated remaining: 2m 50s. Rate: 158.6 symbols/min [2025-10-14T22:41:32.022569] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:32.028314] [DEBUG] [LOCAL ] SDHY: Loaded 11019 existing records from primary storage. [2025-10-14T22:41:32.030308] [INFO ] [MAIN ] SDHY: Loaded 11019 primary data records. [2025-10-14T22:41:32.339514] [DEBUG] [LOCAL ] SDRL: Loaded 41556 existing records from primary storage. [2025-10-14T22:41:32.347982] [INFO ] [MAIN ] SDRL: Loaded 41556 primary data records. [2025-10-14T22:41:32.570041] [DEBUG] [LOCAL ] SE: Loaded 53305 existing records from primary storage. [2025-10-14T22:41:32.690385] [INFO ] [MAIN ] SE: Loaded 53305 primary data records. [2025-10-14T22:41:33.019397] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:33.020451] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 11019 primary records. [2025-10-14T22:41:33.020740] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-14T22:41:33.041741] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-14T22:41:33.042202] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-14T22:41:33.044876] [INFO ] [MAIN ] Derivative Progress: 1363/1812 symbols completed. SDHY took 1.0s. Estimated remaining: 2m 50s. Rate: 158.4 symbols/min [2025-10-14T22:41:33.058874] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:33.059759] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41556 primary records. [2025-10-14T22:41:33.059823] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-14T22:41:33.078857] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-14T22:41:33.079210] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-14T22:41:33.081338] [INFO ] [MAIN ] Derivative Progress: 1364/1812 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 50s. Rate: 158.5 symbols/min [2025-10-14T22:41:33.099914] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:33.100547] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53305 primary records. [2025-10-14T22:41:33.100606] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-14T22:41:33.116620] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-14T22:41:33.116787] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-14T22:41:33.118827] [INFO ] [MAIN ] Derivative Progress: 1365/1812 symbols completed. SE took 1.1s. Estimated remaining: 2m 49s. Rate: 158.6 symbols/min [2025-10-14T22:41:33.119314] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:33.119422] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:33.119637] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:33.136356] [DEBUG] [LOCAL ] SEG: Loaded 13042 existing records from primary storage. [2025-10-14T22:41:33.136497] [INFO ] [MAIN ] SEG: Loaded 13042 primary data records. [2025-10-14T22:41:33.500600] [DEBUG] [LOCAL ] SEE: Loaded 48203 existing records from primary storage. [2025-10-14T22:41:33.500898] [INFO ] [MAIN ] SEE: Loaded 48203 primary data records. [2025-10-14T22:41:33.626287] [DEBUG] [LOCAL ] SEI: Loaded 49923 existing records from primary storage. [2025-10-14T22:41:33.632189] [INFO ] [MAIN ] SEI: Loaded 49923 primary data records. [2025-10-14T22:41:34.159442] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:34.160501] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13042 primary records. [2025-10-14T22:41:34.160744] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-14T22:41:34.180882] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-14T22:41:34.181451] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-14T22:41:34.184057] [INFO ] [MAIN ] Derivative Progress: 1366/1812 symbols completed. SEG took 1.1s. Estimated remaining: 2m 49s. Rate: 158.4 symbols/min [2025-10-14T22:41:34.184391] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:34.209143] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:34.210735] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48203 primary records. [2025-10-14T22:41:34.211005] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-14T22:41:34.257108] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-14T22:41:34.257324] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:34.257518] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-14T22:41:34.258304] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49923 primary records. [2025-10-14T22:41:34.258393] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-14T22:41:34.260280] [INFO ] [MAIN ] Derivative Progress: 1367/1812 symbols completed. SEE took 1.1s. Estimated remaining: 2m 48s. Rate: 158.5 symbols/min [2025-10-14T22:41:34.261065] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:34.291551] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-14T22:41:34.291723] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-14T22:41:34.294569] [INFO ] [MAIN ] Derivative Progress: 1368/1812 symbols completed. SEI took 1.2s. Estimated remaining: 2m 48s. Rate: 158.6 symbols/min [2025-10-14T22:41:34.292465] [DEBUG] [LOCAL ] SEM: Loaded 43155 existing records from primary storage. [2025-10-14T22:41:34.295020] [INFO ] [MAIN ] SEM: Loaded 43155 primary data records. [2025-10-14T22:41:34.294858] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:34.480822] [DEBUG] [LOCAL ] SEMR: Loaded 41977 existing records from primary storage. [2025-10-14T22:41:34.516010] [INFO ] [MAIN ] SEMR: Loaded 41977 primary data records. [2025-10-14T22:41:34.795200] [DEBUG] [LOCAL ] SES: Loaded 51578 existing records from primary storage. [2025-10-14T22:41:34.796553] [INFO ] [MAIN ] SES: Loaded 51578 primary data records. [2025-10-14T22:41:35.411710] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:35.413694] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43155 primary records. [2025-10-14T22:41:35.413926] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-14T22:41:35.443706] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:35.444575] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41977 primary records. [2025-10-14T22:41:35.445538] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-14T22:41:35.448306] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-14T22:41:35.449453] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-14T22:41:35.462680] [INFO ] [MAIN ] Derivative Progress: 1369/1812 symbols completed. SEM took 1.3s. Estimated remaining: 2m 48s. Rate: 158.3 symbols/min [2025-10-14T22:41:35.463456] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:35.480947] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-14T22:41:35.481166] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-14T22:41:35.481457] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:35.484391] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51578 primary records. [2025-10-14T22:41:35.483608] [INFO ] [MAIN ] Derivative Progress: 1370/1812 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 47s. Rate: 158.5 symbols/min [2025-10-14T22:41:35.484696] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:35.484552] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-14T22:41:35.503013] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-14T22:41:35.503174] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-14T22:41:35.505232] [INFO ] [MAIN ] Derivative Progress: 1371/1812 symbols completed. SES took 1.2s. Estimated remaining: 2m 47s. Rate: 158.6 symbols/min [2025-10-14T22:41:35.505471] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:35.509038] [DEBUG] [LOCAL ] SFB: Loaded 3900 existing records from primary storage. [2025-10-14T22:41:35.509421] [INFO ] [MAIN ] SFB: Loaded 3900 primary data records. [2025-10-14T22:41:35.662912] [DEBUG] [LOCAL ] SFBS: Loaded 21185 existing records from primary storage. [2025-10-14T22:41:35.692056] [INFO ] [MAIN ] SFBS: Loaded 21185 primary data records. [2025-10-14T22:41:35.729707] [DEBUG] [LOCAL ] SF: Loaded 41638 existing records from primary storage. [2025-10-14T22:41:35.870688] [INFO ] [MAIN ] SF: Loaded 41638 primary data records. [2025-10-14T22:41:36.467838] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:36.469107] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 3900 primary records. [2025-10-14T22:41:36.469291] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-14T22:41:36.487595] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-14T22:41:36.488566] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-14T22:41:36.490498] [INFO ] [MAIN ] Derivative Progress: 1372/1812 symbols completed. SFB took 1.0s. Estimated remaining: 2m 47s. Rate: 158.4 symbols/min [2025-10-14T22:41:36.492301] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:36.506253] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:36.508767] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21185 primary records. [2025-10-14T22:41:36.510413] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-14T22:41:36.536116] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:36.538098] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41638 primary records. [2025-10-14T22:41:36.538446] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-14T22:41:36.553678] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-14T22:41:36.554086] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-14T22:41:36.556580] [INFO ] [MAIN ] Derivative Progress: 1373/1812 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 46s. Rate: 158.5 symbols/min [2025-10-14T22:41:36.557240] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:36.570859] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-14T22:41:36.570955] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-14T22:41:36.573106] [INFO ] [MAIN ] Derivative Progress: 1374/1812 symbols completed. SF took 1.1s. Estimated remaining: 2m 46s. Rate: 158.6 symbols/min [2025-10-14T22:41:36.573396] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:36.590114] [DEBUG] [LOCAL ] SFL: Loaded 45328 existing records from primary storage. [2025-10-14T22:41:36.590346] [INFO ] [MAIN ] SFL: Loaded 45328 primary data records. [2025-10-14T22:41:36.924889] [DEBUG] [LOCAL ] SG: Loaded 53488 existing records from primary storage. [2025-10-14T22:41:36.925038] [INFO ] [MAIN ] SG: Loaded 53488 primary data records. [2025-10-14T22:41:37.054556] [DEBUG] [LOCAL ] SGHC: Loaded 46928 existing records from primary storage. [2025-10-14T22:41:37.065132] [INFO ] [MAIN ] SGHC: Loaded 46928 primary data records. [2025-10-14T22:41:37.687249] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:37.693456] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45328 primary records. [2025-10-14T22:41:37.693703] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-14T22:41:37.724472] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-14T22:41:37.724717] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-14T22:41:37.727441] [INFO ] [MAIN ] Derivative Progress: 1375/1812 symbols completed. SFL took 1.2s. Estimated remaining: 2m 46s. Rate: 158.4 symbols/min [2025-10-14T22:41:37.727837] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:37.749063] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:37.749996] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53488 primary records. [2025-10-14T22:41:37.750130] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-14T22:41:37.767799] [DEBUG] [LOCAL ] SGU: Loaded 6580 existing records from primary storage. [2025-10-14T22:41:37.768222] [INFO ] [MAIN ] SGU: Loaded 6580 primary data records. [2025-10-14T22:41:37.866573] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-14T22:41:37.878997] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-14T22:41:37.893116] [INFO ] [MAIN ] Derivative Progress: 1376/1812 symbols completed. SG took 1.3s. Estimated remaining: 2m 45s. Rate: 158.4 symbols/min [2025-10-14T22:41:37.894295] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:37.975304] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:41:38.076765] [INFO ] [MAIN ] SGHC: Generated 1793 derivative records from 46928 primary records. [2025-10-14T22:41:38.089596] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-14T22:41:38.112465] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1793 records). [2025-10-14T22:41:38.112731] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-14T22:41:38.115741] [INFO ] [MAIN ] Derivative Progress: 1377/1812 symbols completed. SGHC took 1.5s. Estimated remaining: 2m 45s. Rate: 158.5 symbols/min [2025-10-14T22:41:38.116308] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:38.150813] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:38.170460] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6580 primary records. [2025-10-14T22:41:38.171530] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-14T22:41:38.173119] [DEBUG] [LOCAL ] SHAK: Loaded 48851 existing records from primary storage. [2025-10-14T22:41:38.183351] [INFO ] [MAIN ] SHAK: Loaded 48851 primary data records. [2025-10-14T22:41:38.290143] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-14T22:41:38.290299] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-14T22:41:38.278919] [DEBUG] [LOCAL ] SHCO: Loaded 25511 existing records from primary storage. [2025-10-14T22:41:38.303581] [INFO ] [MAIN ] Derivative Progress: 1378/1812 symbols completed. SGU took 0.6s. Estimated remaining: 2m 44s. Rate: 158.5 symbols/min [2025-10-14T22:41:38.309873] [INFO ] [MAIN ] SHCO: Loaded 25511 primary data records. [2025-10-14T22:41:38.809783] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:38.810516] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48851 primary records. [2025-10-14T22:41:38.810771] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-14T22:41:38.828507] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-14T22:41:38.828721] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-14T22:41:38.830753] [INFO ] [MAIN ] Derivative Progress: 1379/1812 symbols completed. SHAK took 0.9s. Estimated remaining: 2m 44s. Rate: 158.5 symbols/min [2025-10-14T22:41:38.843516] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:38.844097] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25511 primary records. [2025-10-14T22:41:38.844160] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-14T22:41:38.859061] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-14T22:41:38.859117] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-14T22:41:38.861070] [INFO ] [MAIN ] Derivative Progress: 1380/1812 symbols completed. SHCO took 0.7s. Estimated remaining: 2m 43s. Rate: 158.6 symbols/min [2025-10-14T22:41:38.861421] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:38.861610] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:38.861542] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:38.906303] [DEBUG] [LOCAL ] SHG: Loaded 26502 existing records from primary storage. [2025-10-14T22:41:38.906630] [INFO ] [MAIN ] SHG: Loaded 26502 primary data records. [2025-10-14T22:41:39.042940] [DEBUG] [LOCAL ] SHO: Loaded 49430 existing records from primary storage. [2025-10-14T22:41:39.043155] [INFO ] [MAIN ] SHO: Loaded 49430 primary data records. [2025-10-14T22:41:39.241602] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-10-14T22:41:39.361386] [INFO ] [MAIN ] SHEL: Loaded 53673 primary data records. [2025-10-14T22:41:39.931321] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:39.941010] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26502 primary records. [2025-10-14T22:41:39.941219] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-14T22:41:39.942338] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:39.943558] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49430 primary records. [2025-10-14T22:41:39.943782] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-14T22:41:39.959728] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-14T22:41:39.967111] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-14T22:41:39.968950] [INFO ] [MAIN ] Derivative Progress: 1381/1812 symbols completed. SHG took 1.1s. Estimated remaining: 2m 43s. Rate: 158.4 symbols/min [2025-10-14T22:41:39.973515] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:39.996277] [DEBUG] [LOCAL ] SHOC: Loaded 3300 existing records from primary storage. [2025-10-14T22:41:39.997526] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-14T22:41:39.998216] [INFO ] [MAIN ] SHOC: Loaded 3300 primary data records. [2025-10-14T22:41:39.998325] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-14T22:41:39.998058] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:39.999165] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53673 primary records. [2025-10-14T22:41:40.020169] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-14T22:41:40.045787] [INFO ] [MAIN ] Derivative Progress: 1382/1812 symbols completed. SHO took 1.2s. Estimated remaining: 2m 43s. Rate: 158.5 symbols/min [2025-10-14T22:41:40.072516] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:40.206800] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-14T22:41:40.207001] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-14T22:41:40.209029] [INFO ] [MAIN ] Derivative Progress: 1383/1812 symbols completed. SHEL took 1.3s. Estimated remaining: 2m 42s. Rate: 158.5 symbols/min [2025-10-14T22:41:40.318671] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:40.375254] [DEBUG] [LOCAL ] SHW: Loaded 50357 existing records from primary storage. [2025-10-14T22:41:40.375679] [INFO ] [MAIN ] SHW: Loaded 50357 primary data records. [2025-10-14T22:41:40.481254] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:41:40.510222] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3300 primary records. [2025-10-14T22:41:40.526345] [DEBUG] [LOCAL ] SID: Loaded 42651 existing records from primary storage. [2025-10-14T22:41:40.544181] [INFO ] [MAIN ] SID: Loaded 42651 primary data records. [2025-10-14T22:41:40.558241] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-14T22:41:40.806264] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-14T22:41:40.818140] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-14T22:41:40.820230] [INFO ] [MAIN ] Derivative Progress: 1384/1812 symbols completed. SHOC took 0.8s. Estimated remaining: 2m 42s. Rate: 158.4 symbols/min [2025-10-14T22:41:40.820528] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:41.053141] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:41.054042] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50357 primary records. [2025-10-14T22:41:41.054147] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-14T22:41:41.081948] [DEBUG] [LOCAL ] SIG: Loaded 45688 existing records from primary storage. [2025-10-14T22:41:41.082760] [INFO ] [MAIN ] SIG: Loaded 45688 primary data records. [2025-10-14T22:41:41.201817] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:41.201549] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-14T22:41:41.205191] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-14T22:41:41.209090] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42651 primary records. [2025-10-14T22:41:41.209262] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-14T22:41:41.207929] [INFO ] [MAIN ] Derivative Progress: 1385/1812 symbols completed. SHW took 1.1s. Estimated remaining: 2m 42s. Rate: 158.4 symbols/min [2025-10-14T22:41:41.209483] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:41.451773] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-14T22:41:41.451894] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-14T22:41:41.453810] [INFO ] [MAIN ] Derivative Progress: 1386/1812 symbols completed. SID took 1.1s. Estimated remaining: 2m 41s. Rate: 158.5 symbols/min [2025-10-14T22:41:41.460275] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:41.471240] [DEBUG] [LOCAL ] SII: Loaded 23971 existing records from primary storage. [2025-10-14T22:41:41.471534] [INFO ] [MAIN ] SII: Loaded 23971 primary data records. [2025-10-14T22:41:41.787275] [DEBUG] [LOCAL ] SILA: Loaded 30520 existing records from primary storage. [2025-10-14T22:41:41.788170] [INFO ] [MAIN ] SILA: Loaded 30520 primary data records. [2025-10-14T22:41:41.899560] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:41.912056] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45688 primary records. [2025-10-14T22:41:41.912210] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-14T22:41:42.120713] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-14T22:41:42.129148] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-14T22:41:42.131018] [INFO ] [MAIN ] Derivative Progress: 1387/1812 symbols completed. SIG took 1.3s. Estimated remaining: 2m 41s. Rate: 158.4 symbols/min [2025-10-14T22:41:42.131215] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:42.152847] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:42.153711] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23971 primary records. [2025-10-14T22:41:42.153982] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-14T22:41:42.173487] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-14T22:41:42.173949] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-14T22:41:42.176159] [INFO ] [MAIN ] Derivative Progress: 1388/1812 symbols completed. SII took 1.0s. Estimated remaining: 2m 41s. Rate: 158.5 symbols/min [2025-10-14T22:41:42.176367] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:42.205437] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:42.206566] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30520 primary records. [2025-10-14T22:41:42.206721] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-14T22:41:42.232871] [DEBUG] [LOCAL ] SITC: Loaded 41760 existing records from primary storage. [2025-10-14T22:41:42.233622] [INFO ] [MAIN ] SITC: Loaded 41760 primary data records. [2025-10-14T22:41:42.346222] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-14T22:41:42.356889] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-14T22:41:42.380377] [DEBUG] [LOCAL ] SITE: Loaded 35503 existing records from primary storage. [2025-10-14T22:41:42.379201] [INFO ] [MAIN ] Derivative Progress: 1389/1812 symbols completed. SILA took 0.9s. Estimated remaining: 2m 40s. Rate: 158.5 symbols/min [2025-10-14T22:41:42.380936] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:42.381013] [INFO ] [MAIN ] SITE: Loaded 35503 primary data records. [2025-10-14T22:41:42.935228] [DEBUG] [LOCAL ] SJM: Loaded 50116 existing records from primary storage. [2025-10-14T22:41:42.934091] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:42.935535] [INFO ] [MAIN ] SJM: Loaded 50116 primary data records. [2025-10-14T22:41:42.936504] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41760 primary records. [2025-10-14T22:41:42.936764] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-14T22:41:43.117600] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:43.147741] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35503 primary records. [2025-10-14T22:41:43.147817] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-14T22:41:43.288687] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-14T22:41:43.288778] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-14T22:41:43.290814] [INFO ] [MAIN ] Derivative Progress: 1390/1812 symbols completed. SITC took 1.2s. Estimated remaining: 2m 40s. Rate: 158.4 symbols/min [2025-10-14T22:41:43.290978] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:43.331038] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-14T22:41:43.331250] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-14T22:41:43.334022] [INFO ] [MAIN ] Derivative Progress: 1391/1812 symbols completed. SITE took 1.2s. Estimated remaining: 2m 39s. Rate: 158.5 symbols/min [2025-10-14T22:41:43.334574] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:43.346638] [DEBUG] [LOCAL ] SJT: Loaded 22467 existing records from primary storage. [2025-10-14T22:41:43.346852] [INFO ] [MAIN ] SJT: Loaded 22467 primary data records. [2025-10-14T22:41:43.493163] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:43.504334] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50116 primary records. [2025-10-14T22:41:43.524557] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-14T22:41:43.706158] [DEBUG] [LOCAL ] SKE: Loaded 36810 existing records from primary storage. [2025-10-14T22:41:43.707054] [INFO ] [MAIN ] SKE: Loaded 36810 primary data records. [2025-10-14T22:41:43.791231] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-14T22:41:43.808401] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-14T22:41:43.818204] [INFO ] [MAIN ] Derivative Progress: 1392/1812 symbols completed. SJM took 1.4s. Estimated remaining: 2m 39s. Rate: 158.5 symbols/min [2025-10-14T22:41:43.822684] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:43.909829] [DEBUG] [LOCAL ] SKIL: Loaded 6572 existing records from primary storage. [2025-10-14T22:41:44.026598] [INFO ] [MAIN ] SKIL: Loaded 6572 primary data records. [2025-10-14T22:41:44.290972] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:44.353330] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22467 primary records. [2025-10-14T22:41:44.353962] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-14T22:41:44.373351] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-14T22:41:44.376320] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-14T22:41:44.378544] [INFO ] [MAIN ] Derivative Progress: 1393/1812 symbols completed. SJT took 1.1s. Estimated remaining: 2m 39s. Rate: 158.4 symbols/min [2025-10-14T22:41:44.391700] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:44.392401] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 36810 primary records. [2025-10-14T22:41:44.392542] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-14T22:41:44.414275] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-14T22:41:44.414480] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-14T22:41:44.416640] [INFO ] [MAIN ] Derivative Progress: 1394/1812 symbols completed. SKE took 1.1s. Estimated remaining: 2m 38s. Rate: 158.5 symbols/min [2025-10-14T22:41:44.431552] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:44.432114] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6572 primary records. [2025-10-14T22:41:44.432173] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-14T22:41:44.446439] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-14T22:41:44.446537] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-14T22:41:44.448522] [INFO ] [MAIN ] Derivative Progress: 1395/1812 symbols completed. SKIL took 0.6s. Estimated remaining: 2m 38s. Rate: 158.6 symbols/min [2025-10-14T22:41:44.448980] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:44.449126] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:44.449059] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:44.461575] [DEBUG] [LOCAL ] SKLZ: Loaded 11578 existing records from primary storage. [2025-10-14T22:41:44.461827] [INFO ] [MAIN ] SKLZ: Loaded 11578 primary data records. [2025-10-14T22:41:44.680995] [DEBUG] [LOCAL ] SKM: Loaded 35146 existing records from primary storage. [2025-10-14T22:41:44.807561] [DEBUG] [LOCAL ] SKT: Loaded 42544 existing records from primary storage. [2025-10-14T22:41:44.808242] [INFO ] [MAIN ] SKT: Loaded 42544 primary data records. [2025-10-14T22:41:44.806995] [INFO ] [MAIN ] SKM: Loaded 35146 primary data records. [2025-10-14T22:41:45.485749] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:45.486874] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11578 primary records. [2025-10-14T22:41:45.487063] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-14T22:41:45.503609] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-14T22:41:45.504264] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-14T22:41:45.506314] [INFO ] [MAIN ] Derivative Progress: 1396/1812 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 38s. Rate: 158.4 symbols/min [2025-10-14T22:41:45.506571] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:45.540414] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:45.540233] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:45.541196] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42544 primary records. [2025-10-14T22:41:45.541346] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-14T22:41:45.542446] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35146 primary records. [2025-10-14T22:41:45.542759] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-14T22:41:45.578624] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-14T22:41:45.579452] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-14T22:41:45.581400] [INFO ] [MAIN ] Derivative Progress: 1397/1812 symbols completed. SKM took 1.1s. Estimated remaining: 2m 37s. Rate: 158.5 symbols/min [2025-10-14T22:41:45.582585] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:45.585557] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-14T22:41:45.596246] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-14T22:41:45.598324] [INFO ] [MAIN ] Derivative Progress: 1398/1812 symbols completed. SKT took 1.1s. Estimated remaining: 2m 37s. Rate: 158.6 symbols/min [2025-10-14T22:41:45.598575] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:45.599787] [DEBUG] [LOCAL ] SKY: Loaded 38409 existing records from primary storage. [2025-10-14T22:41:45.600059] [INFO ] [MAIN ] SKY: Loaded 38409 primary data records. [2025-10-14T22:41:45.696845] [DEBUG] [LOCAL ] SKYH: Loaded 16330 existing records from primary storage. [2025-10-14T22:41:45.705842] [INFO ] [MAIN ] SKYH: Loaded 16330 primary data records. [2025-10-14T22:41:46.220844] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-14T22:41:46.221635] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-14T22:41:46.539521] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:46.540776] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38409 primary records. [2025-10-14T22:41:46.540973] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-14T22:41:46.559555] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-14T22:41:46.559973] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-14T22:41:46.561962] [INFO ] [MAIN ] Derivative Progress: 1399/1812 symbols completed. SKY took 1.1s. Estimated remaining: 2m 36s. Rate: 158.4 symbols/min [2025-10-14T22:41:46.569863] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:46.576077] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:46.576777] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16330 primary records. [2025-10-14T22:41:46.577130] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-14T22:41:46.593222] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-14T22:41:46.593672] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-14T22:41:46.595827] [INFO ] [MAIN ] Derivative Progress: 1400/1812 symbols completed. SKYH took 1.0s. Estimated remaining: 2m 36s. Rate: 158.5 symbols/min [2025-10-14T22:41:46.596272] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:46.613082] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:46.613801] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-14T22:41:46.614004] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-14T22:41:46.639075] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-14T22:41:46.639739] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-14T22:41:46.651542] [INFO ] [MAIN ] Derivative Progress: 1401/1812 symbols completed. SLB took 1.1s. Estimated remaining: 2m 35s. Rate: 158.6 symbols/min [2025-10-14T22:41:46.652813] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:46.653922] [DEBUG] [LOCAL ] SLF: Loaded 38782 existing records from primary storage. [2025-10-14T22:41:46.654112] [INFO ] [MAIN ] SLF: Loaded 38782 primary data records. [2025-10-14T22:41:46.794314] [DEBUG] [LOCAL ] SLG: Loaded 45469 existing records from primary storage. [2025-10-14T22:41:46.862993] [INFO ] [MAIN ] SLG: Loaded 45469 primary data records. [2025-10-14T22:41:47.101168] [DEBUG] [LOCAL ] SLGN: Loaded 40779 existing records from primary storage. [2025-10-14T22:41:47.113501] [INFO ] [MAIN ] SLGN: Loaded 40779 primary data records. [2025-10-14T22:41:47.691588] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:47.694326] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38782 primary records. [2025-10-14T22:41:47.694759] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-14T22:41:47.713682] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-14T22:41:47.714477] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-14T22:41:47.716662] [INFO ] [MAIN ] Derivative Progress: 1402/1812 symbols completed. SLF took 1.1s. Estimated remaining: 2m 35s. Rate: 158.4 symbols/min [2025-10-14T22:41:47.716979] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:47.736794] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:47.737557] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45469 primary records. [2025-10-14T22:41:47.737698] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-14T22:41:47.780127] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-14T22:41:47.779329] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:47.780238] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-14T22:41:47.782409] [INFO ] [MAIN ] Derivative Progress: 1403/1812 symbols completed. SLG took 1.2s. Estimated remaining: 2m 35s. Rate: 158.5 symbols/min [2025-10-14T22:41:47.783423] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40779 primary records. [2025-10-14T22:41:47.783525] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-14T22:41:47.783687] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:47.813460] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-14T22:41:47.813571] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-14T22:41:47.813316] [DEBUG] [LOCAL ] SLQT: Loaded 43549 existing records from primary storage. [2025-10-14T22:41:47.815578] [INFO ] [MAIN ] Derivative Progress: 1404/1812 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 34s. Rate: 158.6 symbols/min [2025-10-14T22:41:47.815754] [INFO ] [MAIN ] SLQT: Loaded 43549 primary data records. [2025-10-14T22:41:47.815855] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:47.982510] [DEBUG] [LOCAL ] SLVM: Loaded 27784 existing records from primary storage. [2025-10-14T22:41:48.016791] [INFO ] [MAIN ] SLVM: Loaded 27784 primary data records. [2025-10-14T22:41:48.362871] [DEBUG] [LOCAL ] SM: Loaded 52369 existing records from primary storage. [2025-10-14T22:41:48.384005] [INFO ] [MAIN ] SM: Loaded 52369 primary data records. [2025-10-14T22:41:48.813159] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:48.827884] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43549 primary records. [2025-10-14T22:41:48.828073] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-14T22:41:48.852319] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-14T22:41:48.853092] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-14T22:41:48.856394] [INFO ] [MAIN ] Derivative Progress: 1405/1812 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 34s. Rate: 158.4 symbols/min [2025-10-14T22:41:48.858438] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:48.877426] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:48.881580] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27784 primary records. [2025-10-14T22:41:48.881829] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-14T22:41:48.905450] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-14T22:41:48.919029] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-14T22:41:48.921315] [INFO ] [MAIN ] Derivative Progress: 1406/1812 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 34s. Rate: 158.5 symbols/min [2025-10-14T22:41:48.918847] [DEBUG] [LOCAL ] SMBK: Loaded 8212 existing records from primary storage. [2025-10-14T22:41:48.921741] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:48.922335] [INFO ] [MAIN ] SMBK: Loaded 8212 primary data records. [2025-10-14T22:41:48.922567] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:48.928987] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52369 primary records. [2025-10-14T22:41:48.945755] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-14T22:41:49.059354] [DEBUG] [LOCAL ] SMC: Loaded 11268 existing records from primary storage. [2025-10-14T22:41:49.063601] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-14T22:41:49.074762] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-14T22:41:49.082214] [INFO ] [MAIN ] Derivative Progress: 1407/1812 symbols completed. SM took 1.3s. Estimated remaining: 2m 33s. Rate: 158.6 symbols/min [2025-10-14T22:41:49.082474] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:49.082357] [INFO ] [MAIN ] SMC: Loaded 11268 primary data records. [2025-10-14T22:41:49.674623] [DEBUG] [LOCAL ] SMFG: Loaded 48339 existing records from primary storage. [2025-10-14T22:41:49.675338] [INFO ] [MAIN ] SMFG: Loaded 48339 primary data records. [2025-10-14T22:41:49.771962] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:49.795076] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8212 primary records. [2025-10-14T22:41:49.795278] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-14T22:41:49.990295] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:50.006273] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11268 primary records. [2025-10-14T22:41:50.019743] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-14T22:41:50.021295] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-14T22:41:50.022062] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-14T22:41:50.024120] [INFO ] [MAIN ] Derivative Progress: 1408/1812 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 33s. Rate: 158.4 symbols/min [2025-10-14T22:41:50.040581] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-14T22:41:50.041036] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-14T22:41:50.043041] [INFO ] [MAIN ] Derivative Progress: 1409/1812 symbols completed. SMC took 1.1s. Estimated remaining: 2m 33s. Rate: 158.5 symbols/min [2025-10-14T22:41:50.063062] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:50.063609] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48339 primary records. [2025-10-14T22:41:50.063692] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-14T22:41:50.079040] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-14T22:41:50.079107] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-14T22:41:50.081157] [INFO ] [MAIN ] Derivative Progress: 1410/1812 symbols completed. SMFG took 1.0s. Estimated remaining: 2m 32s. Rate: 158.6 symbols/min [2025-10-14T22:41:50.081745] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:50.081856] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:50.082257] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:50.100104] [DEBUG] [LOCAL ] SMHI: Loaded 13133 existing records from primary storage. [2025-10-14T22:41:50.100313] [INFO ] [MAIN ] SMHI: Loaded 13133 primary data records. [2025-10-14T22:41:50.155000] [DEBUG] [LOCAL ] SMP: Loaded 18889 existing records from primary storage. [2025-10-14T22:41:50.185752] [INFO ] [MAIN ] SMP: Loaded 18889 primary data records. [2025-10-14T22:41:50.494918] [DEBUG] [LOCAL ] SMG: Loaded 43417 existing records from primary storage. [2025-10-14T22:41:50.515717] [INFO ] [MAIN ] SMG: Loaded 43417 primary data records. [2025-10-14T22:41:51.023433] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:51.025153] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13133 primary records. [2025-10-14T22:41:51.026007] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-14T22:41:51.051139] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:51.054618] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 18889 primary records. [2025-10-14T22:41:51.054835] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-14T22:41:51.063923] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-14T22:41:51.067470] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-14T22:41:51.073001] [INFO ] [MAIN ] Derivative Progress: 1411/1812 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 32s. Rate: 158.4 symbols/min [2025-10-14T22:41:51.074353] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-14T22:41:51.074599] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-14T22:41:51.076580] [INFO ] [MAIN ] Derivative Progress: 1412/1812 symbols completed. SMP took 1.0s. Estimated remaining: 2m 31s. Rate: 158.5 symbols/min [2025-10-14T22:41:51.076734] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:51.073264] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:51.093323] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:51.094056] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43417 primary records. [2025-10-14T22:41:51.094166] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-14T22:41:51.110947] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-14T22:41:51.111212] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-14T22:41:51.113351] [INFO ] [MAIN ] Derivative Progress: 1413/1812 symbols completed. SMG took 1.0s. Estimated remaining: 2m 31s. Rate: 158.7 symbols/min [2025-10-14T22:41:51.113580] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:51.171840] [DEBUG] [LOCAL ] SMRT: Loaded 43957 existing records from primary storage. [2025-10-14T22:41:51.172083] [INFO ] [MAIN ] SMRT: Loaded 43957 primary data records. [2025-10-14T22:41:51.194021] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-14T22:41:51.204681] [INFO ] [MAIN ] SMR: Loaded 53799 primary data records. [2025-10-14T22:41:51.680971] [DEBUG] [LOCAL ] SN: Loaded 49980 existing records from primary storage. [2025-10-14T22:41:51.800931] [INFO ] [MAIN ] SN: Loaded 49980 primary data records. [2025-10-14T22:41:52.143299] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:52.149407] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53799 primary records. [2025-10-14T22:41:52.150986] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-14T22:41:52.151422] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:52.153277] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43957 primary records. [2025-10-14T22:41:52.153902] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-14T22:41:52.195189] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-14T22:41:52.196759] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-14T22:41:52.201328] [INFO ] [MAIN ] Derivative Progress: 1414/1812 symbols completed. SMR took 1.1s. Estimated remaining: 2m 31s. Rate: 158.4 symbols/min [2025-10-14T22:41:52.202182] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-14T22:41:52.202463] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-14T22:41:52.204898] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:52.205026] [INFO ] [MAIN ] Derivative Progress: 1415/1812 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 30s. Rate: 158.6 symbols/min [2025-10-14T22:41:52.205368] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:52.220320] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:52.221522] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49980 primary records. [2025-10-14T22:41:52.221816] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-14T22:41:52.242183] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-14T22:41:52.242336] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-14T22:41:52.244746] [INFO ] [MAIN ] Derivative Progress: 1416/1812 symbols completed. SN took 1.1s. Estimated remaining: 2m 30s. Rate: 158.7 symbols/min [2025-10-14T22:41:52.244917] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:52.261327] [DEBUG] [LOCAL ] SNDA: Loaded 4467 existing records from primary storage. [2025-10-14T22:41:52.261509] [INFO ] [MAIN ] SNDA: Loaded 4467 primary data records. [2025-10-14T22:41:52.332407] [DEBUG] [LOCAL ] SNA: Loaded 25723 existing records from primary storage. [2025-10-14T22:41:52.367242] [INFO ] [MAIN ] SNA: Loaded 25723 primary data records. [2025-10-14T22:41:52.486368] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-14T22:41:52.537011] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-14T22:41:53.269696] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:53.271114] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4467 primary records. [2025-10-14T22:41:53.271738] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-14T22:41:53.290965] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-14T22:41:53.291176] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-14T22:41:53.293140] [INFO ] [MAIN ] Derivative Progress: 1417/1812 symbols completed. SNDA took 1.0s. Estimated remaining: 2m 30s. Rate: 158.5 symbols/min [2025-10-14T22:41:53.301492] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:53.307786] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:53.308960] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25723 primary records. [2025-10-14T22:41:53.309320] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-14T22:41:53.325879] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-14T22:41:53.326154] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-14T22:41:53.328596] [INFO ] [MAIN ] Derivative Progress: 1418/1812 symbols completed. SNA took 1.1s. Estimated remaining: 2m 29s. Rate: 158.6 symbols/min [2025-10-14T22:41:53.328838] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:53.346957] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:53.347777] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-14T22:41:53.347943] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-14T22:41:53.376507] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-14T22:41:53.376843] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-14T22:41:53.379399] [INFO ] [MAIN ] Derivative Progress: 1419/1812 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 29s. Rate: 158.7 symbols/min [2025-10-14T22:41:53.379789] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:53.394057] [DEBUG] [LOCAL ] SNDR: Loaded 41514 existing records from primary storage. [2025-10-14T22:41:53.394206] [INFO ] [MAIN ] SNDR: Loaded 41514 primary data records. [2025-10-14T22:41:53.590134] [DEBUG] [LOCAL ] SNN: Loaded 44352 existing records from primary storage. [2025-10-14T22:41:53.611613] [INFO ] [MAIN ] SNN: Loaded 44352 primary data records. [2025-10-14T22:41:53.890980] [DEBUG] [LOCAL ] SNOW: Loaded 53595 existing records from primary storage. [2025-10-14T22:41:53.908858] [INFO ] [MAIN ] SNOW: Loaded 53595 primary data records. [2025-10-14T22:41:54.376594] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:54.377896] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41514 primary records. [2025-10-14T22:41:54.378154] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-14T22:41:54.397998] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-14T22:41:54.398215] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-14T22:41:54.400455] [INFO ] [MAIN ] Derivative Progress: 1420/1812 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 28s. Rate: 158.5 symbols/min [2025-10-14T22:41:54.400766] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:54.421119] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:54.422288] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44352 primary records. [2025-10-14T22:41:54.422524] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-14T22:41:54.436504] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:54.437698] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53595 primary records. [2025-10-14T22:41:54.444994] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-14T22:41:54.467311] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-14T22:41:54.468019] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-14T22:41:54.470328] [INFO ] [MAIN ] Derivative Progress: 1421/1812 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 28s. Rate: 158.6 symbols/min [2025-10-14T22:41:54.471114] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:54.473076] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-14T22:41:54.473293] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-14T22:41:54.475423] [INFO ] [MAIN ] Derivative Progress: 1422/1812 symbols completed. SNN took 1.1s. Estimated remaining: 2m 27s. Rate: 158.7 symbols/min [2025-10-14T22:41:54.475718] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:54.507609] [DEBUG] [LOCAL ] SNV: Loaded 49028 existing records from primary storage. [2025-10-14T22:41:54.507792] [INFO ] [MAIN ] SNV: Loaded 49028 primary data records. [2025-10-14T22:41:54.653085] [DEBUG] [LOCAL ] SNX: Loaded 39600 existing records from primary storage. [2025-10-14T22:41:54.659210] [INFO ] [MAIN ] SNX: Loaded 39600 primary data records. [2025-10-14T22:41:54.939096] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-14T22:41:54.963375] [INFO ] [MAIN ] SO: Loaded 53614 primary data records. [2025-10-14T22:41:55.524463] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:55.526203] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 49028 primary records. [2025-10-14T22:41:55.526632] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-14T22:41:55.556937] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:55.559263] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39600 primary records. [2025-10-14T22:41:55.560008] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-14T22:41:55.570187] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-14T22:41:55.579458] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-14T22:41:55.580412] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-14T22:41:55.583327] [INFO ] [MAIN ] Derivative Progress: 1423/1812 symbols completed. SNX took 1.1s. Estimated remaining: 2m 27s. Rate: 158.4 symbols/min [2025-10-14T22:41:55.575144] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-14T22:41:55.586303] [INFO ] [MAIN ] Derivative Progress: 1424/1812 symbols completed. SNV took 1.2s. Estimated remaining: 2m 27s. Rate: 158.6 symbols/min [2025-10-14T22:41:55.599006] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:55.599631] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53614 primary records. [2025-10-14T22:41:55.599725] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-14T22:41:55.614892] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-14T22:41:55.614956] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-14T22:41:55.617063] [INFO ] [MAIN ] Derivative Progress: 1425/1812 symbols completed. SO took 1.1s. Estimated remaining: 2m 26s. Rate: 158.7 symbols/min [2025-10-14T22:41:55.617439] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:55.617551] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:55.618476] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:55.626233] [DEBUG] [LOCAL ] SOJC: Loaded 4906 existing records from primary storage. [2025-10-14T22:41:55.626409] [INFO ] [MAIN ] SOJC: Loaded 4906 primary data records. [2025-10-14T22:41:55.952835] [DEBUG] [LOCAL ] SOBO: Loaded 39409 existing records from primary storage. [2025-10-14T22:41:55.953086] [INFO ] [MAIN ] SOBO: Loaded 39409 primary data records. [2025-10-14T22:41:56.076254] [DEBUG] [LOCAL ] SOC: Loaded 50853 existing records from primary storage. [2025-10-14T22:41:56.087187] [INFO ] [MAIN ] SOC: Loaded 50853 primary data records. [2025-10-14T22:41:56.606724] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:56.607921] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4906 primary records. [2025-10-14T22:41:56.608689] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-14T22:41:56.627578] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-14T22:41:56.627677] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-14T22:41:56.630088] [INFO ] [MAIN ] Derivative Progress: 1426/1812 symbols completed. SOJC took 1.0s. Estimated remaining: 2m 26s. Rate: 158.5 symbols/min [2025-10-14T22:41:56.632125] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:56.647248] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:56.648001] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39409 primary records. [2025-10-14T22:41:56.648184] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-14T22:41:56.675975] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-14T22:41:56.676209] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-14T22:41:56.674141] [DEBUG] [LOCAL ] SOJD: Loaded 12989 existing records from primary storage. [2025-10-14T22:41:56.676382] [INFO ] [MAIN ] SOJD: Loaded 12989 primary data records. [2025-10-14T22:41:56.678343] [INFO ] [MAIN ] Derivative Progress: 1427/1812 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 26s. Rate: 158.6 symbols/min [2025-10-14T22:41:56.678777] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:56.722853] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:56.736042] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50853 primary records. [2025-10-14T22:41:56.771070] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-14T22:41:56.838821] [DEBUG] [LOCAL ] SOJE: Loaded 8970 existing records from primary storage. [2025-10-14T22:41:56.869940] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-14T22:41:56.878898] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-14T22:41:56.881110] [INFO ] [MAIN ] Derivative Progress: 1428/1812 symbols completed. SOC took 1.3s. Estimated remaining: 2m 25s. Rate: 158.6 symbols/min [2025-10-14T22:41:56.881275] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:56.882157] [INFO ] [MAIN ] SOJE: Loaded 8970 primary data records. [2025-10-14T22:41:57.152448] [DEBUG] [LOCAL ] SOL: Loaded 13206 existing records from primary storage. [2025-10-14T22:41:57.158199] [INFO ] [MAIN ] SOL: Loaded 13206 primary data records. [2025-10-14T22:41:57.682742] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:57.683699] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12989 primary records. [2025-10-14T22:41:57.683940] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-14T22:41:57.716433] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-14T22:41:57.716968] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-14T22:41:57.716888] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:57.719842] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 8970 primary records. [2025-10-14T22:41:57.719039] [INFO ] [MAIN ] Derivative Progress: 1429/1812 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 25s. Rate: 158.5 symbols/min [2025-10-14T22:41:57.720178] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:57.719974] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-14T22:41:57.750552] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:57.751843] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-14T22:41:57.752500] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13206 primary records. [2025-10-14T22:41:57.752708] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-14T22:41:57.755057] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-14T22:41:57.755002] [INFO ] [MAIN ] Derivative Progress: 1430/1812 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 25s. Rate: 158.6 symbols/min [2025-10-14T22:41:57.756261] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:57.782760] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-14T22:41:57.782967] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-14T22:41:57.785287] [INFO ] [MAIN ] Derivative Progress: 1431/1812 symbols completed. SOL took 0.9s. Estimated remaining: 2m 24s. Rate: 158.7 symbols/min [2025-10-14T22:41:57.785592] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:57.810679] [DEBUG] [LOCAL ] SOLV: Loaded 43830 existing records from primary storage. [2025-10-14T22:41:57.810868] [INFO ] [MAIN ] SOLV: Loaded 43830 primary data records. [2025-10-14T22:41:58.039796] [DEBUG] [LOCAL ] SON: Loaded 43266 existing records from primary storage. [2025-10-14T22:41:58.160008] [INFO ] [MAIN ] SON: Loaded 43266 primary data records. [2025-10-14T22:41:58.179234] [DEBUG] [LOCAL ] SONY: Loaded 53379 existing records from primary storage. [2025-10-14T22:41:58.186085] [INFO ] [MAIN ] SONY: Loaded 53379 primary data records. [2025-10-14T22:41:58.788371] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:58.790543] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43830 primary records. [2025-10-14T22:41:58.790920] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-14T22:41:58.809770] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-14T22:41:58.809992] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-14T22:41:58.812352] [INFO ] [MAIN ] Derivative Progress: 1432/1812 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 24s. Rate: 158.5 symbols/min [2025-10-14T22:41:58.812607] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:58.824259] [DEBUG] [LOCAL ] SOR: Loaded 2904 existing records from primary storage. [2025-10-14T22:41:58.832441] [INFO ] [MAIN ] SOR: Loaded 2904 primary data records. [2025-10-14T22:41:58.870886] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:58.881609] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:58.888054] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53379 primary records. [2025-10-14T22:41:58.887415] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43266 primary records. [2025-10-14T22:41:58.895154] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-14T22:41:58.895275] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-14T22:41:58.982897] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-14T22:41:58.987174] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-14T22:41:58.994678] [INFO ] [MAIN ] Derivative Progress: 1433/1812 symbols completed. SONY took 1.2s. Estimated remaining: 2m 23s. Rate: 158.6 symbols/min [2025-10-14T22:41:58.995146] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:59.086143] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-14T22:41:59.223975] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-14T22:41:59.240149] [INFO ] [MAIN ] Derivative Progress: 1434/1812 symbols completed. SON took 1.5s. Estimated remaining: 2m 23s. Rate: 158.6 symbols/min [2025-10-14T22:41:59.246595] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:59.246988] [DEBUG] [LOCAL ] SOS: Loaded 9409 existing records from primary storage. [2025-10-14T22:41:59.247838] [INFO ] [MAIN ] SOS: Loaded 9409 primary data records. [2025-10-14T22:41:59.567697] [DEBUG] [LOCAL ] SPB: Loaded 34199 existing records from primary storage. [2025-10-14T22:41:59.580929] [INFO ] [MAIN ] SPB: Loaded 34199 primary data records. [2025-10-14T22:41:59.902276] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:41:59.904004] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2904 primary records. [2025-10-14T22:41:59.904184] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-14T22:41:59.920616] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-14T22:41:59.921046] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-14T22:41:59.923380] [INFO ] [MAIN ] Derivative Progress: 1435/1812 symbols completed. SOR took 1.1s. Estimated remaining: 2m 23s. Rate: 158.5 symbols/min [2025-10-14T22:41:59.924000] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:41:59.945454] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:41:59.946425] [INFO ] [MAIN ] SOS: Generated 1793 derivative records from 9409 primary records. [2025-10-14T22:41:59.946791] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-14T22:41:59.962397] [DEBUG] [LOCAL ] SOS: Derivative data saved (1793 records). [2025-10-14T22:41:59.962851] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-14T22:41:59.965818] [INFO ] [MAIN ] Derivative Progress: 1436/1812 symbols completed. SOS took 1.0s. Estimated remaining: 2m 22s. Rate: 158.6 symbols/min [2025-10-14T22:41:59.978752] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:00.000281] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:00.001537] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34199 primary records. [2025-10-14T22:42:00.002523] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-14T22:42:00.019563] [DEBUG] [LOCAL ] SPE: Loaded 6303 existing records from primary storage. [2025-10-14T22:42:00.020251] [INFO ] [MAIN ] SPE: Loaded 6303 primary data records. [2025-10-14T22:42:00.050890] [DEBUG] [LOCAL ] SPCE: Loaded 49963 existing records from primary storage. [2025-10-14T22:42:00.074334] [INFO ] [MAIN ] SPCE: Loaded 49963 primary data records. [2025-10-14T22:42:00.101789] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-14T22:42:00.113938] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-14T22:42:00.136482] [INFO ] [MAIN ] Derivative Progress: 1437/1812 symbols completed. SPB took 0.9s. Estimated remaining: 2m 22s. Rate: 158.7 symbols/min [2025-10-14T22:42:00.146868] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:00.669551] [DEBUG] [LOCAL ] SPG: Loaded 50221 existing records from primary storage. [2025-10-14T22:42:00.670128] [INFO ] [MAIN ] SPG: Loaded 50221 primary data records. [2025-10-14T22:42:01.004926] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:01.049231] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:01.051416] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49963 primary records. [2025-10-14T22:42:01.050539] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6303 primary records. [2025-10-14T22:42:01.051677] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-14T22:42:01.051575] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-14T22:42:01.087763] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-14T22:42:01.086109] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-14T22:42:01.088116] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-14T22:42:01.090383] [INFO ] [MAIN ] Derivative Progress: 1438/1812 symbols completed. SPE took 1.1s. Estimated remaining: 2m 22s. Rate: 158.5 symbols/min [2025-10-14T22:42:01.088260] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-14T22:42:01.094212] [INFO ] [MAIN ] Derivative Progress: 1439/1812 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 21s. Rate: 158.6 symbols/min [2025-10-14T22:42:01.113271] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:01.113985] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50221 primary records. [2025-10-14T22:42:01.114050] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-14T22:42:01.129766] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-14T22:42:01.129824] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-14T22:42:01.132178] [INFO ] [MAIN ] Derivative Progress: 1440/1812 symbols completed. SPG took 1.0s. Estimated remaining: 2m 21s. Rate: 158.7 symbols/min [2025-10-14T22:42:01.132578] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:01.132861] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:01.132678] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:01.154586] [DEBUG] [LOCAL ] SPH: Loaded 16691 existing records from primary storage. [2025-10-14T22:42:01.154816] [INFO ] [MAIN ] SPH: Loaded 16691 primary data records. [2025-10-14T22:42:01.339047] [DEBUG] [LOCAL ] SPGI: Loaded 45881 existing records from primary storage. [2025-10-14T22:42:01.353789] [DEBUG] [LOCAL ] SPIR: Loaded 37592 existing records from primary storage. [2025-10-14T22:42:01.372688] [INFO ] [MAIN ] SPGI: Loaded 45881 primary data records. [2025-10-14T22:42:01.398309] [INFO ] [MAIN ] SPIR: Loaded 37592 primary data records. [2025-10-14T22:42:02.196931] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:02.199292] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 16691 primary records. [2025-10-14T22:42:02.199729] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-14T22:42:02.219002] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-14T22:42:02.219482] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-14T22:42:02.221816] [INFO ] [MAIN ] Derivative Progress: 1441/1812 symbols completed. SPH took 1.1s. Estimated remaining: 2m 20s. Rate: 158.5 symbols/min [2025-10-14T22:42:02.223176] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:02.242562] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:02.246454] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37592 primary records. [2025-10-14T22:42:02.247114] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-14T22:42:02.246908] [DEBUG] [LOCAL ] SPMC: Loaded 5266 existing records from primary storage. [2025-10-14T22:42:02.247730] [INFO ] [MAIN ] SPMC: Loaded 5266 primary data records. [2025-10-14T22:42:02.303058] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-14T22:42:02.324154] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-14T22:42:02.368279] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:02.384982] [INFO ] [MAIN ] Derivative Progress: 1442/1812 symbols completed. SPIR took 1.3s. Estimated remaining: 2m 20s. Rate: 158.6 symbols/min [2025-10-14T22:42:02.397775] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:02.397490] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45881 primary records. [2025-10-14T22:42:02.414759] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-14T22:42:02.609468] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-14T22:42:02.610367] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-14T22:42:02.625624] [INFO ] [MAIN ] Derivative Progress: 1443/1812 symbols completed. SPGI took 1.5s. Estimated remaining: 2m 20s. Rate: 158.6 symbols/min [2025-10-14T22:42:02.626218] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:02.644839] [DEBUG] [LOCAL ] SPNT: Loaded 34701 existing records from primary storage. [2025-10-14T22:42:02.646134] [INFO ] [MAIN ] SPNT: Loaded 34701 primary data records. [2025-10-14T22:42:02.734861] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:02.741002] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5266 primary records. [2025-10-14T22:42:02.765505] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-14T22:42:02.898614] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-14T22:42:03.004100] [DEBUG] [LOCAL ] SPOT: Loaded 50374 existing records from primary storage. [2025-10-14T22:42:03.012179] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-14T22:42:03.013075] [INFO ] [MAIN ] SPOT: Loaded 50374 primary data records. [2025-10-14T22:42:03.016268] [INFO ] [MAIN ] Derivative Progress: 1444/1812 symbols completed. SPMC took 0.8s. Estimated remaining: 2m 19s. Rate: 158.6 symbols/min [2025-10-14T22:42:03.068485] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:03.384335] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:03.386034] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34701 primary records. [2025-10-14T22:42:03.386319] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-14T22:42:03.414712] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-14T22:42:03.416014] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-14T22:42:03.418326] [INFO ] [MAIN ] Derivative Progress: 1445/1812 symbols completed. SPNT took 1.0s. Estimated remaining: 2m 19s. Rate: 158.6 symbols/min [2025-10-14T22:42:03.415767] [DEBUG] [LOCAL ] SPR: Loaded 41128 existing records from primary storage. [2025-10-14T22:42:03.419131] [INFO ] [MAIN ] SPR: Loaded 41128 primary data records. [2025-10-14T22:42:03.418888] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:03.504766] [DEBUG] [LOCAL ] SPRU: Loaded 9725 existing records from primary storage. [2025-10-14T22:42:03.518322] [INFO ] [MAIN ] SPRU: Loaded 9725 primary data records. [2025-10-14T22:42:03.628756] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:03.658731] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50374 primary records. [2025-10-14T22:42:03.685495] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-14T22:42:04.061022] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-14T22:42:04.075133] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-14T22:42:04.077485] [INFO ] [MAIN ] Derivative Progress: 1446/1812 symbols completed. SPOT took 1.5s. Estimated remaining: 2m 19s. Rate: 158.5 symbols/min [2025-10-14T22:42:04.078636] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:04.105684] [DEBUG] [LOCAL ] SPXC: Loaded 23372 existing records from primary storage. [2025-10-14T22:42:04.106479] [INFO ] [MAIN ] SPXC: Loaded 23372 primary data records. [2025-10-14T22:42:04.240138] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:04.251430] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:04.257384] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41128 primary records. [2025-10-14T22:42:04.291005] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-14T22:42:04.290903] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9725 primary records. [2025-10-14T22:42:04.316601] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-14T22:42:04.450771] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-14T22:42:04.450941] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-14T22:42:04.453402] [INFO ] [MAIN ] Derivative Progress: 1447/1812 symbols completed. SPR took 1.4s. Estimated remaining: 2m 18s. Rate: 158.5 symbols/min [2025-10-14T22:42:04.463563] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:04.468115] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-14T22:42:04.468612] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-14T22:42:04.470941] [INFO ] [MAIN ] Derivative Progress: 1448/1812 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 18s. Rate: 158.6 symbols/min [2025-10-14T22:42:04.471283] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:04.483564] [DEBUG] [LOCAL ] SPXX: Loaded 9392 existing records from primary storage. [2025-10-14T22:42:04.483985] [INFO ] [MAIN ] SPXX: Loaded 9392 primary data records. [2025-10-14T22:42:04.796031] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:04.823983] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23372 primary records. [2025-10-14T22:42:04.825182] [DEBUG] [LOCAL ] SQM: Loaded 48759 existing records from primary storage. [2025-10-14T22:42:04.825782] [INFO ] [MAIN ] SQM: Loaded 48759 primary data records. [2025-10-14T22:42:04.825958] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-14T22:42:04.944322] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-14T22:42:04.947933] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-14T22:42:04.960771] [INFO ] [MAIN ] Derivative Progress: 1449/1812 symbols completed. SPXC took 0.9s. Estimated remaining: 2m 17s. Rate: 158.6 symbols/min [2025-10-14T22:42:04.971826] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:05.205107] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:05.206369] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9392 primary records. [2025-10-14T22:42:05.206514] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-14T22:42:05.228966] [DEBUG] [LOCAL ] SQNS: Loaded 27373 existing records from primary storage. [2025-10-14T22:42:05.230398] [INFO ] [MAIN ] SQNS: Loaded 27373 primary data records. [2025-10-14T22:42:05.302403] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-14T22:42:05.302802] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-14T22:42:05.311458] [INFO ] [MAIN ] Derivative Progress: 1450/1812 symbols completed. SPXX took 0.8s. Estimated remaining: 2m 17s. Rate: 158.6 symbols/min [2025-10-14T22:42:05.311863] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:05.438589] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:05.560411] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48759 primary records. [2025-10-14T22:42:05.560630] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-14T22:42:05.576548] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-14T22:42:05.577435] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-14T22:42:05.590028] [INFO ] [MAIN ] Derivative Progress: 1451/1812 symbols completed. SQM took 1.1s. Estimated remaining: 2m 17s. Rate: 158.6 symbols/min [2025-10-14T22:42:05.590698] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:05.592190] [DEBUG] [LOCAL ] SR: Loaded 32518 existing records from primary storage. [2025-10-14T22:42:05.592459] [INFO ] [MAIN ] SR: Loaded 32518 primary data records. [2025-10-14T22:42:05.919638] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:05.920582] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 27373 primary records. [2025-10-14T22:42:05.921830] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-14T22:42:05.939158] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-14T22:42:05.953472] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-14T22:42:05.955864] [INFO ] [MAIN ] Derivative Progress: 1452/1812 symbols completed. SQNS took 1.0s. Estimated remaining: 2m 16s. Rate: 158.6 symbols/min [2025-10-14T22:42:05.957768] [DEBUG] [LOCAL ] SRE: Loaded 53419 existing records from primary storage. [2025-10-14T22:42:05.956065] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:05.959051] [INFO ] [MAIN ] SRE: Loaded 53419 primary data records. [2025-10-14T22:42:06.072276] [DEBUG] [LOCAL ] SREA: Loaded 10122 existing records from primary storage. [2025-10-14T22:42:06.072443] [INFO ] [MAIN ] SREA: Loaded 10122 primary data records. [2025-10-14T22:42:06.383494] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:06.408815] [INFO ] [MAIN ] SR: Generated 1793 derivative records from 32518 primary records. [2025-10-14T22:42:06.434055] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-14T22:42:06.606318] [DEBUG] [LOCAL ] SR: Derivative data saved (1793 records). [2025-10-14T22:42:06.606468] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-14T22:42:06.608813] [INFO ] [MAIN ] Derivative Progress: 1453/1812 symbols completed. SR took 1.3s. Estimated remaining: 2m 16s. Rate: 158.5 symbols/min [2025-10-14T22:42:06.633191] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:06.634112] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53419 primary records. [2025-10-14T22:42:06.634289] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-14T22:42:06.652864] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-14T22:42:06.653002] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-14T22:42:06.655208] [INFO ] [MAIN ] Derivative Progress: 1454/1812 symbols completed. SRE took 1.1s. Estimated remaining: 2m 15s. Rate: 158.6 symbols/min [2025-10-14T22:42:06.667764] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:06.668348] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10122 primary records. [2025-10-14T22:42:06.668409] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-14T22:42:06.683272] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-14T22:42:06.683327] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-14T22:42:06.685407] [INFO ] [MAIN ] Derivative Progress: 1455/1812 symbols completed. SREA took 0.7s. Estimated remaining: 2m 15s. Rate: 158.7 symbols/min [2025-10-14T22:42:06.685794] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:06.685937] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:06.686006] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:06.721369] [DEBUG] [LOCAL ] SRG: Loaded 15358 existing records from primary storage. [2025-10-14T22:42:06.730441] [INFO ] [MAIN ] SRG: Loaded 15358 primary data records. [2025-10-14T22:42:06.731054] [DEBUG] [LOCAL ] SRI: Loaded 26491 existing records from primary storage. [2025-10-14T22:42:06.742754] [INFO ] [MAIN ] SRI: Loaded 26491 primary data records. [2025-10-14T22:42:06.945455] [DEBUG] [LOCAL ] SRFM: Loaded 38827 existing records from primary storage. [2025-10-14T22:42:06.951395] [INFO ] [MAIN ] SRFM: Loaded 38827 primary data records. [2025-10-14T22:42:07.720580] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:07.734435] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26491 primary records. [2025-10-14T22:42:07.734935] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-14T22:42:07.734886] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:07.736198] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15358 primary records. [2025-10-14T22:42:07.736442] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-14T22:42:07.766426] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-14T22:42:07.766671] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-14T22:42:07.769136] [INFO ] [MAIN ] Derivative Progress: 1456/1812 symbols completed. SRI took 1.1s. Estimated remaining: 2m 15s. Rate: 158.5 symbols/min [2025-10-14T22:42:07.783713] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:07.784915] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:07.785751] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 38827 primary records. [2025-10-14T22:42:07.786732] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-14T22:42:07.790143] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-14T22:42:07.798316] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-14T22:42:07.808018] [INFO ] [MAIN ] Derivative Progress: 1457/1812 symbols completed. SRG took 1.1s. Estimated remaining: 2m 14s. Rate: 158.6 symbols/min [2025-10-14T22:42:07.808490] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:07.814135] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-14T22:42:07.814344] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-14T22:42:07.816701] [INFO ] [MAIN ] Derivative Progress: 1458/1812 symbols completed. SRFM took 1.1s. Estimated remaining: 2m 14s. Rate: 158.7 symbols/min [2025-10-14T22:42:07.817265] [DEBUG] [LOCAL ] SRV: Loaded 7392 existing records from primary storage. [2025-10-14T22:42:07.817381] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:07.817451] [INFO ] [MAIN ] SRV: Loaded 7392 primary data records. [2025-10-14T22:42:08.027755] [DEBUG] [LOCAL ] SSD: Loaded 22619 existing records from primary storage. [2025-10-14T22:42:08.136776] [INFO ] [MAIN ] SSD: Loaded 22619 primary data records. [2025-10-14T22:42:08.224894] [DEBUG] [LOCAL ] SSB: Loaded 42733 existing records from primary storage. [2025-10-14T22:42:08.242533] [INFO ] [MAIN ] SSB: Loaded 42733 primary data records. [2025-10-14T22:42:08.792406] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:08.795201] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7392 primary records. [2025-10-14T22:42:08.795446] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-14T22:42:08.816484] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-14T22:42:08.817589] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-14T22:42:08.821061] [INFO ] [MAIN ] Derivative Progress: 1459/1812 symbols completed. SRV took 1.0s. Estimated remaining: 2m 14s. Rate: 158.6 symbols/min [2025-10-14T22:42:08.822527] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:08.836911] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:08.837830] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22619 primary records. [2025-10-14T22:42:08.837978] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-14T22:42:08.857007] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-10-14T22:42:08.870285] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-14T22:42:08.872939] [INFO ] [MAIN ] Derivative Progress: 1460/1812 symbols completed. SSD took 1.1s. Estimated remaining: 2m 13s. Rate: 158.7 symbols/min [2025-10-14T22:42:08.873513] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:08.874851] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42733 primary records. [2025-10-14T22:42:08.873750] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:08.875350] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-14T22:42:08.905951] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-14T22:42:08.910815] [DEBUG] [LOCAL ] SST: Loaded 11578 existing records from primary storage. [2025-10-14T22:42:08.910548] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-14T22:42:08.913071] [INFO ] [MAIN ] SST: Loaded 11578 primary data records. [2025-10-14T22:42:08.913005] [INFO ] [MAIN ] Derivative Progress: 1461/1812 symbols completed. SSB took 1.1s. Estimated remaining: 2m 13s. Rate: 158.8 symbols/min [2025-10-14T22:42:08.925201] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:09.007594] [DEBUG] [LOCAL ] SSL: Loaded 41508 existing records from primary storage. [2025-10-14T22:42:09.029891] [INFO ] [MAIN ] SSL: Loaded 41508 primary data records. [2025-10-14T22:42:09.415925] [DEBUG] [LOCAL ] SSTK: Loaded 25249 existing records from primary storage. [2025-10-14T22:42:09.442697] [INFO ] [MAIN ] SSTK: Loaded 25249 primary data records. [2025-10-14T22:42:09.903486] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:09.905232] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11578 primary records. [2025-10-14T22:42:09.905674] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-14T22:42:09.925577] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-14T22:42:09.926741] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-14T22:42:09.929067] [INFO ] [MAIN ] Derivative Progress: 1462/1812 symbols completed. SST took 1.1s. Estimated remaining: 2m 12s. Rate: 158.6 symbols/min [2025-10-14T22:42:09.937152] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:09.942792] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:09.943783] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41508 primary records. [2025-10-14T22:42:09.944009] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-14T22:42:09.960511] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-14T22:42:09.960904] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-14T22:42:09.963179] [INFO ] [MAIN ] Derivative Progress: 1463/1812 symbols completed. SSL took 1.1s. Estimated remaining: 2m 12s. Rate: 158.7 symbols/min [2025-10-14T22:42:09.963427] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:09.983529] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:09.984293] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25249 primary records. [2025-10-14T22:42:09.984371] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-14T22:42:10.003228] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-14T22:42:10.003383] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-14T22:42:10.005569] [INFO ] [MAIN ] Derivative Progress: 1464/1812 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 12s. Rate: 158.8 symbols/min [2025-10-14T22:42:10.005741] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:10.043310] [DEBUG] [LOCAL ] STC: Loaded 17320 existing records from primary storage. [2025-10-14T22:42:10.044372] [INFO ] [MAIN ] STC: Loaded 17320 primary data records. [2025-10-14T22:42:10.175637] [DEBUG] [LOCAL ] ST: Loaded 49853 existing records from primary storage. [2025-10-14T22:42:10.171265] [DEBUG] [LOCAL ] STAG: Loaded 50116 existing records from primary storage. [2025-10-14T22:42:10.176203] [INFO ] [MAIN ] STAG: Loaded 50116 primary data records. [2025-10-14T22:42:10.186767] [INFO ] [MAIN ] ST: Loaded 49853 primary data records. [2025-10-14T22:42:11.032448] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:11.033727] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17320 primary records. [2025-10-14T22:42:11.033863] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-14T22:42:11.055381] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:11.059684] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50116 primary records. [2025-10-14T22:42:11.059992] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-14T22:42:11.084893] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-14T22:42:11.085089] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-14T22:42:11.084777] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-14T22:42:11.085222] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-14T22:42:11.096522] [INFO ] [MAIN ] Derivative Progress: 1465/1812 symbols completed. STC took 1.1s. Estimated remaining: 2m 11s. Rate: 158.6 symbols/min [2025-10-14T22:42:11.098928] [INFO ] [MAIN ] Derivative Progress: 1466/1812 symbols completed. STAG took 1.1s. Estimated remaining: 2m 11s. Rate: 158.7 symbols/min [2025-10-14T22:42:11.096722] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:11.103963] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:11.105224] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:11.105948] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49853 primary records. [2025-10-14T22:42:11.106011] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-14T22:42:11.124563] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-14T22:42:11.124799] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-14T22:42:11.127073] [INFO ] [MAIN ] Derivative Progress: 1467/1812 symbols completed. ST took 1.2s. Estimated remaining: 2m 10s. Rate: 158.8 symbols/min [2025-10-14T22:42:11.127339] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:11.145726] [DEBUG] [LOCAL ] STEL: Loaded 22708 existing records from primary storage. [2025-10-14T22:42:11.145856] [INFO ] [MAIN ] STEL: Loaded 22708 primary data records. [2025-10-14T22:42:11.268937] [DEBUG] [LOCAL ] STE: Loaded 35362 existing records from primary storage. [2025-10-14T22:42:11.279948] [INFO ] [MAIN ] STE: Loaded 35362 primary data records. [2025-10-14T22:42:11.609089] [DEBUG] [LOCAL ] STEM: Loaded 38827 existing records from primary storage. [2025-10-14T22:42:11.645260] [INFO ] [MAIN ] STEM: Loaded 38827 primary data records. [2025-10-14T22:42:12.129447] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:12.131252] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22708 primary records. [2025-10-14T22:42:12.131625] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-14T22:42:12.163406] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-14T22:42:12.164019] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:12.164118] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-14T22:42:12.167129] [INFO ] [MAIN ] Derivative Progress: 1468/1812 symbols completed. STEL took 1.1s. Estimated remaining: 2m 10s. Rate: 158.6 symbols/min [2025-10-14T22:42:12.164922] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35362 primary records. [2025-10-14T22:42:12.167992] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-14T22:42:12.185303] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-14T22:42:12.186241] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-14T22:42:12.189130] [INFO ] [MAIN ] Derivative Progress: 1469/1812 symbols completed. STE took 1.1s. Estimated remaining: 2m 10s. Rate: 158.7 symbols/min [2025-10-14T22:42:12.202771] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:12.203345] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 38827 primary records. [2025-10-14T22:42:12.203402] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-14T22:42:12.218286] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-14T22:42:12.218342] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-14T22:42:12.220421] [INFO ] [MAIN ] Derivative Progress: 1470/1812 symbols completed. STEM took 1.1s. Estimated remaining: 2m 9s. Rate: 158.8 symbols/min [2025-10-14T22:42:12.220851] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:12.221041] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:12.220975] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:12.235010] [DEBUG] [LOCAL ] STK: Loaded 9720 existing records from primary storage. [2025-10-14T22:42:12.238763] [INFO ] [MAIN ] STK: Loaded 9720 primary data records. [2025-10-14T22:42:12.315416] [DEBUG] [LOCAL ] STEW: Loaded 15793 existing records from primary storage. [2025-10-14T22:42:12.332937] [INFO ] [MAIN ] STEW: Loaded 15793 primary data records. [2025-10-14T22:42:12.777844] [DEBUG] [LOCAL ] STLA: Loaded 53555 existing records from primary storage. [2025-10-14T22:42:12.923278] [INFO ] [MAIN ] STLA: Loaded 53555 primary data records. [2025-10-14T22:42:13.253667] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:13.254877] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9720 primary records. [2025-10-14T22:42:13.255169] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-14T22:42:13.288676] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:13.290430] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-14T22:42:13.291676] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-14T22:42:13.293890] [INFO ] [MAIN ] Derivative Progress: 1471/1812 symbols completed. STK took 1.1s. Estimated remaining: 2m 9s. Rate: 158.6 symbols/min [2025-10-14T22:42:13.291464] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 15793 primary records. [2025-10-14T22:42:13.294193] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:13.294982] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-14T22:42:13.313746] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-14T22:42:13.314850] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-14T22:42:13.317221] [INFO ] [MAIN ] Derivative Progress: 1472/1812 symbols completed. STEW took 1.1s. Estimated remaining: 2m 9s. Rate: 158.7 symbols/min [2025-10-14T22:42:13.319451] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:13.343492] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:13.344513] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53555 primary records. [2025-10-14T22:42:13.344731] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-14T22:42:13.371054] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-14T22:42:13.371299] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-14T22:42:13.373756] [INFO ] [MAIN ] Derivative Progress: 1473/1812 symbols completed. STLA took 1.2s. Estimated remaining: 2m 8s. Rate: 158.8 symbols/min [2025-10-14T22:42:13.373963] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:13.395768] [DEBUG] [LOCAL ] STN: Loaded 22823 existing records from primary storage. [2025-10-14T22:42:13.395907] [INFO ] [MAIN ] STN: Loaded 22823 primary data records. [2025-10-14T22:42:13.516201] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-14T22:42:13.537526] [INFO ] [MAIN ] STM: Loaded 53573 primary data records. [2025-10-14T22:42:13.846982] [DEBUG] [LOCAL ] STNG: Loaded 43645 existing records from primary storage. [2025-10-14T22:42:13.858753] [INFO ] [MAIN ] STNG: Loaded 43645 primary data records. [2025-10-14T22:42:14.359427] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:14.360540] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22823 primary records. [2025-10-14T22:42:14.360630] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-14T22:42:14.394830] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-14T22:42:14.395220] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:14.395460] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-14T22:42:14.397640] [INFO ] [MAIN ] Derivative Progress: 1474/1812 symbols completed. STN took 1.1s. Estimated remaining: 2m 8s. Rate: 158.6 symbols/min [2025-10-14T22:42:14.398552] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53573 primary records. [2025-10-14T22:42:14.398783] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-14T22:42:14.411016] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:14.420565] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-14T22:42:14.420929] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-14T22:42:14.423019] [INFO ] [MAIN ] Derivative Progress: 1475/1812 symbols completed. STM took 1.1s. Estimated remaining: 2m 7s. Rate: 158.7 symbols/min [2025-10-14T22:42:14.438438] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:14.438812] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:14.439903] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43645 primary records. [2025-10-14T22:42:14.444204] [DEBUG] [LOCAL ] STRV: Loaded 11234 existing records from primary storage. [2025-10-14T22:42:14.444319] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-14T22:42:14.445231] [INFO ] [MAIN ] STRV: Loaded 11234 primary data records. [2025-10-14T22:42:14.535986] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-14T22:42:14.541242] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-14T22:42:14.567107] [INFO ] [MAIN ] Derivative Progress: 1476/1812 symbols completed. STNG took 1.2s. Estimated remaining: 2m 7s. Rate: 158.8 symbols/min [2025-10-14T22:42:14.567718] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:14.806321] [DEBUG] [LOCAL ] STVN: Loaded 26710 existing records from primary storage. [2025-10-14T22:42:14.807790] [INFO ] [MAIN ] STVN: Loaded 26710 primary data records. [2025-10-14T22:42:14.807611] [DEBUG] [LOCAL ] STT: Loaded 51051 existing records from primary storage. [2025-10-14T22:42:14.814791] [INFO ] [MAIN ] STT: Loaded 51051 primary data records. [2025-10-14T22:42:15.166357] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:15.459332] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11234 primary records. [2025-10-14T22:42:15.460110] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-14T22:42:15.482606] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-10-14T22:42:15.482889] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-14T22:42:15.484956] [INFO ] [MAIN ] Derivative Progress: 1477/1812 symbols completed. STRV took 1.1s. Estimated remaining: 2m 7s. Rate: 158.6 symbols/min [2025-10-14T22:42:15.485557] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:15.509728] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:15.510784] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51051 primary records. [2025-10-14T22:42:15.512741] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-14T22:42:15.539511] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:15.541867] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26710 primary records. [2025-10-14T22:42:15.542207] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-14T22:42:15.544368] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-14T22:42:15.544730] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-14T22:42:15.546857] [INFO ] [MAIN ] Derivative Progress: 1478/1812 symbols completed. STT took 1.1s. Estimated remaining: 2m 6s. Rate: 158.7 symbols/min [2025-10-14T22:42:15.568069] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:15.576856] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-14T22:42:15.576950] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-14T22:42:15.579488] [INFO ] [MAIN ] Derivative Progress: 1479/1812 symbols completed. STVN took 1.0s. Estimated remaining: 2m 6s. Rate: 158.8 symbols/min [2025-10-14T22:42:15.579735] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:15.582934] [DEBUG] [LOCAL ] STXD: Loaded 1241 existing records from primary storage. [2025-10-14T22:42:15.583887] [INFO ] [MAIN ] STXD: Loaded 1241 primary data records. [2025-10-14T22:42:15.645462] [DEBUG] [LOCAL ] STXE: Loaded 2085 existing records from primary storage. [2025-10-14T22:42:15.667771] [DEBUG] [LOCAL ] STWD: Loaded 51984 existing records from primary storage. [2025-10-14T22:42:15.673025] [INFO ] [MAIN ] STXE: Loaded 2085 primary data records. [2025-10-14T22:42:15.690105] [INFO ] [MAIN ] STWD: Loaded 51984 primary data records. [2025-10-14T22:42:16.527240] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:16.533709] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1241 primary records. [2025-10-14T22:42:16.534373] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-14T22:42:16.553504] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-14T22:42:16.553731] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-14T22:42:16.565291] [INFO ] [MAIN ] Derivative Progress: 1480/1812 symbols completed. STXD took 1.0s. Estimated remaining: 2m 6s. Rate: 158.6 symbols/min [2025-10-14T22:42:16.570578] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:16.571359] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:42:16.584317] [INFO ] [MAIN ] STXE: Generated 1792 derivative records from 2085 primary records. [2025-10-14T22:42:16.589852] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-14T22:42:16.591351] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:16.598176] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51984 primary records. [2025-10-14T22:42:16.599672] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-14T22:42:16.602327] [DEBUG] [LOCAL ] STXG: Loaded 2428 existing records from primary storage. [2025-10-14T22:42:16.606394] [INFO ] [MAIN ] STXG: Loaded 2428 primary data records. [2025-10-14T22:42:16.675553] [DEBUG] [LOCAL ] STXE: Derivative data saved (1792 records). [2025-10-14T22:42:16.684036] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-14T22:42:16.688218] [INFO ] [MAIN ] Derivative Progress: 1481/1812 symbols completed. STXE took 1.1s. Estimated remaining: 2m 5s. Rate: 158.7 symbols/min [2025-10-14T22:42:16.697999] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:16.748603] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-14T22:42:16.751000] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-14T22:42:16.750836] [DEBUG] [LOCAL ] STXK: Loaded 1522 existing records from primary storage. [2025-10-14T22:42:16.763880] [INFO ] [MAIN ] Derivative Progress: 1482/1812 symbols completed. STWD took 1.3s. Estimated remaining: 2m 5s. Rate: 158.8 symbols/min [2025-10-14T22:42:16.769472] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:16.769329] [INFO ] [MAIN ] STXK: Loaded 1522 primary data records. [2025-10-14T22:42:16.991587] [DEBUG] [LOCAL ] STXT: Loaded 2493 existing records from primary storage. [2025-10-14T22:42:17.079329] [INFO ] [MAIN ] STXT: Loaded 2493 primary data records. [2025-10-14T22:42:17.621174] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:17.622243] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2428 primary records. [2025-10-14T22:42:17.622801] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-14T22:42:17.640856] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-14T22:42:17.641057] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-14T22:42:17.643369] [INFO ] [MAIN ] Derivative Progress: 1483/1812 symbols completed. STXG took 1.1s. Estimated remaining: 2m 4s. Rate: 158.6 symbols/min [2025-10-14T22:42:17.656168] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-14T22:42:17.656804] [INFO ] [MAIN ] STXK: Generated 1789 derivative records from 1522 primary records. [2025-10-14T22:42:17.656978] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-14T22:42:17.672918] [DEBUG] [LOCAL ] STXK: Derivative data saved (1789 records). [2025-10-14T22:42:17.673025] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-14T22:42:17.675056] [INFO ] [MAIN ] Derivative Progress: 1484/1812 symbols completed. STXK took 1.0s. Estimated remaining: 2m 4s. Rate: 158.7 symbols/min [2025-10-14T22:42:17.687804] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:17.688387] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2493 primary records. [2025-10-14T22:42:17.688448] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-14T22:42:17.701934] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-10-14T22:42:17.701999] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-14T22:42:17.703934] [INFO ] [MAIN ] Derivative Progress: 1485/1812 symbols completed. STXT took 0.9s. Estimated remaining: 2m 4s. Rate: 158.8 symbols/min [2025-10-14T22:42:17.704284] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:17.704375] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:17.704462] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:17.709788] [DEBUG] [LOCAL ] STXV: Loaded 1522 existing records from primary storage. [2025-10-14T22:42:17.709914] [INFO ] [MAIN ] STXV: Loaded 1522 primary data records. [2025-10-14T22:42:18.066771] [DEBUG] [LOCAL ] SU: Loaded 53426 existing records from primary storage. [2025-10-14T22:42:18.067894] [INFO ] [MAIN ] SU: Loaded 53426 primary data records. [2025-10-14T22:42:18.067452] [DEBUG] [LOCAL ] STZ: Loaded 52396 existing records from primary storage. [2025-10-14T22:42:18.079327] [INFO ] [MAIN ] STZ: Loaded 52396 primary data records. [2025-10-14T22:42:18.764120] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:18.765310] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1522 primary records. [2025-10-14T22:42:18.765480] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-14T22:42:18.785811] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-10-14T22:42:18.785969] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-14T22:42:18.788365] [INFO ] [MAIN ] Derivative Progress: 1486/1812 symbols completed. STXV took 1.1s. Estimated remaining: 2m 3s. Rate: 158.6 symbols/min [2025-10-14T22:42:18.788739] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:18.808454] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:18.809201] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53426 primary records. [2025-10-14T22:42:18.809504] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-14T22:42:18.843010] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:18.842519] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-14T22:42:18.843754] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52396 primary records. [2025-10-14T22:42:18.843988] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-14T22:42:18.844124] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-14T22:42:18.845860] [INFO ] [MAIN ] Derivative Progress: 1487/1812 symbols completed. SU took 1.1s. Estimated remaining: 2m 3s. Rate: 158.7 symbols/min [2025-10-14T22:42:18.847029] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:18.874485] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-14T22:42:18.885932] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-14T22:42:18.888284] [INFO ] [MAIN ] Derivative Progress: 1488/1812 symbols completed. STZ took 1.2s. Estimated remaining: 2m 2s. Rate: 158.8 symbols/min [2025-10-14T22:42:18.888484] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:18.889616] [DEBUG] [LOCAL ] SUI: Loaded 42002 existing records from primary storage. [2025-10-14T22:42:18.890157] [INFO ] [MAIN ] SUI: Loaded 42002 primary data records. [2025-10-14T22:42:19.213638] [DEBUG] [LOCAL ] SUN: Loaded 38233 existing records from primary storage. [2025-10-14T22:42:19.214387] [INFO ] [MAIN ] SUN: Loaded 38233 primary data records. [2025-10-14T22:42:19.340695] [DEBUG] [LOCAL ] SUPV: Loaded 47754 existing records from primary storage. [2025-10-14T22:42:19.351680] [INFO ] [MAIN ] SUPV: Loaded 47754 primary data records. [2025-10-14T22:42:19.866442] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:19.868222] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 42002 primary records. [2025-10-14T22:42:19.868423] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-14T22:42:19.887188] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-14T22:42:19.888915] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-14T22:42:19.891839] [INFO ] [MAIN ] Derivative Progress: 1489/1812 symbols completed. SUI took 1.1s. Estimated remaining: 2m 2s. Rate: 158.6 symbols/min [2025-10-14T22:42:19.892167] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:19.906374] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:19.907193] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 38233 primary records. [2025-10-14T22:42:19.907269] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-14T22:42:19.926811] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-14T22:42:19.927019] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-14T22:42:19.928893] [INFO ] [MAIN ] Derivative Progress: 1490/1812 symbols completed. SUN took 1.1s. Estimated remaining: 2m 2s. Rate: 158.7 symbols/min [2025-10-14T22:42:19.929236] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:19.944800] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:19.945810] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47754 primary records. [2025-10-14T22:42:19.945883] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-14T22:42:19.976267] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-14T22:42:19.976498] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-14T22:42:19.978827] [INFO ] [MAIN ] Derivative Progress: 1491/1812 symbols completed. SUPV took 1.1s. Estimated remaining: 2m 1s. Rate: 158.8 symbols/min [2025-10-14T22:42:19.979166] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:20.002591] [DEBUG] [LOCAL ] SUZ: Loaded 45714 existing records from primary storage. [2025-10-14T22:42:20.002844] [INFO ] [MAIN ] SUZ: Loaded 45714 primary data records. [2025-10-14T22:42:20.122352] [DEBUG] [LOCAL ] SVV: Loaded 40167 existing records from primary storage. [2025-10-14T22:42:20.122687] [INFO ] [MAIN ] SVV: Loaded 40167 primary data records. [2025-10-14T22:42:20.532891] [DEBUG] [LOCAL ] SW: Loaded 53187 existing records from primary storage. [2025-10-14T22:42:20.568252] [INFO ] [MAIN ] SW: Loaded 53187 primary data records. [2025-10-14T22:42:21.016075] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:21.017060] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45714 primary records. [2025-10-14T22:42:21.017319] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-14T22:42:21.037311] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-14T22:42:21.037547] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-14T22:42:21.039897] [INFO ] [MAIN ] Derivative Progress: 1492/1812 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 1s. Rate: 158.6 symbols/min [2025-10-14T22:42:21.047897] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:21.053933] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:21.054810] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 40167 primary records. [2025-10-14T22:42:21.055088] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-14T22:42:21.075835] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-14T22:42:21.076104] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-14T22:42:21.078529] [INFO ] [MAIN ] Derivative Progress: 1493/1812 symbols completed. SVV took 1.1s. Estimated remaining: 2m 1s. Rate: 158.7 symbols/min [2025-10-14T22:42:21.078938] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:21.094957] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:21.095944] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53187 primary records. [2025-10-14T22:42:21.096087] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-14T22:42:21.131882] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-14T22:42:21.132046] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-14T22:42:21.135471] [INFO ] [MAIN ] Derivative Progress: 1494/1812 symbols completed. SW took 1.2s. Estimated remaining: 2m 0s. Rate: 158.8 symbols/min [2025-10-14T22:42:21.136419] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:21.161827] [DEBUG] [LOCAL ] SWK: Loaded 52481 existing records from primary storage. [2025-10-14T22:42:21.171111] [INFO ] [MAIN ] SWK: Loaded 52481 primary data records. [2025-10-14T22:42:21.171716] [DEBUG] [LOCAL ] SWX: Loaded 31078 existing records from primary storage. [2025-10-14T22:42:21.182962] [INFO ] [MAIN ] SWX: Loaded 31078 primary data records. [2025-10-14T22:42:21.195491] [DEBUG] [LOCAL ] SWZ: Loaded 6078 existing records from primary storage. [2025-10-14T22:42:21.217416] [INFO ] [MAIN ] SWZ: Loaded 6078 primary data records. [2025-10-14T22:42:22.130137] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:22.131811] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31078 primary records. [2025-10-14T22:42:22.132730] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-14T22:42:22.130759] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:22.136374] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52481 primary records. [2025-10-14T22:42:22.143756] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-14T22:42:22.176972] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:22.179769] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6078 primary records. [2025-10-14T22:42:22.180933] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-14T22:42:22.185210] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-14T22:42:22.185972] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-14T22:42:22.195633] [INFO ] [MAIN ] Derivative Progress: 1495/1812 symbols completed. SWX took 1.1s. Estimated remaining: 1m 60s. Rate: 158.6 symbols/min [2025-10-14T22:42:22.196165] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:22.205239] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-14T22:42:22.206010] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-14T22:42:22.206160] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-14T22:42:22.206095] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-14T22:42:22.208428] [INFO ] [MAIN ] Derivative Progress: 1496/1812 symbols completed. SWZ took 1.1s. Estimated remaining: 1m 59s. Rate: 158.7 symbols/min [2025-10-14T22:42:22.210584] [INFO ] [MAIN ] Derivative Progress: 1497/1812 symbols completed. SWK took 1.2s. Estimated remaining: 1m 59s. Rate: 158.8 symbols/min [2025-10-14T22:42:22.210529] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:22.211249] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:22.234161] [DEBUG] [LOCAL ] SXI: Loaded 11927 existing records from primary storage. [2025-10-14T22:42:22.234317] [INFO ] [MAIN ] SXI: Loaded 11927 primary data records. [2025-10-14T22:42:22.385835] [DEBUG] [LOCAL ] SXT: Loaded 29849 existing records from primary storage. [2025-10-14T22:42:22.391792] [DEBUG] [LOCAL ] SXC: Loaded 41631 existing records from primary storage. [2025-10-14T22:42:22.414627] [INFO ] [MAIN ] SXC: Loaded 41631 primary data records. [2025-10-14T22:42:22.446784] [INFO ] [MAIN ] SXT: Loaded 29849 primary data records. [2025-10-14T22:42:23.219315] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:23.220813] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11927 primary records. [2025-10-14T22:42:23.221401] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-14T22:42:23.243246] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-14T22:42:23.243799] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-14T22:42:23.245951] [INFO ] [MAIN ] Derivative Progress: 1498/1812 symbols completed. SXI took 1.0s. Estimated remaining: 1m 59s. Rate: 158.7 symbols/min [2025-10-14T22:42:23.259027] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:23.259621] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29849 primary records. [2025-10-14T22:42:23.259789] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-14T22:42:23.288064] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:23.289111] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41631 primary records. [2025-10-14T22:42:23.289765] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-14T22:42:23.290207] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-14T22:42:23.290772] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-14T22:42:23.293107] [INFO ] [MAIN ] Derivative Progress: 1499/1812 symbols completed. SXT took 1.1s. Estimated remaining: 1m 58s. Rate: 158.7 symbols/min [2025-10-14T22:42:23.307660] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-14T22:42:23.307724] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-14T22:42:23.309665] [INFO ] [MAIN ] Derivative Progress: 1500/1812 symbols completed. SXC took 1.1s. Estimated remaining: 1m 58s. Rate: 158.8 symbols/min [2025-10-14T22:42:23.310019] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:23.310111] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:23.310430] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:23.371013] [DEBUG] [LOCAL ] SYY: Loaded 53229 existing records from primary storage. [2025-10-14T22:42:23.371181] [INFO ] [MAIN ] SYY: Loaded 53229 primary data records. [2025-10-14T22:42:23.572294] [DEBUG] [LOCAL ] SYK: Loaded 46923 existing records from primary storage. [2025-10-14T22:42:23.602160] [DEBUG] [LOCAL ] SYF: Loaded 53453 existing records from primary storage. [2025-10-14T22:42:23.600929] [INFO ] [MAIN ] SYK: Loaded 46923 primary data records. [2025-10-14T22:42:23.602317] [INFO ] [MAIN ] SYF: Loaded 53453 primary data records. [2025-10-14T22:42:24.339411] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:24.340932] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53229 primary records. [2025-10-14T22:42:24.341379] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-14T22:42:24.359477] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-14T22:42:24.359703] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-14T22:42:24.361968] [INFO ] [MAIN ] Derivative Progress: 1501/1812 symbols completed. SYY took 1.1s. Estimated remaining: 1m 58s. Rate: 158.7 symbols/min [2025-10-14T22:42:24.362134] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:24.380260] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:24.380989] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46923 primary records. [2025-10-14T22:42:24.381136] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-14T22:42:24.398132] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-14T22:42:24.399223] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-14T22:42:24.402203] [INFO ] [MAIN ] Derivative Progress: 1502/1812 symbols completed. SYK took 1.1s. Estimated remaining: 1m 57s. Rate: 158.8 symbols/min [2025-10-14T22:42:24.402415] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:24.418137] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:24.418885] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53453 primary records. [2025-10-14T22:42:24.419071] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-14T22:42:24.451210] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-14T22:42:24.451371] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-14T22:42:24.453631] [INFO ] [MAIN ] Derivative Progress: 1503/1812 symbols completed. SYF took 1.1s. Estimated remaining: 1m 57s. Rate: 158.8 symbols/min [2025-10-14T22:42:24.454126] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:24.481554] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-14T22:42:24.481922] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-14T22:42:24.605730] [DEBUG] [LOCAL ] TAC: Loaded 43001 existing records from primary storage. [2025-10-14T22:42:24.616308] [INFO ] [MAIN ] TAC: Loaded 43001 primary data records. [2025-10-14T22:42:24.979168] [DEBUG] [LOCAL ] TAK: Loaded 50104 existing records from primary storage. [2025-10-14T22:42:24.990221] [INFO ] [MAIN ] TAK: Loaded 50104 primary data records. [2025-10-14T22:42:25.486827] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:25.488461] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-14T22:42:25.488743] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-14T22:42:25.523168] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-14T22:42:25.523389] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-14T22:42:25.526310] [INFO ] [MAIN ] Derivative Progress: 1504/1812 symbols completed. T took 1.2s. Estimated remaining: 1m 56s. Rate: 158.7 symbols/min [2025-10-14T22:42:25.526711] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:25.522780] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:25.528097] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 43001 primary records. [2025-10-14T22:42:25.528408] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-14T22:42:25.558424] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:25.559402] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 50104 primary records. [2025-10-14T22:42:25.559906] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-14T22:42:25.561119] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-14T22:42:25.568374] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-14T22:42:25.574035] [INFO ] [MAIN ] Derivative Progress: 1505/1812 symbols completed. TAC took 1.2s. Estimated remaining: 1m 56s. Rate: 158.7 symbols/min [2025-10-14T22:42:25.575947] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:25.579274] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-14T22:42:25.579416] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-14T22:42:25.581374] [INFO ] [MAIN ] Derivative Progress: 1506/1812 symbols completed. TAK took 1.1s. Estimated remaining: 1m 56s. Rate: 158.8 symbols/min [2025-10-14T22:42:25.581536] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:25.621373] [DEBUG] [LOCAL ] TAL: Loaded 51795 existing records from primary storage. [2025-10-14T22:42:25.621575] [INFO ] [MAIN ] TAL: Loaded 51795 primary data records. [2025-10-14T22:42:25.844697] [DEBUG] [LOCAL ] TALO: Loaded 50962 existing records from primary storage. [2025-10-14T22:42:25.862681] [INFO ] [MAIN ] TALO: Loaded 50962 primary data records. [2025-10-14T22:42:25.992514] [DEBUG] [LOCAL ] TAP: Loaded 52960 existing records from primary storage. [2025-10-14T22:42:26.019225] [INFO ] [MAIN ] TAP: Loaded 52960 primary data records. [2025-10-14T22:42:26.657484] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:26.659160] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51795 primary records. [2025-10-14T22:42:26.660209] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-14T22:42:26.679323] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-14T22:42:26.680369] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-14T22:42:26.682934] [INFO ] [MAIN ] Derivative Progress: 1507/1812 symbols completed. TAL took 1.2s. Estimated remaining: 1m 55s. Rate: 158.6 symbols/min [2025-10-14T22:42:26.683535] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:26.700598] [DEBUG] [LOCAL ] TBB: Loaded 11578 existing records from primary storage. [2025-10-14T22:42:26.713026] [INFO ] [MAIN ] TBB: Loaded 11578 primary data records. [2025-10-14T22:42:26.724986] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:26.735700] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50962 primary records. [2025-10-14T22:42:26.735871] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-14T22:42:26.833305] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-14T22:42:26.851381] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-14T22:42:26.851230] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:26.852254] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52960 primary records. [2025-10-14T22:42:26.864928] [INFO ] [MAIN ] Derivative Progress: 1508/1812 symbols completed. TALO took 1.3s. Estimated remaining: 1m 55s. Rate: 158.7 symbols/min [2025-10-14T22:42:26.863110] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-14T22:42:26.870618] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:26.945598] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-14T22:42:26.949617] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-14T22:42:26.952190] [INFO ] [MAIN ] Derivative Progress: 1509/1812 symbols completed. TAP took 1.4s. Estimated remaining: 1m 54s. Rate: 158.8 symbols/min [2025-10-14T22:42:27.065939] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:27.101462] [DEBUG] [LOCAL ] TBBB: Loaded 35845 existing records from primary storage. [2025-10-14T22:42:27.101944] [INFO ] [MAIN ] TBBB: Loaded 35845 primary data records. [2025-10-14T22:42:27.160599] [DEBUG] [LOCAL ] TBI: Loaded 22516 existing records from primary storage. [2025-10-14T22:42:27.182405] [INFO ] [MAIN ] TBI: Loaded 22516 primary data records. [2025-10-14T22:42:27.347933] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:27.370864] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11578 primary records. [2025-10-14T22:42:27.396731] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-14T22:42:27.509912] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-14T22:42:27.583679] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-14T22:42:27.636055] [INFO ] [MAIN ] Derivative Progress: 1510/1812 symbols completed. TBB took 1.0s. Estimated remaining: 1m 54s. Rate: 158.7 symbols/min [2025-10-14T22:42:27.643202] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:27.777574] [DEBUG] [LOCAL ] TBN: Loaded 3909 existing records from primary storage. [2025-10-14T22:42:27.778744] [INFO ] [MAIN ] TBN: Loaded 3909 primary data records. [2025-10-14T22:42:28.106232] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:28.107558] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35845 primary records. [2025-10-14T22:42:28.109905] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-14T22:42:28.140388] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-14T22:42:28.141053] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:28.141884] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22516 primary records. [2025-10-14T22:42:28.142126] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-14T22:42:28.140756] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-14T22:42:28.146269] [INFO ] [MAIN ] Derivative Progress: 1511/1812 symbols completed. TBBB took 1.3s. Estimated remaining: 1m 54s. Rate: 158.7 symbols/min [2025-10-14T22:42:28.147089] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:28.172511] [DEBUG] [LOCAL ] TCBX: Loaded 10162 existing records from primary storage. [2025-10-14T22:42:28.172708] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-14T22:42:28.172802] [INFO ] [MAIN ] TCBX: Loaded 10162 primary data records. [2025-10-14T22:42:28.172888] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-14T22:42:28.186494] [INFO ] [MAIN ] Derivative Progress: 1512/1812 symbols completed. TBI took 1.1s. Estimated remaining: 1m 53s. Rate: 158.8 symbols/min [2025-10-14T22:42:28.212688] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:28.382625] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-14T22:42:28.495263] [INFO ] [MAIN ] TBN: Generated 1790 derivative records from 3909 primary records. [2025-10-14T22:42:28.495566] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-14T22:42:28.528109] [DEBUG] [LOCAL ] TBN: Derivative data saved (1790 records). [2025-10-14T22:42:28.543082] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-14T22:42:28.546483] [INFO ] [MAIN ] Derivative Progress: 1513/1812 symbols completed. TBN took 0.9s. Estimated remaining: 1m 53s. Rate: 158.8 symbols/min [2025-10-14T22:42:28.548253] [DEBUG] [LOCAL ] TD: Loaded 52344 existing records from primary storage. [2025-10-14T22:42:28.548590] [INFO ] [MAIN ] TD: Loaded 52344 primary data records. [2025-10-14T22:42:28.759616] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:28.904618] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10162 primary records. [2025-10-14T22:42:28.918012] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-14T22:42:28.935759] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-14T22:42:28.935844] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-14T22:42:28.938004] [INFO ] [MAIN ] Derivative Progress: 1514/1812 symbols completed. TCBX took 0.8s. Estimated remaining: 1m 53s. Rate: 158.8 symbols/min [2025-10-14T22:42:28.958783] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:28.959393] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52344 primary records. [2025-10-14T22:42:28.959455] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-14T22:42:28.975980] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-14T22:42:28.976041] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-14T22:42:28.978282] [INFO ] [MAIN ] Derivative Progress: 1515/1812 symbols completed. TD took 0.8s. Estimated remaining: 1m 52s. Rate: 158.8 symbols/min [2025-10-14T22:42:28.978741] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:28.978864] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:28.979333] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:28.990795] [DEBUG] [LOCAL ] TDF: Loaded 6356 existing records from primary storage. [2025-10-14T22:42:28.990992] [INFO ] [MAIN ] TDF: Loaded 6356 primary data records. [2025-10-14T22:42:29.107567] [DEBUG] [LOCAL ] TDG: Loaded 22050 existing records from primary storage. [2025-10-14T22:42:29.129502] [INFO ] [MAIN ] TDG: Loaded 22050 primary data records. [2025-10-14T22:42:29.440492] [DEBUG] [LOCAL ] TDC: Loaded 46557 existing records from primary storage. [2025-10-14T22:42:29.446869] [INFO ] [MAIN ] TDC: Loaded 46557 primary data records. [2025-10-14T22:42:29.953572] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:29.955300] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6356 primary records. [2025-10-14T22:42:29.955577] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-14T22:42:29.972328] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-14T22:42:29.972583] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-14T22:42:29.974775] [INFO ] [MAIN ] Derivative Progress: 1516/1812 symbols completed. TDF took 1.0s. Estimated remaining: 1m 52s. Rate: 158.7 symbols/min [2025-10-14T22:42:29.975257] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:29.992198] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:29.992942] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22050 primary records. [2025-10-14T22:42:29.993217] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-14T22:42:30.011741] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-14T22:42:30.019639] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-14T22:42:30.026335] [INFO ] [MAIN ] Derivative Progress: 1517/1812 symbols completed. TDG took 1.0s. Estimated remaining: 1m 51s. Rate: 158.8 symbols/min [2025-10-14T22:42:30.026980] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:30.027091] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:30.028358] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46557 primary records. [2025-10-14T22:42:30.028461] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-14T22:42:30.058569] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-14T22:42:30.058678] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-14T22:42:30.060783] [INFO ] [MAIN ] Derivative Progress: 1518/1812 symbols completed. TDC took 1.1s. Estimated remaining: 1m 51s. Rate: 158.9 symbols/min [2025-10-14T22:42:30.060986] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:30.080222] [DEBUG] [LOCAL ] TDOC: Loaded 53362 existing records from primary storage. [2025-10-14T22:42:30.089483] [INFO ] [MAIN ] TDOC: Loaded 53362 primary data records. [2025-10-14T22:42:30.219771] [DEBUG] [LOCAL ] TDS: Loaded 42481 existing records from primary storage. [2025-10-14T22:42:30.253287] [INFO ] [MAIN ] TDS: Loaded 42481 primary data records. [2025-10-14T22:42:30.306623] [DEBUG] [LOCAL ] TDW: Loaded 45073 existing records from primary storage. [2025-10-14T22:42:30.476094] [INFO ] [MAIN ] TDW: Loaded 45073 primary data records. [2025-10-14T22:42:31.278172] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:31.279219] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53362 primary records. [2025-10-14T22:42:31.280688] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-14T22:42:31.298940] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-14T22:42:31.299374] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-14T22:42:31.301422] [INFO ] [MAIN ] Derivative Progress: 1519/1812 symbols completed. TDOC took 1.3s. Estimated remaining: 1m 51s. Rate: 158.6 symbols/min [2025-10-14T22:42:31.301855] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:31.320304] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:31.322136] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42481 primary records. [2025-10-14T22:42:31.323322] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-14T22:42:31.350328] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-14T22:42:31.356447] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-14T22:42:31.359185] [INFO ] [MAIN ] Derivative Progress: 1520/1812 symbols completed. TDS took 1.3s. Estimated remaining: 1m 50s. Rate: 158.7 symbols/min [2025-10-14T22:42:31.365078] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:31.366377] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:31.375609] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45073 primary records. [2025-10-14T22:42:31.375788] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-14T22:42:31.376237] [DEBUG] [LOCAL ] TDY: Loaded 22273 existing records from primary storage. [2025-10-14T22:42:31.376549] [INFO ] [MAIN ] TDY: Loaded 22273 primary data records. [2025-10-14T22:42:31.439449] [DEBUG] [LOCAL ] TEAF: Loaded 7317 existing records from primary storage. [2025-10-14T22:42:31.461172] [INFO ] [MAIN ] TEAF: Loaded 7317 primary data records. [2025-10-14T22:42:31.573215] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-14T22:42:31.594384] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-14T22:42:31.607438] [INFO ] [MAIN ] Derivative Progress: 1521/1812 symbols completed. TDW took 1.5s. Estimated remaining: 1m 50s. Rate: 158.7 symbols/min [2025-10-14T22:42:31.663000] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:32.049175] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:32.050074] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22273 primary records. [2025-10-14T22:42:32.050154] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-14T22:42:32.068893] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-14T22:42:32.069101] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-14T22:42:32.071057] [INFO ] [MAIN ] Derivative Progress: 1522/1812 symbols completed. TDY took 0.8s. Estimated remaining: 1m 50s. Rate: 158.7 symbols/min [2025-10-14T22:42:32.071396] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:32.099325] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:32.101053] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7317 primary records. [2025-10-14T22:42:32.101266] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-14T22:42:32.102422] [DEBUG] [LOCAL ] TECK: Loaded 53437 existing records from primary storage. [2025-10-14T22:42:32.102917] [INFO ] [MAIN ] TECK: Loaded 53437 primary data records. [2025-10-14T22:42:32.223177] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-14T22:42:32.256798] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-14T22:42:32.287451] [INFO ] [MAIN ] Derivative Progress: 1523/1812 symbols completed. TEAF took 0.9s. Estimated remaining: 1m 49s. Rate: 158.8 symbols/min [2025-10-14T22:42:32.287730] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:32.449856] [DEBUG] [LOCAL ] TEF: Loaded 36985 existing records from primary storage. [2025-10-14T22:42:32.450121] [INFO ] [MAIN ] TEF: Loaded 36985 primary data records. [2025-10-14T22:42:32.526140] [DEBUG] [LOCAL ] TEI: Loaded 21378 existing records from primary storage. [2025-10-14T22:42:32.552667] [INFO ] [MAIN ] TEI: Loaded 21378 primary data records. [2025-10-14T22:42:33.161847] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:33.162743] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53437 primary records. [2025-10-14T22:42:33.163550] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-14T22:42:33.182554] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-14T22:42:33.182689] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-14T22:42:33.184721] [INFO ] [MAIN ] Derivative Progress: 1524/1812 symbols completed. TECK took 1.5s. Estimated remaining: 1m 49s. Rate: 158.6 symbols/min [2025-10-14T22:42:33.185612] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:33.204156] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:33.205090] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 36985 primary records. [2025-10-14T22:42:33.205318] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-14T22:42:33.221041] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-14T22:42:33.221170] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-14T22:42:33.223297] [INFO ] [MAIN ] Derivative Progress: 1525/1812 symbols completed. TEF took 1.2s. Estimated remaining: 1m 48s. Rate: 158.7 symbols/min [2025-10-14T22:42:33.223498] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:33.241018] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:33.241840] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21378 primary records. [2025-10-14T22:42:33.241998] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-14T22:42:33.270768] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-14T22:42:33.271019] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-14T22:42:33.273004] [INFO ] [MAIN ] Derivative Progress: 1526/1812 symbols completed. TEI took 1.0s. Estimated remaining: 1m 48s. Rate: 158.8 symbols/min [2025-10-14T22:42:33.280180] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:33.294255] [DEBUG] [LOCAL ] TEN: Loaded 30487 existing records from primary storage. [2025-10-14T22:42:33.308086] [INFO ] [MAIN ] TEN: Loaded 30487 primary data records. [2025-10-14T22:42:33.334566] [DEBUG] [LOCAL ] TEL: Loaded 51073 existing records from primary storage. [2025-10-14T22:42:33.350842] [INFO ] [MAIN ] TEL: Loaded 51073 primary data records. [2025-10-14T22:42:33.508881] [DEBUG] [LOCAL ] TEO: Loaded 22464 existing records from primary storage. [2025-10-14T22:42:33.524948] [INFO ] [MAIN ] TEO: Loaded 22464 primary data records. [2025-10-14T22:42:34.231802] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:34.232787] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30487 primary records. [2025-10-14T22:42:34.233721] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-14T22:42:34.265584] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:34.266300] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51073 primary records. [2025-10-14T22:42:34.264552] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-14T22:42:34.267729] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-14T22:42:34.269949] [INFO ] [MAIN ] Derivative Progress: 1527/1812 symbols completed. TEN took 1.0s. Estimated remaining: 1m 48s. Rate: 158.6 symbols/min [2025-10-14T22:42:34.267111] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-14T22:42:34.270906] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:34.302062] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-14T22:42:34.302230] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-14T22:42:34.298077] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:34.306020] [INFO ] [MAIN ] Derivative Progress: 1528/1812 symbols completed. TEL took 1.1s. Estimated remaining: 1m 47s. Rate: 158.7 symbols/min [2025-10-14T22:42:34.303044] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22464 primary records. [2025-10-14T22:42:34.306330] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-14T22:42:34.322808] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-14T22:42:34.322941] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-14T22:42:34.324993] [INFO ] [MAIN ] Derivative Progress: 1529/1812 symbols completed. TEO took 1.0s. Estimated remaining: 1m 47s. Rate: 158.8 symbols/min [2025-10-14T22:42:34.363068] [DEBUG] [LOCAL ] TEVA: Loaded 53627 existing records from primary storage. [2025-10-14T22:42:34.363203] [INFO ] [MAIN ] TEVA: Loaded 53627 primary data records. [2025-10-14T22:42:34.665095] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:34.665782] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53627 primary records. [2025-10-14T22:42:34.665843] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-14T22:42:34.681049] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-14T22:42:34.681106] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-14T22:42:34.683093] [INFO ] [MAIN ] Derivative Progress: 1530/1812 symbols completed. TEVA took 0.4s. Estimated remaining: 1m 47s. Rate: 158.8 symbols/min [2025-10-14T22:42:34.683800] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:34.683879] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:34.683721] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:34.740480] [DEBUG] [LOCAL ] TFII: Loaded 33006 existing records from primary storage. [2025-10-14T22:42:34.740666] [INFO ] [MAIN ] TFII: Loaded 33006 primary data records. [2025-10-14T22:42:34.871021] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-14T22:42:34.853765] [DEBUG] [LOCAL ] TEX: Loaded 43886 existing records from primary storage. [2025-10-14T22:42:34.871194] [INFO ] [MAIN ] TEX: Loaded 43886 primary data records. [2025-10-14T22:42:34.876741] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-14T22:42:35.700043] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:35.701231] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33006 primary records. [2025-10-14T22:42:35.701776] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-14T22:42:35.719793] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-14T22:42:35.720029] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-14T22:42:35.721979] [INFO ] [MAIN ] Derivative Progress: 1531/1812 symbols completed. TFII took 1.0s. Estimated remaining: 1m 46s. Rate: 158.7 symbols/min [2025-10-14T22:42:35.723270] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:35.740156] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:35.741069] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 43886 primary records. [2025-10-14T22:42:35.748693] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-14T22:42:35.753611] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:35.755070] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-14T22:42:35.762570] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-14T22:42:35.776439] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-14T22:42:35.776803] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-14T22:42:35.789420] [INFO ] [MAIN ] Derivative Progress: 1532/1812 symbols completed. TEX took 1.1s. Estimated remaining: 1m 46s. Rate: 158.7 symbols/min [2025-10-14T22:42:35.789699] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:35.800336] [DEBUG] [LOCAL ] TFIN: Loaded 23531 existing records from primary storage. [2025-10-14T22:42:35.801751] [INFO ] [MAIN ] TFIN: Loaded 23531 primary data records. [2025-10-14T22:42:35.874848] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-14T22:42:35.914563] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-14T22:42:35.920438] [INFO ] [MAIN ] Derivative Progress: 1533/1812 symbols completed. TFC took 1.2s. Estimated remaining: 1m 45s. Rate: 158.8 symbols/min [2025-10-14T22:42:35.920760] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:36.011156] [DEBUG] [LOCAL ] TFPM: Loaded 39273 existing records from primary storage. [2025-10-14T22:42:36.011409] [INFO ] [MAIN ] TFPM: Loaded 39273 primary data records. [2025-10-14T22:42:36.279999] [DEBUG] [LOCAL ] TFX: Loaded 36356 existing records from primary storage. [2025-10-14T22:42:36.302335] [INFO ] [MAIN ] TFX: Loaded 36356 primary data records. [2025-10-14T22:42:36.802180] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:36.802981] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23531 primary records. [2025-10-14T22:42:36.803856] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-14T22:42:36.823827] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-14T22:42:36.824128] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-14T22:42:36.826046] [INFO ] [MAIN ] Derivative Progress: 1534/1812 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 45s. Rate: 158.7 symbols/min [2025-10-14T22:42:36.826207] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:36.840395] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:36.841204] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 39273 primary records. [2025-10-14T22:42:36.841341] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-14T22:42:36.861394] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-14T22:42:36.865272] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-14T22:42:36.865527] [DEBUG] [LOCAL ] TG: Loaded 10473 existing records from primary storage. [2025-10-14T22:42:36.867725] [INFO ] [MAIN ] TG: Loaded 10473 primary data records. [2025-10-14T22:42:36.867662] [INFO ] [MAIN ] Derivative Progress: 1535/1812 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 45s. Rate: 158.8 symbols/min [2025-10-14T22:42:36.899014] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:37.184584] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:37.193799] [DEBUG] [LOCAL ] TGLS: Loaded 27617 existing records from primary storage. [2025-10-14T22:42:37.193968] [INFO ] [MAIN ] TGLS: Loaded 27617 primary data records. [2025-10-14T22:42:37.207194] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 36356 primary records. [2025-10-14T22:42:37.228857] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-14T22:42:37.399429] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-14T22:42:37.406290] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-14T22:42:37.517094] [INFO ] [MAIN ] Derivative Progress: 1536/1812 symbols completed. TFX took 1.6s. Estimated remaining: 1m 44s. Rate: 158.7 symbols/min [2025-10-14T22:42:37.531040] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:37.552217] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:37.553543] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10473 primary records. [2025-10-14T22:42:37.553997] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-14T22:42:37.571483] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-14T22:42:37.571815] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-14T22:42:37.573915] [INFO ] [MAIN ] Derivative Progress: 1537/1812 symbols completed. TG took 0.7s. Estimated remaining: 1m 44s. Rate: 158.8 symbols/min [2025-10-14T22:42:37.574180] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:37.593237] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:37.593922] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27617 primary records. [2025-10-14T22:42:37.594034] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-14T22:42:37.620210] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-14T22:42:37.620357] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-14T22:42:37.622338] [INFO ] [MAIN ] Derivative Progress: 1538/1812 symbols completed. TGLS took 0.7s. Estimated remaining: 1m 43s. Rate: 158.9 symbols/min [2025-10-14T22:42:37.622482] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:37.656566] [DEBUG] [LOCAL ] TGNA: Loaded 48637 existing records from primary storage. [2025-10-14T22:42:37.657728] [INFO ] [MAIN ] TGNA: Loaded 48637 primary data records. [2025-10-14T22:42:37.658249] [DEBUG] [LOCAL ] TGS: Loaded 33400 existing records from primary storage. [2025-10-14T22:42:37.669567] [INFO ] [MAIN ] TGS: Loaded 33400 primary data records. [2025-10-14T22:42:38.286080] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-14T22:42:38.286812] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-14T22:42:38.659749] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:38.661274] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48637 primary records. [2025-10-14T22:42:38.662268] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-14T22:42:38.690350] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:38.692986] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 33400 primary records. [2025-10-14T22:42:38.693306] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-14T22:42:38.693613] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-14T22:42:38.694707] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-14T22:42:38.696798] [INFO ] [MAIN ] Derivative Progress: 1539/1812 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 43s. Rate: 158.7 symbols/min [2025-10-14T22:42:38.704149] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:38.713322] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-14T22:42:38.713552] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-14T22:42:38.715778] [INFO ] [MAIN ] Derivative Progress: 1540/1812 symbols completed. TGS took 1.1s. Estimated remaining: 1m 43s. Rate: 158.8 symbols/min [2025-10-14T22:42:38.716118] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:38.733296] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:38.734069] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-14T22:42:38.734151] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-14T22:42:38.757453] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-14T22:42:38.757575] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-14T22:42:38.759536] [INFO ] [MAIN ] Derivative Progress: 1541/1812 symbols completed. TGT took 1.1s. Estimated remaining: 1m 42s. Rate: 158.9 symbols/min [2025-10-14T22:42:38.766040] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:38.767843] [DEBUG] [LOCAL ] THG: Loaded 21676 existing records from primary storage. [2025-10-14T22:42:38.767947] [INFO ] [MAIN ] THG: Loaded 21676 primary data records. [2025-10-14T22:42:38.852719] [DEBUG] [LOCAL ] THIR: Loaded 2355 existing records from primary storage. [2025-10-14T22:42:38.888462] [INFO ] [MAIN ] THIR: Loaded 2355 primary data records. [2025-10-14T22:42:39.091539] [DEBUG] [LOCAL ] THC: Loaded 47104 existing records from primary storage. [2025-10-14T22:42:39.091854] [INFO ] [MAIN ] THC: Loaded 47104 primary data records. [2025-10-14T22:42:39.731288] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:39.732283] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21676 primary records. [2025-10-14T22:42:39.732604] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-14T22:42:39.769234] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7831 incomplete bins [2025-10-14T22:42:39.769919] [INFO ] [MAIN ] THIR: Generated 1783 derivative records from 2355 primary records. [2025-10-14T22:42:39.770780] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-14T22:42:39.771753] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-14T22:42:39.777933] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-14T22:42:39.784075] [INFO ] [MAIN ] Derivative Progress: 1542/1812 symbols completed. THG took 1.1s. Estimated remaining: 1m 42s. Rate: 158.7 symbols/min [2025-10-14T22:42:39.787776] [DEBUG] [LOCAL ] THIR: Derivative data saved (1783 records). [2025-10-14T22:42:39.787926] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:39.788628] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-14T22:42:39.792500] [INFO ] [MAIN ] Derivative Progress: 1543/1812 symbols completed. THIR took 1.0s. Estimated remaining: 1m 42s. Rate: 158.8 symbols/min [2025-10-14T22:42:39.796154] [DEBUG] [LOCAL ] THLV: Loaded 1508 existing records from primary storage. [2025-10-14T22:42:39.796307] [INFO ] [MAIN ] THLV: Loaded 1508 primary data records. [2025-10-14T22:42:39.852619] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:39.882601] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47104 primary records. [2025-10-14T22:42:39.893840] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-14T22:42:40.121385] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-14T22:42:40.121555] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-14T22:42:40.123608] [INFO ] [MAIN ] Derivative Progress: 1544/1812 symbols completed. THC took 1.4s. Estimated remaining: 1m 41s. Rate: 158.8 symbols/min [2025-10-14T22:42:40.145921] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:40.146509] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1508 primary records. [2025-10-14T22:42:40.146568] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-14T22:42:40.159341] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-10-14T22:42:40.159400] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-14T22:42:40.161299] [INFO ] [MAIN ] Derivative Progress: 1545/1812 symbols completed. THLV took 0.4s. Estimated remaining: 1m 41s. Rate: 158.9 symbols/min [2025-10-14T22:42:40.162111] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:40.162040] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:40.162783] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:40.198807] [DEBUG] [LOCAL ] THR: Loaded 19733 existing records from primary storage. [2025-10-14T22:42:40.199009] [INFO ] [MAIN ] THR: Loaded 19733 primary data records. [2025-10-14T22:42:40.292850] [DEBUG] [LOCAL ] THQ: Loaded 25366 existing records from primary storage. [2025-10-14T22:42:40.309408] [INFO ] [MAIN ] THQ: Loaded 25366 primary data records. [2025-10-14T22:42:40.446278] [DEBUG] [LOCAL ] THO: Loaded 41591 existing records from primary storage. [2025-10-14T22:42:40.478691] [INFO ] [MAIN ] THO: Loaded 41591 primary data records. [2025-10-14T22:42:41.169801] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:41.170980] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19733 primary records. [2025-10-14T22:42:41.171410] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-14T22:42:41.191490] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-14T22:42:41.191940] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-14T22:42:41.205923] [INFO ] [MAIN ] Derivative Progress: 1546/1812 symbols completed. THR took 1.0s. Estimated remaining: 1m 41s. Rate: 158.7 symbols/min [2025-10-14T22:42:41.207072] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:41.208464] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:41.207947] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25366 primary records. [2025-10-14T22:42:41.210823] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-14T22:42:41.236611] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:41.239692] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41591 primary records. [2025-10-14T22:42:41.240000] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-14T22:42:41.259352] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-14T22:42:41.259792] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-14T22:42:41.263036] [INFO ] [MAIN ] Derivative Progress: 1547/1812 symbols completed. THQ took 1.1s. Estimated remaining: 1m 40s. Rate: 158.8 symbols/min [2025-10-14T22:42:41.263612] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-14T22:42:41.263979] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:41.264107] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-14T22:42:41.266201] [INFO ] [MAIN ] Derivative Progress: 1548/1812 symbols completed. THO took 1.1s. Estimated remaining: 1m 40s. Rate: 158.9 symbols/min [2025-10-14T22:42:41.266867] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:41.301479] [DEBUG] [LOCAL ] THS: Loaded 38604 existing records from primary storage. [2025-10-14T22:42:41.309398] [INFO ] [MAIN ] THS: Loaded 38604 primary data records. [2025-10-14T22:42:41.316287] [DEBUG] [LOCAL ] THW: Loaded 19747 existing records from primary storage. [2025-10-14T22:42:41.316475] [INFO ] [MAIN ] THW: Loaded 19747 primary data records. [2025-10-14T22:42:41.510460] [DEBUG] [LOCAL ] TIMB: Loaded 35322 existing records from primary storage. [2025-10-14T22:42:41.526479] [INFO ] [MAIN ] TIMB: Loaded 35322 primary data records. [2025-10-14T22:42:42.276126] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:42.278463] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38604 primary records. [2025-10-14T22:42:42.291096] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-14T22:42:42.305393] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:42.307383] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 35322 primary records. [2025-10-14T22:42:42.306486] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:42.308991] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-14T22:42:42.308521] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19747 primary records. [2025-10-14T22:42:42.316437] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-14T22:42:42.351737] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-14T22:42:42.358151] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-14T22:42:42.358355] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-14T22:42:42.360498] [INFO ] [MAIN ] Derivative Progress: 1549/1812 symbols completed. THS took 1.2s. Estimated remaining: 1m 39s. Rate: 158.7 symbols/min [2025-10-14T22:42:42.356043] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-14T22:42:42.361300] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:42.365323] [INFO ] [MAIN ] Derivative Progress: 1550/1812 symbols completed. THW took 1.1s. Estimated remaining: 1m 39s. Rate: 158.8 symbols/min [2025-10-14T22:42:42.367458] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:42.370484] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-14T22:42:42.371827] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-14T22:42:42.373884] [INFO ] [MAIN ] Derivative Progress: 1551/1812 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 39s. Rate: 158.9 symbols/min [2025-10-14T22:42:42.374232] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:42.377576] [DEBUG] [LOCAL ] TISI: Loaded 3343 existing records from primary storage. [2025-10-14T22:42:42.377794] [INFO ] [MAIN ] TISI: Loaded 3343 primary data records. [2025-10-14T22:42:42.581124] [DEBUG] [LOCAL ] TIXT: Loaded 32339 existing records from primary storage. [2025-10-14T22:42:42.715318] [INFO ] [MAIN ] TIXT: Loaded 32339 primary data records. [2025-10-14T22:42:42.874173] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-14T22:42:42.893607] [INFO ] [MAIN ] TJX: Loaded 53668 primary data records. [2025-10-14T22:42:43.227181] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:42:43.232357] [INFO ] [MAIN ] TISI: Generated 1793 derivative records from 3343 primary records. [2025-10-14T22:42:43.238368] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-14T22:42:43.458973] [DEBUG] [LOCAL ] TISI: Derivative data saved (1793 records). [2025-10-14T22:42:43.460314] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-14T22:42:43.462571] [INFO ] [MAIN ] Derivative Progress: 1552/1812 symbols completed. TISI took 1.1s. Estimated remaining: 1m 38s. Rate: 158.7 symbols/min [2025-10-14T22:42:43.462929] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:43.484804] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:43.485814] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 32339 primary records. [2025-10-14T22:42:43.486223] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-14T22:42:43.512166] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-14T22:42:43.512228] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-14T22:42:43.514157] [INFO ] [MAIN ] Derivative Progress: 1553/1812 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 38s. Rate: 158.8 symbols/min [2025-10-14T22:42:43.514415] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:43.530294] [DEBUG] [LOCAL ] TK: Loaded 39177 existing records from primary storage. [2025-10-14T22:42:43.530629] [INFO ] [MAIN ] TK: Loaded 39177 primary data records. [2025-10-14T22:42:43.565526] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:43.610470] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53668 primary records. [2025-10-14T22:42:43.622621] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-14T22:42:43.762303] [DEBUG] [LOCAL ] TKC: Loaded 39400 existing records from primary storage. [2025-10-14T22:42:43.873073] [INFO ] [MAIN ] TKC: Loaded 39400 primary data records. [2025-10-14T22:42:43.894065] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-14T22:42:43.914773] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-14T22:42:43.941257] [INFO ] [MAIN ] Derivative Progress: 1554/1812 symbols completed. TJX took 1.6s. Estimated remaining: 1m 37s. Rate: 158.8 symbols/min [2025-10-14T22:42:43.973746] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:44.220816] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:44.221731] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39177 primary records. [2025-10-14T22:42:44.221881] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-14T22:42:44.239714] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-14T22:42:44.240138] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-14T22:42:44.254225] [INFO ] [MAIN ] Derivative Progress: 1555/1812 symbols completed. TK took 0.8s. Estimated remaining: 1m 37s. Rate: 158.8 symbols/min [2025-10-14T22:42:44.256419] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:44.258130] [DEBUG] [LOCAL ] TKO: Loaded 43799 existing records from primary storage. [2025-10-14T22:42:44.258466] [INFO ] [MAIN ] TKO: Loaded 43799 primary data records. [2025-10-14T22:42:44.447893] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:44.478410] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39400 primary records. [2025-10-14T22:42:44.576879] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-14T22:42:44.655818] [DEBUG] [LOCAL ] TKR: Loaded 39830 existing records from primary storage. [2025-10-14T22:42:44.658111] [INFO ] [MAIN ] TKR: Loaded 39830 primary data records. [2025-10-14T22:42:44.660381] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-14T22:42:44.666066] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-14T22:42:44.674303] [INFO ] [MAIN ] Derivative Progress: 1556/1812 symbols completed. TKC took 1.2s. Estimated remaining: 1m 37s. Rate: 158.8 symbols/min [2025-10-14T22:42:44.674442] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:45.002923] [DEBUG] [LOCAL ] TLK: Loaded 38631 existing records from primary storage. [2025-10-14T22:42:45.003940] [INFO ] [MAIN ] TLK: Loaded 38631 primary data records. [2025-10-14T22:42:45.085022] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:45.102414] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43799 primary records. [2025-10-14T22:42:45.113310] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-14T22:42:45.207022] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-14T22:42:45.230066] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-14T22:42:45.343883] [INFO ] [MAIN ] Derivative Progress: 1557/1812 symbols completed. TKO took 1.4s. Estimated remaining: 1m 36s. Rate: 158.7 symbols/min [2025-10-14T22:42:45.345007] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:45.370228] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:45.371225] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39830 primary records. [2025-10-14T22:42:45.371498] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-14T22:42:45.392171] [DEBUG] [LOCAL ] TLYS: Loaded 16568 existing records from primary storage. [2025-10-14T22:42:45.392400] [INFO ] [MAIN ] TLYS: Loaded 16568 primary data records. [2025-10-14T22:42:45.436369] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-14T22:42:45.455982] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-14T22:42:45.480083] [INFO ] [MAIN ] Derivative Progress: 1558/1812 symbols completed. TKR took 1.2s. Estimated remaining: 1m 36s. Rate: 158.8 symbols/min [2025-10-14T22:42:45.727792] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:45.729728] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38631 primary records. [2025-10-14T22:42:45.729832] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-14T22:42:45.752424] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-14T22:42:45.753502] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-14T22:42:45.756269] [INFO ] [MAIN ] Derivative Progress: 1559/1812 symbols completed. TLK took 1.1s. Estimated remaining: 1m 36s. Rate: 158.8 symbols/min [2025-10-14T22:42:45.775425] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:45.776253] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16568 primary records. [2025-10-14T22:42:45.776321] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-14T22:42:45.792449] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-14T22:42:45.792552] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-14T22:42:45.794968] [INFO ] [MAIN ] Derivative Progress: 1560/1812 symbols completed. TLYS took 0.4s. Estimated remaining: 1m 35s. Rate: 158.9 symbols/min [2025-10-14T22:42:45.795575] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:45.796181] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:45.796748] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:45.873576] [DEBUG] [LOCAL ] TM: Loaded 36538 existing records from primary storage. [2025-10-14T22:42:45.874538] [INFO ] [MAIN ] TM: Loaded 36538 primary data records. [2025-10-14T22:42:45.874428] [DEBUG] [LOCAL ] TMHC: Loaded 45442 existing records from primary storage. [2025-10-14T22:42:45.906189] [INFO ] [MAIN ] TMHC: Loaded 45442 primary data records. [2025-10-14T22:42:46.043278] [DEBUG] [LOCAL ] TME: Loaded 53189 existing records from primary storage. [2025-10-14T22:42:46.093521] [INFO ] [MAIN ] TME: Loaded 53189 primary data records. [2025-10-14T22:42:46.896881] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:46.900464] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36538 primary records. [2025-10-14T22:42:46.914961] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-14T22:42:46.916621] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:46.939371] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45442 primary records. [2025-10-14T22:42:46.944516] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-14T22:42:46.949294] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-14T22:42:46.949920] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:46.951508] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-14T22:42:46.952506] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53189 primary records. [2025-10-14T22:42:46.954377] [INFO ] [MAIN ] Derivative Progress: 1561/1812 symbols completed. TM took 1.2s. Estimated remaining: 1m 35s. Rate: 158.7 symbols/min [2025-10-14T22:42:46.954526] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:46.954725] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-14T22:42:46.981285] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-14T22:42:46.981481] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-14T22:42:46.983692] [INFO ] [MAIN ] Derivative Progress: 1562/1812 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 34s. Rate: 158.8 symbols/min [2025-10-14T22:42:46.986625] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:46.992952] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-14T22:42:46.993107] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-14T22:42:46.995875] [INFO ] [MAIN ] Derivative Progress: 1563/1812 symbols completed. TME took 1.2s. Estimated remaining: 1m 34s. Rate: 158.9 symbols/min [2025-10-14T22:42:46.996058] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:47.009906] [DEBUG] [LOCAL ] TNC: Loaded 14451 existing records from primary storage. [2025-10-14T22:42:47.010053] [INFO ] [MAIN ] TNC: Loaded 14451 primary data records. [2025-10-14T22:42:47.182506] [DEBUG] [LOCAL ] TMO: Loaded 52458 existing records from primary storage. [2025-10-14T22:42:47.211111] [INFO ] [MAIN ] TMO: Loaded 52458 primary data records. [2025-10-14T22:42:47.423404] [DEBUG] [LOCAL ] TNET: Loaded 28269 existing records from primary storage. [2025-10-14T22:42:47.455927] [INFO ] [MAIN ] TNET: Loaded 28269 primary data records. [2025-10-14T22:42:47.995238] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:47.997310] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14451 primary records. [2025-10-14T22:42:47.998393] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-14T22:42:48.018430] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-14T22:42:48.018781] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-14T22:42:48.021064] [INFO ] [MAIN ] Derivative Progress: 1564/1812 symbols completed. TNC took 1.0s. Estimated remaining: 1m 34s. Rate: 158.7 symbols/min [2025-10-14T22:42:48.022156] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:48.043990] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:48.045190] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52458 primary records. [2025-10-14T22:42:48.045768] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-14T22:42:48.090436] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:48.092639] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28269 primary records. [2025-10-14T22:42:48.093989] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-14T22:42:48.093204] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-14T22:42:48.105409] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-14T22:42:48.106448] [DEBUG] [LOCAL ] TNK: Loaded 35389 existing records from primary storage. [2025-10-14T22:42:48.108550] [INFO ] [MAIN ] Derivative Progress: 1565/1812 symbols completed. TMO took 1.2s. Estimated remaining: 1m 33s. Rate: 158.8 symbols/min [2025-10-14T22:42:48.109214] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:48.108768] [INFO ] [MAIN ] TNK: Loaded 35389 primary data records. [2025-10-14T22:42:48.148323] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-14T22:42:48.184550] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-14T22:42:48.215912] [INFO ] [MAIN ] Derivative Progress: 1566/1812 symbols completed. TNET took 1.2s. Estimated remaining: 1m 33s. Rate: 158.9 symbols/min [2025-10-14T22:42:48.228230] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:48.468472] [DEBUG] [LOCAL ] TNL: Loaded 41832 existing records from primary storage. [2025-10-14T22:42:48.469750] [INFO ] [MAIN ] TNL: Loaded 41832 primary data records. [2025-10-14T22:42:48.629610] [DEBUG] [LOCAL ] TOL: Loaded 50688 existing records from primary storage. [2025-10-14T22:42:48.655997] [INFO ] [MAIN ] TOL: Loaded 50688 primary data records. [2025-10-14T22:42:49.046175] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:49.052821] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35389 primary records. [2025-10-14T22:42:49.052931] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-14T22:42:49.203856] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-14T22:42:49.204289] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-14T22:42:49.207030] [INFO ] [MAIN ] Derivative Progress: 1567/1812 symbols completed. TNK took 1.2s. Estimated remaining: 1m 33s. Rate: 158.7 symbols/min [2025-10-14T22:42:49.207472] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:49.229118] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:49.229992] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41832 primary records. [2025-10-14T22:42:49.230256] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-14T22:42:49.248906] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-14T22:42:49.249194] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-14T22:42:49.251321] [INFO ] [MAIN ] Derivative Progress: 1568/1812 symbols completed. TNL took 1.1s. Estimated remaining: 1m 32s. Rate: 158.8 symbols/min [2025-10-14T22:42:49.264004] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:49.264407] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:49.265569] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50688 primary records. [2025-10-14T22:42:49.265668] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-14T22:42:49.295972] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-14T22:42:49.296095] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-14T22:42:49.298308] [INFO ] [MAIN ] Derivative Progress: 1569/1812 symbols completed. TOL took 1.1s. Estimated remaining: 1m 32s. Rate: 158.9 symbols/min [2025-10-14T22:42:49.298549] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:49.323435] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-14T22:42:49.323750] [INFO ] [MAIN ] TOST: Loaded 53690 primary data records. [2025-10-14T22:42:49.405070] [DEBUG] [LOCAL ] TPB: Loaded 26074 existing records from primary storage. [2025-10-14T22:42:49.448891] [INFO ] [MAIN ] TPB: Loaded 26074 primary data records. [2025-10-14T22:42:49.589133] [DEBUG] [LOCAL ] TPC: Loaded 38979 existing records from primary storage. [2025-10-14T22:42:49.608962] [INFO ] [MAIN ] TPC: Loaded 38979 primary data records. [2025-10-14T22:42:50.269315] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:50.270286] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53690 primary records. [2025-10-14T22:42:50.270746] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-14T22:42:50.290872] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-14T22:42:50.291073] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-14T22:42:50.293158] [INFO ] [MAIN ] Derivative Progress: 1570/1812 symbols completed. TOST took 1.1s. Estimated remaining: 1m 31s. Rate: 158.7 symbols/min [2025-10-14T22:42:50.293561] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:50.309140] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:50.310101] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 26074 primary records. [2025-10-14T22:42:50.310179] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-14T22:42:50.331781] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:50.335122] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38979 primary records. [2025-10-14T22:42:50.338333] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-14T22:42:50.339779] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-14T22:42:50.340175] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-14T22:42:50.342291] [INFO ] [MAIN ] Derivative Progress: 1571/1812 symbols completed. TPB took 1.1s. Estimated remaining: 1m 31s. Rate: 158.8 symbols/min [2025-10-14T22:42:50.350576] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:50.357477] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-14T22:42:50.357680] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-14T22:42:50.360776] [INFO ] [MAIN ] Derivative Progress: 1572/1812 symbols completed. TPC took 1.1s. Estimated remaining: 1m 31s. Rate: 158.9 symbols/min [2025-10-14T22:42:50.360975] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:50.384292] [DEBUG] [LOCAL ] TPL: Loaded 12351 existing records from primary storage. [2025-10-14T22:42:50.384505] [INFO ] [MAIN ] TPL: Loaded 12351 primary data records. [2025-10-14T22:42:50.474137] [DEBUG] [LOCAL ] TPH: Loaded 44879 existing records from primary storage. [2025-10-14T22:42:50.497684] [INFO ] [MAIN ] TPH: Loaded 44879 primary data records. [2025-10-14T22:42:51.032235] [DEBUG] [LOCAL ] TPR: Loaded 53439 existing records from primary storage. [2025-10-14T22:42:51.040762] [INFO ] [MAIN ] TPR: Loaded 53439 primary data records. [2025-10-14T22:42:51.371956] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:51.372903] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12351 primary records. [2025-10-14T22:42:51.385156] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-14T22:42:51.386617] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:51.387435] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44879 primary records. [2025-10-14T22:42:51.394616] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-14T22:42:51.418630] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-14T22:42:51.418798] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-14T22:42:51.418861] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-14T22:42:51.421162] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-14T22:42:51.421075] [INFO ] [MAIN ] Derivative Progress: 1573/1812 symbols completed. TPH took 1.1s. Estimated remaining: 1m 30s. Rate: 158.7 symbols/min [2025-10-14T22:42:51.423595] [INFO ] [MAIN ] Derivative Progress: 1574/1812 symbols completed. TPL took 1.1s. Estimated remaining: 1m 30s. Rate: 158.8 symbols/min [2025-10-14T22:42:51.441067] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:51.441560] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53439 primary records. [2025-10-14T22:42:51.441618] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-14T22:42:51.456521] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-14T22:42:51.456576] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-14T22:42:51.458509] [INFO ] [MAIN ] Derivative Progress: 1575/1812 symbols completed. TPR took 1.1s. Estimated remaining: 1m 29s. Rate: 158.9 symbols/min [2025-10-14T22:42:51.459163] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:51.459101] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:51.459255] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:51.468870] [DEBUG] [LOCAL ] TPZ: Loaded 4740 existing records from primary storage. [2025-10-14T22:42:51.471000] [INFO ] [MAIN ] TPZ: Loaded 4740 primary data records. [2025-10-14T22:42:51.559860] [DEBUG] [LOCAL ] TPYP: Loaded 7955 existing records from primary storage. [2025-10-14T22:42:51.591569] [INFO ] [MAIN ] TPYP: Loaded 7955 primary data records. [2025-10-14T22:42:51.731718] [DEBUG] [LOCAL ] TPVG: Loaded 27289 existing records from primary storage. [2025-10-14T22:42:51.778028] [INFO ] [MAIN ] TPVG: Loaded 27289 primary data records. [2025-10-14T22:42:52.511521] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:52.516438] [INFO ] [MAIN ] TPZ: Generated 1794 derivative records from 4740 primary records. [2025-10-14T22:42:52.525712] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-14T22:42:52.532092] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:52.533695] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7955 primary records. [2025-10-14T22:42:52.542525] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-14T22:42:52.551905] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1794 records). [2025-10-14T22:42:52.552587] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-14T22:42:52.554952] [INFO ] [MAIN ] Derivative Progress: 1576/1812 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 29s. Rate: 158.7 symbols/min [2025-10-14T22:42:52.555140] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:52.573154] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-14T22:42:52.573411] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-14T22:42:52.575883] [INFO ] [MAIN ] Derivative Progress: 1577/1812 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 29s. Rate: 158.8 symbols/min [2025-10-14T22:42:52.576151] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:52.600605] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:52.611496] [DEBUG] [LOCAL ] TR: Loaded 18940 existing records from primary storage. [2025-10-14T22:42:52.611106] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27289 primary records. [2025-10-14T22:42:52.611803] [INFO ] [MAIN ] TR: Loaded 18940 primary data records. [2025-10-14T22:42:52.612033] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-14T22:42:52.681755] [DEBUG] [LOCAL ] TRAK: Loaded 9650 existing records from primary storage. [2025-10-14T22:42:52.701242] [INFO ] [MAIN ] TRAK: Loaded 9650 primary data records. [2025-10-14T22:42:52.789078] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-14T22:42:52.831591] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-14T22:42:52.846884] [INFO ] [MAIN ] Derivative Progress: 1578/1812 symbols completed. TPVG took 1.4s. Estimated remaining: 1m 28s. Rate: 158.8 symbols/min [2025-10-14T22:42:52.918972] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:53.261277] [DEBUG] [LOCAL ] TRC: Loaded 15544 existing records from primary storage. [2025-10-14T22:42:53.262628] [INFO ] [MAIN ] TRC: Loaded 15544 primary data records. [2025-10-14T22:42:53.591186] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:53.592372] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18940 primary records. [2025-10-14T22:42:53.592612] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-14T22:42:53.633341] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-14T22:42:53.634216] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-14T22:42:53.636801] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:53.636270] [INFO ] [MAIN ] Derivative Progress: 1579/1812 symbols completed. TR took 1.1s. Estimated remaining: 1m 28s. Rate: 158.7 symbols/min [2025-10-14T22:42:53.638375] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:53.638247] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9650 primary records. [2025-10-14T22:42:53.638812] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-14T22:42:53.656235] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-14T22:42:53.656878] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-14T22:42:53.658999] [INFO ] [MAIN ] Derivative Progress: 1580/1812 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 28s. Rate: 158.8 symbols/min [2025-10-14T22:42:53.659311] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:53.677445] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:53.678462] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15544 primary records. [2025-10-14T22:42:53.678625] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-14T22:42:53.706606] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-14T22:42:53.706974] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-14T22:42:53.709280] [INFO ] [MAIN ] Derivative Progress: 1581/1812 symbols completed. TRC took 0.8s. Estimated remaining: 1m 27s. Rate: 158.9 symbols/min [2025-10-14T22:42:53.709684] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:53.749869] [DEBUG] [LOCAL ] TREX: Loaded 49850 existing records from primary storage. [2025-10-14T22:42:53.750201] [INFO ] [MAIN ] TREX: Loaded 49850 primary data records. [2025-10-14T22:42:53.750762] [DEBUG] [LOCAL ] TRN: Loaded 36858 existing records from primary storage. [2025-10-14T22:42:53.750842] [INFO ] [MAIN ] TRN: Loaded 36858 primary data records. [2025-10-14T22:42:54.054091] [DEBUG] [LOCAL ] TRNO: Loaded 43872 existing records from primary storage. [2025-10-14T22:42:54.085574] [INFO ] [MAIN ] TRNO: Loaded 43872 primary data records. [2025-10-14T22:42:54.769820] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:54.784032] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49850 primary records. [2025-10-14T22:42:54.784482] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:54.784776] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-14T22:42:54.786813] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36858 primary records. [2025-10-14T22:42:54.787394] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-14T22:42:54.822728] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-14T22:42:54.831759] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-14T22:42:54.839637] [INFO ] [MAIN ] Derivative Progress: 1582/1812 symbols completed. TRN took 1.2s. Estimated remaining: 1m 27s. Rate: 158.7 symbols/min [2025-10-14T22:42:54.840444] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:54.840828] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:54.842333] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43872 primary records. [2025-10-14T22:42:54.839803] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-14T22:42:54.842535] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-14T22:42:54.842606] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-14T22:42:54.845226] [INFO ] [MAIN ] Derivative Progress: 1583/1812 symbols completed. TREX took 1.2s. Estimated remaining: 1m 27s. Rate: 158.8 symbols/min [2025-10-14T22:42:54.846070] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:54.872595] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-14T22:42:54.872738] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-14T22:42:54.875039] [INFO ] [MAIN ] Derivative Progress: 1584/1812 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 26s. Rate: 158.9 symbols/min [2025-10-14T22:42:54.875373] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:54.942250] [DEBUG] [LOCAL ] TROX: Loaded 52150 existing records from primary storage. [2025-10-14T22:42:54.943072] [INFO ] [MAIN ] TROX: Loaded 52150 primary data records. [2025-10-14T22:42:54.979080] [DEBUG] [LOCAL ] TRP: Loaded 52150 existing records from primary storage. [2025-10-14T22:42:55.014732] [INFO ] [MAIN ] TRP: Loaded 52150 primary data records. [2025-10-14T22:42:55.094279] [DEBUG] [LOCAL ] TRTX: Loaded 37327 existing records from primary storage. [2025-10-14T22:42:55.140246] [INFO ] [MAIN ] TRTX: Loaded 37327 primary data records. [2025-10-14T22:42:55.918771] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:55.919860] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 52150 primary records. [2025-10-14T22:42:55.920191] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-14T22:42:55.939188] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-14T22:42:55.940060] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-14T22:42:55.942082] [INFO ] [MAIN ] Derivative Progress: 1585/1812 symbols completed. TROX took 1.1s. Estimated remaining: 1m 26s. Rate: 158.7 symbols/min [2025-10-14T22:42:55.942625] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:55.961088] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:55.962284] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52150 primary records. [2025-10-14T22:42:55.970409] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-14T22:42:55.976693] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:55.995160] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-14T22:42:55.986438] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37327 primary records. [2025-10-14T22:42:55.995418] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-14T22:42:55.995515] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-14T22:42:55.998006] [INFO ] [MAIN ] Derivative Progress: 1586/1812 symbols completed. TRP took 1.2s. Estimated remaining: 1m 25s. Rate: 158.8 symbols/min [2025-10-14T22:42:55.999260] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:56.015588] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-14T22:42:56.015896] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-14T22:42:56.017978] [INFO ] [MAIN ] Derivative Progress: 1587/1812 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 25s. Rate: 158.9 symbols/min [2025-10-14T22:42:56.018163] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:56.055184] [DEBUG] [LOCAL ] TRU: Loaded 51431 existing records from primary storage. [2025-10-14T22:42:56.067075] [INFO ] [MAIN ] TRU: Loaded 51431 primary data records. [2025-10-14T22:42:56.226100] [DEBUG] [LOCAL ] TRV: Loaded 47444 existing records from primary storage. [2025-10-14T22:42:56.258197] [INFO ] [MAIN ] TRV: Loaded 47444 primary data records. [2025-10-14T22:42:56.481310] [DEBUG] [LOCAL ] TS: Loaded 51676 existing records from primary storage. [2025-10-14T22:42:56.492951] [INFO ] [MAIN ] TS: Loaded 51676 primary data records. [2025-10-14T22:42:57.070202] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:57.071250] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51431 primary records. [2025-10-14T22:42:57.071674] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-14T22:42:57.089955] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-14T22:42:57.091196] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-14T22:42:57.094928] [INFO ] [MAIN ] Derivative Progress: 1588/1812 symbols completed. TRU took 1.2s. Estimated remaining: 1m 25s. Rate: 158.7 symbols/min [2025-10-14T22:42:57.108858] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:57.109628] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47444 primary records. [2025-10-14T22:42:57.109805] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-14T22:42:57.140905] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-14T22:42:57.140591] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:57.141627] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51676 primary records. [2025-10-14T22:42:57.141714] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-14T22:42:57.144229] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-14T22:42:57.144139] [INFO ] [MAIN ] Derivative Progress: 1589/1812 symbols completed. TRV took 1.1s. Estimated remaining: 1m 24s. Rate: 158.8 symbols/min [2025-10-14T22:42:57.159696] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-14T22:42:57.159762] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-14T22:42:57.161888] [INFO ] [MAIN ] Derivative Progress: 1590/1812 symbols completed. TS took 1.1s. Estimated remaining: 1m 24s. Rate: 158.9 symbols/min [2025-10-14T22:42:57.162297] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:57.162393] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:57.162829] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:57.173562] [DEBUG] [LOCAL ] TSI: Loaded 8000 existing records from primary storage. [2025-10-14T22:42:57.173779] [INFO ] [MAIN ] TSI: Loaded 8000 primary data records. [2025-10-14T22:42:57.396856] [DEBUG] [LOCAL ] TSE: Loaded 27791 existing records from primary storage. [2025-10-14T22:42:57.505239] [DEBUG] [LOCAL ] TSLX: Loaded 35821 existing records from primary storage. [2025-10-14T22:42:57.505437] [INFO ] [MAIN ] TSE: Loaded 27791 primary data records. [2025-10-14T22:42:57.511091] [INFO ] [MAIN ] TSLX: Loaded 35821 primary data records. [2025-10-14T22:42:58.161489] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:58.163021] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8000 primary records. [2025-10-14T22:42:58.163241] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-14T22:42:58.181299] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-14T22:42:58.182351] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-14T22:42:58.185754] [INFO ] [MAIN ] Derivative Progress: 1591/1812 symbols completed. TSI took 1.0s. Estimated remaining: 1m 24s. Rate: 158.7 symbols/min [2025-10-14T22:42:58.187305] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:58.202033] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:58.204602] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 27791 primary records. [2025-10-14T22:42:58.205331] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-14T22:42:58.234067] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-14T22:42:58.234278] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-14T22:42:58.236409] [INFO ] [MAIN ] Derivative Progress: 1592/1812 symbols completed. TSE took 1.1s. Estimated remaining: 1m 23s. Rate: 158.8 symbols/min [2025-10-14T22:42:58.236882] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:58.236686] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:58.238090] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35821 primary records. [2025-10-14T22:42:58.238170] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-14T22:42:58.254760] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-14T22:42:58.254910] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-14T22:42:58.257302] [INFO ] [MAIN ] Derivative Progress: 1593/1812 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 23s. Rate: 158.9 symbols/min [2025-10-14T22:42:58.257532] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:58.282671] [DEBUG] [LOCAL ] TSQ: Loaded 11710 existing records from primary storage. [2025-10-14T22:42:58.282985] [INFO ] [MAIN ] TSQ: Loaded 11710 primary data records. [2025-10-14T22:42:58.438906] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-14T22:42:58.454748] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-14T22:42:58.568020] [DEBUG] [LOCAL ] TSN: Loaded 53014 existing records from primary storage. [2025-10-14T22:42:58.613041] [INFO ] [MAIN ] TSN: Loaded 53014 primary data records. [2025-10-14T22:42:59.314557] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:59.318462] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11710 primary records. [2025-10-14T22:42:59.320286] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-14T22:42:59.348590] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-14T22:42:59.349111] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:59.349230] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-14T22:42:59.352064] [INFO ] [MAIN ] Derivative Progress: 1594/1812 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 22s. Rate: 158.7 symbols/min [2025-10-14T22:42:59.350106] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-14T22:42:59.352411] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:59.352618] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-14T22:42:59.375639] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:42:59.384867] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 53014 primary records. [2025-10-14T22:42:59.384980] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-14T22:42:59.384067] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-14T22:42:59.385821] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-14T22:42:59.387978] [INFO ] [MAIN ] Derivative Progress: 1595/1812 symbols completed. TSM took 1.2s. Estimated remaining: 1m 22s. Rate: 158.8 symbols/min [2025-10-14T22:42:59.388403] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:59.404009] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-14T22:42:59.404205] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-14T22:42:59.406706] [INFO ] [MAIN ] Derivative Progress: 1596/1812 symbols completed. TSN took 1.2s. Estimated remaining: 1m 22s. Rate: 158.9 symbols/min [2025-10-14T22:42:59.406889] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:42:59.471839] [DEBUG] [LOCAL ] TT: Loaded 47349 existing records from primary storage. [2025-10-14T22:42:59.472500] [INFO ] [MAIN ] TT: Loaded 47349 primary data records. [2025-10-14T22:42:59.536781] [DEBUG] [LOCAL ] TTC: Loaded 42049 existing records from primary storage. [2025-10-14T22:42:59.565880] [INFO ] [MAIN ] TTC: Loaded 42049 primary data records. [2025-10-14T22:42:59.646551] [DEBUG] [LOCAL ] TTE: Loaded 51576 existing records from primary storage. [2025-10-14T22:42:59.711153] [INFO ] [MAIN ] TTE: Loaded 51576 primary data records. [2025-10-14T22:43:00.492874] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:00.494472] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47349 primary records. [2025-10-14T22:43:00.494886] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-14T22:43:00.544712] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-14T22:43:00.539509] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:00.545958] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42049 primary records. [2025-10-14T22:43:00.546423] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-14T22:43:00.546323] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:00.548210] [INFO ] [MAIN ] Derivative Progress: 1597/1812 symbols completed. TT took 1.2s. Estimated remaining: 1m 21s. Rate: 158.7 symbols/min [2025-10-14T22:43:00.548356] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:00.549269] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51576 primary records. [2025-10-14T22:43:00.549407] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-14T22:43:00.549871] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-14T22:43:00.575076] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-14T22:43:00.578155] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-14T22:43:00.581238] [INFO ] [MAIN ] Derivative Progress: 1598/1812 symbols completed. TTE took 1.2s. Estimated remaining: 1m 21s. Rate: 158.8 symbols/min [2025-10-14T22:43:00.581400] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:00.585388] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-14T22:43:00.585683] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-14T22:43:00.588977] [INFO ] [MAIN ] Derivative Progress: 1599/1812 symbols completed. TTC took 1.2s. Estimated remaining: 1m 20s. Rate: 158.9 symbols/min [2025-10-14T22:43:00.591538] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:00.623775] [DEBUG] [LOCAL ] TTI: Loaded 46300 existing records from primary storage. [2025-10-14T22:43:00.624031] [INFO ] [MAIN ] TTI: Loaded 46300 primary data records. [2025-10-14T22:43:00.853364] [DEBUG] [LOCAL ] TU: Loaded 49830 existing records from primary storage. [2025-10-14T22:43:00.861069] [DEBUG] [LOCAL ] TUYA: Loaded 45942 existing records from primary storage. [2025-10-14T22:43:00.962135] [INFO ] [MAIN ] TUYA: Loaded 45942 primary data records. [2025-10-14T22:43:00.860115] [INFO ] [MAIN ] TU: Loaded 49830 primary data records. [2025-10-14T22:43:01.619845] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:01.621336] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 46300 primary records. [2025-10-14T22:43:01.621695] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-14T22:43:01.642463] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-14T22:43:01.642784] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-14T22:43:01.644487] [INFO ] [MAIN ] Derivative Progress: 1600/1812 symbols completed. TTI took 1.1s. Estimated remaining: 1m 20s. Rate: 158.7 symbols/min [2025-10-14T22:43:01.644860] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:01.658840] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:01.660000] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 45942 primary records. [2025-10-14T22:43:01.660110] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-14T22:43:01.688849] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:01.690931] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49830 primary records. [2025-10-14T22:43:01.691328] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-14T22:43:01.721089] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-14T22:43:01.719324] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-14T22:43:01.721263] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-14T22:43:01.725075] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-14T22:43:01.724968] [INFO ] [MAIN ] Derivative Progress: 1601/1812 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 20s. Rate: 158.8 symbols/min [2025-10-14T22:43:01.725338] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:01.727542] [INFO ] [MAIN ] Derivative Progress: 1602/1812 symbols completed. TU took 1.1s. Estimated remaining: 1m 19s. Rate: 158.9 symbols/min [2025-10-14T22:43:01.728065] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:01.748568] [DEBUG] [LOCAL ] TVE: Loaded 2679 existing records from primary storage. [2025-10-14T22:43:01.745850] [DEBUG] [LOCAL ] TV: Loaded 41720 existing records from primary storage. [2025-10-14T22:43:01.748834] [INFO ] [MAIN ] TV: Loaded 41720 primary data records. [2025-10-14T22:43:01.749003] [INFO ] [MAIN ] TVE: Loaded 2679 primary data records. [2025-10-14T22:43:01.817150] [DEBUG] [LOCAL ] TVC: Loaded 3241 existing records from primary storage. [2025-10-14T22:43:01.916714] [INFO ] [MAIN ] TVC: Loaded 3241 primary data records. [2025-10-14T22:43:02.786488] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:02.789378] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2679 primary records. [2025-10-14T22:43:02.790715] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-14T22:43:02.817009] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:02.821527] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 41720 primary records. [2025-10-14T22:43:02.826593] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-14T22:43:02.828680] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:02.836550] [INFO ] [MAIN ] TVC: Generated 1793 derivative records from 3241 primary records. [2025-10-14T22:43:02.836907] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-14T22:43:02.852685] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-14T22:43:02.856091] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-14T22:43:02.858288] [INFO ] [MAIN ] Derivative Progress: 1603/1812 symbols completed. TV took 1.2s. Estimated remaining: 1m 19s. Rate: 158.7 symbols/min [2025-10-14T22:43:02.852415] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-14T22:43:02.858837] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-14T22:43:02.862432] [INFO ] [MAIN ] Derivative Progress: 1604/1812 symbols completed. TVE took 1.1s. Estimated remaining: 1m 19s. Rate: 158.8 symbols/min [2025-10-14T22:43:02.863941] [DEBUG] [LOCAL ] TVC: Derivative data saved (1793 records). [2025-10-14T22:43:02.864048] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-14T22:43:02.866107] [INFO ] [MAIN ] Derivative Progress: 1605/1812 symbols completed. TVC took 1.1s. Estimated remaining: 1m 18s. Rate: 158.9 symbols/min [2025-10-14T22:43:02.866482] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:02.866427] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:02.866986] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:02.873461] [DEBUG] [LOCAL ] TWN: Loaded 3274 existing records from primary storage. [2025-10-14T22:43:02.873692] [INFO ] [MAIN ] TWN: Loaded 3274 primary data records. [2025-10-14T22:43:03.184782] [DEBUG] [LOCAL ] TWI: Loaded 33919 existing records from primary storage. [2025-10-14T22:43:03.193004] [INFO ] [MAIN ] TWI: Loaded 33919 primary data records. [2025-10-14T22:43:03.313617] [DEBUG] [LOCAL ] TWLO: Loaded 52819 existing records from primary storage. [2025-10-14T22:43:03.319393] [INFO ] [MAIN ] TWLO: Loaded 52819 primary data records. [2025-10-14T22:43:03.840531] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:03.841376] [INFO ] [MAIN ] TWN: Generated 1793 derivative records from 3274 primary records. [2025-10-14T22:43:03.841809] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-14T22:43:03.857352] [DEBUG] [LOCAL ] TWN: Derivative data saved (1793 records). [2025-10-14T22:43:03.857800] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-14T22:43:03.860254] [INFO ] [MAIN ] Derivative Progress: 1606/1812 symbols completed. TWN took 1.0s. Estimated remaining: 1m 18s. Rate: 158.7 symbols/min [2025-10-14T22:43:03.860891] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:03.878034] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:03.878772] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 33919 primary records. [2025-10-14T22:43:03.878993] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-14T22:43:03.908113] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:03.908831] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52819 primary records. [2025-10-14T22:43:03.908964] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-14T22:43:03.926222] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-14T22:43:03.927537] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-14T22:43:03.930342] [INFO ] [MAIN ] Derivative Progress: 1607/1812 symbols completed. TWI took 1.1s. Estimated remaining: 1m 17s. Rate: 158.8 symbols/min [2025-10-14T22:43:03.930563] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:03.951018] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-14T22:43:03.951239] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-14T22:43:03.953342] [INFO ] [MAIN ] Derivative Progress: 1608/1812 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 17s. Rate: 158.9 symbols/min [2025-10-14T22:43:03.958959] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:03.976443] [DEBUG] [LOCAL ] TWO: Loaded 48647 existing records from primary storage. [2025-10-14T22:43:03.983225] [INFO ] [MAIN ] TWO: Loaded 48647 primary data records. [2025-10-14T22:43:04.021848] [DEBUG] [LOCAL ] TX: Loaded 23315 existing records from primary storage. [2025-10-14T22:43:04.059865] [INFO ] [MAIN ] TX: Loaded 23315 primary data records. [2025-10-14T22:43:04.194884] [DEBUG] [LOCAL ] TXO: Loaded 19715 existing records from primary storage. [2025-10-14T22:43:04.240140] [INFO ] [MAIN ] TXO: Loaded 19715 primary data records. [2025-10-14T22:43:04.980224] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:04.982106] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48647 primary records. [2025-10-14T22:43:04.982492] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-14T22:43:04.996265] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:05.005835] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23315 primary records. [2025-10-14T22:43:05.008711] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-14T22:43:05.031470] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-14T22:43:05.032909] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-14T22:43:05.032701] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-14T22:43:05.042590] [INFO ] [MAIN ] Derivative Progress: 1609/1812 symbols completed. TWO took 1.2s. Estimated remaining: 1m 17s. Rate: 158.7 symbols/min [2025-10-14T22:43:05.040683] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-14T22:43:05.049718] [INFO ] [MAIN ] Derivative Progress: 1610/1812 symbols completed. TX took 1.1s. Estimated remaining: 1m 16s. Rate: 158.8 symbols/min [2025-10-14T22:43:05.047312] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:05.049943] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:05.051751] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:05.052388] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 19715 primary records. [2025-10-14T22:43:05.052449] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-14T22:43:05.072951] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-14T22:43:05.073065] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-14T22:43:05.074976] [INFO ] [MAIN ] Derivative Progress: 1611/1812 symbols completed. TXO took 1.1s. Estimated remaining: 1m 16s. Rate: 158.9 symbols/min [2025-10-14T22:43:05.079030] [DEBUG] [LOCAL ] TY: Loaded 7589 existing records from primary storage. [2025-10-14T22:43:05.079277] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:05.079409] [INFO ] [MAIN ] TY: Loaded 7589 primary data records. [2025-10-14T22:43:05.284421] [DEBUG] [LOCAL ] TYG: Loaded 13882 existing records from primary storage. [2025-10-14T22:43:05.284625] [INFO ] [MAIN ] TYG: Loaded 13882 primary data records. [2025-10-14T22:43:05.483558] [DEBUG] [LOCAL ] TXT: Loaded 49654 existing records from primary storage. [2025-10-14T22:43:05.501496] [INFO ] [MAIN ] TXT: Loaded 49654 primary data records. [2025-10-14T22:43:06.034012] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:06.035259] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7589 primary records. [2025-10-14T22:43:06.035535] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-14T22:43:06.055009] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-14T22:43:06.055325] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-14T22:43:06.057482] [INFO ] [MAIN ] Derivative Progress: 1612/1812 symbols completed. TY took 1.0s. Estimated remaining: 1m 16s. Rate: 158.7 symbols/min [2025-10-14T22:43:06.065955] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:06.073417] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:06.074551] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13882 primary records. [2025-10-14T22:43:06.074672] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-14T22:43:06.095873] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:06.096669] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49654 primary records. [2025-10-14T22:43:06.097889] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-14T22:43:06.126235] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-14T22:43:06.134501] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-14T22:43:06.137134] [DEBUG] [LOCAL ] TYL: Loaded 22515 existing records from primary storage. [2025-10-14T22:43:06.136532] [INFO ] [MAIN ] Derivative Progress: 1613/1812 symbols completed. TXT took 1.1s. Estimated remaining: 1m 15s. Rate: 158.8 symbols/min [2025-10-14T22:43:06.137314] [INFO ] [MAIN ] TYL: Loaded 22515 primary data records. [2025-10-14T22:43:06.133495] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-14T22:43:06.137570] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-14T22:43:06.160371] [INFO ] [MAIN ] Derivative Progress: 1614/1812 symbols completed. TYG took 1.1s. Estimated remaining: 1m 15s. Rate: 158.9 symbols/min [2025-10-14T22:43:06.148982] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:06.160722] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:06.556244] [DEBUG] [LOCAL ] UA: Loaded 50470 existing records from primary storage. [2025-10-14T22:43:06.557263] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-14T22:43:06.557668] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-14T22:43:06.557529] [INFO ] [MAIN ] UA: Loaded 50470 primary data records. [2025-10-14T22:43:07.053256] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:07.054218] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22515 primary records. [2025-10-14T22:43:07.166692] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-14T22:43:07.185177] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-14T22:43:07.185939] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-14T22:43:07.188510] [INFO ] [MAIN ] Derivative Progress: 1615/1812 symbols completed. TYL took 1.1s. Estimated remaining: 1m 14s. Rate: 158.7 symbols/min [2025-10-14T22:43:07.188666] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:07.215695] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:07.229235] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50470 primary records. [2025-10-14T22:43:07.228447] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:07.229936] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-14T22:43:07.229352] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-14T22:43:07.230353] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-14T22:43:07.272255] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-14T22:43:07.273883] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-14T22:43:07.274112] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-14T22:43:07.273990] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-14T22:43:07.276081] [INFO ] [MAIN ] Derivative Progress: 1616/1812 symbols completed. U took 1.1s. Estimated remaining: 1m 14s. Rate: 158.8 symbols/min [2025-10-14T22:43:07.278846] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:07.279042] [INFO ] [MAIN ] Derivative Progress: 1617/1812 symbols completed. UA took 1.1s. Estimated remaining: 1m 14s. Rate: 158.9 symbols/min [2025-10-14T22:43:07.279146] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:07.302220] [DEBUG] [LOCAL ] UAA: Loaded 53505 existing records from primary storage. [2025-10-14T22:43:07.301398] [DEBUG] [LOCAL ] UAN: Loaded 5446 existing records from primary storage. [2025-10-14T22:43:07.302465] [INFO ] [MAIN ] UAA: Loaded 53505 primary data records. [2025-10-14T22:43:07.302540] [INFO ] [MAIN ] UAN: Loaded 5446 primary data records. [2025-10-14T22:43:07.928295] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-14T22:43:07.928598] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-14T22:43:08.270148] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:08.271423] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53505 primary records. [2025-10-14T22:43:08.272221] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-14T22:43:08.305245] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-14T22:43:08.306092] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:08.306184] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-14T22:43:08.308473] [INFO ] [MAIN ] Derivative Progress: 1618/1812 symbols completed. UAA took 1.1s. Estimated remaining: 1m 13s. Rate: 158.7 symbols/min [2025-10-14T22:43:08.309315] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5446 primary records. [2025-10-14T22:43:08.309798] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-14T22:43:08.327724] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-14T22:43:08.328051] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-14T22:43:08.330209] [INFO ] [MAIN ] Derivative Progress: 1619/1812 symbols completed. UAN took 1.1s. Estimated remaining: 1m 13s. Rate: 158.8 symbols/min [2025-10-14T22:43:08.342556] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:08.343214] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-14T22:43:08.343317] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-14T22:43:08.358828] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-14T22:43:08.358884] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-14T22:43:08.360760] [INFO ] [MAIN ] Derivative Progress: 1620/1812 symbols completed. UBER took 1.1s. Estimated remaining: 1m 12s. Rate: 158.9 symbols/min [2025-10-14T22:43:08.361271] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:08.361193] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:08.361436] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:08.441322] [DEBUG] [LOCAL ] UDR: Loaded 52034 existing records from primary storage. [2025-10-14T22:43:08.455508] [INFO ] [MAIN ] UDR: Loaded 52034 primary data records. [2025-10-14T22:43:08.454453] [DEBUG] [LOCAL ] UCB: Loaded 37813 existing records from primary storage. [2025-10-14T22:43:08.455780] [INFO ] [MAIN ] UCB: Loaded 37813 primary data records. [2025-10-14T22:43:08.479769] [DEBUG] [LOCAL ] UBS: Loaded 52316 existing records from primary storage. [2025-10-14T22:43:08.524867] [INFO ] [MAIN ] UBS: Loaded 52316 primary data records. [2025-10-14T22:43:09.406564] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:09.421061] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:09.420621] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 52034 primary records. [2025-10-14T22:43:09.421207] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-14T22:43:09.421904] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37813 primary records. [2025-10-14T22:43:09.429775] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-14T22:43:09.442672] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:09.453989] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52316 primary records. [2025-10-14T22:43:09.454919] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-14T22:43:09.472465] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-14T22:43:09.472563] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-14T22:43:09.477099] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-14T22:43:09.479864] [INFO ] [MAIN ] Derivative Progress: 1621/1812 symbols completed. UDR took 1.1s. Estimated remaining: 1m 12s. Rate: 158.7 symbols/min [2025-10-14T22:43:09.477821] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-14T22:43:09.480705] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:09.483388] [INFO ] [MAIN ] Derivative Progress: 1622/1812 symbols completed. UCB took 1.1s. Estimated remaining: 1m 12s. Rate: 158.8 symbols/min [2025-10-14T22:43:09.483639] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:09.488462] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-14T22:43:09.488585] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-14T22:43:09.490692] [INFO ] [MAIN ] Derivative Progress: 1623/1812 symbols completed. UBS took 1.1s. Estimated remaining: 1m 11s. Rate: 158.9 symbols/min [2025-10-14T22:43:09.492793] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:09.497891] [DEBUG] [LOCAL ] UFI: Loaded 8163 existing records from primary storage. [2025-10-14T22:43:09.498121] [INFO ] [MAIN ] UFI: Loaded 8163 primary data records. [2025-10-14T22:43:09.826588] [DEBUG] [LOCAL ] UE: Loaded 42547 existing records from primary storage. [2025-10-14T22:43:09.839994] [INFO ] [MAIN ] UE: Loaded 42547 primary data records. [2025-10-14T22:43:09.955969] [DEBUG] [LOCAL ] UGI: Loaded 50609 existing records from primary storage. [2025-10-14T22:43:09.963942] [INFO ] [MAIN ] UGI: Loaded 50609 primary data records. [2025-10-14T22:43:10.518377] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:10.519531] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8163 primary records. [2025-10-14T22:43:10.519752] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-14T22:43:10.535148] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-14T22:43:10.535278] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-14T22:43:10.537073] [INFO ] [MAIN ] Derivative Progress: 1624/1812 symbols completed. UFI took 1.1s. Estimated remaining: 1m 11s. Rate: 158.7 symbols/min [2025-10-14T22:43:10.538423] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:10.555229] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:10.555983] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42547 primary records. [2025-10-14T22:43:10.556149] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-14T22:43:10.572978] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-14T22:43:10.574532] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-14T22:43:10.576687] [INFO ] [MAIN ] Derivative Progress: 1625/1812 symbols completed. UE took 1.1s. Estimated remaining: 1m 11s. Rate: 158.8 symbols/min [2025-10-14T22:43:10.577188] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:10.590440] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:10.591150] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50609 primary records. [2025-10-14T22:43:10.591343] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-14T22:43:10.616367] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-14T22:43:10.619910] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-14T22:43:10.622728] [INFO ] [MAIN ] Derivative Progress: 1626/1812 symbols completed. UGI took 1.1s. Estimated remaining: 1m 10s. Rate: 158.9 symbols/min [2025-10-14T22:43:10.622960] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:10.636547] [DEBUG] [LOCAL ] UGP: Loaded 42920 existing records from primary storage. [2025-10-14T22:43:10.642165] [INFO ] [MAIN ] UGP: Loaded 42920 primary data records. [2025-10-14T22:43:10.642753] [DEBUG] [LOCAL ] UHAL: Loaded 16876 existing records from primary storage. [2025-10-14T22:43:10.673632] [INFO ] [MAIN ] UHAL: Loaded 16876 primary data records. [2025-10-14T22:43:11.241458] [DEBUG] [LOCAL ] UHS: Loaded 40255 existing records from primary storage. [2025-10-14T22:43:11.242178] [INFO ] [MAIN ] UHS: Loaded 40255 primary data records. [2025-10-14T22:43:11.584784] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:11.584421] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:11.586824] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42920 primary records. [2025-10-14T22:43:11.587580] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-14T22:43:11.588670] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16876 primary records. [2025-10-14T22:43:11.588782] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-14T22:43:11.623018] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-14T22:43:11.624002] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-14T22:43:11.626297] [INFO ] [MAIN ] Derivative Progress: 1627/1812 symbols completed. UHAL took 1.0s. Estimated remaining: 1m 10s. Rate: 158.8 symbols/min [2025-10-14T22:43:11.626991] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:11.630357] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-14T22:43:11.630477] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-14T22:43:11.632611] [INFO ] [MAIN ] Derivative Progress: 1628/1812 symbols completed. UGP took 1.1s. Estimated remaining: 1m 9s. Rate: 158.9 symbols/min [2025-10-14T22:43:11.633806] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:11.652427] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:11.653217] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40255 primary records. [2025-10-14T22:43:11.653415] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-14T22:43:11.672544] [DEBUG] [LOCAL ] UHT: Loaded 10125 existing records from primary storage. [2025-10-14T22:43:11.679563] [INFO ] [MAIN ] UHT: Loaded 10125 primary data records. [2025-10-14T22:43:11.688264] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-14T22:43:11.734933] [DEBUG] [LOCAL ] UI: Loaded 13864 existing records from primary storage. [2025-10-14T22:43:11.735020] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-14T22:43:11.756993] [INFO ] [MAIN ] UI: Loaded 13864 primary data records. [2025-10-14T22:43:11.831164] [INFO ] [MAIN ] Derivative Progress: 1629/1812 symbols completed. UHS took 1.2s. Estimated remaining: 1m 9s. Rate: 158.9 symbols/min [2025-10-14T22:43:11.852245] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:12.364505] [DEBUG] [LOCAL ] UIS: Loaded 36896 existing records from primary storage. [2025-10-14T22:43:12.365483] [INFO ] [MAIN ] UIS: Loaded 36896 primary data records. [2025-10-14T22:43:12.686702] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:12.692293] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:12.693165] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13864 primary records. [2025-10-14T22:43:12.693369] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-14T22:43:12.694082] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10125 primary records. [2025-10-14T22:43:12.695008] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-14T22:43:12.727075] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-14T22:43:12.729450] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-14T22:43:12.729556] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-14T22:43:12.729988] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-14T22:43:12.732588] [INFO ] [MAIN ] Derivative Progress: 1630/1812 symbols completed. UHT took 1.1s. Estimated remaining: 1m 9s. Rate: 158.8 symbols/min [2025-10-14T22:43:12.735200] [INFO ] [MAIN ] Derivative Progress: 1631/1812 symbols completed. UI took 1.1s. Estimated remaining: 1m 8s. Rate: 158.9 symbols/min [2025-10-14T22:43:12.735026] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:12.735839] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:12.754996] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:12.755619] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36896 primary records. [2025-10-14T22:43:12.755828] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-14T22:43:12.771853] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-14T22:43:12.772091] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-14T22:43:12.774133] [INFO ] [MAIN ] Derivative Progress: 1632/1812 symbols completed. UIS took 0.9s. Estimated remaining: 1m 8s. Rate: 159.0 symbols/min [2025-10-14T22:43:12.774387] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:12.813764] [DEBUG] [LOCAL ] ULS: Loaded 38972 existing records from primary storage. [2025-10-14T22:43:12.813922] [INFO ] [MAIN ] ULS: Loaded 38972 primary data records. [2025-10-14T22:43:12.931879] [DEBUG] [LOCAL ] UL: Loaded 53077 existing records from primary storage. [2025-10-14T22:43:12.961627] [INFO ] [MAIN ] UL: Loaded 53077 primary data records. [2025-10-14T22:43:13.271203] [DEBUG] [LOCAL ] UMC: Loaded 52685 existing records from primary storage. [2025-10-14T22:43:13.277321] [INFO ] [MAIN ] UMC: Loaded 52685 primary data records. [2025-10-14T22:43:13.793210] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:13.794882] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 38972 primary records. [2025-10-14T22:43:13.795665] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-14T22:43:13.826628] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-14T22:43:13.840843] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-14T22:43:13.841842] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:13.845307] [INFO ] [MAIN ] Derivative Progress: 1633/1812 symbols completed. ULS took 1.1s. Estimated remaining: 1m 8s. Rate: 158.8 symbols/min [2025-10-14T22:43:13.846597] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53077 primary records. [2025-10-14T22:43:13.847115] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-14T22:43:13.878169] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:13.878892] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-14T22:43:13.879053] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-14T22:43:13.881228] [INFO ] [MAIN ] Derivative Progress: 1634/1812 symbols completed. UL took 1.1s. Estimated remaining: 1m 7s. Rate: 158.9 symbols/min [2025-10-14T22:43:13.882034] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52685 primary records. [2025-10-14T22:43:13.882105] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-14T22:43:13.897849] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-14T22:43:13.897958] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-14T22:43:13.900102] [INFO ] [MAIN ] Derivative Progress: 1635/1812 symbols completed. UMC took 1.1s. Estimated remaining: 1m 7s. Rate: 159.0 symbols/min [2025-10-14T22:43:13.900510] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:13.900618] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:13.901707] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:13.916795] [DEBUG] [LOCAL ] UNF: Loaded 11797 existing records from primary storage. [2025-10-14T22:43:13.916918] [INFO ] [MAIN ] UNF: Loaded 11797 primary data records. [2025-10-14T22:43:14.236223] [DEBUG] [LOCAL ] UMH: Loaded 34032 existing records from primary storage. [2025-10-14T22:43:14.292106] [INFO ] [MAIN ] UMH: Loaded 34032 primary data records. [2025-10-14T22:43:14.282982] [DEBUG] [LOCAL ] UNFI: Loaded 42585 existing records from primary storage. [2025-10-14T22:43:14.292289] [INFO ] [MAIN ] UNFI: Loaded 42585 primary data records. [2025-10-14T22:43:14.966335] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:14.967516] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11797 primary records. [2025-10-14T22:43:14.968265] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-14T22:43:15.003562] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-14T22:43:15.003927] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:15.004823] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-14T22:43:15.005556] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 34032 primary records. [2025-10-14T22:43:15.007492] [INFO ] [MAIN ] Derivative Progress: 1636/1812 symbols completed. UNF took 1.1s. Estimated remaining: 1m 7s. Rate: 158.8 symbols/min [2025-10-14T22:43:15.009218] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:15.007565] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-14T22:43:15.037071] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:15.040369] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42585 primary records. [2025-10-14T22:43:15.040562] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-14T22:43:15.039599] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-14T22:43:15.040692] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-14T22:43:15.043233] [INFO ] [MAIN ] Derivative Progress: 1637/1812 symbols completed. UMH took 1.1s. Estimated remaining: 1m 6s. Rate: 158.9 symbols/min [2025-10-14T22:43:15.043418] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:15.059957] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-14T22:43:15.060112] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-14T22:43:15.062335] [INFO ] [MAIN ] Derivative Progress: 1638/1812 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 6s. Rate: 158.9 symbols/min [2025-10-14T22:43:15.062575] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:15.069075] [DEBUG] [LOCAL ] UNMA: Loaded 3529 existing records from primary storage. [2025-10-14T22:43:15.069335] [INFO ] [MAIN ] UNMA: Loaded 3529 primary data records. [2025-10-14T22:43:15.433800] [DEBUG] [LOCAL ] UNH: Loaded 53811 existing records from primary storage. [2025-10-14T22:43:15.434901] [INFO ] [MAIN ] UNH: Loaded 53811 primary data records. [2025-10-14T22:43:15.435849] [DEBUG] [LOCAL ] UNM: Loaded 48154 existing records from primary storage. [2025-10-14T22:43:15.449243] [INFO ] [MAIN ] UNM: Loaded 48154 primary data records. [2025-10-14T22:43:16.097980] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-14T22:43:16.099603] [INFO ] [MAIN ] UNMA: Generated 1792 derivative records from 3529 primary records. [2025-10-14T22:43:16.100157] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-14T22:43:16.122065] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1792 records). [2025-10-14T22:43:16.122480] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-14T22:43:16.124837] [INFO ] [MAIN ] Derivative Progress: 1639/1812 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 5s. Rate: 158.8 symbols/min [2025-10-14T22:43:16.125382] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:16.153471] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:16.159681] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53811 primary records. [2025-10-14T22:43:16.160119] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-14T22:43:16.160356] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:16.162149] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48154 primary records. [2025-10-14T22:43:16.162542] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-14T22:43:16.194720] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-14T22:43:16.196077] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-14T22:43:16.196174] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-14T22:43:16.196374] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-14T22:43:16.198423] [INFO ] [MAIN ] Derivative Progress: 1640/1812 symbols completed. UNH took 1.2s. Estimated remaining: 1m 5s. Rate: 158.8 symbols/min [2025-10-14T22:43:16.200933] [INFO ] [MAIN ] Derivative Progress: 1641/1812 symbols completed. UNM took 1.2s. Estimated remaining: 1m 5s. Rate: 158.9 symbols/min [2025-10-14T22:43:16.201241] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:16.198613] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:16.243225] [DEBUG] [LOCAL ] UNP: Loaded 53343 existing records from primary storage. [2025-10-14T22:43:16.243540] [INFO ] [MAIN ] UNP: Loaded 53343 primary data records. [2025-10-14T22:43:16.408627] [DEBUG] [LOCAL ] UP: Loaded 44064 existing records from primary storage. [2025-10-14T22:43:16.430091] [INFO ] [MAIN ] UP: Loaded 44064 primary data records. [2025-10-14T22:43:16.572492] [DEBUG] [LOCAL ] UPS: Loaded 53719 existing records from primary storage. [2025-10-14T22:43:16.652779] [INFO ] [MAIN ] UPS: Loaded 53719 primary data records. [2025-10-14T22:43:17.293870] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:17.294953] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53343 primary records. [2025-10-14T22:43:17.295292] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-14T22:43:17.326558] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:17.328461] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 44064 primary records. [2025-10-14T22:43:17.328559] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-14T22:43:17.328680] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-14T22:43:17.329087] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-14T22:43:17.331020] [INFO ] [MAIN ] Derivative Progress: 1642/1812 symbols completed. UNP took 1.2s. Estimated remaining: 1m 4s. Rate: 158.8 symbols/min [2025-10-14T22:43:17.332739] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:17.358350] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-14T22:43:17.363282] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-14T22:43:17.365835] [INFO ] [MAIN ] Derivative Progress: 1643/1812 symbols completed. UP took 1.2s. Estimated remaining: 1m 4s. Rate: 158.8 symbols/min [2025-10-14T22:43:17.363586] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:17.366859] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:17.366693] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53719 primary records. [2025-10-14T22:43:17.367535] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-14T22:43:17.384167] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-10-14T22:43:17.384276] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-14T22:43:17.386665] [INFO ] [MAIN ] Derivative Progress: 1644/1812 symbols completed. UPS took 1.2s. Estimated remaining: 1m 3s. Rate: 158.9 symbols/min [2025-10-14T22:43:17.395843] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:17.411137] [DEBUG] [LOCAL ] URI: Loaded 34814 existing records from primary storage. [2025-10-14T22:43:17.420560] [INFO ] [MAIN ] URI: Loaded 34814 primary data records. [2025-10-14T22:43:17.526990] [DEBUG] [LOCAL ] USA: Loaded 36330 existing records from primary storage. [2025-10-14T22:43:17.550561] [DEBUG] [LOCAL ] USAC: Loaded 21622 existing records from primary storage. [2025-10-14T22:43:17.550692] [INFO ] [MAIN ] USA: Loaded 36330 primary data records. [2025-10-14T22:43:17.550994] [INFO ] [MAIN ] USAC: Loaded 21622 primary data records. [2025-10-14T22:43:18.444483] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:18.458622] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 34814 primary records. [2025-10-14T22:43:18.459636] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-14T22:43:18.459559] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:18.461636] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36330 primary records. [2025-10-14T22:43:18.476620] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-14T22:43:18.496744] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-14T22:43:18.504621] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-14T22:43:18.508122] [INFO ] [MAIN ] Derivative Progress: 1645/1812 symbols completed. URI took 1.2s. Estimated remaining: 1m 3s. Rate: 158.7 symbols/min [2025-10-14T22:43:18.508862] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:18.508738] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:18.510453] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21622 primary records. [2025-10-14T22:43:18.511235] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-14T22:43:18.529728] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-14T22:43:18.532269] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-14T22:43:18.534594] [INFO ] [MAIN ] Derivative Progress: 1646/1812 symbols completed. USA took 1.2s. Estimated remaining: 1m 3s. Rate: 158.8 symbols/min [2025-10-14T22:43:18.535798] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:18.538858] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-14T22:43:18.539377] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-14T22:43:18.541814] [INFO ] [MAIN ] Derivative Progress: 1647/1812 symbols completed. USAC took 1.1s. Estimated remaining: 1m 2s. Rate: 158.9 symbols/min [2025-10-14T22:43:18.542078] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:18.561064] [DEBUG] [LOCAL ] USNA: Loaded 17888 existing records from primary storage. [2025-10-14T22:43:18.575012] [INFO ] [MAIN ] USNA: Loaded 17888 primary data records. [2025-10-14T22:43:18.706949] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-14T22:43:18.707798] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-14T22:43:18.843405] [DEBUG] [LOCAL ] USFD: Loaded 51148 existing records from primary storage. [2025-10-14T22:43:18.982696] [INFO ] [MAIN ] USFD: Loaded 51148 primary data records. [2025-10-14T22:43:19.538146] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:19.539807] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17888 primary records. [2025-10-14T22:43:19.540794] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-14T22:43:19.569264] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:19.571401] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-14T22:43:19.571790] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-14T22:43:19.593499] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-14T22:43:19.594059] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-14T22:43:19.595041] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-14T22:43:19.595212] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-14T22:43:19.597145] [INFO ] [MAIN ] Derivative Progress: 1648/1812 symbols completed. USNA took 1.1s. Estimated remaining: 1m 2s. Rate: 158.8 symbols/min [2025-10-14T22:43:19.611714] [INFO ] [MAIN ] Derivative Progress: 1649/1812 symbols completed. USB took 1.1s. Estimated remaining: 1m 2s. Rate: 158.8 symbols/min [2025-10-14T22:43:19.612237] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:19.612912] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51148 primary records. [2025-10-14T22:43:19.612994] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-14T22:43:19.628134] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-14T22:43:19.628192] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-14T22:43:19.630429] [INFO ] [MAIN ] Derivative Progress: 1650/1812 symbols completed. USFD took 1.1s. Estimated remaining: 1m 1s. Rate: 158.9 symbols/min [2025-10-14T22:43:19.630787] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:19.630977] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:19.630923] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:19.666677] [DEBUG] [LOCAL ] USPH: Loaded 17120 existing records from primary storage. [2025-10-14T22:43:19.666917] [INFO ] [MAIN ] USPH: Loaded 17120 primary data records. [2025-10-14T22:43:19.793869] [DEBUG] [LOCAL ] UTF: Loaded 30753 existing records from primary storage. [2025-10-14T22:43:19.833264] [DEBUG] [LOCAL ] UTI: Loaded 40511 existing records from primary storage. [2025-10-14T22:43:19.820126] [INFO ] [MAIN ] UTF: Loaded 30753 primary data records. [2025-10-14T22:43:19.865447] [INFO ] [MAIN ] UTI: Loaded 40511 primary data records. [2025-10-14T22:43:20.656760] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:20.657723] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17120 primary records. [2025-10-14T22:43:20.657834] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-14T22:43:20.677751] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-14T22:43:20.678055] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-14T22:43:20.679964] [INFO ] [MAIN ] Derivative Progress: 1651/1812 symbols completed. USPH took 1.0s. Estimated remaining: 1m 1s. Rate: 158.8 symbols/min [2025-10-14T22:43:20.680219] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:20.715962] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:20.716382] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:20.721937] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40511 primary records. [2025-10-14T22:43:20.717119] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 30753 primary records. [2025-10-14T22:43:20.722126] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-14T22:43:20.722435] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-14T22:43:20.722372] [DEBUG] [LOCAL ] UTL: Loaded 11767 existing records from primary storage. [2025-10-14T22:43:20.723210] [INFO ] [MAIN ] UTL: Loaded 11767 primary data records. [2025-10-14T22:43:20.814448] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-14T22:43:20.830759] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-14T22:43:20.837628] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-14T22:43:20.850020] [INFO ] [MAIN ] Derivative Progress: 1652/1812 symbols completed. UTF took 1.2s. Estimated remaining: 1m 0s. Rate: 158.8 symbols/min [2025-10-14T22:43:20.842847] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-14T22:43:20.850209] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:20.852542] [INFO ] [MAIN ] Derivative Progress: 1653/1812 symbols completed. UTI took 1.2s. Estimated remaining: 1m 0s. Rate: 158.9 symbols/min [2025-10-14T22:43:20.870397] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:21.084022] [DEBUG] [LOCAL ] UVE: Loaded 21951 existing records from primary storage. [2025-10-14T22:43:21.084831] [INFO ] [MAIN ] UVE: Loaded 21951 primary data records. [2025-10-14T22:43:21.216028] [DEBUG] [LOCAL ] UTZ: Loaded 44663 existing records from primary storage. [2025-10-14T22:43:21.221634] [INFO ] [MAIN ] UTZ: Loaded 44663 primary data records. [2025-10-14T22:43:21.608432] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:21.609719] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11767 primary records. [2025-10-14T22:43:21.610047] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-14T22:43:21.741130] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-14T22:43:21.741971] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-14T22:43:21.744527] [INFO ] [MAIN ] Derivative Progress: 1654/1812 symbols completed. UTL took 1.1s. Estimated remaining: 59.7s. Rate: 158.8 symbols/min [2025-10-14T22:43:21.745246] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:21.762495] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:21.763203] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21951 primary records. [2025-10-14T22:43:21.763391] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-14T22:43:21.786512] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-14T22:43:21.789228] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-14T22:43:21.791293] [INFO ] [MAIN ] Derivative Progress: 1655/1812 symbols completed. UVE took 0.9s. Estimated remaining: 59.3s. Rate: 158.9 symbols/min [2025-10-14T22:43:21.791576] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:21.813057] [DEBUG] [LOCAL ] UVV: Loaded 22757 existing records from primary storage. [2025-10-14T22:43:21.813632] [INFO ] [MAIN ] UVV: Loaded 22757 primary data records. [2025-10-14T22:43:21.814061] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:21.827503] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44663 primary records. [2025-10-14T22:43:21.852063] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-14T22:43:21.957172] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-14T22:43:21.957697] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-14T22:43:21.959908] [INFO ] [MAIN ] Derivative Progress: 1656/1812 symbols completed. UTZ took 1.1s. Estimated remaining: 58.9s. Rate: 158.9 symbols/min [2025-10-14T22:43:21.960047] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:22.211520] [DEBUG] [LOCAL ] UZD: Loaded 6257 existing records from primary storage. [2025-10-14T22:43:22.225353] [INFO ] [MAIN ] UZD: Loaded 6257 primary data records. [2025-10-14T22:43:22.265094] [DEBUG] [LOCAL ] UWMC: Loaded 52937 existing records from primary storage. [2025-10-14T22:43:22.272824] [INFO ] [MAIN ] UWMC: Loaded 52937 primary data records. [2025-10-14T22:43:22.872582] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:22.874468] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22757 primary records. [2025-10-14T22:43:22.874560] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-14T22:43:22.896295] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-14T22:43:22.896767] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-14T22:43:22.898805] [INFO ] [MAIN ] Derivative Progress: 1657/1812 symbols completed. UVV took 1.2s. Estimated remaining: 58.6s. Rate: 158.8 symbols/min [2025-10-14T22:43:22.899173] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:22.913807] [DEBUG] [LOCAL ] UZE: Loaded 7371 existing records from primary storage. [2025-10-14T22:43:22.914118] [INFO ] [MAIN ] UZE: Loaded 7371 primary data records. [2025-10-14T22:43:23.005352] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:23.022980] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6257 primary records. [2025-10-14T22:43:23.023312] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:23.034282] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-14T22:43:23.042416] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52937 primary records. [2025-10-14T22:43:23.052195] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-14T22:43:23.264535] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-14T22:43:23.265317] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-14T22:43:23.268265] [INFO ] [MAIN ] Derivative Progress: 1658/1812 symbols completed. UZD took 1.3s. Estimated remaining: 58.2s. Rate: 158.8 symbols/min [2025-10-14T22:43:23.268874] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:23.273574] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-14T22:43:23.274235] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-14T22:43:23.278051] [INFO ] [MAIN ] Derivative Progress: 1659/1812 symbols completed. UWMC took 1.5s. Estimated remaining: 57.8s. Rate: 158.9 symbols/min [2025-10-14T22:43:23.278486] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:23.282323] [DEBUG] [LOCAL ] UZF: Loaded 6123 existing records from primary storage. [2025-10-14T22:43:23.282456] [INFO ] [MAIN ] UZF: Loaded 6123 primary data records. [2025-10-14T22:43:23.675822] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:23.676945] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7371 primary records. [2025-10-14T22:43:23.677213] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-14T22:43:23.716277] [DEBUG] [LOCAL ] V: Loaded 53753 existing records from primary storage. [2025-10-14T22:43:23.716546] [INFO ] [MAIN ] V: Loaded 53753 primary data records. [2025-10-14T22:43:23.747249] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-14T22:43:23.767601] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-14T22:43:23.779098] [INFO ] [MAIN ] Derivative Progress: 1660/1812 symbols completed. UZE took 0.9s. Estimated remaining: 57.4s. Rate: 158.8 symbols/min [2025-10-14T22:43:23.818389] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:23.954861] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:23.988573] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6123 primary records. [2025-10-14T22:43:24.135383] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-14T22:43:24.191421] [DEBUG] [LOCAL ] VAC: Loaded 34176 existing records from primary storage. [2025-10-14T22:43:24.192690] [INFO ] [MAIN ] VAC: Loaded 34176 primary data records. [2025-10-14T22:43:24.211688] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-14T22:43:24.217908] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-14T22:43:24.226681] [INFO ] [MAIN ] Derivative Progress: 1661/1812 symbols completed. UZF took 1.0s. Estimated remaining: 57.0s. Rate: 158.8 symbols/min [2025-10-14T22:43:24.271223] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:24.645493] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:24.646370] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53753 primary records. [2025-10-14T22:43:24.646505] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-14T22:43:24.677306] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-14T22:43:24.678965] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-14T22:43:24.681233] [INFO ] [MAIN ] Derivative Progress: 1662/1812 symbols completed. V took 1.4s. Estimated remaining: 56.7s. Rate: 158.8 symbols/min [2025-10-14T22:43:24.695424] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:24.696823] [DEBUG] [LOCAL ] VAL: Loaded 50194 existing records from primary storage. [2025-10-14T22:43:24.697215] [INFO ] [MAIN ] VAL: Loaded 50194 primary data records. [2025-10-14T22:43:25.035093] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:25.036447] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34176 primary records. [2025-10-14T22:43:25.036880] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-14T22:43:25.069457] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-14T22:43:25.070210] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-14T22:43:25.156128] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-14T22:43:25.167614] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-14T22:43:25.180905] [INFO ] [MAIN ] Derivative Progress: 1663/1812 symbols completed. VAC took 1.4s. Estimated remaining: 56.3s. Rate: 158.8 symbols/min [2025-10-14T22:43:25.270953] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:25.355364] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50194 primary records. [2025-10-14T22:43:25.385802] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-14T22:43:25.403592] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-14T22:43:25.403753] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-14T22:43:25.405945] [INFO ] [MAIN ] Derivative Progress: 1664/1812 symbols completed. VAL took 1.1s. Estimated remaining: 55.9s. Rate: 158.8 symbols/min [2025-10-14T22:43:25.424984] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:25.425523] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-14T22:43:25.425585] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-14T22:43:25.440861] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-14T22:43:25.440920] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-14T22:43:25.442937] [INFO ] [MAIN ] Derivative Progress: 1665/1812 symbols completed. VALE took 0.7s. Estimated remaining: 55.5s. Rate: 158.9 symbols/min [2025-10-14T22:43:25.443364] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:25.443277] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:25.443409] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:25.459220] [DEBUG] [LOCAL ] VATE: Loaded 5216 existing records from primary storage. [2025-10-14T22:43:25.459028] [DEBUG] [LOCAL ] VBF: Loaded 7171 existing records from primary storage. [2025-10-14T22:43:25.459375] [INFO ] [MAIN ] VBF: Loaded 7171 primary data records. [2025-10-14T22:43:25.480444] [INFO ] [MAIN ] VATE: Loaded 5216 primary data records. [2025-10-14T22:43:25.508039] [DEBUG] [LOCAL ] VCV: Loaded 13625 existing records from primary storage. [2025-10-14T22:43:25.571520] [INFO ] [MAIN ] VCV: Loaded 13625 primary data records. [2025-10-14T22:43:26.430803] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:26.446296] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:26.445954] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7171 primary records. [2025-10-14T22:43:26.447183] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5216 primary records. [2025-10-14T22:43:26.447381] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-14T22:43:26.447809] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-14T22:43:26.482343] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:26.483522] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13625 primary records. [2025-10-14T22:43:26.484470] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-14T22:43:26.497474] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-14T22:43:26.497089] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-14T22:43:26.498375] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-14T22:43:26.503081] [INFO ] [MAIN ] Derivative Progress: 1666/1812 symbols completed. VBF took 1.1s. Estimated remaining: 55.2s. Rate: 158.7 symbols/min [2025-10-14T22:43:26.503804] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:26.503434] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-14T22:43:26.508302] [INFO ] [MAIN ] Derivative Progress: 1667/1812 symbols completed. VATE took 1.1s. Estimated remaining: 54.8s. Rate: 158.8 symbols/min [2025-10-14T22:43:26.508923] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:26.511095] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-14T22:43:26.511165] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-14T22:43:26.513284] [INFO ] [MAIN ] Derivative Progress: 1668/1812 symbols completed. VCV took 1.1s. Estimated remaining: 54.4s. Rate: 158.9 symbols/min [2025-10-14T22:43:26.513509] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:26.524263] [DEBUG] [LOCAL ] VEL: Loaded 12210 existing records from primary storage. [2025-10-14T22:43:26.524455] [INFO ] [MAIN ] VEL: Loaded 12210 primary data records. [2025-10-14T22:43:26.883288] [DEBUG] [LOCAL ] VEEV: Loaded 47276 existing records from primary storage. [2025-10-14T22:43:26.883560] [INFO ] [MAIN ] VEEV: Loaded 47276 primary data records. [2025-10-14T22:43:26.953007] [DEBUG] [LOCAL ] VET: Loaded 44140 existing records from primary storage. [2025-10-14T22:43:26.962481] [INFO ] [MAIN ] VET: Loaded 44140 primary data records. [2025-10-14T22:43:27.513094] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:27.514446] [INFO ] [MAIN ] VEL: Generated 1793 derivative records from 12210 primary records. [2025-10-14T22:43:27.514626] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-14T22:43:27.536305] [DEBUG] [LOCAL ] VEL: Derivative data saved (1793 records). [2025-10-14T22:43:27.536730] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-14T22:43:27.539006] [INFO ] [MAIN ] Derivative Progress: 1669/1812 symbols completed. VEL took 1.0s. Estimated remaining: 54.0s. Rate: 158.7 symbols/min [2025-10-14T22:43:27.540236] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:27.571018] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:27.571404] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:27.572167] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44140 primary records. [2025-10-14T22:43:27.573095] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47276 primary records. [2025-10-14T22:43:27.573250] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-14T22:43:27.573197] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-14T22:43:27.604461] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-14T22:43:27.604666] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-14T22:43:27.607804] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-14T22:43:27.608058] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-14T22:43:27.607228] [INFO ] [MAIN ] Derivative Progress: 1670/1812 symbols completed. VET took 1.1s. Estimated remaining: 53.6s. Rate: 158.8 symbols/min [2025-10-14T22:43:27.610440] [INFO ] [MAIN ] Derivative Progress: 1671/1812 symbols completed. VEEV took 1.1s. Estimated remaining: 53.2s. Rate: 158.9 symbols/min [2025-10-14T22:43:27.610556] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:27.610305] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:27.618848] [DEBUG] [LOCAL ] VGI: Loaded 5203 existing records from primary storage. [2025-10-14T22:43:27.619122] [INFO ] [MAIN ] VGI: Loaded 5203 primary data records. [2025-10-14T22:43:27.763399] [DEBUG] [LOCAL ] VGM: Loaded 18483 existing records from primary storage. [2025-10-14T22:43:27.764418] [DEBUG] [LOCAL ] VFC: Loaded 53605 existing records from primary storage. [2025-10-14T22:43:27.770386] [INFO ] [MAIN ] VFC: Loaded 53605 primary data records. [2025-10-14T22:43:27.770509] [INFO ] [MAIN ] VGM: Loaded 18483 primary data records. [2025-10-14T22:43:28.642110] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:28.643947] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5203 primary records. [2025-10-14T22:43:28.644285] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-14T22:43:28.664376] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-14T22:43:28.678049] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:28.679130] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53605 primary records. [2025-10-14T22:43:28.679482] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-14T22:43:28.672622] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-14T22:43:28.682205] [INFO ] [MAIN ] Derivative Progress: 1672/1812 symbols completed. VGI took 1.1s. Estimated remaining: 52.9s. Rate: 158.7 symbols/min [2025-10-14T22:43:28.682435] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:28.702316] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-14T22:43:28.703423] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-14T22:43:28.705675] [INFO ] [MAIN ] Derivative Progress: 1673/1812 symbols completed. VFC took 1.2s. Estimated remaining: 52.5s. Rate: 158.8 symbols/min [2025-10-14T22:43:28.705885] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:28.717071] [DEBUG] [LOCAL ] VHI: Loaded 2770 existing records from primary storage. [2025-10-14T22:43:28.717284] [INFO ] [MAIN ] VHI: Loaded 2770 primary data records. [2025-10-14T22:43:28.768287] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:28.795933] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18483 primary records. [2025-10-14T22:43:28.818957] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-14T22:43:28.925222] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-14T22:43:28.925461] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-14T22:43:28.927633] [INFO ] [MAIN ] Derivative Progress: 1674/1812 symbols completed. VGM took 1.3s. Estimated remaining: 52.1s. Rate: 158.9 symbols/min [2025-10-14T22:43:28.937844] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:29.077527] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-14T22:43:29.077909] [INFO ] [MAIN ] VICI: Loaded 53653 primary data records. [2025-10-14T22:43:29.225987] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:29.250320] [INFO ] [MAIN ] VHI: Generated 1793 derivative records from 2770 primary records. [2025-10-14T22:43:29.299404] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-14T22:43:29.409447] [DEBUG] [LOCAL ] VIK: Loaded 52466 existing records from primary storage. [2025-10-14T22:43:29.427777] [INFO ] [MAIN ] VIK: Loaded 52466 primary data records. [2025-10-14T22:43:29.431912] [DEBUG] [LOCAL ] VHI: Derivative data saved (1793 records). [2025-10-14T22:43:29.432077] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-14T22:43:29.434303] [INFO ] [MAIN ] Derivative Progress: 1675/1812 symbols completed. VHI took 0.8s. Estimated remaining: 51.7s. Rate: 158.8 symbols/min [2025-10-14T22:43:29.446128] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:29.770728] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:29.785206] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53653 primary records. [2025-10-14T22:43:29.785302] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-14T22:43:29.787835] [DEBUG] [LOCAL ] VIRT: Loaded 46659 existing records from primary storage. [2025-10-14T22:43:29.796399] [INFO ] [MAIN ] VIRT: Loaded 46659 primary data records. [2025-10-14T22:43:29.803149] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-14T22:43:29.856116] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-14T22:43:29.889166] [INFO ] [MAIN ] Derivative Progress: 1676/1812 symbols completed. VICI took 1.2s. Estimated remaining: 51.4s. Rate: 158.8 symbols/min [2025-10-14T22:43:29.907444] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:30.136680] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:30.148925] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52466 primary records. [2025-10-14T22:43:30.149238] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-14T22:43:30.166840] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-14T22:43:30.167194] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-14T22:43:30.169270] [INFO ] [MAIN ] Derivative Progress: 1677/1812 symbols completed. VIK took 1.2s. Estimated remaining: 51.0s. Rate: 158.8 symbols/min [2025-10-14T22:43:30.169705] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:30.185217] [DEBUG] [LOCAL ] VIST: Loaded 46457 existing records from primary storage. [2025-10-14T22:43:30.185662] [INFO ] [MAIN ] VIST: Loaded 46457 primary data records. [2025-10-14T22:43:30.313135] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:30.324389] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46659 primary records. [2025-10-14T22:43:30.366909] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-14T22:43:30.579108] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-14T22:43:30.580159] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-14T22:43:30.583147] [INFO ] [MAIN ] Derivative Progress: 1678/1812 symbols completed. VIRT took 1.1s. Estimated remaining: 50.6s. Rate: 158.8 symbols/min [2025-10-14T22:43:30.580935] [DEBUG] [LOCAL ] VIV: Loaded 44865 existing records from primary storage. [2025-10-14T22:43:30.584590] [INFO ] [MAIN ] VIV: Loaded 44865 primary data records. [2025-10-14T22:43:30.901827] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:30.902584] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46457 primary records. [2025-10-14T22:43:30.903194] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-14T22:43:30.921156] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-14T22:43:30.921384] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-14T22:43:30.923284] [INFO ] [MAIN ] Derivative Progress: 1679/1812 symbols completed. VIST took 1.0s. Estimated remaining: 50.2s. Rate: 158.8 symbols/min [2025-10-14T22:43:30.941382] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:30.941929] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44865 primary records. [2025-10-14T22:43:30.941987] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-14T22:43:30.957135] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-14T22:43:30.957201] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-14T22:43:30.959164] [INFO ] [MAIN ] Derivative Progress: 1680/1812 symbols completed. VIV took 0.8s. Estimated remaining: 49.8s. Rate: 158.9 symbols/min [2025-10-14T22:43:30.959791] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:30.959955] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:30.959900] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:30.986875] [DEBUG] [LOCAL ] VKQ: Loaded 17557 existing records from primary storage. [2025-10-14T22:43:30.987100] [INFO ] [MAIN ] VKQ: Loaded 17557 primary data records. [2025-10-14T22:43:31.094944] [DEBUG] [LOCAL ] VLN: Loaded 30586 existing records from primary storage. [2025-10-14T22:43:31.097286] [INFO ] [MAIN ] VLN: Loaded 30586 primary data records. [2025-10-14T22:43:31.485524] [DEBUG] [LOCAL ] VLO: Loaded 53039 existing records from primary storage. [2025-10-14T22:43:31.524790] [INFO ] [MAIN ] VLO: Loaded 53039 primary data records. [2025-10-14T22:43:31.997623] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:32.011055] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17557 primary records. [2025-10-14T22:43:32.011317] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:32.011503] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-14T22:43:32.012107] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 30586 primary records. [2025-10-14T22:43:32.013929] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-14T22:43:32.043884] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-14T22:43:32.045045] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-14T22:43:32.045205] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-14T22:43:32.047372] [INFO ] [MAIN ] Derivative Progress: 1681/1812 symbols completed. VLN took 1.1s. Estimated remaining: 49.5s. Rate: 158.8 symbols/min [2025-10-14T22:43:32.045159] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-14T22:43:32.047559] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:32.049593] [INFO ] [MAIN ] Derivative Progress: 1682/1812 symbols completed. VKQ took 1.1s. Estimated remaining: 49.1s. Rate: 158.9 symbols/min [2025-10-14T22:43:32.050318] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:32.071143] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:32.071336] [DEBUG] [LOCAL ] VLT: Loaded 4433 existing records from primary storage. [2025-10-14T22:43:32.072196] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53039 primary records. [2025-10-14T22:43:32.072272] [INFO ] [MAIN ] VLT: Loaded 4433 primary data records. [2025-10-14T22:43:32.072328] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-14T22:43:32.200422] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-14T22:43:32.204136] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-14T22:43:32.216755] [INFO ] [MAIN ] Derivative Progress: 1683/1812 symbols completed. VLO took 1.3s. Estimated remaining: 48.7s. Rate: 158.9 symbols/min [2025-10-14T22:43:32.227578] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:32.431218] [DEBUG] [LOCAL ] VLRS: Loaded 39894 existing records from primary storage. [2025-10-14T22:43:32.444482] [INFO ] [MAIN ] VLRS: Loaded 39894 primary data records. [2025-10-14T22:43:32.777179] [DEBUG] [LOCAL ] VLTO: Loaded 46185 existing records from primary storage. [2025-10-14T22:43:32.777500] [INFO ] [MAIN ] VLTO: Loaded 46185 primary data records. [2025-10-14T22:43:32.878069] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:32.898322] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4433 primary records. [2025-10-14T22:43:32.901880] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-14T22:43:32.996201] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-14T22:43:33.113139] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-14T22:43:33.116544] [INFO ] [MAIN ] Derivative Progress: 1684/1812 symbols completed. VLT took 1.1s. Estimated remaining: 48.4s. Rate: 158.8 symbols/min [2025-10-14T22:43:33.118098] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:33.133057] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:33.134077] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 39894 primary records. [2025-10-14T22:43:33.134240] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-14T22:43:33.153035] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-14T22:43:33.153275] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-14T22:43:33.155535] [INFO ] [MAIN ] Derivative Progress: 1685/1812 symbols completed. VLRS took 1.1s. Estimated remaining: 48.0s. Rate: 158.9 symbols/min [2025-10-14T22:43:33.156300] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:33.193712] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:33.206696] [DEBUG] [LOCAL ] VMC: Loaded 42613 existing records from primary storage. [2025-10-14T22:43:33.212745] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46185 primary records. [2025-10-14T22:43:33.213257] [DEBUG] [LOCAL ] VMI: Loaded 15080 existing records from primary storage. [2025-10-14T22:43:33.213426] [INFO ] [MAIN ] VMI: Loaded 15080 primary data records. [2025-10-14T22:43:33.213505] [INFO ] [MAIN ] VMC: Loaded 42613 primary data records. [2025-10-14T22:43:33.213731] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-14T22:43:33.486692] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-14T22:43:33.579911] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-14T22:43:33.608873] [INFO ] [MAIN ] Derivative Progress: 1686/1812 symbols completed. VLTO took 1.4s. Estimated remaining: 47.6s. Rate: 158.8 symbols/min [2025-10-14T22:43:33.834291] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:33.868259] [DEBUG] [LOCAL ] VMO: Loaded 20806 existing records from primary storage. [2025-10-14T22:43:33.868558] [INFO ] [MAIN ] VMO: Loaded 20806 primary data records. [2025-10-14T22:43:33.994607] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:33.996406] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15080 primary records. [2025-10-14T22:43:34.007039] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-14T22:43:34.088247] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:34.089221] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 42613 primary records. [2025-10-14T22:43:34.089314] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-14T22:43:34.238414] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-10-14T22:43:34.240088] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-14T22:43:34.242286] [INFO ] [MAIN ] Derivative Progress: 1687/1812 symbols completed. VMI took 1.1s. Estimated remaining: 47.2s. Rate: 158.8 symbols/min [2025-10-14T22:43:34.243051] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:34.243690] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-14T22:43:34.244580] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-14T22:43:34.246554] [INFO ] [MAIN ] Derivative Progress: 1688/1812 symbols completed. VMC took 1.1s. Estimated remaining: 46.8s. Rate: 158.9 symbols/min [2025-10-14T22:43:34.246883] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:34.258546] [DEBUG] [LOCAL ] VNCE: Loaded 8930 existing records from primary storage. [2025-10-14T22:43:34.259125] [INFO ] [MAIN ] VNCE: Loaded 8930 primary data records. [2025-10-14T22:43:34.480042] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:34.526112] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20806 primary records. [2025-10-14T22:43:34.526200] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-14T22:43:34.642046] [DEBUG] [LOCAL ] VNO: Loaded 48953 existing records from primary storage. [2025-10-14T22:43:34.644627] [INFO ] [MAIN ] VNO: Loaded 48953 primary data records. [2025-10-14T22:43:34.666987] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-14T22:43:34.701347] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-14T22:43:34.724162] [INFO ] [MAIN ] Derivative Progress: 1689/1812 symbols completed. VMO took 0.9s. Estimated remaining: 46.5s. Rate: 158.8 symbols/min [2025-10-14T22:43:34.730055] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:34.961768] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:34.962933] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 8930 primary records. [2025-10-14T22:43:34.963130] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-14T22:43:34.992476] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-14T22:43:34.992826] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-14T22:43:34.995138] [INFO ] [MAIN ] Derivative Progress: 1690/1812 symbols completed. VNCE took 0.8s. Estimated remaining: 46.1s. Rate: 158.9 symbols/min [2025-10-14T22:43:34.995548] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:35.015819] [DEBUG] [LOCAL ] VNT: Loaded 43921 existing records from primary storage. [2025-10-14T22:43:35.028791] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:35.028503] [INFO ] [MAIN ] VNT: Loaded 43921 primary data records. [2025-10-14T22:43:35.033563] [DEBUG] [LOCAL ] VOC: Loaded 9019 existing records from primary storage. [2025-10-14T22:43:35.029552] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48953 primary records. [2025-10-14T22:43:35.038828] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-14T22:43:35.038930] [INFO ] [MAIN ] VOC: Loaded 9019 primary data records. [2025-10-14T22:43:35.642562] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-14T22:43:35.656523] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-14T22:43:35.658726] [INFO ] [MAIN ] Derivative Progress: 1691/1812 symbols completed. VNO took 1.4s. Estimated remaining: 45.7s. Rate: 158.8 symbols/min [2025-10-14T22:43:35.659858] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:35.709014] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:35.714149] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:35.715091] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43921 primary records. [2025-10-14T22:43:35.715994] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 9019 primary records. [2025-10-14T22:43:35.716088] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-14T22:43:35.716280] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-14T22:43:35.759840] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-14T22:43:35.760144] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-14T22:43:35.761219] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-14T22:43:35.761019] [DEBUG] [LOCAL ] VOYA: Loaded 42230 existing records from primary storage. [2025-10-14T22:43:35.761092] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-14T22:43:35.763336] [INFO ] [MAIN ] Derivative Progress: 1692/1812 symbols completed. VOC took 0.8s. Estimated remaining: 45.3s. Rate: 158.9 symbols/min [2025-10-14T22:43:35.765542] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:35.765719] [INFO ] [MAIN ] Derivative Progress: 1693/1812 symbols completed. VNT took 1.0s. Estimated remaining: 44.9s. Rate: 159.0 symbols/min [2025-10-14T22:43:35.766321] [INFO ] [MAIN ] VOYA: Loaded 42230 primary data records. [2025-10-14T22:43:35.956299] [DEBUG] [LOCAL ] VPG: Loaded 17069 existing records from primary storage. [2025-10-14T22:43:36.068809] [INFO ] [MAIN ] VPG: Loaded 17069 primary data records. [2025-10-14T22:43:36.424132] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:36.425034] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42230 primary records. [2025-10-14T22:43:36.425334] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-14T22:43:36.441421] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-14T22:43:36.441625] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-14T22:43:36.443731] [INFO ] [MAIN ] Derivative Progress: 1694/1812 symbols completed. VOYA took 0.8s. Estimated remaining: 44.6s. Rate: 158.9 symbols/min [2025-10-14T22:43:36.459036] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:36.459712] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17069 primary records. [2025-10-14T22:43:36.459774] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-14T22:43:36.475146] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-14T22:43:36.475206] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-14T22:43:36.477148] [INFO ] [MAIN ] Derivative Progress: 1695/1812 symbols completed. VPG took 0.7s. Estimated remaining: 44.2s. Rate: 159.0 symbols/min [2025-10-14T22:43:36.477758] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:36.477864] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:36.478441] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:36.487153] [DEBUG] [LOCAL ] VPV: Loaded 5452 existing records from primary storage. [2025-10-14T22:43:36.487348] [INFO ] [MAIN ] VPV: Loaded 5452 primary data records. [2025-10-14T22:43:36.818194] [DEBUG] [LOCAL ] VRE: Loaded 35222 existing records from primary storage. [2025-10-14T22:43:36.818439] [INFO ] [MAIN ] VRE: Loaded 35222 primary data records. [2025-10-14T22:43:36.940485] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-14T22:43:36.967600] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-14T22:43:37.447848] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:37.449793] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5452 primary records. [2025-10-14T22:43:37.449899] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-14T22:43:37.466951] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-14T22:43:37.467184] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-14T22:43:37.470407] [INFO ] [MAIN ] Derivative Progress: 1696/1812 symbols completed. VPV took 1.0s. Estimated remaining: 43.8s. Rate: 158.8 symbols/min [2025-10-14T22:43:37.470583] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:37.488090] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:37.491604] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35222 primary records. [2025-10-14T22:43:37.492084] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-14T22:43:37.509977] [DEBUG] [LOCAL ] VRTS: Loaded 9357 existing records from primary storage. [2025-10-14T22:43:37.511145] [INFO ] [MAIN ] VRTS: Loaded 9357 primary data records. [2025-10-14T22:43:37.598332] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:37.624066] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-14T22:43:37.633879] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-14T22:43:37.637943] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-14T22:43:37.638143] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-14T22:43:37.641148] [INFO ] [MAIN ] Derivative Progress: 1697/1812 symbols completed. VRE took 1.2s. Estimated remaining: 43.4s. Rate: 158.9 symbols/min [2025-10-14T22:43:37.641781] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:37.741617] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-14T22:43:37.852972] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-14T22:43:37.855807] [INFO ] [MAIN ] Derivative Progress: 1698/1812 symbols completed. VRT took 1.4s. Estimated remaining: 43.0s. Rate: 158.9 symbols/min [2025-10-14T22:43:37.856026] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:37.911765] [DEBUG] [LOCAL ] VSCO: Loaded 52743 existing records from primary storage. [2025-10-14T22:43:37.912035] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:37.912343] [INFO ] [MAIN ] VSCO: Loaded 52743 primary data records. [2025-10-14T22:43:37.913100] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9357 primary records. [2025-10-14T22:43:37.913351] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-14T22:43:38.080933] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-14T22:43:38.081093] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-14T22:43:38.083124] [INFO ] [MAIN ] Derivative Progress: 1699/1812 symbols completed. VRTS took 0.6s. Estimated remaining: 42.7s. Rate: 158.9 symbols/min [2025-10-14T22:43:38.099904] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:38.096545] [DEBUG] [LOCAL ] VSH: Loaded 48180 existing records from primary storage. [2025-10-14T22:43:38.112042] [INFO ] [MAIN ] VSH: Loaded 48180 primary data records. [2025-10-14T22:43:38.620948] [DEBUG] [LOCAL ] VST: Loaded 53711 existing records from primary storage. [2025-10-14T22:43:38.634681] [INFO ] [MAIN ] VST: Loaded 53711 primary data records. [2025-10-14T22:43:38.646761] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:38.705191] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52743 primary records. [2025-10-14T22:43:38.735618] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-14T22:43:38.966208] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:38.966755] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-14T22:43:38.967183] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-14T22:43:38.968414] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48180 primary records. [2025-10-14T22:43:38.968949] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-14T22:43:38.970970] [INFO ] [MAIN ] Derivative Progress: 1700/1812 symbols completed. VSCO took 1.3s. Estimated remaining: 42.3s. Rate: 158.8 symbols/min [2025-10-14T22:43:38.971764] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:38.994335] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-14T22:43:38.994827] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-14T22:43:38.997322] [INFO ] [MAIN ] Derivative Progress: 1701/1812 symbols completed. VSH took 1.1s. Estimated remaining: 41.9s. Rate: 158.9 symbols/min [2025-10-14T22:43:38.997592] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:39.016769] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:39.017541] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53711 primary records. [2025-10-14T22:43:39.017697] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-14T22:43:39.044872] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-14T22:43:39.045012] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-14T22:43:39.047165] [INFO ] [MAIN ] Derivative Progress: 1702/1812 symbols completed. VST took 0.9s. Estimated remaining: 41.5s. Rate: 159.0 symbols/min [2025-10-14T22:43:39.047446] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:39.074171] [DEBUG] [LOCAL ] VSTS: Loaded 48940 existing records from primary storage. [2025-10-14T22:43:39.074438] [INFO ] [MAIN ] VSTS: Loaded 48940 primary data records. [2025-10-14T22:43:39.197633] [DEBUG] [LOCAL ] VTEX: Loaded 42979 existing records from primary storage. [2025-10-14T22:43:39.224143] [INFO ] [MAIN ] VTEX: Loaded 42979 primary data records. [2025-10-14T22:43:39.519441] [DEBUG] [LOCAL ] VTLE: Loaded 48088 existing records from primary storage. [2025-10-14T22:43:39.536928] [INFO ] [MAIN ] VTLE: Loaded 48088 primary data records. [2025-10-14T22:43:40.031288] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:40.032910] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 48940 primary records. [2025-10-14T22:43:40.033067] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-14T22:43:40.054208] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-14T22:43:40.067676] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-14T22:43:40.069776] [INFO ] [MAIN ] Derivative Progress: 1703/1812 symbols completed. VSTS took 1.1s. Estimated remaining: 41.2s. Rate: 158.8 symbols/min [2025-10-14T22:43:40.070426] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:40.070120] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:40.072185] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 42979 primary records. [2025-10-14T22:43:40.072459] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-14T22:43:40.096431] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-14T22:43:40.100851] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-14T22:43:40.103021] [INFO ] [MAIN ] Derivative Progress: 1704/1812 symbols completed. VTEX took 1.1s. Estimated remaining: 40.8s. Rate: 158.9 symbols/min [2025-10-14T22:43:40.103479] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:40.122178] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:40.128783] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48088 primary records. [2025-10-14T22:43:40.130742] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-14T22:43:40.132071] [DEBUG] [LOCAL ] VTMX: Loaded 17622 existing records from primary storage. [2025-10-14T22:43:40.144115] [INFO ] [MAIN ] VTMX: Loaded 17622 primary data records. [2025-10-14T22:43:40.147696] [DEBUG] [LOCAL ] VTN: Loaded 6973 existing records from primary storage. [2025-10-14T22:43:40.156044] [INFO ] [MAIN ] VTN: Loaded 6973 primary data records. [2025-10-14T22:43:40.291504] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-14T22:43:40.301940] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-14T22:43:40.317766] [INFO ] [MAIN ] Derivative Progress: 1705/1812 symbols completed. VTLE took 1.3s. Estimated remaining: 40.4s. Rate: 159.0 symbols/min [2025-10-14T22:43:40.340017] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:40.798277] [DEBUG] [LOCAL ] VTOL: Loaded 19561 existing records from primary storage. [2025-10-14T22:43:40.799090] [INFO ] [MAIN ] VTOL: Loaded 19561 primary data records. [2025-10-14T22:43:41.139348] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:41.145213] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17622 primary records. [2025-10-14T22:43:41.145703] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:41.145505] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-14T22:43:41.148611] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 6973 primary records. [2025-10-14T22:43:41.155964] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-14T22:43:41.180943] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-14T22:43:41.180867] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-14T22:43:41.181253] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-14T22:43:41.183296] [INFO ] [MAIN ] Derivative Progress: 1706/1812 symbols completed. VTN took 1.1s. Estimated remaining: 40.0s. Rate: 158.8 symbols/min [2025-10-14T22:43:41.183452] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:41.183795] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-14T22:43:41.186582] [INFO ] [MAIN ] Derivative Progress: 1707/1812 symbols completed. VTMX took 1.1s. Estimated remaining: 39.6s. Rate: 158.9 symbols/min [2025-10-14T22:43:41.188462] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:41.204430] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:41.205284] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19561 primary records. [2025-10-14T22:43:41.205453] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-14T22:43:41.225463] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-14T22:43:41.225639] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-14T22:43:41.227960] [INFO ] [MAIN ] Derivative Progress: 1708/1812 symbols completed. VTOL took 0.9s. Estimated remaining: 39.2s. Rate: 159.0 symbols/min [2025-10-14T22:43:41.260293] [DEBUG] [LOCAL ] VTS: Loaded 29989 existing records from primary storage. [2025-10-14T22:43:41.260438] [INFO ] [MAIN ] VTS: Loaded 29989 primary data records. [2025-10-14T22:43:41.384094] [DEBUG] [LOCAL ] VTR: Loaded 52778 existing records from primary storage. [2025-10-14T22:43:41.394511] [INFO ] [MAIN ] VTR: Loaded 52778 primary data records. [2025-10-14T22:43:41.880558] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:41.881317] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 29989 primary records. [2025-10-14T22:43:41.881462] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-14T22:43:41.912137] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-14T22:43:41.909487] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:41.912234] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-14T22:43:41.912859] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52778 primary records. [2025-10-14T22:43:41.914605] [INFO ] [MAIN ] Derivative Progress: 1709/1812 symbols completed. VTS took 0.7s. Estimated remaining: 38.9s. Rate: 158.9 symbols/min [2025-10-14T22:43:41.914723] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-14T22:43:41.930126] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-14T22:43:41.930183] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-14T22:43:41.932186] [INFO ] [MAIN ] Derivative Progress: 1710/1812 symbols completed. VTR took 0.7s. Estimated remaining: 38.5s. Rate: 159.0 symbols/min [2025-10-14T22:43:41.932598] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:41.932534] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:41.932983] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:41.955904] [DEBUG] [LOCAL ] VVX: Loaded 22906 existing records from primary storage. [2025-10-14T22:43:41.956120] [INFO ] [MAIN ] VVX: Loaded 22906 primary data records. [2025-10-14T22:43:42.137330] [DEBUG] [LOCAL ] VVR: Loaded 31242 existing records from primary storage. [2025-10-14T22:43:42.166145] [INFO ] [MAIN ] VVR: Loaded 31242 primary data records. [2025-10-14T22:43:42.402949] [DEBUG] [LOCAL ] VVV: Loaded 50339 existing records from primary storage. [2025-10-14T22:43:42.428701] [INFO ] [MAIN ] VVV: Loaded 50339 primary data records. [2025-10-14T22:43:42.943510] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:42.945462] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 22906 primary records. [2025-10-14T22:43:42.946678] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-14T22:43:42.965783] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-14T22:43:42.966436] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-14T22:43:42.968580] [INFO ] [MAIN ] Derivative Progress: 1711/1812 symbols completed. VVX took 1.0s. Estimated remaining: 38.1s. Rate: 158.9 symbols/min [2025-10-14T22:43:42.968996] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:42.988365] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:42.989486] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31242 primary records. [2025-10-14T22:43:42.990381] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-14T22:43:43.018127] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:43.019728] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50339 primary records. [2025-10-14T22:43:43.022991] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-14T22:43:43.021880] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-14T22:43:43.023143] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-14T22:43:43.026048] [INFO ] [MAIN ] Derivative Progress: 1712/1812 symbols completed. VVR took 1.1s. Estimated remaining: 37.8s. Rate: 158.9 symbols/min [2025-10-14T22:43:43.026405] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:43.052131] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-14T22:43:43.052293] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-14T22:43:43.054820] [INFO ] [MAIN ] Derivative Progress: 1713/1812 symbols completed. VVV took 1.1s. Estimated remaining: 37.4s. Rate: 159.0 symbols/min [2025-10-14T22:43:43.055113] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:43.077159] [DEBUG] [LOCAL ] VYX: Loaded 48535 existing records from primary storage. [2025-10-14T22:43:43.077479] [INFO ] [MAIN ] VYX: Loaded 48535 primary data records. [2025-10-14T22:43:43.448600] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-14T22:43:43.449310] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-14T22:43:43.528194] [DEBUG] [LOCAL ] W: Loaded 53441 existing records from primary storage. [2025-10-14T22:43:43.546177] [INFO ] [MAIN ] W: Loaded 53441 primary data records. [2025-10-14T22:43:44.112200] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:44.113724] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48535 primary records. [2025-10-14T22:43:44.114178] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-14T22:43:44.132988] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-14T22:43:44.134203] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-14T22:43:44.136422] [INFO ] [MAIN ] Derivative Progress: 1714/1812 symbols completed. VYX took 1.2s. Estimated remaining: 37.0s. Rate: 158.9 symbols/min [2025-10-14T22:43:44.137470] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:44.152222] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:44.152924] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-14T22:43:44.153068] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-14T22:43:44.186781] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-14T22:43:44.186971] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-14T22:43:44.187228] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:44.189194] [INFO ] [MAIN ] Derivative Progress: 1715/1812 symbols completed. VZ took 1.2s. Estimated remaining: 36.6s. Rate: 158.9 symbols/min [2025-10-14T22:43:44.190105] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:44.189999] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53441 primary records. [2025-10-14T22:43:44.190725] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-14T22:43:44.217295] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-14T22:43:44.217392] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-14T22:43:44.219559] [INFO ] [MAIN ] Derivative Progress: 1716/1812 symbols completed. W took 1.2s. Estimated remaining: 36.2s. Rate: 159.0 symbols/min [2025-10-14T22:43:44.219831] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:44.237532] [DEBUG] [LOCAL ] WAB: Loaded 44007 existing records from primary storage. [2025-10-14T22:43:44.237896] [INFO ] [MAIN ] WAB: Loaded 44007 primary data records. [2025-10-14T22:43:44.412620] [DEBUG] [LOCAL ] WAL: Loaded 45445 existing records from primary storage. [2025-10-14T22:43:44.406588] [DEBUG] [LOCAL ] WAT: Loaded 35781 existing records from primary storage. [2025-10-14T22:43:44.412811] [INFO ] [MAIN ] WAL: Loaded 45445 primary data records. [2025-10-14T22:43:44.413018] [INFO ] [MAIN ] WAT: Loaded 35781 primary data records. [2025-10-14T22:43:45.187541] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:45.189497] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44007 primary records. [2025-10-14T22:43:45.189692] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-14T22:43:45.216747] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:45.218360] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45445 primary records. [2025-10-14T22:43:45.219719] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-14T22:43:45.248932] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-14T22:43:45.251965] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:45.252724] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-14T22:43:45.255161] [INFO ] [MAIN ] Derivative Progress: 1717/1812 symbols completed. WAB took 1.1s. Estimated remaining: 35.9s. Rate: 158.9 symbols/min [2025-10-14T22:43:45.256012] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35781 primary records. [2025-10-14T22:43:45.256389] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:45.256524] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-14T22:43:45.256949] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-14T22:43:45.258048] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-14T22:43:45.260449] [INFO ] [MAIN ] Derivative Progress: 1718/1812 symbols completed. WAL took 1.1s. Estimated remaining: 35.5s. Rate: 158.9 symbols/min [2025-10-14T22:43:45.267528] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:45.277025] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-14T22:43:45.280037] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-14T22:43:45.282253] [INFO ] [MAIN ] Derivative Progress: 1719/1812 symbols completed. WAT took 1.1s. Estimated remaining: 35.1s. Rate: 159.0 symbols/min [2025-10-14T22:43:45.282440] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:45.287851] [DEBUG] [LOCAL ] WBX: Loaded 10592 existing records from primary storage. [2025-10-14T22:43:45.287995] [INFO ] [MAIN ] WBX: Loaded 10592 primary data records. [2025-10-14T22:43:45.609316] [DEBUG] [LOCAL ] WBS: Loaded 48738 existing records from primary storage. [2025-10-14T22:43:45.610101] [INFO ] [MAIN ] WBS: Loaded 48738 primary data records. [2025-10-14T22:43:45.681080] [DEBUG] [LOCAL ] WCC: Loaded 39070 existing records from primary storage. [2025-10-14T22:43:45.695448] [INFO ] [MAIN ] WCC: Loaded 39070 primary data records. [2025-10-14T22:43:46.281337] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:46.283078] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 10592 primary records. [2025-10-14T22:43:46.283556] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-14T22:43:46.304142] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-14T22:43:46.304610] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-14T22:43:46.306864] [INFO ] [MAIN ] Derivative Progress: 1720/1812 symbols completed. WBX took 1.0s. Estimated remaining: 34.7s. Rate: 158.9 symbols/min [2025-10-14T22:43:46.320186] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:46.307170] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:46.321164] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48738 primary records. [2025-10-14T22:43:46.321545] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-14T22:43:46.340176] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-14T22:43:46.340325] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-14T22:43:46.342185] [INFO ] [MAIN ] Derivative Progress: 1721/1812 symbols completed. WBS took 1.1s. Estimated remaining: 34.3s. Rate: 159.0 symbols/min [2025-10-14T22:43:46.342613] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:46.355870] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:46.356540] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39070 primary records. [2025-10-14T22:43:46.356824] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-14T22:43:46.380609] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-14T22:43:46.380961] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-14T22:43:46.392021] [INFO ] [MAIN ] Derivative Progress: 1722/1812 symbols completed. WCC took 1.1s. Estimated remaining: 34.0s. Rate: 159.0 symbols/min [2025-10-14T22:43:46.392292] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:46.401475] [DEBUG] [LOCAL ] WD: Loaded 23172 existing records from primary storage. [2025-10-14T22:43:46.401756] [INFO ] [MAIN ] WD: Loaded 23172 primary data records. [2025-10-14T22:43:46.528789] [DEBUG] [LOCAL ] WCN: Loaded 48017 existing records from primary storage. [2025-10-14T22:43:46.529009] [INFO ] [MAIN ] WCN: Loaded 48017 primary data records. [2025-10-14T22:43:46.671075] [DEBUG] [LOCAL ] WDH: Loaded 18114 existing records from primary storage. [2025-10-14T22:43:46.802142] [INFO ] [MAIN ] WDH: Loaded 18114 primary data records. [2025-10-14T22:43:47.374374] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:47.375304] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23172 primary records. [2025-10-14T22:43:47.375637] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-14T22:43:47.394904] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-14T22:43:47.403530] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-14T22:43:47.410105] [INFO ] [MAIN ] Derivative Progress: 1723/1812 symbols completed. WD took 1.1s. Estimated remaining: 33.6s. Rate: 158.9 symbols/min [2025-10-14T22:43:47.412210] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:47.413051] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48017 primary records. [2025-10-14T22:43:47.413192] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-14T22:43:47.425944] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:47.426721] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 18114 primary records. [2025-10-14T22:43:47.426943] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-14T22:43:47.453471] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-14T22:43:47.453804] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-14T22:43:47.456324] [INFO ] [MAIN ] Derivative Progress: 1724/1812 symbols completed. WCN took 1.1s. Estimated remaining: 33.2s. Rate: 159.0 symbols/min [2025-10-14T22:43:47.459853] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-14T22:43:47.459916] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-14T22:43:47.461871] [INFO ] [MAIN ] Derivative Progress: 1725/1812 symbols completed. WDH took 1.1s. Estimated remaining: 32.8s. Rate: 159.1 symbols/min [2025-10-14T22:43:47.462306] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:47.462666] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:47.462413] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:47.477081] [DEBUG] [LOCAL ] WEA: Loaded 7733 existing records from primary storage. [2025-10-14T22:43:47.477287] [INFO ] [MAIN ] WEA: Loaded 7733 primary data records. [2025-10-14T22:43:47.615982] [DEBUG] [LOCAL ] WDI: Loaded 21180 existing records from primary storage. [2025-10-14T22:43:47.645988] [INFO ] [MAIN ] WDI: Loaded 21180 primary data records. [2025-10-14T22:43:47.918370] [DEBUG] [LOCAL ] WDS: Loaded 43136 existing records from primary storage. [2025-10-14T22:43:47.923579] [INFO ] [MAIN ] WDS: Loaded 43136 primary data records. [2025-10-14T22:43:48.481590] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:48.483434] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7733 primary records. [2025-10-14T22:43:48.483915] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-14T22:43:48.503251] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-14T22:43:48.503767] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-14T22:43:48.506264] [INFO ] [MAIN ] Derivative Progress: 1726/1812 symbols completed. WEA took 1.0s. Estimated remaining: 32.5s. Rate: 158.9 symbols/min [2025-10-14T22:43:48.507426] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:48.524066] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:48.525009] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21180 primary records. [2025-10-14T22:43:48.525225] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-14T22:43:48.557298] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:48.560146] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43136 primary records. [2025-10-14T22:43:48.562064] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-14T22:43:48.560756] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-14T22:43:48.571493] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-14T22:43:48.574538] [INFO ] [MAIN ] Derivative Progress: 1727/1812 symbols completed. WDI took 1.1s. Estimated remaining: 32.1s. Rate: 159.0 symbols/min [2025-10-14T22:43:48.574758] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:48.590607] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-14T22:43:48.590875] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-14T22:43:48.592972] [INFO ] [MAIN ] Derivative Progress: 1728/1812 symbols completed. WDS took 1.1s. Estimated remaining: 31.7s. Rate: 159.1 symbols/min [2025-10-14T22:43:48.593828] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:48.608748] [DEBUG] [LOCAL ] WEAV: Loaded 42250 existing records from primary storage. [2025-10-14T22:43:48.609129] [INFO ] [MAIN ] WEAV: Loaded 42250 primary data records. [2025-10-14T22:43:49.004993] [DEBUG] [LOCAL ] WEC: Loaded 52186 existing records from primary storage. [2025-10-14T22:43:49.005412] [INFO ] [MAIN ] WEC: Loaded 52186 primary data records. [2025-10-14T22:43:49.076254] [DEBUG] [LOCAL ] WELL: Loaded 52329 existing records from primary storage. [2025-10-14T22:43:49.103411] [INFO ] [MAIN ] WELL: Loaded 52329 primary data records. [2025-10-14T22:43:49.634274] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:49.635582] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42250 primary records. [2025-10-14T22:43:49.635687] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-14T22:43:49.653234] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-14T22:43:49.653916] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-14T22:43:49.656189] [INFO ] [MAIN ] Derivative Progress: 1729/1812 symbols completed. WEAV took 1.1s. Estimated remaining: 31.3s. Rate: 158.9 symbols/min [2025-10-14T22:43:49.656751] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:49.678603] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:49.679445] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52186 primary records. [2025-10-14T22:43:49.679543] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-14T22:43:49.723457] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-14T22:43:49.722491] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:49.724438] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52329 primary records. [2025-10-14T22:43:49.723725] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-14T22:43:49.736353] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-14T22:43:49.740162] [INFO ] [MAIN ] Derivative Progress: 1730/1812 symbols completed. WEC took 1.2s. Estimated remaining: 31.0s. Rate: 159.0 symbols/min [2025-10-14T22:43:49.740695] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:49.742249] [DEBUG] [LOCAL ] WES: Loaded 48500 existing records from primary storage. [2025-10-14T22:43:49.742378] [INFO ] [MAIN ] WES: Loaded 48500 primary data records. [2025-10-14T22:43:49.907823] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-14T22:43:49.940335] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-14T22:43:49.952451] [INFO ] [MAIN ] Derivative Progress: 1731/1812 symbols completed. WELL took 1.4s. Estimated remaining: 30.6s. Rate: 159.0 symbols/min [2025-10-14T22:43:50.086704] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:50.095840] [DEBUG] [LOCAL ] WEX: Loaded 33069 existing records from primary storage. [2025-10-14T22:43:50.096444] [INFO ] [MAIN ] WEX: Loaded 33069 primary data records. [2025-10-14T22:43:50.217172] [DEBUG] [LOCAL ] WF: Loaded 10980 existing records from primary storage. [2025-10-14T22:43:50.218904] [INFO ] [MAIN ] WF: Loaded 10980 primary data records. [2025-10-14T22:43:50.734511] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:50.737041] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48500 primary records. [2025-10-14T22:43:50.737555] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-14T22:43:50.754968] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-14T22:43:50.755260] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-14T22:43:50.758820] [INFO ] [MAIN ] Derivative Progress: 1732/1812 symbols completed. WES took 1.1s. Estimated remaining: 30.2s. Rate: 158.9 symbols/min [2025-10-14T22:43:50.760721] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:50.774828] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:50.775557] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 33069 primary records. [2025-10-14T22:43:50.775679] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-14T22:43:50.804308] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-14T22:43:50.809043] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-14T22:43:50.811239] [INFO ] [MAIN ] Derivative Progress: 1733/1812 symbols completed. WEX took 1.1s. Estimated remaining: 29.8s. Rate: 159.0 symbols/min [2025-10-14T22:43:50.811524] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:50.811878] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:50.813150] [INFO ] [MAIN ] WF: Generated 1793 derivative records from 10980 primary records. [2025-10-14T22:43:50.813268] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-14T22:43:50.842780] [DEBUG] [LOCAL ] WF: Derivative data saved (1793 records). [2025-10-14T22:43:50.842927] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-14T22:43:50.844920] [INFO ] [MAIN ] Derivative Progress: 1734/1812 symbols completed. WF took 0.8s. Estimated remaining: 29.4s. Rate: 159.1 symbols/min [2025-10-14T22:43:50.845184] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:50.875723] [DEBUG] [LOCAL ] WFG: Loaded 24783 existing records from primary storage. [2025-10-14T22:43:50.877027] [INFO ] [MAIN ] WFG: Loaded 24783 primary data records. [2025-10-14T22:43:50.898825] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-14T22:43:50.921409] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-14T22:43:51.138432] [DEBUG] [LOCAL ] WGO: Loaded 38217 existing records from primary storage. [2025-10-14T22:43:51.167309] [INFO ] [MAIN ] WGO: Loaded 38217 primary data records. [2025-10-14T22:43:51.893275] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:51.894265] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24783 primary records. [2025-10-14T22:43:51.894365] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-14T22:43:51.909600] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:51.910283] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-14T22:43:51.910788] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-14T22:43:51.941131] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-14T22:43:51.941908] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-14T22:43:51.944739] [INFO ] [MAIN ] Derivative Progress: 1735/1812 symbols completed. WFC took 1.2s. Estimated remaining: 29.1s. Rate: 158.9 symbols/min [2025-10-14T22:43:51.945113] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:51.950598] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-14T22:43:51.951558] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-14T22:43:51.953512] [INFO ] [MAIN ] Derivative Progress: 1736/1812 symbols completed. WFG took 1.1s. Estimated remaining: 28.7s. Rate: 159.0 symbols/min [2025-10-14T22:43:51.953745] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:51.968459] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:51.969177] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38217 primary records. [2025-10-14T22:43:51.969372] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-14T22:43:51.985807] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-14T22:43:51.985963] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-14T22:43:51.988123] [INFO ] [MAIN ] Derivative Progress: 1737/1812 symbols completed. WGO took 1.1s. Estimated remaining: 28.3s. Rate: 159.1 symbols/min [2025-10-14T22:43:51.988400] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:52.012348] [DEBUG] [LOCAL ] WHG: Loaded 3169 existing records from primary storage. [2025-10-14T22:43:52.012580] [INFO ] [MAIN ] WHG: Loaded 3169 primary data records. [2025-10-14T22:43:52.142427] [DEBUG] [LOCAL ] WHD: Loaded 40178 existing records from primary storage. [2025-10-14T22:43:52.142967] [INFO ] [MAIN ] WHD: Loaded 40178 primary data records. [2025-10-14T22:43:52.149341] [DEBUG] [LOCAL ] WH: Loaded 45249 existing records from primary storage. [2025-10-14T22:43:52.164991] [INFO ] [MAIN ] WH: Loaded 45249 primary data records. [2025-10-14T22:43:52.983725] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:52.985076] [INFO ] [MAIN ] WHG: Generated 1793 derivative records from 3169 primary records. [2025-10-14T22:43:52.985495] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-14T22:43:53.006689] [DEBUG] [LOCAL ] WHG: Derivative data saved (1793 records). [2025-10-14T22:43:53.007434] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-14T22:43:53.010039] [INFO ] [MAIN ] Derivative Progress: 1738/1812 symbols completed. WHG took 1.0s. Estimated remaining: 27.9s. Rate: 158.9 symbols/min [2025-10-14T22:43:53.036786] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:53.037118] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:53.038080] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40178 primary records. [2025-10-14T22:43:53.038994] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45249 primary records. [2025-10-14T22:43:53.039087] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-14T22:43:53.038895] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-14T22:43:53.070014] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-14T22:43:53.071761] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-14T22:43:53.074129] [INFO ] [MAIN ] Derivative Progress: 1739/1812 symbols completed. WHD took 1.1s. Estimated remaining: 27.6s. Rate: 159.0 symbols/min [2025-10-14T22:43:53.075674] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-14T22:43:53.075750] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-14T22:43:53.078241] [INFO ] [MAIN ] Derivative Progress: 1740/1812 symbols completed. WH took 1.1s. Estimated remaining: 27.2s. Rate: 159.1 symbols/min [2025-10-14T22:43:53.079060] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:53.078994] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:53.078910] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:53.087751] [DEBUG] [LOCAL ] WIA: Loaded 5004 existing records from primary storage. [2025-10-14T22:43:53.088000] [INFO ] [MAIN ] WIA: Loaded 5004 primary data records. [2025-10-14T22:43:53.198867] [DEBUG] [LOCAL ] WINN: Loaded 11550 existing records from primary storage. [2025-10-14T22:43:53.199412] [INFO ] [MAIN ] WINN: Loaded 11550 primary data records. [2025-10-14T22:43:53.625858] [DEBUG] [LOCAL ] WHR: Loaded 48789 existing records from primary storage. [2025-10-14T22:43:53.632255] [INFO ] [MAIN ] WHR: Loaded 48789 primary data records. [2025-10-14T22:43:54.114562] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:54.116225] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 5004 primary records. [2025-10-14T22:43:54.116528] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-14T22:43:54.150219] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-14T22:43:54.151172] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:43:54.152201] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-14T22:43:54.154346] [INFO ] [MAIN ] Derivative Progress: 1741/1812 symbols completed. WIA took 1.1s. Estimated remaining: 26.8s. Rate: 158.9 symbols/min [2025-10-14T22:43:54.152120] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11550 primary records. [2025-10-14T22:43:54.154990] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:54.155223] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-14T22:43:54.175794] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-14T22:43:54.176116] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-14T22:43:54.178404] [INFO ] [MAIN ] Derivative Progress: 1742/1812 symbols completed. WINN took 1.1s. Estimated remaining: 26.4s. Rate: 159.0 symbols/min [2025-10-14T22:43:54.186284] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:54.192017] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:54.192706] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48789 primary records. [2025-10-14T22:43:54.192836] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-14T22:43:54.209880] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-14T22:43:54.210065] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-14T22:43:54.212382] [INFO ] [MAIN ] Derivative Progress: 1743/1812 symbols completed. WHR took 1.1s. Estimated remaining: 26.0s. Rate: 159.1 symbols/min [2025-10-14T22:43:54.212596] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:54.244514] [DEBUG] [LOCAL ] WIW: Loaded 20330 existing records from primary storage. [2025-10-14T22:43:54.244864] [INFO ] [MAIN ] WIW: Loaded 20330 primary data records. [2025-10-14T22:43:54.368689] [DEBUG] [LOCAL ] WIT: Loaded 52426 existing records from primary storage. [2025-10-14T22:43:54.402397] [INFO ] [MAIN ] WIT: Loaded 52426 primary data records. [2025-10-14T22:43:54.430376] [DEBUG] [LOCAL ] WK: Loaded 37336 existing records from primary storage. [2025-10-14T22:43:54.453428] [INFO ] [MAIN ] WK: Loaded 37336 primary data records. [2025-10-14T22:43:55.206472] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:55.207728] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20330 primary records. [2025-10-14T22:43:55.208253] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-14T22:43:55.231324] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-14T22:43:55.231844] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-14T22:43:55.233919] [INFO ] [MAIN ] Derivative Progress: 1744/1812 symbols completed. WIW took 1.0s. Estimated remaining: 25.7s. Rate: 158.9 symbols/min [2025-10-14T22:43:55.247057] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:55.259761] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:55.261201] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37336 primary records. [2025-10-14T22:43:55.260345] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:55.261728] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-14T22:43:55.262511] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52426 primary records. [2025-10-14T22:43:55.262608] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-14T22:43:55.291556] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-14T22:43:55.293217] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-14T22:43:55.295430] [INFO ] [MAIN ] Derivative Progress: 1745/1812 symbols completed. WIT took 1.1s. Estimated remaining: 25.3s. Rate: 159.0 symbols/min [2025-10-14T22:43:55.296119] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:55.298602] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-14T22:43:55.298931] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-14T22:43:55.301122] [INFO ] [MAIN ] Derivative Progress: 1746/1812 symbols completed. WK took 1.1s. Estimated remaining: 24.9s. Rate: 159.1 symbols/min [2025-10-14T22:43:55.301378] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:55.322922] [DEBUG] [LOCAL ] WLKP: Loaded 6971 existing records from primary storage. [2025-10-14T22:43:55.323169] [INFO ] [MAIN ] WLKP: Loaded 6971 primary data records. [2025-10-14T22:43:55.428079] [DEBUG] [LOCAL ] WKC: Loaded 34575 existing records from primary storage. [2025-10-14T22:43:55.448214] [INFO ] [MAIN ] WKC: Loaded 34575 primary data records. [2025-10-14T22:43:55.771325] [DEBUG] [LOCAL ] WLK: Loaded 45712 existing records from primary storage. [2025-10-14T22:43:55.800615] [INFO ] [MAIN ] WLK: Loaded 45712 primary data records. [2025-10-14T22:43:56.325234] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:56.326900] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6971 primary records. [2025-10-14T22:43:56.327090] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-14T22:43:56.348391] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-14T22:43:56.348585] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-14T22:43:56.351197] [INFO ] [MAIN ] Derivative Progress: 1747/1812 symbols completed. WLKP took 1.0s. Estimated remaining: 24.5s. Rate: 158.9 symbols/min [2025-10-14T22:43:56.363999] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:56.365595] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:56.366376] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34575 primary records. [2025-10-14T22:43:56.366459] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-14T22:43:56.398429] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:56.399694] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45712 primary records. [2025-10-14T22:43:56.399818] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-14T22:43:56.402100] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-14T22:43:56.402835] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-14T22:43:56.423519] [INFO ] [MAIN ] Derivative Progress: 1748/1812 symbols completed. WKC took 1.2s. Estimated remaining: 24.2s. Rate: 159.0 symbols/min [2025-10-14T22:43:56.425530] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:56.439189] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-14T22:43:56.439105] [DEBUG] [LOCAL ] WLY: Loaded 29766 existing records from primary storage. [2025-10-14T22:43:56.439439] [INFO ] [MAIN ] WLY: Loaded 29766 primary data records. [2025-10-14T22:43:56.439349] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-14T22:43:56.441601] [INFO ] [MAIN ] Derivative Progress: 1749/1812 symbols completed. WLK took 1.1s. Estimated remaining: 23.8s. Rate: 159.1 symbols/min [2025-10-14T22:43:56.479903] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:56.778109] [DEBUG] [LOCAL ] WM: Loaded 50989 existing records from primary storage. [2025-10-14T22:43:56.793564] [INFO ] [MAIN ] WM: Loaded 50989 primary data records. [2025-10-14T22:43:56.902419] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-14T22:43:56.918864] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-14T22:43:57.434207] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:57.435116] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29766 primary records. [2025-10-14T22:43:57.435335] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-14T22:43:57.459243] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-14T22:43:57.460273] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-14T22:43:57.462422] [INFO ] [MAIN ] Derivative Progress: 1750/1812 symbols completed. WLY took 1.1s. Estimated remaining: 23.4s. Rate: 158.9 symbols/min [2025-10-14T22:43:57.462776] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:57.478106] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:57.479035] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50989 primary records. [2025-10-14T22:43:57.479245] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-14T22:43:57.519188] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:57.521069] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-14T22:43:57.522269] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-14T22:43:57.522372] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-14T22:43:57.519915] [DEBUG] [LOCAL ] WMK: Loaded 14709 existing records from primary storage. [2025-10-14T22:43:57.524724] [INFO ] [MAIN ] Derivative Progress: 1751/1812 symbols completed. WM took 1.1s. Estimated remaining: 23.0s. Rate: 159.0 symbols/min [2025-10-14T22:43:57.524832] [INFO ] [MAIN ] WMK: Loaded 14709 primary data records. [2025-10-14T22:43:57.525121] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:57.525020] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-14T22:43:57.891311] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-14T22:43:57.891463] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-14T22:43:57.894483] [INFO ] [MAIN ] Derivative Progress: 1752/1812 symbols completed. WMB took 1.4s. Estimated remaining: 22.6s. Rate: 159.0 symbols/min [2025-10-14T22:43:57.894900] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:57.911760] [DEBUG] [LOCAL ] WMS: Loaded 39730 existing records from primary storage. [2025-10-14T22:43:57.912351] [INFO ] [MAIN ] WMS: Loaded 39730 primary data records. [2025-10-14T22:43:58.254520] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:58.256311] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14709 primary records. [2025-10-14T22:43:58.257397] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-14T22:43:58.288726] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-14T22:43:58.290059] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-14T22:43:58.288917] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-14T22:43:58.290195] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-14T22:43:58.292157] [INFO ] [MAIN ] Derivative Progress: 1753/1812 symbols completed. WMK took 0.8s. Estimated remaining: 22.3s. Rate: 159.0 symbols/min [2025-10-14T22:43:58.503385] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:58.615829] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39730 primary records. [2025-10-14T22:43:58.615935] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-14T22:43:58.633415] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-14T22:43:58.633829] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-14T22:43:58.636349] [INFO ] [MAIN ] Derivative Progress: 1754/1812 symbols completed. WMS took 1.1s. Estimated remaining: 21.9s. Rate: 159.0 symbols/min [2025-10-14T22:43:58.655389] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:58.655981] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-14T22:43:58.656042] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-14T22:43:58.671499] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-14T22:43:58.671555] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-14T22:43:58.673468] [INFO ] [MAIN ] Derivative Progress: 1755/1812 symbols completed. WMT took 0.8s. Estimated remaining: 21.5s. Rate: 159.1 symbols/min [2025-10-14T22:43:58.674120] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:58.674251] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:58.674057] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:58.720271] [DEBUG] [LOCAL ] WNC: Loaded 38582 existing records from primary storage. [2025-10-14T22:43:58.720424] [INFO ] [MAIN ] WNC: Loaded 38582 primary data records. [2025-10-14T22:43:58.852710] [DEBUG] [LOCAL ] WNS: Loaded 40118 existing records from primary storage. [2025-10-14T22:43:58.858569] [INFO ] [MAIN ] WNS: Loaded 40118 primary data records. [2025-10-14T22:43:59.168147] [DEBUG] [LOCAL ] WOLF: Loaded 53168 existing records from primary storage. [2025-10-14T22:43:59.174179] [INFO ] [MAIN ] WOLF: Loaded 53168 primary data records. [2025-10-14T22:43:59.704860] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:59.706478] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38582 primary records. [2025-10-14T22:43:59.707003] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-14T22:43:59.737302] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:59.739184] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 40118 primary records. [2025-10-14T22:43:59.740292] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-14T22:43:59.741984] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-14T22:43:59.742278] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-14T22:43:59.755806] [INFO ] [MAIN ] Derivative Progress: 1756/1812 symbols completed. WNC took 1.1s. Estimated remaining: 21.1s. Rate: 158.9 symbols/min [2025-10-14T22:43:59.756226] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:59.764847] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-14T22:43:59.773083] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-14T22:43:59.779956] [INFO ] [MAIN ] Derivative Progress: 1757/1812 symbols completed. WNS took 1.1s. Estimated remaining: 20.8s. Rate: 159.0 symbols/min [2025-10-14T22:43:59.780544] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:43:59.780954] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:43:59.782135] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53168 primary records. [2025-10-14T22:43:59.787812] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-14T22:43:59.810202] [DEBUG] [LOCAL ] WOR: Loaded 24101 existing records from primary storage. [2025-10-14T22:43:59.810737] [INFO ] [MAIN ] WOR: Loaded 24101 primary data records. [2025-10-14T22:43:59.935380] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-14T22:43:59.936075] [DEBUG] [LOCAL ] WOW: Loaded 30915 existing records from primary storage. [2025-10-14T22:43:59.961968] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-14T22:43:59.983047] [INFO ] [MAIN ] WOW: Loaded 30915 primary data records. [2025-10-14T22:43:59.987584] [INFO ] [MAIN ] Derivative Progress: 1758/1812 symbols completed. WOLF took 1.3s. Estimated remaining: 20.4s. Rate: 159.0 symbols/min [2025-10-14T22:44:00.045268] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:00.506310] [DEBUG] [LOCAL ] WPC: Loaded 48209 existing records from primary storage. [2025-10-14T22:44:00.506782] [INFO ] [MAIN ] WPC: Loaded 48209 primary data records. [2025-10-14T22:44:00.606853] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:00.631553] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24101 primary records. [2025-10-14T22:44:00.654342] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-14T22:44:00.852164] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-14T22:44:00.852304] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-14T22:44:00.853104] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:00.856241] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30915 primary records. [2025-10-14T22:44:00.856415] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-14T22:44:00.855245] [INFO ] [MAIN ] Derivative Progress: 1759/1812 symbols completed. WOR took 1.1s. Estimated remaining: 20.0s. Rate: 158.9 symbols/min [2025-10-14T22:44:00.857383] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:00.877796] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-14T22:44:00.878358] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-14T22:44:00.880879] [INFO ] [MAIN ] Derivative Progress: 1760/1812 symbols completed. WOW took 1.1s. Estimated remaining: 19.6s. Rate: 159.0 symbols/min [2025-10-14T22:44:00.881136] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:00.903946] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:00.904636] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48209 primary records. [2025-10-14T22:44:00.904731] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-14T22:44:00.922133] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-14T22:44:00.922280] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-14T22:44:00.925120] [INFO ] [MAIN ] Derivative Progress: 1761/1812 symbols completed. WPC took 0.9s. Estimated remaining: 19.2s. Rate: 159.1 symbols/min [2025-10-14T22:44:00.925376] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:00.965162] [DEBUG] [LOCAL ] WPP: Loaded 34428 existing records from primary storage. [2025-10-14T22:44:00.966220] [INFO ] [MAIN ] WPP: Loaded 34428 primary data records. [2025-10-14T22:44:01.056808] [DEBUG] [LOCAL ] WPM: Loaded 52772 existing records from primary storage. [2025-10-14T22:44:01.069336] [INFO ] [MAIN ] WPM: Loaded 52772 primary data records. [2025-10-14T22:44:01.412152] [DEBUG] [LOCAL ] WRB: Loaded 50785 existing records from primary storage. [2025-10-14T22:44:01.417458] [INFO ] [MAIN ] WRB: Loaded 50785 primary data records. [2025-10-14T22:44:01.978393] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:01.979718] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34428 primary records. [2025-10-14T22:44:01.979855] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-14T22:44:02.011833] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:02.013196] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52772 primary records. [2025-10-14T22:44:02.013533] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-14T22:44:02.015555] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-14T22:44:02.015795] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-14T22:44:02.018076] [INFO ] [MAIN ] Derivative Progress: 1762/1812 symbols completed. WPP took 1.1s. Estimated remaining: 18.9s. Rate: 158.9 symbols/min [2025-10-14T22:44:02.027386] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:02.050051] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-14T22:44:02.050413] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:02.051346] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50785 primary records. [2025-10-14T22:44:02.050609] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-14T22:44:02.053727] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-14T22:44:02.053621] [INFO ] [MAIN ] Derivative Progress: 1763/1812 symbols completed. WPM took 1.2s. Estimated remaining: 18.5s. Rate: 159.0 symbols/min [2025-10-14T22:44:02.054761] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:02.071838] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-14T22:44:02.072004] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-14T22:44:02.075021] [INFO ] [MAIN ] Derivative Progress: 1764/1812 symbols completed. WRB took 1.1s. Estimated remaining: 18.1s. Rate: 159.1 symbols/min [2025-10-14T22:44:02.075302] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:02.103815] [DEBUG] [LOCAL ] WS: Loaded 23392 existing records from primary storage. [2025-10-14T22:44:02.103999] [INFO ] [MAIN ] WS: Loaded 23392 primary data records. [2025-10-14T22:44:02.222741] [DEBUG] [LOCAL ] WRBY: Loaded 50719 existing records from primary storage. [2025-10-14T22:44:02.226193] [INFO ] [MAIN ] WRBY: Loaded 50719 primary data records. [2025-10-14T22:44:02.767519] [DEBUG] [LOCAL ] WSM: Loaded 49186 existing records from primary storage. [2025-10-14T22:44:02.768281] [INFO ] [MAIN ] WSM: Loaded 49186 primary data records. [2025-10-14T22:44:03.100864] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:03.103626] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23392 primary records. [2025-10-14T22:44:03.104095] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-14T22:44:03.135096] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:03.136345] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50719 primary records. [2025-10-14T22:44:03.138545] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-14T22:44:03.152574] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-14T22:44:03.153088] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-14T22:44:03.155552] [INFO ] [MAIN ] Derivative Progress: 1765/1812 symbols completed. WS took 1.1s. Estimated remaining: 17.7s. Rate: 158.9 symbols/min [2025-10-14T22:44:03.157360] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:03.160276] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-14T22:44:03.162577] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-14T22:44:03.165220] [INFO ] [MAIN ] Derivative Progress: 1766/1812 symbols completed. WRBY took 1.1s. Estimated remaining: 17.4s. Rate: 159.0 symbols/min [2025-10-14T22:44:03.165551] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:03.183139] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:03.183896] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49186 primary records. [2025-10-14T22:44:03.184079] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-14T22:44:03.219936] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-14T22:44:03.226878] [DEBUG] [LOCAL ] WSO: Loaded 25521 existing records from primary storage. [2025-10-14T22:44:03.228608] [INFO ] [MAIN ] WSO: Loaded 25521 primary data records. [2025-10-14T22:44:03.227964] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-14T22:44:03.228494] [DEBUG] [LOCAL ] WSR: Loaded 22994 existing records from primary storage. [2025-10-14T22:44:03.275058] [INFO ] [MAIN ] Derivative Progress: 1767/1812 symbols completed. WSM took 1.2s. Estimated remaining: 17.0s. Rate: 159.1 symbols/min [2025-10-14T22:44:03.272247] [INFO ] [MAIN ] WSR: Loaded 22994 primary data records. [2025-10-14T22:44:03.289590] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:03.903610] [DEBUG] [LOCAL ] WST: Loaded 36760 existing records from primary storage. [2025-10-14T22:44:03.906070] [INFO ] [MAIN ] WST: Loaded 36760 primary data records. [2025-10-14T22:44:04.228900] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:04.229990] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 25521 primary records. [2025-10-14T22:44:04.230339] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-14T22:44:04.272497] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:04.274259] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22994 primary records. [2025-10-14T22:44:04.274569] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-14T22:44:04.276590] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-14T22:44:04.277002] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-14T22:44:04.290755] [INFO ] [MAIN ] Derivative Progress: 1768/1812 symbols completed. WSO took 1.1s. Estimated remaining: 16.6s. Rate: 158.9 symbols/min [2025-10-14T22:44:04.296743] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-14T22:44:04.297014] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-14T22:44:04.299434] [INFO ] [MAIN ] Derivative Progress: 1769/1812 symbols completed. WSR took 1.1s. Estimated remaining: 16.2s. Rate: 159.0 symbols/min [2025-10-14T22:44:04.318620] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:04.319227] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36760 primary records. [2025-10-14T22:44:04.319288] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-14T22:44:04.335387] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-14T22:44:04.335449] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-14T22:44:04.337768] [INFO ] [MAIN ] Derivative Progress: 1770/1812 symbols completed. WST took 1.0s. Estimated remaining: 15.8s. Rate: 159.1 symbols/min [2025-10-14T22:44:04.338314] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:04.338480] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:04.338249] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:04.416118] [DEBUG] [LOCAL ] WTI: Loaded 44501 existing records from primary storage. [2025-10-14T22:44:04.416370] [INFO ] [MAIN ] WTI: Loaded 44501 primary data records. [2025-10-14T22:44:04.549822] [DEBUG] [LOCAL ] WT: Loaded 48029 existing records from primary storage. [2025-10-14T22:44:04.550822] [INFO ] [MAIN ] WT: Loaded 48029 primary data records. [2025-10-14T22:44:04.550531] [DEBUG] [LOCAL ] WTRG: Loaded 50985 existing records from primary storage. [2025-10-14T22:44:04.566982] [INFO ] [MAIN ] WTRG: Loaded 50985 primary data records. [2025-10-14T22:44:05.401718] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:05.403370] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44501 primary records. [2025-10-14T22:44:05.403474] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-14T22:44:05.422482] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-14T22:44:05.424964] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-14T22:44:05.426938] [INFO ] [MAIN ] Derivative Progress: 1771/1812 symbols completed. WTI took 1.1s. Estimated remaining: 15.5s. Rate: 158.9 symbols/min [2025-10-14T22:44:05.428913] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:05.450815] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:05.455929] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:05.457220] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50985 primary records. [2025-10-14T22:44:05.456616] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 48029 primary records. [2025-10-14T22:44:05.457365] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-14T22:44:05.457819] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-14T22:44:05.493781] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-14T22:44:05.500565] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-14T22:44:05.503388] [INFO ] [MAIN ] Derivative Progress: 1772/1812 symbols completed. WT took 1.2s. Estimated remaining: 15.1s. Rate: 159.0 symbols/min [2025-10-14T22:44:05.500942] [DEBUG] [LOCAL ] WTS: Loaded 17497 existing records from primary storage. [2025-10-14T22:44:05.500354] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-14T22:44:05.503625] [INFO ] [MAIN ] WTS: Loaded 17497 primary data records. [2025-10-14T22:44:05.503882] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:05.503784] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-14T22:44:05.507197] [INFO ] [MAIN ] Derivative Progress: 1773/1812 symbols completed. WTRG took 1.2s. Estimated remaining: 14.7s. Rate: 159.1 symbols/min [2025-10-14T22:44:05.518853] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:05.841366] [DEBUG] [LOCAL ] WTTR: Loaded 44560 existing records from primary storage. [2025-10-14T22:44:05.841781] [INFO ] [MAIN ] WTTR: Loaded 44560 primary data records. [2025-10-14T22:44:05.988057] [DEBUG] [LOCAL ] WU: Loaded 53481 existing records from primary storage. [2025-10-14T22:44:06.015678] [INFO ] [MAIN ] WU: Loaded 53481 primary data records. [2025-10-14T22:44:06.340868] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:06.380587] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 17497 primary records. [2025-10-14T22:44:06.472729] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-14T22:44:06.518544] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-14T22:44:06.519135] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-14T22:44:06.521143] [INFO ] [MAIN ] Derivative Progress: 1774/1812 symbols completed. WTS took 1.1s. Estimated remaining: 14.3s. Rate: 158.9 symbols/min [2025-10-14T22:44:06.521838] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:06.541323] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:06.542046] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44560 primary records. [2025-10-14T22:44:06.542233] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-14T22:44:06.560813] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-14T22:44:06.561173] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-14T22:44:06.563084] [INFO ] [MAIN ] Derivative Progress: 1775/1812 symbols completed. WTTR took 1.1s. Estimated remaining: 14.0s. Rate: 159.0 symbols/min [2025-10-14T22:44:06.576163] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:06.577119] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:06.577948] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53481 primary records. [2025-10-14T22:44:06.578080] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-14T22:44:06.604151] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-14T22:44:06.604273] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-14T22:44:06.606702] [INFO ] [MAIN ] Derivative Progress: 1776/1812 symbols completed. WU took 1.1s. Estimated remaining: 13.6s. Rate: 159.1 symbols/min [2025-10-14T22:44:06.606989] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:06.627125] [DEBUG] [LOCAL ] WWW: Loaded 49188 existing records from primary storage. [2025-10-14T22:44:06.627455] [INFO ] [MAIN ] WWW: Loaded 49188 primary data records. [2025-10-14T22:44:06.765265] [DEBUG] [LOCAL ] XFLT: Loaded 29906 existing records from primary storage. [2025-10-14T22:44:06.786237] [INFO ] [MAIN ] XFLT: Loaded 29906 primary data records. [2025-10-14T22:44:07.068876] [DEBUG] [LOCAL ] WY: Loaded 53199 existing records from primary storage. [2025-10-14T22:44:07.091591] [INFO ] [MAIN ] WY: Loaded 53199 primary data records. [2025-10-14T22:44:07.610952] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:07.612692] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49188 primary records. [2025-10-14T22:44:07.614537] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-14T22:44:07.635213] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-14T22:44:07.635701] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-14T22:44:07.637858] [INFO ] [MAIN ] Derivative Progress: 1777/1812 symbols completed. WWW took 1.1s. Estimated remaining: 13.2s. Rate: 158.9 symbols/min [2025-10-14T22:44:07.639488] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:07.659045] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:07.659922] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29906 primary records. [2025-10-14T22:44:07.660369] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-14T22:44:07.680024] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-14T22:44:07.681300] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-14T22:44:07.683414] [INFO ] [MAIN ] Derivative Progress: 1778/1812 symbols completed. XFLT took 1.1s. Estimated remaining: 12.8s. Rate: 159.0 symbols/min [2025-10-14T22:44:07.684580] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:07.701003] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:07.701824] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53199 primary records. [2025-10-14T22:44:07.701986] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-14T22:44:07.741851] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-14T22:44:07.755397] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-14T22:44:07.757592] [INFO ] [MAIN ] Derivative Progress: 1779/1812 symbols completed. WY took 1.2s. Estimated remaining: 12.4s. Rate: 159.1 symbols/min [2025-10-14T22:44:07.757818] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:07.759250] [DEBUG] [LOCAL ] XHR: Loaded 43595 existing records from primary storage. [2025-10-14T22:44:07.759755] [INFO ] [MAIN ] XHR: Loaded 43595 primary data records. [2025-10-14T22:44:08.156548] [DEBUG] [LOCAL ] XPER: Loaded 30321 existing records from primary storage. [2025-10-14T22:44:08.157253] [INFO ] [MAIN ] XPER: Loaded 30321 primary data records. [2025-10-14T22:44:08.158361] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-14T22:44:08.170034] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-14T22:44:08.785379] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:08.787115] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43595 primary records. [2025-10-14T22:44:08.787440] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-14T22:44:08.805295] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-14T22:44:08.805853] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-14T22:44:08.808483] [INFO ] [MAIN ] Derivative Progress: 1780/1812 symbols completed. XHR took 1.2s. Estimated remaining: 12.1s. Rate: 158.9 symbols/min [2025-10-14T22:44:08.809676] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:08.828936] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:08.831040] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30321 primary records. [2025-10-14T22:44:08.831817] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-14T22:44:08.856954] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:08.859201] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-14T22:44:08.859284] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-14T22:44:08.870372] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-14T22:44:08.871791] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-14T22:44:08.890523] [INFO ] [MAIN ] Derivative Progress: 1781/1812 symbols completed. XPER took 1.1s. Estimated remaining: 11.7s. Rate: 159.0 symbols/min [2025-10-14T22:44:08.891028] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:08.896832] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-14T22:44:08.897026] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-14T22:44:08.899186] [INFO ] [MAIN ] Derivative Progress: 1782/1812 symbols completed. XOM took 1.2s. Estimated remaining: 11.3s. Rate: 159.1 symbols/min [2025-10-14T22:44:08.899506] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:08.922619] [DEBUG] [LOCAL ] XPEV: Loaded 53631 existing records from primary storage. [2025-10-14T22:44:08.922978] [INFO ] [MAIN ] XPEV: Loaded 53631 primary data records. [2025-10-14T22:44:09.151256] [DEBUG] [LOCAL ] XPOF: Loaded 37447 existing records from primary storage. [2025-10-14T22:44:09.256783] [DEBUG] [LOCAL ] XPO: Loaded 47713 existing records from primary storage. [2025-10-14T22:44:09.264888] [INFO ] [MAIN ] XPO: Loaded 47713 primary data records. [2025-10-14T22:44:09.264262] [INFO ] [MAIN ] XPOF: Loaded 37447 primary data records. [2025-10-14T22:44:09.926789] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:09.928017] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53631 primary records. [2025-10-14T22:44:09.928926] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-14T22:44:09.946589] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-14T22:44:09.946746] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-14T22:44:09.948748] [INFO ] [MAIN ] Derivative Progress: 1783/1812 symbols completed. XPEV took 1.1s. Estimated remaining: 10.9s. Rate: 158.9 symbols/min [2025-10-14T22:44:09.965265] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:09.966143] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47713 primary records. [2025-10-14T22:44:09.966314] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-14T22:44:09.996882] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-14T22:44:09.997301] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-14T22:44:09.997163] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:09.999959] [INFO ] [MAIN ] Derivative Progress: 1784/1812 symbols completed. XPO took 1.1s. Estimated remaining: 10.6s. Rate: 159.0 symbols/min [2025-10-14T22:44:09.998023] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37447 primary records. [2025-10-14T22:44:10.000173] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-14T22:44:10.015608] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-14T22:44:10.015706] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-14T22:44:10.018031] [INFO ] [MAIN ] Derivative Progress: 1785/1812 symbols completed. XPOF took 1.1s. Estimated remaining: 10.2s. Rate: 159.1 symbols/min [2025-10-14T22:44:10.018475] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:10.018569] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:10.018423] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:10.058381] [DEBUG] [LOCAL ] XYF: Loaded 27954 existing records from primary storage. [2025-10-14T22:44:10.058511] [INFO ] [MAIN ] XYF: Loaded 27954 primary data records. [2025-10-14T22:44:10.205022] [DEBUG] [LOCAL ] XYL: Loaded 47817 existing records from primary storage. [2025-10-14T22:44:10.204143] [DEBUG] [LOCAL ] XPRO: Loaded 45907 existing records from primary storage. [2025-10-14T22:44:10.210346] [INFO ] [MAIN ] XYL: Loaded 47817 primary data records. [2025-10-14T22:44:10.215550] [INFO ] [MAIN ] XPRO: Loaded 45907 primary data records. [2025-10-14T22:44:11.020904] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:11.022806] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 27954 primary records. [2025-10-14T22:44:11.023168] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-14T22:44:11.036962] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:11.038101] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47817 primary records. [2025-10-14T22:44:11.045560] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-14T22:44:11.054601] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-14T22:44:11.068617] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-14T22:44:11.071837] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-14T22:44:11.073918] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-14T22:44:11.073760] [INFO ] [MAIN ] Derivative Progress: 1786/1812 symbols completed. XYF took 1.1s. Estimated remaining: 9.8s. Rate: 158.9 symbols/min [2025-10-14T22:44:11.076412] [INFO ] [MAIN ] Derivative Progress: 1787/1812 symbols completed. XYL took 1.1s. Estimated remaining: 9.4s. Rate: 159.0 symbols/min [2025-10-14T22:44:11.076527] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:11.076307] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:11.090629] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:11.091359] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45907 primary records. [2025-10-14T22:44:11.091505] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-14T22:44:11.108325] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-14T22:44:11.108468] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-14T22:44:11.110588] [INFO ] [MAIN ] Derivative Progress: 1788/1812 symbols completed. XPRO took 1.1s. Estimated remaining: 9.1s. Rate: 159.1 symbols/min [2025-10-14T22:44:11.111395] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:11.160850] [DEBUG] [LOCAL ] YALA: Loaded 36892 existing records from primary storage. [2025-10-14T22:44:11.161119] [INFO ] [MAIN ] YALA: Loaded 36892 primary data records. [2025-10-14T22:44:11.183259] [DEBUG] [LOCAL ] YELP: Loaded 45451 existing records from primary storage. [2025-10-14T22:44:11.217370] [INFO ] [MAIN ] YELP: Loaded 45451 primary data records. [2025-10-14T22:44:11.656144] [DEBUG] [LOCAL ] YETI: Loaded 52490 existing records from primary storage. [2025-10-14T22:44:11.765870] [INFO ] [MAIN ] YETI: Loaded 52490 primary data records. [2025-10-14T22:44:12.158268] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:12.164304] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 36892 primary records. [2025-10-14T22:44:12.164699] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-14T22:44:12.165004] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:12.166564] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45451 primary records. [2025-10-14T22:44:12.166919] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-14T22:44:12.196258] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-14T22:44:12.197090] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-14T22:44:12.199161] [INFO ] [MAIN ] Derivative Progress: 1789/1812 symbols completed. YALA took 1.1s. Estimated remaining: 8.7s. Rate: 158.9 symbols/min [2025-10-14T22:44:12.199637] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:12.203815] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-14T22:44:12.204015] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-14T22:44:12.206086] [INFO ] [MAIN ] Derivative Progress: 1790/1812 symbols completed. YELP took 1.1s. Estimated remaining: 8.3s. Rate: 159.0 symbols/min [2025-10-14T22:44:12.206409] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:12.223471] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:12.224142] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52490 primary records. [2025-10-14T22:44:12.224280] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-14T22:44:12.240856] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-14T22:44:12.252407] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-14T22:44:12.254636] [INFO ] [MAIN ] Derivative Progress: 1791/1812 symbols completed. YETI took 1.1s. Estimated remaining: 7.9s. Rate: 159.1 symbols/min [2025-10-14T22:44:12.254862] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:12.284132] [DEBUG] [LOCAL ] YEXT: Loaded 43121 existing records from primary storage. [2025-10-14T22:44:12.284323] [INFO ] [MAIN ] YEXT: Loaded 43121 primary data records. [2025-10-14T22:44:12.403354] [DEBUG] [LOCAL ] YMM: Loaded 52601 existing records from primary storage. [2025-10-14T22:44:12.419695] [INFO ] [MAIN ] YMM: Loaded 52601 primary data records. [2025-10-14T22:44:12.716017] [DEBUG] [LOCAL ] YOU: Loaded 49635 existing records from primary storage. [2025-10-14T22:44:12.719948] [INFO ] [MAIN ] YOU: Loaded 49635 primary data records. [2025-10-14T22:44:13.221232] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:13.222449] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43121 primary records. [2025-10-14T22:44:13.222673] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-14T22:44:13.240743] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-14T22:44:13.241744] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-14T22:44:13.244390] [INFO ] [MAIN ] Derivative Progress: 1792/1812 symbols completed. YEXT took 1.0s. Estimated remaining: 7.6s. Rate: 158.9 symbols/min [2025-10-14T22:44:13.245321] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:13.259037] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:13.259781] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52601 primary records. [2025-10-14T22:44:13.259962] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-14T22:44:13.278231] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-14T22:44:13.280180] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-14T22:44:13.282336] [INFO ] [MAIN ] Derivative Progress: 1793/1812 symbols completed. YMM took 1.1s. Estimated remaining: 7.2s. Rate: 159.0 symbols/min [2025-10-14T22:44:13.282577] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:13.296165] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:13.296946] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49635 primary records. [2025-10-14T22:44:13.297006] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-14T22:44:13.331095] [DEBUG] [LOCAL ] YRD: Loaded 11665 existing records from primary storage. [2025-10-14T22:44:13.331684] [INFO ] [MAIN ] YRD: Loaded 11665 primary data records. [2025-10-14T22:44:13.364968] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-14T22:44:13.377305] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-14T22:44:13.385099] [INFO ] [MAIN ] Derivative Progress: 1794/1812 symbols completed. YOU took 1.1s. Estimated remaining: 6.8s. Rate: 159.1 symbols/min [2025-10-14T22:44:13.385284] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:13.445167] [DEBUG] [LOCAL ] YPF: Loaded 50641 existing records from primary storage. [2025-10-14T22:44:13.457084] [INFO ] [MAIN ] YPF: Loaded 50641 primary data records. [2025-10-14T22:44:13.764030] [DEBUG] [LOCAL ] YSG: Loaded 25500 existing records from primary storage. [2025-10-14T22:44:13.769896] [INFO ] [MAIN ] YSG: Loaded 25500 primary data records. [2025-10-14T22:44:14.308107] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:14.309171] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 11665 primary records. [2025-10-14T22:44:14.309455] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-14T22:44:14.329150] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-14T22:44:14.329612] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-14T22:44:14.332722] [INFO ] [MAIN ] Derivative Progress: 1795/1812 symbols completed. YRD took 1.1s. Estimated remaining: 6.4s. Rate: 158.9 symbols/min [2025-10-14T22:44:14.333604] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:14.348456] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:14.349411] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50641 primary records. [2025-10-14T22:44:14.349687] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-14T22:44:14.370931] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-14T22:44:14.371472] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-14T22:44:14.373804] [INFO ] [MAIN ] Derivative Progress: 1796/1812 symbols completed. YPF took 1.1s. Estimated remaining: 6.0s. Rate: 159.0 symbols/min [2025-10-14T22:44:14.374106] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:14.387743] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:14.388602] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25500 primary records. [2025-10-14T22:44:14.388813] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-14T22:44:14.420033] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-14T22:44:14.420231] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-14T22:44:14.422329] [INFO ] [MAIN ] Derivative Progress: 1797/1812 symbols completed. YSG took 1.0s. Estimated remaining: 5.7s. Rate: 159.1 symbols/min [2025-10-14T22:44:14.422564] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:14.440253] [DEBUG] [LOCAL ] YUM: Loaded 51156 existing records from primary storage. [2025-10-14T22:44:14.440475] [INFO ] [MAIN ] YUM: Loaded 51156 primary data records. [2025-10-14T22:44:14.820689] [DEBUG] [LOCAL ] YUMC: Loaded 52590 existing records from primary storage. [2025-10-14T22:44:14.820933] [INFO ] [MAIN ] YUMC: Loaded 52590 primary data records. [2025-10-14T22:44:14.940848] [DEBUG] [LOCAL ] ZBH: Loaded 50789 existing records from primary storage. [2025-10-14T22:44:14.951890] [INFO ] [MAIN ] ZBH: Loaded 50789 primary data records. [2025-10-14T22:44:15.481665] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:15.482689] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51156 primary records. [2025-10-14T22:44:15.483249] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-14T22:44:15.501908] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-14T22:44:15.502560] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-14T22:44:15.505353] [INFO ] [MAIN ] Derivative Progress: 1798/1812 symbols completed. YUM took 1.2s. Estimated remaining: 5.3s. Rate: 158.9 symbols/min [2025-10-14T22:44:15.521454] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:15.522278] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52590 primary records. [2025-10-14T22:44:15.522477] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-14T22:44:15.540558] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-14T22:44:15.541276] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-14T22:44:15.543729] [INFO ] [MAIN ] Derivative Progress: 1799/1812 symbols completed. YUMC took 1.2s. Estimated remaining: 4.9s. Rate: 159.0 symbols/min [2025-10-14T22:44:15.557992] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:15.558637] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50789 primary records. [2025-10-14T22:44:15.558725] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-14T22:44:15.575083] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-14T22:44:15.575154] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-14T22:44:15.577316] [INFO ] [MAIN ] Derivative Progress: 1800/1812 symbols completed. ZBH took 1.2s. Estimated remaining: 4.5s. Rate: 159.1 symbols/min [2025-10-14T22:44:15.577697] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:15.577891] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:15.577802] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:15.606441] [DEBUG] [LOCAL ] ZH: Loaded 25441 existing records from primary storage. [2025-10-14T22:44:15.606663] [INFO ] [MAIN ] ZH: Loaded 25441 primary data records. [2025-10-14T22:44:15.785858] [DEBUG] [LOCAL ] ZGN: Loaded 40886 existing records from primary storage. [2025-10-14T22:44:15.823600] [INFO ] [MAIN ] ZGN: Loaded 40886 primary data records. [2025-10-14T22:44:15.923082] [DEBUG] [LOCAL ] ZETA: Loaded 53617 existing records from primary storage. [2025-10-14T22:44:16.074754] [INFO ] [MAIN ] ZETA: Loaded 53617 primary data records. [2025-10-14T22:44:16.750024] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:16.751376] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 25441 primary records. [2025-10-14T22:44:16.753290] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-14T22:44:16.802781] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-14T22:44:16.803436] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-14T22:44:16.805502] [INFO ] [MAIN ] Derivative Progress: 1801/1812 symbols completed. ZH took 1.2s. Estimated remaining: 4.2s. Rate: 158.9 symbols/min [2025-10-14T22:44:16.803354] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:16.806793] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40886 primary records. [2025-10-14T22:44:16.806969] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:16.807207] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-14T22:44:16.845786] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:16.847346] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53617 primary records. [2025-10-14T22:44:16.847735] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-14T22:44:16.861742] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-14T22:44:16.868001] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-14T22:44:16.873800] [INFO ] [MAIN ] Derivative Progress: 1802/1812 symbols completed. ZGN took 1.3s. Estimated remaining: 3.8s. Rate: 159.0 symbols/min [2025-10-14T22:44:16.874215] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:16.877040] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-14T22:44:16.877340] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-14T22:44:16.879681] [INFO ] [MAIN ] Derivative Progress: 1803/1812 symbols completed. ZETA took 1.3s. Estimated remaining: 3.4s. Rate: 159.1 symbols/min [2025-10-14T22:44:16.879959] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:16.956795] [DEBUG] [LOCAL ] ZIM: Loaded 53497 existing records from primary storage. [2025-10-14T22:44:16.957536] [INFO ] [MAIN ] ZIM: Loaded 53497 primary data records. [2025-10-14T22:44:17.058710] [DEBUG] [LOCAL ] ZK: Loaded 39048 existing records from primary storage. [2025-10-14T22:44:17.091069] [INFO ] [MAIN ] ZK: Loaded 39048 primary data records. [2025-10-14T22:44:17.178252] [DEBUG] [LOCAL ] ZIP: Loaded 43727 existing records from primary storage. [2025-10-14T22:44:17.220699] [INFO ] [MAIN ] ZIP: Loaded 43727 primary data records. [2025-10-14T22:44:18.085419] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:18.087229] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53497 primary records. [2025-10-14T22:44:18.087340] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-14T22:44:18.112715] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:18.114544] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39048 primary records. [2025-10-14T22:44:18.114908] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-14T22:44:18.129527] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-14T22:44:18.132290] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-14T22:44:18.136306] [INFO ] [MAIN ] Derivative Progress: 1804/1812 symbols completed. ZIM took 1.3s. Estimated remaining: 3.0s. Rate: 158.8 symbols/min [2025-10-14T22:44:18.136544] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:18.147002] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-14T22:44:18.152075] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-14T22:44:18.154182] [INFO ] [MAIN ] Derivative Progress: 1805/1812 symbols completed. ZK took 1.3s. Estimated remaining: 2.6s. Rate: 158.9 symbols/min [2025-10-14T22:44:18.154600] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:18.157428] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43727 primary records. [2025-10-14T22:44:18.156668] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:18.157555] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-14T22:44:18.173901] [DEBUG] [LOCAL ] ZKH: Loaded 7520 existing records from primary storage. [2025-10-14T22:44:18.174467] [INFO ] [MAIN ] ZKH: Loaded 7520 primary data records. [2025-10-14T22:44:18.263062] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-14T22:44:18.282375] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-14T22:44:18.288497] [INFO ] [MAIN ] Derivative Progress: 1806/1812 symbols completed. ZIP took 1.4s. Estimated remaining: 2.3s. Rate: 159.0 symbols/min [2025-10-14T22:44:18.289136] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:18.511444] [DEBUG] [LOCAL ] ZTO: Loaded 49503 existing records from primary storage. [2025-10-14T22:44:18.511600] [INFO ] [MAIN ] ZTO: Loaded 49503 primary data records. [2025-10-14T22:44:18.564134] [DEBUG] [LOCAL ] ZTR: Loaded 16762 existing records from primary storage. [2025-10-14T22:44:18.569573] [INFO ] [MAIN ] ZTR: Loaded 16762 primary data records. [2025-10-14T22:44:19.139248] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-14T22:44:19.140720] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7520 primary records. [2025-10-14T22:44:19.141048] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-14T22:44:19.158699] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-10-14T22:44:19.160998] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-14T22:44:19.163637] [INFO ] [MAIN ] Derivative Progress: 1807/1812 symbols completed. ZKH took 1.0s. Estimated remaining: 1.9s. Rate: 158.9 symbols/min [2025-10-14T22:44:19.164023] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:19.178801] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:19.179531] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49503 primary records. [2025-10-14T22:44:19.179634] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-14T22:44:19.211774] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:19.212629] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-14T22:44:19.212736] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-14T22:44:19.214733] [INFO ] [MAIN ] Derivative Progress: 1808/1812 symbols completed. ZTO took 1.1s. Estimated remaining: 1.5s. Rate: 158.9 symbols/min [2025-10-14T22:44:19.215910] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16762 primary records. [2025-10-14T22:44:19.216024] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:19.216207] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-14T22:44:19.232373] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-14T22:44:19.232565] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-14T22:44:19.234532] [INFO ] [MAIN ] Derivative Progress: 1809/1812 symbols completed. ZTR took 0.9s. Estimated remaining: 1.1s. Rate: 159.0 symbols/min [2025-10-14T22:44:19.234710] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-14T22:44:19.275197] [DEBUG] [LOCAL ] ZVIA: Loaded 35749 existing records from primary storage. [2025-10-14T22:44:19.290562] [INFO ] [MAIN ] ZVIA: Loaded 35749 primary data records. [2025-10-14T22:44:19.328442] [DEBUG] [LOCAL ] ZTS: Loaded 53127 existing records from primary storage. [2025-10-14T22:44:19.341122] [INFO ] [MAIN ] ZTS: Loaded 53127 primary data records. [2025-10-14T22:44:19.554874] [DEBUG] [LOCAL ] ZWS: Loaded 42346 existing records from primary storage. [2025-10-14T22:44:19.601126] [INFO ] [MAIN ] ZWS: Loaded 42346 primary data records. [2025-10-14T22:44:20.285670] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:20.286965] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35749 primary records. [2025-10-14T22:44:20.287139] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-14T22:44:20.313662] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:20.314754] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53127 primary records. [2025-10-14T22:44:20.315327] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-14T22:44:20.334893] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-14T22:44:20.335865] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-14T22:44:20.352151] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-14T22:44:20.351557] [INFO ] [MAIN ] Derivative Progress: 1810/1812 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.8s. Rate: 158.9 symbols/min [2025-10-14T22:44:20.352998] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42346 primary records. [2025-10-14T22:44:20.355135] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-14T22:44:20.355216] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-14T22:44:20.355075] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-14T22:44:20.357743] [INFO ] [MAIN ] Derivative Progress: 1811/1812 symbols completed. ZTS took 1.2s. Estimated remaining: 0.4s. Rate: 158.9 symbols/min [2025-10-14T22:44:20.372509] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-14T22:44:20.372576] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-14T22:44:20.374593] [INFO ] [MAIN ] Derivative Progress: 1812/1812 symbols completed. ZWS took 1.1s. Estimated remaining: 0.0s. Rate: 159.0 symbols/min [2025-10-14T22:44:20.375189] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 24s [2025-10-14T22:44:20.375258] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1812/1812 symbols) [2025-10-14T22:44:21.045366] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1812/1812 @ 100.00%)' [2025-10-14T22:44:21.045910] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-14T22:44:21.046961] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-14T22:44:21.047182] [INFO ] [STATE ] Last completion updated: 2025-10-14T22:44:21.047046